2023-11-26T06:58:58.725 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-26T06:58:58.725 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351 --name rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi --verbose --owner scheduled_rishabh@teuthology --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} -- /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351/orig.config.yaml 2023-11-26T06:58:58.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-26T06:58:58.855 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} email: null first_in_suite: false job_id: '7467351' kernel: client: branch: testing flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 44c2237fe77713214148c1fd622c872f346f1b99 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 44c2237fe77713214148c1fd622c872f346f1b99 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mgr-vol-misc sha1: 44c2237fe77713214148c1fd622c872f346f1b99 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1863 sha1: 44c2237fe77713214148c1fd622c872f346f1b99 sleep_before_teardown: 0 suite: fs:volumes suite_branch: rishabh-mgr-vol-misc suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 44c2237fe77713214148c1fd622c872f346f1b99 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM/ATFn2p0pwIyeNjWm72qoXq3rg+iTZFIlhhCYpbsSXLiPEAjkpLBV2LltLg0yO82BbJAWCERqN+lc6fA+6YA= smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4K/8XUKafj24hIFBgmXqB1H2JY1MwqMBlgBgCc2Ayt1MZFqLRuNcBu5kqkr9jddzcZxW06vijAfW0QJT5M9ZU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-26_06:51:12 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-26T06:58:58.855 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa; will attempt to use it 2023-11-26T06:58:58.856 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks 2023-11-26T06:58:58.856 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-26T06:58:58.858 INFO:teuthology.task.internal:Checking packages... 2023-11-26T06:58:58.880 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '44c2237fe77713214148c1fd622c872f346f1b99' 2023-11-26T06:58:58.881 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-26T06:58:58.881 INFO:teuthology.packaging:ref: None 2023-11-26T06:58:58.881 INFO:teuthology.packaging:tag: None 2023-11-26T06:58:58.881 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-26T06:58:58.881 INFO:teuthology.packaging:sha1: 44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T06:58:58.881 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-26T06:58:59.145 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484.g44c2237f 2023-11-26T06:58:59.145 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-26T06:58:59.153 INFO:teuthology.task.internal:no buildpackages task found 2023-11-26T06:58:59.154 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-26T06:58:59.200 INFO:teuthology.task.internal:Saving configuration 2023-11-26T06:58:59.217 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-26T06:58:59.235 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-26T06:58:59.258 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:37.499128', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM/ATFn2p0pwIyeNjWm72qoXq3rg+iTZFIlhhCYpbsSXLiPEAjkpLBV2LltLg0yO82BbJAWCERqN+lc6fA+6YA='} 2023-11-26T06:58:59.280 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:37.500664', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4K/8XUKafj24hIFBgmXqB1H2JY1MwqMBlgBgCc2Ayt1MZFqLRuNcBu5kqkr9jddzcZxW06vijAfW0QJT5M9ZU='} 2023-11-26T06:58:59.280 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-26T06:58:59.291 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-26T06:58:59.291 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-26T06:58:59.291 INFO:teuthology.run_tasks:Running task console_log... 2023-11-26T06:58:59.390 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4db52f8b80>, signals=[15]) 2023-11-26T06:58:59.390 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-26T06:58:59.402 INFO:teuthology.task.internal:Opening connections... 2023-11-26T06:58:59.402 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T06:58:59.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T06:58:59.485 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T06:58:59.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T06:58:59.568 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-26T06:58:59.580 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2023-11-26T06:58:59.596 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-11-26T06:58:59.596 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-11-26T06:58:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2023-11-26T06:58:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2023-11-26T06:58:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2023-11-26T06:58:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2023-11-26T06:58:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2023-11-26T06:58:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2023-11-26T06:58:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-26T06:58:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-11-26T06:58:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2023-11-26T06:58:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-26T06:58:59.653 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2023-11-26T06:58:59.653 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-26T06:58:59.653 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-26T06:58:59.653 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-26T06:58:59.653 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-11-26T06:58:59.671 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-11-26T06:58:59.688 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-11-26T06:58:59.689 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-11-26T06:58:59.745 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-26T06:58:59.746 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-26T06:58:59.746 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-26T06:58:59.746 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-11-26T06:58:59.763 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-26T06:58:59.774 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-26T06:58:59.801 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-26T06:58:59.801 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2023-11-26T06:58:59.803 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2023-11-26T06:58:59.819 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-26T06:58:59.830 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-26T06:58:59.830 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2023-11-26T06:58:59.860 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2023-11-26T06:58:59.958 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-26T06:59:00.019 INFO:teuthology.run_tasks:Running task kernel... 2023-11-26T06:59:00.038 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-26T06:59:00.039 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-11-26T06:59:00.039 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-26T06:59:00.039 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-26T06:59:00.040 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-26T06:59:00.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T06:59:00.056 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-11-26T06:59:00.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T06:59:00.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-11-26T06:59:00.210 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T06:59:00.210 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-26T06:59:00.210 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2023-11-26T06:59:00.227 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-361.el9.x86_64 2023-11-26T06:59:00.228 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T06:59:00.228 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-26T06:59:00.228 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum upgrade -y linux-firmware 2023-11-26T06:59:00.311 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T06:59:00.312 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-26T06:59:00.312 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2023-11-26T06:59:00.328 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-361.el9.x86_64 2023-11-26T06:59:00.329 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T06:59:00.329 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-26T06:59:00.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum upgrade -y linux-firmware 2023-11-26T06:59:02.565 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - AppStream 9.3 MB/s | 6.4 MB 00:00 2023-11-26T06:59:02.730 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS-9 - AppStream 9.5 MB/s | 6.4 MB 00:00 2023-11-26T06:59:04.073 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - BaseOS 4.3 MB/s | 2.0 MB 00:00 2023-11-26T06:59:04.239 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS-9 - BaseOS 4.3 MB/s | 2.0 MB 00:00 2023-11-26T06:59:06.097 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 7.9 MB 00:01 2023-11-26T06:59:08.731 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-11-26T06:59:08.804 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 7.9 MB 00:04 2023-11-26T06:59:13.199 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 5.8 MB 00:00 2023-11-26T06:59:14.883 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 15 kB 00:00 2023-11-26T06:59:16.653 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-11-26T06:59:21.459 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2023-11-26T06:59:23.889 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2023-11-26T06:59:23.903 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2023-11-26T06:59:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2023-11-26T06:59:23.903 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2023-11-26T06:59:23.903 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2023-11-26T06:59:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-26T06:59:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T06:59:23.904 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2023-11-26T06:59:23.904 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2023-11-26T06:59:23.904 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 1 Package 2023-11-26T06:59:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T06:59:23.904 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 328 M 2023-11-26T06:59:23.904 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2023-11-26T06:59:48.449 INFO:teuthology.orchestra.run.smithi159.stdout:linux-firmware-20231030-141.el9.noarch.rpm 13 MB/s | 328 MB 00:24 2023-11-26T06:59:48.450 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2023-11-26T06:59:48.450 INFO:teuthology.orchestra.run.smithi159.stdout:Total 13 MB/s | 328 MB 00:24 2023-11-26T06:59:48.451 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2023-11-26T06:59:48.549 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2023-11-26T06:59:48.549 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2023-11-26T06:59:50.693 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2023-11-26T06:59:50.693 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2023-11-26T06:59:56.520 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2023-11-26T06:59:56.898 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-26T06:59:56.988 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-26T06:59:57.591 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-26T06:59:57.591 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-26T06:59:57.990 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-26T06:59:57.990 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T06:59:57.990 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2023-11-26T06:59:57.990 INFO:teuthology.orchestra.run.smithi159.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-26T06:59:57.990 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T06:59:57.990 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2023-11-26T06:59:58.273 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-26T06:59:58.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T06:59:58.511 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-26T06:59:58.512 DEBUG:teuthology.orchestra.run.smithi159:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-26T06:59:58.515 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi159.front.sepia.ceph.com to complete... 2023-11-26T07:00:29.439 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 233 kB/s | 18 MB 01:19 2023-11-26T07:00:34.798 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 5.8 MB 00:01 2023-11-26T07:00:36.740 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 15 kB 00:00 2023-11-26T07:00:47.077 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 1.9 MB/s | 20 MB 00:10 2023-11-26T07:00:47.696 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26 07:00:47 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-26T07:00:47.696 INFO:teuthology.orchestra.run.smithi159.stderr:FINISHED --2023-11-26 07:00:47-- 2023-11-26T07:00:47.696 INFO:teuthology.orchestra.run.smithi159.stderr:Total wall clock time: 49s 2023-11-26T07:00:47.696 INFO:teuthology.orchestra.run.smithi159.stderr:Downloaded: 1 files, 306M in 49s (6.27 MB/s) 2023-11-26T07:00:47.698 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-26T07:00:47.698 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-26T07:00:49.541 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying... ######################################## 2023-11-26T07:00:49.636 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing... ######################################## 2023-11-26T07:00:49.715 INFO:teuthology.orchestra.run.smithi159.stdout:Updating / installing... 2023-11-26T07:00:51.791 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-11-26T07:00:54.175 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2023-11-26T07:00:54.186 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2023-11-26T07:00:54.186 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2023-11-26T07:00:54.186 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2023-11-26T07:00:54.186 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2023-11-26T07:00:54.186 INFO:teuthology.orchestra.run.smithi077.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-26T07:00:54.186 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:00:54.187 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2023-11-26T07:00:54.187 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2023-11-26T07:00:54.187 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 1 Package 2023-11-26T07:00:54.187 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:00:54.187 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 328 M 2023-11-26T07:00:54.187 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2023-11-26T07:00:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-26T07:01:03.401 INFO:teuthology.orchestra.run.smithi077.stdout:linux-firmware-20231030-141.el9.noarch.rpm 36 MB/s | 328 MB 00:09 2023-11-26T07:01:03.402 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2023-11-26T07:01:03.403 INFO:teuthology.orchestra.run.smithi077.stdout:Total 36 MB/s | 328 MB 00:09 2023-11-26T07:01:03.403 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2023-11-26T07:01:03.488 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2023-11-26T07:01:03.488 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2023-11-26T07:01:05.629 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2023-11-26T07:01:05.630 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2023-11-26T07:01:10.922 INFO:teuthology.orchestra.run.smithi159.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-26T07:01:11.159 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2023-11-26T07:01:11.625 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-26T07:01:11.698 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-26T07:01:12.507 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-26T07:01:12.507 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-26T07:01:12.846 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-26T07:01:12.846 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:01:12.847 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2023-11-26T07:01:12.847 INFO:teuthology.orchestra.run.smithi077.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-26T07:01:12.847 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:01:12.847 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2023-11-26T07:01:13.115 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-26T07:01:13.115 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T07:01:13.266 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-26T07:01:13.266 DEBUG:teuthology.orchestra.run.smithi077:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-26T07:01:13.269 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi077.front.sepia.ceph.com to complete... 2023-11-26T07:01:32.259 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-26T07:01:32.259 DEBUG:teuthology.orchestra.run.smithi159:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-26T07:01:32.324 INFO:teuthology.orchestra.run.smithi159.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-26T07:01:32.324 INFO:teuthology.orchestra.run.smithi159.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-26T07:01:32.324 INFO:teuthology.orchestra.run.smithi159.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-26T07:01:32.324 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-26T07:01:32.324 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-26T07:01:32.324 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-26T07:01:32.324 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-26T07:01:32.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-26T07:01:32.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-26T07:01:32.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-26T07:01:32.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-26T07:01:32.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-26T07:01:32.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-26T07:01:32.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-26T07:01:32.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-26T07:01:32.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-26T07:01:32.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-26T07:01:32.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-26T07:01:32.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-26T07:01:32.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-26T07:01:32.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-26T07:01:32.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-26T07:01:32.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-26T07:01:32.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-26T07:01:32.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-26T07:01:32.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-26T07:01:32.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-26T07:01:32.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-26T07:01:32.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-26T07:01:32.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-26T07:01:32.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-26T07:01:32.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-26T07:01:32.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-26T07:01:32.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-26T07:01:32.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-26T07:01:32.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-26T07:01:32.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-26T07:01:32.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-26T07:01:32.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-26T07:01:32.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-26T07:01:32.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-26T07:01:32.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-26T07:01:32.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-26T07:01:32.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-26T07:01:32.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-26T07:01:32.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-26T07:01:32.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-26T07:01:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-26T07:01:32.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-26T07:01:32.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-26T07:01:32.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-26T07:01:32.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-26T07:01:32.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-26T07:01:32.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-26T07:01:32.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-26T07:01:32.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-26T07:01:32.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-26T07:01:32.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-26T07:01:32.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-26T07:01:32.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-26T07:01:32.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-26T07:01:32.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-26T07:01:32.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-26T07:01:32.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-26T07:01:32.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-26T07:01:32.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-26T07:01:32.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-26T07:01:32.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-26T07:01:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-26T07:01:32.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-26T07:01:32.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-26T07:01:32.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-26T07:01:32.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-26T07:01:32.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-26T07:01:32.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-26T07:01:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-26T07:01:32.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-26T07:01:32.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-26T07:01:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-26T07:01:32.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-26T07:01:32.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-26T07:01:32.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-26T07:01:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-26T07:01:32.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-26T07:01:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-26T07:01:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-26T07:01:32.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-26T07:01:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-26T07:01:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-26T07:01:32.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-26T07:01:32.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-26T07:01:32.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-26T07:01:32.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-26T07:01:32.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-26T07:01:32.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-26T07:01:32.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-26T07:01:32.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-26T07:01:32.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-26T07:01:32.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-26T07:01:32.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-26T07:01:32.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-26T07:01:32.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-26T07:01:32.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-26T07:01:32.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-26T07:01:32.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-26T07:01:32.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-26T07:01:32.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-26T07:01:32.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-26T07:01:32.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-26T07:01:32.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-26T07:01:32.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-26T07:01:32.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-26T07:01:32.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-26T07:01:32.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-26T07:01:32.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-26T07:01:32.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-26T07:01:32.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-26T07:01:32.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-26T07:01:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-26T07:01:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-26T07:01:32.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-26T07:01:32.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-26T07:01:32.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-26T07:01:32.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-26T07:01:32.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-26T07:01:32.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-26T07:01:32.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-26T07:01:32.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-26T07:01:32.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-26T07:01:32.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-26T07:01:32.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-26T07:01:32.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-26T07:01:32.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-26T07:01:32.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-26T07:01:32.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-26T07:01:32.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-26T07:01:32.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-26T07:01:32.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-26T07:01:32.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-26T07:01:32.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-26T07:01:32.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-26T07:01:32.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-26T07:01:32.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-26T07:01:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-26T07:01:32.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-26T07:01:32.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-26T07:01:32.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-26T07:01:32.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-26T07:01:32.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-26T07:01:32.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-26T07:01:32.461 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-26T07:01:32.462 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-26T07:01:32.463 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-26T07:01:32.463 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-26T07:01:32.463 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-26T07:01:32.463 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-26T07:01:32.463 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-26T07:01:32.463 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-26T07:01:32.463 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-26T07:01:32.463 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-26T07:01:32.463 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-26T07:01:32.463 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-26T07:01:32.463 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-26T07:01:32.464 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-26T07:01:32.464 DEBUG:teuthology.orchestra.run.smithi159:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-26T07:01:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:postinstall scriptlet (using /bin/sh): 2023-11-26T07:01:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-26T07:01:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-26T07:01:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-26T07:01:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-26T07:01:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-26T07:01:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-26T07:01:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2023-11-26T07:01:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-26T07:01:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-26T07:01:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-26T07:01:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-26T07:01:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-26T07:01:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2023-11-26T07:01:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-26T07:01:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-26T07:01:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-26T07:01:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2023-11-26T07:01:32.488 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -qi grub2-tools 2023-11-26T07:01:32.563 INFO:teuthology.orchestra.run.smithi159.stdout:Name : grub2-tools 2023-11-26T07:01:32.563 INFO:teuthology.orchestra.run.smithi159.stdout:Epoch : 1 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Version : 2.06 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Release : 68.el9 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: x86_64 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Group : Unspecified 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Size : 8264254 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:License : GPLv3+ 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Packager : builder@centos.org 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Vendor : CentOS 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-26T07:01:32.564 INFO:teuthology.orchestra.run.smithi159.stdout:Summary : Support tools for GRUB. 2023-11-26T07:01:32.565 INFO:teuthology.orchestra.run.smithi159.stdout:Description : 2023-11-26T07:01:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:01:32.565 INFO:teuthology.orchestra.run.smithi159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-26T07:01:32.565 INFO:teuthology.orchestra.run.smithi159.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-26T07:01:32.565 INFO:teuthology.orchestra.run.smithi159.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-26T07:01:32.565 INFO:teuthology.orchestra.run.smithi159.stdout:hardware devices. 2023-11-26T07:01:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:01:32.565 INFO:teuthology.orchestra.run.smithi159.stdout:This subpackage provides tools for support of all platforms. 2023-11-26T07:01:32.566 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-26T07:01:32.566 INFO:teuthology.task.kernel:Updating grub on smithi159 to boot 6.6.0-g8247bbb5b470 2023-11-26T07:01:32.566 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-26T07:01:33.142 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2023-11-26T07:01:34.520 INFO:teuthology.orchestra.run.smithi159.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-26T07:01:34.550 INFO:teuthology.orchestra.run.smithi159.stderr:done 2023-11-26T07:01:34.551 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2023-11-26T07:01:34.566 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.0dJOJWJCXJ 2023-11-26T07:01:34.567 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0dJOJWJCXJ 2023-11-26T07:01:34.644 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.0dJOJWJCXJ 2023-11-26T07:01:34.780 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.0dJOJWJCXJ is 6KB 2023-11-26T07:01:34.800 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.0dJOJWJCXJ 2023-11-26T07:01:34.813 DEBUG:teuthology.orchestra.run.smithi159:> sudo /bin/ls /boot/loader/entries || true 2023-11-26T07:01:34.886 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-26T07:01:34.886 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-26T07:01:34.886 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-26T07:01:34.886 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-26T07:01:34.888 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-26T07:01:35.043 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2023-11-26T07:01:36.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26 07:01:36 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-26T07:01:36.744 INFO:teuthology.orchestra.run.smithi077.stderr:FINISHED --2023-11-26 07:01:36-- 2023-11-26T07:01:36.744 INFO:teuthology.orchestra.run.smithi077.stderr:Total wall clock time: 23s 2023-11-26T07:01:36.744 INFO:teuthology.orchestra.run.smithi077.stderr:Downloaded: 1 files, 306M in 23s (13.3 MB/s) 2023-11-26T07:01:36.745 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-26T07:01:36.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-26T07:01:38.586 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying... ######################################## 2023-11-26T07:01:38.634 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing... ######################################## 2023-11-26T07:01:38.712 INFO:teuthology.orchestra.run.smithi077.stdout:Updating / installing... 2023-11-26T07:01:45.786 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-26T07:02:00.936 INFO:teuthology.orchestra.run.smithi077.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-26T07:02:05.045 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-26T07:02:05.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-26T07:02:05.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:02:22.185 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi077.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-26T07:02:22.185 DEBUG:teuthology.orchestra.run.smithi077:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-26T07:02:22.253 INFO:teuthology.orchestra.run.smithi077.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-26T07:02:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-26T07:02:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-26T07:02:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-26T07:02:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-26T07:02:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-26T07:02:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-26T07:02:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-26T07:02:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-26T07:02:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-26T07:02:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-26T07:02:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-26T07:02:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-26T07:02:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-26T07:02:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-26T07:02:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-26T07:02:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-26T07:02:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-26T07:02:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-26T07:02:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-26T07:02:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-26T07:02:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-26T07:02:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-26T07:02:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-26T07:02:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-26T07:02:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-26T07:02:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-26T07:02:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-26T07:02:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-26T07:02:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-26T07:02:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-26T07:02:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-26T07:02:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-26T07:02:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-26T07:02:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-26T07:02:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-26T07:02:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-26T07:02:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-26T07:02:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-26T07:02:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-26T07:02:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-26T07:02:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-26T07:02:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-26T07:02:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-26T07:02:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-26T07:02:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-26T07:02:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-26T07:02:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-26T07:02:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-26T07:02:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-26T07:02:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-26T07:02:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-26T07:02:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-26T07:02:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-26T07:02:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-26T07:02:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-26T07:02:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-26T07:02:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-26T07:02:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-26T07:02:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-26T07:02:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-26T07:02:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-26T07:02:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-26T07:02:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-26T07:02:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-26T07:02:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-26T07:02:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-26T07:02:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-26T07:02:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-26T07:02:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-26T07:02:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-26T07:02:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-26T07:02:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-26T07:02:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-26T07:02:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-26T07:02:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-26T07:02:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-26T07:02:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-26T07:02:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-26T07:02:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-26T07:02:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-26T07:02:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-26T07:02:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-26T07:02:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-26T07:02:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-26T07:02:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-26T07:02:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-26T07:02:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-26T07:02:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-26T07:02:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-26T07:02:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-26T07:02:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-26T07:02:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-26T07:02:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-26T07:02:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-26T07:02:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-26T07:02:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-26T07:02:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-26T07:02:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-26T07:02:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-26T07:02:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-26T07:02:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-26T07:02:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-26T07:02:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-26T07:02:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-26T07:02:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-26T07:02:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-26T07:02:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-26T07:02:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-26T07:02:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-26T07:02:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-26T07:02:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-26T07:02:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-26T07:02:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-26T07:02:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-26T07:02:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-26T07:02:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-26T07:02:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-26T07:02:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-26T07:02:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-26T07:02:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-26T07:02:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-26T07:02:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-26T07:02:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-26T07:02:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-26T07:02:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-26T07:02:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-26T07:02:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-26T07:02:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-26T07:02:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-26T07:02:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-26T07:02:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-26T07:02:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-26T07:02:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-26T07:02:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-26T07:02:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-26T07:02:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-26T07:02:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-26T07:02:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-26T07:02:22.382 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-26T07:02:22.382 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-26T07:02:22.382 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-26T07:02:22.382 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-26T07:02:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-26T07:02:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-26T07:02:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-26T07:02:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-26T07:02:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-26T07:02:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-26T07:02:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-26T07:02:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-26T07:02:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-26T07:02:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-26T07:02:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-26T07:02:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-26T07:02:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-26T07:02:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-26T07:02:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-26T07:02:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-26T07:02:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-26T07:02:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-26T07:02:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-26T07:02:22.392 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-26T07:02:22.392 INFO:teuthology.orchestra.run.smithi077.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-26T07:02:22.392 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-26T07:02:22.392 DEBUG:teuthology.orchestra.run.smithi077:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-26T07:02:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:postinstall scriptlet (using /bin/sh): 2023-11-26T07:02:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-26T07:02:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-26T07:02:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-26T07:02:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-26T07:02:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-26T07:02:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-26T07:02:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:fi 2023-11-26T07:02:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-26T07:02:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-26T07:02:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-26T07:02:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-26T07:02:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-26T07:02:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:fi 2023-11-26T07:02:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-26T07:02:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-26T07:02:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-26T07:02:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:fi 2023-11-26T07:02:22.417 DEBUG:teuthology.orchestra.run.smithi077:> sudo rpm -qi grub2-tools 2023-11-26T07:02:22.492 INFO:teuthology.orchestra.run.smithi077.stdout:Name : grub2-tools 2023-11-26T07:02:22.492 INFO:teuthology.orchestra.run.smithi077.stdout:Epoch : 1 2023-11-26T07:02:22.492 INFO:teuthology.orchestra.run.smithi077.stdout:Version : 2.06 2023-11-26T07:02:22.492 INFO:teuthology.orchestra.run.smithi077.stdout:Release : 68.el9 2023-11-26T07:02:22.492 INFO:teuthology.orchestra.run.smithi077.stdout:Architecture: x86_64 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:Group : Unspecified 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:Size : 8264254 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:License : GPLv3+ 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:Packager : builder@centos.org 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:Vendor : CentOS 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:Summary : Support tools for GRUB. 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:Description : 2023-11-26T07:02:22.493 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:02:22.494 INFO:teuthology.orchestra.run.smithi077.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-26T07:02:22.494 INFO:teuthology.orchestra.run.smithi077.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-26T07:02:22.494 INFO:teuthology.orchestra.run.smithi077.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-26T07:02:22.494 INFO:teuthology.orchestra.run.smithi077.stdout:hardware devices. 2023-11-26T07:02:22.494 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:02:22.494 INFO:teuthology.orchestra.run.smithi077.stdout:This subpackage provides tools for support of all platforms. 2023-11-26T07:02:22.495 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-26T07:02:22.495 INFO:teuthology.task.kernel:Updating grub on smithi077 to boot 6.6.0-g8247bbb5b470 2023-11-26T07:02:22.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-26T07:02:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2023-11-26T07:02:23.586 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-26T07:02:24.460 INFO:teuthology.orchestra.run.smithi077.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-26T07:02:24.487 INFO:teuthology.orchestra.run.smithi077.stderr:done 2023-11-26T07:02:24.489 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2023-11-26T07:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.kwzihOL6Cr 2023-11-26T07:02:24.504 DEBUG:teuthology.orchestra.run.smithi077:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kwzihOL6Cr 2023-11-26T07:02:24.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.kwzihOL6Cr 2023-11-26T07:02:24.725 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.kwzihOL6Cr is 6KB 2023-11-26T07:02:24.774 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.kwzihOL6Cr 2023-11-26T07:02:24.788 DEBUG:teuthology.orchestra.run.smithi077:> sudo /bin/ls /boot/loader/entries || true 2023-11-26T07:02:24.852 INFO:teuthology.orchestra.run.smithi077.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-26T07:02:24.853 INFO:teuthology.orchestra.run.smithi077.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-26T07:02:24.853 INFO:teuthology.orchestra.run.smithi077.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-26T07:02:24.853 INFO:teuthology.orchestra.run.smithi077.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-26T07:02:24.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-26T07:02:24.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo shutdown -r now 2023-11-26T07:02:32.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-26T07:02:32.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:02:35.650 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-26T07:02:47.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-26T07:02:47.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:02:55.003 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-26T07:02:55.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-26T07:02:55.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:03:13.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-11-26T07:03:22.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-26T07:03:22.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:03:47.684 DEBUG:teuthology.orchestra.remote:timed out 2023-11-26T07:04:02.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-26T07:04:02.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:04:03.102 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-11-26T07:04:03.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-26T07:04:03.729 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-11-26T07:04:03.729 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2023-11-26T07:04:03.783 INFO:teuthology.orchestra.run.smithi159.stdout:6.6.0-g8247bbb5b470 2023-11-26T07:04:03.783 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-26T07:04:03.783 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-26T07:04:03.783 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-26T07:04:04.785 DEBUG:teuthology.parallel:result is None 2023-11-26T07:04:22.517 DEBUG:teuthology.orchestra.remote:timed out 2023-11-26T07:04:34.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-26T07:04:34.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:04:34.889 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-11-26T07:04:35.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-26T07:04:35.580 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-26T07:04:35.580 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2023-11-26T07:04:35.632 INFO:teuthology.orchestra.run.smithi077.stdout:6.6.0-g8247bbb5b470 2023-11-26T07:04:35.632 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-26T07:04:35.632 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-26T07:04:35.632 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-26T07:04:36.633 DEBUG:teuthology.parallel:result is None 2023-11-26T07:04:36.633 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-26T07:04:36.641 INFO:teuthology.task.internal:Creating test directory... 2023-11-26T07:04:36.641 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-26T07:04:36.650 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-26T07:04:36.708 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-26T07:04:36.716 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-26T07:04:36.744 INFO:teuthology.task.internal:Creating archive directory... 2023-11-26T07:04:36.744 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-26T07:04:36.753 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-26T07:04:36.839 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-26T07:04:36.847 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-26T07:04:36.848 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-26T07:04:36.856 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-26T07:04:36.980 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T07:04:37.039 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T07:04:37.048 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T07:04:37.120 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T07:04:37.124 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-26T07:04:37.131 INFO:teuthology.task.internal:Configuring sudo... 2023-11-26T07:04:37.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-26T07:04:37.140 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-26T07:04:37.239 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-26T07:04:37.248 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-26T07:04:37.249 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-26T07:04:37.254 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-26T07:04:37.310 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-26T07:04:37.392 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-26T07:04:37.517 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-26T07:04:37.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-26T07:04:37.704 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:04:37.704 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-26T07:04:37.801 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-26T07:04:37.890 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-26T07:04:38.002 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-26T07:04:38.082 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-26T07:04:38.167 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:04:38.167 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-26T07:04:38.263 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2023-11-26T07:04:38.272 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2023-11-26T07:04:38.392 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-26T07:04:38.447 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-26T07:04:38.757 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-26T07:04:38.769 INFO:teuthology.task.internal:Starting timer... 2023-11-26T07:04:38.769 INFO:teuthology.run_tasks:Running task pcp... 2023-11-26T07:04:38.833 INFO:teuthology.run_tasks:Running task selinux... 2023-11-26T07:04:38.865 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2023-11-26T07:04:39.006 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2023-11-26T07:04:39.010 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2023-11-26T07:04:39.141 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2023-11-26T07:04:39.145 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-26T07:04:39.145 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2023-11-26T07:04:39.211 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2023-11-26T07:04:39.212 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2023-11-26T07:04:39.268 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2023-11-26T07:04:39.269 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi159.front.sepia.ceph.com': 'permissive'} 2023-11-26T07:04:39.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-26T07:04:39.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:04:39.369 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-26T07:04:39.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:04:39.468 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-26T07:04:39.468 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2023-11-26T07:04:39.592 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2023-11-26T07:04:39.708 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-26T07:04:39.720 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-26T07:04:39.720 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-26T07:04:39.736 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-26T07:04:39.737 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-26T07:14:30.101 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com')] 2023-11-26T07:14:30.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-26T07:14:30.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:14:30.238 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-11-26T07:14:30.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-26T07:14:30.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-26T07:14:30.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:14:30.525 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-11-26T07:14:30.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-26T07:14:30.674 INFO:teuthology.run_tasks:Running task clock... 2023-11-26T07:14:30.684 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-26T07:14:30.684 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-26T07:14:30.685 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:14:30.694 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-26T07:14:30.694 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:14:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-26T07:14:30.794 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-26T07:14:30.839 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-26T07:14:30.845 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-26T07:14:30.932 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2023-11-26T07:14:30.937 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2023-11-26T07:14:30.974 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2023-11-26T07:14:30.978 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2023-11-26T07:14:31.027 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-26T07:14:31.028 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-26T07:14:31.079 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-26T07:14:31.083 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-26T07:14:31.202 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2023-11-26T07:14:31.209 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2023-11-26T07:14:31.210 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-26T07:14:31.210 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2023-11-26T07:14:31.210 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:14:31.210 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:14:31.210 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:14:31.210 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:14:31.217 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-26T07:14:31.217 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2023-11-26T07:14:31.217 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:14:31.217 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:14:31.217 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:14:31.218 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:14:31.219 INFO:teuthology.run_tasks:Running task install... 2023-11-26T07:14:31.228 DEBUG:teuthology.task.install:project ceph 2023-11-26T07:14:31.228 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}} 2023-11-26T07:14:31.228 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'} 2023-11-26T07:14:31.228 INFO:teuthology.task.install:Using flavor: default 2023-11-26T07:14:31.234 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-26T07:14:31.234 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-26T07:14:31.234 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'tag': None, 'wait_for_package': False} 2023-11-26T07:14:31.235 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:14:31.236 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'tag': None, 'wait_for_package': False} 2023-11-26T07:14:31.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:14:31.383 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/9/flavors/default/ 2023-11-26T07:14:31.383 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.g44c2237f 2023-11-26T07:14:31.461 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/9/flavors/default/ 2023-11-26T07:14:31.461 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.g44c2237f 2023-11-26T07:14:31.556 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-26T07:14:31.556 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:14:31.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-26T07:14:31.628 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-26T07:14:31.628 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:14:31.628 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-26T07:14:31.660 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-26T07:14:31.660 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/44c2237fe77713214148c1fd622c872f346f1b99/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-26T07:14:31.728 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-26T07:14:31.729 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/44c2237fe77713214148c1fd622c872f346f1b99/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-26T07:14:31.801 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-26T07:14:31.869 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-26T07:14:31.933 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-26T07:14:32.009 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-26T07:14:32.017 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2023-11-26T07:14:32.021 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2023-11-26T07:14:32.100 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2023-11-26T07:14:32.104 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2023-11-26T07:14:32.394 INFO:teuthology.orchestra.run.smithi077.stdout:73 files removed 2023-11-26T07:14:32.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-26T07:14:32.469 INFO:teuthology.orchestra.run.smithi159.stdout:73 files removed 2023-11-26T07:14:32.506 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-26T07:14:33.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 158 kB/s | 78 kB 00:00 2023-11-26T07:14:33.548 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 144 kB/s | 78 kB 00:00 2023-11-26T07:14:34.056 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2023-11-26T07:14:34.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 18 kB/s | 9.5 kB 00:00 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2023-11-26T07:14:34.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2023-11-26T07:14:35.160 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-11-26T07:14:35.229 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-11-26T07:14:36.685 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.0 MB 00:00 2023-11-26T07:14:36.837 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2023-11-26T07:14:37.967 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-11-26T07:14:38.863 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 7.9 MB 00:01 2023-11-26T07:14:40.068 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 21 MB/s | 18 MB 00:00 2023-11-26T07:14:41.717 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-11-26T07:14:45.911 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 5.8 MB 00:02 2023-11-26T07:14:46.683 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 5.8 MB 00:01 2023-11-26T07:14:48.474 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 15 kB 00:00 2023-11-26T07:14:48.761 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 9.9 kB/s | 15 kB 00:01 2023-11-26T07:14:49.460 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2023-11-26T07:14:50.005 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2023-11-26T07:14:55.143 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-11-26T07:14:55.664 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-11-26T07:14:58.027 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-26T07:14:58.029 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-26T07:14:58.048 INFO:teuthology.orchestra.run.smithi159.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-26T07:14:58.049 INFO:teuthology.orchestra.run.smithi159.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-26T07:14:58.050 INFO:teuthology.orchestra.run.smithi159.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-26T07:14:58.052 INFO:teuthology.orchestra.run.smithi159.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-26T07:14:58.054 INFO:teuthology.orchestra.run.smithi159.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-26T07:14:58.058 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-26T07:14:58.059 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-26T07:14:58.140 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2023-11-26T07:14:58.156 INFO:teuthology.orchestra.run.smithi159.stdout:============================================================================================ 2023-11-26T07:14:58.156 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2023-11-26T07:14:58.156 INFO:teuthology.orchestra.run.smithi159.stdout:============================================================================================ 2023-11-26T07:14:58.156 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2023-11-26T07:14:58.156 INFO:teuthology.orchestra.run.smithi159.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-26T07:14:58.156 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 6.5 k 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 5.2 M 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 860 k 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 141 k 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 1.5 M 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 133 k 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 1.8 M 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 7.4 M 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 50 k 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 8.6 M 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 41 M 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 262 k 2023-11-26T07:14:58.157 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 774 k 2023-11-26T07:14:58.158 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 217 k 2023-11-26T07:14:58.158 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 18 k 2023-11-26T07:14:58.158 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-26T07:14:58.158 INFO:teuthology.orchestra.run.smithi159.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-26T07:14:58.158 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-26T07:14:58.158 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 31 k 2023-11-26T07:14:58.158 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 719 k 2023-11-26T07:14:58.158 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 127 k 2023-11-26T07:14:58.158 INFO:teuthology.orchestra.run.smithi159.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-26T07:14:58.158 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-26T07:14:58.158 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 162 k 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 320 k 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 299 k 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 99 k 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 85 k 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 3.0 M 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 170 k 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2023-11-26T07:14:58.159 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 3.3 M 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 3.0 M 2023-11-26T07:14:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 19 M 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 28 k 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 2.1 M 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 243 k 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 4.4 M 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 18 M 2023-11-26T07:14:58.161 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 15 k 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 24 k 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 163 k 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-26T07:14:58.162 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 475 k 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 4.8 M 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-26T07:14:58.163 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 45 k 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 129 k 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-26T07:14:58.164 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-26T07:14:58.165 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-26T07:14:58.166 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-26T07:14:58.167 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout:Installing weak dependencies: 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:14:58.168 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2023-11-26T07:14:58.169 INFO:teuthology.orchestra.run.smithi159.stdout:============================================================================================ 2023-11-26T07:14:58.169 INFO:teuthology.orchestra.run.smithi159.stdout:Install 132 Packages 2023-11-26T07:14:58.169 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 15 Packages 2023-11-26T07:14:58.169 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:14:58.169 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 204 M 2023-11-26T07:14:58.169 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2023-11-26T07:14:58.555 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-26T07:14:58.557 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-26T07:14:58.579 INFO:teuthology.orchestra.run.smithi077.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-26T07:14:58.580 INFO:teuthology.orchestra.run.smithi077.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-26T07:14:58.582 INFO:teuthology.orchestra.run.smithi077.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-26T07:14:58.583 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-26T07:14:58.586 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-26T07:14:58.590 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-26T07:14:58.591 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-26T07:14:58.668 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2023-11-26T07:14:58.692 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================================ 2023-11-26T07:14:58.692 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2023-11-26T07:14:58.692 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================================ 2023-11-26T07:14:58.692 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2023-11-26T07:14:58.692 INFO:teuthology.orchestra.run.smithi077.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-26T07:14:58.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 6.5 k 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 5.2 M 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 860 k 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 141 k 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 1.5 M 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 133 k 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 1.8 M 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 7.4 M 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 50 k 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 8.6 M 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 41 M 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 262 k 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 774 k 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 217 k 2023-11-26T07:14:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 18 k 2023-11-26T07:14:58.694 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-26T07:14:58.694 INFO:teuthology.orchestra.run.smithi077.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-26T07:14:58.694 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-26T07:14:58.694 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 31 k 2023-11-26T07:14:58.694 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 719 k 2023-11-26T07:14:58.694 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 127 k 2023-11-26T07:14:58.694 INFO:teuthology.orchestra.run.smithi077.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-26T07:14:58.694 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-26T07:14:58.694 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-26T07:14:58.694 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 162 k 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 320 k 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 299 k 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 99 k 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 85 k 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 3.0 M 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 170 k 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2023-11-26T07:14:58.695 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-26T07:14:58.696 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-26T07:14:58.696 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-26T07:14:58.696 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-26T07:14:58.696 INFO:teuthology.orchestra.run.smithi077.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-26T07:14:58.696 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-26T07:14:58.696 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-26T07:14:58.696 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-26T07:14:58.696 INFO:teuthology.orchestra.run.smithi077.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-26T07:14:58.696 INFO:teuthology.orchestra.run.smithi077.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-26T07:14:58.696 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 3.3 M 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 3.0 M 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 19 M 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 28 k 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 2.1 M 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 243 k 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 4.4 M 2023-11-26T07:14:58.697 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 18 M 2023-11-26T07:14:58.698 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.g44c2237f.el9 ceph-noarch 15 k 2023-11-26T07:14:58.698 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 24 k 2023-11-26T07:14:58.698 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-26T07:14:58.698 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-26T07:14:58.698 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-26T07:14:58.698 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-26T07:14:58.698 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-26T07:14:58.698 INFO:teuthology.orchestra.run.smithi077.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-26T07:14:58.698 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-26T07:14:58.698 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-26T07:14:58.698 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 163 k 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 475 k 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 4.8 M 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-26T07:14:58.699 INFO:teuthology.orchestra.run.smithi077.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 45 k 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:18.0.0-7484.g44c2237f.el9 ceph 129 k 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-26T07:14:58.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-26T07:14:58.701 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-26T07:14:58.702 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-26T07:14:58.703 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-26T07:14:58.704 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-26T07:14:58.705 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2023-11-26T07:14:58.705 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-26T07:14:58.705 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:14:58.705 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2023-11-26T07:14:58.705 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================================ 2023-11-26T07:14:58.705 INFO:teuthology.orchestra.run.smithi077.stdout:Install 132 Packages 2023-11-26T07:14:58.705 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 15 Packages 2023-11-26T07:14:58.705 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:14:58.706 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 204 M 2023-11-26T07:14:58.706 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2023-11-26T07:14:59.094 INFO:teuthology.orchestra.run.smithi159.stdout:(1/147): ceph-18.0.0-7484.g44c2237f.el9.x86_64. 20 kB/s | 6.5 kB 00:00 2023-11-26T07:14:59.395 INFO:teuthology.orchestra.run.smithi159.stdout:(2/147): ceph-base-18.0.0-7484.g44c2237f.el9.x8 8.4 MB/s | 5.2 MB 00:00 2023-11-26T07:14:59.437 INFO:teuthology.orchestra.run.smithi159.stdout:(3/147): ceph-immutable-object-cache-18.0.0-748 3.4 MB/s | 141 kB 00:00 2023-11-26T07:14:59.587 INFO:teuthology.orchestra.run.smithi159.stdout:(4/147): ceph-mds-18.0.0-7484.g44c2237f.el9.x86 14 MB/s | 2.1 MB 00:00 2023-11-26T07:14:59.704 INFO:teuthology.orchestra.run.smithi159.stdout:(5/147): ceph-mgr-18.0.0-7484.g44c2237f.el9.x86 13 MB/s | 1.5 MB 00:00 2023-11-26T07:14:59.706 INFO:teuthology.orchestra.run.smithi077.stdout:(1/147): ceph-18.0.0-7484.g44c2237f.el9.x86_64. 22 kB/s | 6.5 kB 00:00 2023-11-26T07:14:59.762 INFO:teuthology.orchestra.run.smithi159.stdout:(6/147): ceph-fuse-18.0.0-7484.g44c2237f.el9.x8 1.3 MB/s | 860 kB 00:00 2023-11-26T07:14:59.996 INFO:teuthology.orchestra.run.smithi159.stdout:(7/147): ceph-mon-18.0.0-7484.g44c2237f.el9.x86 15 MB/s | 4.4 MB 00:00 2023-11-26T07:15:00.282 INFO:teuthology.orchestra.run.smithi077.stdout:(2/147): ceph-fuse-18.0.0-7484.g44c2237f.el9.x8 1.5 MB/s | 860 kB 00:00 2023-11-26T07:15:00.457 INFO:teuthology.orchestra.run.smithi077.stdout:(3/147): ceph-immutable-object-cache-18.0.0-748 812 kB/s | 141 kB 00:00 2023-11-26T07:15:00.621 INFO:teuthology.orchestra.run.smithi159.stdout:(8/147): ceph-radosgw-18.0.0-7484.g44c2237f.el9 14 MB/s | 8.6 MB 00:00 2023-11-26T07:15:00.679 INFO:teuthology.orchestra.run.smithi159.stdout:(9/147): ceph-selinux-18.0.0-7484.g44c2237f.el9 420 kB/s | 24 kB 00:00 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi077.stdout:(4/147): ceph-base-18.0.0-7484.g44c2237f.el9.x8 3.8 MB/s | 5.2 MB 00:01 2023-11-26T07:15:01.341 INFO:teuthology.orchestra.run.smithi077.stdout:(5/147): ceph-mgr-18.0.0-7484.g44c2237f.el9.x86 2.6 MB/s | 1.5 MB 00:00 2023-11-26T07:15:01.741 INFO:teuthology.orchestra.run.smithi077.stdout:(6/147): ceph-mds-18.0.0-7484.g44c2237f.el9.x86 1.6 MB/s | 2.1 MB 00:01 2023-11-26T07:15:02.925 INFO:teuthology.orchestra.run.smithi077.stdout:(7/147): ceph-mon-18.0.0-7484.g44c2237f.el9.x86 2.8 MB/s | 4.4 MB 00:01 2023-11-26T07:15:03.716 INFO:teuthology.orchestra.run.smithi077.stdout:(8/147): ceph-common-18.0.0-7484.g44c2237f.el9. 4.4 MB/s | 19 MB 00:04 2023-11-26T07:15:08.165 INFO:teuthology.orchestra.run.smithi077.stdout:(9/147): ceph-selinux-18.0.0-7484.g44c2237f.el9 293 kB/s | 24 kB 00:00 2023-11-26T07:15:08.165 INFO:teuthology.orchestra.run.smithi077.stdout:(10/147): ceph-radosgw-18.0.0-7484.g44c2237f.el 4.0 MB/s | 8.6 MB 00:02 2023-11-26T07:15:08.165 INFO:teuthology.orchestra.run.smithi077.stdout:(11/147): cephfs-mirror-18.0.0-7484.g44c2237f.e 2.1 MB/s | 217 kB 00:00 2023-11-26T07:15:08.165 INFO:teuthology.orchestra.run.smithi077.stdout:(12/147): libcephfs-devel-18.0.0-7484.g44c2237f 635 kB/s | 31 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(13/147): libcephfs2-18.0.0-7484.g44c2237f.el9. 3.4 MB/s | 719 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(14/147): libcephsqlite-18.0.0-7484.g44c2237f.e 2.8 MB/s | 163 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(15/147): librados-devel-18.0.0-7484.g44c2237f. 956 kB/s | 127 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(16/147): libradosstriper1-18.0.0-7484.g44c2237 2.3 MB/s | 475 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(17/147): librgw2-18.0.0-7484.g44c2237f.el9.x86 6.0 MB/s | 4.8 MB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(18/147): python3-ceph-argparse-18.0.0-7484.g44 789 kB/s | 45 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(19/147): python3-ceph-common-18.0.0-7484.g44c2 1.7 MB/s | 129 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(20/147): python3-cephfs-18.0.0-7484.g44c2237f. 2.7 MB/s | 162 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(21/147): python3-rados-18.0.0-7484.g44c2237f.e 3.2 MB/s | 320 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(22/147): python3-rbd-18.0.0-7484.g44c2237f.el9 2.4 MB/s | 299 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(23/147): python3-rgw-18.0.0-7484.g44c2237f.el9 2.0 MB/s | 99 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(24/147): rbd-fuse-18.0.0-7484.g44c2237f.el9.x8 1.4 MB/s | 85 kB 00:00 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(25/147): ceph-osd-18.0.0-7484.g44c2237f.el9.x8 3.0 MB/s | 18 MB 00:05 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:(26/147): rbd-mirror-18.0.0-7484.g44c2237f.el9. 4.3 MB/s | 3.0 MB 00:00 2023-11-26T07:15:08.167 INFO:teuthology.orchestra.run.smithi077.stdout:(27/147): rbd-nbd-18.0.0-7484.g44c2237f.el9.x86 682 kB/s | 170 kB 00:00 2023-11-26T07:15:08.167 INFO:teuthology.orchestra.run.smithi077.stdout:(28/147): ceph-grafana-dashboards-18.0.0-7484.g 568 kB/s | 28 kB 00:00 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi159.stdout:(10/147): ceph-test-18.0.0-7484.g44c2237f.el9.x 13 MB/s | 41 MB 00:03 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi159.stdout:(11/147): cephfs-mirror-18.0.0-7484.g44c2237f.e 3.2 MB/s | 217 kB 00:00 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi159.stdout:(12/147): libcephfs-devel-18.0.0-7484.g44c2237f 476 kB/s | 31 kB 00:00 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi159.stdout:(13/147): libcephfs2-18.0.0-7484.g44c2237f.el9. 5.0 MB/s | 719 kB 00:00 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi159.stdout:(14/147): libcephsqlite-18.0.0-7484.g44c2237f.e 1.7 MB/s | 163 kB 00:00 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi159.stdout:(15/147): librados-devel-18.0.0-7484.g44c2237f. 1.6 MB/s | 127 kB 00:00 2023-11-26T07:15:08.170 INFO:teuthology.orchestra.run.smithi159.stdout:(16/147): libradosstriper1-18.0.0-7484.g44c2237 5.6 MB/s | 475 kB 00:00 2023-11-26T07:15:08.170 INFO:teuthology.orchestra.run.smithi159.stdout:(17/147): librgw2-18.0.0-7484.g44c2237f.el9.x86 9.0 MB/s | 4.8 MB 00:00 2023-11-26T07:15:08.170 INFO:teuthology.orchestra.run.smithi159.stdout:(18/147): python3-ceph-argparse-18.0.0-7484.g44 923 kB/s | 45 kB 00:00 2023-11-26T07:15:08.170 INFO:teuthology.orchestra.run.smithi159.stdout:(19/147): python3-ceph-common-18.0.0-7484.g44c2 1.7 MB/s | 129 kB 00:00 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(20/147): python3-cephfs-18.0.0-7484.g44c2237f. 2.7 MB/s | 162 kB 00:00 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(21/147): python3-rados-18.0.0-7484.g44c2237f.e 4.2 MB/s | 320 kB 00:00 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(22/147): python3-rbd-18.0.0-7484.g44c2237f.el9 2.9 MB/s | 299 kB 00:00 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(23/147): python3-rgw-18.0.0-7484.g44c2237f.el9 1.7 MB/s | 99 kB 00:00 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(24/147): rbd-fuse-18.0.0-7484.g44c2237f.el9.x8 1.7 MB/s | 85 kB 00:00 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(25/147): rbd-mirror-18.0.0-7484.g44c2237f.el9. 9.8 MB/s | 3.0 MB 00:00 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(26/147): ceph-common-18.0.0-7484.g44c2237f.el9 2.6 MB/s | 19 MB 00:07 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(27/147): rbd-nbd-18.0.0-7484.g44c2237f.el9.x86 620 kB/s | 170 kB 00:00 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(28/147): ceph-grafana-dashboards-18.0.0-7484.g 427 kB/s | 28 kB 00:00 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(29/147): ceph-osd-18.0.0-7484.g44c2237f.el9.x8 2.7 MB/s | 18 MB 00:06 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(30/147): ceph-mgr-cephadm-18.0.0-7484.g44c2237 408 kB/s | 133 kB 00:00 2023-11-26T07:15:08.194 INFO:teuthology.orchestra.run.smithi159.stdout:(31/147): ceph-mgr-modules-core-18.0.0-7484.g44 3.6 MB/s | 243 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(32/147): ceph-mgr-rook-18.0.0-7484.g44c2237f.e 870 kB/s | 50 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(33/147): ceph-prometheus-alerts-18.0.0-7484.g4 264 kB/s | 15 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(34/147): ceph-volume-18.0.0-7484.g44c2237f.el9 4.5 MB/s | 262 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(35/147): ceph-mgr-dashboard-18.0.0-7484.g44c22 2.8 MB/s | 1.8 MB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(36/147): cephadm-18.0.0-7484.g44c2237f.el9.noa 5.0 MB/s | 774 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(37/147): cephfs-top-18.0.0-7484.g44c2237f.el9. 239 kB/s | 18 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(38/147): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 662 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(39/147): boost-program-options-1.75.0-8.el9.x8 3.3 MB/s | 106 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(40/147): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 920 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(41/147): elfutils-libelf-devel-0.190-1.el9.x86 329 kB/s | 21 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(42/147): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 673 kB/s | 32 kB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(44/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2023-11-26T07:15:08.195 INFO:teuthology.orchestra.run.smithi159.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 151 kB/s | 17 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(46/147): libaio-devel-0.3.111-13.el9.x86_64.rp 315 kB/s | 10 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(47/147): jq-1.6-16.el9.x86_64.rpm 2.8 MB/s | 186 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(48/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.8 MB/s | 159 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(49/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 919 kB/s | 44 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(50/147): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(51/147): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(52/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 401 kB/s | 24 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(53/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 626 kB/s | 46 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(54/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 282 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(55/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.8 MB/s | 217 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 719 kB/s | 34 kB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(57/147): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 9.0 MB/s | 1.5 MB 00:00 2023-11-26T07:15:08.196 INFO:teuthology.orchestra.run.smithi159.stdout:(59/147): postgresql-private-libs-13.11-1.el9.x 538 kB/s | 134 kB 00:00 2023-11-26T07:15:08.197 INFO:teuthology.orchestra.run.smithi159.stdout:(60/147): postgresql-contrib-13.11-1.el9.x86_64 2.6 MB/s | 811 kB 00:00 2023-11-26T07:15:08.330 INFO:teuthology.orchestra.run.smithi077.stdout:(29/147): ceph-test-18.0.0-7484.g44c2237f.el9.x 9.1 MB/s | 41 MB 00:04 2023-11-26T07:15:08.337 INFO:teuthology.orchestra.run.smithi159.stdout:(61/147): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2023-11-26T07:15:08.355 INFO:teuthology.orchestra.run.smithi077.stdout:(30/147): ceph-mgr-cephadm-18.0.0-7484.g44c2237 275 kB/s | 133 kB 00:00 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi077.stdout:(31/147): ceph-mgr-dashboard-18.0.0-7484.g44c22 3.2 MB/s | 1.8 MB 00:00 2023-11-26T07:15:08.463 INFO:teuthology.orchestra.run.smithi159.stdout:(62/147): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-11-26T07:15:08.472 INFO:teuthology.orchestra.run.smithi077.stdout:(32/147): ceph-mgr-modules-core-18.0.0-7484.g44 2.1 MB/s | 243 kB 00:00 2023-11-26T07:15:08.488 INFO:teuthology.orchestra.run.smithi159.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-11-26T07:15:08.522 INFO:teuthology.orchestra.run.smithi159.stdout:(64/147): python3-jsonpatch-1.21-16.el9.noarch. 757 kB/s | 24 kB 00:00 2023-11-26T07:15:08.522 INFO:teuthology.orchestra.run.smithi077.stdout:(33/147): ceph-mgr-rook-18.0.0-7484.g44c2237f.e 605 kB/s | 50 kB 00:00 2023-11-26T07:15:08.539 INFO:teuthology.orchestra.run.smithi159.stdout:(65/147): python3-jsonpointer-2.0-4.el9.noarch. 370 kB/s | 18 kB 00:00 2023-11-26T07:15:08.564 INFO:teuthology.orchestra.run.smithi077.stdout:(34/147): ceph-prometheus-alerts-18.0.0-7484.g4 166 kB/s | 15 kB 00:00 2023-11-26T07:15:08.572 INFO:teuthology.orchestra.run.smithi159.stdout:(66/147): python3-markupsafe-1.1.1-12.el9.x86_6 985 kB/s | 32 kB 00:00 2023-11-26T07:15:08.597 INFO:teuthology.orchestra.run.smithi159.stdout:(67/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2023-11-26T07:15:08.614 INFO:teuthology.orchestra.run.smithi077.stdout:(35/147): ceph-volume-18.0.0-7484.g44c2237f.el9 2.8 MB/s | 262 kB 00:00 2023-11-26T07:15:08.681 INFO:teuthology.orchestra.run.smithi077.stdout:(36/147): cephadm-18.0.0-7484.g44c2237f.el9.noa 6.5 MB/s | 774 kB 00:00 2023-11-26T07:15:08.723 INFO:teuthology.orchestra.run.smithi159.stdout:(68/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2023-11-26T07:15:08.723 INFO:teuthology.orchestra.run.smithi077.stdout:(37/147): cephfs-top-18.0.0-7484.g44c2237f.el9. 169 kB/s | 18 kB 00:00 2023-11-26T07:15:08.756 INFO:teuthology.orchestra.run.smithi159.stdout:(69/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2023-11-26T07:15:08.798 INFO:teuthology.orchestra.run.smithi159.stdout:(70/147): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2023-11-26T07:15:08.832 INFO:teuthology.orchestra.run.smithi159.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 2.3 MB/s | 174 kB 00:00 2023-11-26T07:15:08.891 INFO:teuthology.orchestra.run.smithi159.stdout:(72/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 132 kB 00:00 2023-11-26T07:15:08.924 INFO:teuthology.orchestra.run.smithi159.stdout:(73/147): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2023-11-26T07:15:08.949 INFO:teuthology.orchestra.run.smithi077.stdout:(38/147): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 662 kB 00:00 2023-11-26T07:15:08.949 INFO:teuthology.orchestra.run.smithi159.stdout:(74/147): python3-pytz-2021.1-5.el9.noarch.rpm 858 kB/s | 47 kB 00:00 2023-11-26T07:15:08.975 INFO:teuthology.orchestra.run.smithi159.stdout:(75/147): python3-requests-oauthlib-1.3.0-12.el 870 kB/s | 43 kB 00:00 2023-11-26T07:15:08.990 INFO:teuthology.orchestra.run.smithi077.stdout:(39/147): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 920 kB 00:00 2023-11-26T07:15:09.016 INFO:teuthology.orchestra.run.smithi077.stdout:(40/147): boost-program-options-1.75.0-8.el9.x8 1.7 MB/s | 106 kB 00:00 2023-11-26T07:15:09.058 INFO:teuthology.orchestra.run.smithi077.stdout:(41/147): elfutils-libelf-devel-0.190-1.el9.x86 331 kB/s | 21 kB 00:00 2023-11-26T07:15:09.091 INFO:teuthology.orchestra.run.smithi077.stdout:(42/147): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 307 kB 00:00 2023-11-26T07:15:09.133 INFO:teuthology.orchestra.run.smithi077.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 441 kB/s | 32 kB 00:00 2023-11-26T07:15:09.167 INFO:teuthology.orchestra.run.smithi159.stdout:(76/147): ceph-mgr-diskprediction-local-18.0.0- 2.6 MB/s | 7.4 MB 00:02 2023-11-26T07:15:09.233 INFO:teuthology.orchestra.run.smithi077.stdout:(44/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2023-11-26T07:15:09.275 INFO:teuthology.orchestra.run.smithi077.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 134 kB/s | 17 kB 00:00 2023-11-26T07:15:09.349 INFO:teuthology.orchestra.run.smithi077.stdout:(46/147): jq-1.6-16.el9.x86_64.rpm 2.5 MB/s | 186 kB 00:00 2023-11-26T07:15:09.392 INFO:teuthology.orchestra.run.smithi077.stdout:(47/147): libaio-devel-0.3.111-13.el9.x86_64.rp 87 kB/s | 10 kB 00:00 2023-11-26T07:15:09.401 INFO:teuthology.orchestra.run.smithi159.stdout:(77/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2023-11-26T07:15:09.426 INFO:teuthology.orchestra.run.smithi159.stdout:(78/147): python3-toml-0.10.2-6.el9.noarch.rpm 89 kB/s | 39 kB 00:00 2023-11-26T07:15:09.434 INFO:teuthology.orchestra.run.smithi077.stdout:(48/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2023-11-26T07:15:09.451 INFO:teuthology.orchestra.run.smithi159.stdout:(79/147): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2023-11-26T07:15:09.476 INFO:teuthology.orchestra.run.smithi077.stdout:(49/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 538 kB/s | 44 kB 00:00 2023-11-26T07:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:(80/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.3 MB/s | 85 kB 00:00 2023-11-26T07:15:09.526 INFO:teuthology.orchestra.run.smithi077.stdout:(50/147): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2023-11-26T07:15:09.543 INFO:teuthology.orchestra.run.smithi159.stdout:(81/147): uuid-1.6.2-55.el9.x86_64.rpm 620 kB/s | 56 kB 00:00 2023-11-26T07:15:09.568 INFO:teuthology.orchestra.run.smithi077.stdout:(51/147): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 661 kB 00:00 2023-11-26T07:15:09.568 INFO:teuthology.orchestra.run.smithi159.stdout:(82/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 541 kB/s | 63 kB 00:00 2023-11-26T07:15:09.593 INFO:teuthology.orchestra.run.smithi159.stdout:(83/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 599 kB/s | 44 kB 00:00 2023-11-26T07:15:09.619 INFO:teuthology.orchestra.run.smithi077.stdout:(52/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 281 kB/s | 24 kB 00:00 2023-11-26T07:15:09.627 INFO:teuthology.orchestra.run.smithi159.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-11-26T07:15:09.661 INFO:teuthology.orchestra.run.smithi159.stdout:(85/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.7 MB/s | 803 kB 00:00 2023-11-26T07:15:09.669 INFO:teuthology.orchestra.run.smithi077.stdout:(53/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 465 kB/s | 46 kB 00:00 2023-11-26T07:15:09.694 INFO:teuthology.orchestra.run.smithi159.stdout:(86/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2023-11-26T07:15:09.702 INFO:teuthology.orchestra.run.smithi077.stdout:(54/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 282 kB 00:00 2023-11-26T07:15:09.736 INFO:teuthology.orchestra.run.smithi077.stdout:(55/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-11-26T07:15:09.736 INFO:teuthology.orchestra.run.smithi159.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2023-11-26T07:15:09.778 INFO:teuthology.orchestra.run.smithi159.stdout:(88/147): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.1 MB 00:00 2023-11-26T07:15:09.786 INFO:teuthology.orchestra.run.smithi077.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 420 kB/s | 34 kB 00:00 2023-11-26T07:15:09.803 INFO:teuthology.orchestra.run.smithi159.stdout:(89/147): python3-ply-3.11-14.el9.noarch.rpm 957 kB/s | 103 kB 00:00 2023-11-26T07:15:09.853 INFO:teuthology.orchestra.run.smithi159.stdout:(90/147): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-11-26T07:15:09.879 INFO:teuthology.orchestra.run.smithi159.stdout:(91/147): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-11-26T07:15:09.912 INFO:teuthology.orchestra.run.smithi159.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 1.7 MB/s | 187 kB 00:00 2023-11-26T07:15:09.920 INFO:teuthology.orchestra.run.smithi077.stdout:(57/147): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2023-11-26T07:15:09.970 INFO:teuthology.orchestra.run.smithi077.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 9.0 MB/s | 1.5 MB 00:00 2023-11-26T07:15:10.012 INFO:teuthology.orchestra.run.smithi077.stdout:(59/147): postgresql-contrib-13.11-1.el9.x86_64 8.8 MB/s | 811 kB 00:00 2023-11-26T07:15:10.037 INFO:teuthology.orchestra.run.smithi077.stdout:(60/147): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2023-11-26T07:15:10.163 INFO:teuthology.orchestra.run.smithi159.stdout:(93/147): python3-devel-3.9.17-2.el9.x86_64.rpm 986 kB/s | 245 kB 00:00 2023-11-26T07:15:10.179 INFO:teuthology.orchestra.run.smithi077.stdout:(61/147): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2023-11-26T07:15:10.329 INFO:teuthology.orchestra.run.smithi077.stdout:(62/147): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2023-11-26T07:15:10.330 INFO:teuthology.orchestra.run.smithi159.stdout:(94/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 743 kB/s | 309 kB 00:00 2023-11-26T07:15:10.363 INFO:teuthology.orchestra.run.smithi077.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.3 MB/s | 228 kB 00:00 2023-11-26T07:15:10.396 INFO:teuthology.orchestra.run.smithi159.stdout:(95/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 391 kB/s | 24 kB 00:00 2023-11-26T07:15:10.414 INFO:teuthology.orchestra.run.smithi077.stdout:(64/147): python3-jsonpatch-1.21-16.el9.noarch. 498 kB/s | 24 kB 00:00 2023-11-26T07:15:10.455 INFO:teuthology.orchestra.run.smithi159.stdout:(96/147): liboath-2.6.7-2.el9.x86_64.rpm 846 kB/s | 49 kB 00:00 2023-11-26T07:15:10.456 INFO:teuthology.orchestra.run.smithi077.stdout:(65/147): python3-jsonpointer-2.0-4.el9.noarch. 199 kB/s | 18 kB 00:00 2023-11-26T07:15:10.481 INFO:teuthology.orchestra.run.smithi077.stdout:(66/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-11-26T07:15:10.514 INFO:teuthology.orchestra.run.smithi159.stdout:(97/147): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2023-11-26T07:15:10.523 INFO:teuthology.orchestra.run.smithi077.stdout:(67/147): python3-markupsafe-1.1.1-12.el9.x86_6 487 kB/s | 32 kB 00:00 2023-11-26T07:15:10.648 INFO:teuthology.orchestra.run.smithi077.stdout:(68/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2023-11-26T07:15:10.664 INFO:teuthology.orchestra.run.smithi159.stdout:(98/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 5.5 MB/s | 837 kB 00:00 2023-11-26T07:15:10.673 INFO:teuthology.orchestra.run.smithi077.stdout:(69/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-11-26T07:15:10.748 INFO:teuthology.orchestra.run.smithi159.stdout:(99/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 4.6 MB/s | 4.1 MB 00:00 2023-11-26T07:15:10.757 INFO:teuthology.orchestra.run.smithi077.stdout:(70/147): python3-prettytable-0.7.2-27.el9.noar 503 kB/s | 41 kB 00:00 2023-11-26T07:15:10.782 INFO:teuthology.orchestra.run.smithi077.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 174 kB 00:00 2023-11-26T07:15:10.807 INFO:teuthology.orchestra.run.smithi077.stdout:(72/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-11-26T07:15:10.823 INFO:teuthology.orchestra.run.smithi159.stdout:(100/147): python3-asyncssh-2.13.2-3.el9.noarch 3.4 MB/s | 548 kB 00:00 2023-11-26T07:15:10.841 INFO:teuthology.orchestra.run.smithi077.stdout:(73/147): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 211 kB 00:00 2023-11-26T07:15:10.883 INFO:teuthology.orchestra.run.smithi077.stdout:(74/147): python3-pytz-2021.1-5.el9.noarch.rpm 651 kB/s | 47 kB 00:00 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi077.stdout:(75/147): python3-requests-oauthlib-1.3.0-12.el 518 kB/s | 43 kB 00:00 2023-11-26T07:15:10.990 INFO:teuthology.orchestra.run.smithi159.stdout:(101/147): libarrow-9.0.0-9.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2023-11-26T07:15:11.023 INFO:teuthology.orchestra.run.smithi159.stdout:(102/147): python3-cachetools-4.2.4-1.el9.noarc 245 kB/s | 32 kB 00:00 2023-11-26T07:15:11.057 INFO:teuthology.orchestra.run.smithi159.stdout:(103/147): python3-certifi-2021.10.8-2.el9.noar 237 kB/s | 15 kB 00:00 2023-11-26T07:15:11.091 INFO:teuthology.orchestra.run.smithi159.stdout:(104/147): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2023-11-26T07:15:11.116 INFO:teuthology.orchestra.run.smithi159.stdout:(105/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 118 kB/s | 43 kB 00:00 2023-11-26T07:15:11.117 INFO:teuthology.orchestra.run.smithi077.stdout:(76/147): ceph-mgr-diskprediction-local-18.0.0- 2.7 MB/s | 7.4 MB 00:02 2023-11-26T07:15:11.158 INFO:teuthology.orchestra.run.smithi159.stdout:(106/147): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2023-11-26T07:15:11.175 INFO:teuthology.orchestra.run.smithi159.stdout:(107/147): python3-jaraco-8.2.1-3.el9.noarch.rp 184 kB/s | 11 kB 00:00 2023-11-26T07:15:11.184 INFO:teuthology.orchestra.run.smithi077.stdout:(77/147): python3-toml-0.10.2-6.el9.noarch.rpm 158 kB/s | 39 kB 00:00 2023-11-26T07:15:11.209 INFO:teuthology.orchestra.run.smithi159.stdout:(108/147): python3-google-auth-2.23.4-1.el9.noa 1.7 MB/s | 197 kB 00:00 2023-11-26T07:15:11.234 INFO:teuthology.orchestra.run.smithi159.stdout:(109/147): python3-jaraco-classes-3.2.1-5.el9.n 237 kB/s | 18 kB 00:00 2023-11-26T07:15:11.259 INFO:teuthology.orchestra.run.smithi159.stdout:(110/147): python3-jaraco-collections-3.0.0-8.e 278 kB/s | 23 kB 00:00 2023-11-26T07:15:11.285 INFO:teuthology.orchestra.run.smithi159.stdout:(111/147): python3-jaraco-functools-3.5.0-2.el9 260 kB/s | 19 kB 00:00 2023-11-26T07:15:11.310 INFO:teuthology.orchestra.run.smithi159.stdout:(112/147): python3-jaraco-text-3.2.0-6.el9.noar 263 kB/s | 20 kB 00:00 2023-11-26T07:15:11.335 INFO:teuthology.orchestra.run.smithi159.stdout:(113/147): python3-jwt+crypto-2.4.0-1.el9.noarc 121 kB/s | 9.0 kB 00:00 2023-11-26T07:15:11.360 INFO:teuthology.orchestra.run.smithi159.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 547 kB/s | 41 kB 00:00 2023-11-26T07:15:11.401 INFO:teuthology.orchestra.run.smithi077.stdout:(78/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2023-11-26T07:15:11.402 INFO:teuthology.orchestra.run.smithi159.stdout:(115/147): python3-logutils-0.3.5-21.el9.noarch 700 kB/s | 46 kB 00:00 2023-11-26T07:15:11.434 INFO:teuthology.orchestra.run.smithi077.stdout:(79/147): socat-1.7.4.1-5.el9.x86_64.rpm 987 kB/s | 300 kB 00:00 2023-11-26T07:15:11.453 INFO:teuthology.orchestra.run.smithi159.stdout:(116/147): python3-more-itertools-8.12.0-2.el9. 864 kB/s | 79 kB 00:00 2023-11-26T07:15:11.476 INFO:teuthology.orchestra.run.smithi077.stdout:(80/147): uuid-1.6.2-55.el9.x86_64.rpm 196 kB/s | 56 kB 00:00 2023-11-26T07:15:11.478 INFO:teuthology.orchestra.run.smithi159.stdout:(117/147): python3-natsort-7.1.1-5.el9.noarch.r 776 kB/s | 58 kB 00:00 2023-11-26T07:15:11.501 INFO:teuthology.orchestra.run.smithi077.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 883 kB/s | 85 kB 00:00 2023-11-26T07:15:11.520 INFO:teuthology.orchestra.run.smithi159.stdout:(118/147): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2023-11-26T07:15:11.543 INFO:teuthology.orchestra.run.smithi077.stdout:(82/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 963 kB/s | 63 kB 00:00 2023-11-26T07:15:11.545 INFO:teuthology.orchestra.run.smithi159.stdout:(119/147): python3-portend-3.1.0-2.el9.noarch.r 248 kB/s | 16 kB 00:00 2023-11-26T07:15:11.579 INFO:teuthology.orchestra.run.smithi159.stdout:(120/147): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2023-11-26T07:15:11.585 INFO:teuthology.orchestra.run.smithi077.stdout:(83/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 413 kB/s | 44 kB 00:00 2023-11-26T07:15:11.604 INFO:teuthology.orchestra.run.smithi159.stdout:(121/147): python3-repoze-lru-0.7-16.el9.noarch 531 kB/s | 31 kB 00:00 2023-11-26T07:15:11.610 INFO:teuthology.orchestra.run.smithi077.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 734 kB/s | 79 kB 00:00 2023-11-26T07:15:11.629 INFO:teuthology.orchestra.run.smithi159.stdout:(122/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 830 kB/s | 90 kB 00:00 2023-11-26T07:15:11.644 INFO:teuthology.orchestra.run.smithi077.stdout:(85/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.4 MB/s | 195 kB 00:00 2023-11-26T07:15:11.663 INFO:teuthology.orchestra.run.smithi159.stdout:(123/147): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-11-26T07:15:11.696 INFO:teuthology.orchestra.run.smithi159.stdout:(124/147): python3-tempora-5.0.0-2.el9.noarch.r 541 kB/s | 36 kB 00:00 2023-11-26T07:15:11.711 INFO:teuthology.orchestra.run.smithi077.stdout:(86/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2023-11-26T07:15:11.722 INFO:teuthology.orchestra.run.smithi159.stdout:(125/147): python3-rsa-4.9-2.el9.noarch.rpm 506 kB/s | 59 kB 00:00 2023-11-26T07:15:11.744 INFO:teuthology.orchestra.run.smithi077.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 241 kB 00:00 2023-11-26T07:15:11.747 INFO:teuthology.orchestra.run.smithi159.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 616 kB/s | 51 kB 00:00 2023-11-26T07:15:11.781 INFO:teuthology.orchestra.run.smithi159.stdout:(127/147): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-11-26T07:15:11.795 INFO:teuthology.orchestra.run.smithi077.stdout:(88/147): python3-cryptography-36.0.1-4.el9.x86 7.9 MB/s | 1.1 MB 00:00 2023-11-26T07:15:11.806 INFO:teuthology.orchestra.run.smithi159.stdout:(128/147): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2023-11-26T07:15:11.820 INFO:teuthology.orchestra.run.smithi077.stdout:(89/147): python3-pycparser-2.20-6.el9.noarch.r 1.9 MB/s | 124 kB 00:00 2023-11-26T07:15:11.840 INFO:teuthology.orchestra.run.smithi159.stdout:(129/147): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2023-11-26T07:15:11.845 INFO:teuthology.orchestra.run.smithi077.stdout:(90/147): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2023-11-26T07:15:11.865 INFO:teuthology.orchestra.run.smithi159.stdout:(130/147): python3-zc-lockfile-2.0-10.el9.noarc 241 kB/s | 20 kB 00:00 2023-11-26T07:15:11.871 INFO:teuthology.orchestra.run.smithi077.stdout:(91/147): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-11-26T07:15:11.904 INFO:teuthology.orchestra.run.smithi077.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 2.3 MB/s | 187 kB 00:00 2023-11-26T07:15:11.957 INFO:teuthology.orchestra.run.smithi159.stdout:(131/147): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2023-11-26T07:15:12.018 INFO:teuthology.orchestra.run.smithi159.stdout:(132/147): thrift-0.15.0-2.el9.x86_64.rpm 8.9 MB/s | 1.6 MB 00:00 2023-11-26T07:15:12.076 INFO:teuthology.orchestra.run.smithi159.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 68 kB 00:00 2023-11-26T07:15:12.159 INFO:teuthology.orchestra.run.smithi077.stdout:(93/147): python3-devel-3.9.17-2.el9.x86_64.rpm 861 kB/s | 245 kB 00:00 2023-11-26T07:15:12.185 INFO:teuthology.orchestra.run.smithi159.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-11-26T07:15:12.269 INFO:teuthology.orchestra.run.smithi159.stdout:(135/147): NetworkManager-libnm-1.45.6-1.el9.x8 21 MB/s | 1.8 MB 00:00 2023-11-26T07:15:12.302 INFO:teuthology.orchestra.run.smithi159.stdout:(136/147): NetworkManager-team-1.45.6-1.el9.x86 1.3 MB/s | 42 kB 00:00 2023-11-26T07:15:12.344 INFO:teuthology.orchestra.run.smithi159.stdout:(137/147): NetworkManager-tui-1.45.6-1.el9.x86_ 5.9 MB/s | 245 kB 00:00 2023-11-26T07:15:12.346 INFO:teuthology.orchestra.run.smithi077.stdout:(94/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 700 kB/s | 309 kB 00:00 2023-11-26T07:15:12.378 INFO:teuthology.orchestra.run.smithi159.stdout:(138/147): acl-2.3.1-4.el9.x86_64.rpm 2.1 MB/s | 69 kB 00:00 2023-11-26T07:15:12.403 INFO:teuthology.orchestra.run.smithi159.stdout:(139/147): elfutils-debuginfod-client-0.190-1.e 1.5 MB/s | 36 kB 00:00 2023-11-26T07:15:12.447 INFO:teuthology.orchestra.run.smithi077.stdout:(95/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 7.2 MB/s | 4.1 MB 00:00 2023-11-26T07:15:12.478 INFO:teuthology.orchestra.run.smithi159.stdout:(140/147): librbd1-18.0.0-7484.g44c2237f.el9.x8 5.8 MB/s | 3.0 MB 00:00 2023-11-26T07:15:12.488 INFO:teuthology.orchestra.run.smithi077.stdout:(96/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 172 kB/s | 24 kB 00:00 2023-11-26T07:15:12.512 INFO:teuthology.orchestra.run.smithi159.stdout:(141/147): elfutils-libelf-0.190-1.el9.x86_64.r 1.7 MB/s | 192 kB 00:00 2023-11-26T07:15:12.546 INFO:teuthology.orchestra.run.smithi159.stdout:(142/147): elfutils-libs-0.190-1.el9.x86_64.rpm 3.9 MB/s | 255 kB 00:00 2023-11-26T07:15:12.547 INFO:teuthology.orchestra.run.smithi077.stdout:(97/147): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2023-11-26T07:15:12.571 INFO:teuthology.orchestra.run.smithi159.stdout:(143/147): libacl-2.3.1-4.el9.x86_64.rpm 395 kB/s | 22 kB 00:00 2023-11-26T07:15:12.589 INFO:teuthology.orchestra.run.smithi077.stdout:(98/147): liboath-2.6.7-2.el9.x86_64.rpm 344 kB/s | 49 kB 00:00 2023-11-26T07:15:12.605 INFO:teuthology.orchestra.run.smithi159.stdout:(144/147): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-11-26T07:15:12.689 INFO:teuthology.orchestra.run.smithi077.stdout:(99/147): libarrow-9.0.0-9.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2023-11-26T07:15:12.756 INFO:teuthology.orchestra.run.smithi077.stdout:(100/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 661 kB/s | 43 kB 00:00 2023-11-26T07:15:12.796 INFO:teuthology.orchestra.run.smithi159.stdout:(145/147): librados2-18.0.0-7484.g44c2237f.el9. 3.6 MB/s | 3.3 MB 00:00 2023-11-26T07:15:12.798 INFO:teuthology.orchestra.run.smithi077.stdout:(101/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.3 MB/s | 837 kB 00:00 2023-11-26T07:15:12.840 INFO:teuthology.orchestra.run.smithi077.stdout:(102/147): python3-cachetools-4.2.4-1.el9.noarc 388 kB/s | 32 kB 00:00 2023-11-26T07:15:12.965 INFO:teuthology.orchestra.run.smithi077.stdout:(103/147): python3-certifi-2021.10.8-2.el9.noar 90 kB/s | 15 kB 00:00 2023-11-26T07:15:12.999 INFO:teuthology.orchestra.run.smithi077.stdout:(104/147): python3-asyncssh-2.13.2-3.el9.noarch 1.3 MB/s | 548 kB 00:00 2023-11-26T07:15:13.033 INFO:teuthology.orchestra.run.smithi077.stdout:(105/147): python3-cheroot-8.6.0-4.el9.noarch.r 897 kB/s | 172 kB 00:00 2023-11-26T07:15:13.066 INFO:teuthology.orchestra.run.smithi077.stdout:(106/147): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2023-11-26T07:15:13.133 INFO:teuthology.orchestra.run.smithi077.stdout:(107/147): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-11-26T07:15:13.183 INFO:teuthology.orchestra.run.smithi077.stdout:(108/147): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2023-11-26T07:15:13.234 INFO:teuthology.orchestra.run.smithi077.stdout:(109/147): python3-jaraco-collections-3.0.0-8.e 233 kB/s | 23 kB 00:00 2023-11-26T07:15:13.284 INFO:teuthology.orchestra.run.smithi077.stdout:(110/147): python3-jaraco-functools-3.5.0-2.el9 195 kB/s | 19 kB 00:00 2023-11-26T07:15:13.305 INFO:teuthology.orchestra.run.smithi159.stdout:(146/147): openssl-3.0.7-25.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2023-11-26T07:15:13.334 INFO:teuthology.orchestra.run.smithi077.stdout:(111/147): python3-jaraco-text-3.2.0-6.el9.noar 198 kB/s | 20 kB 00:00 2023-11-26T07:15:13.360 INFO:teuthology.orchestra.run.smithi077.stdout:(112/147): python3-google-auth-2.23.4-1.el9.noa 550 kB/s | 197 kB 00:00 2023-11-26T07:15:13.405 INFO:teuthology.orchestra.run.smithi159.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 2.7 MB/s | 2.2 MB 00:00 2023-11-26T07:15:13.410 INFO:teuthology.orchestra.run.smithi077.stdout:(113/147): python3-jwt+crypto-2.4.0-1.el9.noarc 73 kB/s | 9.0 kB 00:00 2023-11-26T07:15:13.420 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2023-11-26T07:15:13.420 INFO:teuthology.orchestra.run.smithi159.stdout:Total 13 MB/s | 204 MB 00:15 2023-11-26T07:15:13.460 INFO:teuthology.orchestra.run.smithi077.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 328 kB/s | 41 kB 00:00 2023-11-26T07:15:13.510 INFO:teuthology.orchestra.run.smithi077.stdout:(115/147): python3-logutils-0.3.5-21.el9.noarch 467 kB/s | 46 kB 00:00 2023-11-26T07:15:13.566 INFO:teuthology.orchestra.run.smithi077.stdout:(116/147): python3-more-itertools-8.12.0-2.el9. 749 kB/s | 79 kB 00:00 2023-11-26T07:15:13.627 INFO:teuthology.orchestra.run.smithi077.stdout:(117/147): python3-natsort-7.1.1-5.el9.noarch.r 497 kB/s | 58 kB 00:00 2023-11-26T07:15:13.649 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2023-11-26T07:15:13.686 INFO:teuthology.orchestra.run.smithi077.stdout:(118/147): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2023-11-26T07:15:13.736 INFO:teuthology.orchestra.run.smithi077.stdout:(119/147): python3-portend-3.1.0-2.el9.noarch.r 152 kB/s | 16 kB 00:00 2023-11-26T07:15:13.761 INFO:teuthology.orchestra.run.smithi077.stdout:(120/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-11-26T07:15:13.787 INFO:teuthology.orchestra.run.smithi077.stdout:(121/147): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2023-11-26T07:15:13.820 INFO:teuthology.orchestra.run.smithi077.stdout:(122/147): python3-repoze-lru-0.7-16.el9.noarch 371 kB/s | 31 kB 00:00 2023-11-26T07:15:13.854 INFO:teuthology.orchestra.run.smithi077.stdout:(123/147): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2023-11-26T07:15:13.879 INFO:teuthology.orchestra.run.smithi077.stdout:(124/147): python3-tempora-5.0.0-2.el9.noarch.r 618 kB/s | 36 kB 00:00 2023-11-26T07:15:13.932 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2023-11-26T07:15:13.933 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2023-11-26T07:15:13.979 INFO:teuthology.orchestra.run.smithi077.stdout:(125/147): python3-webob-1.8.7-6.el9.noarch.rpm 2.3 MB/s | 230 kB 00:00 2023-11-26T07:15:14.097 INFO:teuthology.orchestra.run.smithi077.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 211 kB/s | 51 kB 00:00 2023-11-26T07:15:14.122 INFO:teuthology.orchestra.run.smithi077.stdout:(127/147): python3-rsa-4.9-2.el9.noarch.rpm 177 kB/s | 59 kB 00:00 2023-11-26T07:15:14.164 INFO:teuthology.orchestra.run.smithi077.stdout:(128/147): python3-zc-lockfile-2.0-10.el9.noarc 485 kB/s | 20 kB 00:00 2023-11-26T07:15:14.214 INFO:teuthology.orchestra.run.smithi077.stdout:(129/147): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2023-11-26T07:15:14.248 INFO:teuthology.orchestra.run.smithi077.stdout:(130/147): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2023-11-26T07:15:14.540 INFO:teuthology.orchestra.run.smithi077.stdout:(131/147): thrift-0.15.0-2.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2023-11-26T07:15:14.773 INFO:teuthology.orchestra.run.smithi077.stdout:(132/147): librados2-18.0.0-7484.g44c2237f.el9. 6.3 MB/s | 3.3 MB 00:00 2023-11-26T07:15:14.815 INFO:teuthology.orchestra.run.smithi077.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-11-26T07:15:14.923 INFO:teuthology.orchestra.run.smithi077.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-11-26T07:15:15.007 INFO:teuthology.orchestra.run.smithi077.stdout:(135/147): NetworkManager-libnm-1.45.6-1.el9.x8 21 MB/s | 1.8 MB 00:00 2023-11-26T07:15:15.041 INFO:teuthology.orchestra.run.smithi077.stdout:(136/147): NetworkManager-team-1.45.6-1.el9.x86 1.3 MB/s | 42 kB 00:00 2023-11-26T07:15:15.116 INFO:teuthology.orchestra.run.smithi077.stdout:(137/147): librbd1-18.0.0-7484.g44c2237f.el9.x8 5.2 MB/s | 3.0 MB 00:00 2023-11-26T07:15:15.150 INFO:teuthology.orchestra.run.smithi077.stdout:(138/147): NetworkManager-tui-1.45.6-1.el9.x86_ 2.2 MB/s | 245 kB 00:00 2023-11-26T07:15:15.167 INFO:teuthology.orchestra.run.smithi077.stdout:(139/147): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2023-11-26T07:15:15.183 INFO:teuthology.orchestra.run.smithi077.stdout:(140/147): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-11-26T07:15:15.209 INFO:teuthology.orchestra.run.smithi077.stdout:(141/147): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-11-26T07:15:15.242 INFO:teuthology.orchestra.run.smithi077.stdout:(142/147): elfutils-libs-0.190-1.el9.x86_64.rpm 4.4 MB/s | 255 kB 00:00 2023-11-26T07:15:15.268 INFO:teuthology.orchestra.run.smithi077.stdout:(143/147): libacl-2.3.1-4.el9.x86_64.rpm 395 kB/s | 22 kB 00:00 2023-11-26T07:15:15.301 INFO:teuthology.orchestra.run.smithi077.stdout:(144/147): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-11-26T07:15:15.385 INFO:teuthology.orchestra.run.smithi077.stdout:(145/147): python3-websocket-client-1.2.3-2.el9 64 kB/s | 90 kB 00:01 2023-11-26T07:15:15.535 INFO:teuthology.orchestra.run.smithi077.stdout:(146/147): openssl-3.0.7-25.el9.x86_64.rpm 4.6 MB/s | 1.2 MB 00:00 2023-11-26T07:15:15.810 INFO:teuthology.orchestra.run.smithi077.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 4.2 MB/s | 2.2 MB 00:00 2023-11-26T07:15:15.819 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2023-11-26T07:15:15.819 INFO:teuthology.orchestra.run.smithi077.stdout:Total 12 MB/s | 204 MB 00:17 2023-11-26T07:15:16.037 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2023-11-26T07:15:16.042 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2023-11-26T07:15:16.043 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2023-11-26T07:15:16.312 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2023-11-26T07:15:16.312 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2023-11-26T07:15:18.601 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2023-11-26T07:15:18.602 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2023-11-26T07:15:22.388 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2023-11-26T07:15:22.568 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-26T07:15:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-26T07:15:22.704 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-26T07:15:22.759 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-26T07:15:22.797 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-26T07:15:22.891 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-26T07:15:23.337 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-26T07:15:23.436 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:18.0.0-7484.g44c2237f.el9.x86_64 8/162 2023-11-26T07:15:23.602 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:18.0.0-7484.g44c2237f.el9.x86_64 8/162 2023-11-26T07:15:23.646 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:18.0.0-7484.g44c2237f.el9.x86_64 9/162 2023-11-26T07:15:23.771 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.g44c2237f.el9.x86_64 9/162 2023-11-26T07:15:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:18.0.0-7484.g44c2237f.el9.x86_64 10/162 2023-11-26T07:15:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-26T07:15:24.180 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-26T07:15:24.259 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-26T07:15:24.292 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:18.0.0-7484.g44c2237f.el9.x86_64 14/162 2023-11-26T07:15:24.438 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.g44c2237f.el9.x86_64 14/162 2023-11-26T07:15:24.468 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:18.0.0-7484.g44c2237f.el9.x86 15/162 2023-11-26T07:15:24.534 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.g44c2237f.el9.x86 15/162 2023-11-26T07:15:24.823 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-26T07:15:25.013 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-26T07:15:25.034 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2023-11-26T07:15:25.103 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-26T07:15:25.191 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-26T07:15:25.298 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-26T07:15:25.352 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-26T07:15:25.404 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-26T07:15:25.485 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-26T07:15:25.545 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-26T07:15:25.674 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-26T07:15:25.758 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-26T07:15:25.798 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-26T07:15:25.889 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-26T07:15:25.950 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-26T07:15:25.985 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-26T07:15:26.037 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-26T07:15:26.088 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-26T07:15:26.094 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-26T07:15:26.118 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:18.0.0-7484.g44c2237f.el9.x86_64 8/162 2023-11-26T07:15:26.195 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-26T07:15:26.237 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-26T07:15:26.291 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-26T07:15:26.305 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:18.0.0-7484.g44c2237f.el9.x86_64 8/162 2023-11-26T07:15:26.344 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:18.0.0-7484.g44c2237f.el9.x86_64 9/162 2023-11-26T07:15:26.400 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-26T07:15:26.435 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:18.0.0-7484.g44c2237f.el9. 29/162 2023-11-26T07:15:26.465 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.g44c2237f.el9.x86_64 9/162 2023-11-26T07:15:26.485 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el 30/162 2023-11-26T07:15:26.509 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:18.0.0-7484.g44c2237f.el9.x86_64 10/162 2023-11-26T07:15:26.567 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-26T07:15:26.589 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:18.0.0-7484.g44c2237f.el9.x86_6 31/162 2023-11-26T07:15:26.760 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-26T07:15:26.827 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-26T07:15:26.900 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-26T07:15:26.956 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-26T07:15:26.982 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:18.0.0-7484.g44c2237f.el9.x86_64 14/162 2023-11-26T07:15:27.123 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.g44c2237f.el9.x86_64 14/162 2023-11-26T07:15:27.158 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:18.0.0-7484.g44c2237f.el9.x86 15/162 2023-11-26T07:15:27.249 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.g44c2237f.el9.x86 15/162 2023-11-26T07:15:27.513 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-26T07:15:27.596 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-26T07:15:27.633 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-26T07:15:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-26T07:15:27.744 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-26T07:15:27.792 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:18.0.0-7484.g44c2237f.el9.x86_6 38/162 2023-11-26T07:15:27.796 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-26T07:15:27.854 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-26T07:15:27.884 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-26T07:15:28.086 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-26T07:15:28.183 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-26T07:15:28.304 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-26T07:15:28.345 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-26T07:15:28.488 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-26T07:15:28.540 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-26T07:15:28.613 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-26T07:15:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-26T07:15:28.671 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-26T07:15:28.701 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-26T07:15:28.749 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-26T07:15:28.771 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-26T07:15:28.788 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-26T07:15:28.843 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-26T07:15:28.875 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-26T07:15:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-26T07:15:28.926 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-26T07:15:28.966 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-26T07:15:29.000 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-26T07:15:29.025 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-26T07:15:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-26T07:15:29.160 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-26T07:15:29.194 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-26T07:15:29.216 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-26T07:15:29.272 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-26T07:15:29.302 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-26T07:15:29.318 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-26T07:15:29.341 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:18.0.0-7484.g44c2237f.el9. 29/162 2023-11-26T07:15:29.391 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el 30/162 2023-11-26T07:15:29.443 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-26T07:15:29.497 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-26T07:15:29.535 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:18.0.0-7484.g44c2237f.el9.x86_6 31/162 2023-11-26T07:15:29.539 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-26T07:15:29.570 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-26T07:15:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-26T07:15:29.722 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-26T07:15:29.777 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-26T07:15:29.783 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-26T07:15:29.844 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-26T07:15:29.915 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-26T07:15:30.165 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-26T07:15:30.239 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-26T07:15:30.415 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-26T07:15:30.463 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-26T07:15:30.466 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-26T07:15:30.491 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-26T07:15:30.529 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-26T07:15:30.555 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-26T07:15:30.573 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-26T07:15:30.616 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-26T07:15:30.618 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-26T07:15:30.660 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-26T07:15:30.700 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-26T07:15:30.719 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-26T07:15:30.746 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:18.0.0-7484.g44c2237f.el9.x86_6 38/162 2023-11-26T07:15:30.802 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-26T07:15:30.839 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-26T07:15:30.956 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-26T07:15:30.974 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-26T07:15:31.014 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-26T07:15:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-26T07:15:31.101 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-26T07:15:31.144 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-26T07:15:31.180 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-26T07:15:31.234 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-26T07:15:31.286 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-26T07:15:31.334 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-26T07:15:31.380 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-26T07:15:31.421 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-26T07:15:31.479 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-26T07:15:31.484 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-26T07:15:31.548 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-26T07:15:31.567 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-26T07:15:31.603 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-26T07:15:31.642 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-26T07:15:31.708 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-26T07:15:31.767 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-26T07:15:31.855 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-26T07:15:32.050 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-26T07:15:32.102 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-26T07:15:32.149 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-26T07:15:32.276 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-26T07:15:32.327 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-26T07:15:32.376 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-26T07:15:32.408 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-26T07:15:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-26T07:15:32.543 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-26T07:15:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-26T07:15:32.604 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-26T07:15:32.606 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-26T07:15:32.639 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-26T07:15:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-26T07:15:32.744 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-26T07:15:32.918 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-26T07:15:32.944 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-26T07:15:33.002 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-26T07:15:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-26T07:15:33.059 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-26T07:15:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-26T07:15:33.278 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-26T07:15:33.302 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-26T07:15:33.383 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-26T07:15:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-26T07:15:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-26T07:15:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-26T07:15:33.592 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-26T07:15:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-26T07:15:33.732 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-26T07:15:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-26T07:15:33.863 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-26T07:15:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-26T07:15:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-26T07:15:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-26T07:15:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-26T07:15:34.031 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-26T07:15:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-26T07:15:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-26T07:15:34.340 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-26T07:15:34.408 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-26T07:15:35.373 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-26T07:15:35.424 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-26T07:15:35.458 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-26T07:15:35.492 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-26T07:15:35.511 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-26T07:15:35.606 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-26T07:15:35.658 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-26T07:15:35.683 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-26T07:15:35.719 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-26T07:15:35.731 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-26T07:15:35.761 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-26T07:15:35.771 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-26T07:15:35.863 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-26T07:15:36.136 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-26T07:15:36.431 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:18.0.0-7484.g44c2237f.el9.x86_64 99/162 2023-11-26T07:15:36.598 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:18.0.0-7484.g44c2237f.el9.x86_64 99/162 2023-11-26T07:15:36.639 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:18.0.0-7484.g44c2237f.el9.x86_64 100/162 2023-11-26T07:15:36.687 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-26T07:15:36.701 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-26T07:15:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-26T07:15:37.223 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-26T07:15:37.251 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:18.0.0-7484.g44c2237f.el9.x86_64 103/162 2023-11-26T07:15:37.334 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:18.0.0-7484.g44c2237f.el9.x86_64 103/162 2023-11-26T07:15:37.360 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:18.0.0-7484.g44c2237f.el9.x86_64 104/162 2023-11-26T07:15:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-26T07:15:38.449 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-26T07:15:38.487 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-26T07:15:38.518 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-26T07:15:38.560 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-26T07:15:38.603 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-26T07:15:38.975 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-26T07:15:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:18.0.0-7484.g44c2237f.el9.x86_64 99/162 2023-11-26T07:15:39.135 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:18.0.0-7484.g44c2237f.el9.x86_64 99/162 2023-11-26T07:15:39.163 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:18.0.0-7484.g44c2237f.el9.x86_64 100/162 2023-11-26T07:15:39.219 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-26T07:15:39.721 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-26T07:15:39.760 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:18.0.0-7484.g44c2237f.el9.x86_64 103/162 2023-11-26T07:15:39.803 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 105/162 2023-11-26T07:15:39.849 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 105/162 2023-11-26T07:15:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:18.0.0-7484.g44c2237f.el9.x86_64 103/162 2023-11-26T07:15:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:18.0.0-7484.g44c2237f.el9.x86_64 104/162 2023-11-26T07:15:40.477 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 105/162 2023-11-26T07:15:40.519 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:18.0.0-7484.g44c2237f.el9.x86_64 106/162 2023-11-26T07:15:40.675 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.g44c2237f.el9.x86_64 106/162 2023-11-26T07:15:40.675 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-26T07:15:40.675 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-26T07:15:40.675 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:15:40.728 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:18.0.0-7484.g44c2237f.el9.x86_64 107/162 2023-11-26T07:15:42.396 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 105/162 2023-11-26T07:15:42.433 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 105/162 2023-11-26T07:15:43.057 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 105/162 2023-11-26T07:15:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:18.0.0-7484.g44c2237f.el9.x86_64 106/162 2023-11-26T07:15:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.g44c2237f.el9.x86_64 106/162 2023-11-26T07:15:43.265 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-26T07:15:43.265 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-26T07:15:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:15:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:18.0.0-7484.g44c2237f.el9.x86_64 107/162 2023-11-26T07:15:53.095 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.g44c2237f.el9.x86_64 107/162 2023-11-26T07:15:53.095 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2023-11-26T07:15:53.095 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2023-11-26T07:15:53.095 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2023-11-26T07:15:53.095 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2023-11-26T07:15:53.095 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2023-11-26T07:15:53.095 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /root 2023-11-26T07:15:53.096 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2023-11-26T07:15:53.096 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:15:53.300 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-volume-2:18.0.0-7484.g44c2237f.el9.noarch 108/162 2023-11-26T07:15:53.346 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.g44c2237f.el9.noarch 108/162 2023-11-26T07:15:53.346 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:15:53.346 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-26T07:15:53.347 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:15:55.027 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:18.0.0-7484.g44c2237f.el9.x86_64 109/162 2023-11-26T07:15:55.118 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.g44c2237f.el9.x86_64 109/162 2023-11-26T07:15:55.118 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:15:55.118 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-26T07:15:55.118 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-26T07:15:55.118 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-26T07:15:55.118 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:15:55.378 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:18.0.0-7484.g44c2237f.el9.x86_64 110/162 2023-11-26T07:15:55.479 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.g44c2237f.el9.x86_64 110/162 2023-11-26T07:15:55.479 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:15:55.479 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-26T07:15:55.479 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-26T07:15:55.479 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-26T07:15:55.479 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:15:55.986 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:18.0.0-7484.g44c2237f.el9.x86_64 111/162 2023-11-26T07:15:56.024 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.g44c2237f.el9.x86_64 107/162 2023-11-26T07:15:56.024 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2023-11-26T07:15:56.024 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2023-11-26T07:15:56.024 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2023-11-26T07:15:56.024 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2023-11-26T07:15:56.024 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2023-11-26T07:15:56.024 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2023-11-26T07:15:56.024 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2023-11-26T07:15:56.024 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:15:56.078 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.g44c2237f.el9.x86_64 111/162 2023-11-26T07:15:56.079 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:15:56.079 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-26T07:15:56.079 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-26T07:15:56.079 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-26T07:15:56.079 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:15:56.197 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-26T07:15:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:18.0.0-7484.g44c2237f.el9.noarch 108/162 2023-11-26T07:15:56.299 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.g44c2237f.el9.noarch 108/162 2023-11-26T07:15:56.300 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:15:56.300 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-26T07:15:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:15:56.819 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:18.0.0-7484.g44c2237f.el9.noarch 113/162 2023-11-26T07:15:56.864 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:18.0.0-7484.g44c2237f.el9.noarch 113/162 2023-11-26T07:15:56.909 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.e 114/162 2023-11-26T07:15:57.004 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f. 115/162 2023-11-26T07:15:57.035 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el9.noa 116/162 2023-11-26T07:15:57.353 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el9.noa 116/162 2023-11-26T07:15:57.386 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el9.n 117/162 2023-11-26T07:15:58.044 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:18.0.0-7484.g44c2237f.el9.x86_64 109/162 2023-11-26T07:15:58.132 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.g44c2237f.el9.x86_64 109/162 2023-11-26T07:15:58.132 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:15:58.132 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-26T07:15:58.132 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-26T07:15:58.132 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-26T07:15:58.132 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:15:58.369 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:18.0.0-7484.g44c2237f.el9.x86_64 110/162 2023-11-26T07:15:58.454 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.g44c2237f.el9.x86_64 110/162 2023-11-26T07:15:58.454 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:15:58.455 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-26T07:15:58.455 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-26T07:15:58.455 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-26T07:15:58.455 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:15:58.541 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el9.n 117/162 2023-11-26T07:15:58.590 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 118/162 2023-11-26T07:15:58.734 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 118/162 2023-11-26T07:15:58.911 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el 119/162 2023-11-26T07:15:58.947 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:18.0.0-7484.g44c2237f.el9.x86_64 120/162 2023-11-26T07:15:58.970 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:18.0.0-7484.g44c2237f.el9.x86_64 111/162 2023-11-26T07:15:59.019 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.g44c2237f.el9.x86_64 120/162 2023-11-26T07:15:59.019 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:15:59.019 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-26T07:15:59.019 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-26T07:15:59.019 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-26T07:15:59.019 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:15:59.040 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.g44c2237f.el9.x86_64 111/162 2023-11-26T07:15:59.040 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:15:59.041 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-26T07:15:59.041 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-26T07:15:59.041 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-26T07:15:59.041 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:15:59.081 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el9.noarch 121/162 2023-11-26T07:15:59.120 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el9.noarch 121/162 2023-11-26T07:15:59.164 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-26T07:15:59.184 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:18.0.0-7484.g44c2237f.el9.x86_64 122/162 2023-11-26T07:15:59.984 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:18.0.0-7484.g44c2237f.el9.noarch 113/162 2023-11-26T07:16:00.022 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:18.0.0-7484.g44c2237f.el9.noarch 113/162 2023-11-26T07:16:00.069 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-26T07:16:00.075 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.e 114/162 2023-11-26T07:16:00.099 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:18.0.0-7484.g44c2237f.el9.x86_64 124/162 2023-11-26T07:16:00.178 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.g44c2237f.el9.x86_64 124/162 2023-11-26T07:16:00.178 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:16:00.178 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-26T07:16:00.178 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-26T07:16:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-26T07:16:00.179 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:00.180 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f. 115/162 2023-11-26T07:16:00.218 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el9.noa 116/162 2023-11-26T07:16:00.225 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.g44c22 125/162 2023-11-26T07:16:00.303 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.g44c22 125/162 2023-11-26T07:16:00.303 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:16:00.303 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-26T07:16:00.303 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:00.396 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 126/162 2023-11-26T07:16:00.505 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 126/162 2023-11-26T07:16:00.506 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:16:00.506 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-26T07:16:00.506 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-26T07:16:00.506 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-26T07:16:00.506 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:00.538 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el9.noa 116/162 2023-11-26T07:16:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el9.n 117/162 2023-11-26T07:16:00.885 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 127/162 2023-11-26T07:16:00.982 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 127/162 2023-11-26T07:16:00.982 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:16:00.982 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-26T07:16:00.982 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-26T07:16:00.983 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-26T07:16:00.983 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:01.693 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el9.n 117/162 2023-11-26T07:16:01.719 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 118/162 2023-11-26T07:16:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 118/162 2023-11-26T07:16:02.043 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el 119/162 2023-11-26T07:16:02.071 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:18.0.0-7484.g44c2237f.el9.x86_64 120/162 2023-11-26T07:16:02.149 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.g44c2237f.el9.x86_64 120/162 2023-11-26T07:16:02.149 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:16:02.149 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-26T07:16:02.150 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-26T07:16:02.150 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-26T07:16:02.150 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:02.205 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el9.noarch 121/162 2023-11-26T07:16:02.244 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el9.noarch 121/162 2023-11-26T07:16:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:18.0.0-7484.g44c2237f.el9.x86_64 122/162 2023-11-26T07:16:03.273 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-26T07:16:03.315 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:18.0.0-7484.g44c2237f.el9.x86_64 124/162 2023-11-26T07:16:03.395 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.g44c2237f.el9.x86_64 124/162 2023-11-26T07:16:03.395 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:16:03.395 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-26T07:16:03.395 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-26T07:16:03.395 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-26T07:16:03.395 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:03.442 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.g44c22 125/162 2023-11-26T07:16:03.527 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.g44c22 125/162 2023-11-26T07:16:03.527 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:16:03.528 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-26T07:16:03.528 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:03.601 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 126/162 2023-11-26T07:16:03.705 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 126/162 2023-11-26T07:16:03.705 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:16:03.705 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-26T07:16:03.706 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-26T07:16:03.706 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-26T07:16:03.706 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:04.076 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 127/162 2023-11-26T07:16:04.160 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 127/162 2023-11-26T07:16:04.160 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-26T07:16:04.160 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-26T07:16:04.161 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-26T07:16:04.161 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-26T07:16:04.161 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:05.115 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:18.0.0-7484.g44c2237f.el9.x86_64 128/162 2023-11-26T07:16:05.160 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 129/162 2023-11-26T07:16:05.216 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:18.0.0-7484.g44c2237f.el9.x86_64 130/162 2023-11-26T07:16:05.246 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-26T07:16:05.511 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-26T07:16:05.630 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-26T07:16:05.659 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 134/162 2023-11-26T07:16:05.692 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:18.0.0-7484.g44c2237f.el9.x86_ 135/162 2023-11-26T07:16:05.732 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-26T07:16:05.770 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-26T07:16:05.884 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-26T07:16:05.951 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-26T07:16:05.995 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-26T07:16:06.963 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-26T07:16:07.010 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-26T07:16:07.076 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-26T07:16:08.317 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:18.0.0-7484.g44c2237f.el9.x86_64 128/162 2023-11-26T07:16:08.388 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 129/162 2023-11-26T07:16:08.404 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-top-2:18.0.0-7484.g44c2237f.el9.noarch 142/162 2023-11-26T07:16:08.443 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:18.0.0-7484.g44c2237f.el9.x86_64 130/162 2023-11-26T07:16:08.480 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-26T07:16:08.527 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-26T07:16:08.591 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-26T07:16:08.660 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-26T07:16:08.746 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-26T07:16:08.844 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-26T07:16:08.879 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-26T07:16:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-26T07:16:08.912 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-26T07:16:08.946 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-26T07:16:08.950 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 134/162 2023-11-26T07:16:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:18.0.0-7484.g44c2237f.el9.x86_ 135/162 2023-11-26T07:16:08.996 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-26T07:16:08.997 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-26T07:16:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-26T07:16:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-26T07:16:09.128 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-26T07:16:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-26T07:16:09.172 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-26T07:16:09.218 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-26T07:16:09.236 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-26T07:16:09.250 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-26T07:16:09.250 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-26T07:16:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-26T07:16:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-26T07:16:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-26T07:16:09.491 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-26T07:16:09.491 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-26T07:16:09.826 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-26T07:16:09.826 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-26T07:16:10.021 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-26T07:16:10.062 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-26T07:16:10.096 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-26T07:16:10.130 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-26T07:16:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-26T07:16:10.258 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-26T07:16:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-26T07:16:10.345 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-26T07:16:10.523 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-26T07:16:10.523 INFO:teuthology.orchestra.run.smithi159.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-26T07:16:10.523 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:11.685 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-top-2:18.0.0-7484.g44c2237f.el9.noarch 142/162 2023-11-26T07:16:11.809 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-26T07:16:11.863 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-26T07:16:11.950 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-26T07:16:12.140 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-26T07:16:12.176 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-26T07:16:12.209 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-26T07:16:12.252 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-26T07:16:12.295 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-26T07:16:12.295 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-26T07:16:12.427 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-26T07:16:12.470 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-26T07:16:12.516 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-26T07:16:12.582 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-26T07:16:12.582 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-26T07:16:12.711 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-26T07:16:12.750 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-26T07:16:12.788 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-26T07:16:12.789 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-26T07:16:13.132 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-26T07:16:13.132 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-26T07:16:13.275 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-26T07:16:13.311 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-26T07:16:13.344 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-26T07:16:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-26T07:16:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-26T07:16:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-26T07:16:13.754 INFO:teuthology.orchestra.run.smithi077.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-26T07:16:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:15.053 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:18.0.0-7484.g44c2237f.el9.x86_64 1/162 2023-11-26T07:16:15.053 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:18.0.0-7484.g44c2237f.el9.x86_64 2/162 2023-11-26T07:16:15.053 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 3/162 2023-11-26T07:16:15.053 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 4/162 2023-11-26T07:16:15.053 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.g44c22 5/162 2023-11-26T07:16:15.053 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:18.0.0-7484.g44c2237f.el9.x86_64 6/162 2023-11-26T07:16:15.054 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:18.0.0-7484.g44c2237f.el9.x86_64 7/162 2023-11-26T07:16:15.054 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:18.0.0-7484.g44c2237f.el9.x86_64 8/162 2023-11-26T07:16:15.054 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:18.0.0-7484.g44c2237f.el9.x86_64 9/162 2023-11-26T07:16:15.054 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.g44c2237f.el9.x86_64 10/162 2023-11-26T07:16:15.054 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:18.0.0-7484.g44c2237f.el9.x86_64 11/162 2023-11-26T07:16:15.054 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:18.0.0-7484.g44c2237f.el9.x86_64 12/162 2023-11-26T07:16:15.054 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 13/162 2023-11-26T07:16:15.054 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.g44c2237f.el9.x86_ 14/162 2023-11-26T07:16:15.054 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:18.0.0-7484.g44c2237f.el9.x86_64 15/162 2023-11-26T07:16:15.054 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:18.0.0-7484.g44c2237f.el9.x86_64 16/162 2023-11-26T07:16:15.054 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:18.0.0-7484.g44c2237f.el9.x86_6 17/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:18.0.0-7484.g44c2237f.el9.x86 18/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:18.0.0-7484.g44c2237f.el9.x86_64 19/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el 20/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.g44c2237f.el9. 21/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:18.0.0-7484.g44c2237f.el9.x86_6 22/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:18.0.0-7484.g44c2237f.el9.x86_64 23/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:18.0.0-7484.g44c2237f.el9.x86_64 24/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:18.0.0-7484.g44c2237f.el9.x86_64 25/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 26/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 27/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:18.0.0-7484.g44c2237f.el9.x86_64 28/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f. 29/162 2023-11-26T07:16:15.055 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el9.noa 30/162 2023-11-26T07:16:15.056 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el9.n 31/162 2023-11-26T07:16:15.067 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 32/162 2023-11-26T07:16:15.067 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el 33/162 2023-11-26T07:16:15.067 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el9.noarch 34/162 2023-11-26T07:16:15.067 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.e 35/162 2023-11-26T07:16:15.067 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-volume-2:18.0.0-7484.g44c2237f.el9.noarch 36/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:18.0.0-7484.g44c2237f.el9.noarch 37/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-top-2:18.0.0-7484.g44c2237f.el9.noarch 38/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-26T07:16:15.068 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-26T07:16:15.069 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-26T07:16:15.070 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-26T07:16:15.071 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-26T07:16:15.072 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-26T07:16:15.073 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-26T07:16:15.074 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-26T07:16:15.074 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-26T07:16:15.074 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-26T07:16:15.074 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-26T07:16:15.074 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-26T07:16:15.074 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-26T07:16:15.074 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-26T07:16:15.074 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-26T07:16:15.074 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-26T07:16:15.074 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-26T07:16:15.074 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-26T07:16:15.075 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-26T07:16:15.075 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-26T07:16:15.075 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-26T07:16:15.075 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-26T07:16:15.075 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-26T07:16:15.075 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-26T07:16:15.075 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-26T07:16:15.075 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-26T07:16:15.075 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:18.0.0-7484.g44c2237f.el9.x86_64 133/162 2023-11-26T07:16:15.075 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-26T07:16:15.075 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:18.0.0-7484.g44c2237f.el9.x86_64 135/162 2023-11-26T07:16:15.077 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-26T07:16:15.077 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-26T07:16:15.077 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-26T07:16:15.077 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-26T07:16:15.077 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-26T07:16:15.077 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-26T07:16:15.077 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-26T07:16:15.077 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-26T07:16:15.077 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-26T07:16:15.077 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-26T07:16:15.078 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-26T07:16:15.078 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-26T07:16:15.078 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-26T07:16:15.078 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-26T07:16:15.078 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-26T07:16:15.078 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-26T07:16:15.078 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-26T07:16:15.078 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-26T07:16:15.078 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-26T07:16:15.078 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-26T07:16:15.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-26T07:16:15.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-26T07:16:15.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-26T07:16:15.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-26T07:16:15.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-26T07:16:15.079 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-26T07:16:17.222 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-26T07:16:17.222 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:17.222 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2023-11-26T07:16:17.222 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-26T07:16:17.222 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-26T07:16:17.222 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: acl-2.3.1-4.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-26T07:16:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout: automake-1.16.2-8.el9.noarch 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout: bison-3.7.4-5.el9.x86_64 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.224 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:17.225 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: flex-2.6.4-9.el9.x86_64 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: jq-1.6-16.el9.x86_64 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-26T07:16:17.226 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-26T07:16:17.227 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-26T07:16:17.227 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.227 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.227 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.227 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-26T07:16:17.227 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-26T07:16:17.227 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-26T07:16:17.227 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-26T07:16:17.227 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-26T07:16:17.227 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.227 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-26T07:16:17.228 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-13.11-1.el9.x86_64 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-26T07:16:17.230 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-26T07:16:17.231 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply-3.11-14.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-26T07:16:17.232 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.233 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.234 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:17.234 INFO:teuthology.orchestra.run.smithi159.stdout: re2-1:20211101-3.el9.x86_64 2023-11-26T07:16:17.234 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-26T07:16:17.234 INFO:teuthology.orchestra.run.smithi159.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-26T07:16:17.234 INFO:teuthology.orchestra.run.smithi159.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-26T07:16:17.234 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-26T07:16:17.234 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-26T07:16:17.234 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-26T07:16:17.234 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:17.235 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2023-11-26T07:16:17.812 DEBUG:teuthology.parallel:result is None 2023-11-26T07:16:18.458 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:18.0.0-7484.g44c2237f.el9.x86_64 1/162 2023-11-26T07:16:18.458 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:18.0.0-7484.g44c2237f.el9.x86_64 2/162 2023-11-26T07:16:18.458 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 3/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 4/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.g44c22 5/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:18.0.0-7484.g44c2237f.el9.x86_64 6/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:18.0.0-7484.g44c2237f.el9.x86_64 7/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:18.0.0-7484.g44c2237f.el9.x86_64 8/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:18.0.0-7484.g44c2237f.el9.x86_64 9/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.g44c2237f.el9.x86_64 10/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:18.0.0-7484.g44c2237f.el9.x86_64 11/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:18.0.0-7484.g44c2237f.el9.x86_64 12/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 13/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.g44c2237f.el9.x86_ 14/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:18.0.0-7484.g44c2237f.el9.x86_64 15/162 2023-11-26T07:16:18.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:18.0.0-7484.g44c2237f.el9.x86_64 16/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:18.0.0-7484.g44c2237f.el9.x86_6 17/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:18.0.0-7484.g44c2237f.el9.x86 18/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:18.0.0-7484.g44c2237f.el9.x86_64 19/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el 20/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.g44c2237f.el9. 21/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:18.0.0-7484.g44c2237f.el9.x86_6 22/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:18.0.0-7484.g44c2237f.el9.x86_64 23/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:18.0.0-7484.g44c2237f.el9.x86_64 24/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:18.0.0-7484.g44c2237f.el9.x86_64 25/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 26/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 27/162 2023-11-26T07:16:18.460 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:18.0.0-7484.g44c2237f.el9.x86_64 28/162 2023-11-26T07:16:18.470 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f. 29/162 2023-11-26T07:16:18.470 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el9.noa 30/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el9.n 31/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 32/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el 33/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el9.noarch 34/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.e 35/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:18.0.0-7484.g44c2237f.el9.noarch 36/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:18.0.0-7484.g44c2237f.el9.noarch 37/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-top-2:18.0.0-7484.g44c2237f.el9.noarch 38/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-26T07:16:18.471 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-26T07:16:18.472 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-26T07:16:18.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-26T07:16:18.474 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-26T07:16:18.475 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-26T07:16:18.476 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-26T07:16:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-26T07:16:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-26T07:16:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-26T07:16:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-26T07:16:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-26T07:16:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-26T07:16:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-26T07:16:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-26T07:16:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-26T07:16:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-26T07:16:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-26T07:16:18.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:18.0.0-7484.g44c2237f.el9.x86_64 133/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:18.0.0-7484.g44c2237f.el9.x86_64 135/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-26T07:16:18.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-26T07:16:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-26T07:16:18.481 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-26T07:16:18.481 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-26T07:16:18.481 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-26T07:16:18.481 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-26T07:16:18.481 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-26T07:16:18.481 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-26T07:16:20.689 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-26T07:16:20.689 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:20.689 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2023-11-26T07:16:20.689 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: acl-2.3.1-4.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.690 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout: automake-1.16.2-8.el9.noarch 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout: bison-3.7.4-5.el9.x86_64 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:20.691 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.692 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top-2:18.0.0-7484.g44c2237f.el9.noarch 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: flex-2.6.4-9.el9.x86_64 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: jq-1.6-16.el9.x86_64 2023-11-26T07:16:20.693 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.694 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-26T07:16:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-13.11-1.el9.x86_64 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-26T07:16:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-26T07:16:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-26T07:16:20.698 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-26T07:16:20.699 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-26T07:16:20.700 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.701 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.701 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:18.0.0-7484.g44c2237f.el9.x86_64 2023-11-26T07:16:20.701 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-3.el9.x86_64 2023-11-26T07:16:20.701 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-26T07:16:20.701 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-26T07:16:20.701 INFO:teuthology.orchestra.run.smithi077.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-26T07:16:20.701 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-26T07:16:20.701 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-26T07:16:20.701 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-26T07:16:20.701 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:20.701 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2023-11-26T07:16:21.388 DEBUG:teuthology.parallel:result is None 2023-11-26T07:16:21.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:16:21.609 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-26T07:16:21.664 INFO:teuthology.orchestra.run.smithi077.stdout:18.0.0-7484.g44c2237f.el9 2023-11-26T07:16:21.664 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.g44c2237f.el9 2023-11-26T07:16:21.664 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.g44c2237f is installed. 2023-11-26T07:16:21.665 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:16:21.799 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-26T07:16:21.867 INFO:teuthology.orchestra.run.smithi159.stdout:18.0.0-7484.g44c2237f.el9 2023-11-26T07:16:21.867 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.g44c2237f.el9 2023-11-26T07:16:21.867 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.g44c2237f is installed. 2023-11-26T07:16:21.867 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-26T07:16:21.867 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:16:21.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-26T07:16:21.946 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:16:21.946 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-26T07:16:22.025 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-26T07:16:22.025 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:16:22.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2023-11-26T07:16:22.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-26T07:16:22.220 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:16:22.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2023-11-26T07:16:22.306 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-26T07:16:22.421 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-26T07:16:22.421 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:16:22.421 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-26T07:16:22.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-26T07:16:22.622 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:16:22.622 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-26T07:16:22.703 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-26T07:16:22.822 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-26T07:16:22.822 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:16:22.822 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2023-11-26T07:16:22.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-26T07:16:23.026 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:16:23.026 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2023-11-26T07:16:23.101 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-26T07:16:23.238 INFO:teuthology.run_tasks:Running task ceph... 2023-11-26T07:16:23.303 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-26T07:16:23.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2023-11-26T07:16:23.308 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /var/log/ceph 2023-11-26T07:16:23.414 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-26T07:16:23.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-26T07:16:23.419 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-26T07:16:23.510 INFO:tasks.ceph:Creating extra log directories... 2023-11-26T07:16:23.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-26T07:16:23.515 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-26T07:16:23.617 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-26T07:16:23.617 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-26T07:16:23.617 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-26T07:16:23.617 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:16:23.617 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-26T07:16:23.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:23.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:23.947 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:16:23.947 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-26T07:16:24.004 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:24.312 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:24.412 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-26T07:16:24.412 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-26T07:16:24.412 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}', 'email': None, 'first_in_suite': False, 'job_id': '7467351', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mgr-vol-misc', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1863, 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'rishabh-mgr-vol-misc', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM/ATFn2p0pwIyeNjWm72qoXq3rg+iTZFIlhhCYpbsSXLiPEAjkpLBV2LltLg0yO82BbJAWCERqN+lc6fA+6YA=', 'smithi159.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4K/8XUKafj24hIFBgmXqB1H2JY1MwqMBlgBgCc2Ayt1MZFqLRuNcBu5kqkr9jddzcZxW06vijAfW0QJT5M9ZU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-26_06:51:12', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-26T07:16:24.413 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-26T07:16:24.418 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-26T07:16:24.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2023-11-26T07:16:24.505 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/run/ceph 2023-11-26T07:16:24.604 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:16:24.604 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2023-11-26T07:16:24.647 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-26T07:16:24.647 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2023-11-26T07:16:24.729 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-26T07:16:24.729 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:24.729 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-11-26T07:16:24.729 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:24.729 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:16:24.729 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-11-26 07:16:14.188120904 +0000 2023-11-26T07:16:24.730 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-11-26 07:13:44.319304648 +0000 2023-11-26T07:16:24.730 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-11-26 07:13:44.320304625 +0000 2023-11-26T07:16:24.730 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2023-11-26 07:13:44.319304648 +0000 2023-11-26T07:16:24.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-26T07:16:24.845 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:16:24.845 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:16:24.846 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000349046 s, 1.5 MB/s 2023-11-26T07:16:24.848 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-26T07:16:24.890 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2023-11-26T07:16:24.973 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-26T07:16:24.973 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 650 Links: 1 2023-11-26T07:16:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:16:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-11-26 07:16:14.189120882 +0000 2023-11-26T07:16:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-11-26 07:13:45.322281872 +0000 2023-11-26T07:16:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-11-26 07:13:45.322281872 +0000 2023-11-26T07:16:24.973 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2023-11-26 07:13:45.322281872 +0000 2023-11-26T07:16:24.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-26T07:16:25.099 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:16:25.100 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:16:25.100 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000330162 s, 1.6 MB/s 2023-11-26T07:16:25.103 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-26T07:16:25.147 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2023-11-26T07:16:25.232 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-26T07:16:25.233 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:25.233 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 670 Links: 1 2023-11-26T07:16:25.233 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:25.233 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:16:25.233 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-11-26 07:16:14.189120882 +0000 2023-11-26T07:16:25.233 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-11-26 07:13:46.328259027 +0000 2023-11-26T07:16:25.233 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-11-26 07:13:46.328259027 +0000 2023-11-26T07:16:25.233 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2023-11-26 07:13:46.328259027 +0000 2023-11-26T07:16:25.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-26T07:16:25.342 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:16:25.342 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:16:25.343 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000311199 s, 1.6 MB/s 2023-11-26T07:16:25.345 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-26T07:16:25.388 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2023-11-26T07:16:25.470 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-26T07:16:25.470 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:25.470 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 688 Links: 1 2023-11-26T07:16:25.470 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:25.470 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:16:25.470 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-11-26 07:16:14.190120859 +0000 2023-11-26T07:16:25.471 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-11-26 07:13:47.325236388 +0000 2023-11-26T07:16:25.471 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-11-26 07:13:47.325236388 +0000 2023-11-26T07:16:25.471 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2023-11-26 07:13:47.325236388 +0000 2023-11-26T07:16:25.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-26T07:16:25.584 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:16:25.584 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:16:25.584 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000339502 s, 1.5 MB/s 2023-11-26T07:16:25.587 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-26T07:16:25.641 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:16:25.641 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:16:25.641 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2023-11-26T07:16:25.700 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-26T07:16:25.701 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2023-11-26T07:16:25.754 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-26T07:16:25.754 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:25.754 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 635 Links: 1 2023-11-26T07:16:25.754 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:25.754 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:16:25.754 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-11-26 07:16:10.953804998 +0000 2023-11-26T07:16:25.754 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-11-26 07:13:43.239425481 +0000 2023-11-26T07:16:25.754 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-11-26 07:13:43.239425481 +0000 2023-11-26T07:16:25.754 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-11-26 07:13:43.239425481 +0000 2023-11-26T07:16:25.754 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-26T07:16:25.848 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-11-26T07:16:25.848 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-11-26T07:16:25.848 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000363592 s, 1.4 MB/s 2023-11-26T07:16:25.852 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-26T07:16:25.907 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2023-11-26T07:16:25.955 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-26T07:16:25.956 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:25.956 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 657 Links: 1 2023-11-26T07:16:25.956 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:25.956 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:16:25.956 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-11-26 07:16:10.954804979 +0000 2023-11-26T07:16:25.956 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-11-26 07:13:44.236406701 +0000 2023-11-26T07:16:25.956 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-11-26 07:13:44.236406701 +0000 2023-11-26T07:16:25.956 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-11-26 07:13:44.236406701 +0000 2023-11-26T07:16:25.956 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-26T07:16:26.045 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-11-26T07:16:26.045 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-11-26T07:16:26.045 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000337194 s, 1.5 MB/s 2023-11-26T07:16:26.049 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-26T07:16:26.105 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2023-11-26T07:16:26.157 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-26T07:16:26.157 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:26.157 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 676 Links: 1 2023-11-26T07:16:26.157 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:26.157 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:16:26.157 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-11-26 07:16:10.954804979 +0000 2023-11-26T07:16:26.157 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-11-26 07:13:45.242387752 +0000 2023-11-26T07:16:26.157 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-11-26 07:13:45.242387752 +0000 2023-11-26T07:16:26.157 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-11-26 07:13:45.242387752 +0000 2023-11-26T07:16:26.157 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-26T07:16:26.246 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-11-26T07:16:26.246 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-11-26T07:16:26.246 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.00033836 s, 1.5 MB/s 2023-11-26T07:16:26.249 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-26T07:16:26.301 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2023-11-26T07:16:26.344 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-26T07:16:26.345 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:26.345 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 694 Links: 1 2023-11-26T07:16:26.345 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:26.345 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:16:26.345 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-11-26 07:16:10.955804960 +0000 2023-11-26T07:16:26.345 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-11-26 07:13:46.234369066 +0000 2023-11-26T07:16:26.345 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-11-26 07:13:46.234369066 +0000 2023-11-26T07:16:26.345 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-11-26 07:13:46.234369066 +0000 2023-11-26T07:16:26.345 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-26T07:16:26.468 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-11-26T07:16:26.468 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-11-26T07:16:26.468 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.00029325 s, 1.7 MB/s 2023-11-26T07:16:26.471 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-26T07:16:26.520 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:16:26.521 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-26T07:16:26.521 INFO:tasks.ceph:Generating config... 2023-11-26T07:16:26.522 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-26T07:16:26.522 INFO:tasks.ceph:[client] debug client = 20 2023-11-26T07:16:26.522 INFO:tasks.ceph:[client] debug ms = 1 2023-11-26T07:16:26.522 INFO:tasks.ceph:[client] pid file = 2023-11-26T07:16:26.522 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-26T07:16:26.522 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-26T07:16:26.522 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-26T07:16:26.522 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-26T07:16:26.523 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-26T07:16:26.524 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-26T07:16:26.524 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-26T07:16:26.524 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-26T07:16:26.524 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-26T07:16:26.524 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-26T07:16:26.524 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-26T07:16:26.524 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-26T07:16:26.524 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-26T07:16:26.524 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-26T07:16:26.524 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-26T07:16:26.524 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-26T07:16:26.524 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-26T07:16:26.524 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-26T07:16:26.525 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-26T07:16:26.525 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-26T07:16:26.525 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-26T07:16:26.525 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-26T07:16:26.525 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-26T07:16:26.525 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-26T07:16:26.525 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-26T07:16:26.525 INFO:tasks.ceph:Setting up mon.a... 2023-11-26T07:16:26.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-26T07:16:26.677 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.keyring 2023-11-26T07:16:26.683 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-26T07:16:26.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-26T07:16:26.896 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.77'), ('mon.b', '172.21.15.159'), ('mon.c', '[v2:172.21.15.159:3301,v1:172.21.15.159:6790]')] 2023-11-26T07:16:26.897 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.77,172.21.15.159,[v2:172.21.15.159:3301,v1:172.21.15.159:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-26T07:16:26.898 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:16:26.898 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-26T07:16:26.954 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.77 --add b 172.21.15.159 --addv c '[v2:172.21.15.159:3301,v1:172.21.15.159:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:16:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:16:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: generated fsid 957368bd-e942-499b-9938-86266ae9bafb 2023-11-26T07:16:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = pacific 2023-11-26T07:16:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 0 2023-11-26T07:16:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:fsid 957368bd-e942-499b-9938-86266ae9bafb 2023-11-26T07:16:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:last_changed 2023-11-26T07:16:27.108258+0000 2023-11-26T07:16:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:created 2023-11-26T07:16:27.108258+0000 2023-11-26T07:16:27.110 INFO:teuthology.orchestra.run.smithi077.stdout:min_mon_release 16 (pacific) 2023-11-26T07:16:27.110 INFO:teuthology.orchestra.run.smithi077.stdout:election_strategy: 1 2023-11-26T07:16:27.110 INFO:teuthology.orchestra.run.smithi077.stdout:0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2023-11-26T07:16:27.110 INFO:teuthology.orchestra.run.smithi077.stdout:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2023-11-26T07:16:27.110 INFO:teuthology.orchestra.run.smithi077.stdout:2: [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] mon.c 2023-11-26T07:16:27.110 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-26T07:16:27.112 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-26T07:16:27.163 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 957368bd-e942-499b-9938-86266ae9bafb... 2023-11-26T07:16:27.164 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-26T07:16:27.169 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-26T07:16:27.324 INFO:teuthology.orchestra.run.smithi159.stdout:[global] 2023-11-26T07:16:27.324 INFO:teuthology.orchestra.run.smithi159.stdout: chdir = "" 2023-11-26T07:16:27.324 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-26T07:16:27.324 INFO:teuthology.orchestra.run.smithi159.stdout: auth supported = cephx 2023-11-26T07:16:27.324 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.324 INFO:teuthology.orchestra.run.smithi159.stdout: filestore xattr use omap = true 2023-11-26T07:16:27.324 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.324 INFO:teuthology.orchestra.run.smithi159.stdout: mon clock drift allowed = 1.000 2023-11-26T07:16:27.324 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.324 INFO:teuthology.orchestra.run.smithi159.stdout: osd crush chooseleaf type = 0 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: auth debug = true 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on old message = true 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on bug = true 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: mon pg warn max object skew = 0 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: # disable pg_autoscaler by default for new pools 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.325 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default size = 2 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow primary affinity = true 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow pg remap = true 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on legacy crush tunables = false 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on crush straw calc version zero = false 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on no sortbitwise = false 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on osd down out interval zero = false 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on too few osds = false 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: mon_allow_pool_size_one = true 2023-11-26T07:16:27.326 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: osd default data pool replay window = 5 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: mon allow pool delete = true 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: mon cluster log file level = debug 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: debug asserts on shutdown = true 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: mon health detail to clog = false 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: mon host = "172.21.15.77,172.21.15.159,[v2:172.21.15.159:3301,v1:172.21.15.159:6790]" 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on skipped message = False 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: fsid = 957368bd-e942-499b-9938-86266ae9bafb 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.327 INFO:teuthology.orchestra.run.smithi159.stdout:[osd] 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: osd journal size = 100 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub load threshold = 5.0 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub max interval = 600 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: osd mclock profile = high_recovery_ops 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: osd recover clone overlap = true 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: osd recovery max chunk = 1048576 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug shutdown = true 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug op order = true 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug verify stray on activate = true 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug trim objects = true 2023-11-26T07:16:27.328 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: osd open classes on start = true 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug pg log writeout = true 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: osd deep scrub update digest min age = 30 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: osd map max advance = 10 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: journal zero on create = true 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: filestore ondisk finisher threads = 3 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: filestore apply finisher threads = 3 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.329 INFO:teuthology.orchestra.run.smithi159.stdout: bdev debug aio = true 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug misdirected ops = true 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: bdev async discard = True 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: bdev enable discard = True 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore allocator = bitmap 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore block size = 96636764160 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore fsck on mount = True 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluefs = 1/20 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluestore = 1/20 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: debug osd = 20 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: debug rocksdb = 4/10 2023-11-26T07:16:27.330 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd backfillfull_ratio = 0.85 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd full ratio = 0.9 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd nearfull ratio = 0.8 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: osd failsafe full ratio = 0.95 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: osd objectstore = bluestore 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: osd op complaint time = 180 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr] 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: debug mgr = 20 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:16:27.331 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: mgr/telemetry/nag = false 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: debug client = 20 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: debug finisher = 20 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout:[mon] 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: debug paxos = 20 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: mon data avail warn = 5 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: mon mgr mkfs grace = 240 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd reporter subtree level = osd 2023-11-26T07:16:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd prime pg temp = true 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: auth mon ticket ttl = 660 # 11m 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: auth service ticket ttl = 240 # 4m 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: # don't complain about insecure global_id in the test suite 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: # 1m isn't quite enough 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: mon_down_mkfs_grace = 2m 2023-11-26T07:16:27.333 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_filestore_osds = false 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout: mon op complaint time = 120 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout:[client] 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout: rgw cache enabled = true 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable ops log = true 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable usage log = true 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout: client mount timeout = 600 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout: debug client = 20 2023-11-26T07:16:27.334 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = "" 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout: rados mon op timeout = 900 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout: rados osd op timeout = 900 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.a] 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.b] 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.c] 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a] 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c] 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b] 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.d] 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout:[mds] 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout: debug mds = 20 2023-11-26T07:16:27.335 INFO:teuthology.orchestra.run.smithi159.stdout: debug mds balancer = 20 2023-11-26T07:16:27.336 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-11-26T07:16:27.336 INFO:teuthology.orchestra.run.smithi159.stdout: mds debug frag = True 2023-11-26T07:16:27.336 INFO:teuthology.orchestra.run.smithi159.stdout: mds debug scatterstat = True 2023-11-26T07:16:27.336 INFO:teuthology.orchestra.run.smithi159.stdout: mds op complaint time = 180 2023-11-26T07:16:27.336 INFO:teuthology.orchestra.run.smithi159.stdout: mds verify scatter = True 2023-11-26T07:16:27.336 INFO:teuthology.orchestra.run.smithi159.stdout: osd op complaint time = 180 2023-11-26T07:16:27.336 INFO:teuthology.orchestra.run.smithi159.stdout: rados mon op timeout = 900 2023-11-26T07:16:27.336 INFO:teuthology.orchestra.run.smithi159.stdout: rados osd op timeout = 900 2023-11-26T07:16:27.336 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2023-11-26T07:16:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2023-11-26T07:16:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2023-11-26T07:16:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.77,172.21.15.159,[v2:172.21.15.159:3301,v1:172.21.15.159:6790]" 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on skipped message = False 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 957368bd-e942-499b-9938-86266ae9bafb 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: bdev async discard = True 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: bdev enable discard = True 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore allocator = bitmap 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2023-11-26T07:16:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 1/20 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 1/20 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 4/10 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.343 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: debug finisher = 20 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2023-11-26T07:16:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: mon op complaint time = 120 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2023-11-26T07:16:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 600 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2023-11-26T07:16:27.347 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds = 20 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds balancer = 20 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug frag = True 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = True 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: mds op complaint time = 180 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = True 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2023-11-26T07:16:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2023-11-26T07:16:27.377 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-26T07:16:27.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-26T07:16:27.524 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-26T07:16:27.525 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:16:27.525 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-26T07:16:27.575 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:16:27.575 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-26T07:16:27.673 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:16:27.673 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:16:27.673 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-26T07:16:27.673 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-26T07:16:27.820 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:16:27.821 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:16:27.919 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:16:27.919 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:16:27.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-26T07:16:27.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-26T07:16:28.074 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:16:28.074 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:16:28.173 INFO:tasks.ceph:Setting up mon nodes... 2023-11-26T07:16:28.174 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-26T07:16:28.174 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-26T07:16:28.352 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-26T07:16:28.359 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-26T07:16:28.552 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-26T07:16:28.562 INFO:tasks.ceph:Setting up mds nodes... 2023-11-26T07:16:28.563 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-26T07:16:28.722 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-26T07:16:28.727 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-26T07:16:28.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-26T07:16:28.951 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-26T07:16:28.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-26T07:16:29.039 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-26T07:16:29.227 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-26T07:16:29.236 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-26T07:16:29.333 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-26T07:16:29.511 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-26T07:16:29.520 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-26T07:16:29.609 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-26T07:16:29.609 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-26T07:16:29.731 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-26T07:16:29.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-26T07:16:29.917 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-26T07:16:29.975 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-26T07:16:30.108 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-26T07:16:30.168 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-26T07:16:30.294 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-26T07:16:30.349 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-26T07:16:30.350 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-26T07:16:30.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-26T07:16:30.454 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:16:30.454 INFO:tasks.ceph:role: osd.0 2023-11-26T07:16:30.454 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:16:30.454 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-26T07:16:30.555 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:16:30.555 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:16:30.556 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:16:30.556 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-26T07:16:30.556 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:16:30.556 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:16:30.556 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:16:30.556 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-26T07:16:30.556 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:16:30.556 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:16:31.076 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-11-26T07:16:31.083 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-11-26T07:16:31.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-26T07:16:31.278 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-26T07:16:31.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-26T07:16:31.483 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:16:31.483 INFO:tasks.ceph:role: osd.1 2023-11-26T07:16:31.483 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:16:31.483 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-26T07:16:31.581 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:16:31.581 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:16:31.581 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:16:31.582 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-26T07:16:31.582 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:16:31.582 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:16:31.582 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:16:31.582 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-26T07:16:31.582 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:16:31.582 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:16:32.071 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-11-26T07:16:32.078 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-11-26T07:16:32.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-26T07:16:32.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-26T07:16:32.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-26T07:16:32.421 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:16:32.422 INFO:tasks.ceph:role: osd.2 2023-11-26T07:16:32.422 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:16:32.422 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-26T07:16:32.517 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:16:32.517 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:16:32.517 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:16:32.517 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-26T07:16:32.517 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:16:32.517 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:16:32.517 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:16:32.517 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-26T07:16:32.518 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:16:32.518 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:16:33.034 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-11-26T07:16:33.041 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-11-26T07:16:33.041 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-26T07:16:33.243 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-26T07:16:33.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-26T07:16:33.447 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:16:33.447 INFO:tasks.ceph:role: osd.3 2023-11-26T07:16:33.447 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:16:33.447 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-26T07:16:33.549 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:16:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:16:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:16:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-26T07:16:33.549 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:16:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:16:33.550 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:16:33.550 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-26T07:16:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:16:33.550 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:16:34.017 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-11-26T07:16:34.023 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-11-26T07:16:34.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-26T07:16:34.165 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-26T07:16:34.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:16:34.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:34.395+0000 7f69dc4a9500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-26T07:16:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:34.396+0000 7f69dc4a9500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-26T07:16:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:34.397+0000 7f69dc4a9500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-26T07:16:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:34.397+0000 7f69dc4a9500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-26T07:16:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:34.397+0000 7f69dc4a9500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-26T07:16:34.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:34.400+0000 7f69dc4a9500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-26T07:16:37.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-26T07:16:37.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:16:37.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:37.573+0000 7f2936025500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-26T07:16:37.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:37.573+0000 7f2936025500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-26T07:16:37.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:37.573+0000 7f2936025500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-26T07:16:37.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:37.574+0000 7f2936025500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-26T07:16:37.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:37.574+0000 7f2936025500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-26T07:16:37.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:37.576+0000 7f2936025500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-26T07:16:40.753 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-26T07:16:40.853 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:16:40.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:40.987+0000 7f3c6ee19500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-26T07:16:40.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:40.988+0000 7f3c6ee19500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-26T07:16:40.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:40.988+0000 7f3c6ee19500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-26T07:16:40.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:40.988+0000 7f3c6ee19500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-26T07:16:40.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:40.988+0000 7f3c6ee19500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-26T07:16:40.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:40.990+0000 7f3c6ee19500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-26T07:16:44.159 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-26T07:16:44.256 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:16:44.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:44.395+0000 7effb1025500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-26T07:16:44.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:44.396+0000 7effb1025500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-26T07:16:44.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:44.396+0000 7effb1025500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-26T07:16:44.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:44.396+0000 7effb1025500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-26T07:16:44.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:44.396+0000 7effb1025500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-26T07:16:44.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:16:44.398+0000 7effb1025500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-26T07:16:47.317 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-26T07:16:47.411 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-26T07:16:47.510 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:16:47.511 INFO:tasks.ceph:role: osd.4 2023-11-26T07:16:47.511 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:16:47.511 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:16:48.141 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-11-26T07:16:48.148 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-11-26T07:16:48.148 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-26T07:16:48.353 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-26T07:16:48.455 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-26T07:16:48.548 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:16:48.548 INFO:tasks.ceph:role: osd.5 2023-11-26T07:16:48.548 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:16:48.548 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-26T07:16:48.649 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:16:48.649 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:16:48.649 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:16:48.649 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-26T07:16:48.649 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:16:48.649 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:16:48.649 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:16:48.649 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-26T07:16:48.650 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:16:48.650 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:16:49.139 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-11-26T07:16:49.145 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-11-26T07:16:49.145 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-26T07:16:49.279 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-26T07:16:49.369 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-26T07:16:49.461 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:16:49.461 INFO:tasks.ceph:role: osd.6 2023-11-26T07:16:49.461 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:16:49.461 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-26T07:16:49.561 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:16:49.561 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:16:49.561 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:16:49.562 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-26T07:16:49.562 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:16:49.562 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:16:49.562 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:16:49.562 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-26T07:16:49.562 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:16:49.562 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:16:50.103 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-11-26T07:16:50.108 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-11-26T07:16:50.108 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-26T07:16:50.300 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-26T07:16:50.403 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-26T07:16:50.495 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:16:50.495 INFO:tasks.ceph:role: osd.7 2023-11-26T07:16:50.495 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:16:50.496 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-26T07:16:50.592 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:16:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:16:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:16:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-26T07:16:50.592 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:16:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:16:50.592 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:16:50.592 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-26T07:16:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:16:50.592 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:16:51.048 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-11-26T07:16:51.054 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-11-26T07:16:51.054 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-26T07:16:51.208 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-26T07:16:51.309 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:16:51.463 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:51.462+0000 7f737d81d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-26T07:16:51.466 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:51.464+0000 7f737d81d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-26T07:16:51.466 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:51.464+0000 7f737d81d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-26T07:16:51.467 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:51.465+0000 7f737d81d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-26T07:16:51.467 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:51.465+0000 7f737d81d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-26T07:16:51.469 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:51.468+0000 7f737d81d500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-26T07:16:54.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:54.423 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:54.667 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-26T07:16:54.767 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:16:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:54.904+0000 7fa94b68c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-26T07:16:54.908 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:54.905+0000 7fa94b68c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-26T07:16:54.908 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:54.905+0000 7fa94b68c500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-26T07:16:54.908 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:54.905+0000 7fa94b68c500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-26T07:16:54.908 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:54.905+0000 7fa94b68c500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-26T07:16:54.910 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:54.907+0000 7fa94b68c500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-26T07:16:58.074 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-26T07:16:58.172 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:16:58.308 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:58.305+0000 7f093b38b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-26T07:16:58.308 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:58.306+0000 7f093b38b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-26T07:16:58.309 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:58.306+0000 7f093b38b500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-26T07:16:58.309 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:58.306+0000 7f093b38b500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-26T07:16:58.309 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:58.306+0000 7f093b38b500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-26T07:16:58.310 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:16:58.308+0000 7f093b38b500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-26T07:17:01.489 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-26T07:17:01.589 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:01.723+0000 7f9559e14500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-26T07:17:01.727 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:01.724+0000 7f9559e14500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-26T07:17:01.727 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:01.724+0000 7f9559e14500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-26T07:17:01.727 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:01.724+0000 7f9559e14500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-26T07:17:01.728 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:01.724+0000 7f9559e14500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-26T07:17:01.729 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:01.727+0000 7f9559e14500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-26T07:17:04.650 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-26T07:17:04.745 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-26T07:17:04.746 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:04.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-26T07:17:04.850 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:04.850 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-26T07:17:04.947 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:04.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-26T07:17:05.044 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:05.045 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-26T07:17:05.137 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:05.137 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-26T07:17:05.260 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:05.260 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-26T07:17:05.388 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:05.388 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-26T07:17:05.472 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:05.472 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-26T07:17:05.574 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:05.574 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-26T07:17:05.673 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:05.673 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-26T07:17:05.771 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:05.771 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-26T07:17:05.865 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:05.865 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-26T07:17:05.959 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:05.959 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-26T07:17:06.053 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:06.053 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-26T07:17:06.151 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:06.151 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-26T07:17:06.201 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:06.201 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-26T07:17:06.293 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:06.293 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-26T07:17:06.351 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:06.351 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-26T07:17:06.403 INFO:tasks.ceph:Adding keys to all mons... 2023-11-26T07:17:06.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-26T07:17:06.412 DEBUG:teuthology.orchestra.run.smithi159:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-26T07:17:06.488 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDM8GJl07f3FBAAL3JjjVDVa3eQe+Phdo0agw== 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDM8GJls/H7KhAAJS2XRN0c7/K+7oskAg2PWQ== 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDM8GJlejOkOBAAdCCERoTPpw8Fk1PciaPtag== 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDS8GJlaI6nFxAARyjS0s1azVjAfqdNZIT4BA== 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDV8GJl+YY9IhAAPh7GuZ2EhEZBybZJJL16gA== 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDY8GJlWjPxOhAApethgteKlUOMhor55mJc9A== 2023-11-26T07:17:06.489 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDc8GJl9OCqFxAAJeYH2CcWuQG8iILjc/PmTw== 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDM8GJlYYTeIBAATi/P7CpbfWNxuKAyi2DChA== 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDN8GJljSp5DRAAOH30kXLDMsVQpQomhskVow== 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDN8GJl5HpoHhAAaW2/GvlUZsizM1A5Gd3U7A== 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDj8GJlVXaWGxAAfxXHfo561p+2qKX1+9C7+A== 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDm8GJlrAsENhAALSWl4bAiy33+ZxX95xvcIw== 2023-11-26T07:17:06.490 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2023-11-26T07:17:06.491 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDq8GJlUm5MEhAAVlkzzyqBJP1qdcuCfwhZmw== 2023-11-26T07:17:06.491 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2023-11-26T07:17:06.491 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDt8GJlhvw+KxAAfn+Rklyv9MbMoGvi64A3eQ== 2023-11-26T07:17:06.491 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-11-26T07:17:06.491 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDN8GJlhqOIKxAAiafAbVhNu4B+yTd/1i7+1A== 2023-11-26T07:17:06.491 INFO:teuthology.orchestra.run.smithi077.stdout:[client.2] 2023-11-26T07:17:06.491 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDN8GJlCgKpNhAAX0HSBMyXxclLtvXwdw4gBQ== 2023-11-26T07:17:06.491 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2023-11-26T07:17:06.491 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDO8GJlTnRuBhAA00v94pDxY21mhcK5h8b5ag== 2023-11-26T07:17:06.491 INFO:teuthology.orchestra.run.smithi077.stdout:[client.3] 2023-11-26T07:17:06.491 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDO8GJlFP2HERAA02DfbslNoErl7daZAir6yw== 2023-11-26T07:17:06.502 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.y] 2023-11-26T07:17:06.502 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDM8GJl07f3FBAAL3JjjVDVa3eQe+Phdo0agw== 2023-11-26T07:17:06.502 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a] 2023-11-26T07:17:06.502 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDM8GJls/H7KhAAJS2XRN0c7/K+7oskAg2PWQ== 2023-11-26T07:17:06.502 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c] 2023-11-26T07:17:06.502 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDM8GJlejOkOBAAdCCERoTPpw8Fk1PciaPtag== 2023-11-26T07:17:06.502 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.0] 2023-11-26T07:17:06.502 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDS8GJlaI6nFxAARyjS0s1azVjAfqdNZIT4BA== 2023-11-26T07:17:06.502 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.1] 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDV8GJl+YY9IhAAPh7GuZ2EhEZBybZJJL16gA== 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.2] 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDY8GJlWjPxOhAApethgteKlUOMhor55mJc9A== 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.3] 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDc8GJl9OCqFxAAJeYH2CcWuQG8iILjc/PmTw== 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.x] 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDM8GJlYYTeIBAATi/P7CpbfWNxuKAyi2DChA== 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b] 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDN8GJljSp5DRAAOH30kXLDMsVQpQomhskVow== 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.d] 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDN8GJl5HpoHhAAaW2/GvlUZsizM1A5Gd3U7A== 2023-11-26T07:17:06.503 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.4] 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDj8GJlVXaWGxAAfxXHfo561p+2qKX1+9C7+A== 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.5] 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDm8GJlrAsENhAALSWl4bAiy33+ZxX95xvcIw== 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.6] 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDq8GJlUm5MEhAAVlkzzyqBJP1qdcuCfwhZmw== 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.7] 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDt8GJlhvw+KxAAfn+Rklyv9MbMoGvi64A3eQ== 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout:[client.0] 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDN8GJlhqOIKxAAiafAbVhNu4B+yTd/1i7+1A== 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout:[client.2] 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDN8GJlCgKpNhAAX0HSBMyXxclLtvXwdw4gBQ== 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout:[client.1] 2023-11-26T07:17:06.504 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDO8GJlTnRuBhAA00v94pDxY21mhcK5h8b5ag== 2023-11-26T07:17:06.505 INFO:teuthology.orchestra.run.smithi159.stdout:[client.3] 2023-11-26T07:17:06.505 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDO8GJlFP2HERAA02DfbslNoErl7daZAir6yw== 2023-11-26T07:17:06.506 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:17:06.540 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:17:06.690 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:06.696 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:06.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:06.851 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:06.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:06.995 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:07.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:07.148 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:07.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:07.297 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:07.440 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:07.446 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:07.586 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:17:07.595 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:17:07.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:07.741 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:07.885 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:07.894 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:08.049 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:08.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:08.205 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:08.213 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:08.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:08.363 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:08.507 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:08.516 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:08.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:08.660 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:08.800 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:08.808 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:08.949 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:08.954 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:09.104 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:09.112 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:09.265 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-26T07:17:09.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-26T07:17:09.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-26T07:17:09.507 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-26T07:17:09.579 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-26T07:17:09.686 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-26T07:17:09.845 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-26T07:17:09.934 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-26T07:17:10.030 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-26T07:17:10.194 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-26T07:17:10.290 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:10.299 DEBUG:teuthology.orchestra.run.smithi159:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:10.355 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-26T07:17:10.356 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-26T07:17:10.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-26T07:17:10.361 INFO:tasks.ceph.mon.a:Started 2023-11-26T07:17:10.362 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-26T07:17:10.362 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-26T07:17:10.367 INFO:tasks.ceph.mon.b:Started 2023-11-26T07:17:10.367 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-26T07:17:10.367 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-26T07:17:10.372 INFO:tasks.ceph.mon.c:Started 2023-11-26T07:17:10.372 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-26T07:17:10.373 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-26T07:17:10.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-26T07:17:10.377 INFO:tasks.ceph.mgr.y:Started 2023-11-26T07:17:10.377 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-26T07:17:10.378 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-26T07:17:10.384 INFO:tasks.ceph.mgr.x:Started 2023-11-26T07:17:10.384 INFO:tasks.ceph:Setting crush tunables to default 2023-11-26T07:17:10.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd crush tunables default 2023-11-26T07:17:10.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.567+0000 7fc4d7567640 1 Processor -- start 2023-11-26T07:17:10.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.567+0000 7fc4d7567640 1 -- start start 2023-11-26T07:17:10.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.568+0000 7fc4d7567640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 0x7fc4d00d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:10.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.568+0000 7fc4d7567640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc4d00b2050 0x7fc4d00d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:10.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.568+0000 7fc4d7567640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d00b41b0 con 0x7fc4d0160dd0 2023-11-26T07:17:10.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.568+0000 7fc4d7567640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d00b4490 con 0x7fc4d00b2050 2023-11-26T07:17:10.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.568+0000 7fc4d7567640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00b0090 con 0x7fc4d01609f0 2023-11-26T07:17:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.568+0000 7fc4d6565640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 0x7fc4d00d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.569+0000 7fc4d6565640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 0x7fc4d00d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:58394/0 (socket says 172.21.15.77:58394) 2023-11-26T07:17:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.569+0000 7fc4d6565640 1 -- 172.21.15.77:0/897764857 learned_addr learned my addr 172.21.15.77:0/897764857 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.569+0000 7fc4d6565640 1 -- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 msgr2=0x7fc4d00d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:17:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.569+0000 7fc4d6565640 1 -- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 msgr2=0x7fc4d00d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.569+0000 7fc4d6565640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 0x7fc4d00d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.569+0000 7fc4d6565640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 0x7fc4d00d12f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-26T07:17:10.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.569+0000 7fc4d6d66640 1 --2- 172.21.15.77:0/897764857 >> v2:172.21.15.159:3300/0 conn(0x7fc4d00b2050 0x7fc4d00d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:10.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.569+0000 7fc4d6d66640 1 -- 172.21.15.77:0/897764857 >> v2:172.21.15.159:3300/0 conn(0x7fc4d00b2050 msgr2=0x7fc4d00d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-26T07:17:10.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.569+0000 7fc4d6d66640 1 -- 172.21.15.77:0/897764857 >> v2:172.21.15.159:3300/0 conn(0x7fc4d00b2050 msgr2=0x7fc4d00d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:10.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.569+0000 7fc4d6d66640 1 --2- 172.21.15.77:0/897764857 >> v2:172.21.15.159:3300/0 conn(0x7fc4d00b2050 0x7fc4d00d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:10.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.569+0000 7fc4d6d66640 1 --2- 172.21.15.77:0/897764857 >> v2:172.21.15.159:3300/0 conn(0x7fc4d00b2050 0x7fc4d00d1830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-26T07:17:10.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.578+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511018220 0 0) 0x7fc4d00b41b0 con 0x7fc4d0160dd0 2023-11-26T07:17:10.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.578+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4bc003520 con 0x7fc4d0160dd0 2023-11-26T07:17:10.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.578+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2449705571 0 0) 0x7fc4bc003520 con 0x7fc4d0160dd0 2023-11-26T07:17:10.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.578+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 msgr2=0x7fc4d00d12f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:17:10.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.578+0000 7fc4d5563640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 0x7fc4d00d12f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.578+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 >> v2:172.21.15.159:3300/0 conn(0x7fc4d00b2050 msgr2=0x7fc4d00d1830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:17:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.578+0000 7fc4d5563640 1 --2- 172.21.15.77:0/897764857 >> v2:172.21.15.159:3300/0 conn(0x7fc4d00b2050 0x7fc4d00d1830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.578+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d00b0370 con 0x7fc4d0160dd0 2023-11-26T07:17:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fc4c0001670 con 0x7fc4d0160dd0 2023-11-26T07:17:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 >> v1:172.21.15.77:6789/0 conn(0x7fc4d0160dd0 legacy=0x7fc4d00b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d5563640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 0x7fc4bc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d5563640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4bc003fa0 0x7fc4bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d5563640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4bc004d00 0x7fc4bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00b4490 con 0x7fc4bc004d00 2023-11-26T07:17:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00b0090 con 0x7fc4bc003fa0 2023-11-26T07:17:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc00ba80 con 0x7fc4d01609f0 2023-11-26T07:17:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d6d66640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4bc004d00 0x7fc4bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d6565640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 0x7fc4bc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d5d64640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4bc003fa0 0x7fc4bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d6d66640 1 -- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 msgr2=0x7fc4bc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d6d66640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d01609f0 0x7fc4bc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d6d66640 1 -- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4bc003fa0 msgr2=0x7fc4bc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d6d66640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4bc003fa0 0x7fc4bc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.579+0000 7fc4d6d66640 1 -- 172.21.15.77:0/897764857 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc003520 con 0x7fc4bc004d00 2023-11-26T07:17:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.581+0000 7fc4d6d66640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4bc004d00 0x7fc4bc005180 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009fc0 tx=0x7fc4bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d96b2190abc962 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.581+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c802ccb0 con 0x7fc4bc004d00 2023-11-26T07:17:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.581+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c802ce10 con 0x7fc4bc004d00 2023-11-26T07:17:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.581+0000 7fc4d5563640 1 -- 172.21.15.77:0/897764857 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8034680 con 0x7fc4bc004d00 2023-11-26T07:17:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.581+0000 7fc4d7567640 1 -- 172.21.15.77:0/897764857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4bc004d00 msgr2=0x7fc4bc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.581+0000 7fc4d7567640 1 --2- 172.21.15.77:0/897764857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4bc004d00 0x7fc4bc005180 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009fc0 tx=0x7fc4bc0057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.581+0000 7fc4d6d66640 1 -- 172.21.15.77:0/897764857 reap_dead start 2023-11-26T07:17:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.582+0000 7fc4d7567640 1 -- 172.21.15.77:0/897764857 shutdown_connections 2023-11-26T07:17:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.582+0000 7fc4d7567640 1 -- 172.21.15.77:0/897764857 >> 172.21.15.77:0/897764857 conn(0x7fc4d009c5b0 msgr2=0x7fc4d00d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.582+0000 7fc4d7567640 1 -- 172.21.15.77:0/897764857 shutdown_connections 2023-11-26T07:17:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.582+0000 7fc4d7567640 1 -- 172.21.15.77:0/897764857 wait complete. 2023-11-26T07:17:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.584+0000 7fc4d7567640 1 Processor -- start 2023-11-26T07:17:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.584+0000 7fc4d7567640 1 -- start start 2023-11-26T07:17:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d7567640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4bc004d00 0x7fc4d00c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d7567640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d00c8eb0 0x7fc4d00ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d7567640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d00ca890 0x7fc4d00c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d7567640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00cbce0 con 0x7fc4d00ca890 2023-11-26T07:17:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d7567640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00c9310 con 0x7fc4d00c8eb0 2023-11-26T07:17:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d7567640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00cb060 con 0x7fc4bc004d00 2023-11-26T07:17:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d6d66640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d00ca890 0x7fc4d00c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d6d66640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d00ca890 0x7fc4d00c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56940/0 (socket says 172.21.15.77:56940) 2023-11-26T07:17:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d6d66640 1 -- 172.21.15.77:0/2638001203 learned_addr learned my addr 172.21.15.77:0/2638001203 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d5d64640 1 --2- 172.21.15.77:0/2638001203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d00c8eb0 0x7fc4d00ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d6565640 1 --2- 172.21.15.77:0/2638001203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4bc004d00 0x7fc4d00c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d6d66640 1 -- 172.21.15.77:0/2638001203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4bc004d00 msgr2=0x7fc4d00c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d6d66640 1 --2- 172.21.15.77:0/2638001203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4bc004d00 0x7fc4d00c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d6d66640 1 -- 172.21.15.77:0/2638001203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d00c8eb0 msgr2=0x7fc4d00ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d6d66640 1 --2- 172.21.15.77:0/2638001203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d00c8eb0 0x7fc4d00ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.585+0000 7fc4d6d66640 1 -- 172.21.15.77:0/2638001203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d00cb340 con 0x7fc4d00ca890 2023-11-26T07:17:10.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.586+0000 7fc4d6d66640 1 --2- 172.21.15.77:0/2638001203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d00ca890 0x7fc4d00c6db0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8037040 tx=0x7fc4c8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:10.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.586+0000 7fc4c6ffd640 1 -- 172.21.15.77:0/2638001203 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c803e410 con 0x7fc4d00ca890 2023-11-26T07:17:10.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.586+0000 7fc4c6ffd640 1 -- 172.21.15.77:0/2638001203 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c803e570 con 0x7fc4d00ca890 2023-11-26T07:17:10.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.586+0000 7fc4c6ffd640 1 -- 172.21.15.77:0/2638001203 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c803e920 con 0x7fc4d00ca890 2023-11-26T07:17:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.586+0000 7fc4d7567640 1 -- 172.21.15.77:0/2638001203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d00cb620 con 0x7fc4d00ca890 2023-11-26T07:17:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.586+0000 7fc4d7567640 1 -- 172.21.15.77:0/2638001203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d0155980 con 0x7fc4d00ca890 2023-11-26T07:17:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.586+0000 7fc4c6ffd640 1 -- 172.21.15.77:0/2638001203 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc4c803b050 con 0x7fc4d00ca890 2023-11-26T07:17:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.587+0000 7fc4c6ffd640 1 -- 172.21.15.77:0/2638001203 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc4c8049ce0 con 0x7fc4d00ca890 2023-11-26T07:17:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.587+0000 7fc4d7567640 1 -- 172.21.15.77:0/2638001203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d004e840 con 0x7fc4d00ca890 2023-11-26T07:17:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.590+0000 7fc4c6ffd640 1 -- 172.21.15.77:0/2638001203 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc4c804e060 con 0x7fc4d00ca890 2023-11-26T07:17:10.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.661+0000 7fc4d7567640 1 -- 172.21.15.77:0/2638001203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc4d00cd510 con 0x7fc4d00ca890 2023-11-26T07:17:10.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.664+0000 7fc4c6ffd640 1 -- 172.21.15.77:0/2638001203 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc4c8044070 con 0x7fc4d00ca890 2023-11-26T07:17:10.667 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2023-11-26T07:17:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.665+0000 7fc4d7567640 1 -- 172.21.15.77:0/2638001203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d00ca890 msgr2=0x7fc4d00c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.665+0000 7fc4d7567640 1 --2- 172.21.15.77:0/2638001203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d00ca890 0x7fc4d00c6db0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8037040 tx=0x7fc4c8004ab0 comp rx=0 tx=0).stop 2023-11-26T07:17:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.666+0000 7fc4d7567640 1 -- 172.21.15.77:0/2638001203 shutdown_connections 2023-11-26T07:17:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.666+0000 7fc4d7567640 1 --2- 172.21.15.77:0/2638001203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d00ca890 0x7fc4d00c6db0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.666+0000 7fc4d7567640 1 --2- 172.21.15.77:0/2638001203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d00c8eb0 0x7fc4d00ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:10.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.666+0000 7fc4d7567640 1 --2- 172.21.15.77:0/2638001203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4bc004d00 0x7fc4d00c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:10.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.666+0000 7fc4d7567640 1 -- 172.21.15.77:0/2638001203 >> 172.21.15.77:0/2638001203 conn(0x7fc4d009c5b0 msgr2=0x7fc4d015fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:10.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.666+0000 7fc4d7567640 1 -- 172.21.15.77:0/2638001203 shutdown_connections 2023-11-26T07:17:10.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:10.666+0000 7fc4d7567640 1 -- 172.21.15.77:0/2638001203 wait complete. 2023-11-26T07:17:10.685 INFO:tasks.ceph:check_enable_crimson: False 2023-11-26T07:17:10.685 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-26T07:17:10.686 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:10.686 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-26T07:17:10.764 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:10.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-26T07:17:10.887 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:10.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-26T07:17:11.016 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:11.016 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-26T07:17:11.097 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:11.098 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-26T07:17:11.186 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:11.186 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-26T07:17:11.265 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:11.266 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-26T07:17:11.292 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:11.289+0000 7f5a34d7f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-26T07:17:11.314 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:11.308+0000 7f39c260f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-26T07:17:11.352 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:11.350+0000 7f5a34d7f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-26T07:17:11.374 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:11.371+0000 7f39c260f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-26T07:17:11.393 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:17:11.393 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-26T07:17:11.472 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 52fc69a9-f720-4f47-9380-45380d7cd6cb 0 2023-11-26T07:17:11.703 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.700+0000 7f2a42568640 1 Processor -- start 2023-11-26T07:17:11.703 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.700+0000 7f2a42568640 1 -- start start 2023-11-26T07:17:11.705 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.702+0000 7f2a42568640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2a3c15d720 0x7f2a3c0d3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:11.705 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.702+0000 7f2a42568640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3c0d3870 0x7f2a3c0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:11.705 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.702+0000 7f2a42568640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2a3c0b1400 0x7f2a3c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:11.705 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.702+0000 7f2a42568640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c0d3d20 con 0x7f2a3c0b1400 2023-11-26T07:17:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.702+0000 7f2a42568640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c15db00 con 0x7f2a3c15d720 2023-11-26T07:17:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.702+0000 7f2a42568640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0d0ce0 con 0x7f2a3c0d3870 2023-11-26T07:17:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.702+0000 7f2a3bfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2a3c15d720 0x7f2a3c0d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.702+0000 7f2a337fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3c0d3870 0x7f2a3c0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.702+0000 7f2a3bfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2a3c15d720 0x7f2a3c0d3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48240/0 (socket says 172.21.15.159:48240) 2023-11-26T07:17:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.702+0000 7f2a3bfff640 1 -- 172.21.15.159:0/2417594260 learned_addr learned my addr 172.21.15.159:0/2417594260 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.702+0000 7f2a40b05640 1 --2- 172.21.15.159:0/2417594260 >> v2:172.21.15.77:3300/0 conn(0x7f2a3c0b1400 0x7f2a3c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.703+0000 7f2a3bfff640 1 -- 172.21.15.159:0/2417594260 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3c0d3870 msgr2=0x7f2a3c0b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.703+0000 7f2a3bfff640 1 --2- 172.21.15.159:0/2417594260 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3c0d3870 0x7f2a3c0b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.703+0000 7f2a3bfff640 1 -- 172.21.15.159:0/2417594260 >> v2:172.21.15.77:3300/0 conn(0x7f2a3c0b1400 msgr2=0x7f2a3c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.703+0000 7f2a3bfff640 1 --2- 172.21.15.159:0/2417594260 >> v2:172.21.15.77:3300/0 conn(0x7f2a3c0b1400 0x7f2a3c0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:11.707 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.703+0000 7f2a3bfff640 1 -- 172.21.15.159:0/2417594260 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c06d400 con 0x7f2a3c15d720 2023-11-26T07:17:11.707 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.703+0000 7f2a337fe640 1 --2- 172.21.15.159:0/2417594260 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3c0d3870 0x7f2a3c0b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:11.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.704+0000 7f2a3bfff640 1 --2- 172.21.15.159:0/2417594260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c15d720 0x7f2a3c0d3330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c08b890 tx=0x7f2a2c02be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1107b813df6dc4e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:11.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.704+0000 7f2a3b7fe640 1 -- 172.21.15.159:0/2417594260 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c02c9f0 con 0x7f2a3c15d720 2023-11-26T07:17:11.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.704+0000 7f2a3b7fe640 1 -- 172.21.15.159:0/2417594260 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c02cb50 con 0x7f2a3c15d720 2023-11-26T07:17:11.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.704+0000 7f2a3b7fe640 1 -- 172.21.15.159:0/2417594260 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0343f0 con 0x7f2a3c15d720 2023-11-26T07:17:11.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.705+0000 7f2a42568640 1 -- 172.21.15.159:0/2417594260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c15d720 msgr2=0x7f2a3c0d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:11.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.705+0000 7f2a42568640 1 --2- 172.21.15.159:0/2417594260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c15d720 0x7f2a3c0d3330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c08b890 tx=0x7f2a2c02be50 comp rx=0 tx=0).stop 2023-11-26T07:17:11.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.705+0000 7f2a42568640 1 -- 172.21.15.159:0/2417594260 shutdown_connections 2023-11-26T07:17:11.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.705+0000 7f2a42568640 1 --2- 172.21.15.159:0/2417594260 >> v2:172.21.15.77:3300/0 conn(0x7f2a3c0b1400 0x7f2a3c0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:11.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.705+0000 7f2a42568640 1 --2- 172.21.15.159:0/2417594260 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3c0d3870 0x7f2a3c0b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:11.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.705+0000 7f2a42568640 1 --2- 172.21.15.159:0/2417594260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c15d720 0x7f2a3c0d3330 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:11.709 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.705+0000 7f2a42568640 1 -- 172.21.15.159:0/2417594260 >> 172.21.15.159:0/2417594260 conn(0x7f2a3c08af60 msgr2=0x7f2a3c09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:11.709 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.705+0000 7f2a42568640 1 -- 172.21.15.159:0/2417594260 shutdown_connections 2023-11-26T07:17:11.709 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.705+0000 7f2a42568640 1 -- 172.21.15.159:0/2417594260 wait complete. 2023-11-26T07:17:11.709 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.706+0000 7f2a42568640 1 Processor -- start 2023-11-26T07:17:11.709 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.707+0000 7f2a42568640 1 -- start start 2023-11-26T07:17:11.711 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.707+0000 7f2a42568640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c0b1400 0x7f2a3c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:11.711 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a42568640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0d3870 0x7f2a3c157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:11.711 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a42568640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3c15d720 0x7f2a3c0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:11.711 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a42568640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c158270 con 0x7f2a3c0b1400 2023-11-26T07:17:11.711 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a42568640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0cccf0 con 0x7f2a3c0d3870 2023-11-26T07:17:11.711 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a42568640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0c6fb0 con 0x7f2a3c15d720 2023-11-26T07:17:11.711 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a337fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0d3870 0x7f2a3c157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:11.711 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a40b05640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3c15d720 0x7f2a3c0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:11.711 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a337fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0d3870 0x7f2a3c157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48252/0 (socket says 172.21.15.159:48252) 2023-11-26T07:17:11.712 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a337fe640 1 -- 172.21.15.159:0/3189906253 learned_addr learned my addr 172.21.15.159:0/3189906253 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:11.712 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a3bfff640 1 --2- 172.21.15.159:0/3189906253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c0b1400 0x7f2a3c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:11.712 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a337fe640 1 -- 172.21.15.159:0/3189906253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3c15d720 msgr2=0x7f2a3c0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:11.712 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a337fe640 1 --2- 172.21.15.159:0/3189906253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3c15d720 0x7f2a3c0c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:11.712 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a337fe640 1 -- 172.21.15.159:0/3189906253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c0b1400 msgr2=0x7f2a3c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:11.712 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a337fe640 1 --2- 172.21.15.159:0/3189906253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c0b1400 0x7f2a3c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:11.712 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a337fe640 1 -- 172.21.15.159:0/3189906253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a24009400 con 0x7f2a3c0d3870 2023-11-26T07:17:11.712 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.708+0000 7f2a3bfff640 1 --2- 172.21.15.159:0/3189906253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c0b1400 0x7f2a3c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:11.713 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.709+0000 7f2a337fe640 1 --2- 172.21.15.159:0/3189906253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0d3870 0x7f2a3c157d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400e960 tx=0x7f2a2400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:11.713 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.709+0000 7f2a397fa640 1 -- 172.21.15.159:0/3189906253 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400ca00 con 0x7f2a3c0d3870 2023-11-26T07:17:11.713 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.709+0000 7f2a397fa640 1 -- 172.21.15.159:0/3189906253 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2400cb60 con 0x7f2a3c0d3870 2023-11-26T07:17:11.713 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.709+0000 7f2a397fa640 1 -- 172.21.15.159:0/3189906253 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24013470 con 0x7f2a3c0d3870 2023-11-26T07:17:11.713 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.709+0000 7f2a42568640 1 -- 172.21.15.159:0/3189906253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c009b30 con 0x7f2a3c0d3870 2023-11-26T07:17:11.714 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.709+0000 7f2a42568640 1 -- 172.21.15.159:0/3189906253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c0c7570 con 0x7f2a3c0d3870 2023-11-26T07:17:11.714 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.709+0000 7f2a397fa640 1 -- 172.21.15.159:0/3189906253 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2a24005c90 con 0x7f2a3c0d3870 2023-11-26T07:17:11.714 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.709+0000 7f2a397fa640 1 -- 172.21.15.159:0/3189906253 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2a24013910 con 0x7f2a3c0d3870 2023-11-26T07:17:11.714 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.710+0000 7f2a42568640 1 -- 172.21.15.159:0/3189906253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c0c6d80 con 0x7f2a3c0d3870 2023-11-26T07:17:11.715 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.713+0000 7f2a397fa640 1 -- 172.21.15.159:0/3189906253 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f2a24021060 con 0x7f2a3c0d3870 2023-11-26T07:17:11.794 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.791+0000 7f2a42568640 1 -- 172.21.15.159:0/3189906253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "52fc69a9-f720-4f47-9380-45380d7cd6cb", "id": 0} v 0) v1 -- 0x7f2a3c04e8b0 con 0x7f2a3c0d3870 2023-11-26T07:17:11.802 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.799+0000 7f2a397fa640 1 -- 172.21.15.159:0/3189906253 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52fc69a9-f720-4f47-9380-45380d7cd6cb", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2a24029020 con 0x7f2a3c0d3870 2023-11-26T07:17:11.802 INFO:teuthology.orchestra.run.smithi159.stdout:0 2023-11-26T07:17:11.803 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.800+0000 7f2a42568640 1 -- 172.21.15.159:0/3189906253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0d3870 msgr2=0x7f2a3c157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:11.803 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.800+0000 7f2a42568640 1 --2- 172.21.15.159:0/3189906253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0d3870 0x7f2a3c157d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400e960 tx=0x7f2a2400ee20 comp rx=0 tx=0).stop 2023-11-26T07:17:11.804 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.800+0000 7f2a42568640 1 -- 172.21.15.159:0/3189906253 shutdown_connections 2023-11-26T07:17:11.804 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.801+0000 7f2a42568640 1 --2- 172.21.15.159:0/3189906253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3c15d720 0x7f2a3c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:11.804 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.801+0000 7f2a42568640 1 --2- 172.21.15.159:0/3189906253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0d3870 0x7f2a3c157d30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:11.804 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.801+0000 7f2a42568640 1 --2- 172.21.15.159:0/3189906253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c0b1400 0x7f2a3c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:11.804 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.801+0000 7f2a42568640 1 -- 172.21.15.159:0/3189906253 >> 172.21.15.159:0/3189906253 conn(0x7f2a3c08af60 msgr2=0x7f2a3c06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:11.804 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.801+0000 7f2a42568640 1 -- 172.21.15.159:0/3189906253 shutdown_connections 2023-11-26T07:17:11.804 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:11.801+0000 7f2a42568640 1 -- 172.21.15.159:0/3189906253 wait complete. 2023-11-26T07:17:11.824 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 58ed8820-6e20-42a4-9aa1-777a3a87f8db 1 2023-11-26T07:17:11.964 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:11.962+0000 7f5a34d7f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-26T07:17:12.023 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.021+0000 7f6c0b59e640 1 Processor -- start 2023-11-26T07:17:12.024 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.021+0000 7f6c0b59e640 1 -- start start 2023-11-26T07:17:12.025 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:12.022+0000 7f5a34d7f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-26T07:17:12.026 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.022+0000 7f6c0b59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6c0c1609f0 0x7f6c0c0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.026 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0b59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c0c0b2050 0x7f6c0c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.026 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0b59e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0c0b41b0 con 0x7f6c0c160dd0 2023-11-26T07:17:12.027 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0b59e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0c0b4490 con 0x7f6c0c0b2050 2023-11-26T07:17:12.027 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0b59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0c0b0090 con 0x7f6c0c1609f0 2023-11-26T07:17:12.027 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0a59c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6c0c1609f0 0x7f6c0c0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.027 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0a59c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6c0c1609f0 0x7f6c0c0d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48258/0 (socket says 172.21.15.159:48258) 2023-11-26T07:17:12.027 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0a59c640 1 -- 172.21.15.159:0/3758144433 learned_addr learned my addr 172.21.15.159:0/3758144433 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:12.027 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0ad9d640 1 --2- 172.21.15.159:0/3758144433 >> v2:172.21.15.77:3300/0 conn(0x7f6c0c0b2050 0x7f6c0c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.027 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0a59c640 1 -- 172.21.15.159:0/3758144433 >> v2:172.21.15.77:3300/0 conn(0x7f6c0c0b2050 msgr2=0x7f6c0c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:12.027 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0a59c640 1 --2- 172.21.15.159:0/3758144433 >> v2:172.21.15.77:3300/0 conn(0x7f6c0c0b2050 0x7f6c0c0d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.027 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0a59c640 1 -- 172.21.15.159:0/3758144433 >> v1:172.21.15.77:6789/0 conn(0x7f6c0c160dd0 legacy=0x7f6c0c0b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:12.027 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.023+0000 7f6c0a59c640 1 -- 172.21.15.159:0/3758144433 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0b0370 con 0x7f6c0c1609f0 2023-11-26T07:17:12.028 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.024+0000 7f6c0a59c640 1 --2- 172.21.15.159:0/3758144433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c0c1609f0 0x7f6c0c0d12f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c067bb0 tx=0x7f6bfc02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a03c1de714b4227 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:12.029 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.025+0000 7f6c09d9b640 1 -- 172.21.15.159:0/3758144433 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc031870 con 0x7f6c0c1609f0 2023-11-26T07:17:12.029 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.025+0000 7f6c09d9b640 1 -- 172.21.15.159:0/3758144433 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc0319d0 con 0x7f6c0c1609f0 2023-11-26T07:17:12.029 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.025+0000 7f6c09d9b640 1 -- 172.21.15.159:0/3758144433 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc031d60 con 0x7f6c0c1609f0 2023-11-26T07:17:12.029 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.025+0000 7f6c0b59e640 1 -- 172.21.15.159:0/3758144433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c0c1609f0 msgr2=0x7f6c0c0d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.029 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.025+0000 7f6c0b59e640 1 --2- 172.21.15.159:0/3758144433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c0c1609f0 0x7f6c0c0d12f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c067bb0 tx=0x7f6bfc02b910 comp rx=0 tx=0).stop 2023-11-26T07:17:12.029 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.026+0000 7f6c0b59e640 1 -- 172.21.15.159:0/3758144433 shutdown_connections 2023-11-26T07:17:12.029 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.026+0000 7f6c0b59e640 1 --2- 172.21.15.159:0/3758144433 >> v2:172.21.15.77:3300/0 conn(0x7f6c0c0b2050 0x7f6c0c0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.029 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.026+0000 7f6c0b59e640 1 --2- 172.21.15.159:0/3758144433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c0c1609f0 0x7f6c0c0d12f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.029 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.026+0000 7f6c0b59e640 1 -- 172.21.15.159:0/3758144433 >> 172.21.15.159:0/3758144433 conn(0x7f6c0c09c5b0 msgr2=0x7f6c0c0d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:12.029 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.026+0000 7f6c0b59e640 1 -- 172.21.15.159:0/3758144433 shutdown_connections 2023-11-26T07:17:12.030 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.026+0000 7f6c0b59e640 1 -- 172.21.15.159:0/3758144433 wait complete. 2023-11-26T07:17:12.030 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.027+0000 7f6c0b59e640 1 Processor -- start 2023-11-26T07:17:12.030 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.027+0000 7f6c0b59e640 1 -- start start 2023-11-26T07:17:12.032 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.028+0000 7f6c0b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c0c0b2050 0x7f6c0c0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.032 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.028+0000 7f6c0b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c0c1609f0 0x7f6c0c06bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.028+0000 7f6c0b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c0c160dd0 0x7f6c0c06c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.028+0000 7f6c0b59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0ca700 con 0x7f6c0c160dd0 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.028+0000 7f6c0b59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c1f6730 con 0x7f6c0c1609f0 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.028+0000 7f6c0b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0cd180 con 0x7f6c0c0b2050 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c0a59c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c0c0b2050 0x7f6c0c0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c0c1609f0 0x7f6c0c06bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c0a59c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c0c0b2050 0x7f6c0c0ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:57088/0 (socket says 172.21.15.159:57088) 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c0a59c640 1 -- 172.21.15.159:0/4049337041 learned_addr learned my addr 172.21.15.159:0/4049337041 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c0ad9d640 1 --2- 172.21.15.159:0/4049337041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c0c160dd0 0x7f6c0c06c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c0a59c640 1 -- 172.21.15.159:0/4049337041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c0c1609f0 msgr2=0x7f6c0c06bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c0a59c640 1 --2- 172.21.15.159:0/4049337041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c0c1609f0 0x7f6c0c06bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.033 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c0a59c640 1 -- 172.21.15.159:0/4049337041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c0c160dd0 msgr2=0x7f6c0c06c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.034 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c0a59c640 1 --2- 172.21.15.159:0/4049337041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c0c160dd0 0x7f6c0c06c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.034 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c0a59c640 1 -- 172.21.15.159:0/4049337041 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc0094d0 con 0x7f6c0c0b2050 2023-11-26T07:17:12.034 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c03fff640 1 --2- 172.21.15.159:0/4049337041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c0c1609f0 0x7f6c0c06bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:12.034 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.029+0000 7f6c0a59c640 1 --2- 172.21.15.159:0/4049337041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c0c0b2050 0x7f6c0c0ccba0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc000c00 tx=0x7f6bfc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:12.034 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.030+0000 7f6c02ffd640 1 -- 172.21.15.159:0/4049337041 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc031840 con 0x7f6c0c0b2050 2023-11-26T07:17:12.034 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.030+0000 7f6c02ffd640 1 -- 172.21.15.159:0/4049337041 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc0443f0 con 0x7f6c0c0b2050 2023-11-26T07:17:12.034 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.030+0000 7f6c02ffd640 1 -- 172.21.15.159:0/4049337041 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc0447a0 con 0x7f6c0c0b2050 2023-11-26T07:17:12.034 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.030+0000 7f6c0b59e640 1 -- 172.21.15.159:0/4049337041 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c1f69f0 con 0x7f6c0c0b2050 2023-11-26T07:17:12.034 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.030+0000 7f6c0b59e640 1 -- 172.21.15.159:0/4049337041 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c1f6fb0 con 0x7f6c0c0b2050 2023-11-26T07:17:12.035 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.030+0000 7f6c02ffd640 1 -- 172.21.15.159:0/4049337041 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6bfc044c00 con 0x7f6c0c0b2050 2023-11-26T07:17:12.035 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.030+0000 7f6c02ffd640 1 -- 172.21.15.159:0/4049337041 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6bfc02d040 con 0x7f6c0c0b2050 2023-11-26T07:17:12.035 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.031+0000 7f6c0b59e640 1 -- 172.21.15.159:0/4049337041 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c04e840 con 0x7f6c0c0b2050 2023-11-26T07:17:12.037 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.034+0000 7f6c02ffd640 1 -- 172.21.15.159:0/4049337041 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6bfc035020 con 0x7f6c0c0b2050 2023-11-26T07:17:12.075 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:12.073+0000 7f5a34d7f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-26T07:17:12.078 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:12.075+0000 7f39c260f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-26T07:17:12.114 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.112+0000 7f6c0b59e640 1 -- 172.21.15.159:0/4049337041 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd new", "uuid": "58ed8820-6e20-42a4-9aa1-777a3a87f8db", "id": 1} v 0) v1 -- 0x7f6c0c0cd510 con 0x7f6c0c0b2050 2023-11-26T07:17:12.123 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.120+0000 7f6c02ffd640 1 -- 172.21.15.159:0/4049337041 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58ed8820-6e20-42a4-9aa1-777a3a87f8db", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6bfc04dd90 con 0x7f6c0c0b2050 2023-11-26T07:17:12.123 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-11-26T07:17:12.125 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.122+0000 7f6c0b59e640 1 -- 172.21.15.159:0/4049337041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c0c0b2050 msgr2=0x7f6c0c0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.125 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.122+0000 7f6c0b59e640 1 --2- 172.21.15.159:0/4049337041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c0c0b2050 0x7f6c0c0ccba0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc000c00 tx=0x7f6bfc0046c0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.126 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.122+0000 7f6c0b59e640 1 -- 172.21.15.159:0/4049337041 shutdown_connections 2023-11-26T07:17:12.126 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.122+0000 7f6c0b59e640 1 --2- 172.21.15.159:0/4049337041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c0c160dd0 0x7f6c0c06c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.126 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.122+0000 7f6c0b59e640 1 --2- 172.21.15.159:0/4049337041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c0c1609f0 0x7f6c0c06bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.126 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.122+0000 7f6c0b59e640 1 --2- 172.21.15.159:0/4049337041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c0c0b2050 0x7f6c0c0ccba0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.126 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.122+0000 7f6c0b59e640 1 -- 172.21.15.159:0/4049337041 >> 172.21.15.159:0/4049337041 conn(0x7f6c0c09c5b0 msgr2=0x7f6c0c0d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:12.126 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.122+0000 7f6c0b59e640 1 -- 172.21.15.159:0/4049337041 shutdown_connections 2023-11-26T07:17:12.127 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.122+0000 7f6c0b59e640 1 -- 172.21.15.159:0/4049337041 wait complete. 2023-11-26T07:17:12.138 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:12.136+0000 7f5a34d7f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-26T07:17:12.141 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new be52fac4-d4a7-4134-9604-4cc522f1825b 2 2023-11-26T07:17:12.147 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:12.140+0000 7f39c260f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-26T07:17:12.188 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:12.185+0000 7f5a34d7f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-26T07:17:12.197 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:12.195+0000 7f39c260f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-26T07:17:12.264 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:12.261+0000 7f39c260f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-26T07:17:12.301 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:12.298+0000 7f5a34d7f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-26T07:17:12.316 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:12.313+0000 7f39c260f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-26T07:17:12.326 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.323+0000 7fa10359e640 1 Processor -- start 2023-11-26T07:17:12.326 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.324+0000 7fa10359e640 1 -- start start 2023-11-26T07:17:12.328 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.325+0000 7fa10359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa104160a00 0x7fa1040d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.328 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.325+0000 7fa10359e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1040d1ae0 con 0x7fa1040d36d0 2023-11-26T07:17:12.328 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.325+0000 7fa10359e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1040d1dc0 con 0x7fa1040d1380 2023-11-26T07:17:12.328 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.325+0000 7fa10359e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040d20a0 con 0x7fa104160a00 2023-11-26T07:17:12.328 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.325+0000 7fa10259c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa104160a00 0x7fa1040d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.329 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.325+0000 7fa10259c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa104160a00 0x7fa1040d0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:57104/0 (socket says 172.21.15.159:57104) 2023-11-26T07:17:12.329 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.325+0000 7fa10259c640 1 -- 172.21.15.159:0/2380971226 learned_addr learned my addr 172.21.15.159:0/2380971226 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:12.329 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.325+0000 7fa0fbfff640 1 --1- 172.21.15.159:0/2380971226 >> v1:172.21.15.159:6789/0 conn(0x7fa1040d1380 0x7fa1040d2fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:36316/0 (socket says 172.21.15.159:36316) 2023-11-26T07:17:12.330 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.326+0000 7fa10259c640 1 -- 172.21.15.159:0/2380971226 >> v1:172.21.15.159:6789/0 conn(0x7fa1040d1380 legacy=0x7fa1040d2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.330 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.326+0000 7fa10259c640 1 -- 172.21.15.159:0/2380971226 >> v1:172.21.15.77:6789/0 conn(0x7fa1040d36d0 legacy=0x7fa1040ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:12.330 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.326+0000 7fa10259c640 1 -- 172.21.15.159:0/2380971226 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1040ce140 con 0x7fa104160a00 2023-11-26T07:17:12.330 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.326+0000 7fa101d9b640 1 -- 172.21.15.159:0/2380971226 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172056921 0 0) 0x7fa1040d1dc0 con 0x7fa1040d1380 2023-11-26T07:17:12.330 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.327+0000 7fa10259c640 1 --2- 172.21.15.159:0/2380971226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa104160a00 0x7fa1040d0e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40098a0 tx=0x7fa0f402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ab1dd133b8b3f2c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:12.330 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.327+0000 7fa101d9b640 1 -- 172.21.15.159:0/2380971226 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40317c0 con 0x7fa104160a00 2023-11-26T07:17:12.330 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.327+0000 7fa101d9b640 1 -- 172.21.15.159:0/2380971226 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f4031920 con 0x7fa104160a00 2023-11-26T07:17:12.330 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.327+0000 7fa101d9b640 1 -- 172.21.15.159:0/2380971226 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4031cb0 con 0x7fa104160a00 2023-11-26T07:17:12.331 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.328+0000 7fa10359e640 1 -- 172.21.15.159:0/2380971226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa104160a00 msgr2=0x7fa1040d0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.331 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.328+0000 7fa10359e640 1 --2- 172.21.15.159:0/2380971226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa104160a00 0x7fa1040d0e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40098a0 tx=0x7fa0f402b860 comp rx=0 tx=0).stop 2023-11-26T07:17:12.331 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.328+0000 7fa10359e640 1 -- 172.21.15.159:0/2380971226 shutdown_connections 2023-11-26T07:17:12.331 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.328+0000 7fa10359e640 1 --2- 172.21.15.159:0/2380971226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa104160a00 0x7fa1040d0e40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.331 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.328+0000 7fa10359e640 1 -- 172.21.15.159:0/2380971226 >> 172.21.15.159:0/2380971226 conn(0x7fa10408cc90 msgr2=0x7fa10409c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:12.331 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.328+0000 7fa10359e640 1 -- 172.21.15.159:0/2380971226 shutdown_connections 2023-11-26T07:17:12.332 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.328+0000 7fa10359e640 1 -- 172.21.15.159:0/2380971226 wait complete. 2023-11-26T07:17:12.332 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.330+0000 7fa10359e640 1 Processor -- start 2023-11-26T07:17:12.332 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.330+0000 7fa10359e640 1 -- start start 2023-11-26T07:17:12.334 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.331+0000 7fa10359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1040d1380 0x7fa1040b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.334 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.331+0000 7fa10359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1040d36d0 0x7fa1040cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.334 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.331+0000 7fa10359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa104160a00 0x7fa10415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.334 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.331+0000 7fa10359e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040cbad0 con 0x7fa1040d36d0 2023-11-26T07:17:12.334 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.331+0000 7fa10359e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040b7070 con 0x7fa104160a00 2023-11-26T07:17:12.335 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.331+0000 7fa10359e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040b7630 con 0x7fa1040d1380 2023-11-26T07:17:12.335 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.331+0000 7fa10259c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1040d1380 0x7fa1040b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.335 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.331+0000 7fa10259c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1040d1380 0x7fa1040b6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:57118/0 (socket says 172.21.15.159:57118) 2023-11-26T07:17:12.335 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.331+0000 7fa10259c640 1 -- 172.21.15.159:0/1675807684 learned_addr learned my addr 172.21.15.159:0/1675807684 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:12.335 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.331+0000 7fa102d9d640 1 --2- 172.21.15.159:0/1675807684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa104160a00 0x7fa10415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.335 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.331+0000 7fa0fbfff640 1 --2- 172.21.15.159:0/1675807684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1040d36d0 0x7fa1040cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.335 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.332+0000 7fa10259c640 1 -- 172.21.15.159:0/1675807684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa104160a00 msgr2=0x7fa10415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.335 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.332+0000 7fa10259c640 1 --2- 172.21.15.159:0/1675807684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa104160a00 0x7fa10415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.335 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.332+0000 7fa10259c640 1 -- 172.21.15.159:0/1675807684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1040d36d0 msgr2=0x7fa1040cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.335 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.332+0000 7fa10259c640 1 --2- 172.21.15.159:0/1675807684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1040d36d0 0x7fa1040cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.335 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.332+0000 7fa10259c640 1 -- 172.21.15.159:0/1675807684 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f40094d0 con 0x7fa1040d1380 2023-11-26T07:17:12.336 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.332+0000 7fa10259c640 1 --2- 172.21.15.159:0/1675807684 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1040d1380 0x7fa1040b6aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4000c00 tx=0x7fa0f40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:12.336 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.332+0000 7fa0faffd640 1 -- 172.21.15.159:0/1675807684 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4032860 con 0x7fa1040d1380 2023-11-26T07:17:12.336 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.332+0000 7fa0faffd640 1 -- 172.21.15.159:0/1675807684 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f40329e0 con 0x7fa1040d1380 2023-11-26T07:17:12.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.332+0000 7fa0faffd640 1 -- 172.21.15.159:0/1675807684 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4032d90 con 0x7fa1040d1380 2023-11-26T07:17:12.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.332+0000 7fa10359e640 1 -- 172.21.15.159:0/1675807684 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1040cb270 con 0x7fa1040d1380 2023-11-26T07:17:12.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.333+0000 7fa10359e640 1 -- 172.21.15.159:0/1675807684 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1040cb510 con 0x7fa1040d1380 2023-11-26T07:17:12.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.333+0000 7fa0faffd640 1 -- 172.21.15.159:0/1675807684 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa0f4005c90 con 0x7fa1040d1380 2023-11-26T07:17:12.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.333+0000 7fa0faffd640 1 -- 172.21.15.159:0/1675807684 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa0f4006440 con 0x7fa1040d1380 2023-11-26T07:17:12.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.334+0000 7fa10359e640 1 -- 172.21.15.159:0/1675807684 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10404e840 con 0x7fa1040d1380 2023-11-26T07:17:12.339 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.336+0000 7fa0faffd640 1 -- 172.21.15.159:0/1675807684 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa0f4006840 con 0x7fa1040d1380 2023-11-26T07:17:12.381 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:12.378+0000 7f5a34d7f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-26T07:17:12.416 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.414+0000 7fa10359e640 1 -- 172.21.15.159:0/1675807684 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd new", "uuid": "be52fac4-d4a7-4134-9604-4cc522f1825b", "id": 2} v 0) v1 -- 0x7fa1040d0fc0 con 0x7fa1040d1380 2023-11-26T07:17:12.425 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.422+0000 7fa0faffd640 1 -- 172.21.15.159:0/1675807684 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be52fac4-d4a7-4134-9604-4cc522f1825b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa0f4006020 con 0x7fa1040d1380 2023-11-26T07:17:12.425 INFO:teuthology.orchestra.run.smithi159.stdout:2 2023-11-26T07:17:12.426 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.423+0000 7fa10359e640 1 -- 172.21.15.159:0/1675807684 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1040d1380 msgr2=0x7fa1040b6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.426 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.423+0000 7fa10359e640 1 --2- 172.21.15.159:0/1675807684 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1040d1380 0x7fa1040b6aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4000c00 tx=0x7fa0f40046c0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.426 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.423+0000 7fa10359e640 1 -- 172.21.15.159:0/1675807684 shutdown_connections 2023-11-26T07:17:12.426 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.423+0000 7fa10359e640 1 --2- 172.21.15.159:0/1675807684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa104160a00 0x7fa10415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.426 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.423+0000 7fa10359e640 1 --2- 172.21.15.159:0/1675807684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1040d36d0 0x7fa1040cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.426 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.423+0000 7fa10359e640 1 --2- 172.21.15.159:0/1675807684 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1040d1380 0x7fa1040b6aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.427 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.423+0000 7fa10359e640 1 -- 172.21.15.159:0/1675807684 >> 172.21.15.159:0/1675807684 conn(0x7fa10408cc90 msgr2=0x7fa1040734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:12.427 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.423+0000 7fa10359e640 1 -- 172.21.15.159:0/1675807684 shutdown_connections 2023-11-26T07:17:12.427 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.423+0000 7fa10359e640 1 -- 172.21.15.159:0/1675807684 wait complete. 2023-11-26T07:17:12.434 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:12.431+0000 7f5a34d7f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-26T07:17:12.438 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:12.435+0000 7f39c260f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-26T07:17:12.441 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new b1dba02d-31b2-4897-924b-47b8d3ef925f 3 2023-11-26T07:17:12.493 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:12.490+0000 7f5a34d7f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-26T07:17:12.523 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:12.521+0000 7f39c260f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-26T07:17:12.547 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:12.544+0000 7f5a34d7f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-26T07:17:12.580 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:12.577+0000 7f39c260f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-26T07:17:12.634 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.632+0000 7ffab7450640 1 Processor -- start 2023-11-26T07:17:12.635 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.632+0000 7ffab7450640 1 -- start start 2023-11-26T07:17:12.637 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.633+0000 7ffab7450640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffab0160a00 0x7ffab00d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.637 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.633+0000 7ffab7450640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab00d1380 0x7ffab00d2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.637 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab7450640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab00d1ae0 con 0x7ffab00d3500 2023-11-26T07:17:12.637 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab7450640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab00d1dc0 con 0x7ffab0160a00 2023-11-26T07:17:12.637 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab7450640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00d20a0 con 0x7ffab00d1380 2023-11-26T07:17:12.637 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab5c4d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab00d1380 0x7ffab00d2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.637 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab644e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffab0160a00 0x7ffab00d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.637 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab5c4d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab00d1380 0x7ffab00d2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:57126/0 (socket says 172.21.15.159:57126) 2023-11-26T07:17:12.638 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab5c4d640 1 -- 172.21.15.159:0/86525774 learned_addr learned my addr 172.21.15.159:0/86525774 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:12.638 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab5c4d640 1 -- 172.21.15.159:0/86525774 >> v2:172.21.15.159:3300/0 conn(0x7ffab0160a00 msgr2=0x7ffab00d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:12.638 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab5c4d640 1 --2- 172.21.15.159:0/86525774 >> v2:172.21.15.159:3300/0 conn(0x7ffab0160a00 0x7ffab00d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.638 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab5c4d640 1 -- 172.21.15.159:0/86525774 >> v1:172.21.15.159:6789/0 conn(0x7ffab00d3500 legacy=0x7ffab00cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.638 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab5c4d640 1 -- 172.21.15.159:0/86525774 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00ce140 con 0x7ffab00d1380 2023-11-26T07:17:12.638 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.634+0000 7ffab644e640 1 --2- 172.21.15.159:0/86525774 >> v2:172.21.15.159:3300/0 conn(0x7ffab0160a00 0x7ffab00d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:12.639 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.635+0000 7ffab5c4d640 1 --2- 172.21.15.159:0/86525774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab00d1380 0x7ffab00d2fc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009870 tx=0x7ffaa002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c76654d200ff57ba server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:12.639 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.636+0000 7ffab544c640 1 -- 172.21.15.159:0/86525774 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00317c0 con 0x7ffab00d1380 2023-11-26T07:17:12.639 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.636+0000 7ffab544c640 1 -- 172.21.15.159:0/86525774 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa0031920 con 0x7ffab00d1380 2023-11-26T07:17:12.639 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.636+0000 7ffab544c640 1 -- 172.21.15.159:0/86525774 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0031cb0 con 0x7ffab00d1380 2023-11-26T07:17:12.639 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.636+0000 7ffab7450640 1 -- 172.21.15.159:0/86525774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab00d1380 msgr2=0x7ffab00d2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.639 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.636+0000 7ffab7450640 1 --2- 172.21.15.159:0/86525774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab00d1380 0x7ffab00d2fc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009870 tx=0x7ffaa002b860 comp rx=0 tx=0).stop 2023-11-26T07:17:12.640 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.637+0000 7ffab7450640 1 -- 172.21.15.159:0/86525774 shutdown_connections 2023-11-26T07:17:12.640 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.637+0000 7ffab7450640 1 --2- 172.21.15.159:0/86525774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab00d1380 0x7ffab00d2fc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.640 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.637+0000 7ffab7450640 1 --2- 172.21.15.159:0/86525774 >> v2:172.21.15.159:3300/0 conn(0x7ffab0160a00 0x7ffab00d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.640 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.637+0000 7ffab7450640 1 -- 172.21.15.159:0/86525774 >> 172.21.15.159:0/86525774 conn(0x7ffab008cc90 msgr2=0x7ffab009c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:12.640 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.637+0000 7ffab7450640 1 -- 172.21.15.159:0/86525774 shutdown_connections 2023-11-26T07:17:12.640 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.637+0000 7ffab7450640 1 -- 172.21.15.159:0/86525774 wait complete. 2023-11-26T07:17:12.641 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.638+0000 7ffab7450640 1 Processor -- start 2023-11-26T07:17:12.641 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.638+0000 7ffab7450640 1 -- start start 2023-11-26T07:17:12.643 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.639+0000 7ffab7450640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffab00d1380 0x7ffab00cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.643 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.639+0000 7ffab7450640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab00d3500 0x7ffab00cff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.643 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.639+0000 7ffab7450640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab0160a00 0x7ffab01f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.643 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.639+0000 7ffab7450640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00c6fb0 con 0x7ffab00d3500 2023-11-26T07:17:12.643 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.639+0000 7ffab7450640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00caf50 con 0x7ffab00d1380 2023-11-26T07:17:12.643 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.639+0000 7ffab7450640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00ca340 con 0x7ffab0160a00 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.639+0000 7ffab644e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffab00d1380 0x7ffab00cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.639+0000 7ffab644e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffab00d1380 0x7ffab00cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48284/0 (socket says 172.21.15.159:48284) 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.639+0000 7ffab644e640 1 -- 172.21.15.159:0/3834098862 learned_addr learned my addr 172.21.15.159:0/3834098862 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffab6c4f640 1 --2- 172.21.15.159:0/3834098862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab0160a00 0x7ffab01f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffab5c4d640 1 --2- 172.21.15.159:0/3834098862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab00d3500 0x7ffab00cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffab644e640 1 -- 172.21.15.159:0/3834098862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab0160a00 msgr2=0x7ffab01f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffab644e640 1 --2- 172.21.15.159:0/3834098862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab0160a00 0x7ffab01f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffab644e640 1 -- 172.21.15.159:0/3834098862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab00d3500 msgr2=0x7ffab00cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffab644e640 1 --2- 172.21.15.159:0/3834098862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab00d3500 0x7ffab00cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffab644e640 1 -- 172.21.15.159:0/3834098862 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac009400 con 0x7ffab00d1380 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffab5c4d640 1 --2- 172.21.15.159:0/3834098862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab00d3500 0x7ffab00cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffab644e640 1 --2- 172.21.15.159:0/3834098862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffab00d1380 0x7ffab00cfa30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00e990 tx=0x7ffaac00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffaa6ffd640 1 -- 172.21.15.159:0/3834098862 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac00c9e0 con 0x7ffab00d1380 2023-11-26T07:17:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffaa6ffd640 1 -- 172.21.15.159:0/3834098862 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac00cb40 con 0x7ffab00d1380 2023-11-26T07:17:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.640+0000 7ffab7450640 1 -- 172.21.15.159:0/3834098862 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa00094d0 con 0x7ffab00d1380 2023-11-26T07:17:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.641+0000 7ffaa6ffd640 1 -- 172.21.15.159:0/3834098862 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac00ced0 con 0x7ffab00d1380 2023-11-26T07:17:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.641+0000 7ffab7450640 1 -- 172.21.15.159:0/3834098862 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab00ca900 con 0x7ffab00d1380 2023-11-26T07:17:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.641+0000 7ffaa6ffd640 1 -- 172.21.15.159:0/3834098862 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffaac005c90 con 0x7ffab00d1380 2023-11-26T07:17:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.641+0000 7ffaa6ffd640 1 -- 172.21.15.159:0/3834098862 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7ffaac0064b0 con 0x7ffab00d1380 2023-11-26T07:17:12.646 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.642+0000 7ffab7450640 1 -- 172.21.15.159:0/3834098862 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab004e840 con 0x7ffab00d1380 2023-11-26T07:17:12.646 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:12.643+0000 7f39c260f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-26T07:17:12.647 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.644+0000 7ffaa6ffd640 1 -- 172.21.15.159:0/3834098862 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ffaac021060 con 0x7ffab00d1380 2023-11-26T07:17:12.703 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:12.700+0000 7f39c260f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-26T07:17:12.724 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.722+0000 7ffab7450640 1 -- 172.21.15.159:0/3834098862 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b1dba02d-31b2-4897-924b-47b8d3ef925f", "id": 3} v 0) v1 -- 0x7ffab00cb520 con 0x7ffab00d1380 2023-11-26T07:17:12.730 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.727+0000 7ffaa6ffd640 1 -- 172.21.15.159:0/3834098862 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b1dba02d-31b2-4897-924b-47b8d3ef925f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffaac029020 con 0x7ffab00d1380 2023-11-26T07:17:12.730 INFO:teuthology.orchestra.run.smithi159.stdout:3 2023-11-26T07:17:12.731 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.728+0000 7ffab7450640 1 -- 172.21.15.159:0/3834098862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffab00d1380 msgr2=0x7ffab00cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.731 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.728+0000 7ffab7450640 1 --2- 172.21.15.159:0/3834098862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffab00d1380 0x7ffab00cfa30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00e990 tx=0x7ffaac00ee50 comp rx=0 tx=0).stop 2023-11-26T07:17:12.731 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.728+0000 7ffab7450640 1 -- 172.21.15.159:0/3834098862 shutdown_connections 2023-11-26T07:17:12.731 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.728+0000 7ffab7450640 1 --2- 172.21.15.159:0/3834098862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffab0160a00 0x7ffab01f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.731 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.728+0000 7ffab7450640 1 --2- 172.21.15.159:0/3834098862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab00d3500 0x7ffab00cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.731 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.728+0000 7ffab7450640 1 --2- 172.21.15.159:0/3834098862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffab00d1380 0x7ffab00cfa30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.731 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.728+0000 7ffab7450640 1 -- 172.21.15.159:0/3834098862 >> 172.21.15.159:0/3834098862 conn(0x7ffab008cc90 msgr2=0x7ffab006c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:12.731 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.728+0000 7ffab7450640 1 -- 172.21.15.159:0/3834098862 shutdown_connections 2023-11-26T07:17:12.732 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.728+0000 7ffab7450640 1 -- 172.21.15.159:0/3834098862 wait complete. 2023-11-26T07:17:12.748 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 89943722-64a8-4ff2-ad1a-21dd42e10ddc 4 2023-11-26T07:17:12.937 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.934+0000 7fafaa147640 1 Processor -- start 2023-11-26T07:17:12.937 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.934+0000 7fafaa147640 1 -- start start 2023-11-26T07:17:12.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.936+0000 7fafaa147640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fafa41609f0 0x7fafa40d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.936+0000 7fafaa147640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa4160dd0 0x7fafa40d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.936+0000 7fafaa147640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa40b41b0 con 0x7fafa40b2050 2023-11-26T07:17:12.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.936+0000 7fafaa147640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa40b4490 con 0x7fafa41609f0 2023-11-26T07:17:12.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.936+0000 7fafaa147640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40b0090 con 0x7fafa4160dd0 2023-11-26T07:17:12.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.936+0000 7fafa9145640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fafa41609f0 0x7fafa40d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.937+0000 7fafa9145640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fafa41609f0 0x7fafa40d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48294/0 (socket says 172.21.15.159:48294) 2023-11-26T07:17:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.937+0000 7fafa9145640 1 -- 172.21.15.159:0/3820469781 learned_addr learned my addr 172.21.15.159:0/3820469781 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.937+0000 7fafa8944640 1 --2- 172.21.15.159:0/3820469781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa4160dd0 0x7fafa40d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.937+0000 7fafa9145640 1 -- 172.21.15.159:0/3820469781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa4160dd0 msgr2=0x7fafa40d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.937+0000 7fafa9145640 1 --2- 172.21.15.159:0/3820469781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa4160dd0 0x7fafa40d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.937+0000 7fafa9145640 1 -- 172.21.15.159:0/3820469781 >> v1:172.21.15.159:6789/0 conn(0x7fafa40b2050 legacy=0x7fafa40b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.937+0000 7fafa9145640 1 -- 172.21.15.159:0/3820469781 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40b0370 con 0x7fafa41609f0 2023-11-26T07:17:12.941 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.938+0000 7fafa9145640 1 --2- 172.21.15.159:0/3820469781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41609f0 0x7fafa40d12f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009870 tx=0x7fafa002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f59792ad8df6fd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:12.941 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.938+0000 7faf9bfff640 1 -- 172.21.15.159:0/3820469781 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0030840 con 0x7fafa41609f0 2023-11-26T07:17:12.941 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.938+0000 7faf9bfff640 1 -- 172.21.15.159:0/3820469781 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa00309a0 con 0x7fafa41609f0 2023-11-26T07:17:12.941 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.938+0000 7faf9bfff640 1 -- 172.21.15.159:0/3820469781 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0030d30 con 0x7fafa41609f0 2023-11-26T07:17:12.942 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.939+0000 7fafaa147640 1 -- 172.21.15.159:0/3820469781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41609f0 msgr2=0x7fafa40d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.942 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.939+0000 7fafaa147640 1 --2- 172.21.15.159:0/3820469781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41609f0 0x7fafa40d12f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009870 tx=0x7fafa002b980 comp rx=0 tx=0).stop 2023-11-26T07:17:12.942 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.939+0000 7fafaa147640 1 -- 172.21.15.159:0/3820469781 shutdown_connections 2023-11-26T07:17:12.942 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.939+0000 7fafaa147640 1 --2- 172.21.15.159:0/3820469781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa4160dd0 0x7fafa40d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.939+0000 7fafaa147640 1 --2- 172.21.15.159:0/3820469781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41609f0 0x7fafa40d12f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.939+0000 7fafaa147640 1 -- 172.21.15.159:0/3820469781 >> 172.21.15.159:0/3820469781 conn(0x7fafa409c5b0 msgr2=0x7fafa40d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:12.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.939+0000 7fafaa147640 1 -- 172.21.15.159:0/3820469781 shutdown_connections 2023-11-26T07:17:12.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.939+0000 7fafaa147640 1 -- 172.21.15.159:0/3820469781 wait complete. 2023-11-26T07:17:12.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.941+0000 7fafaa147640 1 Processor -- start 2023-11-26T07:17:12.944 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.941+0000 7fafaa147640 1 -- start start 2023-11-26T07:17:12.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.942+0000 7fafaa147640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa40b2050 0x7fafa40c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.942+0000 7fafaa147640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41609f0 0x7fafa40c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.942+0000 7fafaa147640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa4160dd0 0x7fafa40c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:12.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.942+0000 7fafaa147640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa41489c0 con 0x7fafa4160dd0 2023-11-26T07:17:12.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.942+0000 7fafaa147640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4148ca0 con 0x7fafa41609f0 2023-11-26T07:17:12.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.942+0000 7fafaa147640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4148f80 con 0x7fafa40b2050 2023-11-26T07:17:12.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.942+0000 7fafa9145640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa40b2050 0x7fafa40c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.942+0000 7fafa8944640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41609f0 0x7fafa40c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:12.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.942+0000 7fafa9145640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa40b2050 0x7fafa40c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:57156/0 (socket says 172.21.15.159:57156) 2023-11-26T07:17:12.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.942+0000 7fafa9145640 1 -- 172.21.15.159:0/542969365 learned_addr learned my addr 172.21.15.159:0/542969365 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:12.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.943+0000 7fafa9145640 1 -- 172.21.15.159:0/542969365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41609f0 msgr2=0x7fafa40c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.943+0000 7fafa9145640 1 --2- 172.21.15.159:0/542969365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41609f0 0x7fafa40c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.943+0000 7fafa9145640 1 -- 172.21.15.159:0/542969365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa4160dd0 msgr2=0x7fafa40c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:12.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.943+0000 7fafa9145640 1 --2- 172.21.15.159:0/542969365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa4160dd0 0x7fafa40c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:12.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.943+0000 7fafa9145640 1 -- 172.21.15.159:0/542969365 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00094d0 con 0x7fafa40b2050 2023-11-26T07:17:12.947 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.943+0000 7fafa9145640 1 --2- 172.21.15.159:0/542969365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa40b2050 0x7fafa40c9b10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009870 tx=0x7fafa0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:12.947 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.943+0000 7faf99ffb640 1 -- 172.21.15.159:0/542969365 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0039c90 con 0x7fafa40b2050 2023-11-26T07:17:12.947 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.943+0000 7faf99ffb640 1 -- 172.21.15.159:0/542969365 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0039e10 con 0x7fafa40b2050 2023-11-26T07:17:12.947 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.943+0000 7faf99ffb640 1 -- 172.21.15.159:0/542969365 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0043640 con 0x7fafa40b2050 2023-11-26T07:17:12.948 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.943+0000 7fafaa147640 1 -- 172.21.15.159:0/542969365 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa4149260 con 0x7fafa40b2050 2023-11-26T07:17:12.948 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.944+0000 7fafaa147640 1 -- 172.21.15.159:0/542969365 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa40ca050 con 0x7fafa40b2050 2023-11-26T07:17:12.948 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.944+0000 7faf99ffb640 1 -- 172.21.15.159:0/542969365 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fafa0043aa0 con 0x7fafa40b2050 2023-11-26T07:17:12.948 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.944+0000 7faf99ffb640 1 -- 172.21.15.159:0/542969365 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fafa003e070 con 0x7fafa40b2050 2023-11-26T07:17:12.948 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.945+0000 7fafaa147640 1 -- 172.21.15.159:0/542969365 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa4149780 con 0x7fafa40b2050 2023-11-26T07:17:12.950 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:12.948+0000 7faf99ffb640 1 -- 172.21.15.159:0/542969365 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fafa0034070 con 0x7fafa40b2050 2023-11-26T07:17:12.995 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:12.993+0000 7f5a34d7f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-26T07:17:13.029 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.027+0000 7fafaa147640 1 -- 172.21.15.159:0/542969365 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd new", "uuid": "89943722-64a8-4ff2-ad1a-21dd42e10ddc", "id": 4} v 0) v1 -- 0x7fafa404e840 con 0x7fafa40b2050 2023-11-26T07:17:13.036 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.033+0000 7faf99ffb640 1 -- 172.21.15.159:0/542969365 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89943722-64a8-4ff2-ad1a-21dd42e10ddc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fafa004d460 con 0x7fafa40b2050 2023-11-26T07:17:13.036 INFO:teuthology.orchestra.run.smithi159.stdout:4 2023-11-26T07:17:13.037 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.035+0000 7fafaa147640 1 -- 172.21.15.159:0/542969365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa40b2050 msgr2=0x7fafa40c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.037 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.035+0000 7fafaa147640 1 --2- 172.21.15.159:0/542969365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa40b2050 0x7fafa40c9b10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009870 tx=0x7fafa0004730 comp rx=0 tx=0).stop 2023-11-26T07:17:13.038 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.035+0000 7fafaa147640 1 -- 172.21.15.159:0/542969365 shutdown_connections 2023-11-26T07:17:13.038 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.035+0000 7fafaa147640 1 --2- 172.21.15.159:0/542969365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa4160dd0 0x7fafa40c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.038 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.035+0000 7fafaa147640 1 --2- 172.21.15.159:0/542969365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41609f0 0x7fafa40c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.038 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.035+0000 7fafaa147640 1 --2- 172.21.15.159:0/542969365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafa40b2050 0x7fafa40c9b10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.038 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.035+0000 7fafaa147640 1 -- 172.21.15.159:0/542969365 >> 172.21.15.159:0/542969365 conn(0x7fafa409c5b0 msgr2=0x7fafa406c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:13.039 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.035+0000 7fafaa147640 1 -- 172.21.15.159:0/542969365 shutdown_connections 2023-11-26T07:17:13.039 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.035+0000 7fafaa147640 1 -- 172.21.15.159:0/542969365 wait complete. 2023-11-26T07:17:13.059 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 61449b27-a919-4e28-8afd-3284ef0ab3ee 5 2023-11-26T07:17:13.156 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:13.153+0000 7f5a34d7f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-26T07:17:13.190 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:13.188+0000 7f39c260f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-26T07:17:13.259 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.256+0000 7f56cd5ff640 1 Processor -- start 2023-11-26T07:17:13.259 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.256+0000 7f56cd5ff640 1 -- start start 2023-11-26T07:17:13.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.258+0000 7f56cd5ff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56c81609f0 0x7f56c80d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.258+0000 7f56cd5ff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c8160dd0 0x7f56c80d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.258+0000 7f56cd5ff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c80b41b0 con 0x7f56c80b2050 2023-11-26T07:17:13.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.258+0000 7f56cd5ff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c80b4490 con 0x7f56c81609f0 2023-11-26T07:17:13.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.258+0000 7f56cd5ff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80b0090 con 0x7f56c8160dd0 2023-11-26T07:17:13.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.258+0000 7f56bffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c8160dd0 0x7f56c80d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.258+0000 7f56bffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c8160dd0 0x7f56c80d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:57172/0 (socket says 172.21.15.159:57172) 2023-11-26T07:17:13.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.258+0000 7f56bffff640 1 -- 172.21.15.159:0/2369859226 learned_addr learned my addr 172.21.15.159:0/2369859226 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:13.262 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.259+0000 7f56c7fff640 1 --2- 172.21.15.159:0/2369859226 >> v2:172.21.15.77:3300/0 conn(0x7f56c81609f0 0x7f56c80d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.262 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.259+0000 7f56bffff640 1 -- 172.21.15.159:0/2369859226 >> v2:172.21.15.77:3300/0 conn(0x7f56c81609f0 msgr2=0x7f56c80d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:13.262 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.259+0000 7f56bffff640 1 --2- 172.21.15.159:0/2369859226 >> v2:172.21.15.77:3300/0 conn(0x7f56c81609f0 0x7f56c80d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.262 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.259+0000 7f56bffff640 1 -- 172.21.15.159:0/2369859226 >> v1:172.21.15.77:6789/0 conn(0x7f56c80b2050 legacy=0x7f56c80b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:13.262 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.259+0000 7f56bffff640 1 -- 172.21.15.159:0/2369859226 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80b0370 con 0x7f56c8160dd0 2023-11-26T07:17:13.263 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.260+0000 7f56bffff640 1 --2- 172.21.15.159:0/2369859226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c8160dd0 0x7f56c80d1830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009870 tx=0x7f56b002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b5717b218502fc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.263 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.260+0000 7f56c77fe640 1 -- 172.21.15.159:0/2369859226 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0031640 con 0x7f56c8160dd0 2023-11-26T07:17:13.263 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.260+0000 7f56c77fe640 1 -- 172.21.15.159:0/2369859226 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b00317a0 con 0x7f56c8160dd0 2023-11-26T07:17:13.263 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.260+0000 7f56c77fe640 1 -- 172.21.15.159:0/2369859226 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0031b30 con 0x7f56c8160dd0 2023-11-26T07:17:13.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.261+0000 7f56cd5ff640 1 -- 172.21.15.159:0/2369859226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c8160dd0 msgr2=0x7f56c80d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.261+0000 7f56cd5ff640 1 --2- 172.21.15.159:0/2369859226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c8160dd0 0x7f56c80d1830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009870 tx=0x7f56b002b8f0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.261+0000 7f56cd5ff640 1 -- 172.21.15.159:0/2369859226 shutdown_connections 2023-11-26T07:17:13.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.261+0000 7f56cd5ff640 1 --2- 172.21.15.159:0/2369859226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c8160dd0 0x7f56c80d1830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.261+0000 7f56cd5ff640 1 --2- 172.21.15.159:0/2369859226 >> v2:172.21.15.77:3300/0 conn(0x7f56c81609f0 0x7f56c80d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.261+0000 7f56cd5ff640 1 -- 172.21.15.159:0/2369859226 >> 172.21.15.159:0/2369859226 conn(0x7f56c809c5b0 msgr2=0x7f56c80d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:13.265 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.261+0000 7f56cd5ff640 1 -- 172.21.15.159:0/2369859226 shutdown_connections 2023-11-26T07:17:13.265 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.261+0000 7f56cd5ff640 1 -- 172.21.15.159:0/2369859226 wait complete. 2023-11-26T07:17:13.266 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.264+0000 7f56cd5ff640 1 Processor -- start 2023-11-26T07:17:13.266 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.264+0000 7f56cd5ff640 1 -- start start 2023-11-26T07:17:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.265+0000 7f56cd5ff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c80b2050 0x7f56c80cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.265+0000 7f56cd5ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c81609f0 0x7f56c81f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.265+0000 7f56cd5ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56c8160dd0 0x7f56c8159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.265+0000 7f56cd5ff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c815a060 con 0x7f56c8160dd0 2023-11-26T07:17:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.265+0000 7f56cd5ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c8148f20 con 0x7f56c81609f0 2023-11-26T07:17:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.265+0000 7f56cd5ff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80cc550 con 0x7f56c80b2050 2023-11-26T07:17:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56c7fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c80b2050 0x7f56c80cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56bffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c81609f0 0x7f56c81f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56bffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c81609f0 0x7f56c81f2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48308/0 (socket says 172.21.15.159:48308) 2023-11-26T07:17:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56bffff640 1 -- 172.21.15.159:0/1518149652 learned_addr learned my addr 172.21.15.159:0/1518149652 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56c7fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c80b2050 0x7f56c80cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:57182/0 (socket says 172.21.15.159:57182) 2023-11-26T07:17:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56ccdfe640 1 --2- 172.21.15.159:0/1518149652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56c8160dd0 0x7f56c8159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56c7fff640 1 -- 172.21.15.159:0/1518149652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c81609f0 msgr2=0x7f56c81f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56c7fff640 1 --2- 172.21.15.159:0/1518149652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c81609f0 0x7f56c81f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56c7fff640 1 -- 172.21.15.159:0/1518149652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56c8160dd0 msgr2=0x7f56c8159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56c7fff640 1 --2- 172.21.15.159:0/1518149652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56c8160dd0 0x7f56c8159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56c7fff640 1 -- 172.21.15.159:0/1518149652 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b00094d0 con 0x7f56c80b2050 2023-11-26T07:17:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.266+0000 7f56bffff640 1 --2- 172.21.15.159:0/1518149652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c81609f0 0x7f56c81f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.267+0000 7f56c7fff640 1 --2- 172.21.15.159:0/1518149652 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c80b2050 0x7f56c80cc010 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56b800d5f0 tx=0x7f56b800dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.267+0000 7f56c57fa640 1 -- 172.21.15.159:0/1518149652 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b80125f0 con 0x7f56c80b2050 2023-11-26T07:17:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.267+0000 7f56c57fa640 1 -- 172.21.15.159:0/1518149652 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b8012750 con 0x7f56c80b2050 2023-11-26T07:17:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.267+0000 7f56cd5ff640 1 -- 172.21.15.159:0/1518149652 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c80caf70 con 0x7f56c80b2050 2023-11-26T07:17:13.272 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.267+0000 7f56c57fa640 1 -- 172.21.15.159:0/1518149652 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8012b00 con 0x7f56c80b2050 2023-11-26T07:17:13.272 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.267+0000 7f56cd5ff640 1 -- 172.21.15.159:0/1518149652 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c80cb300 con 0x7f56c80b2050 2023-11-26T07:17:13.272 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.267+0000 7f56c57fa640 1 -- 172.21.15.159:0/1518149652 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f56b801e460 con 0x7f56c80b2050 2023-11-26T07:17:13.272 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.267+0000 7f56c57fa640 1 -- 172.21.15.159:0/1518149652 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f56b801ec90 con 0x7f56c80b2050 2023-11-26T07:17:13.272 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.268+0000 7f56cd5ff640 1 -- 172.21.15.159:0/1518149652 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c804e840 con 0x7f56c80b2050 2023-11-26T07:17:13.273 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.270+0000 7f56c57fa640 1 -- 172.21.15.159:0/1518149652 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f56b801e710 con 0x7f56c80b2050 2023-11-26T07:17:13.293 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:13.290+0000 7f5a34d7f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-26T07:17:13.345 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:13.343+0000 7f5a34d7f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-26T07:17:13.351 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.349+0000 7f56cd5ff640 1 -- 172.21.15.159:0/1518149652 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd new", "uuid": "61449b27-a919-4e28-8afd-3284ef0ab3ee", "id": 5} v 0) v1 -- 0x7f56c80cd510 con 0x7f56c80b2050 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.355+0000 7f56c57fa640 1 -- 172.21.15.159:0/1518149652 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "61449b27-a919-4e28-8afd-3284ef0ab3ee", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f56b801e9e0 con 0x7f56c80b2050 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi159.stdout:5 2023-11-26T07:17:13.360 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.357+0000 7f56cd5ff640 1 -- 172.21.15.159:0/1518149652 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c80b2050 msgr2=0x7f56c80cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.360 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.357+0000 7f56cd5ff640 1 --2- 172.21.15.159:0/1518149652 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c80b2050 0x7f56c80cc010 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56b800d5f0 tx=0x7f56b800dab0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.360 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.357+0000 7f56cd5ff640 1 -- 172.21.15.159:0/1518149652 shutdown_connections 2023-11-26T07:17:13.360 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.357+0000 7f56cd5ff640 1 --2- 172.21.15.159:0/1518149652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56c8160dd0 0x7f56c8159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.360 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.357+0000 7f56cd5ff640 1 --2- 172.21.15.159:0/1518149652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c81609f0 0x7f56c81f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.360 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.357+0000 7f56cd5ff640 1 --2- 172.21.15.159:0/1518149652 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56c80b2050 0x7f56c80cc010 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.360 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.357+0000 7f56cd5ff640 1 -- 172.21.15.159:0/1518149652 >> 172.21.15.159:0/1518149652 conn(0x7f56c809c5b0 msgr2=0x7f56c80d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:13.360 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.357+0000 7f56cd5ff640 1 -- 172.21.15.159:0/1518149652 shutdown_connections 2023-11-26T07:17:13.361 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.357+0000 7f56cd5ff640 1 -- 172.21.15.159:0/1518149652 wait complete. 2023-11-26T07:17:13.361 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:13.358+0000 7f39c260f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-26T07:17:13.375 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new f40f87f7-a3b9-4185-baa0-d44d356c0493 6 2023-11-26T07:17:13.455 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:13.453+0000 7f5a34d7f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:17:13.505 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:13.502+0000 7f39c260f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-26T07:17:13.561 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:13.558+0000 7f39c260f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-26T07:17:13.565 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:13.563+0000 7f5a34d7f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-26T07:17:13.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.563+0000 7f29a316c640 1 Processor -- start 2023-11-26T07:17:13.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.564+0000 7f29a316c640 1 -- start start 2023-11-26T07:17:13.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.565+0000 7f29a316c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f299c0cefb0 0x7f299c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.565+0000 7f29a316c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c0cc8d0 con 0x7f299c0cdbb0 2023-11-26T07:17:13.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.565+0000 7f29a316c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c0cbd30 con 0x7f299c15a2f0 2023-11-26T07:17:13.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.565+0000 7f29a316c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c0cb400 con 0x7f299c0cefb0 2023-11-26T07:17:13.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.565+0000 7f29a296b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f299c0cefb0 0x7f299c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.565+0000 7f29a296b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f299c0cefb0 0x7f299c06d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48324/0 (socket says 172.21.15.159:48324) 2023-11-26T07:17:13.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.565+0000 7f29a296b640 1 -- 172.21.15.159:0/2597856747 learned_addr learned my addr 172.21.15.159:0/2597856747 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:13.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.566+0000 7f29a296b640 1 -- 172.21.15.159:0/2597856747 >> v1:172.21.15.159:6789/0 conn(0x7f299c15a2f0 legacy=0x7f299c0cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.566+0000 7f29a296b640 1 -- 172.21.15.159:0/2597856747 >> v1:172.21.15.77:6789/0 conn(0x7f299c0cdbb0 legacy=0x7f299c0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.566+0000 7f29a296b640 1 -- 172.21.15.159:0/2597856747 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c0cb6e0 con 0x7f299c0cefb0 2023-11-26T07:17:13.570 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.567+0000 7f29a296b640 1 --2- 172.21.15.159:0/2597856747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f299c0cefb0 0x7f299c06d390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2994009e50 tx=0x7f299402bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a5de9fe0de3f04d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.570 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.567+0000 7f29a1168640 1 -- 172.21.15.159:0/2597856747 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299402cb10 con 0x7f299c0cefb0 2023-11-26T07:17:13.570 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.567+0000 7f29a1168640 1 -- 172.21.15.159:0/2597856747 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299402cc70 con 0x7f299c0cefb0 2023-11-26T07:17:13.570 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.567+0000 7f29a1168640 1 -- 172.21.15.159:0/2597856747 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29940343f0 con 0x7f299c0cefb0 2023-11-26T07:17:13.571 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.568+0000 7f29a316c640 1 -- 172.21.15.159:0/2597856747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f299c0cefb0 msgr2=0x7f299c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.571 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.568+0000 7f29a316c640 1 --2- 172.21.15.159:0/2597856747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f299c0cefb0 0x7f299c06d390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2994009e50 tx=0x7f299402bf70 comp rx=0 tx=0).stop 2023-11-26T07:17:13.571 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.568+0000 7f29a316c640 1 -- 172.21.15.159:0/2597856747 shutdown_connections 2023-11-26T07:17:13.571 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.568+0000 7f29a316c640 1 --2- 172.21.15.159:0/2597856747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f299c0cefb0 0x7f299c06d390 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.571 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.568+0000 7f29a316c640 1 -- 172.21.15.159:0/2597856747 >> 172.21.15.159:0/2597856747 conn(0x7f299c0b1ad0 msgr2=0x7f299c0b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:13.571 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.568+0000 7f29a316c640 1 -- 172.21.15.159:0/2597856747 shutdown_connections 2023-11-26T07:17:13.571 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.568+0000 7f29a316c640 1 -- 172.21.15.159:0/2597856747 wait complete. 2023-11-26T07:17:13.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.570+0000 7f29a316c640 1 Processor -- start 2023-11-26T07:17:13.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.570+0000 7f29a316c640 1 -- start start 2023-11-26T07:17:13.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.571+0000 7f29a316c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f299c0cdbb0 0x7f299c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.571+0000 7f29a316c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f299c0cefb0 0x7f299c1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.571+0000 7f29a316c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f299c15a2f0 0x7f299c1586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.571+0000 7f29a316c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0c5370 con 0x7f299c0cefb0 2023-11-26T07:17:13.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.571+0000 7f29a316c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c15c940 con 0x7f299c0cdbb0 2023-11-26T07:17:13.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.571+0000 7f29a316c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c15cc20 con 0x7f299c15a2f0 2023-11-26T07:17:13.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.571+0000 7f29a216a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f299c0cdbb0 0x7f299c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.571+0000 7f29a296b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f299c15a2f0 0x7f299c1586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.571+0000 7f29a216a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f299c0cdbb0 0x7f299c071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48326/0 (socket says 172.21.15.159:48326) 2023-11-26T07:17:13.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.571+0000 7f29a216a640 1 -- 172.21.15.159:0/1765801238 learned_addr learned my addr 172.21.15.159:0/1765801238 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:13.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.571+0000 7f29a1969640 1 --2- 172.21.15.159:0/1765801238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f299c0cefb0 0x7f299c1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.572+0000 7f29a216a640 1 -- 172.21.15.159:0/1765801238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f299c15a2f0 msgr2=0x7f299c1586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.572+0000 7f29a216a640 1 --2- 172.21.15.159:0/1765801238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f299c15a2f0 0x7f299c1586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.572+0000 7f29a216a640 1 -- 172.21.15.159:0/1765801238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f299c0cefb0 msgr2=0x7f299c1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.572+0000 7f29a216a640 1 --2- 172.21.15.159:0/1765801238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f299c0cefb0 0x7f299c1581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.572+0000 7f29a216a640 1 -- 172.21.15.159:0/1765801238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2994009b30 con 0x7f299c0cdbb0 2023-11-26T07:17:13.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.572+0000 7f29a216a640 1 --2- 172.21.15.159:0/1765801238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f299c0cdbb0 0x7f299c071380 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f299800c450 tx=0x7f299800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.572+0000 7f2992ffd640 1 -- 172.21.15.159:0/1765801238 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980052d0 con 0x7f299c0cdbb0 2023-11-26T07:17:13.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.572+0000 7f2992ffd640 1 -- 172.21.15.159:0/1765801238 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2998005430 con 0x7f299c0cdbb0 2023-11-26T07:17:13.577 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.572+0000 7f2992ffd640 1 -- 172.21.15.159:0/1765801238 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998012870 con 0x7f299c0cdbb0 2023-11-26T07:17:13.577 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.572+0000 7f29a316c640 1 -- 172.21.15.159:0/1765801238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c15cf00 con 0x7f299c0cdbb0 2023-11-26T07:17:13.577 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.572+0000 7f29a316c640 1 -- 172.21.15.159:0/1765801238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c0718c0 con 0x7f299c0cdbb0 2023-11-26T07:17:13.577 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.573+0000 7f2992ffd640 1 -- 172.21.15.159:0/1765801238 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2998012cd0 con 0x7f299c0cdbb0 2023-11-26T07:17:13.577 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.573+0000 7f2992ffd640 1 -- 172.21.15.159:0/1765801238 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2998011380 con 0x7f299c0cdbb0 2023-11-26T07:17:13.577 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.573+0000 7f29a316c640 1 -- 172.21.15.159:0/1765801238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c15d420 con 0x7f299c0cdbb0 2023-11-26T07:17:13.578 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.576+0000 7f2992ffd640 1 -- 172.21.15.159:0/1765801238 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f299c15d420 con 0x7f299c0cdbb0 2023-11-26T07:17:13.657 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.655+0000 7f29a316c640 1 -- 172.21.15.159:0/1765801238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f40f87f7-a3b9-4185-baa0-d44d356c0493", "id": 6} v 0) v1 -- 0x7f299c071a80 con 0x7f299c0cdbb0 2023-11-26T07:17:13.664 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.661+0000 7f2992ffd640 1 -- 172.21.15.159:0/1765801238 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f40f87f7-a3b9-4185-baa0-d44d356c0493", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f29980035f0 con 0x7f299c0cdbb0 2023-11-26T07:17:13.664 INFO:teuthology.orchestra.run.smithi159.stdout:6 2023-11-26T07:17:13.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.663+0000 7f29a316c640 1 -- 172.21.15.159:0/1765801238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f299c0cdbb0 msgr2=0x7f299c071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.663+0000 7f29a316c640 1 --2- 172.21.15.159:0/1765801238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f299c0cdbb0 0x7f299c071380 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f299800c450 tx=0x7f299800c910 comp rx=0 tx=0).stop 2023-11-26T07:17:13.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.663+0000 7f29a316c640 1 -- 172.21.15.159:0/1765801238 shutdown_connections 2023-11-26T07:17:13.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.663+0000 7f29a316c640 1 --2- 172.21.15.159:0/1765801238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f299c15a2f0 0x7f299c1586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.663+0000 7f29a316c640 1 --2- 172.21.15.159:0/1765801238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f299c0cefb0 0x7f299c1581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.663+0000 7f29a316c640 1 --2- 172.21.15.159:0/1765801238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f299c0cdbb0 0x7f299c071380 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.663+0000 7f29a316c640 1 -- 172.21.15.159:0/1765801238 >> 172.21.15.159:0/1765801238 conn(0x7f299c0b1ad0 msgr2=0x7f299c0aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:13.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.663+0000 7f29a316c640 1 -- 172.21.15.159:0/1765801238 shutdown_connections 2023-11-26T07:17:13.667 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.663+0000 7f29a316c640 1 -- 172.21.15.159:0/1765801238 wait complete. 2023-11-26T07:17:13.678 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:13.676+0000 7f39c260f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:17:13.682 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new ef2b712e-4b9f-4810-a090-2c70819ac313 7 2023-11-26T07:17:13.727 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:13.724+0000 7f5a34d7f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:17:13.776 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:13.773+0000 7f5a34d7f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-26T07:17:13.796 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:13.794+0000 7f39c260f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-26T07:17:13.876 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.874+0000 7eff26e2d640 1 Processor -- start 2023-11-26T07:17:13.877 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.874+0000 7eff26e2d640 1 -- start start 2023-11-26T07:17:13.879 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.875+0000 7eff26e2d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7eff20072160 0x7eff2015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.879 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.875+0000 7eff26e2d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff200c49f0 0x7eff2006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.879 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.875+0000 7eff26e2d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2006dc40 0x7eff200cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.879 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.875+0000 7eff26e2d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2006e0d0 con 0x7eff200c49f0 2023-11-26T07:17:13.879 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.875+0000 7eff26e2d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2015ec90 con 0x7eff20072160 2023-11-26T07:17:13.879 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.875+0000 7eff26e2d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff200cd530 con 0x7eff2006dc40 2023-11-26T07:17:13.879 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.876+0000 7eff24bc9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7eff20072160 0x7eff2015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.879 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.876+0000 7eff253ca640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2006dc40 0x7eff200cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.879 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.876+0000 7eff24bc9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7eff20072160 0x7eff2015e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48338/0 (socket says 172.21.15.159:48338) 2023-11-26T07:17:13.880 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.876+0000 7eff24bc9640 1 -- 172.21.15.159:0/820945557 learned_addr learned my addr 172.21.15.159:0/820945557 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:13.880 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.876+0000 7eff1ffff640 1 --2- 172.21.15.159:0/820945557 >> v2:172.21.15.77:3300/0 conn(0x7eff200c49f0 0x7eff2006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.880 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.876+0000 7eff24bc9640 1 -- 172.21.15.159:0/820945557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2006dc40 msgr2=0x7eff200cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:13.880 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.876+0000 7eff24bc9640 1 --2- 172.21.15.159:0/820945557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2006dc40 0x7eff200cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.880 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.876+0000 7eff24bc9640 1 -- 172.21.15.159:0/820945557 >> v2:172.21.15.77:3300/0 conn(0x7eff200c49f0 msgr2=0x7eff2006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:13.880 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.876+0000 7eff24bc9640 1 --2- 172.21.15.159:0/820945557 >> v2:172.21.15.77:3300/0 conn(0x7eff200c49f0 0x7eff2006d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.880 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.876+0000 7eff24bc9640 1 -- 172.21.15.159:0/820945557 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff200c4ed0 con 0x7eff20072160 2023-11-26T07:17:13.881 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.877+0000 7eff24bc9640 1 --2- 172.21.15.159:0/820945557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff20072160 0x7eff2015e750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7eff200ccae0 tx=0x7eff1402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7d6fedb2892c7b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.881 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.878+0000 7eff1f7fe640 1 -- 172.21.15.159:0/820945557 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14031870 con 0x7eff20072160 2023-11-26T07:17:13.881 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.878+0000 7eff1f7fe640 1 -- 172.21.15.159:0/820945557 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff140319d0 con 0x7eff20072160 2023-11-26T07:17:13.881 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.878+0000 7eff1f7fe640 1 -- 172.21.15.159:0/820945557 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14031d60 con 0x7eff20072160 2023-11-26T07:17:13.881 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.878+0000 7eff26e2d640 1 -- 172.21.15.159:0/820945557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff20072160 msgr2=0x7eff2015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.881 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.878+0000 7eff26e2d640 1 --2- 172.21.15.159:0/820945557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff20072160 0x7eff2015e750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7eff200ccae0 tx=0x7eff1402b910 comp rx=0 tx=0).stop 2023-11-26T07:17:13.881 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.878+0000 7eff26e2d640 1 -- 172.21.15.159:0/820945557 shutdown_connections 2023-11-26T07:17:13.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.878+0000 7eff26e2d640 1 --2- 172.21.15.159:0/820945557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2006dc40 0x7eff200cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.878+0000 7eff26e2d640 1 --2- 172.21.15.159:0/820945557 >> v2:172.21.15.77:3300/0 conn(0x7eff200c49f0 0x7eff2006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.878+0000 7eff26e2d640 1 --2- 172.21.15.159:0/820945557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff20072160 0x7eff2015e750 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.878+0000 7eff26e2d640 1 -- 172.21.15.159:0/820945557 >> 172.21.15.159:0/820945557 conn(0x7eff200b0c50 msgr2=0x7eff200b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:13.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.878+0000 7eff26e2d640 1 -- 172.21.15.159:0/820945557 shutdown_connections 2023-11-26T07:17:13.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.879+0000 7eff26e2d640 1 -- 172.21.15.159:0/820945557 wait complete. 2023-11-26T07:17:13.883 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.880+0000 7eff26e2d640 1 Processor -- start 2023-11-26T07:17:13.883 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.880+0000 7eff26e2d640 1 -- start start 2023-11-26T07:17:13.885 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.881+0000 7eff26e2d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff2006dc40 0x7eff20158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.885 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.881+0000 7eff26e2d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff20072160 0x7eff200cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.885 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.881+0000 7eff26e2d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff200c49f0 0x7eff200cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.885 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.881+0000 7eff26e2d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff200cc8f0 con 0x7eff2006dc40 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.881+0000 7eff26e2d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff200b1eb0 con 0x7eff200c49f0 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.881+0000 7eff26e2d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff200b2630 con 0x7eff20072160 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.881+0000 7eff253ca640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff200c49f0 0x7eff200cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.881+0000 7eff1ffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff20072160 0x7eff200cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.881+0000 7eff1ffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff20072160 0x7eff200cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:57212/0 (socket says 172.21.15.159:57212) 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.881+0000 7eff253ca640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff200c49f0 0x7eff200cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48350/0 (socket says 172.21.15.159:48350) 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.881+0000 7eff1ffff640 1 -- 172.21.15.159:0/598496889 learned_addr learned my addr 172.21.15.159:0/598496889 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.882+0000 7eff24bc9640 1 --2- 172.21.15.159:0/598496889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff2006dc40 0x7eff20158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.882+0000 7eff1ffff640 1 -- 172.21.15.159:0/598496889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff200c49f0 msgr2=0x7eff200cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.882+0000 7eff1ffff640 1 --2- 172.21.15.159:0/598496889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff200c49f0 0x7eff200cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.882+0000 7eff1ffff640 1 -- 172.21.15.159:0/598496889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff2006dc40 msgr2=0x7eff20158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.882+0000 7eff1ffff640 1 --2- 172.21.15.159:0/598496889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff2006dc40 0x7eff20158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.882+0000 7eff1ffff640 1 -- 172.21.15.159:0/598496889 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140094d0 con 0x7eff20072160 2023-11-26T07:17:13.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.882+0000 7eff253ca640 1 --2- 172.21.15.159:0/598496889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff200c49f0 0x7eff200cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:13.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.882+0000 7eff1ffff640 1 --2- 172.21.15.159:0/598496889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff20072160 0x7eff200cb290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00d5f0 tx=0x7eff0c00dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.882+0000 7eff1d7fa640 1 -- 172.21.15.159:0/598496889 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0125f0 con 0x7eff20072160 2023-11-26T07:17:13.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.883+0000 7eff1d7fa640 1 -- 172.21.15.159:0/598496889 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c012750 con 0x7eff20072160 2023-11-26T07:17:13.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.883+0000 7eff1d7fa640 1 -- 172.21.15.159:0/598496889 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c012b00 con 0x7eff20072160 2023-11-26T07:17:13.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.883+0000 7eff26e2d640 1 -- 172.21.15.159:0/598496889 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff200b2910 con 0x7eff20072160 2023-11-26T07:17:13.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.883+0000 7eff26e2d640 1 -- 172.21.15.159:0/598496889 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff200b2150 con 0x7eff20072160 2023-11-26T07:17:13.888 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.883+0000 7eff1d7fa640 1 -- 172.21.15.159:0/598496889 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7eff0c01e460 con 0x7eff20072160 2023-11-26T07:17:13.888 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.883+0000 7eff1d7fa640 1 -- 172.21.15.159:0/598496889 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7eff0c014b30 con 0x7eff20072160 2023-11-26T07:17:13.888 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.884+0000 7eff26e2d640 1 -- 172.21.15.159:0/598496889 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2004e8b0 con 0x7eff20072160 2023-11-26T07:17:13.889 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.886+0000 7eff1d7fa640 1 -- 172.21.15.159:0/598496889 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7eff0c014d80 con 0x7eff20072160 2023-11-26T07:17:13.934 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:13.932+0000 7f5a34d7f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-26T07:17:13.961 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:13.959+0000 7f39c260f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:17:13.966 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.963+0000 7eff26e2d640 1 -- 172.21.15.159:0/598496889 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ef2b712e-4b9f-4810-a090-2c70819ac313", "id": 7} v 0) v1 -- 0x7eff2015dab0 con 0x7eff20072160 2023-11-26T07:17:13.974 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.972+0000 7eff1d7fa640 1 -- 172.21.15.159:0/598496889 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef2b712e-4b9f-4810-a090-2c70819ac313", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7eff0c0144d0 con 0x7eff20072160 2023-11-26T07:17:13.974 INFO:teuthology.orchestra.run.smithi159.stdout:7 2023-11-26T07:17:13.976 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.973+0000 7eff26e2d640 1 -- 172.21.15.159:0/598496889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff20072160 msgr2=0x7eff200cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.976 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.973+0000 7eff26e2d640 1 --2- 172.21.15.159:0/598496889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff20072160 0x7eff200cb290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00d5f0 tx=0x7eff0c00dab0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.976 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.973+0000 7eff26e2d640 1 -- 172.21.15.159:0/598496889 shutdown_connections 2023-11-26T07:17:13.976 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.973+0000 7eff26e2d640 1 --2- 172.21.15.159:0/598496889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff200c49f0 0x7eff200cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.976 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.973+0000 7eff26e2d640 1 --2- 172.21.15.159:0/598496889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff20072160 0x7eff200cb290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.976 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.973+0000 7eff26e2d640 1 --2- 172.21.15.159:0/598496889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff2006dc40 0x7eff20158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.976 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.973+0000 7eff26e2d640 1 -- 172.21.15.159:0/598496889 >> 172.21.15.159:0/598496889 conn(0x7eff200b0c50 msgr2=0x7eff200ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:13.976 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.973+0000 7eff26e2d640 1 -- 172.21.15.159:0/598496889 shutdown_connections 2023-11-26T07:17:13.976 INFO:teuthology.orchestra.run.smithi159.stderr:2023-11-26T07:17:13.973+0000 7eff26e2d640 1 -- 172.21.15.159:0/598496889 wait complete. 2023-11-26T07:17:13.998 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-26T07:17:13.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-26T07:17:14.007 INFO:tasks.ceph.osd.0:Started 2023-11-26T07:17:14.007 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-26T07:17:14.007 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-26T07:17:14.015 INFO:tasks.ceph.osd.1:Started 2023-11-26T07:17:14.015 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-26T07:17:14.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-26T07:17:14.021 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:14.018+0000 7f39c260f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-26T07:17:14.021 INFO:tasks.ceph.osd.2:Started 2023-11-26T07:17:14.021 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-26T07:17:14.022 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-26T07:17:14.027 INFO:tasks.ceph.osd.3:Started 2023-11-26T07:17:14.027 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-26T07:17:14.027 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-26T07:17:14.035 INFO:tasks.ceph.osd.4:Started 2023-11-26T07:17:14.036 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-26T07:17:14.036 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-26T07:17:14.043 INFO:tasks.ceph.osd.5:Started 2023-11-26T07:17:14.044 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-26T07:17:14.044 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-26T07:17:14.049 INFO:tasks.ceph.osd.6:Started 2023-11-26T07:17:14.049 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-26T07:17:14.049 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-26T07:17:14.054 INFO:tasks.ceph.osd.7:Started 2023-11-26T07:17:14.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:14.219 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:14.217+0000 7f39c260f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-26T07:17:14.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.294+0000 7fcd9b4ff640 1 Processor -- start 2023-11-26T07:17:14.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.295+0000 7fcd9b4ff640 1 -- start start 2023-11-26T07:17:14.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.296+0000 7fcd9b4ff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcd9406a500 0x7fcd9406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.296+0000 7fcd9b4ff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd940b2ed0 con 0x7fcd940d0ae0 2023-11-26T07:17:14.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.296+0000 7fcd9b4ff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9406e250 con 0x7fcd94144880 2023-11-26T07:17:14.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.296+0000 7fcd9b4ff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9406aed0 con 0x7fcd9406a500 2023-11-26T07:17:14.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.296+0000 7fcd99cfc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcd940d0ae0 0x7fcd9406db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55300/0 (socket says 172.21.15.77:55300) 2023-11-26T07:17:14.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.296+0000 7fcd99cfc640 1 -- 172.21.15.77:0/4182392415 learned_addr learned my addr 172.21.15.77:0/4182392415 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:14.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.296+0000 7fcd9acfe640 1 --2- 172.21.15.77:0/4182392415 >> v2:172.21.15.159:3300/0 conn(0x7fcd9406a500 0x7fcd9406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447804690 0 0) 0x7fcd940b2ed0 con 0x7fcd940d0ae0 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd80003520 con 0x7fcd940d0ae0 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2099074498 0 0) 0x7fcd80003520 con 0x7fcd940d0ae0 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 >> v2:172.21.15.159:3300/0 conn(0x7fcd9406a500 msgr2=0x7fcd9406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 --2- 172.21.15.77:0/4182392415 >> v2:172.21.15.159:3300/0 conn(0x7fcd9406a500 0x7fcd9406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 >> v1:172.21.15.159:6789/0 conn(0x7fcd94144880 legacy=0x7fcd9406f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940b3120 con 0x7fcd940d0ae0 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fcd84001670 con 0x7fcd940d0ae0 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 >> v1:172.21.15.77:6789/0 conn(0x7fcd940d0ae0 legacy=0x7fcd9406db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 0x7fcd80003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd800047c0 0x7fcd80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd80005180 0x7fcd8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9406aed0 con 0x7fcd800039f0 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8000c0b0 con 0x7fcd80005180 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8000c270 con 0x7fcd800047c0 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.297+0000 7fcd9a4fd640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 0x7fcd80003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.298+0000 7fcd99cfc640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd800047c0 0x7fcd80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.298+0000 7fcd9acfe640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd80005180 0x7fcd8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.298+0000 7fcd9a4fd640 1 -- 172.21.15.77:0/4182392415 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd800047c0 msgr2=0x7fcd80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.298+0000 7fcd9a4fd640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd800047c0 0x7fcd80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.298+0000 7fcd9a4fd640 1 -- 172.21.15.77:0/4182392415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd80005180 msgr2=0x7fcd8000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.298+0000 7fcd9a4fd640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd80005180 0x7fcd8000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.298+0000 7fcd9a4fd640 1 -- 172.21.15.77:0/4182392415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd80003520 con 0x7fcd800039f0 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.298+0000 7fcd9acfe640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd80005180 0x7fcd8000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.298+0000 7fcd9acfe640 1 -- 172.21.15.77:0/4182392415 reap_dead start 2023-11-26T07:17:14.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.299+0000 7fcd9a4fd640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 0x7fcd80003e10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd90001750 tx=0x7fcd800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7055497e1d4473e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:14.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.299+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd900052d0 con 0x7fcd800039f0 2023-11-26T07:17:14.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.299+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9002e050 con 0x7fcd800039f0 2023-11-26T07:17:14.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.299+0000 7fcd994fb640 1 -- 172.21.15.77:0/4182392415 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90003830 con 0x7fcd800039f0 2023-11-26T07:17:14.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.299+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4182392415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 msgr2=0x7fcd80003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.299+0000 7fcd9b4ff640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 0x7fcd80003e10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd90001750 tx=0x7fcd800057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.300+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4182392415 shutdown_connections 2023-11-26T07:17:14.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.300+0000 7fcd9b4ff640 1 --2- 172.21.15.77:0/4182392415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 0x7fcd80003e10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.300+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4182392415 >> 172.21.15.77:0/4182392415 conn(0x7fcd940cfea0 msgr2=0x7fcd940d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:14.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.300+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4182392415 shutdown_connections 2023-11-26T07:17:14.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.300+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4182392415 wait complete. 2023-11-26T07:17:14.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.301+0000 7fcd9b4ff640 1 Processor -- start 2023-11-26T07:17:14.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.302+0000 7fcd9b4ff640 1 -- start start 2023-11-26T07:17:14.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.302+0000 7fcd9b4ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 0x7fcd9413ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.302+0000 7fcd9b4ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd94140290 0x7fcd940b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.302+0000 7fcd9b4ff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd941406f0 0x7fcd940b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.302+0000 7fcd9b4ff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd941f3090 con 0x7fcd800039f0 2023-11-26T07:17:14.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.302+0000 7fcd9b4ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd941f3370 con 0x7fcd94140290 2023-11-26T07:17:14.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.302+0000 7fcd9b4ff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd941f3650 con 0x7fcd941406f0 2023-11-26T07:17:14.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.303+0000 7fcd9a4fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 0x7fcd9413ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.303+0000 7fcd9a4fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 0x7fcd9413ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57026/0 (socket says 172.21.15.77:57026) 2023-11-26T07:17:14.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.303+0000 7fcd9a4fd640 1 -- 172.21.15.77:0/4183423318 learned_addr learned my addr 172.21.15.77:0/4183423318 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:14.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.303+0000 7fcd99cfc640 1 --2- 172.21.15.77:0/4183423318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd94140290 0x7fcd940b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.303+0000 7fcd9acfe640 1 --2- 172.21.15.77:0/4183423318 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd941406f0 0x7fcd940b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.303+0000 7fcd9a4fd640 1 -- 172.21.15.77:0/4183423318 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd941406f0 msgr2=0x7fcd940b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.303+0000 7fcd9a4fd640 1 --2- 172.21.15.77:0/4183423318 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd941406f0 0x7fcd940b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.303+0000 7fcd9a4fd640 1 -- 172.21.15.77:0/4183423318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd94140290 msgr2=0x7fcd940b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.303+0000 7fcd9a4fd640 1 --2- 172.21.15.77:0/4183423318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd94140290 0x7fcd940b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.303+0000 7fcd9a4fd640 1 -- 172.21.15.77:0/4183423318 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9413d1b0 con 0x7fcd800039f0 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.304+0000 7fcd9a4fd640 1 --2- 172.21.15.77:0/4183423318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 0x7fcd9413ee40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcd90005040 tx=0x7fcd90001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.304+0000 7fcd8affd640 1 -- 172.21.15.77:0/4183423318 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd900076c0 con 0x7fcd800039f0 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.304+0000 7fcd8affd640 1 -- 172.21.15.77:0/4183423318 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd900069e0 con 0x7fcd800039f0 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.304+0000 7fcd8affd640 1 -- 172.21.15.77:0/4183423318 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90006d50 con 0x7fcd800039f0 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.304+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4183423318 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9413f380 con 0x7fcd800039f0 2023-11-26T07:17:14.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.304+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4183423318 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9413d6d0 con 0x7fcd800039f0 2023-11-26T07:17:14.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.304+0000 7fcd8affd640 1 -- 172.21.15.77:0/4183423318 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcd900038f0 con 0x7fcd800039f0 2023-11-26T07:17:14.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.304+0000 7fcd8affd640 1 -- 172.21.15.77:0/4183423318 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcd90003ba0 con 0x7fcd800039f0 2023-11-26T07:17:14.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.305+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4183423318 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd941f3790 con 0x7fcd800039f0 2023-11-26T07:17:14.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.308+0000 7fcd8affd640 1 -- 172.21.15.77:0/4183423318 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fcd941f3790 con 0x7fcd800039f0 2023-11-26T07:17:14.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.371+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4183423318 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd9404e840 con 0x7fcd800039f0 2023-11-26T07:17:14.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.373+0000 7fcd8affd640 1 -- 172.21.15.77:0/4183423318 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fcd90041020 con 0x7fcd800039f0 2023-11-26T07:17:14.375 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:14.375 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":10,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:13.966900+0000","last_up_change":"0.000000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.374+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4183423318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 msgr2=0x7fcd9413ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.374+0000 7fcd9b4ff640 1 --2- 172.21.15.77:0/4183423318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 0x7fcd9413ee40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcd90005040 tx=0x7fcd90001120 comp rx=0 tx=0).stop 2023-11-26T07:17:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.374+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4183423318 shutdown_connections 2023-11-26T07:17:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.374+0000 7fcd9b4ff640 1 --2- 172.21.15.77:0/4183423318 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd941406f0 0x7fcd940b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.374+0000 7fcd9b4ff640 1 --2- 172.21.15.77:0/4183423318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd94140290 0x7fcd940b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.374+0000 7fcd9b4ff640 1 --2- 172.21.15.77:0/4183423318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd800039f0 0x7fcd9413ee40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.374+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4183423318 >> 172.21.15.77:0/4183423318 conn(0x7fcd940cfea0 msgr2=0x7fcd940b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.374+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4183423318 shutdown_connections 2023-11-26T07:17:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:14.374+0000 7fcd9b4ff640 1 -- 172.21.15.77:0/4183423318 wait complete. 2023-11-26T07:17:14.392 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-26T07:17:14.392 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-26T07:17:14.723 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-11-26T07:17:14.720+0000 7f7e17a10500 -1 Falling back to public interface 2023-11-26T07:17:14.737 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-11-26T07:17:14.735+0000 7fe1de4a5500 -1 Falling back to public interface 2023-11-26T07:17:14.740 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-11-26T07:17:14.738+0000 7f012dc23500 -1 Falling back to public interface 2023-11-26T07:17:14.740 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-11-26T07:17:14.738+0000 7ff5729f9500 -1 Falling back to public interface 2023-11-26T07:17:14.744 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-11-26T07:17:14.742+0000 7fadb6994500 -1 Falling back to public interface 2023-11-26T07:17:14.752 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-11-26T07:17:14.749+0000 7f376ff92500 -1 Falling back to public interface 2023-11-26T07:17:14.764 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-11-26T07:17:14.762+0000 7ffbb760c500 -1 Falling back to public interface 2023-11-26T07:17:14.765 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-11-26T07:17:14.763+0000 7f2d472cd500 -1 Falling back to public interface 2023-11-26T07:17:15.074 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:15.071+0000 7f5a34d7f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-26T07:17:15.198 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:15.310 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:15.308+0000 7f39c260f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-26T07:17:15.359 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.357+0000 7ff96d459640 1 Processor -- start 2023-11-26T07:17:15.359 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.357+0000 7ff96d459640 1 -- start start 2023-11-26T07:17:15.362 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.359+0000 7ff96d459640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff96815d340 0x7ff9680d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:15.362 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.359+0000 7ff96d459640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff9680cdd40 0x7ff9680cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:15.362 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.359+0000 7ff96d459640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680b4ac0 con 0x7ff96815d720 2023-11-26T07:17:15.363 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.359+0000 7ff96d459640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9680cf260 con 0x7ff96815d340 2023-11-26T07:17:15.363 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.359+0000 7ff96d459640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9680ce1c0 con 0x7ff9680cdd40 2023-11-26T07:17:15.363 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.359+0000 7ff967fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff96815d340 0x7ff9680d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:15.363 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.359+0000 7ff967fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff96815d340 0x7ff9680d1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57028/0 (socket says 172.21.15.77:57028) 2023-11-26T07:17:15.363 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.359+0000 7ff967fff640 1 -- 172.21.15.77:0/2699947293 learned_addr learned my addr 172.21.15.77:0/2699947293 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:15.363 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.359+0000 7ff9677fe640 1 --2- 172.21.15.77:0/2699947293 >> v2:172.21.15.159:3300/0 conn(0x7ff9680cdd40 0x7ff9680cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:15.363 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.360+0000 7ff967fff640 1 -- 172.21.15.77:0/2699947293 >> v2:172.21.15.159:3300/0 conn(0x7ff9680cdd40 msgr2=0x7ff9680cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:15.363 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.360+0000 7ff967fff640 1 --2- 172.21.15.77:0/2699947293 >> v2:172.21.15.159:3300/0 conn(0x7ff9680cdd40 0x7ff9680cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.363 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.360+0000 7ff967fff640 1 -- 172.21.15.77:0/2699947293 >> v1:172.21.15.159:6789/0 conn(0x7ff96815d720 legacy=0x7ff968161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:15.363 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.360+0000 7ff967fff640 1 -- 172.21.15.77:0/2699947293 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680ce4a0 con 0x7ff96815d340 2023-11-26T07:17:15.364 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.361+0000 7ff967fff640 1 --2- 172.21.15.77:0/2699947293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96815d340 0x7ff9680d1a40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff9680d4260 tx=0x7ff95802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7c2cdc44dc8e6f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:15.364 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.361+0000 7ff966ffd640 1 -- 172.21.15.77:0/2699947293 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958030860 con 0x7ff96815d340 2023-11-26T07:17:15.365 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.361+0000 7ff966ffd640 1 -- 172.21.15.77:0/2699947293 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9580309c0 con 0x7ff96815d340 2023-11-26T07:17:15.365 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.361+0000 7ff966ffd640 1 -- 172.21.15.77:0/2699947293 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958030d50 con 0x7ff96815d340 2023-11-26T07:17:15.365 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.362+0000 7ff96d459640 1 -- 172.21.15.77:0/2699947293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96815d340 msgr2=0x7ff9680d1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:15.365 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.362+0000 7ff96d459640 1 --2- 172.21.15.77:0/2699947293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96815d340 0x7ff9680d1a40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff9680d4260 tx=0x7ff95802b9a0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.365 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.362+0000 7ff96d459640 1 -- 172.21.15.77:0/2699947293 shutdown_connections 2023-11-26T07:17:15.365 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.362+0000 7ff96d459640 1 --2- 172.21.15.77:0/2699947293 >> v2:172.21.15.159:3300/0 conn(0x7ff9680cdd40 0x7ff9680cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.365 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.362+0000 7ff96d459640 1 --2- 172.21.15.77:0/2699947293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96815d340 0x7ff9680d1a40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.365 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.362+0000 7ff96d459640 1 -- 172.21.15.77:0/2699947293 >> 172.21.15.77:0/2699947293 conn(0x7ff96809c500 msgr2=0x7ff9680d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:15.365 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.362+0000 7ff96d459640 1 -- 172.21.15.77:0/2699947293 shutdown_connections 2023-11-26T07:17:15.365 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.362+0000 7ff96d459640 1 -- 172.21.15.77:0/2699947293 wait complete. 2023-11-26T07:17:15.367 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.365+0000 7ff96d459640 1 Processor -- start 2023-11-26T07:17:15.367 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.365+0000 7ff96d459640 1 -- start start 2023-11-26T07:17:15.370 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.366+0000 7ff96d459640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9680cdd40 0x7ff968149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.366+0000 7ff96d459640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96815d340 0x7ff96814a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.366+0000 7ff96d459640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff96815d720 0x7ff96815f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.366+0000 7ff96d459640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680b64f0 con 0x7ff96815d340 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.366+0000 7ff96d459640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680cd100 con 0x7ff9680cdd40 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff96d459640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff968160740 con 0x7ff96815d720 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff9677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96815d340 0x7ff96814a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff9677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96815d340 0x7ff96814a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57038/0 (socket says 172.21.15.77:57038) 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff9677fe640 1 -- 172.21.15.77:0/1413899518 learned_addr learned my addr 172.21.15.77:0/1413899518 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff967fff640 1 --2- 172.21.15.77:0/1413899518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9680cdd40 0x7ff968149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff9677fe640 1 -- 172.21.15.77:0/1413899518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff96815d720 msgr2=0x7ff96815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff96cc58640 1 --2- 172.21.15.77:0/1413899518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff96815d720 0x7ff96815f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff9677fe640 1 --2- 172.21.15.77:0/1413899518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff96815d720 0x7ff96815f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.371 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff9677fe640 1 -- 172.21.15.77:0/1413899518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9680cdd40 msgr2=0x7ff968149ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:15.372 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff9677fe640 1 --2- 172.21.15.77:0/1413899518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9680cdd40 0x7ff968149ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.372 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff9677fe640 1 -- 172.21.15.77:0/1413899518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9580094d0 con 0x7ff96815d340 2023-11-26T07:17:15.372 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.367+0000 7ff967fff640 1 --2- 172.21.15.77:0/1413899518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9680cdd40 0x7ff968149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:15.372 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.368+0000 7ff9677fe640 1 --2- 172.21.15.77:0/1413899518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96815d340 0x7ff96814a220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00e9b0 tx=0x7ff95c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:15.372 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.368+0000 7ff964ff9640 1 -- 172.21.15.77:0/1413899518 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c009670 con 0x7ff96815d340 2023-11-26T07:17:15.372 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.368+0000 7ff964ff9640 1 -- 172.21.15.77:0/1413899518 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c00c9a0 con 0x7ff96815d340 2023-11-26T07:17:15.372 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.368+0000 7ff964ff9640 1 -- 172.21.15.77:0/1413899518 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00cd50 con 0x7ff96815d340 2023-11-26T07:17:15.372 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.368+0000 7ff96d459640 1 -- 172.21.15.77:0/1413899518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9680b6790 con 0x7ff96815d340 2023-11-26T07:17:15.372 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.368+0000 7ff96d459640 1 -- 172.21.15.77:0/1413899518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff968160a20 con 0x7ff96815d340 2023-11-26T07:17:15.372 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.368+0000 7ff964ff9640 1 -- 172.21.15.77:0/1413899518 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff95c005c90 con 0x7ff96815d340 2023-11-26T07:17:15.372 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.368+0000 7ff964ff9640 1 -- 172.21.15.77:0/1413899518 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff95c013470 con 0x7ff96815d340 2023-11-26T07:17:15.373 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.369+0000 7ff96d459640 1 -- 172.21.15.77:0/1413899518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff968068450 con 0x7ff96815d340 2023-11-26T07:17:15.374 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.372+0000 7ff964ff9640 1 -- 172.21.15.77:0/1413899518 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff95c021060 con 0x7ff96815d340 2023-11-26T07:17:15.408 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:15.406+0000 7f5a34d7f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-26T07:17:15.438 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.435+0000 7ff96d459640 1 -- 172.21.15.77:0/1413899518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9680b28b0 con 0x7ff96815d340 2023-11-26T07:17:15.438 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.436+0000 7ff964ff9640 1 -- 172.21.15.77:0/1413899518 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff9680b28b0 con 0x7ff96815d340 2023-11-26T07:17:15.439 INFO:teuthology.misc.health.smithi077.stdout: 2023-11-26T07:17:15.439 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":10,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:13.966900+0000","last_up_change":"0.000000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:15.440 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.437+0000 7ff96d459640 1 -- 172.21.15.77:0/1413899518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96815d340 msgr2=0x7ff96814a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:15.440 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.437+0000 7ff96d459640 1 --2- 172.21.15.77:0/1413899518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96815d340 0x7ff96814a220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00e9b0 tx=0x7ff95c00ee70 comp rx=0 tx=0).stop 2023-11-26T07:17:15.440 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.437+0000 7ff96d459640 1 -- 172.21.15.77:0/1413899518 shutdown_connections 2023-11-26T07:17:15.440 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.437+0000 7ff96d459640 1 --2- 172.21.15.77:0/1413899518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff96815d720 0x7ff96815f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.440 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.437+0000 7ff96d459640 1 --2- 172.21.15.77:0/1413899518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96815d340 0x7ff96814a220 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.440 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.437+0000 7ff96d459640 1 --2- 172.21.15.77:0/1413899518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9680cdd40 0x7ff968149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.440 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.437+0000 7ff96d459640 1 -- 172.21.15.77:0/1413899518 >> 172.21.15.77:0/1413899518 conn(0x7ff96809c500 msgr2=0x7ff9680b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:15.440 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.437+0000 7ff96d459640 1 -- 172.21.15.77:0/1413899518 shutdown_connections 2023-11-26T07:17:15.440 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:15.438+0000 7ff96d459640 1 -- 172.21.15.77:0/1413899518 wait complete. 2023-11-26T07:17:15.453 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-26T07:17:15.471 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:15.468+0000 7f5a34d7f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-26T07:17:15.586 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:15.583+0000 7f5a34d7f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-26T07:17:15.654 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:15.651+0000 7f39c260f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-26T07:17:15.719 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:15.716+0000 7f39c260f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-26T07:17:15.836 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-11-26T07:17:15.833+0000 7f39c260f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-26T07:17:16.632 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:16.629+0000 7f59d4ebc640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-26T07:17:16.632 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:17:16.630+0000 7f59d4ebc640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-26T07:17:18.265 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-11-26T07:17:18.263+0000 7f7e17a10500 -1 osd.5 0 log_to_monitors true 2023-11-26T07:17:18.320 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-11-26T07:17:18.319+0000 7ffbb760c500 -1 osd.4 0 log_to_monitors true 2023-11-26T07:17:18.335 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-11-26T07:17:18.333+0000 7f012dc23500 -1 osd.2 0 log_to_monitors true 2023-11-26T07:17:18.337 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-11-26T07:17:18.334+0000 7fe1de4a5500 -1 osd.0 0 log_to_monitors true 2023-11-26T07:17:18.339 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-11-26T07:17:18.337+0000 7ff5729f9500 -1 osd.3 0 log_to_monitors true 2023-11-26T07:17:18.355 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-11-26T07:17:18.352+0000 7fadb6994500 -1 osd.1 0 log_to_monitors true 2023-11-26T07:17:18.556 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-11-26T07:17:18.554+0000 7f376ff92500 -1 osd.6 0 log_to_monitors true 2023-11-26T07:17:18.593 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-11-26T07:17:18.591+0000 7f2d472cd500 -1 osd.7 0 log_to_monitors true 2023-11-26T07:17:21.880 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-11-26T07:17:21.876+0000 7f2d42a38640 -1 osd.7 0 waiting for initial osdmap 2023-11-26T07:17:21.886 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-11-26T07:17:21.884+0000 7f2d3b071640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:21.972 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-11-26T07:17:21.970+0000 7f7e1317b640 -1 osd.5 0 waiting for initial osdmap 2023-11-26T07:17:21.981 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-11-26T07:17:21.980+0000 7f7e0b7b4640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:21.992 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-11-26T07:17:21.990+0000 7fadb3939640 -1 osd.1 0 waiting for initial osdmap 2023-11-26T07:17:21.994 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-11-26T07:17:21.993+0000 7f376cf35640 -1 osd.6 0 waiting for initial osdmap 2023-11-26T07:17:21.998 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-11-26T07:17:21.996+0000 7fe1d9c10640 -1 osd.0 0 waiting for initial osdmap 2023-11-26T07:17:22.000 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-11-26T07:17:21.999+0000 7f3763d36640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:22.002 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-11-26T07:17:21.999+0000 7fadaa73a640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:22.008 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-11-26T07:17:22.006+0000 7fe1d2249640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:22.019 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-11-26T07:17:22.017+0000 7f0128df0640 -1 osd.2 0 waiting for initial osdmap 2023-11-26T07:17:22.021 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-11-26T07:17:22.020+0000 7ffbb3f2a640 -1 osd.4 0 waiting for initial osdmap 2023-11-26T07:17:22.022 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-11-26T07:17:22.020+0000 7ff56e164640 -1 osd.3 0 waiting for initial osdmap 2023-11-26T07:17:22.029 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-11-26T07:17:22.027+0000 7f0121429640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:22.030 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-11-26T07:17:22.028+0000 7ff56679d640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:22.030 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-11-26T07:17:22.028+0000 7ffbaad2b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:22.260 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:22.442 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.439+0000 7f3c18600640 1 Processor -- start 2023-11-26T07:17:22.442 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.439+0000 7f3c18600640 1 -- start start 2023-11-26T07:17:22.443 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.441+0000 7f3c18600640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1015d5b0 0x7f3c100d19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:22.443 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.441+0000 7f3c18600640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3c100ce5e0 0x7f3c100d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:22.443 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.441+0000 7f3c18600640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c100d0f90 con 0x7f3c100d1f20 2023-11-26T07:17:22.443 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.441+0000 7f3c18600640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c100d15c0 con 0x7f3c100ce5e0 2023-11-26T07:17:22.443 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.441+0000 7f3c18600640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c100b4020 con 0x7f3c1015d5b0 2023-11-26T07:17:22.444 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.441+0000 7f3c16b9d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3c100ce5e0 0x7f3c100d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:22.444 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.441+0000 7f3c1639c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1015d5b0 0x7f3c100d19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:22.444 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.441+0000 7f3c1639c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1015d5b0 0x7f3c100d19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:38810/0 (socket says 172.21.15.77:38810) 2023-11-26T07:17:22.444 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.441+0000 7f3c16b9d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3c100ce5e0 0x7f3c100d3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:34914/0 (socket says 172.21.15.77:34914) 2023-11-26T07:17:22.444 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.442+0000 7f3c1639c640 1 -- 172.21.15.77:0/404230483 learned_addr learned my addr 172.21.15.77:0/404230483 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:22.445 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.442+0000 7f3c1539a640 1 -- 172.21.15.77:0/404230483 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037621404 0 0) 0x7f3c100d0f90 con 0x7f3c100d1f20 2023-11-26T07:17:22.445 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.442+0000 7f3c16b9d640 1 -- 172.21.15.77:0/404230483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1015d5b0 msgr2=0x7f3c100d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:22.445 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.442+0000 7f3c16b9d640 1 --2- 172.21.15.77:0/404230483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1015d5b0 0x7f3c100d19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.445 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.442+0000 7f3c16b9d640 1 -- 172.21.15.77:0/404230483 >> v1:172.21.15.159:6789/0 conn(0x7f3c100d1f20 legacy=0x7f3c100cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.445 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.442+0000 7f3c16b9d640 1 -- 172.21.15.77:0/404230483 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c100b4300 con 0x7f3c100ce5e0 2023-11-26T07:17:22.446 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.442+0000 7f3c1639c640 1 --2- 172.21.15.77:0/404230483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1015d5b0 0x7f3c100d19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:22.446 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.444+0000 7f3c16b9d640 1 --2- 172.21.15.77:0/404230483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c100ce5e0 0x7f3c100d3030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3c080097a0 tx=0x7f3c0802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=696b0c19c024403f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:22.446 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.444+0000 7f3c1539a640 1 -- 172.21.15.77:0/404230483 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08031780 con 0x7f3c100ce5e0 2023-11-26T07:17:22.447 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.444+0000 7f3c1539a640 1 -- 172.21.15.77:0/404230483 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c080318e0 con 0x7f3c100ce5e0 2023-11-26T07:17:22.447 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.444+0000 7f3c1539a640 1 -- 172.21.15.77:0/404230483 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08031c70 con 0x7f3c100ce5e0 2023-11-26T07:17:22.447 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.445+0000 7f3c18600640 1 -- 172.21.15.77:0/404230483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c100ce5e0 msgr2=0x7f3c100d3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.447 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.445+0000 7f3c18600640 1 --2- 172.21.15.77:0/404230483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c100ce5e0 0x7f3c100d3030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3c080097a0 tx=0x7f3c0802b820 comp rx=0 tx=0).stop 2023-11-26T07:17:22.448 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.445+0000 7f3c18600640 1 -- 172.21.15.77:0/404230483 shutdown_connections 2023-11-26T07:17:22.448 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.445+0000 7f3c18600640 1 --2- 172.21.15.77:0/404230483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c100ce5e0 0x7f3c100d3030 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.448 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.445+0000 7f3c18600640 1 --2- 172.21.15.77:0/404230483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1015d5b0 0x7f3c100d19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.448 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.445+0000 7f3c18600640 1 -- 172.21.15.77:0/404230483 >> 172.21.15.77:0/404230483 conn(0x7f3c1008cd70 msgr2=0x7f3c1009c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:22.448 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.445+0000 7f3c18600640 1 -- 172.21.15.77:0/404230483 shutdown_connections 2023-11-26T07:17:22.448 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.445+0000 7f3c18600640 1 -- 172.21.15.77:0/404230483 wait complete. 2023-11-26T07:17:22.449 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.446+0000 7f3c18600640 1 Processor -- start 2023-11-26T07:17:22.449 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.446+0000 7f3c18600640 1 -- start start 2023-11-26T07:17:22.451 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.447+0000 7f3c18600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c100ce5e0 0x7f3c10154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:22.451 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.447+0000 7f3c18600640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c100d1f20 0x7f3c10151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:22.451 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.447+0000 7f3c18600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1015d5b0 0x7f3c100cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:22.451 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.447+0000 7f3c18600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10153430 con 0x7f3c100ce5e0 2023-11-26T07:17:22.452 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.447+0000 7f3c18600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c100cd210 con 0x7f3c1015d5b0 2023-11-26T07:17:22.452 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.447+0000 7f3c18600640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10153640 con 0x7f3c100d1f20 2023-11-26T07:17:22.452 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c1639c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c100ce5e0 0x7f3c10154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:22.452 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c1639c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c100ce5e0 0x7f3c10154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49864/0 (socket says 172.21.15.77:49864) 2023-11-26T07:17:22.452 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c1639c640 1 -- 172.21.15.77:0/1701270224 learned_addr learned my addr 172.21.15.77:0/1701270224 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:22.452 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c16b9d640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1015d5b0 0x7f3c100cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:22.452 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c15b9b640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c100d1f20 0x7f3c10151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:22.452 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c1639c640 1 -- 172.21.15.77:0/1701270224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c100d1f20 msgr2=0x7f3c10151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.452 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c1639c640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c100d1f20 0x7f3c10151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.452 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c1639c640 1 -- 172.21.15.77:0/1701270224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1015d5b0 msgr2=0x7f3c100cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.452 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c1639c640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1015d5b0 0x7f3c100cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.453 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c1639c640 1 -- 172.21.15.77:0/1701270224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00009b30 con 0x7f3c100ce5e0 2023-11-26T07:17:22.453 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c16b9d640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1015d5b0 0x7f3c100cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:22.453 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.448+0000 7f3c1639c640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c100ce5e0 0x7f3c10154120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000efc0 tx=0x7f3c0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:22.453 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.449+0000 7f3c0effd640 1 -- 172.21.15.77:0/1701270224 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0000ce60 con 0x7f3c100ce5e0 2023-11-26T07:17:22.453 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.449+0000 7f3c0effd640 1 -- 172.21.15.77:0/1701270224 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0000f040 con 0x7f3c100ce5e0 2023-11-26T07:17:22.453 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.449+0000 7f3c0effd640 1 -- 172.21.15.77:0/1701270224 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00014680 con 0x7f3c100ce5e0 2023-11-26T07:17:22.453 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.449+0000 7f3c18600640 1 -- 172.21.15.77:0/1701270224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c08009400 con 0x7f3c100ce5e0 2023-11-26T07:17:22.453 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.449+0000 7f3c18600640 1 -- 172.21.15.77:0/1701270224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1015db10 con 0x7f3c100ce5e0 2023-11-26T07:17:22.453 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.450+0000 7f3c18600640 1 -- 172.21.15.77:0/1701270224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c100748f0 con 0x7f3c100ce5e0 2023-11-26T07:17:22.454 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.451+0000 7f3c0effd640 1 -- 172.21.15.77:0/1701270224 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f3c000147e0 con 0x7f3c100ce5e0 2023-11-26T07:17:22.454 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.452+0000 7f3c0effd640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3bfc06ade0 0x7f3bfc06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:22.454 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.452+0000 7f3c0effd640 1 -- 172.21.15.77:0/1701270224 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f3c00088f40 con 0x7f3c100ce5e0 2023-11-26T07:17:22.454 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.452+0000 7f3c15b9b640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3bfc06ade0 0x7f3bfc06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:22.455 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.452+0000 7f3c15b9b640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3bfc06ade0 0x7f3bfc06d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c100a12d0 tx=0x7f3c04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:22.459 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.457+0000 7f3c0effd640 1 -- 172.21.15.77:0/1701270224 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c00054ef0 con 0x7f3c100ce5e0 2023-11-26T07:17:22.635 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.633+0000 7f3c18600640 1 -- 172.21.15.77:0/1701270224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c100b2e20 con 0x7f3c100ce5e0 2023-11-26T07:17:22.637 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.634+0000 7f3c0effd640 1 -- 172.21.15.77:0/1701270224 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3c00058510 con 0x7f3c100ce5e0 2023-11-26T07:17:22.637 INFO:teuthology.misc.health.smithi077.stdout: 2023-11-26T07:17:22.637 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":12,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:19.635313+0000","last_up_change":"0.000000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:22.639 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.636+0000 7f3c18600640 1 -- 172.21.15.77:0/1701270224 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3bfc06ade0 msgr2=0x7f3bfc06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.639 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.636+0000 7f3c18600640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3bfc06ade0 0x7f3bfc06d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c100a12d0 tx=0x7f3c04009040 comp rx=0 tx=0).stop 2023-11-26T07:17:22.639 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.637+0000 7f3c18600640 1 -- 172.21.15.77:0/1701270224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c100ce5e0 msgr2=0x7f3c10154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.640 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.637+0000 7f3c18600640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c100ce5e0 0x7f3c10154120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000efc0 tx=0x7f3c0000c490 comp rx=0 tx=0).stop 2023-11-26T07:17:22.640 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.637+0000 7f3c18600640 1 -- 172.21.15.77:0/1701270224 shutdown_connections 2023-11-26T07:17:22.640 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.637+0000 7f3c18600640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3bfc06ade0 0x7f3bfc06d2a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.640 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.637+0000 7f3c18600640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1015d5b0 0x7f3c100cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.640 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.637+0000 7f3c18600640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c100d1f20 0x7f3c10151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.640 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.637+0000 7f3c18600640 1 --2- 172.21.15.77:0/1701270224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c100ce5e0 0x7f3c10154120 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.640 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.637+0000 7f3c18600640 1 -- 172.21.15.77:0/1701270224 >> 172.21.15.77:0/1701270224 conn(0x7f3c1008cd70 msgr2=0x7f3c100d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:22.640 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.637+0000 7f3c18600640 1 -- 172.21.15.77:0/1701270224 shutdown_connections 2023-11-26T07:17:22.640 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:22.637+0000 7f3c18600640 1 -- 172.21.15.77:0/1701270224 wait complete. 2023-11-26T07:17:22.653 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-26T07:17:24.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:17:24.593 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:17:29.460 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:29.646 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.644+0000 7f38c340e640 1 Processor -- start 2023-11-26T07:17:29.646 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.644+0000 7f38c340e640 1 -- start start 2023-11-26T07:17:29.648 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.645+0000 7f38c340e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f38bc0ce1d0 0x7f38bc0cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.648 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.646+0000 7f38c340e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38bc0ae9c0 con 0x7f38bc0b3400 2023-11-26T07:17:29.648 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.646+0000 7f38c340e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38bc0ccea0 con 0x7f38bc0705c0 2023-11-26T07:17:29.649 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.646+0000 7f38c340e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38bc0cd140 con 0x7f38bc0ce1d0 2023-11-26T07:17:29.649 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.646+0000 7f38c11aa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f38bc0ce1d0 0x7f38bc0cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.649 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.646+0000 7f38c11aa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f38bc0ce1d0 0x7f38bc0cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37466/0 (socket says 172.21.15.77:37466) 2023-11-26T07:17:29.649 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.646+0000 7f38c11aa640 1 -- 172.21.15.77:0/2033566155 learned_addr learned my addr 172.21.15.77:0/2033566155 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:29.649 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.646+0000 7f38c11aa640 1 -- 172.21.15.77:0/2033566155 >> v1:172.21.15.159:6789/0 conn(0x7f38bc0705c0 legacy=0x7f38bc070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:29.650 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.646+0000 7f38c11aa640 1 -- 172.21.15.77:0/2033566155 >> v1:172.21.15.77:6789/0 conn(0x7f38bc0b3400 legacy=0x7f38bc0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.650 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.646+0000 7f38c11aa640 1 -- 172.21.15.77:0/2033566155 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc0cd420 con 0x7f38bc0ce1d0 2023-11-26T07:17:29.650 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.646+0000 7f38b3fff640 1 -- 172.21.15.77:0/2033566155 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612791902 0 0) 0x7f38bc0ae9c0 con 0x7f38bc0b3400 2023-11-26T07:17:29.650 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.647+0000 7f38c11aa640 1 --2- 172.21.15.77:0/2033566155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38bc0ce1d0 0x7f38bc0cc960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009870 tx=0x7f38b802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d0f0731b731eda server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.651 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.648+0000 7f38b3fff640 1 -- 172.21.15.77:0/2033566155 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8030850 con 0x7f38bc0ce1d0 2023-11-26T07:17:29.651 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.648+0000 7f38b3fff640 1 -- 172.21.15.77:0/2033566155 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b80309b0 con 0x7f38bc0ce1d0 2023-11-26T07:17:29.651 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.648+0000 7f38b3fff640 1 -- 172.21.15.77:0/2033566155 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8030d40 con 0x7f38bc0ce1d0 2023-11-26T07:17:29.651 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.648+0000 7f38c340e640 1 -- 172.21.15.77:0/2033566155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38bc0ce1d0 msgr2=0x7f38bc0cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.651 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.648+0000 7f38c340e640 1 --2- 172.21.15.77:0/2033566155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38bc0ce1d0 0x7f38bc0cc960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009870 tx=0x7f38b802b990 comp rx=0 tx=0).stop 2023-11-26T07:17:29.651 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.648+0000 7f38c340e640 1 -- 172.21.15.77:0/2033566155 shutdown_connections 2023-11-26T07:17:29.651 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.648+0000 7f38c340e640 1 --2- 172.21.15.77:0/2033566155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38bc0ce1d0 0x7f38bc0cc960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.651 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.648+0000 7f38c340e640 1 -- 172.21.15.77:0/2033566155 >> 172.21.15.77:0/2033566155 conn(0x7f38bc06a490 msgr2=0x7f38bc06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:29.651 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.648+0000 7f38c340e640 1 -- 172.21.15.77:0/2033566155 shutdown_connections 2023-11-26T07:17:29.651 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.648+0000 7f38c340e640 1 -- 172.21.15.77:0/2033566155 wait complete. 2023-11-26T07:17:29.652 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.650+0000 7f38c340e640 1 Processor -- start 2023-11-26T07:17:29.653 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.650+0000 7f38c340e640 1 -- start start 2023-11-26T07:17:29.654 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.651+0000 7f38c340e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38bc0705c0 0x7f38bc153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.654 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.651+0000 7f38c340e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc0b3400 0x7f38bc1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.654 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.651+0000 7f38c340e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38bc0ce1d0 0x7f38bc0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.654 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.651+0000 7f38c340e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc154d10 con 0x7f38bc0705c0 2023-11-26T07:17:29.654 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.651+0000 7f38c340e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc154100 con 0x7f38bc0b3400 2023-11-26T07:17:29.654 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.651+0000 7f38c340e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc1543e0 con 0x7f38bc0ce1d0 2023-11-26T07:17:29.654 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.651+0000 7f38c11aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38bc0705c0 0x7f38bc153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.654 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.651+0000 7f38c11aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38bc0705c0 0x7f38bc153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37480/0 (socket says 172.21.15.77:37480) 2023-11-26T07:17:29.654 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.651+0000 7f38c11aa640 1 -- 172.21.15.77:0/2523755797 learned_addr learned my addr 172.21.15.77:0/2523755797 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:29.655 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.652+0000 7f38c11aa640 1 -- 172.21.15.77:0/2523755797 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38bc0ce1d0 msgr2=0x7f38bc0b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.655 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.652+0000 7f38c11aa640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38bc0ce1d0 0x7f38bc0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.655 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.652+0000 7f38c11aa640 1 -- 172.21.15.77:0/2523755797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc0b3400 msgr2=0x7f38bc1478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.656 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.652+0000 7f38c11aa640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc0b3400 0x7f38bc1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.656 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.652+0000 7f38c11aa640 1 -- 172.21.15.77:0/2523755797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b80094d0 con 0x7f38bc0705c0 2023-11-26T07:17:29.656 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.652+0000 7f38c11aa640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38bc0705c0 0x7f38bc153a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009870 tx=0x7f38b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.656 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.652+0000 7f38b1ffb640 1 -- 172.21.15.77:0/2523755797 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8039b60 con 0x7f38bc0705c0 2023-11-26T07:17:29.656 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.652+0000 7f38b1ffb640 1 -- 172.21.15.77:0/2523755797 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b8039cc0 con 0x7f38bc0705c0 2023-11-26T07:17:29.656 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.652+0000 7f38b1ffb640 1 -- 172.21.15.77:0/2523755797 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8043630 con 0x7f38bc0705c0 2023-11-26T07:17:29.656 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.652+0000 7f38c340e640 1 -- 172.21.15.77:0/2523755797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc1546c0 con 0x7f38bc0705c0 2023-11-26T07:17:29.656 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.653+0000 7f38c340e640 1 -- 172.21.15.77:0/2523755797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc1551a0 con 0x7f38bc0705c0 2023-11-26T07:17:29.656 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.654+0000 7f38c340e640 1 -- 172.21.15.77:0/2523755797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc0748f0 con 0x7f38bc0705c0 2023-11-26T07:17:29.657 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.655+0000 7f38b1ffb640 1 -- 172.21.15.77:0/2523755797 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38b802e070 con 0x7f38bc0705c0 2023-11-26T07:17:29.658 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.656+0000 7f38b1ffb640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f38a006ae40 0x7f38a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.658 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.656+0000 7f38b1ffb640 1 -- 172.21.15.77:0/2523755797 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f38b80ab310 con 0x7f38bc0705c0 2023-11-26T07:17:29.658 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.656+0000 7f38c09a9640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f38a006ae40 0x7f38a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.659 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.656+0000 7f38c09a9640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f38a006ae40 0x7f38a006d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0cc320 tx=0x7f38ac007910 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.663 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.661+0000 7f38b1ffb640 1 -- 172.21.15.77:0/2523755797 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f38b8076710 con 0x7f38bc0705c0 2023-11-26T07:17:29.847 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.845+0000 7f38c340e640 1 -- 172.21.15.77:0/2523755797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38bc0cb730 con 0x7f38bc0705c0 2023-11-26T07:17:29.849 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.846+0000 7f38b1ffb640 1 -- 172.21.15.77:0/2523755797 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f38b8079d30 con 0x7f38bc0705c0 2023-11-26T07:17:29.849 INFO:teuthology.misc.health.smithi077.stdout: 2023-11-26T07:17:29.849 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":16,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:25.934049+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:29.852 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 -- 172.21.15.77:0/2523755797 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f38a006ae40 msgr2=0x7f38a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.852 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f38a006ae40 0x7f38a006d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0cc320 tx=0x7f38ac007910 comp rx=0 tx=0).stop 2023-11-26T07:17:29.852 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 -- 172.21.15.77:0/2523755797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38bc0705c0 msgr2=0x7f38bc153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.852 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38bc0705c0 0x7f38bc153a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009870 tx=0x7f38b8004730 comp rx=0 tx=0).stop 2023-11-26T07:17:29.852 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 -- 172.21.15.77:0/2523755797 shutdown_connections 2023-11-26T07:17:29.852 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f38a006ae40 0x7f38a006d300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.852 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38bc0ce1d0 0x7f38bc0b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.852 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc0b3400 0x7f38bc1478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.852 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 --2- 172.21.15.77:0/2523755797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38bc0705c0 0x7f38bc153a40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.852 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 -- 172.21.15.77:0/2523755797 >> 172.21.15.77:0/2523755797 conn(0x7f38bc06a490 msgr2=0x7f38bc071880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:29.852 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 -- 172.21.15.77:0/2523755797 shutdown_connections 2023-11-26T07:17:29.853 INFO:teuthology.misc.health.smithi077.stderr:2023-11-26T07:17:29.849+0000 7f38c340e640 1 -- 172.21.15.77:0/2523755797 wait complete. 2023-11-26T07:17:29.865 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-26T07:17:29.865 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-26T07:17:29.866 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:17:29.866 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:17:29.875 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:17:29.875 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:17:29.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:17:29.883 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:17:29.883 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:17:29.884 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:17:29.892 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:17:29.892 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:17:29.893 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:17:29.902 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:17:29.902 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-26T07:17:29.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:30.025 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-26T07:17:30.032 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-26T07:17:30.061 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-11-26T07:17:30.062 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-11-26T07:17:30.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.074+0000 7f13e03dc640 1 Processor -- start 2023-11-26T07:17:30.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.075+0000 7f13e03dc640 1 -- start start 2023-11-26T07:17:30.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.076+0000 7f13e03dc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13d80b28d0 0x7f13d80cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.076+0000 7f13e03dc640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f13d80cf420 0x7f13d80cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.076+0000 7f13e03dc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d80b2690 con 0x7f13d806aa30 2023-11-26T07:17:30.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.076+0000 7f13e03dc640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d80cc7f0 con 0x7f13d80cf420 2023-11-26T07:17:30.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.076+0000 7f13e03dc640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80cfdf0 con 0x7f13d80b28d0 2023-11-26T07:17:30.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.076+0000 7f13de178640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f13d806aa30 0x7f13d80cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46212/0 (socket says 172.21.15.77:46212) 2023-11-26T07:17:30.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.076+0000 7f13de178640 1 -- 172.21.15.77:0/723345160 learned_addr learned my addr 172.21.15.77:0/723345160 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:30.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.076+0000 7f13dd977640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13d80b28d0 0x7f13d80cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.076+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900837891 0 0) 0x7f13d80b2690 con 0x7f13d806aa30 2023-11-26T07:17:30.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.076+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c4003520 con 0x7f13d806aa30 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13de979640 1 --2- 172.21.15.77:0/723345160 >> v2:172.21.15.159:3300/0 conn(0x7f13d80cf420 0x7f13d80cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 837149938 0 0) 0x7f13c4003520 con 0x7f13d806aa30 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13d80b28d0 msgr2=0x7f13d80cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13d80b28d0 0x7f13d80cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 >> v2:172.21.15.159:3300/0 conn(0x7f13d80cf420 msgr2=0x7f13d80cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 --2- 172.21.15.77:0/723345160 >> v2:172.21.15.159:3300/0 conn(0x7f13d80cf420 0x7f13d80cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d806ed00 con 0x7f13d806aa30 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f13d4001670 con 0x7f13d806aa30 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 >> v1:172.21.15.77:6789/0 conn(0x7f13d806aa30 legacy=0x7f13d80cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c4003970 0x7f13c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c40047c0 0x7f13c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13d80b28d0 0x7f13c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80cc7f0 con 0x7f13c40047c0 2023-11-26T07:17:30.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80cfdf0 con 0x7f13c4003970 2023-11-26T07:17:30.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c400ba60 con 0x7f13d80b28d0 2023-11-26T07:17:30.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd977640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c40047c0 0x7f13c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13de178640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c4003970 0x7f13c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13de979640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13d80b28d0 0x7f13c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd977640 1 -- 172.21.15.77:0/723345160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13d80b28d0 msgr2=0x7f13c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:30.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd977640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13d80b28d0 0x7f13c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd977640 1 -- 172.21.15.77:0/723345160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c4003970 msgr2=0x7f13c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:30.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd977640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c4003970 0x7f13c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.077+0000 7f13dd977640 1 -- 172.21.15.77:0/723345160 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4003520 con 0x7f13c40047c0 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.078+0000 7f13dd977640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c40047c0 0x7f13c4004c40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009ac0 tx=0x7f13c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbead724fdfceda4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.079+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c802c6b0 con 0x7f13c40047c0 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.079+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c802c810 con 0x7f13c40047c0 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.079+0000 7f13dd176640 1 -- 172.21.15.77:0/723345160 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c802cba0 con 0x7f13c40047c0 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.079+0000 7f13e03dc640 1 -- 172.21.15.77:0/723345160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c40047c0 msgr2=0x7f13c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.079+0000 7f13e03dc640 1 --2- 172.21.15.77:0/723345160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c40047c0 0x7f13c4004c40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009ac0 tx=0x7f13c40057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.079+0000 7f13de979640 1 -- 172.21.15.77:0/723345160 reap_dead start 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.079+0000 7f13e03dc640 1 -- 172.21.15.77:0/723345160 shutdown_connections 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.079+0000 7f13e03dc640 1 -- 172.21.15.77:0/723345160 >> 172.21.15.77:0/723345160 conn(0x7f13d80999d0 msgr2=0x7f13d80b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.079+0000 7f13e03dc640 1 -- 172.21.15.77:0/723345160 shutdown_connections 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.079+0000 7f13e03dc640 1 -- 172.21.15.77:0/723345160 wait complete. 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.081+0000 7f13e03dc640 1 Processor -- start 2023-11-26T07:17:30.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.081+0000 7f13e03dc640 1 -- start start 2023-11-26T07:17:30.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.082+0000 7f13e03dc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c40047c0 0x7f13d8144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.082+0000 7f13e03dc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d80ad9e0 0x7f13d8148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.082+0000 7f13e03dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d80ade60 0x7f13d80c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.082+0000 7f13e03dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d8145c60 con 0x7f13d80ade60 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.082+0000 7f13e03dc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80ae2e0 con 0x7f13d80ad9e0 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.082+0000 7f13e03dc640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80ae5c0 con 0x7f13c40047c0 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.082+0000 7f13de979640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d80ade60 0x7f13d80c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.082+0000 7f13de178640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c40047c0 0x7f13d8144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.082+0000 7f13de979640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d80ade60 0x7f13d80c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37544/0 (socket says 172.21.15.77:37544) 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.082+0000 7f13de979640 1 -- 172.21.15.77:0/362510743 learned_addr learned my addr 172.21.15.77:0/362510743 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.082+0000 7f13dd977640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d80ad9e0 0x7f13d8148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.083+0000 7f13de979640 1 -- 172.21.15.77:0/362510743 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c40047c0 msgr2=0x7f13d8144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.083+0000 7f13de979640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c40047c0 0x7f13d8144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.083+0000 7f13de979640 1 -- 172.21.15.77:0/362510743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d80ad9e0 msgr2=0x7f13d8148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.083+0000 7f13de979640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d80ad9e0 0x7f13d8148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.083+0000 7f13de979640 1 -- 172.21.15.77:0/362510743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d80ae8a0 con 0x7f13d80ade60 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.083+0000 7f13de979640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d80ade60 0x7f13d80c71f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13d806ff30 tx=0x7f13d0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.083+0000 7f13ceffd640 1 -- 172.21.15.77:0/362510743 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d00046a0 con 0x7f13d80ade60 2023-11-26T07:17:30.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.083+0000 7f13ceffd640 1 -- 172.21.15.77:0/362510743 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d0004800 con 0x7f13d80ade60 2023-11-26T07:17:30.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.083+0000 7f13e03dc640 1 -- 172.21.15.77:0/362510743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d8145880 con 0x7f13d80ade60 2023-11-26T07:17:30.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.083+0000 7f13ceffd640 1 -- 172.21.15.77:0/362510743 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0015660 con 0x7f13d80ade60 2023-11-26T07:17:30.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.083+0000 7f13e03dc640 1 -- 172.21.15.77:0/362510743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d81485d0 con 0x7f13d80ade60 2023-11-26T07:17:30.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.084+0000 7f13e03dc640 1 -- 172.21.15.77:0/362510743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d8145da0 con 0x7f13d80ade60 2023-11-26T07:17:30.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.086+0000 7f13ceffd640 1 -- 172.21.15.77:0/362510743 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13d00157c0 con 0x7f13d80ade60 2023-11-26T07:17:30.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.087+0000 7f13ceffd640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13bc06ae40 0x7f13bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.087+0000 7f13ceffd640 1 -- 172.21.15.77:0/362510743 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f13d0089b70 con 0x7f13d80ade60 2023-11-26T07:17:30.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.087+0000 7f13de178640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13bc06ae40 0x7f13bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.087+0000 7f13de178640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13bc06ae40 0x7f13bc06d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f13d4001bf0 tx=0x7f13d4001dd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.091+0000 7f13ceffd640 1 -- 172.21.15.77:0/362510743 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13d8145da0 con 0x7f13d80ade60 2023-11-26T07:17:30.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.271+0000 7f13e03dc640 1 -- 172.21.15.77:0/362510743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13d8145da0 con 0x7f13d80ade60 2023-11-26T07:17:30.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.273+0000 7f13ceffd640 1 -- 172.21.15.77:0/362510743 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f13d8145da0 con 0x7f13d80ade60 2023-11-26T07:17:30.276 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:30.276 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:25.934049+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:30.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.276+0000 7f13e03dc640 1 -- 172.21.15.77:0/362510743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13bc06ae40 msgr2=0x7f13bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.276+0000 7f13e03dc640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13bc06ae40 0x7f13bc06d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f13d4001bf0 tx=0x7f13d4001dd0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.276+0000 7f13e03dc640 1 -- 172.21.15.77:0/362510743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d80ade60 msgr2=0x7f13d80c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.276+0000 7f13e03dc640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d80ade60 0x7f13d80c71f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13d806ff30 tx=0x7f13d0007700 comp rx=0 tx=0).stop 2023-11-26T07:17:30.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.276+0000 7f13e03dc640 1 -- 172.21.15.77:0/362510743 shutdown_connections 2023-11-26T07:17:30.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.276+0000 7f13e03dc640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13bc06ae40 0x7f13bc06d300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.276+0000 7f13e03dc640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d80ade60 0x7f13d80c71f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.276+0000 7f13e03dc640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d80ad9e0 0x7f13d8148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.276+0000 7f13e03dc640 1 --2- 172.21.15.77:0/362510743 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c40047c0 0x7f13d8144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.276+0000 7f13e03dc640 1 -- 172.21.15.77:0/362510743 >> 172.21.15.77:0/362510743 conn(0x7f13d80999d0 msgr2=0x7f13d80afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:30.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.277+0000 7f13e03dc640 1 -- 172.21.15.77:0/362510743 shutdown_connections 2023-11-26T07:17:30.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.277+0000 7f13e03dc640 1 -- 172.21.15.77:0/362510743 wait complete. 2023-11-26T07:17:30.295 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:17:30.295 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:17:30.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.487+0000 7f160b34e640 1 Processor -- start 2023-11-26T07:17:30.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.487+0000 7f160b34e640 1 -- start start 2023-11-26T07:17:30.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.489+0000 7f160b34e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f160415d3f0 0x7f16040d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.489+0000 7f160b34e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f160415d7d0 0x7f16040d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.489+0000 7f160b34e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16040d15e0 con 0x7f16040d0e40 2023-11-26T07:17:30.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.489+0000 7f160b34e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040d0280 con 0x7f160415d7d0 2023-11-26T07:17:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.489+0000 7f160b34e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040d1300 con 0x7f160415d3f0 2023-11-26T07:17:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.489+0000 7f1609b4b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f160415d7d0 0x7f16040d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.489+0000 7f1609b4b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f160415d7d0 0x7f16040d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37548/0 (socket says 172.21.15.77:37548) 2023-11-26T07:17:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.489+0000 7f160ab4d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f16040d0e40 0x7f16040afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46228/0 (socket says 172.21.15.77:46228) 2023-11-26T07:17:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.489+0000 7f1609b4b640 1 -- 172.21.15.77:0/2840154749 learned_addr learned my addr 172.21.15.77:0/2840154749 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.490+0000 7f160a34c640 1 --2- 172.21.15.77:0/2840154749 >> v2:172.21.15.159:3300/0 conn(0x7f160415d3f0 0x7f16040d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.490+0000 7f1609b4b640 1 -- 172.21.15.77:0/2840154749 >> v2:172.21.15.159:3300/0 conn(0x7f160415d3f0 msgr2=0x7f16040d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.490+0000 7f1609b4b640 1 --2- 172.21.15.77:0/2840154749 >> v2:172.21.15.159:3300/0 conn(0x7f160415d3f0 0x7f16040d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.490+0000 7f1609b4b640 1 -- 172.21.15.77:0/2840154749 >> v1:172.21.15.77:6789/0 conn(0x7f16040d0e40 legacy=0x7f16040afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.490+0000 7f1609b4b640 1 -- 172.21.15.77:0/2840154749 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16040cfc30 con 0x7f160415d7d0 2023-11-26T07:17:30.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.491+0000 7f1609b4b640 1 --2- 172.21.15.77:0/2840154749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f160415d7d0 0x7f16040d1d70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1604067c60 tx=0x7f15f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585d054ba49acd35 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.491+0000 7f160934a640 1 -- 172.21.15.77:0/2840154749 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0030860 con 0x7f160415d7d0 2023-11-26T07:17:30.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.491+0000 7f160934a640 1 -- 172.21.15.77:0/2840154749 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f00309c0 con 0x7f160415d7d0 2023-11-26T07:17:30.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.492+0000 7f160934a640 1 -- 172.21.15.77:0/2840154749 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0030d50 con 0x7f160415d7d0 2023-11-26T07:17:30.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.492+0000 7f160b34e640 1 -- 172.21.15.77:0/2840154749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f160415d7d0 msgr2=0x7f16040d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.492+0000 7f160b34e640 1 --2- 172.21.15.77:0/2840154749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f160415d7d0 0x7f16040d1d70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1604067c60 tx=0x7f15f002b9a0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.492+0000 7f160b34e640 1 -- 172.21.15.77:0/2840154749 shutdown_connections 2023-11-26T07:17:30.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.492+0000 7f160b34e640 1 --2- 172.21.15.77:0/2840154749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f160415d7d0 0x7f16040d1d70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.492+0000 7f160b34e640 1 --2- 172.21.15.77:0/2840154749 >> v2:172.21.15.159:3300/0 conn(0x7f160415d3f0 0x7f16040d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.492+0000 7f160b34e640 1 -- 172.21.15.77:0/2840154749 >> 172.21.15.77:0/2840154749 conn(0x7f160409c5b0 msgr2=0x7f16040d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:30.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.492+0000 7f160b34e640 1 -- 172.21.15.77:0/2840154749 shutdown_connections 2023-11-26T07:17:30.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.492+0000 7f160b34e640 1 -- 172.21.15.77:0/2840154749 wait complete. 2023-11-26T07:17:30.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.494+0000 7f160b34e640 1 Processor -- start 2023-11-26T07:17:30.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.494+0000 7f160b34e640 1 -- start start 2023-11-26T07:17:30.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.495+0000 7f160b34e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16040d0e40 0x7f16040cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.495+0000 7f160b34e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160415d3f0 0x7f1604149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.495+0000 7f160b34e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f160415d7d0 0x7f1604149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.495+0000 7f160b34e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160415f360 con 0x7f16040d0e40 2023-11-26T07:17:30.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.495+0000 7f160b34e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16041f2e30 con 0x7f160415d3f0 2023-11-26T07:17:30.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.495+0000 7f160b34e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1604156e20 con 0x7f160415d7d0 2023-11-26T07:17:30.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.495+0000 7f160a34c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16040d0e40 0x7f16040cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.495+0000 7f160a34c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16040d0e40 0x7f16040cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37562/0 (socket says 172.21.15.77:37562) 2023-11-26T07:17:30.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.495+0000 7f160a34c640 1 -- 172.21.15.77:0/2532908520 learned_addr learned my addr 172.21.15.77:0/2532908520 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:30.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.496+0000 7f160a34c640 1 -- 172.21.15.77:0/2532908520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f160415d7d0 msgr2=0x7f1604149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.496+0000 7f160a34c640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f160415d7d0 0x7f1604149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.496+0000 7f160a34c640 1 -- 172.21.15.77:0/2532908520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160415d3f0 msgr2=0x7f1604149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.496+0000 7f160a34c640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160415d3f0 0x7f1604149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.496+0000 7f160a34c640 1 -- 172.21.15.77:0/2532908520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00094d0 con 0x7f16040d0e40 2023-11-26T07:17:30.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.496+0000 7f160a34c640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16040d0e40 0x7f16040cca50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15f8007ef0 tx=0x7f15f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.496+0000 7f1602ffd640 1 -- 172.21.15.77:0/2532908520 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8014620 con 0x7f16040d0e40 2023-11-26T07:17:30.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.496+0000 7f1602ffd640 1 -- 172.21.15.77:0/2532908520 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8014780 con 0x7f16040d0e40 2023-11-26T07:17:30.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.496+0000 7f1602ffd640 1 -- 172.21.15.77:0/2532908520 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8014b30 con 0x7f16040d0e40 2023-11-26T07:17:30.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.496+0000 7f160b34e640 1 -- 172.21.15.77:0/2532908520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16040b54c0 con 0x7f16040d0e40 2023-11-26T07:17:30.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.497+0000 7f160b34e640 1 -- 172.21.15.77:0/2532908520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160415eca0 con 0x7f16040d0e40 2023-11-26T07:17:30.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.498+0000 7f160b34e640 1 -- 172.21.15.77:0/2532908520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160404e840 con 0x7f16040d0e40 2023-11-26T07:17:30.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.499+0000 7f1602ffd640 1 -- 172.21.15.77:0/2532908520 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15f8014c90 con 0x7f16040d0e40 2023-11-26T07:17:30.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.499+0000 7f1602ffd640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f15e806ae70 0x7f15e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.500+0000 7f1602ffd640 1 -- 172.21.15.77:0/2532908520 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f15f8089c50 con 0x7f16040d0e40 2023-11-26T07:17:30.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.500+0000 7f1609b4b640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f15e806ae70 0x7f15e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.500+0000 7f1609b4b640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f15e806ae70 0x7f15e806d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15f0036000 tx=0x7f15f003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.504+0000 7f1602ffd640 1 -- 172.21.15.77:0/2532908520 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15f808f020 con 0x7f16040d0e40 2023-11-26T07:17:30.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.684+0000 7f160b34e640 1 -- 172.21.15.77:0/2532908520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16040c64e0 con 0x7f16040d0e40 2023-11-26T07:17:30.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.684+0000 7f1602ffd640 1 -- 172.21.15.77:0/2532908520 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15f80550e0 con 0x7f16040d0e40 2023-11-26T07:17:30.687 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:17:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 -- 172.21.15.77:0/2532908520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f15e806ae70 msgr2=0x7f15e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f15e806ae70 0x7f15e806d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15f0036000 tx=0x7f15f003b040 comp rx=0 tx=0).stop 2023-11-26T07:17:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 -- 172.21.15.77:0/2532908520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16040d0e40 msgr2=0x7f16040cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16040d0e40 0x7f16040cca50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15f8007ef0 tx=0x7f15f800e4b0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 -- 172.21.15.77:0/2532908520 shutdown_connections 2023-11-26T07:17:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f15e806ae70 0x7f15e806d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f160415d7d0 0x7f1604149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160415d3f0 0x7f1604149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 --2- 172.21.15.77:0/2532908520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16040d0e40 0x7f16040cca50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 -- 172.21.15.77:0/2532908520 >> 172.21.15.77:0/2532908520 conn(0x7f160409c5b0 msgr2=0x7f16040c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 -- 172.21.15.77:0/2532908520 shutdown_connections 2023-11-26T07:17:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.687+0000 7f160b34e640 1 -- 172.21.15.77:0/2532908520 wait complete. 2023-11-26T07:17:30.706 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:17:30.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.909+0000 7f35bc200640 1 Processor -- start 2023-11-26T07:17:30.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.910+0000 7f35bc200640 1 -- start start 2023-11-26T07:17:30.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.911+0000 7f35bc200640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f35b41609e0 0x7f35b406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.911+0000 7f35bc200640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40ce010 0x7f35b40ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.911+0000 7f35bc200640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b406c1f0 con 0x7f35b40d31a0 2023-11-26T07:17:30.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.911+0000 7f35bc200640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b40d1070 con 0x7f35b41609e0 2023-11-26T07:17:30.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.911+0000 7f35bc200640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40cedc0 con 0x7f35b40ce010 2023-11-26T07:17:30.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.912+0000 7f35ba79d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40ce010 0x7f35b40ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.912+0000 7f35ba79d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40ce010 0x7f35b40ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:58482/0 (socket says 172.21.15.77:58482) 2023-11-26T07:17:30.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.912+0000 7f35ba79d640 1 -- 172.21.15.77:0/1383527517 learned_addr learned my addr 172.21.15.77:0/1383527517 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:30.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.912+0000 7f35b9f9c640 1 --2- 172.21.15.77:0/1383527517 >> v2:172.21.15.159:3300/0 conn(0x7f35b41609e0 0x7f35b406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.912+0000 7f35ba79d640 1 -- 172.21.15.77:0/1383527517 >> v2:172.21.15.159:3300/0 conn(0x7f35b41609e0 msgr2=0x7f35b406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:30.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.912+0000 7f35ba79d640 1 --2- 172.21.15.77:0/1383527517 >> v2:172.21.15.159:3300/0 conn(0x7f35b41609e0 0x7f35b406bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.913+0000 7f35ba79d640 1 -- 172.21.15.77:0/1383527517 >> v1:172.21.15.159:6789/0 conn(0x7f35b40d31a0 legacy=0x7f35b40d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.913+0000 7f35ba79d640 1 -- 172.21.15.77:0/1383527517 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40cf0a0 con 0x7f35b40ce010 2023-11-26T07:17:30.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.914+0000 7f35ba79d640 1 --2- 172.21.15.77:0/1383527517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40ce010 0x7f35b40ce4a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009870 tx=0x7f35ac02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ade4b1104abc320 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.914+0000 7f35b8f9a640 1 -- 172.21.15.77:0/1383527517 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac030840 con 0x7f35b40ce010 2023-11-26T07:17:30.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.914+0000 7f35b8f9a640 1 -- 172.21.15.77:0/1383527517 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac0309a0 con 0x7f35b40ce010 2023-11-26T07:17:30.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.914+0000 7f35b8f9a640 1 -- 172.21.15.77:0/1383527517 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac030d30 con 0x7f35b40ce010 2023-11-26T07:17:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.915+0000 7f35bc200640 1 -- 172.21.15.77:0/1383527517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40ce010 msgr2=0x7f35b40ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.915+0000 7f35bc200640 1 --2- 172.21.15.77:0/1383527517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40ce010 0x7f35b40ce4a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009870 tx=0x7f35ac02b980 comp rx=0 tx=0).stop 2023-11-26T07:17:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.915+0000 7f35bc200640 1 -- 172.21.15.77:0/1383527517 shutdown_connections 2023-11-26T07:17:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.915+0000 7f35bc200640 1 --2- 172.21.15.77:0/1383527517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40ce010 0x7f35b40ce4a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.915+0000 7f35bc200640 1 --2- 172.21.15.77:0/1383527517 >> v2:172.21.15.159:3300/0 conn(0x7f35b41609e0 0x7f35b406bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.915+0000 7f35bc200640 1 -- 172.21.15.77:0/1383527517 >> 172.21.15.77:0/1383527517 conn(0x7f35b408af60 msgr2=0x7f35b409c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:30.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.915+0000 7f35bc200640 1 -- 172.21.15.77:0/1383527517 shutdown_connections 2023-11-26T07:17:30.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.915+0000 7f35bc200640 1 -- 172.21.15.77:0/1383527517 wait complete. 2023-11-26T07:17:30.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.917+0000 7f35bc200640 1 Processor -- start 2023-11-26T07:17:30.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.917+0000 7f35bc200640 1 -- start start 2023-11-26T07:17:30.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35bc200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b40ce010 0x7f35b41502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35bc200640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40d31a0 0x7f35b409f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35bc200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35b41609e0 0x7f35b414f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35bc200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b415f630 con 0x7f35b40ce010 2023-11-26T07:17:30.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35bc200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40b2e60 con 0x7f35b41609e0 2023-11-26T07:17:30.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35bc200640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40b39e0 con 0x7f35b40d31a0 2023-11-26T07:17:30.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35b9f9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b40ce010 0x7f35b41502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35b9f9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b40ce010 0x7f35b41502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37566/0 (socket says 172.21.15.77:37566) 2023-11-26T07:17:30.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35b9f9c640 1 -- 172.21.15.77:0/913990790 learned_addr learned my addr 172.21.15.77:0/913990790 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:30.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35ba79d640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35b41609e0 0x7f35b414f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35b9f9c640 1 -- 172.21.15.77:0/913990790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40d31a0 msgr2=0x7f35b409f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35b979b640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40d31a0 0x7f35b409f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35b9f9c640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40d31a0 0x7f35b409f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35b9f9c640 1 -- 172.21.15.77:0/913990790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35b41609e0 msgr2=0x7f35b414f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35b9f9c640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35b41609e0 0x7f35b414f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.918+0000 7f35b9f9c640 1 -- 172.21.15.77:0/913990790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac0094d0 con 0x7f35b40ce010 2023-11-26T07:17:30.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.919+0000 7f35ba79d640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35b41609e0 0x7f35b414f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:30.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.919+0000 7f35b979b640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40d31a0 0x7f35b409f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:30.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.919+0000 7f35b9f9c640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b40ce010 0x7f35b41502b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009d10 tx=0x7f35a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.919+0000 7f35b27fc640 1 -- 172.21.15.77:0/913990790 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4009b80 con 0x7f35b40ce010 2023-11-26T07:17:30.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.919+0000 7f35b27fc640 1 -- 172.21.15.77:0/913990790 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a400f040 con 0x7f35b40ce010 2023-11-26T07:17:30.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.919+0000 7f35bc200640 1 -- 172.21.15.77:0/913990790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b40b30b0 con 0x7f35b40ce010 2023-11-26T07:17:30.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.919+0000 7f35b27fc640 1 -- 172.21.15.77:0/913990790 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4014680 con 0x7f35b40ce010 2023-11-26T07:17:30.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.919+0000 7f35bc200640 1 -- 172.21.15.77:0/913990790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b40b3670 con 0x7f35b40ce010 2023-11-26T07:17:30.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.920+0000 7f35bc200640 1 -- 172.21.15.77:0/913990790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b4067470 con 0x7f35b40ce010 2023-11-26T07:17:30.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.921+0000 7f35b27fc640 1 -- 172.21.15.77:0/913990790 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35a40147e0 con 0x7f35b40ce010 2023-11-26T07:17:30.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.922+0000 7f35b27fc640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f35a006ae40 0x7f35a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.922+0000 7f35b27fc640 1 -- 172.21.15.77:0/913990790 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f35a408a050 con 0x7f35b40ce010 2023-11-26T07:17:30.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.922+0000 7f35b979b640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f35a006ae40 0x7f35a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.923+0000 7f35b979b640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f35a006ae40 0x7f35a006d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35b40cceb0 tx=0x7f35a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:30.927+0000 7f35b27fc640 1 -- 172.21.15.77:0/913990790 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35a40554e0 con 0x7f35b40ce010 2023-11-26T07:17:31.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.158+0000 7f35bc200640 1 -- 172.21.15.77:0/913990790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35b406b750 con 0x7f35b40ce010 2023-11-26T07:17:31.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.159+0000 7f35b27fc640 1 -- 172.21.15.77:0/913990790 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f35a4058b00 con 0x7f35b40ce010 2023-11-26T07:17:31.162 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:31.162 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2517793456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2517793456},{"type":"v1","addr":"172.21.15.77:6835","nonce":2517793456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/169772143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":169772143},{"type":"v1","addr":"172.21.15.77:6837","nonce":169772143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3797973649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3797973649},{"type":"v1","addr":"172.21.15.159:6834","nonce":3797973649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2168278307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2168278307},{"type":"v1","addr":"172.21.15.159:6835","nonce":2168278307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-26T07:17:31.162 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 3 2023-11-26T07:17:31.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.161+0000 7f35bc200640 1 -- 172.21.15.77:0/913990790 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f35a006ae40 msgr2=0x7f35a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.162+0000 7f35bc200640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f35a006ae40 0x7f35a006d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35b40cceb0 tx=0x7f35a8009040 comp rx=0 tx=0).stop 2023-11-26T07:17:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.162+0000 7f35bc200640 1 -- 172.21.15.77:0/913990790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b40ce010 msgr2=0x7f35b41502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.162+0000 7f35bc200640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b40ce010 0x7f35b41502b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009d10 tx=0x7f35a400c490 comp rx=0 tx=0).stop 2023-11-26T07:17:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.162+0000 7f35bc200640 1 -- 172.21.15.77:0/913990790 shutdown_connections 2023-11-26T07:17:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.162+0000 7f35bc200640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f35a006ae40 0x7f35a006d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.162+0000 7f35bc200640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35b41609e0 0x7f35b414f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.162+0000 7f35bc200640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b40d31a0 0x7f35b409f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.162+0000 7f35bc200640 1 --2- 172.21.15.77:0/913990790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b40ce010 0x7f35b41502b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.162+0000 7f35bc200640 1 -- 172.21.15.77:0/913990790 >> 172.21.15.77:0/913990790 conn(0x7f35b408af60 msgr2=0x7f35b40ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:31.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.162+0000 7f35bc200640 1 -- 172.21.15.77:0/913990790 shutdown_connections 2023-11-26T07:17:31.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.162+0000 7f35bc200640 1 -- 172.21.15.77:0/913990790 wait complete. 2023-11-26T07:17:31.184 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:31.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.391+0000 7f7c2b7a9640 1 Processor -- start 2023-11-26T07:17:31.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.391+0000 7f7c2b7a9640 1 -- start start 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.392+0000 7f7c2b7a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c240b2250 0x7f7c2415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.392+0000 7f7c2b7a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c240b2aa0 0x7f7c2415b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.393+0000 7f7c2b7a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2415ab80 con 0x7f7c240b2630 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.393+0000 7f7c2b7a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2415a990 con 0x7f7c240b2250 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.393+0000 7f7c2b7a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2415e680 con 0x7f7c240b2aa0 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.393+0000 7f7c29545640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c240b2250 0x7f7c2415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.393+0000 7f7c29545640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c240b2250 0x7f7c2415df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37576/0 (socket says 172.21.15.77:37576) 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.393+0000 7f7c29545640 1 -- 172.21.15.77:0/3331661361 learned_addr learned my addr 172.21.15.77:0/3331661361 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.393+0000 7f7c29d46640 1 --2- 172.21.15.77:0/3331661361 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c240b2aa0 0x7f7c2415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.393+0000 7f7c29545640 1 -- 172.21.15.77:0/3331661361 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c240b2aa0 msgr2=0x7f7c2415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.393+0000 7f7c29545640 1 --2- 172.21.15.77:0/3331661361 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c240b2aa0 0x7f7c2415b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.393+0000 7f7c29545640 1 -- 172.21.15.77:0/3331661361 >> v1:172.21.15.77:6789/0 conn(0x7f7c240b2630 legacy=0x7f7c240ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.393+0000 7f7c29545640 1 -- 172.21.15.77:0/3331661361 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2415e960 con 0x7f7c240b2250 2023-11-26T07:17:31.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.394+0000 7f7c29545640 1 --2- 172.21.15.77:0/3331661361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c240b2250 0x7f7c2415df80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000bb10 tx=0x7f7c2002e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a379f87cab87aec server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.395+0000 7f7c1bfff640 1 -- 172.21.15.77:0/3331661361 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20036440 con 0x7f7c240b2250 2023-11-26T07:17:31.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.395+0000 7f7c1bfff640 1 -- 172.21.15.77:0/3331661361 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c200365a0 con 0x7f7c240b2250 2023-11-26T07:17:31.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.395+0000 7f7c1bfff640 1 -- 172.21.15.77:0/3331661361 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20036930 con 0x7f7c240b2250 2023-11-26T07:17:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.395+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/3331661361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c240b2250 msgr2=0x7f7c2415df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.395+0000 7f7c2b7a9640 1 --2- 172.21.15.77:0/3331661361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c240b2250 0x7f7c2415df80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000bb10 tx=0x7f7c2002e150 comp rx=0 tx=0).stop 2023-11-26T07:17:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.395+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/3331661361 shutdown_connections 2023-11-26T07:17:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.395+0000 7f7c2b7a9640 1 --2- 172.21.15.77:0/3331661361 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c240b2aa0 0x7f7c2415b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.395+0000 7f7c2b7a9640 1 --2- 172.21.15.77:0/3331661361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c240b2250 0x7f7c2415df80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.395+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/3331661361 >> 172.21.15.77:0/3331661361 conn(0x7f7c2406a920 msgr2=0x7f7c2406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:31.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.396+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/3331661361 shutdown_connections 2023-11-26T07:17:31.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.396+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/3331661361 wait complete. 2023-11-26T07:17:31.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.397+0000 7f7c2b7a9640 1 Processor -- start 2023-11-26T07:17:31.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.397+0000 7f7c2b7a9640 1 -- start start 2023-11-26T07:17:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.398+0000 7f7c2b7a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c240b2250 0x7f7c24147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.398+0000 7f7c2b7a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c240b2630 0x7f7c240c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.398+0000 7f7c2b7a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c240b2aa0 0x7f7c24071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.398+0000 7f7c2b7a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c24156160 con 0x7f7c240b2630 2023-11-26T07:17:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.398+0000 7f7c2b7a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c24147860 con 0x7f7c240b2aa0 2023-11-26T07:17:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.398+0000 7f7c2b7a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c24155550 con 0x7f7c240b2250 2023-11-26T07:17:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.399+0000 7f7c28d44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c240b2630 0x7f7c240c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.399+0000 7f7c28d44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c240b2630 0x7f7c240c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37586/0 (socket says 172.21.15.77:37586) 2023-11-26T07:17:31.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.399+0000 7f7c28d44640 1 -- 172.21.15.77:0/71860718 learned_addr learned my addr 172.21.15.77:0/71860718 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:31.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.399+0000 7f7c28d44640 1 -- 172.21.15.77:0/71860718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c240b2250 msgr2=0x7f7c24147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.399+0000 7f7c28d44640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c240b2250 0x7f7c24147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.399+0000 7f7c28d44640 1 -- 172.21.15.77:0/71860718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c240b2aa0 msgr2=0x7f7c24071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.399+0000 7f7c28d44640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c240b2aa0 0x7f7c24071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.399+0000 7f7c28d44640 1 -- 172.21.15.77:0/71860718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2000b770 con 0x7f7c240b2630 2023-11-26T07:17:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.399+0000 7f7c28d44640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c240b2630 0x7f7c240c97d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c450 tx=0x7f7c1400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.399+0000 7f7c19ffb640 1 -- 172.21.15.77:0/71860718 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140052d0 con 0x7f7c240b2630 2023-11-26T07:17:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.400+0000 7f7c19ffb640 1 -- 172.21.15.77:0/71860718 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14005430 con 0x7f7c240b2630 2023-11-26T07:17:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.400+0000 7f7c19ffb640 1 -- 172.21.15.77:0/71860718 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14012870 con 0x7f7c240b2630 2023-11-26T07:17:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.400+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/71860718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c240cd7c0 con 0x7f7c240b2630 2023-11-26T07:17:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.400+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/71860718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c24155b10 con 0x7f7c240b2630 2023-11-26T07:17:31.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.401+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/71860718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c24067470 con 0x7f7c240b2630 2023-11-26T07:17:31.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.401+0000 7f7c19ffb640 1 -- 172.21.15.77:0/71860718 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c140129d0 con 0x7f7c240b2630 2023-11-26T07:17:31.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.402+0000 7f7c19ffb640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c0806ae40 0x7f7c0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.402+0000 7f7c19ffb640 1 -- 172.21.15.77:0/71860718 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c14088d60 con 0x7f7c240b2630 2023-11-26T07:17:31.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.403+0000 7f7c29545640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c0806ae40 0x7f7c0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.403+0000 7f7c29545640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c0806ae40 0x7f7c0806d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7c20038000 tx=0x7f7c20030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.407+0000 7f7c19ffb640 1 -- 172.21.15.77:0/71860718 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c140541f0 con 0x7f7c240b2630 2023-11-26T07:17:31.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.595+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/71860718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c241562a0 con 0x7f7c240b2630 2023-11-26T07:17:31.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.596+0000 7f7c19ffb640 1 -- 172.21.15.77:0/71860718 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f7c14057810 con 0x7f7c240b2630 2023-11-26T07:17:31.599 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:31.599 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:25.934049+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/71860718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c0806ae40 msgr2=0x7f7c0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c0806ae40 0x7f7c0806d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7c20038000 tx=0x7f7c20030000 comp rx=0 tx=0).stop 2023-11-26T07:17:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/71860718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c240b2630 msgr2=0x7f7c240c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c240b2630 0x7f7c240c97d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c450 tx=0x7f7c1400c910 comp rx=0 tx=0).stop 2023-11-26T07:17:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/71860718 shutdown_connections 2023-11-26T07:17:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c0806ae40 0x7f7c0806d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c240b2aa0 0x7f7c24071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c240b2630 0x7f7c240c97d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 --2- 172.21.15.77:0/71860718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c240b2250 0x7f7c24147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/71860718 >> 172.21.15.77:0/71860718 conn(0x7f7c2406a920 msgr2=0x7f7c240caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/71860718 shutdown_connections 2023-11-26T07:17:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.599+0000 7f7c2b7a9640 1 -- 172.21.15.77:0/71860718 wait complete. 2023-11-26T07:17:31.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:17:31.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:17:31.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.832+0000 7f33ea9cb640 1 Processor -- start 2023-11-26T07:17:31.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.832+0000 7f33ea9cb640 1 -- start start 2023-11-26T07:17:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.833+0000 7f33ea9cb640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f33e40b0b40 0x7f33e40b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.833+0000 7f33ea9cb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33e415ded0 0x7f33e415e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.833+0000 7f33ea9cb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e406d430 con 0x7f33e415a1c0 2023-11-26T07:17:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.833+0000 7f33ea9cb640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e415ec50 con 0x7f33e40b0b40 2023-11-26T07:17:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.833+0000 7f33ea9cb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e406cb00 con 0x7f33e415ded0 2023-11-26T07:17:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e99c9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f33e415a1c0 0x7f33e406d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46254/0 (socket says 172.21.15.77:46254) 2023-11-26T07:17:31.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e99c9640 1 -- 172.21.15.77:0/621249176 learned_addr learned my addr 172.21.15.77:0/621249176 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818154373 0 0) 0x7f33e406d430 con 0x7f33e415a1c0 2023-11-26T07:17:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33d0005730 con 0x7f33e415a1c0 2023-11-26T07:17:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e91c8640 1 --2- 172.21.15.77:0/621249176 >> v2:172.21.15.159:3300/0 conn(0x7f33e40b0b40 0x7f33e40b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33ea1ca640 1 --2- 172.21.15.77:0/621249176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33e415ded0 0x7f33e415e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3396651429 0 0) 0x7f33d0005730 con 0x7f33e415a1c0 2023-11-26T07:17:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33e415ded0 msgr2=0x7f33e415e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e89c7640 1 --2- 172.21.15.77:0/621249176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33e415ded0 0x7f33e415e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 >> v2:172.21.15.159:3300/0 conn(0x7f33e40b0b40 msgr2=0x7f33e40b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e89c7640 1 --2- 172.21.15.77:0/621249176 >> v2:172.21.15.159:3300/0 conn(0x7f33e40b0b40 0x7f33e40b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40b14e0 con 0x7f33e415a1c0 2023-11-26T07:17:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f33e0001670 con 0x7f33e415a1c0 2023-11-26T07:17:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.834+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 >> v1:172.21.15.77:6789/0 conn(0x7f33e415a1c0 legacy=0x7f33e406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e89c7640 1 --2- 172.21.15.77:0/621249176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d0005b80 0x7f33d0005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e89c7640 1 --2- 172.21.15.77:0/621249176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33e415ded0 0x7f33d00069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e89c7640 1 --2- 172.21.15.77:0/621249176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33d0006f10 0x7f33d0007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e415ec50 con 0x7f33d0005b80 2023-11-26T07:17:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e406cb00 con 0x7f33d0006f10 2023-11-26T07:17:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d000dc70 con 0x7f33e415ded0 2023-11-26T07:17:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e99c9640 1 --2- 172.21.15.77:0/621249176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d0005b80 0x7f33d0005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e99c9640 1 -- 172.21.15.77:0/621249176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33e415ded0 msgr2=0x7f33d00069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e99c9640 1 --2- 172.21.15.77:0/621249176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33e415ded0 0x7f33d00069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e99c9640 1 -- 172.21.15.77:0/621249176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33d0006f10 msgr2=0x7f33d0007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e99c9640 1 --2- 172.21.15.77:0/621249176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33d0006f10 0x7f33d0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.835+0000 7f33e99c9640 1 -- 172.21.15.77:0/621249176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d0005730 con 0x7f33d0005b80 2023-11-26T07:17:31.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.836+0000 7f33e99c9640 1 --2- 172.21.15.77:0/621249176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d0005b80 0x7f33d0005fa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f33e000c240 tx=0x7f33d0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a75a54079c80d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.836+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e002cae0 con 0x7f33d0005b80 2023-11-26T07:17:31.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.836+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e002cc40 con 0x7f33d0005b80 2023-11-26T07:17:31.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.836+0000 7f33e89c7640 1 -- 172.21.15.77:0/621249176 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e00058d0 con 0x7f33d0005b80 2023-11-26T07:17:31.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.837+0000 7f33ea9cb640 1 -- 172.21.15.77:0/621249176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d0005b80 msgr2=0x7f33d0005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.837+0000 7f33ea9cb640 1 --2- 172.21.15.77:0/621249176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d0005b80 0x7f33d0005fa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f33e000c240 tx=0x7f33d0007a00 comp rx=0 tx=0).stop 2023-11-26T07:17:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.837+0000 7f33ea1ca640 1 -- 172.21.15.77:0/621249176 reap_dead start 2023-11-26T07:17:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.837+0000 7f33ea9cb640 1 -- 172.21.15.77:0/621249176 shutdown_connections 2023-11-26T07:17:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.837+0000 7f33ea9cb640 1 -- 172.21.15.77:0/621249176 >> 172.21.15.77:0/621249176 conn(0x7f33e40cbb40 msgr2=0x7f33e40cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.837+0000 7f33ea9cb640 1 -- 172.21.15.77:0/621249176 shutdown_connections 2023-11-26T07:17:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.837+0000 7f33ea9cb640 1 -- 172.21.15.77:0/621249176 wait complete. 2023-11-26T07:17:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.839+0000 7f33ea9cb640 1 Processor -- start 2023-11-26T07:17:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.839+0000 7f33ea9cb640 1 -- start start 2023-11-26T07:17:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.840+0000 7f33ea9cb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d0005b80 0x7f33e40b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.840+0000 7f33ea9cb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33e40b4730 0x7f33e4151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.840+0000 7f33ea9cb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e40b2580 0x7f33e40b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.840+0000 7f33ea9cb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40b2f40 con 0x7f33e40b2580 2023-11-26T07:17:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.840+0000 7f33ea9cb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40c7f30 con 0x7f33e40b4730 2023-11-26T07:17:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.840+0000 7f33ea9cb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40b4bb0 con 0x7f33d0005b80 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.840+0000 7f33ea1ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e40b2580 0x7f33e40b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.840+0000 7f33ea1ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e40b2580 0x7f33e40b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37600/0 (socket says 172.21.15.77:37600) 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.840+0000 7f33ea1ca640 1 -- 172.21.15.77:0/512874253 learned_addr learned my addr 172.21.15.77:0/512874253 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33ea1ca640 1 -- 172.21.15.77:0/512874253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d0005b80 msgr2=0x7f33e40b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33ea1ca640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d0005b80 0x7f33e40b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33ea1ca640 1 -- 172.21.15.77:0/512874253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33e40b4730 msgr2=0x7f33e4151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33e91c8640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33e40b4730 0x7f33e4151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33ea1ca640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33e40b4730 0x7f33e4151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33ea1ca640 1 -- 172.21.15.77:0/512874253 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40c81d0 con 0x7f33e40b2580 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33ea1ca640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e40b2580 0x7f33e40b2a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f33e415e2b0 tx=0x7f33dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33da7fc640 1 -- 172.21.15.77:0/512874253 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00ed90 con 0x7f33e40b2580 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33da7fc640 1 -- 172.21.15.77:0/512874253 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc014420 con 0x7f33e40b2580 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33ea9cb640 1 -- 172.21.15.77:0/512874253 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e40c84b0 con 0x7f33e40b2580 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33da7fc640 1 -- 172.21.15.77:0/512874253 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0147d0 con 0x7f33e40b2580 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.841+0000 7f33ea9cb640 1 -- 172.21.15.77:0/512874253 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e40b22b0 con 0x7f33e40b2580 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.842+0000 7f33ea9cb640 1 -- 172.21.15.77:0/512874253 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e40c89d0 con 0x7f33e40b2580 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.843+0000 7f33da7fc640 1 -- 172.21.15.77:0/512874253 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33dc014930 con 0x7f33e40b2580 2023-11-26T07:17:31.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.844+0000 7f33da7fc640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f33c806ae70 0x7f33c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.844+0000 7f33da7fc640 1 -- 172.21.15.77:0/512874253 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f33dc089800 con 0x7f33e40b2580 2023-11-26T07:17:31.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.845+0000 7f33e99c9640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f33c806ae70 0x7f33c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.845+0000 7f33e99c9640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f33c806ae70 0x7f33c806d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f33e0034000 tx=0x7f33e002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:31.849+0000 7f33da7fc640 1 -- 172.21.15.77:0/512874253 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33e40c89d0 con 0x7f33e40b2580 2023-11-26T07:17:32.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.039+0000 7f33ea9cb640 1 -- 172.21.15.77:0/512874253 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33e40c89d0 con 0x7f33e40b2580 2023-11-26T07:17:32.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.040+0000 7f33da7fc640 1 -- 172.21.15.77:0/512874253 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33e40c89d0 con 0x7f33e40b2580 2023-11-26T07:17:32.042 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:17:32.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.042+0000 7f33ea9cb640 1 -- 172.21.15.77:0/512874253 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f33c806ae70 msgr2=0x7f33c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.042+0000 7f33ea9cb640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f33c806ae70 0x7f33c806d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f33e0034000 tx=0x7f33e002e000 comp rx=0 tx=0).stop 2023-11-26T07:17:32.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.042+0000 7f33ea9cb640 1 -- 172.21.15.77:0/512874253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e40b2580 msgr2=0x7f33e40b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.042+0000 7f33ea9cb640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e40b2580 0x7f33e40b2a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f33e415e2b0 tx=0x7f33dc00e4b0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.042+0000 7f33ea9cb640 1 -- 172.21.15.77:0/512874253 shutdown_connections 2023-11-26T07:17:32.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.042+0000 7f33ea9cb640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f33c806ae70 0x7f33c806d330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.042+0000 7f33ea9cb640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e40b2580 0x7f33e40b2a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.042+0000 7f33ea9cb640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33e40b4730 0x7f33e4151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.042+0000 7f33ea9cb640 1 --2- 172.21.15.77:0/512874253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d0005b80 0x7f33e40b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.042+0000 7f33ea9cb640 1 -- 172.21.15.77:0/512874253 >> 172.21.15.77:0/512874253 conn(0x7f33e40cbb40 msgr2=0x7f33e406d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:32.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.043+0000 7f33ea9cb640 1 -- 172.21.15.77:0/512874253 shutdown_connections 2023-11-26T07:17:32.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.043+0000 7f33ea9cb640 1 -- 172.21.15.77:0/512874253 wait complete. 2023-11-26T07:17:32.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:17:32.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.267+0000 7fd1c0d1d640 1 Processor -- start 2023-11-26T07:17:32.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.267+0000 7fd1c0d1d640 1 -- start start 2023-11-26T07:17:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.268+0000 7fd1c0d1d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd1bc15c7f0 0x7fd1bc06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.268+0000 7fd1c0d1d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1bc0cf450 0x7fd1bc0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.268+0000 7fd1c0d1d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1bc0cdfb0 0x7fd1bc0ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.268+0000 7fd1c0d1d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0cfe40 con 0x7fd1bc0cf450 2023-11-26T07:17:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.268+0000 7fd1c0d1d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc156010 con 0x7fd1bc15c7f0 2023-11-26T07:17:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.268+0000 7fd1c0d1d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc06ce30 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.269+0000 7fd1b3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1bc0cf450 0x7fd1bc0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.269+0000 7fd1b3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1bc0cf450 0x7fd1bc0cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37602/0 (socket says 172.21.15.77:37602) 2023-11-26T07:17:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.269+0000 7fd1b3fff640 1 -- 172.21.15.77:0/1223630928 learned_addr learned my addr 172.21.15.77:0/1223630928 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.269+0000 7fd1b3fff640 1 -- 172.21.15.77:0/1223630928 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1bc0cdfb0 msgr2=0x7fd1bc0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.269+0000 7fd1b3fff640 1 --2- 172.21.15.77:0/1223630928 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1bc0cdfb0 0x7fd1bc0ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.269+0000 7fd1b3fff640 1 -- 172.21.15.77:0/1223630928 >> v2:172.21.15.159:3300/0 conn(0x7fd1bc15c7f0 msgr2=0x7fd1bc06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.269+0000 7fd1b3fff640 1 --2- 172.21.15.77:0/1223630928 >> v2:172.21.15.159:3300/0 conn(0x7fd1bc15c7f0 0x7fd1bc06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.269+0000 7fd1b3fff640 1 -- 172.21.15.77:0/1223630928 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0cece0 con 0x7fd1bc0cf450 2023-11-26T07:17:32.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.270+0000 7fd1b3fff640 1 --2- 172.21.15.77:0/1223630928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1bc0cf450 0x7fd1bc0cf900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0d0130 tx=0x7fd1a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890c59df6f91b13a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1b9d9b640 1 -- 172.21.15.77:0/1223630928 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4031870 con 0x7fd1bc0cf450 2023-11-26T07:17:32.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1b9d9b640 1 -- 172.21.15.77:0/1223630928 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a40319d0 con 0x7fd1bc0cf450 2023-11-26T07:17:32.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1b9d9b640 1 -- 172.21.15.77:0/1223630928 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4031d60 con 0x7fd1bc0cf450 2023-11-26T07:17:32.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/1223630928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1bc0cf450 msgr2=0x7fd1bc0cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1c0d1d640 1 --2- 172.21.15.77:0/1223630928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1bc0cf450 0x7fd1bc0cf900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0d0130 tx=0x7fd1a402b910 comp rx=0 tx=0).stop 2023-11-26T07:17:32.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/1223630928 shutdown_connections 2023-11-26T07:17:32.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1c0d1d640 1 --2- 172.21.15.77:0/1223630928 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1bc0cdfb0 0x7fd1bc0ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1c0d1d640 1 --2- 172.21.15.77:0/1223630928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1bc0cf450 0x7fd1bc0cf900 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1c0d1d640 1 --2- 172.21.15.77:0/1223630928 >> v2:172.21.15.159:3300/0 conn(0x7fd1bc15c7f0 0x7fd1bc06db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/1223630928 >> 172.21.15.77:0/1223630928 conn(0x7fd1bc06a920 msgr2=0x7fd1bc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:32.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/1223630928 shutdown_connections 2023-11-26T07:17:32.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.271+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/1223630928 wait complete. 2023-11-26T07:17:32.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.273+0000 7fd1c0d1d640 1 Processor -- start 2023-11-26T07:17:32.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.273+0000 7fd1c0d1d640 1 -- start start 2023-11-26T07:17:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.274+0000 7fd1c0d1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1bc0cdfb0 0x7fd1bc0c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.274+0000 7fd1c0d1d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1bc0cf450 0x7fd1bc154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.274+0000 7fd1c0d1d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1bc15c7f0 0x7fd1bc0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.274+0000 7fd1c0d1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1570d0 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.274+0000 7fd1c0d1d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc155240 con 0x7fd1bc0cf450 2023-11-26T07:17:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.274+0000 7fd1c0d1d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1564c0 con 0x7fd1bc15c7f0 2023-11-26T07:17:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.274+0000 7fd1ba59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1bc0cdfb0 0x7fd1bc0c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1ba59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1bc0cdfb0 0x7fd1bc0c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37606/0 (socket says 172.21.15.77:37606) 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1ba59c640 1 -- 172.21.15.77:0/2192093314 learned_addr learned my addr 172.21.15.77:0/2192093314 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1ba59c640 1 -- 172.21.15.77:0/2192093314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1bc15c7f0 msgr2=0x7fd1bc0adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1ba59c640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1bc15c7f0 0x7fd1bc0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1ba59c640 1 -- 172.21.15.77:0/2192093314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1bc0cf450 msgr2=0x7fd1bc154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1ba59c640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1bc0cf450 0x7fd1bc154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1ba59c640 1 -- 172.21.15.77:0/2192093314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40094d0 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1ba59c640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1bc0cdfb0 0x7fd1bc0c85d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00b410 tx=0x7fd1ac00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1b2ffd640 1 -- 172.21.15.77:0/2192093314 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac011830 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1b2ffd640 1 -- 172.21.15.77:0/2192093314 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac0119b0 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/2192093314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc1567a0 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.275+0000 7fd1b2ffd640 1 -- 172.21.15.77:0/2192093314 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac011d60 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.276+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/2192093314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc156d60 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.277+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/2192093314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc067470 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.278+0000 7fd1b2ffd640 1 -- 172.21.15.77:0/2192093314 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1ac01a400 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.279+0000 7fd1b2ffd640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd19c06ae40 0x7fd19c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.279+0000 7fd1b2ffd640 1 -- 172.21.15.77:0/2192093314 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd1ac089400 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.279+0000 7fd1b3fff640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd19c06ae40 0x7fd19c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.280+0000 7fd1b3fff640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd19c06ae40 0x7fd19c06d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4036000 tx=0x7fd1a4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.283+0000 7fd1b2ffd640 1 -- 172.21.15.77:0/2192093314 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1ac054890 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.473+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/2192093314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd1bc0cd730 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.474+0000 7fd1b2ffd640 1 -- 172.21.15.77:0/2192093314 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd1ac015090 con 0x7fd1bc0cdfb0 2023-11-26T07:17:32.477 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:32.477 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-26T07:17:32.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:17:32.477 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-11-26T07:17:32.478 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-11-26T07:17:32.478 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:17:32.478 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-26T07:17:32.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.477+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/2192093314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd19c06ae40 msgr2=0x7fd19c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.477+0000 7fd1c0d1d640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd19c06ae40 0x7fd19c06d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4036000 tx=0x7fd1a4030000 comp rx=0 tx=0).stop 2023-11-26T07:17:32.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.477+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/2192093314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1bc0cdfb0 msgr2=0x7fd1bc0c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.477+0000 7fd1c0d1d640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1bc0cdfb0 0x7fd1bc0c85d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00b410 tx=0x7fd1ac00b8d0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.477+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/2192093314 shutdown_connections 2023-11-26T07:17:32.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.477+0000 7fd1c0d1d640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd19c06ae40 0x7fd19c06d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.477+0000 7fd1c0d1d640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1bc15c7f0 0x7fd1bc0adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.477+0000 7fd1c0d1d640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1bc0cf450 0x7fd1bc154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.477+0000 7fd1c0d1d640 1 --2- 172.21.15.77:0/2192093314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1bc0cdfb0 0x7fd1bc0c85d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.478+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/2192093314 >> 172.21.15.77:0/2192093314 conn(0x7fd1bc06a920 msgr2=0x7fd1bc0ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:32.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.478+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/2192093314 shutdown_connections 2023-11-26T07:17:32.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.478+0000 7fd1c0d1d640 1 -- 172.21.15.77:0/2192093314 wait complete. 2023-11-26T07:17:32.498 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:17:32.498 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:17:32.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.714+0000 7f7d9fb01640 1 Processor -- start 2023-11-26T07:17:32.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.714+0000 7f7d9fb01640 1 -- start start 2023-11-26T07:17:32.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.715+0000 7f7d9fb01640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d98157c70 0x7f7d98161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.715+0000 7f7d9fb01640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7d9815e390 0x7f7d980cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.715+0000 7f7d9fb01640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d980ce0b0 con 0x7f7d980cf450 2023-11-26T07:17:32.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.715+0000 7f7d9fb01640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d980cfe10 con 0x7f7d9815e390 2023-11-26T07:17:32.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.715+0000 7f7d9fb01640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98161960 con 0x7f7d98157c70 2023-11-26T07:17:32.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.716+0000 7f7d9d09c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7d980cf450 0x7f7d9815dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46264/0 (socket says 172.21.15.77:46264) 2023-11-26T07:17:32.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.716+0000 7f7d9d09c640 1 -- 172.21.15.77:0/3266077256 learned_addr learned my addr 172.21.15.77:0/3266077256 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:32.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.716+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772649319 0 0) 0x7f7d980ce0b0 con 0x7f7d980cf450 2023-11-26T07:17:32.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.716+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d84003520 con 0x7f7d980cf450 2023-11-26T07:17:32.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.716+0000 7f7d9d89d640 1 --2- 172.21.15.77:0/3266077256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d98157c70 0x7f7d98161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.716+0000 7f7d9e09e640 1 --2- 172.21.15.77:0/3266077256 >> v2:172.21.15.159:3300/0 conn(0x7f7d9815e390 0x7f7d980cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.716+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2841288453 0 0) 0x7f7d84003520 con 0x7f7d980cf450 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d98157c70 msgr2=0x7f7d98161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 --2- 172.21.15.77:0/3266077256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d98157c70 0x7f7d98161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 >> v2:172.21.15.159:3300/0 conn(0x7f7d9815e390 msgr2=0x7f7d980cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 --2- 172.21.15.77:0/3266077256 >> v2:172.21.15.159:3300/0 conn(0x7f7d9815e390 0x7f7d980cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9815e8d0 con 0x7f7d980cf450 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f7d8c001670 con 0x7f7d980cf450 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 >> v1:172.21.15.77:6789/0 conn(0x7f7d980cf450 legacy=0x7f7d9815dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 --2- 172.21.15.77:0/3266077256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 0x7f7d84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 --2- 172.21.15.77:0/3266077256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d840047c0 0x7f7d84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 --2- 172.21.15.77:0/3266077256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d98157c70 0x7f7d84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d980cfe10 con 0x7f7d84003970 2023-11-26T07:17:32.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98161960 con 0x7f7d840047c0 2023-11-26T07:17:32.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8400ba30 con 0x7f7d98157c70 2023-11-26T07:17:32.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9d89d640 1 --2- 172.21.15.77:0/3266077256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 0x7f7d84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9d89d640 1 -- 172.21.15.77:0/3266077256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d98157c70 msgr2=0x7f7d84005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:32.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9d89d640 1 --2- 172.21.15.77:0/3266077256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d98157c70 0x7f7d84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9d89d640 1 -- 172.21.15.77:0/3266077256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d840047c0 msgr2=0x7f7d84004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:32.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9d89d640 1 --2- 172.21.15.77:0/3266077256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d840047c0 0x7f7d84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.717+0000 7f7d9d89d640 1 -- 172.21.15.77:0/3266077256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84003520 con 0x7f7d84003970 2023-11-26T07:17:32.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.719+0000 7f7d9d89d640 1 --2- 172.21.15.77:0/3266077256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 0x7f7d84003d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400ba00 tx=0x7f7d840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7628b78cfdb3f734 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.719+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9402d040 con 0x7f7d84003970 2023-11-26T07:17:32.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.719+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d94033610 con 0x7f7d84003970 2023-11-26T07:17:32.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.719+0000 7f7d9c89b640 1 -- 172.21.15.77:0/3266077256 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d940339a0 con 0x7f7d84003970 2023-11-26T07:17:32.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.719+0000 7f7d9fb01640 1 -- 172.21.15.77:0/3266077256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 msgr2=0x7f7d84003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.719+0000 7f7d9fb01640 1 --2- 172.21.15.77:0/3266077256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 0x7f7d84003d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400ba00 tx=0x7f7d840057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.719+0000 7f7d9e09e640 1 -- 172.21.15.77:0/3266077256 reap_dead start 2023-11-26T07:17:32.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.719+0000 7f7d9fb01640 1 -- 172.21.15.77:0/3266077256 shutdown_connections 2023-11-26T07:17:32.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.719+0000 7f7d9fb01640 1 -- 172.21.15.77:0/3266077256 >> 172.21.15.77:0/3266077256 conn(0x7f7d9806a920 msgr2=0x7f7d9806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:32.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.719+0000 7f7d9fb01640 1 -- 172.21.15.77:0/3266077256 shutdown_connections 2023-11-26T07:17:32.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.720+0000 7f7d9fb01640 1 -- 172.21.15.77:0/3266077256 wait complete. 2023-11-26T07:17:32.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.721+0000 7f7d9fb01640 1 Processor -- start 2023-11-26T07:17:32.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.721+0000 7f7d9fb01640 1 -- start start 2023-11-26T07:17:32.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.722+0000 7f7d9fb01640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 0x7f7d98149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.722+0000 7f7d9fb01640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d98154ae0 0x7f7d98147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.722+0000 7f7d9fb01640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d98154f60 0x7f7d9814a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.722+0000 7f7d9fb01640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98149670 con 0x7f7d84003970 2023-11-26T07:17:32.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.722+0000 7f7d9fb01640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98148a60 con 0x7f7d98154ae0 2023-11-26T07:17:32.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.722+0000 7f7d9fb01640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98148d40 con 0x7f7d98154f60 2023-11-26T07:17:32.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.722+0000 7f7d9d89d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 0x7f7d98149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.722+0000 7f7d9d89d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 0x7f7d98149b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37616/0 (socket says 172.21.15.77:37616) 2023-11-26T07:17:32.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.723+0000 7f7d9d89d640 1 -- 172.21.15.77:0/2671608964 learned_addr learned my addr 172.21.15.77:0/2671608964 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:32.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.723+0000 7f7d9d89d640 1 -- 172.21.15.77:0/2671608964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d98154f60 msgr2=0x7f7d9814a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.723+0000 7f7d9d89d640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d98154f60 0x7f7d9814a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.723+0000 7f7d9d89d640 1 -- 172.21.15.77:0/2671608964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d98154ae0 msgr2=0x7f7d98147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.723+0000 7f7d9d89d640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d98154ae0 0x7f7d98147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.723+0000 7f7d9d89d640 1 -- 172.21.15.77:0/2671608964 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d98149020 con 0x7f7d84003970 2023-11-26T07:17:32.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.723+0000 7f7d9d89d640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 0x7f7d98149b00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d9402bdf0 tx=0x7f7d94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.723+0000 7f7d8a7fc640 1 -- 172.21.15.77:0/2671608964 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9403c800 con 0x7f7d84003970 2023-11-26T07:17:32.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.724+0000 7f7d8a7fc640 1 -- 172.21.15.77:0/2671608964 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d94040070 con 0x7f7d84003970 2023-11-26T07:17:32.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.724+0000 7f7d9fb01640 1 -- 172.21.15.77:0/2671608964 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d98149300 con 0x7f7d84003970 2023-11-26T07:17:32.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.724+0000 7f7d8a7fc640 1 -- 172.21.15.77:0/2671608964 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9403cb60 con 0x7f7d84003970 2023-11-26T07:17:32.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.724+0000 7f7d9fb01640 1 -- 172.21.15.77:0/2671608964 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d98148500 con 0x7f7d84003970 2023-11-26T07:17:32.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.725+0000 7f7d9fb01640 1 -- 172.21.15.77:0/2671608964 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d981487b0 con 0x7f7d84003970 2023-11-26T07:17:32.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.726+0000 7f7d8a7fc640 1 -- 172.21.15.77:0/2671608964 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d9403ccc0 con 0x7f7d84003970 2023-11-26T07:17:32.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.727+0000 7f7d8a7fc640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7d7c06ae70 0x7f7d7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.727+0000 7f7d8a7fc640 1 -- 172.21.15.77:0/2671608964 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d940ab090 con 0x7f7d84003970 2023-11-26T07:17:32.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.727+0000 7f7d9d09c640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7d7c06ae70 0x7f7d7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.728+0000 7f7d9d09c640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7d7c06ae70 0x7f7d7c06d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c001eb0 tx=0x7f7d8c0014e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.731+0000 7f7d8a7fc640 1 -- 172.21.15.77:0/2671608964 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7d94076480 con 0x7f7d84003970 2023-11-26T07:17:32.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:32.926+0000 7f7d9fb01640 1 -- 172.21.15.77:0/2671608964 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7d98067470 con 0x7f7d84003970 2023-11-26T07:17:33.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.219+0000 7f7d8a7fc640 1 -- 172.21.15.77:0/2671608964 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7d94079aa0 con 0x7f7d84003970 2023-11-26T07:17:33.221 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-11-26T07:17:33.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.223+0000 7f7d9fb01640 1 -- 172.21.15.77:0/2671608964 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7d7c06ae70 msgr2=0x7f7d7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.223+0000 7f7d9fb01640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7d7c06ae70 0x7f7d7c06d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c001eb0 tx=0x7f7d8c0014e0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.223+0000 7f7d9fb01640 1 -- 172.21.15.77:0/2671608964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 msgr2=0x7f7d98149b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.223+0000 7f7d9fb01640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 0x7f7d98149b00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d9402bdf0 tx=0x7f7d94004730 comp rx=0 tx=0).stop 2023-11-26T07:17:33.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.223+0000 7f7d9fb01640 1 -- 172.21.15.77:0/2671608964 shutdown_connections 2023-11-26T07:17:33.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.223+0000 7f7d9fb01640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7d7c06ae70 0x7f7d7c06d330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.223+0000 7f7d9fb01640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d98154f60 0x7f7d9814a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.223+0000 7f7d9fb01640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d98154ae0 0x7f7d98147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.223+0000 7f7d9fb01640 1 --2- 172.21.15.77:0/2671608964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d84003970 0x7f7d98149b00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.223+0000 7f7d9fb01640 1 -- 172.21.15.77:0/2671608964 >> 172.21.15.77:0/2671608964 conn(0x7f7d9806a920 msgr2=0x7f7d9815f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:33.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.224+0000 7f7d9fb01640 1 -- 172.21.15.77:0/2671608964 shutdown_connections 2023-11-26T07:17:33.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.224+0000 7f7d9fb01640 1 -- 172.21.15.77:0/2671608964 wait complete. 2023-11-26T07:17:33.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:17:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.456+0000 7ff6ddbfc640 1 Processor -- start 2023-11-26T07:17:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.456+0000 7ff6ddbfc640 1 -- start start 2023-11-26T07:17:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.458+0000 7ff6ddbfc640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff6d80c59b0 0x7ff6d8166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.458+0000 7ff6ddbfc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80c5dc0 con 0x7ff6d815b440 2023-11-26T07:17:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.458+0000 7ff6ddbfc640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d815eea0 con 0x7ff6d80cc0f0 2023-11-26T07:17:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.458+0000 7ff6ddbfc640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d815b820 con 0x7ff6d80c59b0 2023-11-26T07:17:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.458+0000 7ff6d77fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff6d815b440 0x7ff6d80cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46278/0 (socket says 172.21.15.77:46278) 2023-11-26T07:17:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.459+0000 7ff6d77fe640 1 -- 172.21.15.77:0/1934445230 learned_addr learned my addr 172.21.15.77:0/1934445230 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.459+0000 7ff6d7fff640 1 --2- 172.21.15.77:0/1934445230 >> v2:172.21.15.159:3300/0 conn(0x7ff6d80c59b0 0x7ff6d8166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.459+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250762923 0 0) 0x7ff6d80c5dc0 con 0x7ff6d815b440 2023-11-26T07:17:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.459+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6c0003520 con 0x7ff6d815b440 2023-11-26T07:17:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.459+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 167817021 0 0) 0x7ff6c0003520 con 0x7ff6d815b440 2023-11-26T07:17:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.459+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 >> v2:172.21.15.159:3300/0 conn(0x7ff6d80c59b0 msgr2=0x7ff6d8166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.459+0000 7ff6d67fc640 1 --2- 172.21.15.77:0/1934445230 >> v2:172.21.15.159:3300/0 conn(0x7ff6d80c59b0 0x7ff6d8166230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.459+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 >> v1:172.21.15.159:6789/0 conn(0x7ff6d80cc0f0 legacy=0x7ff6d80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.459+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d806d600 con 0x7ff6d815b440 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.459+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7ff6c8001670 con 0x7ff6d815b440 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.459+0000 7ff6d7fff640 1 --2- 172.21.15.77:0/1934445230 >> v2:172.21.15.159:3300/0 conn(0x7ff6d80c59b0 0x7ff6d8166230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 >> v1:172.21.15.77:6789/0 conn(0x7ff6d815b440 legacy=0x7ff6d80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d67fc640 1 --2- 172.21.15.77:0/1934445230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 0x7ff6c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d67fc640 1 --2- 172.21.15.77:0/1934445230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c00047c0 0x7ff6c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d67fc640 1 --2- 172.21.15.77:0/1934445230 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6c00052a0 0x7ff6c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d815b820 con 0x7ff6c0003970 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c000c170 con 0x7ff6c00047c0 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c000c330 con 0x7ff6c00052a0 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d77fe640 1 --2- 172.21.15.77:0/1934445230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 0x7ff6c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d77fe640 1 -- 172.21.15.77:0/1934445230 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6c00052a0 msgr2=0x7ff6c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:33.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d77fe640 1 --2- 172.21.15.77:0/1934445230 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6c00052a0 0x7ff6c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d77fe640 1 -- 172.21.15.77:0/1934445230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c00047c0 msgr2=0x7ff6c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:33.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d77fe640 1 --2- 172.21.15.77:0/1934445230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c00047c0 0x7ff6c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d77fe640 1 -- 172.21.15.77:0/1934445230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0003520 con 0x7ff6c0003970 2023-11-26T07:17:33.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.460+0000 7ff6d7fff640 1 -- 172.21.15.77:0/1934445230 reap_dead start 2023-11-26T07:17:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.461+0000 7ff6d77fe640 1 --2- 172.21.15.77:0/1934445230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 0x7ff6c0003d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8007fd0 tx=0x7ff6c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6385833b16c0ce62 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.462+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8005ad0 con 0x7ff6c0003970 2023-11-26T07:17:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.462+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c8005c30 con 0x7ff6c0003970 2023-11-26T07:17:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.462+0000 7ff6d67fc640 1 -- 172.21.15.77:0/1934445230 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c802ca90 con 0x7ff6c0003970 2023-11-26T07:17:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.462+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/1934445230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 msgr2=0x7ff6c0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.462+0000 7ff6ddbfc640 1 --2- 172.21.15.77:0/1934445230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 0x7ff6c0003d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8007fd0 tx=0x7ff6c00057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.462+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/1934445230 shutdown_connections 2023-11-26T07:17:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.462+0000 7ff6ddbfc640 1 --2- 172.21.15.77:0/1934445230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 0x7ff6c0003d90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.462+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/1934445230 >> 172.21.15.77:0/1934445230 conn(0x7ff6d80b0c50 msgr2=0x7ff6d80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:33.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.462+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/1934445230 shutdown_connections 2023-11-26T07:17:33.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.462+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/1934445230 wait complete. 2023-11-26T07:17:33.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.464+0000 7ff6ddbfc640 1 Processor -- start 2023-11-26T07:17:33.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.464+0000 7ff6ddbfc640 1 -- start start 2023-11-26T07:17:33.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.465+0000 7ff6ddbfc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 0x7ff6d80c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.465+0000 7ff6ddbfc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d80cd710 0x7ff6d81564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.465+0000 7ff6ddbfc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6d81569e0 0x7ff6d815bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.465+0000 7ff6ddbfc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80c7100 con 0x7ff6c0003970 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.465+0000 7ff6ddbfc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80c73e0 con 0x7ff6d80cd710 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.465+0000 7ff6ddbfc640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80c76c0 con 0x7ff6d81569e0 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.465+0000 7ff6d77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 0x7ff6d80c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.465+0000 7ff6d77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 0x7ff6d80c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37634/0 (socket says 172.21.15.77:37634) 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.465+0000 7ff6d77fe640 1 -- 172.21.15.77:0/2133649354 learned_addr learned my addr 172.21.15.77:0/2133649354 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.466+0000 7ff6d77fe640 1 -- 172.21.15.77:0/2133649354 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6d81569e0 msgr2=0x7ff6d815bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.466+0000 7ff6d77fe640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6d81569e0 0x7ff6d815bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.466+0000 7ff6d77fe640 1 -- 172.21.15.77:0/2133649354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d80cd710 msgr2=0x7ff6d81564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.466+0000 7ff6d77fe640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d80cd710 0x7ff6d81564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.466+0000 7ff6d77fe640 1 -- 172.21.15.77:0/2133649354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d80c79a0 con 0x7ff6c0003970 2023-11-26T07:17:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.466+0000 7ff6d77fe640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 0x7ff6d80c6ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009000 tx=0x7ff6c802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.466+0000 7ff6bffff640 1 -- 172.21.15.77:0/2133649354 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c803c040 con 0x7ff6c0003970 2023-11-26T07:17:33.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.466+0000 7ff6bffff640 1 -- 172.21.15.77:0/2133649354 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c802cd20 con 0x7ff6c0003970 2023-11-26T07:17:33.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.466+0000 7ff6bffff640 1 -- 172.21.15.77:0/2133649354 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80072b0 con 0x7ff6c0003970 2023-11-26T07:17:33.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.466+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/2133649354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d80c7c80 con 0x7ff6c0003970 2023-11-26T07:17:33.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.467+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/2133649354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d815c280 con 0x7ff6c0003970 2023-11-26T07:17:33.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.467+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/2133649354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d80c7e10 con 0x7ff6c0003970 2023-11-26T07:17:33.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.469+0000 7ff6bffff640 1 -- 172.21.15.77:0/2133649354 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6c8032070 con 0x7ff6c0003970 2023-11-26T07:17:33.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.470+0000 7ff6bffff640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff6c406ae40 0x7ff6c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.470+0000 7ff6bffff640 1 -- 172.21.15.77:0/2133649354 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff6c80aa960 con 0x7ff6c0003970 2023-11-26T07:17:33.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.470+0000 7ff6d6ffd640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff6c406ae40 0x7ff6c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.471+0000 7ff6d6ffd640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff6c406ae40 0x7ff6c406d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80cd610 tx=0x7ff6cc0079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.474+0000 7ff6bffff640 1 -- 172.21.15.77:0/2133649354 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff6c8075b40 con 0x7ff6c0003970 2023-11-26T07:17:33.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:33.670+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/2133649354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff6d804e8b0 con 0x7ff6c0003970 2023-11-26T07:17:34.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.226+0000 7ff6bffff640 1 -- 172.21.15.77:0/2133649354 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff6c8046070 con 0x7ff6c0003970 2023-11-26T07:17:34.227 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-11-26T07:17:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.230+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/2133649354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff6c406ae40 msgr2=0x7ff6c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.230+0000 7ff6ddbfc640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff6c406ae40 0x7ff6c406d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80cd610 tx=0x7ff6cc0079d0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.230+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/2133649354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 msgr2=0x7ff6d80c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.230+0000 7ff6ddbfc640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 0x7ff6d80c6ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009000 tx=0x7ff6c802e070 comp rx=0 tx=0).stop 2023-11-26T07:17:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.230+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/2133649354 shutdown_connections 2023-11-26T07:17:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.230+0000 7ff6ddbfc640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff6c406ae40 0x7ff6c406d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.230+0000 7ff6ddbfc640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6d81569e0 0x7ff6d815bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.230+0000 7ff6ddbfc640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d80cd710 0x7ff6d81564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.230+0000 7ff6ddbfc640 1 --2- 172.21.15.77:0/2133649354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c0003970 0x7ff6d80c6ae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.230+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/2133649354 >> 172.21.15.77:0/2133649354 conn(0x7ff6d80b0c50 msgr2=0x7ff6d80cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.231+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/2133649354 shutdown_connections 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.231+0000 7ff6ddbfc640 1 -- 172.21.15.77:0/2133649354 wait complete. 2023-11-26T07:17:34.267 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:17:34.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.451+0000 7f27e4551640 1 Processor -- start 2023-11-26T07:17:34.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.451+0000 7f27e4551640 1 -- start start 2023-11-26T07:17:34.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.452+0000 7f27e4551640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27dc072160 0x7f27dc15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.452+0000 7f27e4551640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f27dc0c49f0 0x7f27dc06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.452+0000 7f27e4551640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f27dc06dc40 0x7f27dc0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.452+0000 7f27e4551640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27dc06e0f0 con 0x7f27dc06dc40 2023-11-26T07:17:34.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.452+0000 7f27e4551640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27dc15ec90 con 0x7f27dc0c49f0 2023-11-26T07:17:34.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.452+0000 7f27e4551640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0cd530 con 0x7f27dc072160 2023-11-26T07:17:34.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.453+0000 7f27e2aee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f27dc06dc40 0x7f27dc0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.453+0000 7f27e2aee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f27dc06dc40 0x7f27dc0cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37642/0 (socket says 172.21.15.77:37642) 2023-11-26T07:17:34.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.453+0000 7f27e2aee640 1 -- 172.21.15.77:0/2274137211 learned_addr learned my addr 172.21.15.77:0/2274137211 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:34.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.453+0000 7f27e22ed640 1 --2- 172.21.15.77:0/2274137211 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27dc072160 0x7f27dc15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.453+0000 7f27e1aec640 1 --2- 172.21.15.77:0/2274137211 >> v2:172.21.15.159:3300/0 conn(0x7f27dc0c49f0 0x7f27dc06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.453+0000 7f27e2aee640 1 -- 172.21.15.77:0/2274137211 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27dc072160 msgr2=0x7f27dc15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:34.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.453+0000 7f27e2aee640 1 --2- 172.21.15.77:0/2274137211 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27dc072160 0x7f27dc15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.453+0000 7f27e2aee640 1 -- 172.21.15.77:0/2274137211 >> v2:172.21.15.159:3300/0 conn(0x7f27dc0c49f0 msgr2=0x7f27dc06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:34.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.453+0000 7f27e2aee640 1 --2- 172.21.15.77:0/2274137211 >> v2:172.21.15.159:3300/0 conn(0x7f27dc0c49f0 0x7f27dc06d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.453+0000 7f27e2aee640 1 -- 172.21.15.77:0/2274137211 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc0c4ed0 con 0x7f27dc06dc40 2023-11-26T07:17:34.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.453+0000 7f27e1aec640 1 --2- 172.21.15.77:0/2274137211 >> v2:172.21.15.159:3300/0 conn(0x7f27dc0c49f0 0x7f27dc06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.454+0000 7f27e2aee640 1 --2- 172.21.15.77:0/2274137211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27dc06dc40 0x7f27dc0cd750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0ccb10 tx=0x7f27d402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98f7c15affc3df4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e12eb640 1 -- 172.21.15.77:0/2274137211 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d402ea80 con 0x7f27dc06dc40 2023-11-26T07:17:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e12eb640 1 -- 172.21.15.77:0/2274137211 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d402ebe0 con 0x7f27dc06dc40 2023-11-26T07:17:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e12eb640 1 -- 172.21.15.77:0/2274137211 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4009600 con 0x7f27dc06dc40 2023-11-26T07:17:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e4551640 1 -- 172.21.15.77:0/2274137211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27dc06dc40 msgr2=0x7f27dc0cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e4551640 1 --2- 172.21.15.77:0/2274137211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27dc06dc40 0x7f27dc0cd750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0ccb10 tx=0x7f27d402e0e0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e4551640 1 -- 172.21.15.77:0/2274137211 shutdown_connections 2023-11-26T07:17:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e4551640 1 --2- 172.21.15.77:0/2274137211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27dc06dc40 0x7f27dc0cd750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e4551640 1 --2- 172.21.15.77:0/2274137211 >> v2:172.21.15.159:3300/0 conn(0x7f27dc0c49f0 0x7f27dc06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e4551640 1 --2- 172.21.15.77:0/2274137211 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27dc072160 0x7f27dc15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e4551640 1 -- 172.21.15.77:0/2274137211 >> 172.21.15.77:0/2274137211 conn(0x7f27dc0b0c50 msgr2=0x7f27dc0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e4551640 1 -- 172.21.15.77:0/2274137211 shutdown_connections 2023-11-26T07:17:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.455+0000 7f27e4551640 1 -- 172.21.15.77:0/2274137211 wait complete. 2023-11-26T07:17:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.457+0000 7f27e4551640 1 Processor -- start 2023-11-26T07:17:34.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.457+0000 7f27e4551640 1 -- start start 2023-11-26T07:17:34.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.458+0000 7f27e4551640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27dc06dc40 0x7f27dc152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.458+0000 7f27e4551640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27dc072160 0x7f27dc0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.458+0000 7f27e4551640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27dc0c49f0 0x7f27dc0cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.458+0000 7f27e4551640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc152e80 con 0x7f27dc06dc40 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.458+0000 7f27e4551640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0cbc20 con 0x7f27dc072160 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.458+0000 7f27e4551640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0cb010 con 0x7f27dc0c49f0 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.458+0000 7f27e22ed640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27dc06dc40 0x7f27dc152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27e22ed640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27dc06dc40 0x7f27dc152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37652/0 (socket says 172.21.15.77:37652) 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27e22ed640 1 -- 172.21.15.77:0/3745494973 learned_addr learned my addr 172.21.15.77:0/3745494973 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27e22ed640 1 -- 172.21.15.77:0/3745494973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27dc0c49f0 msgr2=0x7f27dc0cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27e22ed640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27dc0c49f0 0x7f27dc0cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27e22ed640 1 -- 172.21.15.77:0/3745494973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27dc072160 msgr2=0x7f27dc0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27e22ed640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27dc072160 0x7f27dc0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27e22ed640 1 -- 172.21.15.77:0/3745494973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d400bd40 con 0x7f27dc06dc40 2023-11-26T07:17:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27e22ed640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27dc06dc40 0x7f27dc152940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27d800d800 tx=0x7f27d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27d2ffd640 1 -- 172.21.15.77:0/3745494973 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80096a0 con 0x7f27dc06dc40 2023-11-26T07:17:34.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27d2ffd640 1 -- 172.21.15.77:0/3745494973 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8009800 con 0x7f27dc06dc40 2023-11-26T07:17:34.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27d2ffd640 1 -- 172.21.15.77:0/3745494973 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8009b90 con 0x7f27dc06dc40 2023-11-26T07:17:34.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.459+0000 7f27e4551640 1 -- 172.21.15.77:0/3745494973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc0cb2f0 con 0x7f27dc06dc40 2023-11-26T07:17:34.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.460+0000 7f27e4551640 1 -- 172.21.15.77:0/3745494973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27dc0cb8b0 con 0x7f27dc06dc40 2023-11-26T07:17:34.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.461+0000 7f27e4551640 1 -- 172.21.15.77:0/3745494973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27dc04e8b0 con 0x7f27dc06dc40 2023-11-26T07:17:34.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.462+0000 7f27d2ffd640 1 -- 172.21.15.77:0/3745494973 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27d8009cf0 con 0x7f27dc06dc40 2023-11-26T07:17:34.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.463+0000 7f27d2ffd640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f27c006ae40 0x7f27c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.463+0000 7f27d2ffd640 1 -- 172.21.15.77:0/3745494973 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f27d8089a00 con 0x7f27dc06dc40 2023-11-26T07:17:34.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.463+0000 7f27e1aec640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f27c006ae40 0x7f27c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.464+0000 7f27e1aec640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f27c006ae40 0x7f27c006d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f27cc006fd0 tx=0x7f27cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.468+0000 7f27d2ffd640 1 -- 172.21.15.77:0/3745494973 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f27d8054b80 con 0x7f27dc06dc40 2023-11-26T07:17:34.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:34.697+0000 7f27e4551640 1 -- 172.21.15.77:0/3745494973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f27dc15dab0 con 0x7f27dc06dc40 2023-11-26T07:17:35.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.273+0000 7f27d2ffd640 1 -- 172.21.15.77:0/3745494973 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f27d800b440 con 0x7f27dc06dc40 2023-11-26T07:17:35.276 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 2 and data pool 3 2023-11-26T07:17:35.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.282+0000 7f27e4551640 1 -- 172.21.15.77:0/3745494973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f27c006ae40 msgr2=0x7f27c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.282+0000 7f27e4551640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f27c006ae40 0x7f27c006d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f27cc006fd0 tx=0x7f27cc008040 comp rx=0 tx=0).stop 2023-11-26T07:17:35.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.282+0000 7f27e4551640 1 -- 172.21.15.77:0/3745494973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27dc06dc40 msgr2=0x7f27dc152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.282+0000 7f27e4551640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27dc06dc40 0x7f27dc152940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27d800d800 tx=0x7f27d800dcc0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.283+0000 7f27e4551640 1 -- 172.21.15.77:0/3745494973 shutdown_connections 2023-11-26T07:17:35.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.283+0000 7f27e4551640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f27c006ae40 0x7f27c006d300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.283+0000 7f27e4551640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27dc0c49f0 0x7f27dc0cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.283+0000 7f27e4551640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27dc072160 0x7f27dc0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.283+0000 7f27e4551640 1 --2- 172.21.15.77:0/3745494973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27dc06dc40 0x7f27dc152940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.283+0000 7f27e4551640 1 -- 172.21.15.77:0/3745494973 >> 172.21.15.77:0/3745494973 conn(0x7f27dc0b0c50 msgr2=0x7f27dc0abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:35.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.283+0000 7f27e4551640 1 -- 172.21.15.77:0/3745494973 shutdown_connections 2023-11-26T07:17:35.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.284+0000 7f27e4551640 1 -- 172.21.15.77:0/3745494973 wait complete. 2023-11-26T07:17:35.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.498+0000 7f0637301640 1 Processor -- start 2023-11-26T07:17:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.498+0000 7f0637301640 1 -- start start 2023-11-26T07:17:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.500+0000 7f0637301640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f063015df80 0x7f06300ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.500+0000 7f0637301640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f06300cd470 0x7f063015b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.500+0000 7f0637301640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063015e3f0 con 0x7f06300b2250 2023-11-26T07:17:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.500+0000 7f0637301640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063015a990 con 0x7f063015df80 2023-11-26T07:17:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.500+0000 7f0637301640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063015ab80 con 0x7f06300cd470 2023-11-26T07:17:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.500+0000 7f063489c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f063015df80 0x7f06300ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.500+0000 7f063489c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f063015df80 0x7f06300ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37664/0 (socket says 172.21.15.77:37664) 2023-11-26T07:17:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.500+0000 7f063489c640 1 -- 172.21.15.77:0/1581290179 learned_addr learned my addr 172.21.15.77:0/1581290179 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:35.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.501+0000 7f063589e640 1 --2- 172.21.15.77:0/1581290179 >> v2:172.21.15.159:3300/0 conn(0x7f06300cd470 0x7f063015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.501+0000 7f063489c640 1 -- 172.21.15.77:0/1581290179 >> v2:172.21.15.159:3300/0 conn(0x7f06300cd470 msgr2=0x7f063015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:35.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.501+0000 7f063489c640 1 --2- 172.21.15.77:0/1581290179 >> v2:172.21.15.159:3300/0 conn(0x7f06300cd470 0x7f063015b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.501+0000 7f063489c640 1 -- 172.21.15.77:0/1581290179 >> v1:172.21.15.77:6789/0 conn(0x7f06300b2250 legacy=0x7f06300b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.501+0000 7f063489c640 1 -- 172.21.15.77:0/1581290179 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300b2d40 con 0x7f063015df80 2023-11-26T07:17:35.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.502+0000 7f063489c640 1 --2- 172.21.15.77:0/1581290179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063015df80 0x7f06300ccf30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f06300b2fa0 tx=0x7f062c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab29e3f1e9da07d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.502+0000 7f0627fff640 1 -- 172.21.15.77:0/1581290179 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c030860 con 0x7f063015df80 2023-11-26T07:17:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.502+0000 7f0627fff640 1 -- 172.21.15.77:0/1581290179 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c0309c0 con 0x7f063015df80 2023-11-26T07:17:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.502+0000 7f0627fff640 1 -- 172.21.15.77:0/1581290179 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c030d50 con 0x7f063015df80 2023-11-26T07:17:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.503+0000 7f0637301640 1 -- 172.21.15.77:0/1581290179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063015df80 msgr2=0x7f06300ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.503+0000 7f0637301640 1 --2- 172.21.15.77:0/1581290179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063015df80 0x7f06300ccf30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f06300b2fa0 tx=0x7f062c02b9a0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.503+0000 7f0637301640 1 -- 172.21.15.77:0/1581290179 shutdown_connections 2023-11-26T07:17:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.503+0000 7f0637301640 1 --2- 172.21.15.77:0/1581290179 >> v2:172.21.15.159:3300/0 conn(0x7f06300cd470 0x7f063015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.503+0000 7f0637301640 1 --2- 172.21.15.77:0/1581290179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063015df80 0x7f06300ccf30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.503+0000 7f0637301640 1 -- 172.21.15.77:0/1581290179 >> 172.21.15.77:0/1581290179 conn(0x7f063006a920 msgr2=0x7f063006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.503+0000 7f0637301640 1 -- 172.21.15.77:0/1581290179 shutdown_connections 2023-11-26T07:17:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.503+0000 7f0637301640 1 -- 172.21.15.77:0/1581290179 wait complete. 2023-11-26T07:17:35.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.505+0000 7f0637301640 1 Processor -- start 2023-11-26T07:17:35.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.505+0000 7f0637301640 1 -- start start 2023-11-26T07:17:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f0637301640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06300b2250 0x7f063014a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f0637301640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06300cd470 0x7f0630071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f0637301640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063015df80 0x7f0630071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f0637301640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630153a00 con 0x7f063015df80 2023-11-26T07:17:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f0637301640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063014a930 con 0x7f06300b2250 2023-11-26T07:17:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f0637301640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06300ca080 con 0x7f06300cd470 2023-11-26T07:17:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f063589e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063015df80 0x7f0630071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f063589e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063015df80 0x7f0630071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37666/0 (socket says 172.21.15.77:37666) 2023-11-26T07:17:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f063589e640 1 -- 172.21.15.77:0/2904224584 learned_addr learned my addr 172.21.15.77:0/2904224584 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f063589e640 1 -- 172.21.15.77:0/2904224584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06300cd470 msgr2=0x7f0630071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f063589e640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06300cd470 0x7f0630071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f063589e640 1 -- 172.21.15.77:0/2904224584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06300b2250 msgr2=0x7f063014a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.506+0000 7f063589e640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06300b2250 0x7f063014a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.507+0000 7f063589e640 1 -- 172.21.15.77:0/2904224584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c0094d0 con 0x7f063015df80 2023-11-26T07:17:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.507+0000 7f063589e640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063015df80 0x7f0630071b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0628009ea0 tx=0x7f0628009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.507+0000 7f0625ffb640 1 -- 172.21.15.77:0/2904224584 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628010070 con 0x7f063015df80 2023-11-26T07:17:35.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.507+0000 7f0625ffb640 1 -- 172.21.15.77:0/2904224584 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062800b250 con 0x7f063015df80 2023-11-26T07:17:35.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.507+0000 7f0625ffb640 1 -- 172.21.15.77:0/2904224584 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800b3c0 con 0x7f063015df80 2023-11-26T07:17:35.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.507+0000 7f0637301640 1 -- 172.21.15.77:0/2904224584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06300c8fe0 con 0x7f063015df80 2023-11-26T07:17:35.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.507+0000 7f0637301640 1 -- 172.21.15.77:0/2904224584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06300c95a0 con 0x7f063015df80 2023-11-26T07:17:35.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.508+0000 7f0637301640 1 -- 172.21.15.77:0/2904224584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0630067470 con 0x7f063015df80 2023-11-26T07:17:35.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.509+0000 7f0625ffb640 1 -- 172.21.15.77:0/2904224584 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0628014030 con 0x7f063015df80 2023-11-26T07:17:35.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.510+0000 7f0625ffb640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f061c06ae70 0x7f061c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.510+0000 7f0625ffb640 1 -- 172.21.15.77:0/2904224584 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0628089270 con 0x7f063015df80 2023-11-26T07:17:35.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.510+0000 7f063509d640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f061c06ae70 0x7f061c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.511+0000 7f063509d640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f061c06ae70 0x7f061c06d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0620000f60 tx=0x7f06200079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.515+0000 7f0625ffb640 1 -- 172.21.15.77:0/2904224584 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06280543b0 con 0x7f063015df80 2023-11-26T07:17:35.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.708+0000 7f0637301640 1 -- 172.21.15.77:0/2904224584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06300cb250 con 0x7f063015df80 2023-11-26T07:17:35.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.710+0000 7f0625ffb640 1 -- 172.21.15.77:0/2904224584 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16494 (secure 0 0 0) 0x7f06280579d0 con 0x7f063015df80 2023-11-26T07:17:35.712 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:35.712 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:34.698890+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:35.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.712+0000 7f0637301640 1 -- 172.21.15.77:0/2904224584 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f061c06ae70 msgr2=0x7f061c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.712+0000 7f0637301640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f061c06ae70 0x7f061c06d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0620000f60 tx=0x7f06200079b0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.712+0000 7f0637301640 1 -- 172.21.15.77:0/2904224584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063015df80 msgr2=0x7f0630071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.712+0000 7f0637301640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063015df80 0x7f0630071b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0628009ea0 tx=0x7f0628009f90 comp rx=0 tx=0).stop 2023-11-26T07:17:35.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.712+0000 7f0637301640 1 -- 172.21.15.77:0/2904224584 shutdown_connections 2023-11-26T07:17:35.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.712+0000 7f0637301640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f061c06ae70 0x7f061c06d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.712+0000 7f0637301640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063015df80 0x7f0630071b50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.712+0000 7f0637301640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06300cd470 0x7f0630071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.712+0000 7f0637301640 1 --2- 172.21.15.77:0/2904224584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06300b2250 0x7f063014a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.712+0000 7f0637301640 1 -- 172.21.15.77:0/2904224584 >> 172.21.15.77:0/2904224584 conn(0x7f063006a920 msgr2=0x7f06300b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:35.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.713+0000 7f0637301640 1 -- 172.21.15.77:0/2904224584 shutdown_connections 2023-11-26T07:17:35.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.713+0000 7f0637301640 1 -- 172.21.15.77:0/2904224584 wait complete. 2023-11-26T07:17:35.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:35.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.936+0000 7f5d54b33640 1 Processor -- start 2023-11-26T07:17:35.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.936+0000 7f5d54b33640 1 -- start start 2023-11-26T07:17:35.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.937+0000 7f5d54b33640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d5015c7f0 0x7f5d5006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.938+0000 7f5d54b33640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5d500ce6c0 0x7f5d500cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.938+0000 7f5d54b33640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d500cece0 con 0x7f5d500cf450 2023-11-26T07:17:35.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.938+0000 7f5d54b33640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d50156010 con 0x7f5d500ce6c0 2023-11-26T07:17:35.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.938+0000 7f5d54b33640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5006ce30 con 0x7f5d5015c7f0 2023-11-26T07:17:35.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.938+0000 7f5d4ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5d500ce6c0 0x7f5d500cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.938+0000 7f5d4ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5d500ce6c0 0x7f5d500cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34566/0 (socket says 172.21.15.77:34566) 2023-11-26T07:17:35.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.938+0000 7f5d4ed9d640 1 -- 172.21.15.77:0/2692747041 learned_addr learned my addr 172.21.15.77:0/2692747041 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:35.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.938+0000 7f5d4ed9d640 1 -- 172.21.15.77:0/2692747041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d5015c7f0 msgr2=0x7f5d5006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:35.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.938+0000 7f5d4ed9d640 1 --2- 172.21.15.77:0/2692747041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d5015c7f0 0x7f5d5006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.938+0000 7f5d4ed9d640 1 -- 172.21.15.77:0/2692747041 >> v1:172.21.15.159:6789/0 conn(0x7f5d500cf450 legacy=0x7f5d500cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:35.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.938+0000 7f5d4ed9d640 1 -- 172.21.15.77:0/2692747041 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5006d040 con 0x7f5d500ce6c0 2023-11-26T07:17:35.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.940+0000 7f5d4ed9d640 1 --2- 172.21.15.77:0/2692747041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d500ce6c0 0x7f5d500cf8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009e50 tx=0x7f5d4802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eee052cdd75400a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.940+0000 7f5d4d59a640 1 -- 172.21.15.77:0/2692747041 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4802ca70 con 0x7f5d500ce6c0 2023-11-26T07:17:35.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.940+0000 7f5d4d59a640 1 -- 172.21.15.77:0/2692747041 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4802cbd0 con 0x7f5d500ce6c0 2023-11-26T07:17:35.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.940+0000 7f5d4d59a640 1 -- 172.21.15.77:0/2692747041 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d480343f0 con 0x7f5d500ce6c0 2023-11-26T07:17:35.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.941+0000 7f5d54b33640 1 -- 172.21.15.77:0/2692747041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d500ce6c0 msgr2=0x7f5d500cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.941+0000 7f5d54b33640 1 --2- 172.21.15.77:0/2692747041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d500ce6c0 0x7f5d500cf8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009e50 tx=0x7f5d4802bed0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.941+0000 7f5d54b33640 1 -- 172.21.15.77:0/2692747041 shutdown_connections 2023-11-26T07:17:35.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.941+0000 7f5d54b33640 1 --2- 172.21.15.77:0/2692747041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d500ce6c0 0x7f5d500cf8d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.941+0000 7f5d54b33640 1 --2- 172.21.15.77:0/2692747041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d5015c7f0 0x7f5d5006db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.941+0000 7f5d54b33640 1 -- 172.21.15.77:0/2692747041 >> 172.21.15.77:0/2692747041 conn(0x7f5d5006a920 msgr2=0x7f5d5006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:35.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.941+0000 7f5d54b33640 1 -- 172.21.15.77:0/2692747041 shutdown_connections 2023-11-26T07:17:35.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.941+0000 7f5d54b33640 1 -- 172.21.15.77:0/2692747041 wait complete. 2023-11-26T07:17:35.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.943+0000 7f5d54b33640 1 Processor -- start 2023-11-26T07:17:35.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.943+0000 7f5d54b33640 1 -- start start 2023-11-26T07:17:35.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d54b33640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d500ce6c0 0x7f5d501f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d54b33640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d500cf450 0x7f5d501f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d54b33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d5015c7f0 0x7f5d50150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d54b33640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500ad510 con 0x7f5d5015c7f0 2023-11-26T07:17:35.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d54b33640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d501f4370 con 0x7f5d500cf450 2023-11-26T07:17:35.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d54b33640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500ad230 con 0x7f5d500ce6c0 2023-11-26T07:17:35.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d4ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d5015c7f0 0x7f5d50150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d4ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d5015c7f0 0x7f5d50150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34574/0 (socket says 172.21.15.77:34574) 2023-11-26T07:17:35.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d4ed9d640 1 -- 172.21.15.77:0/890866839 learned_addr learned my addr 172.21.15.77:0/890866839 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d4dd9b640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d500cf450 0x7f5d501f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d4e59c640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d500ce6c0 0x7f5d501f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d4ed9d640 1 -- 172.21.15.77:0/890866839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d500ce6c0 msgr2=0x7f5d501f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d4ed9d640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d500ce6c0 0x7f5d501f45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d4ed9d640 1 -- 172.21.15.77:0/890866839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d500cf450 msgr2=0x7f5d501f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d4ed9d640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d500cf450 0x7f5d501f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d4ed9d640 1 -- 172.21.15.77:0/890866839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d48009b30 con 0x7f5d5015c7f0 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.944+0000 7f5d4dd9b640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d500cf450 0x7f5d501f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.945+0000 7f5d4ed9d640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d5015c7f0 0x7f5d50150e70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d48036040 tx=0x7f5d48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.945+0000 7f5d3effd640 1 -- 172.21.15.77:0/890866839 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48009510 con 0x7f5d5015c7f0 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.945+0000 7f5d3effd640 1 -- 172.21.15.77:0/890866839 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4803e450 con 0x7f5d5015c7f0 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.945+0000 7f5d3effd640 1 -- 172.21.15.77:0/890866839 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4803e800 con 0x7f5d5015c7f0 2023-11-26T07:17:35.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.945+0000 7f5d54b33640 1 -- 172.21.15.77:0/890866839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d500b22b0 con 0x7f5d5015c7f0 2023-11-26T07:17:35.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.945+0000 7f5d54b33640 1 -- 172.21.15.77:0/890866839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d500b2870 con 0x7f5d5015c7f0 2023-11-26T07:17:35.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.946+0000 7f5d54b33640 1 -- 172.21.15.77:0/890866839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d500b2110 con 0x7f5d5015c7f0 2023-11-26T07:17:35.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.947+0000 7f5d3effd640 1 -- 172.21.15.77:0/890866839 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d4803e960 con 0x7f5d5015c7f0 2023-11-26T07:17:35.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.948+0000 7f5d3effd640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d3006ae40 0x7f5d3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.948+0000 7f5d3effd640 1 -- 172.21.15.77:0/890866839 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d480ac4d0 con 0x7f5d5015c7f0 2023-11-26T07:17:35.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.948+0000 7f5d4e59c640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d3006ae40 0x7f5d3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.949+0000 7f5d4e59c640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d3006ae40 0x7f5d3006d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000a770 tx=0x7f5d40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:35.953+0000 7f5d3effd640 1 -- 172.21.15.77:0/890866839 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d500b2110 con 0x7f5d5015c7f0 2023-11-26T07:17:36.051 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-11-26T07:17:36.049+0000 7ff03db4f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:17:36.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.144+0000 7f5d54b33640 1 -- 172.21.15.77:0/890866839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d500b2110 con 0x7f5d5015c7f0 2023-11-26T07:17:36.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.147+0000 7f5d3effd640 1 -- 172.21.15.77:0/890866839 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16494 (secure 0 0 0) 0x7f5d500b2110 con 0x7f5d5015c7f0 2023-11-26T07:17:36.149 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:36.149 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:34.698890+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.149+0000 7f5d54b33640 1 -- 172.21.15.77:0/890866839 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d3006ae40 msgr2=0x7f5d3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.149+0000 7f5d54b33640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d3006ae40 0x7f5d3006d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000a770 tx=0x7f5d40008040 comp rx=0 tx=0).stop 2023-11-26T07:17:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.149+0000 7f5d54b33640 1 -- 172.21.15.77:0/890866839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d5015c7f0 msgr2=0x7f5d50150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.149+0000 7f5d54b33640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d5015c7f0 0x7f5d50150e70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d48036040 tx=0x7f5d48004a40 comp rx=0 tx=0).stop 2023-11-26T07:17:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.149+0000 7f5d54b33640 1 -- 172.21.15.77:0/890866839 shutdown_connections 2023-11-26T07:17:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.149+0000 7f5d54b33640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d3006ae40 0x7f5d3006d300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.149+0000 7f5d54b33640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d5015c7f0 0x7f5d50150e70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.149+0000 7f5d54b33640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d500cf450 0x7f5d501f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.149+0000 7f5d54b33640 1 --2- 172.21.15.77:0/890866839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d500ce6c0 0x7f5d501f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.149+0000 7f5d54b33640 1 -- 172.21.15.77:0/890866839 >> 172.21.15.77:0/890866839 conn(0x7f5d5006a920 msgr2=0x7f5d500cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.150+0000 7f5d54b33640 1 -- 172.21.15.77:0/890866839 shutdown_connections 2023-11-26T07:17:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.150+0000 7f5d54b33640 1 -- 172.21.15.77:0/890866839 wait complete. 2023-11-26T07:17:36.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:17:36.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.394+0000 7f3ac0c9b640 1 Processor -- start 2023-11-26T07:17:36.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.394+0000 7f3ac0c9b640 1 -- start start 2023-11-26T07:17:36.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.395+0000 7f3ac0c9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3abc06d900 0x7f3abc165620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.395+0000 7f3ac0c9b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc15a810 con 0x7f3abc0b38a0 2023-11-26T07:17:36.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.395+0000 7f3ac0c9b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc06eb90 con 0x7f3abc0ae9b0 2023-11-26T07:17:36.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.395+0000 7f3ac0c9b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc06ee70 con 0x7f3abc06d900 2023-11-26T07:17:36.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.396+0000 7f3aba59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3abc0b38a0 0x7f3abc0b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54272/0 (socket says 172.21.15.77:54272) 2023-11-26T07:17:36.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.396+0000 7f3aba59c640 1 -- 172.21.15.77:0/1972691695 learned_addr learned my addr 172.21.15.77:0/1972691695 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:36.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.396+0000 7f3abad9d640 1 --2- 172.21.15.77:0/1972691695 >> v2:172.21.15.77:3300/0 conn(0x7f3abc06d900 0x7f3abc165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.396+0000 7f3ab959a640 1 -- 172.21.15.77:0/1972691695 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793874634 0 0) 0x7f3abc15a810 con 0x7f3abc0b38a0 2023-11-26T07:17:36.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.396+0000 7f3ab959a640 1 -- 172.21.15.77:0/1972691695 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa8003520 con 0x7f3abc0b38a0 2023-11-26T07:17:36.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.396+0000 7f3abad9d640 1 -- 172.21.15.77:0/1972691695 >> v1:172.21.15.159:6789/0 conn(0x7f3abc0ae9b0 legacy=0x7f3abc161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.396+0000 7f3abad9d640 1 -- 172.21.15.77:0/1972691695 >> v1:172.21.15.77:6789/0 conn(0x7f3abc0b38a0 legacy=0x7f3abc0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.396+0000 7f3abad9d640 1 -- 172.21.15.77:0/1972691695 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc06f150 con 0x7f3abc06d900 2023-11-26T07:17:36.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.397+0000 7f3abad9d640 1 --2- 172.21.15.77:0/1972691695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3abc06d900 0x7f3abc165620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40097a0 tx=0x7f3ab402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0945243f0fc5c91 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.398+0000 7f3ab959a640 1 -- 172.21.15.77:0/1972691695 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4030610 con 0x7f3abc06d900 2023-11-26T07:17:36.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.398+0000 7f3ab959a640 1 -- 172.21.15.77:0/1972691695 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4030770 con 0x7f3abc06d900 2023-11-26T07:17:36.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.398+0000 7f3ab959a640 1 -- 172.21.15.77:0/1972691695 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4030b00 con 0x7f3abc06d900 2023-11-26T07:17:36.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.398+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/1972691695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3abc06d900 msgr2=0x7f3abc165620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.398+0000 7f3ac0c9b640 1 --2- 172.21.15.77:0/1972691695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3abc06d900 0x7f3abc165620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40097a0 tx=0x7f3ab402b960 comp rx=0 tx=0).stop 2023-11-26T07:17:36.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.398+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/1972691695 shutdown_connections 2023-11-26T07:17:36.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.398+0000 7f3ac0c9b640 1 --2- 172.21.15.77:0/1972691695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3abc06d900 0x7f3abc165620 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.398+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/1972691695 >> 172.21.15.77:0/1972691695 conn(0x7f3abc06c090 msgr2=0x7f3abc0b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:36.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.398+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/1972691695 shutdown_connections 2023-11-26T07:17:36.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.399+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/1972691695 wait complete. 2023-11-26T07:17:36.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.400+0000 7f3ac0c9b640 1 Processor -- start 2023-11-26T07:17:36.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.400+0000 7f3ac0c9b640 1 -- start start 2023-11-26T07:17:36.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.401+0000 7f3ac0c9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3abc06d900 0x7f3abc15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.401+0000 7f3ac0c9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3abc0ae9b0 0x7f3abc150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.401+0000 7f3ac0c9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3abc0b38a0 0x7f3abc14f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.401+0000 7f3ac0c9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc15d230 con 0x7f3abc0b38a0 2023-11-26T07:17:36.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.401+0000 7f3ac0c9b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc15d4d0 con 0x7f3abc06d900 2023-11-26T07:17:36.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.401+0000 7f3ac0c9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc15b480 con 0x7f3abc0ae9b0 2023-11-26T07:17:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.402+0000 7f3abad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3abc0b38a0 0x7f3abc14f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.402+0000 7f3abad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3abc0b38a0 0x7f3abc14f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34590/0 (socket says 172.21.15.77:34590) 2023-11-26T07:17:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.402+0000 7f3abad9d640 1 -- 172.21.15.77:0/3275181551 learned_addr learned my addr 172.21.15.77:0/3275181551 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.402+0000 7f3aba59c640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3abc06d900 0x7f3abc15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.402+0000 7f3ab9d9b640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3abc0ae9b0 0x7f3abc150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.402+0000 7f3abad9d640 1 -- 172.21.15.77:0/3275181551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3abc0ae9b0 msgr2=0x7f3abc150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.402+0000 7f3abad9d640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3abc0ae9b0 0x7f3abc150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.402+0000 7f3abad9d640 1 -- 172.21.15.77:0/3275181551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3abc06d900 msgr2=0x7f3abc15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.402+0000 7f3abad9d640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3abc06d900 0x7f3abc15bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.402+0000 7f3abad9d640 1 -- 172.21.15.77:0/3275181551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab4009400 con 0x7f3abc0b38a0 2023-11-26T07:17:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.403+0000 7f3abad9d640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3abc0b38a0 0x7f3abc14f0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40098c0 tx=0x7f3ab4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.403+0000 7f3ab2ffd640 1 -- 172.21.15.77:0/3275181551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab403e040 con 0x7f3abc0b38a0 2023-11-26T07:17:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.403+0000 7f3ab2ffd640 1 -- 172.21.15.77:0/3275181551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4039c10 con 0x7f3abc0b38a0 2023-11-26T07:17:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.403+0000 7f3ab2ffd640 1 -- 172.21.15.77:0/3275181551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4030e10 con 0x7f3abc0b38a0 2023-11-26T07:17:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.403+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/3275181551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc15b760 con 0x7f3abc0b38a0 2023-11-26T07:17:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.403+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/3275181551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc15d7b0 con 0x7f3abc0b38a0 2023-11-26T07:17:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.404+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/3275181551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3abc15bc80 con 0x7f3abc0b38a0 2023-11-26T07:17:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.405+0000 7f3ab2ffd640 1 -- 172.21.15.77:0/3275181551 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ab404d3b0 con 0x7f3abc0b38a0 2023-11-26T07:17:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.407+0000 7f3ab2ffd640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3a9c06ae40 0x7f3a9c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.407+0000 7f3ab2ffd640 1 -- 172.21.15.77:0/3275181551 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ab40abaa0 con 0x7f3abc0b38a0 2023-11-26T07:17:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.407+0000 7f3aba59c640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3a9c06ae40 0x7f3a9c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.408+0000 7f3aba59c640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3a9c06ae40 0x7f3a9c06d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3aac005c00 tx=0x7f3aac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.411+0000 7f3ab2ffd640 1 -- 172.21.15.77:0/3275181551 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3abc15bc80 con 0x7f3abc0b38a0 2023-11-26T07:17:36.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:36.636+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/3275181551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3abc15bc80 con 0x7f3abc0b38a0 2023-11-26T07:17:37.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.287+0000 7f3ab2ffd640 1 -- 172.21.15.77:0/3275181551 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3abc15bc80 con 0x7f3abc0b38a0 2023-11-26T07:17:37.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.290+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/3275181551 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3a9c06ae40 msgr2=0x7f3a9c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.290+0000 7f3ac0c9b640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3a9c06ae40 0x7f3a9c06d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3aac005c00 tx=0x7f3aac009040 comp rx=0 tx=0).stop 2023-11-26T07:17:37.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.291+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/3275181551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3abc0b38a0 msgr2=0x7f3abc14f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.291+0000 7f3ac0c9b640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3abc0b38a0 0x7f3abc14f0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40098c0 tx=0x7f3ab4004730 comp rx=0 tx=0).stop 2023-11-26T07:17:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.291+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/3275181551 shutdown_connections 2023-11-26T07:17:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.291+0000 7f3ac0c9b640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3a9c06ae40 0x7f3a9c06d300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.291+0000 7f3ac0c9b640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3abc0b38a0 0x7f3abc14f0e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.291+0000 7f3ac0c9b640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3abc0ae9b0 0x7f3abc150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.291+0000 7f3ac0c9b640 1 --2- 172.21.15.77:0/3275181551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3abc06d900 0x7f3abc15bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.291+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/3275181551 >> 172.21.15.77:0/3275181551 conn(0x7f3abc06c090 msgr2=0x7f3abc158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.291+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/3275181551 shutdown_connections 2023-11-26T07:17:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.291+0000 7f3ac0c9b640 1 -- 172.21.15.77:0/3275181551 wait complete. 2023-11-26T07:17:37.313 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:17:37.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:17:37.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.524+0000 7f22282e0640 1 Processor -- start 2023-11-26T07:17:37.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.525+0000 7f22282e0640 1 -- start start 2023-11-26T07:17:37.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.526+0000 7f22282e0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f22200d3a40 0x7f222006ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.526+0000 7f22282e0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222015db00 con 0x7f22200b1ed0 2023-11-26T07:17:37.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.526+0000 7f22282e0640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22200d0ce0 con 0x7f222015d720 2023-11-26T07:17:37.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.526+0000 7f22282e0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222006d400 con 0x7f22200d3a40 2023-11-26T07:17:37.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.527+0000 7f222687d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f22200b1ed0 0x7f222006bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54280/0 (socket says 172.21.15.77:54280) 2023-11-26T07:17:37.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.527+0000 7f222687d640 1 -- 172.21.15.77:0/2687075319 learned_addr learned my addr 172.21.15.77:0/2687075319 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:37.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.527+0000 7f222587b640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f22200d3a40 0x7f222006ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.527+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422385124 0 0) 0x7f222015db00 con 0x7f22200b1ed0 2023-11-26T07:17:37.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.527+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f220c003520 con 0x7f22200b1ed0 2023-11-26T07:17:37.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.527+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118549246 0 0) 0x7f22200d0ce0 con 0x7f222015d720 2023-11-26T07:17:37.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.527+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f222015db00 con 0x7f222015d720 2023-11-26T07:17:37.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.527+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4219589133 0 0) 0x7f220c003520 con 0x7f22200b1ed0 2023-11-26T07:17:37.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.527+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f22200d3a40 msgr2=0x7f222006ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:37.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.527+0000 7f222507a640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f22200d3a40 0x7f222006ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.527+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 >> v1:172.21.15.159:6789/0 conn(0x7f222015d720 legacy=0x7f22200d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200b0100 con 0x7f22200b1ed0 2023-11-26T07:17:37.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f22180019f0 con 0x7f22200b1ed0 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222587b640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f22200d3a40 0x7f222006ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 >> v1:172.21.15.77:6789/0 conn(0x7f22200b1ed0 legacy=0x7f222006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222507a640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 0x7f220c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222507a640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f22200d3a40 0x7f220c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222507a640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f220c004d00 0x7f220c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222006d400 con 0x7f220c003b30 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c00bb40 con 0x7f220c004d00 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c00bd00 con 0x7f22200d3a40 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222607c640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 0x7f220c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222607c640 1 -- 172.21.15.77:0/2687075319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f22200d3a40 msgr2=0x7f220c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222687d640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f220c004d00 0x7f220c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222607c640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f22200d3a40 0x7f220c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222607c640 1 -- 172.21.15.77:0/2687075319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f220c004d00 msgr2=0x7f220c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:37.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222607c640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f220c004d00 0x7f220c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.528+0000 7f222607c640 1 -- 172.21.15.77:0/2687075319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c003520 con 0x7f220c003b30 2023-11-26T07:17:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.529+0000 7f222607c640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 0x7f220c003f30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f221c0018d0 tx=0x7f220c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7245b75cb55cfd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.530+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c0052d0 con 0x7f220c003b30 2023-11-26T07:17:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.530+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c005430 con 0x7f220c003b30 2023-11-26T07:17:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.530+0000 7f222507a640 1 -- 172.21.15.77:0/2687075319 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c003810 con 0x7f220c003b30 2023-11-26T07:17:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.530+0000 7f22282e0640 1 -- 172.21.15.77:0/2687075319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 msgr2=0x7f220c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.530+0000 7f22282e0640 1 --2- 172.21.15.77:0/2687075319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 0x7f220c003f30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f221c0018d0 tx=0x7f220c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.530+0000 7f222687d640 1 -- 172.21.15.77:0/2687075319 reap_dead start 2023-11-26T07:17:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.530+0000 7f22282e0640 1 -- 172.21.15.77:0/2687075319 shutdown_connections 2023-11-26T07:17:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.530+0000 7f22282e0640 1 -- 172.21.15.77:0/2687075319 >> 172.21.15.77:0/2687075319 conn(0x7f222008af60 msgr2=0x7f222009c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.530+0000 7f22282e0640 1 -- 172.21.15.77:0/2687075319 shutdown_connections 2023-11-26T07:17:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.530+0000 7f22282e0640 1 -- 172.21.15.77:0/2687075319 wait complete. 2023-11-26T07:17:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.532+0000 7f22282e0640 1 Processor -- start 2023-11-26T07:17:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.532+0000 7f22282e0640 1 -- start start 2023-11-26T07:17:37.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.533+0000 7f22282e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 0x7f22200cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.533+0000 7f22282e0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2220154a90 0x7f2220154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.533+0000 7f22282e0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f222015f1e0 0x7f222015f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.533+0000 7f22282e0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2220155450 con 0x7f220c003b30 2023-11-26T07:17:37.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.533+0000 7f22282e0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2220160a90 con 0x7f222015f1e0 2023-11-26T07:17:37.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.533+0000 7f22282e0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222015ff10 con 0x7f2220154a90 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.533+0000 7f222607c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 0x7f22200cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.533+0000 7f222607c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 0x7f22200cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34612/0 (socket says 172.21.15.77:34612) 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.533+0000 7f222607c640 1 -- 172.21.15.77:0/1806542394 learned_addr learned my addr 172.21.15.77:0/1806542394 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.534+0000 7f222607c640 1 -- 172.21.15.77:0/1806542394 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2220154a90 msgr2=0x7f2220154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.534+0000 7f222607c640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2220154a90 0x7f2220154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.534+0000 7f222607c640 1 -- 172.21.15.77:0/1806542394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f222015f1e0 msgr2=0x7f222015f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.534+0000 7f222607c640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f222015f1e0 0x7f222015f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.534+0000 7f222607c640 1 -- 172.21.15.77:0/1806542394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22201601f0 con 0x7f220c003b30 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.534+0000 7f222607c640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 0x7f22200cf080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f221c035040 tx=0x7f221c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.534+0000 7f2212ffd640 1 -- 172.21.15.77:0/1806542394 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c006ea0 con 0x7f220c003b30 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.534+0000 7f2212ffd640 1 -- 172.21.15.77:0/1806542394 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c007450 con 0x7f220c003b30 2023-11-26T07:17:37.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.534+0000 7f22282e0640 1 -- 172.21.15.77:0/1806542394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22201604d0 con 0x7f220c003b30 2023-11-26T07:17:37.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.534+0000 7f2212ffd640 1 -- 172.21.15.77:0/1806542394 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c0035f0 con 0x7f220c003b30 2023-11-26T07:17:37.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.534+0000 7f22282e0640 1 -- 172.21.15.77:0/1806542394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222015fba0 con 0x7f220c003b30 2023-11-26T07:17:37.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.535+0000 7f22282e0640 1 -- 172.21.15.77:0/1806542394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22200b33d0 con 0x7f220c003b30 2023-11-26T07:17:37.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.536+0000 7f2212ffd640 1 -- 172.21.15.77:0/1806542394 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f221c003750 con 0x7f220c003b30 2023-11-26T07:17:37.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.538+0000 7f2212ffd640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f220406ae40 0x7f220406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.538+0000 7f2212ffd640 1 -- 172.21.15.77:0/1806542394 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f221c0ab4c0 con 0x7f220c003b30 2023-11-26T07:17:37.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.538+0000 7f222587b640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f220406ae40 0x7f220406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.538+0000 7f222587b640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f220406ae40 0x7f220406d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f22200b1d80 tx=0x7f2214008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:37.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.542+0000 7f2212ffd640 1 -- 172.21.15.77:0/1806542394 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f221c076580 con 0x7f220c003b30 2023-11-26T07:17:37.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:37.771+0000 7f22282e0640 1 -- 172.21.15.77:0/1806542394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f22200d1f30 con 0x7f220c003b30 2023-11-26T07:17:38.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.297+0000 7f2212ffd640 1 -- 172.21.15.77:0/1806542394 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f221c079ba0 con 0x7f220c003b30 2023-11-26T07:17:38.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 -- 172.21.15.77:0/1806542394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f220406ae40 msgr2=0x7f220406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f220406ae40 0x7f220406d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f22200b1d80 tx=0x7f2214008040 comp rx=0 tx=0).stop 2023-11-26T07:17:38.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 -- 172.21.15.77:0/1806542394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 msgr2=0x7f22200cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 0x7f22200cf080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f221c035040 tx=0x7f221c0012d0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 -- 172.21.15.77:0/1806542394 shutdown_connections 2023-11-26T07:17:38.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f220406ae40 0x7f220406d300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f222015f1e0 0x7f222015f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2220154a90 0x7f2220154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 --2- 172.21.15.77:0/1806542394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220c003b30 0x7f22200cf080 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 -- 172.21.15.77:0/1806542394 >> 172.21.15.77:0/1806542394 conn(0x7f222008af60 msgr2=0x7f22200b2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:38.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 -- 172.21.15.77:0/1806542394 shutdown_connections 2023-11-26T07:17:38.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.301+0000 7f22282e0640 1 -- 172.21.15.77:0/1806542394 wait complete. 2023-11-26T07:17:38.323 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:17:38.323 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:17:38.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.532+0000 7fd39b1f4640 1 Processor -- start 2023-11-26T07:17:38.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.532+0000 7fd39b1f4640 1 -- start start 2023-11-26T07:17:38.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.533+0000 7fd39b1f4640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd394159e80 0x7fd394071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.533+0000 7fd39b1f4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3940cd6a0 0x7fd39415a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.533+0000 7fd39b1f4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3940ce870 con 0x7fd39415a7a0 2023-11-26T07:17:38.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.533+0000 7fd39b1f4640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3940cdc60 con 0x7fd394159e80 2023-11-26T07:17:38.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.533+0000 7fd39b1f4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940cdf40 con 0x7fd3940cd6a0 2023-11-26T07:17:38.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd39a9f3640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd39415a7a0 0x7fd39406c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54294/0 (socket says 172.21.15.77:54294) 2023-11-26T07:17:38.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd39a9f3640 1 -- 172.21.15.77:0/3015912848 learned_addr learned my addr 172.21.15.77:0/3015912848 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:38.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582670791 0 0) 0x7fd3940ce870 con 0x7fd39415a7a0 2023-11-26T07:17:38.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd380005730 con 0x7fd39415a7a0 2023-11-26T07:17:38.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd39a1f2640 1 --2- 172.21.15.77:0/3015912848 >> v2:172.21.15.159:3300/0 conn(0x7fd394159e80 0x7fd394071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd3999f1640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3940cd6a0 0x7fd39415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2394520978 0 0) 0x7fd380005730 con 0x7fd39415a7a0 2023-11-26T07:17:38.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3940cd6a0 msgr2=0x7fd39415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:38.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd3991f0640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3940cd6a0 0x7fd39415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 >> v2:172.21.15.159:3300/0 conn(0x7fd394159e80 msgr2=0x7fd394071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:38.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd3991f0640 1 --2- 172.21.15.77:0/3015912848 >> v2:172.21.15.159:3300/0 conn(0x7fd394159e80 0x7fd394071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940ce220 con 0x7fd39415a7a0 2023-11-26T07:17:38.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fd38c0019f0 con 0x7fd39415a7a0 2023-11-26T07:17:38.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.534+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 >> v1:172.21.15.77:6789/0 conn(0x7fd39415a7a0 legacy=0x7fd39406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3991f0640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3940cd6a0 0x7fd380005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3991f0640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3800061b0 0x7fd3800069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3991f0640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd380006f10 0x7fd380007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940cdc60 con 0x7fd3800061b0 2023-11-26T07:17:38.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940cdf40 con 0x7fd380006f10 2023-11-26T07:17:38.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38000dd50 con 0x7fd3940cd6a0 2023-11-26T07:17:38.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3999f1640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3800061b0 0x7fd3800069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd39a1f2640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3940cd6a0 0x7fd380005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3999f1640 1 -- 172.21.15.77:0/3015912848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3940cd6a0 msgr2=0x7fd380005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:38.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd39a9f3640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd380006f10 0x7fd380007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3999f1640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3940cd6a0 0x7fd380005b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3999f1640 1 -- 172.21.15.77:0/3015912848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd380006f10 msgr2=0x7fd380007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:38.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3999f1640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd380006f10 0x7fd380007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.535+0000 7fd3999f1640 1 -- 172.21.15.77:0/3015912848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380005730 con 0x7fd3800061b0 2023-11-26T07:17:38.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.536+0000 7fd3999f1640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3800061b0 0x7fd3800069d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd38400ba30 tx=0x7fd380007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f69912759d0cfa server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.537+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384032640 con 0x7fd3800061b0 2023-11-26T07:17:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.537+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3840327a0 con 0x7fd3800061b0 2023-11-26T07:17:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.537+0000 7fd3991f0640 1 -- 172.21.15.77:0/3015912848 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384032b30 con 0x7fd3800061b0 2023-11-26T07:17:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.537+0000 7fd39b1f4640 1 -- 172.21.15.77:0/3015912848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3800061b0 msgr2=0x7fd3800069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.537+0000 7fd39b1f4640 1 --2- 172.21.15.77:0/3015912848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3800061b0 0x7fd3800069d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd38400ba30 tx=0x7fd380007a00 comp rx=0 tx=0).stop 2023-11-26T07:17:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.537+0000 7fd39a9f3640 1 -- 172.21.15.77:0/3015912848 reap_dead start 2023-11-26T07:17:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.537+0000 7fd39b1f4640 1 -- 172.21.15.77:0/3015912848 shutdown_connections 2023-11-26T07:17:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.537+0000 7fd39b1f4640 1 -- 172.21.15.77:0/3015912848 >> 172.21.15.77:0/3015912848 conn(0x7fd3940cb830 msgr2=0x7fd3940cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.537+0000 7fd39b1f4640 1 -- 172.21.15.77:0/3015912848 shutdown_connections 2023-11-26T07:17:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.537+0000 7fd39b1f4640 1 -- 172.21.15.77:0/3015912848 wait complete. 2023-11-26T07:17:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.539+0000 7fd39b1f4640 1 Processor -- start 2023-11-26T07:17:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.539+0000 7fd39b1f4640 1 -- start start 2023-11-26T07:17:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.540+0000 7fd39b1f4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3800061b0 0x7fd394153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.540+0000 7fd39b1f4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3941403c0 0x7fd394140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.540+0000 7fd39b1f4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd394141080 0x7fd394141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.540+0000 7fd39b1f4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3941429a0 con 0x7fd3941403c0 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.540+0000 7fd39b1f4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd394140d60 con 0x7fd394141080 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.540+0000 7fd39b1f4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd394141d90 con 0x7fd3800061b0 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.540+0000 7fd3999f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3941403c0 0x7fd394140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.540+0000 7fd3999f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3941403c0 0x7fd394140820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34620/0 (socket says 172.21.15.77:34620) 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.540+0000 7fd3999f1640 1 -- 172.21.15.77:0/1517252414 learned_addr learned my addr 172.21.15.77:0/1517252414 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.541+0000 7fd3999f1640 1 -- 172.21.15.77:0/1517252414 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3800061b0 msgr2=0x7fd394153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.541+0000 7fd39a9f3640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd394141080 0x7fd394141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.541+0000 7fd39a1f2640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3800061b0 0x7fd394153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.541+0000 7fd3999f1640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3800061b0 0x7fd394153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.541+0000 7fd3999f1640 1 -- 172.21.15.77:0/1517252414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd394141080 msgr2=0x7fd394141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.541+0000 7fd3999f1640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd394141080 0x7fd394141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.541+0000 7fd3999f1640 1 -- 172.21.15.77:0/1517252414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd394142070 con 0x7fd3941403c0 2023-11-26T07:17:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.541+0000 7fd3999f1640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3941403c0 0x7fd394140820 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd38400bb50 tx=0x7fd384004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:38.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.542+0000 7fd38affd640 1 -- 172.21.15.77:0/1517252414 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38403ca80 con 0x7fd3941403c0 2023-11-26T07:17:38.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.542+0000 7fd38affd640 1 -- 172.21.15.77:0/1517252414 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38403cbe0 con 0x7fd3941403c0 2023-11-26T07:17:38.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.542+0000 7fd38affd640 1 -- 172.21.15.77:0/1517252414 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384030410 con 0x7fd3941403c0 2023-11-26T07:17:38.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.542+0000 7fd39b1f4640 1 -- 172.21.15.77:0/1517252414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd394142350 con 0x7fd3941403c0 2023-11-26T07:17:38.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.542+0000 7fd39b1f4640 1 -- 172.21.15.77:0/1517252414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd394142e30 con 0x7fd3941403c0 2023-11-26T07:17:38.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.543+0000 7fd39b1f4640 1 -- 172.21.15.77:0/1517252414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39404e840 con 0x7fd3941403c0 2023-11-26T07:17:38.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.544+0000 7fd38affd640 1 -- 172.21.15.77:0/1517252414 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd384030570 con 0x7fd3941403c0 2023-11-26T07:17:38.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.545+0000 7fd38affd640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd37806ae70 0x7fd37806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.545+0000 7fd38affd640 1 -- 172.21.15.77:0/1517252414 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3840abe90 con 0x7fd3941403c0 2023-11-26T07:17:38.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.545+0000 7fd39a1f2640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd37806ae70 0x7fd37806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.545+0000 7fd39a1f2640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd37806ae70 0x7fd37806d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd390006fd0 tx=0x7fd390008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:38.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.549+0000 7fd38affd640 1 -- 172.21.15.77:0/1517252414 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd38407a930 con 0x7fd3941403c0 2023-11-26T07:17:38.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.774+0000 7fd39b1f4640 1 -- 172.21.15.77:0/1517252414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd39415cbb0 con 0x7fd3941403c0 2023-11-26T07:17:38.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.776+0000 7fd38affd640 1 -- 172.21.15.77:0/1517252414 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4910 (secure 0 0 0) 0x7fd3840ad090 con 0x7fd3941403c0 2023-11-26T07:17:38.778 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:38.778 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2517793456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2517793456},{"type":"v1","addr":"172.21.15.77:6835","nonce":2517793456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/169772143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":169772143},{"type":"v1","addr":"172.21.15.77:6837","nonce":169772143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3797973649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3797973649},{"type":"v1","addr":"172.21.15.159:6834","nonce":3797973649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:17:34.699805+0000","modified":"2023-11-26T07:17:37.771915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/2168278307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2168278307},{"type":"v1","addr":"172.21.15.159:6835","nonce":2168278307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:17:38.778 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-11-26T07:17:38.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.778+0000 7fd39b1f4640 1 -- 172.21.15.77:0/1517252414 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd37806ae70 msgr2=0x7fd37806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.778+0000 7fd39b1f4640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd37806ae70 0x7fd37806d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd390006fd0 tx=0x7fd390008040 comp rx=0 tx=0).stop 2023-11-26T07:17:38.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.778+0000 7fd39b1f4640 1 -- 172.21.15.77:0/1517252414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3941403c0 msgr2=0x7fd394140820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.778+0000 7fd39b1f4640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3941403c0 0x7fd394140820 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd38400bb50 tx=0x7fd384004730 comp rx=0 tx=0).stop 2023-11-26T07:17:38.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.778+0000 7fd39b1f4640 1 -- 172.21.15.77:0/1517252414 shutdown_connections 2023-11-26T07:17:38.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.778+0000 7fd39b1f4640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd37806ae70 0x7fd37806d330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.778+0000 7fd39b1f4640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd394141080 0x7fd394141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.778+0000 7fd39b1f4640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3941403c0 0x7fd394140820 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.778+0000 7fd39b1f4640 1 --2- 172.21.15.77:0/1517252414 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3800061b0 0x7fd394153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.778+0000 7fd39b1f4640 1 -- 172.21.15.77:0/1517252414 >> 172.21.15.77:0/1517252414 conn(0x7fd3940cb830 msgr2=0x7fd3940b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:38.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.779+0000 7fd39b1f4640 1 -- 172.21.15.77:0/1517252414 shutdown_connections 2023-11-26T07:17:38.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.779+0000 7fd39b1f4640 1 -- 172.21.15.77:0/1517252414 wait complete. 2023-11-26T07:17:38.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.993+0000 7fe2c2133640 1 Processor -- start 2023-11-26T07:17:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.993+0000 7fe2c2133640 1 -- start start 2023-11-26T07:17:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2c2133640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0cf450 0x7fe2bc0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2c2133640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe2bc0cdfb0 0x7fe2bc0ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2c2133640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2bc0cece0 con 0x7fe2bc15c7f0 2023-11-26T07:17:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2c2133640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2bc156010 con 0x7fe2bc0cdfb0 2023-11-26T07:17:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2c2133640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc06ce30 con 0x7fe2bc0cf450 2023-11-26T07:17:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2bbfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe2bc0cdfb0 0x7fe2bc0ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2bbfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe2bc0cdfb0 0x7fe2bc0ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34628/0 (socket says 172.21.15.77:34628) 2023-11-26T07:17:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2bbfff640 1 -- 172.21.15.77:0/4187315967 learned_addr learned my addr 172.21.15.77:0/4187315967 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2b3fff640 1 --2- 172.21.15.77:0/4187315967 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0cf450 0x7fe2bc0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2bbfff640 1 -- 172.21.15.77:0/4187315967 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0cf450 msgr2=0x7fe2bc0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:38.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2bbfff640 1 --2- 172.21.15.77:0/4187315967 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0cf450 0x7fe2bc0cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2bbfff640 1 -- 172.21.15.77:0/4187315967 >> v1:172.21.15.77:6789/0 conn(0x7fe2bc15c7f0 legacy=0x7fe2bc06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.995+0000 7fe2bbfff640 1 -- 172.21.15.77:0/4187315967 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc06d040 con 0x7fe2bc0cdfb0 2023-11-26T07:17:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.996+0000 7fe2bbfff640 1 --2- 172.21.15.77:0/4187315967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc0cdfb0 0x7fe2bc0ce440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009e50 tx=0x7fe2b402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaf7dd9442480a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.997+0000 7fe2baffd640 1 -- 172.21.15.77:0/4187315967 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b402cb00 con 0x7fe2bc0cdfb0 2023-11-26T07:17:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.997+0000 7fe2baffd640 1 -- 172.21.15.77:0/4187315967 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b402cc60 con 0x7fe2bc0cdfb0 2023-11-26T07:17:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.997+0000 7fe2baffd640 1 -- 172.21.15.77:0/4187315967 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40343f0 con 0x7fe2bc0cdfb0 2023-11-26T07:17:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.997+0000 7fe2c2133640 1 -- 172.21.15.77:0/4187315967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc0cdfb0 msgr2=0x7fe2bc0ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.997+0000 7fe2c2133640 1 --2- 172.21.15.77:0/4187315967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc0cdfb0 0x7fe2bc0ce440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009e50 tx=0x7fe2b402bf60 comp rx=0 tx=0).stop 2023-11-26T07:17:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.998+0000 7fe2c2133640 1 -- 172.21.15.77:0/4187315967 shutdown_connections 2023-11-26T07:17:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.998+0000 7fe2c2133640 1 --2- 172.21.15.77:0/4187315967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc0cdfb0 0x7fe2bc0ce440 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.998+0000 7fe2c2133640 1 --2- 172.21.15.77:0/4187315967 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0cf450 0x7fe2bc0cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.998+0000 7fe2c2133640 1 -- 172.21.15.77:0/4187315967 >> 172.21.15.77:0/4187315967 conn(0x7fe2bc06a920 msgr2=0x7fe2bc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.998+0000 7fe2c2133640 1 -- 172.21.15.77:0/4187315967 shutdown_connections 2023-11-26T07:17:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.998+0000 7fe2c2133640 1 -- 172.21.15.77:0/4187315967 wait complete. 2023-11-26T07:17:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:38.999+0000 7fe2c2133640 1 Processor -- start 2023-11-26T07:17:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.000+0000 7fe2c2133640 1 -- start start 2023-11-26T07:17:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2c2133640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc0cdfb0 0x7fe2bc15a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2c2133640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0cf450 0x7fe2bc146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2c2133640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc15c7f0 0x7fe2bc0adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2c2133640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc0b3dd0 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2c2133640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc159870 con 0x7fe2bc15c7f0 2023-11-26T07:17:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2c2133640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc159b50 con 0x7fe2bc0cf450 2023-11-26T07:17:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2bb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc0cdfb0 0x7fe2bc15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2bb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc0cdfb0 0x7fe2bc15a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34638/0 (socket says 172.21.15.77:34638) 2023-11-26T07:17:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2bb7fe640 1 -- 172.21.15.77:0/1673720812 learned_addr learned my addr 172.21.15.77:0/1673720812 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2b3fff640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0cf450 0x7fe2bc146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2bb7fe640 1 -- 172.21.15.77:0/1673720812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0cf450 msgr2=0x7fe2bc146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2bbfff640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc15c7f0 0x7fe2bc0adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2bb7fe640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0cf450 0x7fe2bc146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2bb7fe640 1 -- 172.21.15.77:0/1673720812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc15c7f0 msgr2=0x7fe2bc0adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2bb7fe640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc15c7f0 0x7fe2bc0adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2bb7fe640 1 -- 172.21.15.77:0/1673720812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b4009b30 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.001+0000 7fe2b3fff640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0cf450 0x7fe2bc146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.002+0000 7fe2bb7fe640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc0cdfb0 0x7fe2bc15a630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c400 tx=0x7fe2ac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.002+0000 7fe2b8ff9640 1 -- 172.21.15.77:0/1673720812 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0052d0 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.002+0000 7fe2b8ff9640 1 -- 172.21.15.77:0/1673720812 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac005430 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.002+0000 7fe2b8ff9640 1 -- 172.21.15.77:0/1673720812 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac003830 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.002+0000 7fe2c2133640 1 -- 172.21.15.77:0/1673720812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2bc159e30 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.002+0000 7fe2c2133640 1 -- 172.21.15.77:0/1673720812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2bc1466c0 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.003+0000 7fe2c2133640 1 -- 172.21.15.77:0/1673720812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2bc146850 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.004+0000 7fe2b8ff9640 1 -- 172.21.15.77:0/1673720812 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2ac003990 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.005+0000 7fe2b8ff9640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe29c06ae40 0x7fe29c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.005+0000 7fe2b8ff9640 1 -- 172.21.15.77:0/1673720812 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2ac088b70 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.005+0000 7fe2b3fff640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe29c06ae40 0x7fe29c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.006+0000 7fe2b3fff640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe29c06ae40 0x7fe29c06d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc070af0 tx=0x7fe2a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.009+0000 7fe2b8ff9640 1 -- 172.21.15.77:0/1673720812 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2bc146850 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.184+0000 7fe2c2133640 1 -- 172.21.15.77:0/1673720812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2bc146850 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.187+0000 7fe2b8ff9640 1 -- 172.21.15.77:0/1673720812 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7fe2bc146850 con 0x7fe2bc0cdfb0 2023-11-26T07:17:39.189 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:39.189 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:36.274387+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:39.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.189+0000 7fe2c2133640 1 -- 172.21.15.77:0/1673720812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe29c06ae40 msgr2=0x7fe29c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.189+0000 7fe2c2133640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe29c06ae40 0x7fe29c06d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc070af0 tx=0x7fe2a4008040 comp rx=0 tx=0).stop 2023-11-26T07:17:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.189+0000 7fe2c2133640 1 -- 172.21.15.77:0/1673720812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc0cdfb0 msgr2=0x7fe2bc15a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.189+0000 7fe2c2133640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc0cdfb0 0x7fe2bc15a630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c400 tx=0x7fe2ac00c8c0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.189+0000 7fe2c2133640 1 -- 172.21.15.77:0/1673720812 shutdown_connections 2023-11-26T07:17:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.189+0000 7fe2c2133640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe29c06ae40 0x7fe29c06d300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.189+0000 7fe2c2133640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc15c7f0 0x7fe2bc0adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.189+0000 7fe2c2133640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0cf450 0x7fe2bc146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.189+0000 7fe2c2133640 1 --2- 172.21.15.77:0/1673720812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc0cdfb0 0x7fe2bc15a630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.189+0000 7fe2c2133640 1 -- 172.21.15.77:0/1673720812 >> 172.21.15.77:0/1673720812 conn(0x7fe2bc06a920 msgr2=0x7fe2bc072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.190+0000 7fe2c2133640 1 -- 172.21.15.77:0/1673720812 shutdown_connections 2023-11-26T07:17:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.190+0000 7fe2c2133640 1 -- 172.21.15.77:0/1673720812 wait complete. 2023-11-26T07:17:39.209 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:17:39.209 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:17:39.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.407+0000 7fdb3f27c640 1 Processor -- start 2023-11-26T07:17:39.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.407+0000 7fdb3f27c640 1 -- start start 2023-11-26T07:17:39.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.409+0000 7fdb3f27c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb3815c7f0 0x7fdb3806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.409+0000 7fdb3f27c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdb380ce6c0 0x7fdb380cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.409+0000 7fdb3f27c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb380cece0 con 0x7fdb380cf450 2023-11-26T07:17:39.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.409+0000 7fdb3f27c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb38156010 con 0x7fdb380ce6c0 2023-11-26T07:17:39.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.409+0000 7fdb3f27c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3806ce30 con 0x7fdb3815c7f0 2023-11-26T07:17:39.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.409+0000 7fdb3c817640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdb380cf450 0x7fdb380cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54310/0 (socket says 172.21.15.77:54310) 2023-11-26T07:17:39.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.409+0000 7fdb3c817640 1 -- 172.21.15.77:0/3602775332 learned_addr learned my addr 172.21.15.77:0/3602775332 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:39.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.409+0000 7fdb3d819640 1 --2- 172.21.15.77:0/3602775332 >> v2:172.21.15.159:3300/0 conn(0x7fdb380ce6c0 0x7fdb380cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.409+0000 7fdb3d018640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb3815c7f0 0x7fdb3806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.409+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372089935 0 0) 0x7fdb380cece0 con 0x7fdb380cf450 2023-11-26T07:17:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.409+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb24003520 con 0x7fdb380cf450 2023-11-26T07:17:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1197877873 0 0) 0x7fdb24003520 con 0x7fdb380cf450 2023-11-26T07:17:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb3815c7f0 msgr2=0x7fdb3806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb3815c7f0 0x7fdb3806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 >> v2:172.21.15.159:3300/0 conn(0x7fdb380ce6c0 msgr2=0x7fdb380cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 --2- 172.21.15.77:0/3602775332 >> v2:172.21.15.159:3300/0 conn(0x7fdb380ce6c0 0x7fdb380cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3806d040 con 0x7fdb380cf450 2023-11-26T07:17:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fdb28001670 con 0x7fdb380cf450 2023-11-26T07:17:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 >> v1:172.21.15.77:6789/0 conn(0x7fdb380cf450 legacy=0x7fdb380cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb24003970 0x7fdb24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb240047c0 0x7fdb24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb3815c7f0 0x7fdb24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38156010 con 0x7fdb240047c0 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3806ce30 con 0x7fdb24003970 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2400b980 con 0x7fdb3815c7f0 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.410+0000 7fdb3c817640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb240047c0 0x7fdb24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.411+0000 7fdb3c817640 1 -- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb3815c7f0 msgr2=0x7fdb24005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.411+0000 7fdb3d018640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb24003970 0x7fdb24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.411+0000 7fdb3d819640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb3815c7f0 0x7fdb24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.411+0000 7fdb3c817640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb3815c7f0 0x7fdb24005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.411+0000 7fdb3c817640 1 -- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb24003970 msgr2=0x7fdb24003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:39.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.411+0000 7fdb3c817640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb24003970 0x7fdb24003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.411+0000 7fdb3c817640 1 -- 172.21.15.77:0/3602775332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb24003520 con 0x7fdb240047c0 2023-11-26T07:17:39.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.411+0000 7fdb3d018640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb24003970 0x7fdb24003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.412+0000 7fdb3c817640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb240047c0 0x7fdb24004c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800c240 tx=0x7fdb240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f77feb3400e739 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.412+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2802cb00 con 0x7fdb240047c0 2023-11-26T07:17:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.412+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2802cc60 con 0x7fdb240047c0 2023-11-26T07:17:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.412+0000 7fdb2ffff640 1 -- 172.21.15.77:0/3602775332 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb28005af0 con 0x7fdb240047c0 2023-11-26T07:17:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.412+0000 7fdb3f27c640 1 -- 172.21.15.77:0/3602775332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb240047c0 msgr2=0x7fdb24004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.412+0000 7fdb3f27c640 1 --2- 172.21.15.77:0/3602775332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb240047c0 0x7fdb24004c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800c240 tx=0x7fdb240057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.413+0000 7fdb3d819640 1 -- 172.21.15.77:0/3602775332 reap_dead start 2023-11-26T07:17:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.413+0000 7fdb3f27c640 1 -- 172.21.15.77:0/3602775332 shutdown_connections 2023-11-26T07:17:39.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.413+0000 7fdb3f27c640 1 -- 172.21.15.77:0/3602775332 >> 172.21.15.77:0/3602775332 conn(0x7fdb3806a920 msgr2=0x7fdb3806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.413+0000 7fdb3f27c640 1 -- 172.21.15.77:0/3602775332 shutdown_connections 2023-11-26T07:17:39.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.413+0000 7fdb3f27c640 1 -- 172.21.15.77:0/3602775332 wait complete. 2023-11-26T07:17:39.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.414+0000 7fdb3f27c640 1 Processor -- start 2023-11-26T07:17:39.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.414+0000 7fdb3f27c640 1 -- start start 2023-11-26T07:17:39.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.415+0000 7fdb3f27c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb240047c0 0x7fdb38098ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.415+0000 7fdb3f27c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb38152a10 0x7fdb380b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.415+0000 7fdb3f27c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb38156150 0x7fdb3815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.415+0000 7fdb3f27c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb380b4160 con 0x7fdb38156150 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.415+0000 7fdb3f27c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38152e90 con 0x7fdb240047c0 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.415+0000 7fdb3f27c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb381530a0 con 0x7fdb38152a10 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb3d819640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb38156150 0x7fdb3815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb3d819640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb38156150 0x7fdb3815dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34648/0 (socket says 172.21.15.77:34648) 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb3d819640 1 -- 172.21.15.77:0/569860217 learned_addr learned my addr 172.21.15.77:0/569860217 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb3d819640 1 -- 172.21.15.77:0/569860217 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb38152a10 msgr2=0x7fdb380b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb3d819640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb38152a10 0x7fdb380b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb3d819640 1 -- 172.21.15.77:0/569860217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb240047c0 msgr2=0x7fdb38098ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb3d819640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb240047c0 0x7fdb38098ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb3d819640 1 -- 172.21.15.77:0/569860217 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb380b1ee0 con 0x7fdb38156150 2023-11-26T07:17:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb3d819640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb38156150 0x7fdb3815dba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdb380d0130 tx=0x7fdb3000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb2dffb640 1 -- 172.21.15.77:0/569860217 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3000fe90 con 0x7fdb38156150 2023-11-26T07:17:39.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb2dffb640 1 -- 172.21.15.77:0/569860217 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb30011040 con 0x7fdb38156150 2023-11-26T07:17:39.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.416+0000 7fdb3f27c640 1 -- 172.21.15.77:0/569860217 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb380b21c0 con 0x7fdb38156150 2023-11-26T07:17:39.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.417+0000 7fdb2dffb640 1 -- 172.21.15.77:0/569860217 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30003bd0 con 0x7fdb38156150 2023-11-26T07:17:39.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.417+0000 7fdb3f27c640 1 -- 172.21.15.77:0/569860217 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3815a0e0 con 0x7fdb38156150 2023-11-26T07:17:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.418+0000 7fdb3f27c640 1 -- 172.21.15.77:0/569860217 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb38067470 con 0x7fdb38156150 2023-11-26T07:17:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.418+0000 7fdb2dffb640 1 -- 172.21.15.77:0/569860217 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb30017400 con 0x7fdb38156150 2023-11-26T07:17:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.419+0000 7fdb2dffb640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb1c06add0 0x7fdb1c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.419+0000 7fdb2dffb640 1 -- 172.21.15.77:0/569860217 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb30089b40 con 0x7fdb38156150 2023-11-26T07:17:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.420+0000 7fdb3d018640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb1c06add0 0x7fdb1c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.420+0000 7fdb3d018640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb1c06add0 0x7fdb1c06d290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdb34009910 tx=0x7fdb34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.423+0000 7fdb2dffb640 1 -- 172.21.15.77:0/569860217 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb30054be0 con 0x7fdb38156150 2023-11-26T07:17:39.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.611+0000 7fdb3f27c640 1 -- 172.21.15.77:0/569860217 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb3806d600 con 0x7fdb1c06add0 2023-11-26T07:17:39.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.635+0000 7fdb2dffb640 1 -- 172.21.15.77:0/569860217 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264467 (secure 0 0 0) 0x7fdb340107f0 con 0x7fdb1c06add0 2023-11-26T07:17:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:17:39.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 -- 172.21.15.77:0/569860217 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb1c06add0 msgr2=0x7fdb1c06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb1c06add0 0x7fdb1c06d290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdb34009910 tx=0x7fdb34008040 comp rx=0 tx=0).stop 2023-11-26T07:17:39.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 -- 172.21.15.77:0/569860217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb38156150 msgr2=0x7fdb3815dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb38156150 0x7fdb3815dba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdb380d0130 tx=0x7fdb3000f4a0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 -- 172.21.15.77:0/569860217 shutdown_connections 2023-11-26T07:17:39.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb1c06add0 0x7fdb1c06d290 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb38156150 0x7fdb3815dba0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb38152a10 0x7fdb380b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 --2- 172.21.15.77:0/569860217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb240047c0 0x7fdb38098ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 -- 172.21.15.77:0/569860217 >> 172.21.15.77:0/569860217 conn(0x7fdb3806a920 msgr2=0x7fdb380b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 -- 172.21.15.77:0/569860217 shutdown_connections 2023-11-26T07:17:39.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.640+0000 7fdb3f27c640 1 -- 172.21.15.77:0/569860217 wait complete. 2023-11-26T07:17:39.659 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-26T07:17:39.605418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001944"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857536+0000","last_change":"2023-11-26T07:17:35.294616+0000","last_active":"2023-11-26T07:17:36.857536+0000","last_peered":"2023-11-26T07:17:36.857536+0000","last_clean":"2023-11-26T07:17:36.857536+0000","last_became_active":"2023-11-26T07:17:35.294223+0000","last_became_peered":"2023-11-26T07:17:35.294223+0000","last_unstale":"2023-11-26T07:17:36.857536+0000","last_undegraded":"2023-11-26T07:17:36.857536+0000","last_fullsized":"2023-11-26T07:17:36.857536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:01:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853243+0000","last_change":"2023-11-26T07:17:35.285291+0000","last_active":"2023-11-26T07:17:36.853243+0000","last_peered":"2023-11-26T07:17:36.853243+0000","last_clean":"2023-11-26T07:17:36.853243+0000","last_became_active":"2023-11-26T07:17:35.285002+0000","last_became_peered":"2023-11-26T07:17:35.285002+0000","last_unstale":"2023-11-26T07:17:36.853243+0000","last_undegraded":"2023-11-26T07:17:36.853243+0000","last_fullsized":"2023-11-26T07:17:36.853243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289017+0000","last_change":"2023-11-26T07:17:35.289003+0000","last_active":"2023-11-26T07:17:36.289017+0000","last_peered":"2023-11-26T07:17:36.289017+0000","last_clean":"2023-11-26T07:17:36.289017+0000","last_became_active":"2023-11-26T07:17:35.288628+0000","last_became_peered":"2023-11-26T07:17:35.288628+0000","last_unstale":"2023-11-26T07:17:36.289017+0000","last_undegraded":"2023-11-26T07:17:36.289017+0000","last_fullsized":"2023-11-26T07:17:36.289017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291198+0000","last_change":"2023-11-26T07:17:35.299669+0000","last_active":"2023-11-26T07:17:36.291198+0000","last_peered":"2023-11-26T07:17:36.291198+0000","last_clean":"2023-11-26T07:17:36.291198+0000","last_became_active":"2023-11-26T07:17:35.298175+0000","last_became_peered":"2023-11-26T07:17:35.298175+0000","last_unstale":"2023-11-26T07:17:36.291198+0000","last_undegraded":"2023-11-26T07:17:36.291198+0000","last_fullsized":"2023-11-26T07:17:36.291198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853732+0000","last_change":"2023-11-26T07:17:35.290182+0000","last_active":"2023-11-26T07:17:36.853732+0000","last_peered":"2023-11-26T07:17:36.853732+0000","last_clean":"2023-11-26T07:17:36.853732+0000","last_became_active":"2023-11-26T07:17:35.289848+0000","last_became_peered":"2023-11-26T07:17:35.289848+0000","last_unstale":"2023-11-26T07:17:36.853732+0000","last_undegraded":"2023-11-26T07:17:36.853732+0000","last_fullsized":"2023-11-26T07:17:36.853732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290790+0000","last_change":"2023-11-26T07:17:35.275633+0000","last_active":"2023-11-26T07:17:36.290790+0000","last_peered":"2023-11-26T07:17:36.290790+0000","last_clean":"2023-11-26T07:17:36.290790+0000","last_became_active":"2023-11-26T07:17:35.275245+0000","last_became_peered":"2023-11-26T07:17:35.275245+0000","last_unstale":"2023-11-26T07:17:36.290790+0000","last_undegraded":"2023-11-26T07:17:36.290790+0000","last_fullsized":"2023-11-26T07:17:36.290790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853372+0000","last_change":"2023-11-26T07:17:35.289664+0000","last_active":"2023-11-26T07:17:36.853372+0000","last_peered":"2023-11-26T07:17:36.853372+0000","last_clean":"2023-11-26T07:17:36.853372+0000","last_became_active":"2023-11-26T07:17:35.289347+0000","last_became_peered":"2023-11-26T07:17:35.289347+0000","last_unstale":"2023-11-26T07:17:36.853372+0000","last_undegraded":"2023-11-26T07:17:36.853372+0000","last_fullsized":"2023-11-26T07:17:36.853372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290077+0000","last_change":"2023-11-26T07:17:35.285314+0000","last_active":"2023-11-26T07:17:36.290077+0000","last_peered":"2023-11-26T07:17:36.290077+0000","last_clean":"2023-11-26T07:17:36.290077+0000","last_became_active":"2023-11-26T07:17:35.283583+0000","last_became_peered":"2023-11-26T07:17:35.283583+0000","last_unstale":"2023-11-26T07:17:36.290077+0000","last_undegraded":"2023-11-26T07:17:36.290077+0000","last_fullsized":"2023-11-26T07:17:36.290077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857606+0000","last_change":"2023-11-26T07:17:35.294791+0000","last_active":"2023-11-26T07:17:36.857606+0000","last_peered":"2023-11-26T07:17:36.857606+0000","last_clean":"2023-11-26T07:17:36.857606+0000","last_became_active":"2023-11-26T07:17:35.294267+0000","last_became_peered":"2023-11-26T07:17:35.294267+0000","last_unstale":"2023-11-26T07:17:36.857606+0000","last_undegraded":"2023-11-26T07:17:36.857606+0000","last_fullsized":"2023-11-26T07:17:36.857606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:14:14.039125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856211+0000","last_change":"2023-11-26T07:17:35.291521+0000","last_active":"2023-11-26T07:17:36.856211+0000","last_peered":"2023-11-26T07:17:36.856211+0000","last_clean":"2023-11-26T07:17:36.856211+0000","last_became_active":"2023-11-26T07:17:35.290900+0000","last_became_peered":"2023-11-26T07:17:35.290900+0000","last_unstale":"2023-11-26T07:17:36.856211+0000","last_undegraded":"2023-11-26T07:17:36.856211+0000","last_fullsized":"2023-11-26T07:17:36.856211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855424+0000","last_change":"2023-11-26T07:17:35.293941+0000","last_active":"2023-11-26T07:17:36.855424+0000","last_peered":"2023-11-26T07:17:36.855424+0000","last_clean":"2023-11-26T07:17:36.855424+0000","last_became_active":"2023-11-26T07:17:35.293485+0000","last_became_peered":"2023-11-26T07:17:35.293485+0000","last_unstale":"2023-11-26T07:17:36.855424+0000","last_undegraded":"2023-11-26T07:17:36.855424+0000","last_fullsized":"2023-11-26T07:17:36.855424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856924+0000","last_change":"2023-11-26T07:17:35.302079+0000","last_active":"2023-11-26T07:17:36.856924+0000","last_peered":"2023-11-26T07:17:36.856924+0000","last_clean":"2023-11-26T07:17:36.856924+0000","last_became_active":"2023-11-26T07:17:35.297582+0000","last_became_peered":"2023-11-26T07:17:35.297582+0000","last_unstale":"2023-11-26T07:17:36.856924+0000","last_undegraded":"2023-11-26T07:17:36.856924+0000","last_fullsized":"2023-11-26T07:17:36.856924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:31.406679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291168+0000","last_change":"2023-11-26T07:17:35.286562+0000","last_active":"2023-11-26T07:17:36.291168+0000","last_peered":"2023-11-26T07:17:36.291168+0000","last_clean":"2023-11-26T07:17:36.291168+0000","last_became_active":"2023-11-26T07:17:35.286252+0000","last_became_peered":"2023-11-26T07:17:35.286252+0000","last_unstale":"2023-11-26T07:17:36.291168+0000","last_undegraded":"2023-11-26T07:17:36.291168+0000","last_fullsized":"2023-11-26T07:17:36.291168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288118+0000","last_change":"2023-11-26T07:17:35.281910+0000","last_active":"2023-11-26T07:17:36.288118+0000","last_peered":"2023-11-26T07:17:36.288118+0000","last_clean":"2023-11-26T07:17:36.288118+0000","last_became_active":"2023-11-26T07:17:35.281535+0000","last_became_peered":"2023-11-26T07:17:35.281535+0000","last_unstale":"2023-11-26T07:17:36.288118+0000","last_undegraded":"2023-11-26T07:17:36.288118+0000","last_fullsized":"2023-11-26T07:17:36.288118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:59.107380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852568+0000","last_change":"2023-11-26T07:17:35.305449+0000","last_active":"2023-11-26T07:17:36.852568+0000","last_peered":"2023-11-26T07:17:36.852568+0000","last_clean":"2023-11-26T07:17:36.852568+0000","last_became_active":"2023-11-26T07:17:35.305109+0000","last_became_peered":"2023-11-26T07:17:35.305109+0000","last_unstale":"2023-11-26T07:17:36.852568+0000","last_undegraded":"2023-11-26T07:17:36.852568+0000","last_fullsized":"2023-11-26T07:17:36.852568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290585+0000","last_change":"2023-11-26T07:17:35.278078+0000","last_active":"2023-11-26T07:17:36.290585+0000","last_peered":"2023-11-26T07:17:36.290585+0000","last_clean":"2023-11-26T07:17:36.290585+0000","last_became_active":"2023-11-26T07:17:35.277756+0000","last_became_peered":"2023-11-26T07:17:35.277756+0000","last_unstale":"2023-11-26T07:17:36.290585+0000","last_undegraded":"2023-11-26T07:17:36.290585+0000","last_fullsized":"2023-11-26T07:17:36.290585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.292426+0000","last_change":"2023-11-26T07:17:35.292521+0000","last_active":"2023-11-26T07:17:36.292426+0000","last_peered":"2023-11-26T07:17:36.292426+0000","last_clean":"2023-11-26T07:17:36.292426+0000","last_became_active":"2023-11-26T07:17:35.290387+0000","last_became_peered":"2023-11-26T07:17:35.290387+0000","last_unstale":"2023-11-26T07:17:36.292426+0000","last_undegraded":"2023-11-26T07:17:36.292426+0000","last_fullsized":"2023-11-26T07:17:36.292426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:37:30.364077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.348275+0000","last_change":"2023-11-26T07:17:35.289305+0000","last_active":"2023-11-26T07:17:36.348275+0000","last_peered":"2023-11-26T07:17:36.348275+0000","last_clean":"2023-11-26T07:17:36.348275+0000","last_became_active":"2023-11-26T07:17:35.288484+0000","last_became_peered":"2023-11-26T07:17:35.288484+0000","last_unstale":"2023-11-26T07:17:36.348275+0000","last_undegraded":"2023-11-26T07:17:36.348275+0000","last_fullsized":"2023-11-26T07:17:36.348275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:44:59.432835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.854493+0000","last_change":"2023-11-26T07:17:35.295513+0000","last_active":"2023-11-26T07:17:36.854493+0000","last_peered":"2023-11-26T07:17:36.854493+0000","last_clean":"2023-11-26T07:17:36.854493+0000","last_became_active":"2023-11-26T07:17:35.295339+0000","last_became_peered":"2023-11-26T07:17:35.295339+0000","last_unstale":"2023-11-26T07:17:36.854493+0000","last_undegraded":"2023-11-26T07:17:36.854493+0000","last_fullsized":"2023-11-26T07:17:36.854493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:51:44.669299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856229+0000","last_change":"2023-11-26T07:17:35.304162+0000","last_active":"2023-11-26T07:17:36.856229+0000","last_peered":"2023-11-26T07:17:36.856229+0000","last_clean":"2023-11-26T07:17:36.856229+0000","last_became_active":"2023-11-26T07:17:35.303775+0000","last_became_peered":"2023-11-26T07:17:35.303775+0000","last_unstale":"2023-11-26T07:17:36.856229+0000","last_undegraded":"2023-11-26T07:17:36.856229+0000","last_fullsized":"2023-11-26T07:17:36.856229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288359+0000","last_change":"2023-11-26T07:17:35.289136+0000","last_active":"2023-11-26T07:17:36.288359+0000","last_peered":"2023-11-26T07:17:36.288359+0000","last_clean":"2023-11-26T07:17:36.288359+0000","last_became_active":"2023-11-26T07:17:35.288824+0000","last_became_peered":"2023-11-26T07:17:35.288824+0000","last_unstale":"2023-11-26T07:17:36.288359+0000","last_undegraded":"2023-11-26T07:17:36.288359+0000","last_fullsized":"2023-11-26T07:17:36.288359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:51.436807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290977+0000","last_change":"2023-11-26T07:17:35.299639+0000","last_active":"2023-11-26T07:17:36.290977+0000","last_peered":"2023-11-26T07:17:36.290977+0000","last_clean":"2023-11-26T07:17:36.290977+0000","last_became_active":"2023-11-26T07:17:35.298838+0000","last_became_peered":"2023-11-26T07:17:35.298838+0000","last_unstale":"2023-11-26T07:17:36.290977+0000","last_undegraded":"2023-11-26T07:17:36.290977+0000","last_fullsized":"2023-11-26T07:17:36.290977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290258+0000","last_change":"2023-11-26T07:17:35.288263+0000","last_active":"2023-11-26T07:17:36.290258+0000","last_peered":"2023-11-26T07:17:36.290258+0000","last_clean":"2023-11-26T07:17:36.290258+0000","last_became_active":"2023-11-26T07:17:35.287907+0000","last_became_peered":"2023-11-26T07:17:35.287907+0000","last_unstale":"2023-11-26T07:17:36.290258+0000","last_undegraded":"2023-11-26T07:17:36.290258+0000","last_fullsized":"2023-11-26T07:17:36.290258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290741+0000","last_change":"2023-11-26T07:17:35.298420+0000","last_active":"2023-11-26T07:17:36.290741+0000","last_peered":"2023-11-26T07:17:36.290741+0000","last_clean":"2023-11-26T07:17:36.290741+0000","last_became_active":"2023-11-26T07:17:35.297672+0000","last_became_peered":"2023-11-26T07:17:35.297672+0000","last_unstale":"2023-11-26T07:17:36.290741+0000","last_undegraded":"2023-11-26T07:17:36.290741+0000","last_fullsized":"2023-11-26T07:17:36.290741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291207+0000","last_change":"2023-11-26T07:17:35.299072+0000","last_active":"2023-11-26T07:17:36.291207+0000","last_peered":"2023-11-26T07:17:36.291207+0000","last_clean":"2023-11-26T07:17:36.291207+0000","last_became_active":"2023-11-26T07:17:35.298748+0000","last_became_peered":"2023-11-26T07:17:35.298748+0000","last_unstale":"2023-11-26T07:17:36.291207+0000","last_undegraded":"2023-11-26T07:17:36.291207+0000","last_fullsized":"2023-11-26T07:17:36.291207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855537+0000","last_change":"2023-11-26T07:17:35.295203+0000","last_active":"2023-11-26T07:17:36.855537+0000","last_peered":"2023-11-26T07:17:36.855537+0000","last_clean":"2023-11-26T07:17:36.855537+0000","last_became_active":"2023-11-26T07:17:35.294921+0000","last_became_peered":"2023-11-26T07:17:35.294921+0000","last_unstale":"2023-11-26T07:17:36.855537+0000","last_undegraded":"2023-11-26T07:17:36.855537+0000","last_fullsized":"2023-11-26T07:17:36.855537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852945+0000","last_change":"2023-11-26T07:17:35.288826+0000","last_active":"2023-11-26T07:17:36.852945+0000","last_peered":"2023-11-26T07:17:36.852945+0000","last_clean":"2023-11-26T07:17:36.852945+0000","last_became_active":"2023-11-26T07:17:35.288535+0000","last_became_peered":"2023-11-26T07:17:35.288535+0000","last_unstale":"2023-11-26T07:17:36.852945+0000","last_undegraded":"2023-11-26T07:17:36.852945+0000","last_fullsized":"2023-11-26T07:17:36.852945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291234+0000","last_change":"2023-11-26T07:17:35.299788+0000","last_active":"2023-11-26T07:17:36.291234+0000","last_peered":"2023-11-26T07:17:36.291234+0000","last_clean":"2023-11-26T07:17:36.291234+0000","last_became_active":"2023-11-26T07:17:35.299537+0000","last_became_peered":"2023-11-26T07:17:35.299537+0000","last_unstale":"2023-11-26T07:17:36.291234+0000","last_undegraded":"2023-11-26T07:17:36.291234+0000","last_fullsized":"2023-11-26T07:17:36.291234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288966+0000","last_change":"2023-11-26T07:17:35.291110+0000","last_active":"2023-11-26T07:17:36.288966+0000","last_peered":"2023-11-26T07:17:36.288966+0000","last_clean":"2023-11-26T07:17:36.288966+0000","last_became_active":"2023-11-26T07:17:35.290817+0000","last_became_peered":"2023-11-26T07:17:35.290817+0000","last_unstale":"2023-11-26T07:17:36.288966+0000","last_undegraded":"2023-11-26T07:17:36.288966+0000","last_fullsized":"2023-11-26T07:17:36.288966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291138+0000","last_change":"2023-11-26T07:17:35.299321+0000","last_active":"2023-11-26T07:17:36.291138+0000","last_peered":"2023-11-26T07:17:36.291138+0000","last_clean":"2023-11-26T07:17:36.291138+0000","last_became_active":"2023-11-26T07:17:35.296813+0000","last_became_peered":"2023-11-26T07:17:35.296813+0000","last_unstale":"2023-11-26T07:17:36.291138+0000","last_undegraded":"2023-11-26T07:17:36.291138+0000","last_fullsized":"2023-11-26T07:17:36.291138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.347730+0000","last_change":"2023-11-26T07:17:35.298470+0000","last_active":"2023-11-26T07:17:36.347730+0000","last_peered":"2023-11-26T07:17:36.347730+0000","last_clean":"2023-11-26T07:17:36.347730+0000","last_became_active":"2023-11-26T07:17:35.298120+0000","last_became_peered":"2023-11-26T07:17:35.298120+0000","last_unstale":"2023-11-26T07:17:36.347730+0000","last_undegraded":"2023-11-26T07:17:36.347730+0000","last_fullsized":"2023-11-26T07:17:36.347730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:01.790753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853467+0000","last_change":"2023-11-26T07:17:35.286010+0000","last_active":"2023-11-26T07:17:36.853467+0000","last_peered":"2023-11-26T07:17:36.853467+0000","last_clean":"2023-11-26T07:17:36.853467+0000","last_became_active":"2023-11-26T07:17:35.284996+0000","last_became_peered":"2023-11-26T07:17:35.284996+0000","last_unstale":"2023-11-26T07:17:36.853467+0000","last_undegraded":"2023-11-26T07:17:36.853467+0000","last_fullsized":"2023-11-26T07:17:36.853467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:51.436807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855545+0000","last_change":"2023-11-26T07:17:35.287101+0000","last_active":"2023-11-26T07:17:36.855545+0000","last_peered":"2023-11-26T07:17:36.855545+0000","last_clean":"2023-11-26T07:17:36.855545+0000","last_became_active":"2023-11-26T07:17:35.286319+0000","last_became_peered":"2023-11-26T07:17:35.286319+0000","last_unstale":"2023-11-26T07:17:36.855545+0000","last_undegraded":"2023-11-26T07:17:36.855545+0000","last_fullsized":"2023-11-26T07:17:36.855545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:27.986808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308605+0000","last_change":"2023-11-26T07:17:34.260424+0000","last_active":"2023-11-26T07:17:35.308605+0000","last_peered":"2023-11-26T07:17:35.308605+0000","last_clean":"2023-11-26T07:17:35.308605+0000","last_became_active":"2023-11-26T07:17:34.260186+0000","last_became_peered":"2023-11-26T07:17:34.260186+0000","last_unstale":"2023-11-26T07:17:35.308605+0000","last_undegraded":"2023-11-26T07:17:35.308605+0000","last_fullsized":"2023-11-26T07:17:35.308605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:50.431819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289063+0000","last_change":"2023-11-26T07:17:35.296870+0000","last_active":"2023-11-26T07:17:36.289063+0000","last_peered":"2023-11-26T07:17:36.289063+0000","last_clean":"2023-11-26T07:17:36.289063+0000","last_became_active":"2023-11-26T07:17:35.296511+0000","last_became_peered":"2023-11-26T07:17:35.296511+0000","last_unstale":"2023-11-26T07:17:36.289063+0000","last_undegraded":"2023-11-26T07:17:36.289063+0000","last_fullsized":"2023-11-26T07:17:36.289063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312260+0000","last_change":"2023-11-26T07:17:34.272272+0000","last_active":"2023-11-26T07:17:35.312260+0000","last_peered":"2023-11-26T07:17:35.312260+0000","last_clean":"2023-11-26T07:17:35.312260+0000","last_became_active":"2023-11-26T07:17:34.271546+0000","last_became_peered":"2023-11-26T07:17:34.271546+0000","last_unstale":"2023-11-26T07:17:35.312260+0000","last_undegraded":"2023-11-26T07:17:35.312260+0000","last_fullsized":"2023-11-26T07:17:35.312260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:07.401822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.263326+0000","last_change":"2023-11-26T07:17:34.270516+0000","last_active":"2023-11-26T07:17:35.263326+0000","last_peered":"2023-11-26T07:17:35.263326+0000","last_clean":"2023-11-26T07:17:35.263326+0000","last_became_active":"2023-11-26T07:17:34.270272+0000","last_became_peered":"2023-11-26T07:17:34.270272+0000","last_unstale":"2023-11-26T07:17:35.263326+0000","last_undegraded":"2023-11-26T07:17:35.263326+0000","last_fullsized":"2023-11-26T07:17:35.263326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:31.214665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290438+0000","last_change":"2023-11-26T07:17:35.282691+0000","last_active":"2023-11-26T07:17:36.290438+0000","last_peered":"2023-11-26T07:17:36.290438+0000","last_clean":"2023-11-26T07:17:36.290438+0000","last_became_active":"2023-11-26T07:17:35.282434+0000","last_became_peered":"2023-11-26T07:17:35.282434+0000","last_unstale":"2023-11-26T07:17:36.290438+0000","last_undegraded":"2023-11-26T07:17:36.290438+0000","last_fullsized":"2023-11-26T07:17:36.290438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.263324+0000","last_change":"2023-11-26T07:17:34.264012+0000","last_active":"2023-11-26T07:17:35.263324+0000","last_peered":"2023-11-26T07:17:35.263324+0000","last_clean":"2023-11-26T07:17:35.263324+0000","last_became_active":"2023-11-26T07:17:34.262939+0000","last_became_peered":"2023-11-26T07:17:34.262939+0000","last_unstale":"2023-11-26T07:17:35.263324+0000","last_undegraded":"2023-11-26T07:17:35.263324+0000","last_fullsized":"2023-11-26T07:17:35.263324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:47.932199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852561+0000","last_change":"2023-11-26T07:17:35.290951+0000","last_active":"2023-11-26T07:17:36.852561+0000","last_peered":"2023-11-26T07:17:36.852561+0000","last_clean":"2023-11-26T07:17:36.852561+0000","last_became_active":"2023-11-26T07:17:35.290575+0000","last_became_peered":"2023-11-26T07:17:35.290575+0000","last_unstale":"2023-11-26T07:17:36.852561+0000","last_undegraded":"2023-11-26T07:17:36.852561+0000","last_fullsized":"2023-11-26T07:17:36.852561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.274062+0000","last_change":"2023-11-26T07:17:34.270339+0000","last_active":"2023-11-26T07:17:35.274062+0000","last_peered":"2023-11-26T07:17:35.274062+0000","last_clean":"2023-11-26T07:17:35.274062+0000","last_became_active":"2023-11-26T07:17:34.270058+0000","last_became_peered":"2023-11-26T07:17:34.270058+0000","last_unstale":"2023-11-26T07:17:35.274062+0000","last_undegraded":"2023-11-26T07:17:35.274062+0000","last_fullsized":"2023-11-26T07:17:35.274062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:00.785765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.292197+0000","last_change":"2023-11-26T07:17:35.292487+0000","last_active":"2023-11-26T07:17:36.292197+0000","last_peered":"2023-11-26T07:17:36.292197+0000","last_clean":"2023-11-26T07:17:36.292197+0000","last_became_active":"2023-11-26T07:17:35.291651+0000","last_became_peered":"2023-11-26T07:17:35.291651+0000","last_unstale":"2023-11-26T07:17:36.292197+0000","last_undegraded":"2023-11-26T07:17:36.292197+0000","last_fullsized":"2023-11-26T07:17:36.292197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:14:14.039125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.264303+0000","last_change":"2023-11-26T07:17:34.271134+0000","last_active":"2023-11-26T07:17:35.264303+0000","last_peered":"2023-11-26T07:17:35.264303+0000","last_clean":"2023-11-26T07:17:35.264303+0000","last_became_active":"2023-11-26T07:17:34.270420+0000","last_became_peered":"2023-11-26T07:17:34.270420+0000","last_unstale":"2023-11-26T07:17:35.264303+0000","last_undegraded":"2023-11-26T07:17:35.264303+0000","last_fullsized":"2023-11-26T07:17:35.264303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:39.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289872+0000","last_change":"2023-11-26T07:17:35.290019+0000","last_active":"2023-11-26T07:17:36.289872+0000","last_peered":"2023-11-26T07:17:36.289872+0000","last_clean":"2023-11-26T07:17:36.289872+0000","last_became_active":"2023-11-26T07:17:35.289735+0000","last_became_peered":"2023-11-26T07:17:35.289735+0000","last_unstale":"2023-11-26T07:17:36.289872+0000","last_undegraded":"2023-11-26T07:17:36.289872+0000","last_fullsized":"2023-11-26T07:17:36.289872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.309286+0000","last_change":"2023-11-26T07:17:34.253890+0000","last_active":"2023-11-26T07:17:35.309286+0000","last_peered":"2023-11-26T07:17:35.309286+0000","last_clean":"2023-11-26T07:17:35.309286+0000","last_became_active":"2023-11-26T07:17:34.252298+0000","last_became_peered":"2023-11-26T07:17:34.252298+0000","last_unstale":"2023-11-26T07:17:35.309286+0000","last_undegraded":"2023-11-26T07:17:35.309286+0000","last_fullsized":"2023-11-26T07:17:35.309286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:04.297880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857233+0000","last_change":"2023-11-26T07:17:35.299159+0000","last_active":"2023-11-26T07:17:36.857233+0000","last_peered":"2023-11-26T07:17:36.857233+0000","last_clean":"2023-11-26T07:17:36.857233+0000","last_became_active":"2023-11-26T07:17:35.298172+0000","last_became_peered":"2023-11-26T07:17:35.298172+0000","last_unstale":"2023-11-26T07:17:36.857233+0000","last_undegraded":"2023-11-26T07:17:36.857233+0000","last_fullsized":"2023-11-26T07:17:36.857233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:01.790753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.313145+0000","last_change":"2023-11-26T07:17:34.269809+0000","last_active":"2023-11-26T07:17:35.313145+0000","last_peered":"2023-11-26T07:17:35.313145+0000","last_clean":"2023-11-26T07:17:35.313145+0000","last_became_active":"2023-11-26T07:17:34.264015+0000","last_became_peered":"2023-11-26T07:17:34.264015+0000","last_unstale":"2023-11-26T07:17:35.313145+0000","last_undegraded":"2023-11-26T07:17:35.313145+0000","last_fullsized":"2023-11-26T07:17:35.313145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853444+0000","last_change":"2023-11-26T07:17:35.290779+0000","last_active":"2023-11-26T07:17:36.853444+0000","last_peered":"2023-11-26T07:17:36.853444+0000","last_clean":"2023-11-26T07:17:36.853444+0000","last_became_active":"2023-11-26T07:17:35.290504+0000","last_became_peered":"2023-11-26T07:17:35.290504+0000","last_unstale":"2023-11-26T07:17:36.853444+0000","last_undegraded":"2023-11-26T07:17:36.853444+0000","last_fullsized":"2023-11-26T07:17:36.853444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312451+0000","last_change":"2023-11-26T07:17:34.261601+0000","last_active":"2023-11-26T07:17:35.312451+0000","last_peered":"2023-11-26T07:17:35.312451+0000","last_clean":"2023-11-26T07:17:35.312451+0000","last_became_active":"2023-11-26T07:17:34.261232+0000","last_became_peered":"2023-11-26T07:17:34.261232+0000","last_unstale":"2023-11-26T07:17:35.312451+0000","last_undegraded":"2023-11-26T07:17:35.312451+0000","last_fullsized":"2023-11-26T07:17:35.312451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:30.401691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288255+0000","last_change":"2023-11-26T07:17:35.290421+0000","last_active":"2023-11-26T07:17:36.288255+0000","last_peered":"2023-11-26T07:17:36.288255+0000","last_clean":"2023-11-26T07:17:36.288255+0000","last_became_active":"2023-11-26T07:17:35.290069+0000","last_became_peered":"2023-11-26T07:17:35.290069+0000","last_unstale":"2023-11-26T07:17:36.288255+0000","last_undegraded":"2023-11-26T07:17:36.288255+0000","last_fullsized":"2023-11-26T07:17:36.288255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:05.302868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.266362+0000","last_change":"2023-11-26T07:17:34.263984+0000","last_active":"2023-11-26T07:17:35.266362+0000","last_peered":"2023-11-26T07:17:35.266362+0000","last_clean":"2023-11-26T07:17:35.266362+0000","last_became_active":"2023-11-26T07:17:34.263647+0000","last_became_peered":"2023-11-26T07:17:34.263647+0000","last_unstale":"2023-11-26T07:17:35.266362+0000","last_undegraded":"2023-11-26T07:17:35.266362+0000","last_fullsized":"2023-11-26T07:17:35.266362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:50.841460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853983+0000","last_change":"2023-11-26T07:17:35.307695+0000","last_active":"2023-11-26T07:17:36.853983+0000","last_peered":"2023-11-26T07:17:36.853983+0000","last_clean":"2023-11-26T07:17:36.853983+0000","last_became_active":"2023-11-26T07:17:35.307322+0000","last_became_peered":"2023-11-26T07:17:35.307322+0000","last_unstale":"2023-11-26T07:17:36.853983+0000","last_undegraded":"2023-11-26T07:17:36.853983+0000","last_fullsized":"2023-11-26T07:17:36.853983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:31.633994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.271599+0000","last_change":"2023-11-26T07:17:34.267209+0000","last_active":"2023-11-26T07:17:35.271599+0000","last_peered":"2023-11-26T07:17:35.271599+0000","last_clean":"2023-11-26T07:17:35.271599+0000","last_became_active":"2023-11-26T07:17:34.266896+0000","last_became_peered":"2023-11-26T07:17:34.266896+0000","last_unstale":"2023-11-26T07:17:35.271599+0000","last_undegraded":"2023-11-26T07:17:35.271599+0000","last_fullsized":"2023-11-26T07:17:35.271599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:26.981820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853828+0000","last_change":"2023-11-26T07:17:35.285662+0000","last_active":"2023-11-26T07:17:36.853828+0000","last_peered":"2023-11-26T07:17:36.853828+0000","last_clean":"2023-11-26T07:17:36.853828+0000","last_became_active":"2023-11-26T07:17:35.285344+0000","last_became_peered":"2023-11-26T07:17:35.285344+0000","last_unstale":"2023-11-26T07:17:36.853828+0000","last_undegraded":"2023-11-26T07:17:36.853828+0000","last_fullsized":"2023-11-26T07:17:36.853828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.313128+0000","last_change":"2023-11-26T07:17:34.255794+0000","last_active":"2023-11-26T07:17:35.313128+0000","last_peered":"2023-11-26T07:17:35.313128+0000","last_clean":"2023-11-26T07:17:35.313128+0000","last_became_active":"2023-11-26T07:17:34.255495+0000","last_became_peered":"2023-11-26T07:17:34.255495+0000","last_unstale":"2023-11-26T07:17:35.313128+0000","last_undegraded":"2023-11-26T07:17:35.313128+0000","last_fullsized":"2023-11-26T07:17:35.313128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:26.981820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853750+0000","last_change":"2023-11-26T07:17:35.299739+0000","last_active":"2023-11-26T07:17:36.853750+0000","last_peered":"2023-11-26T07:17:36.853750+0000","last_clean":"2023-11-26T07:17:36.853750+0000","last_became_active":"2023-11-26T07:17:35.299412+0000","last_became_peered":"2023-11-26T07:17:35.299412+0000","last_unstale":"2023-11-26T07:17:36.853750+0000","last_undegraded":"2023-11-26T07:17:36.853750+0000","last_fullsized":"2023-11-26T07:17:36.853750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.311528+0000","last_change":"2023-11-26T07:17:34.261567+0000","last_active":"2023-11-26T07:17:35.311528+0000","last_peered":"2023-11-26T07:17:35.311528+0000","last_clean":"2023-11-26T07:17:35.311528+0000","last_became_active":"2023-11-26T07:17:34.261083+0000","last_became_peered":"2023-11-26T07:17:34.261083+0000","last_unstale":"2023-11-26T07:17:35.311528+0000","last_undegraded":"2023-11-26T07:17:35.311528+0000","last_fullsized":"2023-11-26T07:17:35.311528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:33:02.627652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857599+0000","last_change":"2023-11-26T07:17:35.307619+0000","last_active":"2023-11-26T07:17:36.857599+0000","last_peered":"2023-11-26T07:17:36.857599+0000","last_clean":"2023-11-26T07:17:36.857599+0000","last_became_active":"2023-11-26T07:17:35.307322+0000","last_became_peered":"2023-11-26T07:17:35.307322+0000","last_unstale":"2023-11-26T07:17:36.857599+0000","last_undegraded":"2023-11-26T07:17:36.857599+0000","last_fullsized":"2023-11-26T07:17:36.857599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:59:08.684829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308810+0000","last_change":"2023-11-26T07:17:34.259965+0000","last_active":"2023-11-26T07:17:35.308810+0000","last_peered":"2023-11-26T07:17:35.308810+0000","last_clean":"2023-11-26T07:17:35.308810+0000","last_became_active":"2023-11-26T07:17:34.259453+0000","last_became_peered":"2023-11-26T07:17:34.259453+0000","last_unstale":"2023-11-26T07:17:35.308810+0000","last_undegraded":"2023-11-26T07:17:35.308810+0000","last_fullsized":"2023-11-26T07:17:35.308810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:31.214665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857855+0000","last_change":"2023-11-26T07:17:35.305671+0000","last_active":"2023-11-26T07:17:36.857855+0000","last_peered":"2023-11-26T07:17:36.857855+0000","last_clean":"2023-11-26T07:17:36.857855+0000","last_became_active":"2023-11-26T07:17:35.304797+0000","last_became_peered":"2023-11-26T07:17:35.304797+0000","last_unstale":"2023-11-26T07:17:36.857855+0000","last_undegraded":"2023-11-26T07:17:36.857855+0000","last_fullsized":"2023-11-26T07:17:36.857855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:37:30.364077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312107+0000","last_change":"2023-11-26T07:17:34.260843+0000","last_active":"2023-11-26T07:17:35.312107+0000","last_peered":"2023-11-26T07:17:35.312107+0000","last_clean":"2023-11-26T07:17:35.312107+0000","last_became_active":"2023-11-26T07:17:34.260492+0000","last_became_peered":"2023-11-26T07:17:34.260492+0000","last_unstale":"2023-11-26T07:17:35.312107+0000","last_undegraded":"2023-11-26T07:17:35.312107+0000","last_fullsized":"2023-11-26T07:17:35.312107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:56.938162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291587+0000","last_change":"2023-11-26T07:17:35.299197+0000","last_active":"2023-11-26T07:17:36.291587+0000","last_peered":"2023-11-26T07:17:36.291587+0000","last_clean":"2023-11-26T07:17:36.291587+0000","last_became_active":"2023-11-26T07:17:35.297708+0000","last_became_peered":"2023-11-26T07:17:35.297708+0000","last_unstale":"2023-11-26T07:17:36.291587+0000","last_undegraded":"2023-11-26T07:17:36.291587+0000","last_fullsized":"2023-11-26T07:17:36.291587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:51:44.669299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275592+0000","last_change":"2023-11-26T07:17:34.263596+0000","last_active":"2023-11-26T07:17:35.275592+0000","last_peered":"2023-11-26T07:17:35.275592+0000","last_clean":"2023-11-26T07:17:35.275592+0000","last_became_active":"2023-11-26T07:17:34.263296+0000","last_became_peered":"2023-11-26T07:17:34.263296+0000","last_unstale":"2023-11-26T07:17:35.275592+0000","last_undegraded":"2023-11-26T07:17:35.275592+0000","last_fullsized":"2023-11-26T07:17:35.275592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:07.401822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853854+0000","last_change":"2023-11-26T07:17:35.295518+0000","last_active":"2023-11-26T07:17:36.853854+0000","last_peered":"2023-11-26T07:17:36.853854+0000","last_clean":"2023-11-26T07:17:36.853854+0000","last_became_active":"2023-11-26T07:17:35.295352+0000","last_became_peered":"2023-11-26T07:17:35.295352+0000","last_unstale":"2023-11-26T07:17:36.853854+0000","last_undegraded":"2023-11-26T07:17:36.853854+0000","last_fullsized":"2023-11-26T07:17:36.853854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275660+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:17:35.275660+0000","last_peered":"2023-11-26T07:17:35.275660+0000","last_clean":"2023-11-26T07:17:35.275660+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:17:35.275660+0000","last_undegraded":"2023-11-26T07:17:35.275660+0000","last_fullsized":"2023-11-26T07:17:35.275660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.260546+0000","last_change":"2023-11-26T07:17:34.260166+0000","last_active":"2023-11-26T07:17:35.260546+0000","last_peered":"2023-11-26T07:17:35.260546+0000","last_clean":"2023-11-26T07:17:35.260546+0000","last_became_active":"2023-11-26T07:17:34.259813+0000","last_became_peered":"2023-11-26T07:17:34.259813+0000","last_unstale":"2023-11-26T07:17:35.260546+0000","last_undegraded":"2023-11-26T07:17:35.260546+0000","last_fullsized":"2023-11-26T07:17:35.260546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290730+0000","last_change":"2023-11-26T07:17:35.287427+0000","last_active":"2023-11-26T07:17:36.290730+0000","last_peered":"2023-11-26T07:17:36.290730+0000","last_clean":"2023-11-26T07:17:36.290730+0000","last_became_active":"2023-11-26T07:17:35.287153+0000","last_became_peered":"2023-11-26T07:17:35.287153+0000","last_unstale":"2023-11-26T07:17:36.290730+0000","last_undegraded":"2023-11-26T07:17:36.290730+0000","last_fullsized":"2023-11-26T07:17:36.290730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275512+0000","last_change":"2023-11-26T07:17:34.271952+0000","last_active":"2023-11-26T07:17:35.275512+0000","last_peered":"2023-11-26T07:17:35.275512+0000","last_clean":"2023-11-26T07:17:35.275512+0000","last_became_active":"2023-11-26T07:17:34.271686+0000","last_became_peered":"2023-11-26T07:17:34.271686+0000","last_unstale":"2023-11-26T07:17:35.275512+0000","last_undegraded":"2023-11-26T07:17:35.275512+0000","last_fullsized":"2023-11-26T07:17:35.275512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.287880+0000","last_change":"2023-11-26T07:17:35.289335+0000","last_active":"2023-11-26T07:17:36.287880+0000","last_peered":"2023-11-26T07:17:36.287880+0000","last_clean":"2023-11-26T07:17:36.287880+0000","last_became_active":"2023-11-26T07:17:35.288975+0000","last_became_peered":"2023-11-26T07:17:35.288975+0000","last_unstale":"2023-11-26T07:17:36.287880+0000","last_undegraded":"2023-11-26T07:17:36.287880+0000","last_fullsized":"2023-11-26T07:17:36.287880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:35.805458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.271170+0000","last_change":"2023-11-26T07:17:34.259717+0000","last_active":"2023-11-26T07:17:35.271170+0000","last_peered":"2023-11-26T07:17:35.271170+0000","last_clean":"2023-11-26T07:17:35.271170+0000","last_became_active":"2023-11-26T07:17:34.259440+0000","last_became_peered":"2023-11-26T07:17:34.259440+0000","last_unstale":"2023-11-26T07:17:35.271170+0000","last_undegraded":"2023-11-26T07:17:35.271170+0000","last_fullsized":"2023-11-26T07:17:35.271170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:19:01.400658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852532+0000","last_change":"2023-11-26T07:17:35.284821+0000","last_active":"2023-11-26T07:17:36.852532+0000","last_peered":"2023-11-26T07:17:36.852532+0000","last_clean":"2023-11-26T07:17:36.852532+0000","last_became_active":"2023-11-26T07:17:35.283626+0000","last_became_peered":"2023-11-26T07:17:35.283626+0000","last_unstale":"2023-11-26T07:17:36.852532+0000","last_undegraded":"2023-11-26T07:17:36.852532+0000","last_fullsized":"2023-11-26T07:17:36.852532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.265947+0000","last_change":"2023-11-26T07:17:34.258767+0000","last_active":"2023-11-26T07:17:35.265947+0000","last_peered":"2023-11-26T07:17:35.265947+0000","last_clean":"2023-11-26T07:17:35.265947+0000","last_became_active":"2023-11-26T07:17:34.257967+0000","last_became_peered":"2023-11-26T07:17:34.257967+0000","last_unstale":"2023-11-26T07:17:35.265947+0000","last_undegraded":"2023-11-26T07:17:35.265947+0000","last_fullsized":"2023-11-26T07:17:35.265947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:13.669938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856130+0000","last_change":"2023-11-26T07:17:35.303810+0000","last_active":"2023-11-26T07:17:36.856130+0000","last_peered":"2023-11-26T07:17:36.856130+0000","last_clean":"2023-11-26T07:17:36.856130+0000","last_became_active":"2023-11-26T07:17:35.303085+0000","last_became_peered":"2023-11-26T07:17:35.303085+0000","last_unstale":"2023-11-26T07:17:36.856130+0000","last_undegraded":"2023-11-26T07:17:36.856130+0000","last_fullsized":"2023-11-26T07:17:36.856130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:08.406810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.278333+0000","last_change":"2023-11-26T07:17:34.256005+0000","last_active":"2023-11-26T07:17:35.278333+0000","last_peered":"2023-11-26T07:17:35.278333+0000","last_clean":"2023-11-26T07:17:35.278333+0000","last_became_active":"2023-11-26T07:17:34.255598+0000","last_became_peered":"2023-11-26T07:17:34.255598+0000","last_unstale":"2023-11-26T07:17:35.278333+0000","last_undegraded":"2023-11-26T07:17:35.278333+0000","last_fullsized":"2023-11-26T07:17:35.278333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:47.932199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291901+0000","last_change":"2023-11-26T07:17:35.293918+0000","last_active":"2023-11-26T07:17:36.291901+0000","last_peered":"2023-11-26T07:17:36.291901+0000","last_clean":"2023-11-26T07:17:36.291901+0000","last_became_active":"2023-11-26T07:17:35.293651+0000","last_became_peered":"2023-11-26T07:17:35.293651+0000","last_unstale":"2023-11-26T07:17:36.291901+0000","last_undegraded":"2023-11-26T07:17:36.291901+0000","last_fullsized":"2023-11-26T07:17:36.291901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:59:08.684829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.285652+0000","last_change":"2023-11-26T07:17:34.274703+0000","last_active":"2023-11-26T07:17:35.285652+0000","last_peered":"2023-11-26T07:17:35.285652+0000","last_clean":"2023-11-26T07:17:35.285652+0000","last_became_active":"2023-11-26T07:17:34.274347+0000","last_became_peered":"2023-11-26T07:17:34.274347+0000","last_unstale":"2023-11-26T07:17:35.285652+0000","last_undegraded":"2023-11-26T07:17:35.285652+0000","last_fullsized":"2023-11-26T07:17:35.285652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:13.669938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852897+0000","last_change":"2023-11-26T07:17:35.282993+0000","last_active":"2023-11-26T07:17:36.852897+0000","last_peered":"2023-11-26T07:17:36.852897+0000","last_clean":"2023-11-26T07:17:36.852897+0000","last_became_active":"2023-11-26T07:17:35.282727+0000","last_became_peered":"2023-11-26T07:17:35.282727+0000","last_unstale":"2023-11-26T07:17:36.852897+0000","last_undegraded":"2023-11-26T07:17:36.852897+0000","last_fullsized":"2023-11-26T07:17:36.852897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.277968+0000","last_change":"2023-11-26T07:17:34.271447+0000","last_active":"2023-11-26T07:17:35.277968+0000","last_peered":"2023-11-26T07:17:35.277968+0000","last_clean":"2023-11-26T07:17:35.277968+0000","last_became_active":"2023-11-26T07:17:34.270049+0000","last_became_peered":"2023-11-26T07:17:34.270049+0000","last_unstale":"2023-11-26T07:17:35.277968+0000","last_undegraded":"2023-11-26T07:17:35.277968+0000","last_fullsized":"2023-11-26T07:17:35.277968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291300+0000","last_change":"2023-11-26T07:17:35.296985+0000","last_active":"2023-11-26T07:17:36.291300+0000","last_peered":"2023-11-26T07:17:36.291300+0000","last_clean":"2023-11-26T07:17:36.291300+0000","last_became_active":"2023-11-26T07:17:35.296635+0000","last_became_peered":"2023-11-26T07:17:35.296635+0000","last_unstale":"2023-11-26T07:17:36.291300+0000","last_undegraded":"2023-11-26T07:17:36.291300+0000","last_fullsized":"2023-11-26T07:17:36.291300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.309336+0000","last_change":"2023-11-26T07:17:34.272765+0000","last_active":"2023-11-26T07:17:35.309336+0000","last_peered":"2023-11-26T07:17:35.309336+0000","last_clean":"2023-11-26T07:17:35.309336+0000","last_became_active":"2023-11-26T07:17:34.272359+0000","last_became_peered":"2023-11-26T07:17:34.272359+0000","last_unstale":"2023-11-26T07:17:35.309336+0000","last_undegraded":"2023-11-26T07:17:35.309336+0000","last_fullsized":"2023-11-26T07:17:35.309336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289184+0000","last_change":"2023-11-26T07:17:35.280353+0000","last_active":"2023-11-26T07:17:36.289184+0000","last_peered":"2023-11-26T07:17:36.289184+0000","last_clean":"2023-11-26T07:17:36.289184+0000","last_became_active":"2023-11-26T07:17:35.280060+0000","last_became_peered":"2023-11-26T07:17:35.280060+0000","last_unstale":"2023-11-26T07:17:36.289184+0000","last_undegraded":"2023-11-26T07:17:36.289184+0000","last_fullsized":"2023-11-26T07:17:36.289184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275318+0000","last_change":"2023-11-26T07:17:34.275747+0000","last_active":"2023-11-26T07:17:35.275318+0000","last_peered":"2023-11-26T07:17:35.275318+0000","last_clean":"2023-11-26T07:17:35.275318+0000","last_became_active":"2023-11-26T07:17:34.275273+0000","last_became_peered":"2023-11-26T07:17:34.275273+0000","last_unstale":"2023-11-26T07:17:35.275318+0000","last_undegraded":"2023-11-26T07:17:35.275318+0000","last_fullsized":"2023-11-26T07:17:35.275318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:44:58.427847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853734+0000","last_change":"2023-11-26T07:17:35.287995+0000","last_active":"2023-11-26T07:17:36.853734+0000","last_peered":"2023-11-26T07:17:36.853734+0000","last_clean":"2023-11-26T07:17:36.853734+0000","last_became_active":"2023-11-26T07:17:35.287690+0000","last_became_peered":"2023-11-26T07:17:35.287690+0000","last_unstale":"2023-11-26T07:17:36.853734+0000","last_undegraded":"2023-11-26T07:17:36.853734+0000","last_fullsized":"2023-11-26T07:17:36.853734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:32.219653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.276561+0000","last_change":"2023-11-26T07:17:34.261040+0000","last_active":"2023-11-26T07:17:35.276561+0000","last_peered":"2023-11-26T07:17:35.276561+0000","last_clean":"2023-11-26T07:17:35.276561+0000","last_became_active":"2023-11-26T07:17:34.260678+0000","last_became_peered":"2023-11-26T07:17:34.260678+0000","last_unstale":"2023-11-26T07:17:35.276561+0000","last_undegraded":"2023-11-26T07:17:35.276561+0000","last_fullsized":"2023-11-26T07:17:35.276561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290254+0000","last_change":"2023-11-26T07:17:35.280159+0000","last_active":"2023-11-26T07:17:36.290254+0000","last_peered":"2023-11-26T07:17:36.290254+0000","last_clean":"2023-11-26T07:17:36.290254+0000","last_became_active":"2023-11-26T07:17:35.279819+0000","last_became_peered":"2023-11-26T07:17:35.279819+0000","last_unstale":"2023-11-26T07:17:36.290254+0000","last_undegraded":"2023-11-26T07:17:36.290254+0000","last_fullsized":"2023-11-26T07:17:36.290254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.278229+0000","last_change":"2023-11-26T07:17:34.248282+0000","last_active":"2023-11-26T07:17:35.278229+0000","last_peered":"2023-11-26T07:17:35.278229+0000","last_clean":"2023-11-26T07:17:35.278229+0000","last_became_active":"2023-11-26T07:17:34.247565+0000","last_became_peered":"2023-11-26T07:17:34.247565+0000","last_unstale":"2023-11-26T07:17:35.278229+0000","last_undegraded":"2023-11-26T07:17:35.278229+0000","last_fullsized":"2023-11-26T07:17:35.278229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:50.431819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291259+0000","last_change":"2023-11-26T07:17:35.284496+0000","last_active":"2023-11-26T07:17:36.291259+0000","last_peered":"2023-11-26T07:17:36.291259+0000","last_clean":"2023-11-26T07:17:36.291259+0000","last_became_active":"2023-11-26T07:17:35.283640+0000","last_became_peered":"2023-11-26T07:17:35.283640+0000","last_unstale":"2023-11-26T07:17:36.291259+0000","last_undegraded":"2023-11-26T07:17:36.291259+0000","last_fullsized":"2023-11-26T07:17:36.291259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312542+0000","last_change":"2023-11-26T07:17:34.270854+0000","last_active":"2023-11-26T07:17:35.312542+0000","last_peered":"2023-11-26T07:17:35.312542+0000","last_clean":"2023-11-26T07:17:35.312542+0000","last_became_active":"2023-11-26T07:17:34.270525+0000","last_became_peered":"2023-11-26T07:17:34.270525+0000","last_unstale":"2023-11-26T07:17:35.312542+0000","last_undegraded":"2023-11-26T07:17:35.312542+0000","last_fullsized":"2023-11-26T07:17:35.312542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.854803+0000","last_change":"2023-11-26T07:17:35.288782+0000","last_active":"2023-11-26T07:17:36.854803+0000","last_peered":"2023-11-26T07:17:36.854803+0000","last_clean":"2023-11-26T07:17:36.854803+0000","last_became_active":"2023-11-26T07:17:35.287263+0000","last_became_peered":"2023-11-26T07:17:35.287263+0000","last_unstale":"2023-11-26T07:17:36.854803+0000","last_undegraded":"2023-11-26T07:17:36.854803+0000","last_fullsized":"2023-11-26T07:17:36.854803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291873+0000","last_change":"2023-11-26T07:17:35.303027+0000","last_active":"2023-11-26T07:17:36.291873+0000","last_peered":"2023-11-26T07:17:36.291873+0000","last_clean":"2023-11-26T07:17:36.291873+0000","last_became_active":"2023-11-26T07:17:35.302802+0000","last_became_peered":"2023-11-26T07:17:35.302802+0000","last_unstale":"2023-11-26T07:17:36.291873+0000","last_undegraded":"2023-11-26T07:17:36.291873+0000","last_fullsized":"2023-11-26T07:17:36.291873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:01:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.310109+0000","last_change":"2023-11-26T07:17:34.275614+0000","last_active":"2023-11-26T07:17:35.310109+0000","last_peered":"2023-11-26T07:17:35.310109+0000","last_clean":"2023-11-26T07:17:35.310109+0000","last_became_active":"2023-11-26T07:17:34.274852+0000","last_became_peered":"2023-11-26T07:17:34.274852+0000","last_unstale":"2023-11-26T07:17:35.310109+0000","last_undegraded":"2023-11-26T07:17:35.310109+0000","last_fullsized":"2023-11-26T07:17:35.310109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291376+0000","last_change":"2023-11-26T07:17:35.302995+0000","last_active":"2023-11-26T07:17:36.291376+0000","last_peered":"2023-11-26T07:17:36.291376+0000","last_clean":"2023-11-26T07:17:36.291376+0000","last_became_active":"2023-11-26T07:17:35.302669+0000","last_became_peered":"2023-11-26T07:17:35.302669+0000","last_unstale":"2023-11-26T07:17:36.291376+0000","last_undegraded":"2023-11-26T07:17:36.291376+0000","last_fullsized":"2023-11-26T07:17:36.291376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:31.633994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308916+0000","last_change":"2023-11-26T07:17:34.275105+0000","last_active":"2023-11-26T07:17:35.308916+0000","last_peered":"2023-11-26T07:17:35.308916+0000","last_clean":"2023-11-26T07:17:35.308916+0000","last_became_active":"2023-11-26T07:17:34.274649+0000","last_became_peered":"2023-11-26T07:17:34.274649+0000","last_unstale":"2023-11-26T07:17:35.308916+0000","last_undegraded":"2023-11-26T07:17:35.308916+0000","last_fullsized":"2023-11-26T07:17:35.308916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:04.297880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289574+0000","last_change":"2023-11-26T07:17:35.286325+0000","last_active":"2023-11-26T07:17:36.289574+0000","last_peered":"2023-11-26T07:17:36.289574+0000","last_clean":"2023-11-26T07:17:36.289574+0000","last_became_active":"2023-11-26T07:17:35.286007+0000","last_became_peered":"2023-11-26T07:17:35.286007+0000","last_unstale":"2023-11-26T07:17:36.289574+0000","last_undegraded":"2023-11-26T07:17:36.289574+0000","last_fullsized":"2023-11-26T07:17:36.289574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.307875+0000","last_change":"2023-11-26T07:17:34.258227+0000","last_active":"2023-11-26T07:17:35.307875+0000","last_peered":"2023-11-26T07:17:35.307875+0000","last_clean":"2023-11-26T07:17:35.307875+0000","last_became_active":"2023-11-26T07:17:34.257930+0000","last_became_peered":"2023-11-26T07:17:34.257930+0000","last_unstale":"2023-11-26T07:17:35.307875+0000","last_undegraded":"2023-11-26T07:17:35.307875+0000","last_fullsized":"2023-11-26T07:17:35.307875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291071+0000","last_change":"2023-11-26T07:17:35.286743+0000","last_active":"2023-11-26T07:17:36.291071+0000","last_peered":"2023-11-26T07:17:36.291071+0000","last_clean":"2023-11-26T07:17:36.291071+0000","last_became_active":"2023-11-26T07:17:35.286436+0000","last_became_peered":"2023-11-26T07:17:35.286436+0000","last_unstale":"2023-11-26T07:17:36.291071+0000","last_undegraded":"2023-11-26T07:17:36.291071+0000","last_fullsized":"2023-11-26T07:17:36.291071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.310076+0000","last_change":"2023-11-26T07:17:34.271042+0000","last_active":"2023-11-26T07:17:35.310076+0000","last_peered":"2023-11-26T07:17:35.310076+0000","last_clean":"2023-11-26T07:17:35.310076+0000","last_became_active":"2023-11-26T07:17:34.270720+0000","last_became_peered":"2023-11-26T07:17:34.270720+0000","last_unstale":"2023-11-26T07:17:35.310076+0000","last_undegraded":"2023-11-26T07:17:35.310076+0000","last_fullsized":"2023-11-26T07:17:35.310076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6080000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.76}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.931}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1030000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9239999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1749999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.966}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:17:39.663 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:17:39.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.914+0000 7f753b341640 1 Processor -- start 2023-11-26T07:17:39.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.915+0000 7f753b341640 1 -- start start 2023-11-26T07:17:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.916+0000 7f753b341640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f753406aa30 0x7f75340cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.916+0000 7f753b341640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340b28d0 0x7f75340cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.916+0000 7f753b341640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340b2690 con 0x7f75340cf420 2023-11-26T07:17:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.916+0000 7f753b341640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75340cc7f0 con 0x7f753406aa30 2023-11-26T07:17:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.916+0000 7f753b341640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753406ed00 con 0x7f75340b28d0 2023-11-26T07:17:39.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.917+0000 7f75388dc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340b28d0 0x7f75340cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.917+0000 7f75388dc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340b28d0 0x7f75340cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45418/0 (socket says 172.21.15.77:45418) 2023-11-26T07:17:39.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.917+0000 7f75388dc640 1 -- 172.21.15.77:0/3518411677 learned_addr learned my addr 172.21.15.77:0/3518411677 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:39.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.917+0000 7f75390dd640 1 --2- 172.21.15.77:0/3518411677 >> v2:172.21.15.159:3300/0 conn(0x7f753406aa30 0x7f75340cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.917+0000 7f75388dc640 1 -- 172.21.15.77:0/3518411677 >> v2:172.21.15.159:3300/0 conn(0x7f753406aa30 msgr2=0x7f75340cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:39.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.917+0000 7f75388dc640 1 --2- 172.21.15.77:0/3518411677 >> v2:172.21.15.159:3300/0 conn(0x7f753406aa30 0x7f75340cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.917+0000 7f75388dc640 1 -- 172.21.15.77:0/3518411677 >> v1:172.21.15.159:6789/0 conn(0x7f75340cf420 legacy=0x7f75341616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.917+0000 7f75388dc640 1 -- 172.21.15.77:0/3518411677 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753406efe0 con 0x7f75340b28d0 2023-11-26T07:17:39.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.919+0000 7f75388dc640 1 --2- 172.21.15.77:0/3518411677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340b28d0 0x7f75340cc990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7520009870 tx=0x7f752002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=833b1c852eb05e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.919+0000 7f7533fff640 1 -- 172.21.15.77:0/3518411677 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752002f840 con 0x7f75340b28d0 2023-11-26T07:17:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.919+0000 7f7533fff640 1 -- 172.21.15.77:0/3518411677 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752002f9a0 con 0x7f75340b28d0 2023-11-26T07:17:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.919+0000 7f7533fff640 1 -- 172.21.15.77:0/3518411677 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752002fd30 con 0x7f75340b28d0 2023-11-26T07:17:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.920+0000 7f753b341640 1 -- 172.21.15.77:0/3518411677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340b28d0 msgr2=0x7f75340cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.920+0000 7f753b341640 1 --2- 172.21.15.77:0/3518411677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340b28d0 0x7f75340cc990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7520009870 tx=0x7f752002ba20 comp rx=0 tx=0).stop 2023-11-26T07:17:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.920+0000 7f753b341640 1 -- 172.21.15.77:0/3518411677 shutdown_connections 2023-11-26T07:17:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.920+0000 7f753b341640 1 --2- 172.21.15.77:0/3518411677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340b28d0 0x7f75340cc990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.920+0000 7f753b341640 1 --2- 172.21.15.77:0/3518411677 >> v2:172.21.15.159:3300/0 conn(0x7f753406aa30 0x7f75340cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.920+0000 7f753b341640 1 -- 172.21.15.77:0/3518411677 >> 172.21.15.77:0/3518411677 conn(0x7f75340999d0 msgr2=0x7f75340b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.920+0000 7f753b341640 1 -- 172.21.15.77:0/3518411677 shutdown_connections 2023-11-26T07:17:39.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.920+0000 7f753b341640 1 -- 172.21.15.77:0/3518411677 wait complete. 2023-11-26T07:17:39.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.922+0000 7f753b341640 1 Processor -- start 2023-11-26T07:17:39.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.922+0000 7f753b341640 1 -- start start 2023-11-26T07:17:39.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f753b341640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753406aa30 0x7f753415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f753b341640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75340b28d0 0x7f753409b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f753b341640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340cf420 0x7f75340b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f753b341640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340c8240 con 0x7f753406aa30 2023-11-26T07:17:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f753b341640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340c8450 con 0x7f75340b28d0 2023-11-26T07:17:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f753b341640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340c8730 con 0x7f75340cf420 2023-11-26T07:17:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f75390dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753406aa30 0x7f753415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f75390dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753406aa30 0x7f753415d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34660/0 (socket says 172.21.15.77:34660) 2023-11-26T07:17:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f75390dd640 1 -- 172.21.15.77:0/1079526360 learned_addr learned my addr 172.21.15.77:0/1079526360 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f75388dc640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75340b28d0 0x7f753409b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f75398de640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340cf420 0x7f75340b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f75390dd640 1 -- 172.21.15.77:0/1079526360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340cf420 msgr2=0x7f75340b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f75390dd640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340cf420 0x7f75340b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f75390dd640 1 -- 172.21.15.77:0/1079526360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75340b28d0 msgr2=0x7f753409b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f75390dd640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75340b28d0 0x7f753409b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.923+0000 7f75390dd640 1 -- 172.21.15.77:0/1079526360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75200094d0 con 0x7f753406aa30 2023-11-26T07:17:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.924+0000 7f75390dd640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753406aa30 0x7f753415d920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f752800efc0 tx=0x7f752800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.924+0000 7f7531ffb640 1 -- 172.21.15.77:0/1079526360 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528014480 con 0x7f753406aa30 2023-11-26T07:17:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.924+0000 7f753b341640 1 -- 172.21.15.77:0/1079526360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75340c8a10 con 0x7f753406aa30 2023-11-26T07:17:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.924+0000 7f7531ffb640 1 -- 172.21.15.77:0/1079526360 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752800f040 con 0x7f753406aa30 2023-11-26T07:17:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.924+0000 7f7531ffb640 1 -- 172.21.15.77:0/1079526360 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528014800 con 0x7f753406aa30 2023-11-26T07:17:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.924+0000 7f753b341640 1 -- 172.21.15.77:0/1079526360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753415de60 con 0x7f753406aa30 2023-11-26T07:17:39.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.925+0000 7f753b341640 1 -- 172.21.15.77:0/1079526360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7534067470 con 0x7f753406aa30 2023-11-26T07:17:39.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.926+0000 7f7531ffb640 1 -- 172.21.15.77:0/1079526360 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7528014960 con 0x7f753406aa30 2023-11-26T07:17:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.927+0000 7f7531ffb640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f751806ae40 0x7f751806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.927+0000 7f7531ffb640 1 -- 172.21.15.77:0/1079526360 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f752808a320 con 0x7f753406aa30 2023-11-26T07:17:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.927+0000 7f75388dc640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f751806ae40 0x7f751806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.928+0000 7f75388dc640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f751806ae40 0x7f751806d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7520036000 tx=0x7f7520008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:39.931+0000 7f7531ffb640 1 -- 172.21.15.77:0/1079526360 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7528055340 con 0x7f753406aa30 2023-11-26T07:17:40.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.118+0000 7f753b341640 1 -- 172.21.15.77:0/1079526360 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75340cced0 con 0x7f751806ae40 2023-11-26T07:17:40.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.129+0000 7f7531ffb640 1 -- 172.21.15.77:0/1079526360 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264467 (secure 0 0 0) 0x7f752002fb10 con 0x7f751806ae40 2023-11-26T07:17:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:40.136 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:17:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 -- 172.21.15.77:0/1079526360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f751806ae40 msgr2=0x7f751806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f751806ae40 0x7f751806d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7520036000 tx=0x7f7520008030 comp rx=0 tx=0).stop 2023-11-26T07:17:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 -- 172.21.15.77:0/1079526360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753406aa30 msgr2=0x7f753415d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753406aa30 0x7f753415d920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f752800efc0 tx=0x7f752800c490 comp rx=0 tx=0).stop 2023-11-26T07:17:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 -- 172.21.15.77:0/1079526360 shutdown_connections 2023-11-26T07:17:40.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f751806ae40 0x7f751806d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75340cf420 0x7f75340b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75340b28d0 0x7f753409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 --2- 172.21.15.77:0/1079526360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753406aa30 0x7f753415d920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 -- 172.21.15.77:0/1079526360 >> 172.21.15.77:0/1079526360 conn(0x7f75340999d0 msgr2=0x7f753415f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 -- 172.21.15.77:0/1079526360 shutdown_connections 2023-11-26T07:17:40.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.135+0000 7f753b341640 1 -- 172.21.15.77:0/1079526360 wait complete. 2023-11-26T07:17:40.154 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-26T07:17:39.605418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001944"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857536+0000","last_change":"2023-11-26T07:17:35.294616+0000","last_active":"2023-11-26T07:17:36.857536+0000","last_peered":"2023-11-26T07:17:36.857536+0000","last_clean":"2023-11-26T07:17:36.857536+0000","last_became_active":"2023-11-26T07:17:35.294223+0000","last_became_peered":"2023-11-26T07:17:35.294223+0000","last_unstale":"2023-11-26T07:17:36.857536+0000","last_undegraded":"2023-11-26T07:17:36.857536+0000","last_fullsized":"2023-11-26T07:17:36.857536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:01:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853243+0000","last_change":"2023-11-26T07:17:35.285291+0000","last_active":"2023-11-26T07:17:36.853243+0000","last_peered":"2023-11-26T07:17:36.853243+0000","last_clean":"2023-11-26T07:17:36.853243+0000","last_became_active":"2023-11-26T07:17:35.285002+0000","last_became_peered":"2023-11-26T07:17:35.285002+0000","last_unstale":"2023-11-26T07:17:36.853243+0000","last_undegraded":"2023-11-26T07:17:36.853243+0000","last_fullsized":"2023-11-26T07:17:36.853243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289017+0000","last_change":"2023-11-26T07:17:35.289003+0000","last_active":"2023-11-26T07:17:36.289017+0000","last_peered":"2023-11-26T07:17:36.289017+0000","last_clean":"2023-11-26T07:17:36.289017+0000","last_became_active":"2023-11-26T07:17:35.288628+0000","last_became_peered":"2023-11-26T07:17:35.288628+0000","last_unstale":"2023-11-26T07:17:36.289017+0000","last_undegraded":"2023-11-26T07:17:36.289017+0000","last_fullsized":"2023-11-26T07:17:36.289017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291198+0000","last_change":"2023-11-26T07:17:35.299669+0000","last_active":"2023-11-26T07:17:36.291198+0000","last_peered":"2023-11-26T07:17:36.291198+0000","last_clean":"2023-11-26T07:17:36.291198+0000","last_became_active":"2023-11-26T07:17:35.298175+0000","last_became_peered":"2023-11-26T07:17:35.298175+0000","last_unstale":"2023-11-26T07:17:36.291198+0000","last_undegraded":"2023-11-26T07:17:36.291198+0000","last_fullsized":"2023-11-26T07:17:36.291198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853732+0000","last_change":"2023-11-26T07:17:35.290182+0000","last_active":"2023-11-26T07:17:36.853732+0000","last_peered":"2023-11-26T07:17:36.853732+0000","last_clean":"2023-11-26T07:17:36.853732+0000","last_became_active":"2023-11-26T07:17:35.289848+0000","last_became_peered":"2023-11-26T07:17:35.289848+0000","last_unstale":"2023-11-26T07:17:36.853732+0000","last_undegraded":"2023-11-26T07:17:36.853732+0000","last_fullsized":"2023-11-26T07:17:36.853732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290790+0000","last_change":"2023-11-26T07:17:35.275633+0000","last_active":"2023-11-26T07:17:36.290790+0000","last_peered":"2023-11-26T07:17:36.290790+0000","last_clean":"2023-11-26T07:17:36.290790+0000","last_became_active":"2023-11-26T07:17:35.275245+0000","last_became_peered":"2023-11-26T07:17:35.275245+0000","last_unstale":"2023-11-26T07:17:36.290790+0000","last_undegraded":"2023-11-26T07:17:36.290790+0000","last_fullsized":"2023-11-26T07:17:36.290790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853372+0000","last_change":"2023-11-26T07:17:35.289664+0000","last_active":"2023-11-26T07:17:36.853372+0000","last_peered":"2023-11-26T07:17:36.853372+0000","last_clean":"2023-11-26T07:17:36.853372+0000","last_became_active":"2023-11-26T07:17:35.289347+0000","last_became_peered":"2023-11-26T07:17:35.289347+0000","last_unstale":"2023-11-26T07:17:36.853372+0000","last_undegraded":"2023-11-26T07:17:36.853372+0000","last_fullsized":"2023-11-26T07:17:36.853372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290077+0000","last_change":"2023-11-26T07:17:35.285314+0000","last_active":"2023-11-26T07:17:36.290077+0000","last_peered":"2023-11-26T07:17:36.290077+0000","last_clean":"2023-11-26T07:17:36.290077+0000","last_became_active":"2023-11-26T07:17:35.283583+0000","last_became_peered":"2023-11-26T07:17:35.283583+0000","last_unstale":"2023-11-26T07:17:36.290077+0000","last_undegraded":"2023-11-26T07:17:36.290077+0000","last_fullsized":"2023-11-26T07:17:36.290077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857606+0000","last_change":"2023-11-26T07:17:35.294791+0000","last_active":"2023-11-26T07:17:36.857606+0000","last_peered":"2023-11-26T07:17:36.857606+0000","last_clean":"2023-11-26T07:17:36.857606+0000","last_became_active":"2023-11-26T07:17:35.294267+0000","last_became_peered":"2023-11-26T07:17:35.294267+0000","last_unstale":"2023-11-26T07:17:36.857606+0000","last_undegraded":"2023-11-26T07:17:36.857606+0000","last_fullsized":"2023-11-26T07:17:36.857606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:14:14.039125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856211+0000","last_change":"2023-11-26T07:17:35.291521+0000","last_active":"2023-11-26T07:17:36.856211+0000","last_peered":"2023-11-26T07:17:36.856211+0000","last_clean":"2023-11-26T07:17:36.856211+0000","last_became_active":"2023-11-26T07:17:35.290900+0000","last_became_peered":"2023-11-26T07:17:35.290900+0000","last_unstale":"2023-11-26T07:17:36.856211+0000","last_undegraded":"2023-11-26T07:17:36.856211+0000","last_fullsized":"2023-11-26T07:17:36.856211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855424+0000","last_change":"2023-11-26T07:17:35.293941+0000","last_active":"2023-11-26T07:17:36.855424+0000","last_peered":"2023-11-26T07:17:36.855424+0000","last_clean":"2023-11-26T07:17:36.855424+0000","last_became_active":"2023-11-26T07:17:35.293485+0000","last_became_peered":"2023-11-26T07:17:35.293485+0000","last_unstale":"2023-11-26T07:17:36.855424+0000","last_undegraded":"2023-11-26T07:17:36.855424+0000","last_fullsized":"2023-11-26T07:17:36.855424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856924+0000","last_change":"2023-11-26T07:17:35.302079+0000","last_active":"2023-11-26T07:17:36.856924+0000","last_peered":"2023-11-26T07:17:36.856924+0000","last_clean":"2023-11-26T07:17:36.856924+0000","last_became_active":"2023-11-26T07:17:35.297582+0000","last_became_peered":"2023-11-26T07:17:35.297582+0000","last_unstale":"2023-11-26T07:17:36.856924+0000","last_undegraded":"2023-11-26T07:17:36.856924+0000","last_fullsized":"2023-11-26T07:17:36.856924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:31.406679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291168+0000","last_change":"2023-11-26T07:17:35.286562+0000","last_active":"2023-11-26T07:17:36.291168+0000","last_peered":"2023-11-26T07:17:36.291168+0000","last_clean":"2023-11-26T07:17:36.291168+0000","last_became_active":"2023-11-26T07:17:35.286252+0000","last_became_peered":"2023-11-26T07:17:35.286252+0000","last_unstale":"2023-11-26T07:17:36.291168+0000","last_undegraded":"2023-11-26T07:17:36.291168+0000","last_fullsized":"2023-11-26T07:17:36.291168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288118+0000","last_change":"2023-11-26T07:17:35.281910+0000","last_active":"2023-11-26T07:17:36.288118+0000","last_peered":"2023-11-26T07:17:36.288118+0000","last_clean":"2023-11-26T07:17:36.288118+0000","last_became_active":"2023-11-26T07:17:35.281535+0000","last_became_peered":"2023-11-26T07:17:35.281535+0000","last_unstale":"2023-11-26T07:17:36.288118+0000","last_undegraded":"2023-11-26T07:17:36.288118+0000","last_fullsized":"2023-11-26T07:17:36.288118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:59.107380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852568+0000","last_change":"2023-11-26T07:17:35.305449+0000","last_active":"2023-11-26T07:17:36.852568+0000","last_peered":"2023-11-26T07:17:36.852568+0000","last_clean":"2023-11-26T07:17:36.852568+0000","last_became_active":"2023-11-26T07:17:35.305109+0000","last_became_peered":"2023-11-26T07:17:35.305109+0000","last_unstale":"2023-11-26T07:17:36.852568+0000","last_undegraded":"2023-11-26T07:17:36.852568+0000","last_fullsized":"2023-11-26T07:17:36.852568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290585+0000","last_change":"2023-11-26T07:17:35.278078+0000","last_active":"2023-11-26T07:17:36.290585+0000","last_peered":"2023-11-26T07:17:36.290585+0000","last_clean":"2023-11-26T07:17:36.290585+0000","last_became_active":"2023-11-26T07:17:35.277756+0000","last_became_peered":"2023-11-26T07:17:35.277756+0000","last_unstale":"2023-11-26T07:17:36.290585+0000","last_undegraded":"2023-11-26T07:17:36.290585+0000","last_fullsized":"2023-11-26T07:17:36.290585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.292426+0000","last_change":"2023-11-26T07:17:35.292521+0000","last_active":"2023-11-26T07:17:36.292426+0000","last_peered":"2023-11-26T07:17:36.292426+0000","last_clean":"2023-11-26T07:17:36.292426+0000","last_became_active":"2023-11-26T07:17:35.290387+0000","last_became_peered":"2023-11-26T07:17:35.290387+0000","last_unstale":"2023-11-26T07:17:36.292426+0000","last_undegraded":"2023-11-26T07:17:36.292426+0000","last_fullsized":"2023-11-26T07:17:36.292426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:37:30.364077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.348275+0000","last_change":"2023-11-26T07:17:35.289305+0000","last_active":"2023-11-26T07:17:36.348275+0000","last_peered":"2023-11-26T07:17:36.348275+0000","last_clean":"2023-11-26T07:17:36.348275+0000","last_became_active":"2023-11-26T07:17:35.288484+0000","last_became_peered":"2023-11-26T07:17:35.288484+0000","last_unstale":"2023-11-26T07:17:36.348275+0000","last_undegraded":"2023-11-26T07:17:36.348275+0000","last_fullsized":"2023-11-26T07:17:36.348275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:44:59.432835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.854493+0000","last_change":"2023-11-26T07:17:35.295513+0000","last_active":"2023-11-26T07:17:36.854493+0000","last_peered":"2023-11-26T07:17:36.854493+0000","last_clean":"2023-11-26T07:17:36.854493+0000","last_became_active":"2023-11-26T07:17:35.295339+0000","last_became_peered":"2023-11-26T07:17:35.295339+0000","last_unstale":"2023-11-26T07:17:36.854493+0000","last_undegraded":"2023-11-26T07:17:36.854493+0000","last_fullsized":"2023-11-26T07:17:36.854493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:51:44.669299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856229+0000","last_change":"2023-11-26T07:17:35.304162+0000","last_active":"2023-11-26T07:17:36.856229+0000","last_peered":"2023-11-26T07:17:36.856229+0000","last_clean":"2023-11-26T07:17:36.856229+0000","last_became_active":"2023-11-26T07:17:35.303775+0000","last_became_peered":"2023-11-26T07:17:35.303775+0000","last_unstale":"2023-11-26T07:17:36.856229+0000","last_undegraded":"2023-11-26T07:17:36.856229+0000","last_fullsized":"2023-11-26T07:17:36.856229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288359+0000","last_change":"2023-11-26T07:17:35.289136+0000","last_active":"2023-11-26T07:17:36.288359+0000","last_peered":"2023-11-26T07:17:36.288359+0000","last_clean":"2023-11-26T07:17:36.288359+0000","last_became_active":"2023-11-26T07:17:35.288824+0000","last_became_peered":"2023-11-26T07:17:35.288824+0000","last_unstale":"2023-11-26T07:17:36.288359+0000","last_undegraded":"2023-11-26T07:17:36.288359+0000","last_fullsized":"2023-11-26T07:17:36.288359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:51.436807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290977+0000","last_change":"2023-11-26T07:17:35.299639+0000","last_active":"2023-11-26T07:17:36.290977+0000","last_peered":"2023-11-26T07:17:36.290977+0000","last_clean":"2023-11-26T07:17:36.290977+0000","last_became_active":"2023-11-26T07:17:35.298838+0000","last_became_peered":"2023-11-26T07:17:35.298838+0000","last_unstale":"2023-11-26T07:17:36.290977+0000","last_undegraded":"2023-11-26T07:17:36.290977+0000","last_fullsized":"2023-11-26T07:17:36.290977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290258+0000","last_change":"2023-11-26T07:17:35.288263+0000","last_active":"2023-11-26T07:17:36.290258+0000","last_peered":"2023-11-26T07:17:36.290258+0000","last_clean":"2023-11-26T07:17:36.290258+0000","last_became_active":"2023-11-26T07:17:35.287907+0000","last_became_peered":"2023-11-26T07:17:35.287907+0000","last_unstale":"2023-11-26T07:17:36.290258+0000","last_undegraded":"2023-11-26T07:17:36.290258+0000","last_fullsized":"2023-11-26T07:17:36.290258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290741+0000","last_change":"2023-11-26T07:17:35.298420+0000","last_active":"2023-11-26T07:17:36.290741+0000","last_peered":"2023-11-26T07:17:36.290741+0000","last_clean":"2023-11-26T07:17:36.290741+0000","last_became_active":"2023-11-26T07:17:35.297672+0000","last_became_peered":"2023-11-26T07:17:35.297672+0000","last_unstale":"2023-11-26T07:17:36.290741+0000","last_undegraded":"2023-11-26T07:17:36.290741+0000","last_fullsized":"2023-11-26T07:17:36.290741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291207+0000","last_change":"2023-11-26T07:17:35.299072+0000","last_active":"2023-11-26T07:17:36.291207+0000","last_peered":"2023-11-26T07:17:36.291207+0000","last_clean":"2023-11-26T07:17:36.291207+0000","last_became_active":"2023-11-26T07:17:35.298748+0000","last_became_peered":"2023-11-26T07:17:35.298748+0000","last_unstale":"2023-11-26T07:17:36.291207+0000","last_undegraded":"2023-11-26T07:17:36.291207+0000","last_fullsized":"2023-11-26T07:17:36.291207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855537+0000","last_change":"2023-11-26T07:17:35.295203+0000","last_active":"2023-11-26T07:17:36.855537+0000","last_peered":"2023-11-26T07:17:36.855537+0000","last_clean":"2023-11-26T07:17:36.855537+0000","last_became_active":"2023-11-26T07:17:35.294921+0000","last_became_peered":"2023-11-26T07:17:35.294921+0000","last_unstale":"2023-11-26T07:17:36.855537+0000","last_undegraded":"2023-11-26T07:17:36.855537+0000","last_fullsized":"2023-11-26T07:17:36.855537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852945+0000","last_change":"2023-11-26T07:17:35.288826+0000","last_active":"2023-11-26T07:17:36.852945+0000","last_peered":"2023-11-26T07:17:36.852945+0000","last_clean":"2023-11-26T07:17:36.852945+0000","last_became_active":"2023-11-26T07:17:35.288535+0000","last_became_peered":"2023-11-26T07:17:35.288535+0000","last_unstale":"2023-11-26T07:17:36.852945+0000","last_undegraded":"2023-11-26T07:17:36.852945+0000","last_fullsized":"2023-11-26T07:17:36.852945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291234+0000","last_change":"2023-11-26T07:17:35.299788+0000","last_active":"2023-11-26T07:17:36.291234+0000","last_peered":"2023-11-26T07:17:36.291234+0000","last_clean":"2023-11-26T07:17:36.291234+0000","last_became_active":"2023-11-26T07:17:35.299537+0000","last_became_peered":"2023-11-26T07:17:35.299537+0000","last_unstale":"2023-11-26T07:17:36.291234+0000","last_undegraded":"2023-11-26T07:17:36.291234+0000","last_fullsized":"2023-11-26T07:17:36.291234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288966+0000","last_change":"2023-11-26T07:17:35.291110+0000","last_active":"2023-11-26T07:17:36.288966+0000","last_peered":"2023-11-26T07:17:36.288966+0000","last_clean":"2023-11-26T07:17:36.288966+0000","last_became_active":"2023-11-26T07:17:35.290817+0000","last_became_peered":"2023-11-26T07:17:35.290817+0000","last_unstale":"2023-11-26T07:17:36.288966+0000","last_undegraded":"2023-11-26T07:17:36.288966+0000","last_fullsized":"2023-11-26T07:17:36.288966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291138+0000","last_change":"2023-11-26T07:17:35.299321+0000","last_active":"2023-11-26T07:17:36.291138+0000","last_peered":"2023-11-26T07:17:36.291138+0000","last_clean":"2023-11-26T07:17:36.291138+0000","last_became_active":"2023-11-26T07:17:35.296813+0000","last_became_peered":"2023-11-26T07:17:35.296813+0000","last_unstale":"2023-11-26T07:17:36.291138+0000","last_undegraded":"2023-11-26T07:17:36.291138+0000","last_fullsized":"2023-11-26T07:17:36.291138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.347730+0000","last_change":"2023-11-26T07:17:35.298470+0000","last_active":"2023-11-26T07:17:36.347730+0000","last_peered":"2023-11-26T07:17:36.347730+0000","last_clean":"2023-11-26T07:17:36.347730+0000","last_became_active":"2023-11-26T07:17:35.298120+0000","last_became_peered":"2023-11-26T07:17:35.298120+0000","last_unstale":"2023-11-26T07:17:36.347730+0000","last_undegraded":"2023-11-26T07:17:36.347730+0000","last_fullsized":"2023-11-26T07:17:36.347730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:01.790753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853467+0000","last_change":"2023-11-26T07:17:35.286010+0000","last_active":"2023-11-26T07:17:36.853467+0000","last_peered":"2023-11-26T07:17:36.853467+0000","last_clean":"2023-11-26T07:17:36.853467+0000","last_became_active":"2023-11-26T07:17:35.284996+0000","last_became_peered":"2023-11-26T07:17:35.284996+0000","last_unstale":"2023-11-26T07:17:36.853467+0000","last_undegraded":"2023-11-26T07:17:36.853467+0000","last_fullsized":"2023-11-26T07:17:36.853467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:51.436807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855545+0000","last_change":"2023-11-26T07:17:35.287101+0000","last_active":"2023-11-26T07:17:36.855545+0000","last_peered":"2023-11-26T07:17:36.855545+0000","last_clean":"2023-11-26T07:17:36.855545+0000","last_became_active":"2023-11-26T07:17:35.286319+0000","last_became_peered":"2023-11-26T07:17:35.286319+0000","last_unstale":"2023-11-26T07:17:36.855545+0000","last_undegraded":"2023-11-26T07:17:36.855545+0000","last_fullsized":"2023-11-26T07:17:36.855545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:27.986808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308605+0000","last_change":"2023-11-26T07:17:34.260424+0000","last_active":"2023-11-26T07:17:35.308605+0000","last_peered":"2023-11-26T07:17:35.308605+0000","last_clean":"2023-11-26T07:17:35.308605+0000","last_became_active":"2023-11-26T07:17:34.260186+0000","last_became_peered":"2023-11-26T07:17:34.260186+0000","last_unstale":"2023-11-26T07:17:35.308605+0000","last_undegraded":"2023-11-26T07:17:35.308605+0000","last_fullsized":"2023-11-26T07:17:35.308605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:50.431819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289063+0000","last_change":"2023-11-26T07:17:35.296870+0000","last_active":"2023-11-26T07:17:36.289063+0000","last_peered":"2023-11-26T07:17:36.289063+0000","last_clean":"2023-11-26T07:17:36.289063+0000","last_became_active":"2023-11-26T07:17:35.296511+0000","last_became_peered":"2023-11-26T07:17:35.296511+0000","last_unstale":"2023-11-26T07:17:36.289063+0000","last_undegraded":"2023-11-26T07:17:36.289063+0000","last_fullsized":"2023-11-26T07:17:36.289063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312260+0000","last_change":"2023-11-26T07:17:34.272272+0000","last_active":"2023-11-26T07:17:35.312260+0000","last_peered":"2023-11-26T07:17:35.312260+0000","last_clean":"2023-11-26T07:17:35.312260+0000","last_became_active":"2023-11-26T07:17:34.271546+0000","last_became_peered":"2023-11-26T07:17:34.271546+0000","last_unstale":"2023-11-26T07:17:35.312260+0000","last_undegraded":"2023-11-26T07:17:35.312260+0000","last_fullsized":"2023-11-26T07:17:35.312260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:07.401822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.263326+0000","last_change":"2023-11-26T07:17:34.270516+0000","last_active":"2023-11-26T07:17:35.263326+0000","last_peered":"2023-11-26T07:17:35.263326+0000","last_clean":"2023-11-26T07:17:35.263326+0000","last_became_active":"2023-11-26T07:17:34.270272+0000","last_became_peered":"2023-11-26T07:17:34.270272+0000","last_unstale":"2023-11-26T07:17:35.263326+0000","last_undegraded":"2023-11-26T07:17:35.263326+0000","last_fullsized":"2023-11-26T07:17:35.263326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:31.214665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290438+0000","last_change":"2023-11-26T07:17:35.282691+0000","last_active":"2023-11-26T07:17:36.290438+0000","last_peered":"2023-11-26T07:17:36.290438+0000","last_clean":"2023-11-26T07:17:36.290438+0000","last_became_active":"2023-11-26T07:17:35.282434+0000","last_became_peered":"2023-11-26T07:17:35.282434+0000","last_unstale":"2023-11-26T07:17:36.290438+0000","last_undegraded":"2023-11-26T07:17:36.290438+0000","last_fullsized":"2023-11-26T07:17:36.290438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.263324+0000","last_change":"2023-11-26T07:17:34.264012+0000","last_active":"2023-11-26T07:17:35.263324+0000","last_peered":"2023-11-26T07:17:35.263324+0000","last_clean":"2023-11-26T07:17:35.263324+0000","last_became_active":"2023-11-26T07:17:34.262939+0000","last_became_peered":"2023-11-26T07:17:34.262939+0000","last_unstale":"2023-11-26T07:17:35.263324+0000","last_undegraded":"2023-11-26T07:17:35.263324+0000","last_fullsized":"2023-11-26T07:17:35.263324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:47.932199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852561+0000","last_change":"2023-11-26T07:17:35.290951+0000","last_active":"2023-11-26T07:17:36.852561+0000","last_peered":"2023-11-26T07:17:36.852561+0000","last_clean":"2023-11-26T07:17:36.852561+0000","last_became_active":"2023-11-26T07:17:35.290575+0000","last_became_peered":"2023-11-26T07:17:35.290575+0000","last_unstale":"2023-11-26T07:17:36.852561+0000","last_undegraded":"2023-11-26T07:17:36.852561+0000","last_fullsized":"2023-11-26T07:17:36.852561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.274062+0000","last_change":"2023-11-26T07:17:34.270339+0000","last_active":"2023-11-26T07:17:35.274062+0000","last_peered":"2023-11-26T07:17:35.274062+0000","last_clean":"2023-11-26T07:17:35.274062+0000","last_became_active":"2023-11-26T07:17:34.270058+0000","last_became_peered":"2023-11-26T07:17:34.270058+0000","last_unstale":"2023-11-26T07:17:35.274062+0000","last_undegraded":"2023-11-26T07:17:35.274062+0000","last_fullsized":"2023-11-26T07:17:35.274062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:00.785765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.292197+0000","last_change":"2023-11-26T07:17:35.292487+0000","last_active":"2023-11-26T07:17:36.292197+0000","last_peered":"2023-11-26T07:17:36.292197+0000","last_clean":"2023-11-26T07:17:36.292197+0000","last_became_active":"2023-11-26T07:17:35.291651+0000","last_became_peered":"2023-11-26T07:17:35.291651+0000","last_unstale":"2023-11-26T07:17:36.292197+0000","last_undegraded":"2023-11-26T07:17:36.292197+0000","last_fullsized":"2023-11-26T07:17:36.292197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:14:14.039125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.264303+0000","last_change":"2023-11-26T07:17:34.271134+0000","last_active":"2023-11-26T07:17:35.264303+0000","last_peered":"2023-11-26T07:17:35.264303+0000","last_clean":"2023-11-26T07:17:35.264303+0000","last_became_active":"2023-11-26T07:17:34.270420+0000","last_became_peered":"2023-11-26T07:17:34.270420+0000","last_unstale":"2023-11-26T07:17:35.264303+0000","last_undegraded":"2023-11-26T07:17:35.264303+0000","last_fullsized":"2023-11-26T07:17:35.264303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:39.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289872+0000","last_change":"2023-11-26T07:17:35.290019+0000","last_active":"2023-11-26T07:17:36.289872+0000","last_peered":"2023-11-26T07:17:36.289872+0000","last_clean":"2023-11-26T07:17:36.289872+0000","last_became_active":"2023-11-26T07:17:35.289735+0000","last_became_peered":"2023-11-26T07:17:35.289735+0000","last_unstale":"2023-11-26T07:17:36.289872+0000","last_undegraded":"2023-11-26T07:17:36.289872+0000","last_fullsized":"2023-11-26T07:17:36.289872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.309286+0000","last_change":"2023-11-26T07:17:34.253890+0000","last_active":"2023-11-26T07:17:35.309286+0000","last_peered":"2023-11-26T07:17:35.309286+0000","last_clean":"2023-11-26T07:17:35.309286+0000","last_became_active":"2023-11-26T07:17:34.252298+0000","last_became_peered":"2023-11-26T07:17:34.252298+0000","last_unstale":"2023-11-26T07:17:35.309286+0000","last_undegraded":"2023-11-26T07:17:35.309286+0000","last_fullsized":"2023-11-26T07:17:35.309286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:04.297880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857233+0000","last_change":"2023-11-26T07:17:35.299159+0000","last_active":"2023-11-26T07:17:36.857233+0000","last_peered":"2023-11-26T07:17:36.857233+0000","last_clean":"2023-11-26T07:17:36.857233+0000","last_became_active":"2023-11-26T07:17:35.298172+0000","last_became_peered":"2023-11-26T07:17:35.298172+0000","last_unstale":"2023-11-26T07:17:36.857233+0000","last_undegraded":"2023-11-26T07:17:36.857233+0000","last_fullsized":"2023-11-26T07:17:36.857233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:01.790753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.313145+0000","last_change":"2023-11-26T07:17:34.269809+0000","last_active":"2023-11-26T07:17:35.313145+0000","last_peered":"2023-11-26T07:17:35.313145+0000","last_clean":"2023-11-26T07:17:35.313145+0000","last_became_active":"2023-11-26T07:17:34.264015+0000","last_became_peered":"2023-11-26T07:17:34.264015+0000","last_unstale":"2023-11-26T07:17:35.313145+0000","last_undegraded":"2023-11-26T07:17:35.313145+0000","last_fullsized":"2023-11-26T07:17:35.313145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853444+0000","last_change":"2023-11-26T07:17:35.290779+0000","last_active":"2023-11-26T07:17:36.853444+0000","last_peered":"2023-11-26T07:17:36.853444+0000","last_clean":"2023-11-26T07:17:36.853444+0000","last_became_active":"2023-11-26T07:17:35.290504+0000","last_became_peered":"2023-11-26T07:17:35.290504+0000","last_unstale":"2023-11-26T07:17:36.853444+0000","last_undegraded":"2023-11-26T07:17:36.853444+0000","last_fullsized":"2023-11-26T07:17:36.853444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312451+0000","last_change":"2023-11-26T07:17:34.261601+0000","last_active":"2023-11-26T07:17:35.312451+0000","last_peered":"2023-11-26T07:17:35.312451+0000","last_clean":"2023-11-26T07:17:35.312451+0000","last_became_active":"2023-11-26T07:17:34.261232+0000","last_became_peered":"2023-11-26T07:17:34.261232+0000","last_unstale":"2023-11-26T07:17:35.312451+0000","last_undegraded":"2023-11-26T07:17:35.312451+0000","last_fullsized":"2023-11-26T07:17:35.312451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:30.401691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288255+0000","last_change":"2023-11-26T07:17:35.290421+0000","last_active":"2023-11-26T07:17:36.288255+0000","last_peered":"2023-11-26T07:17:36.288255+0000","last_clean":"2023-11-26T07:17:36.288255+0000","last_became_active":"2023-11-26T07:17:35.290069+0000","last_became_peered":"2023-11-26T07:17:35.290069+0000","last_unstale":"2023-11-26T07:17:36.288255+0000","last_undegraded":"2023-11-26T07:17:36.288255+0000","last_fullsized":"2023-11-26T07:17:36.288255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:05.302868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.266362+0000","last_change":"2023-11-26T07:17:34.263984+0000","last_active":"2023-11-26T07:17:35.266362+0000","last_peered":"2023-11-26T07:17:35.266362+0000","last_clean":"2023-11-26T07:17:35.266362+0000","last_became_active":"2023-11-26T07:17:34.263647+0000","last_became_peered":"2023-11-26T07:17:34.263647+0000","last_unstale":"2023-11-26T07:17:35.266362+0000","last_undegraded":"2023-11-26T07:17:35.266362+0000","last_fullsized":"2023-11-26T07:17:35.266362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:50.841460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853983+0000","last_change":"2023-11-26T07:17:35.307695+0000","last_active":"2023-11-26T07:17:36.853983+0000","last_peered":"2023-11-26T07:17:36.853983+0000","last_clean":"2023-11-26T07:17:36.853983+0000","last_became_active":"2023-11-26T07:17:35.307322+0000","last_became_peered":"2023-11-26T07:17:35.307322+0000","last_unstale":"2023-11-26T07:17:36.853983+0000","last_undegraded":"2023-11-26T07:17:36.853983+0000","last_fullsized":"2023-11-26T07:17:36.853983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:31.633994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.271599+0000","last_change":"2023-11-26T07:17:34.267209+0000","last_active":"2023-11-26T07:17:35.271599+0000","last_peered":"2023-11-26T07:17:35.271599+0000","last_clean":"2023-11-26T07:17:35.271599+0000","last_became_active":"2023-11-26T07:17:34.266896+0000","last_became_peered":"2023-11-26T07:17:34.266896+0000","last_unstale":"2023-11-26T07:17:35.271599+0000","last_undegraded":"2023-11-26T07:17:35.271599+0000","last_fullsized":"2023-11-26T07:17:35.271599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:26.981820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853828+0000","last_change":"2023-11-26T07:17:35.285662+0000","last_active":"2023-11-26T07:17:36.853828+0000","last_peered":"2023-11-26T07:17:36.853828+0000","last_clean":"2023-11-26T07:17:36.853828+0000","last_became_active":"2023-11-26T07:17:35.285344+0000","last_became_peered":"2023-11-26T07:17:35.285344+0000","last_unstale":"2023-11-26T07:17:36.853828+0000","last_undegraded":"2023-11-26T07:17:36.853828+0000","last_fullsized":"2023-11-26T07:17:36.853828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.313128+0000","last_change":"2023-11-26T07:17:34.255794+0000","last_active":"2023-11-26T07:17:35.313128+0000","last_peered":"2023-11-26T07:17:35.313128+0000","last_clean":"2023-11-26T07:17:35.313128+0000","last_became_active":"2023-11-26T07:17:34.255495+0000","last_became_peered":"2023-11-26T07:17:34.255495+0000","last_unstale":"2023-11-26T07:17:35.313128+0000","last_undegraded":"2023-11-26T07:17:35.313128+0000","last_fullsized":"2023-11-26T07:17:35.313128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:26.981820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853750+0000","last_change":"2023-11-26T07:17:35.299739+0000","last_active":"2023-11-26T07:17:36.853750+0000","last_peered":"2023-11-26T07:17:36.853750+0000","last_clean":"2023-11-26T07:17:36.853750+0000","last_became_active":"2023-11-26T07:17:35.299412+0000","last_became_peered":"2023-11-26T07:17:35.299412+0000","last_unstale":"2023-11-26T07:17:36.853750+0000","last_undegraded":"2023-11-26T07:17:36.853750+0000","last_fullsized":"2023-11-26T07:17:36.853750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.311528+0000","last_change":"2023-11-26T07:17:34.261567+0000","last_active":"2023-11-26T07:17:35.311528+0000","last_peered":"2023-11-26T07:17:35.311528+0000","last_clean":"2023-11-26T07:17:35.311528+0000","last_became_active":"2023-11-26T07:17:34.261083+0000","last_became_peered":"2023-11-26T07:17:34.261083+0000","last_unstale":"2023-11-26T07:17:35.311528+0000","last_undegraded":"2023-11-26T07:17:35.311528+0000","last_fullsized":"2023-11-26T07:17:35.311528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:33:02.627652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857599+0000","last_change":"2023-11-26T07:17:35.307619+0000","last_active":"2023-11-26T07:17:36.857599+0000","last_peered":"2023-11-26T07:17:36.857599+0000","last_clean":"2023-11-26T07:17:36.857599+0000","last_became_active":"2023-11-26T07:17:35.307322+0000","last_became_peered":"2023-11-26T07:17:35.307322+0000","last_unstale":"2023-11-26T07:17:36.857599+0000","last_undegraded":"2023-11-26T07:17:36.857599+0000","last_fullsized":"2023-11-26T07:17:36.857599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:59:08.684829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308810+0000","last_change":"2023-11-26T07:17:34.259965+0000","last_active":"2023-11-26T07:17:35.308810+0000","last_peered":"2023-11-26T07:17:35.308810+0000","last_clean":"2023-11-26T07:17:35.308810+0000","last_became_active":"2023-11-26T07:17:34.259453+0000","last_became_peered":"2023-11-26T07:17:34.259453+0000","last_unstale":"2023-11-26T07:17:35.308810+0000","last_undegraded":"2023-11-26T07:17:35.308810+0000","last_fullsized":"2023-11-26T07:17:35.308810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:31.214665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857855+0000","last_change":"2023-11-26T07:17:35.305671+0000","last_active":"2023-11-26T07:17:36.857855+0000","last_peered":"2023-11-26T07:17:36.857855+0000","last_clean":"2023-11-26T07:17:36.857855+0000","last_became_active":"2023-11-26T07:17:35.304797+0000","last_became_peered":"2023-11-26T07:17:35.304797+0000","last_unstale":"2023-11-26T07:17:36.857855+0000","last_undegraded":"2023-11-26T07:17:36.857855+0000","last_fullsized":"2023-11-26T07:17:36.857855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:37:30.364077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312107+0000","last_change":"2023-11-26T07:17:34.260843+0000","last_active":"2023-11-26T07:17:35.312107+0000","last_peered":"2023-11-26T07:17:35.312107+0000","last_clean":"2023-11-26T07:17:35.312107+0000","last_became_active":"2023-11-26T07:17:34.260492+0000","last_became_peered":"2023-11-26T07:17:34.260492+0000","last_unstale":"2023-11-26T07:17:35.312107+0000","last_undegraded":"2023-11-26T07:17:35.312107+0000","last_fullsized":"2023-11-26T07:17:35.312107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:56.938162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291587+0000","last_change":"2023-11-26T07:17:35.299197+0000","last_active":"2023-11-26T07:17:36.291587+0000","last_peered":"2023-11-26T07:17:36.291587+0000","last_clean":"2023-11-26T07:17:36.291587+0000","last_became_active":"2023-11-26T07:17:35.297708+0000","last_became_peered":"2023-11-26T07:17:35.297708+0000","last_unstale":"2023-11-26T07:17:36.291587+0000","last_undegraded":"2023-11-26T07:17:36.291587+0000","last_fullsized":"2023-11-26T07:17:36.291587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:51:44.669299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275592+0000","last_change":"2023-11-26T07:17:34.263596+0000","last_active":"2023-11-26T07:17:35.275592+0000","last_peered":"2023-11-26T07:17:35.275592+0000","last_clean":"2023-11-26T07:17:35.275592+0000","last_became_active":"2023-11-26T07:17:34.263296+0000","last_became_peered":"2023-11-26T07:17:34.263296+0000","last_unstale":"2023-11-26T07:17:35.275592+0000","last_undegraded":"2023-11-26T07:17:35.275592+0000","last_fullsized":"2023-11-26T07:17:35.275592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:07.401822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853854+0000","last_change":"2023-11-26T07:17:35.295518+0000","last_active":"2023-11-26T07:17:36.853854+0000","last_peered":"2023-11-26T07:17:36.853854+0000","last_clean":"2023-11-26T07:17:36.853854+0000","last_became_active":"2023-11-26T07:17:35.295352+0000","last_became_peered":"2023-11-26T07:17:35.295352+0000","last_unstale":"2023-11-26T07:17:36.853854+0000","last_undegraded":"2023-11-26T07:17:36.853854+0000","last_fullsized":"2023-11-26T07:17:36.853854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275660+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:17:35.275660+0000","last_peered":"2023-11-26T07:17:35.275660+0000","last_clean":"2023-11-26T07:17:35.275660+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:17:35.275660+0000","last_undegraded":"2023-11-26T07:17:35.275660+0000","last_fullsized":"2023-11-26T07:17:35.275660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.260546+0000","last_change":"2023-11-26T07:17:34.260166+0000","last_active":"2023-11-26T07:17:35.260546+0000","last_peered":"2023-11-26T07:17:35.260546+0000","last_clean":"2023-11-26T07:17:35.260546+0000","last_became_active":"2023-11-26T07:17:34.259813+0000","last_became_peered":"2023-11-26T07:17:34.259813+0000","last_unstale":"2023-11-26T07:17:35.260546+0000","last_undegraded":"2023-11-26T07:17:35.260546+0000","last_fullsized":"2023-11-26T07:17:35.260546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290730+0000","last_change":"2023-11-26T07:17:35.287427+0000","last_active":"2023-11-26T07:17:36.290730+0000","last_peered":"2023-11-26T07:17:36.290730+0000","last_clean":"2023-11-26T07:17:36.290730+0000","last_became_active":"2023-11-26T07:17:35.287153+0000","last_became_peered":"2023-11-26T07:17:35.287153+0000","last_unstale":"2023-11-26T07:17:36.290730+0000","last_undegraded":"2023-11-26T07:17:36.290730+0000","last_fullsized":"2023-11-26T07:17:36.290730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275512+0000","last_change":"2023-11-26T07:17:34.271952+0000","last_active":"2023-11-26T07:17:35.275512+0000","last_peered":"2023-11-26T07:17:35.275512+0000","last_clean":"2023-11-26T07:17:35.275512+0000","last_became_active":"2023-11-26T07:17:34.271686+0000","last_became_peered":"2023-11-26T07:17:34.271686+0000","last_unstale":"2023-11-26T07:17:35.275512+0000","last_undegraded":"2023-11-26T07:17:35.275512+0000","last_fullsized":"2023-11-26T07:17:35.275512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.287880+0000","last_change":"2023-11-26T07:17:35.289335+0000","last_active":"2023-11-26T07:17:36.287880+0000","last_peered":"2023-11-26T07:17:36.287880+0000","last_clean":"2023-11-26T07:17:36.287880+0000","last_became_active":"2023-11-26T07:17:35.288975+0000","last_became_peered":"2023-11-26T07:17:35.288975+0000","last_unstale":"2023-11-26T07:17:36.287880+0000","last_undegraded":"2023-11-26T07:17:36.287880+0000","last_fullsized":"2023-11-26T07:17:36.287880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:35.805458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.271170+0000","last_change":"2023-11-26T07:17:34.259717+0000","last_active":"2023-11-26T07:17:35.271170+0000","last_peered":"2023-11-26T07:17:35.271170+0000","last_clean":"2023-11-26T07:17:35.271170+0000","last_became_active":"2023-11-26T07:17:34.259440+0000","last_became_peered":"2023-11-26T07:17:34.259440+0000","last_unstale":"2023-11-26T07:17:35.271170+0000","last_undegraded":"2023-11-26T07:17:35.271170+0000","last_fullsized":"2023-11-26T07:17:35.271170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:19:01.400658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852532+0000","last_change":"2023-11-26T07:17:35.284821+0000","last_active":"2023-11-26T07:17:36.852532+0000","last_peered":"2023-11-26T07:17:36.852532+0000","last_clean":"2023-11-26T07:17:36.852532+0000","last_became_active":"2023-11-26T07:17:35.283626+0000","last_became_peered":"2023-11-26T07:17:35.283626+0000","last_unstale":"2023-11-26T07:17:36.852532+0000","last_undegraded":"2023-11-26T07:17:36.852532+0000","last_fullsized":"2023-11-26T07:17:36.852532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.265947+0000","last_change":"2023-11-26T07:17:34.258767+0000","last_active":"2023-11-26T07:17:35.265947+0000","last_peered":"2023-11-26T07:17:35.265947+0000","last_clean":"2023-11-26T07:17:35.265947+0000","last_became_active":"2023-11-26T07:17:34.257967+0000","last_became_peered":"2023-11-26T07:17:34.257967+0000","last_unstale":"2023-11-26T07:17:35.265947+0000","last_undegraded":"2023-11-26T07:17:35.265947+0000","last_fullsized":"2023-11-26T07:17:35.265947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:13.669938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856130+0000","last_change":"2023-11-26T07:17:35.303810+0000","last_active":"2023-11-26T07:17:36.856130+0000","last_peered":"2023-11-26T07:17:36.856130+0000","last_clean":"2023-11-26T07:17:36.856130+0000","last_became_active":"2023-11-26T07:17:35.303085+0000","last_became_peered":"2023-11-26T07:17:35.303085+0000","last_unstale":"2023-11-26T07:17:36.856130+0000","last_undegraded":"2023-11-26T07:17:36.856130+0000","last_fullsized":"2023-11-26T07:17:36.856130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:08.406810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.278333+0000","last_change":"2023-11-26T07:17:34.256005+0000","last_active":"2023-11-26T07:17:35.278333+0000","last_peered":"2023-11-26T07:17:35.278333+0000","last_clean":"2023-11-26T07:17:35.278333+0000","last_became_active":"2023-11-26T07:17:34.255598+0000","last_became_peered":"2023-11-26T07:17:34.255598+0000","last_unstale":"2023-11-26T07:17:35.278333+0000","last_undegraded":"2023-11-26T07:17:35.278333+0000","last_fullsized":"2023-11-26T07:17:35.278333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:47.932199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291901+0000","last_change":"2023-11-26T07:17:35.293918+0000","last_active":"2023-11-26T07:17:36.291901+0000","last_peered":"2023-11-26T07:17:36.291901+0000","last_clean":"2023-11-26T07:17:36.291901+0000","last_became_active":"2023-11-26T07:17:35.293651+0000","last_became_peered":"2023-11-26T07:17:35.293651+0000","last_unstale":"2023-11-26T07:17:36.291901+0000","last_undegraded":"2023-11-26T07:17:36.291901+0000","last_fullsized":"2023-11-26T07:17:36.291901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:59:08.684829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.285652+0000","last_change":"2023-11-26T07:17:34.274703+0000","last_active":"2023-11-26T07:17:35.285652+0000","last_peered":"2023-11-26T07:17:35.285652+0000","last_clean":"2023-11-26T07:17:35.285652+0000","last_became_active":"2023-11-26T07:17:34.274347+0000","last_became_peered":"2023-11-26T07:17:34.274347+0000","last_unstale":"2023-11-26T07:17:35.285652+0000","last_undegraded":"2023-11-26T07:17:35.285652+0000","last_fullsized":"2023-11-26T07:17:35.285652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:13.669938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852897+0000","last_change":"2023-11-26T07:17:35.282993+0000","last_active":"2023-11-26T07:17:36.852897+0000","last_peered":"2023-11-26T07:17:36.852897+0000","last_clean":"2023-11-26T07:17:36.852897+0000","last_became_active":"2023-11-26T07:17:35.282727+0000","last_became_peered":"2023-11-26T07:17:35.282727+0000","last_unstale":"2023-11-26T07:17:36.852897+0000","last_undegraded":"2023-11-26T07:17:36.852897+0000","last_fullsized":"2023-11-26T07:17:36.852897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.277968+0000","last_change":"2023-11-26T07:17:34.271447+0000","last_active":"2023-11-26T07:17:35.277968+0000","last_peered":"2023-11-26T07:17:35.277968+0000","last_clean":"2023-11-26T07:17:35.277968+0000","last_became_active":"2023-11-26T07:17:34.270049+0000","last_became_peered":"2023-11-26T07:17:34.270049+0000","last_unstale":"2023-11-26T07:17:35.277968+0000","last_undegraded":"2023-11-26T07:17:35.277968+0000","last_fullsized":"2023-11-26T07:17:35.277968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291300+0000","last_change":"2023-11-26T07:17:35.296985+0000","last_active":"2023-11-26T07:17:36.291300+0000","last_peered":"2023-11-26T07:17:36.291300+0000","last_clean":"2023-11-26T07:17:36.291300+0000","last_became_active":"2023-11-26T07:17:35.296635+0000","last_became_peered":"2023-11-26T07:17:35.296635+0000","last_unstale":"2023-11-26T07:17:36.291300+0000","last_undegraded":"2023-11-26T07:17:36.291300+0000","last_fullsized":"2023-11-26T07:17:36.291300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.309336+0000","last_change":"2023-11-26T07:17:34.272765+0000","last_active":"2023-11-26T07:17:35.309336+0000","last_peered":"2023-11-26T07:17:35.309336+0000","last_clean":"2023-11-26T07:17:35.309336+0000","last_became_active":"2023-11-26T07:17:34.272359+0000","last_became_peered":"2023-11-26T07:17:34.272359+0000","last_unstale":"2023-11-26T07:17:35.309336+0000","last_undegraded":"2023-11-26T07:17:35.309336+0000","last_fullsized":"2023-11-26T07:17:35.309336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289184+0000","last_change":"2023-11-26T07:17:35.280353+0000","last_active":"2023-11-26T07:17:36.289184+0000","last_peered":"2023-11-26T07:17:36.289184+0000","last_clean":"2023-11-26T07:17:36.289184+0000","last_became_active":"2023-11-26T07:17:35.280060+0000","last_became_peered":"2023-11-26T07:17:35.280060+0000","last_unstale":"2023-11-26T07:17:36.289184+0000","last_undegraded":"2023-11-26T07:17:36.289184+0000","last_fullsized":"2023-11-26T07:17:36.289184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275318+0000","last_change":"2023-11-26T07:17:34.275747+0000","last_active":"2023-11-26T07:17:35.275318+0000","last_peered":"2023-11-26T07:17:35.275318+0000","last_clean":"2023-11-26T07:17:35.275318+0000","last_became_active":"2023-11-26T07:17:34.275273+0000","last_became_peered":"2023-11-26T07:17:34.275273+0000","last_unstale":"2023-11-26T07:17:35.275318+0000","last_undegraded":"2023-11-26T07:17:35.275318+0000","last_fullsized":"2023-11-26T07:17:35.275318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:44:58.427847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853734+0000","last_change":"2023-11-26T07:17:35.287995+0000","last_active":"2023-11-26T07:17:36.853734+0000","last_peered":"2023-11-26T07:17:36.853734+0000","last_clean":"2023-11-26T07:17:36.853734+0000","last_became_active":"2023-11-26T07:17:35.287690+0000","last_became_peered":"2023-11-26T07:17:35.287690+0000","last_unstale":"2023-11-26T07:17:36.853734+0000","last_undegraded":"2023-11-26T07:17:36.853734+0000","last_fullsized":"2023-11-26T07:17:36.853734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:32.219653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.276561+0000","last_change":"2023-11-26T07:17:34.261040+0000","last_active":"2023-11-26T07:17:35.276561+0000","last_peered":"2023-11-26T07:17:35.276561+0000","last_clean":"2023-11-26T07:17:35.276561+0000","last_became_active":"2023-11-26T07:17:34.260678+0000","last_became_peered":"2023-11-26T07:17:34.260678+0000","last_unstale":"2023-11-26T07:17:35.276561+0000","last_undegraded":"2023-11-26T07:17:35.276561+0000","last_fullsized":"2023-11-26T07:17:35.276561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290254+0000","last_change":"2023-11-26T07:17:35.280159+0000","last_active":"2023-11-26T07:17:36.290254+0000","last_peered":"2023-11-26T07:17:36.290254+0000","last_clean":"2023-11-26T07:17:36.290254+0000","last_became_active":"2023-11-26T07:17:35.279819+0000","last_became_peered":"2023-11-26T07:17:35.279819+0000","last_unstale":"2023-11-26T07:17:36.290254+0000","last_undegraded":"2023-11-26T07:17:36.290254+0000","last_fullsized":"2023-11-26T07:17:36.290254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.278229+0000","last_change":"2023-11-26T07:17:34.248282+0000","last_active":"2023-11-26T07:17:35.278229+0000","last_peered":"2023-11-26T07:17:35.278229+0000","last_clean":"2023-11-26T07:17:35.278229+0000","last_became_active":"2023-11-26T07:17:34.247565+0000","last_became_peered":"2023-11-26T07:17:34.247565+0000","last_unstale":"2023-11-26T07:17:35.278229+0000","last_undegraded":"2023-11-26T07:17:35.278229+0000","last_fullsized":"2023-11-26T07:17:35.278229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:50.431819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291259+0000","last_change":"2023-11-26T07:17:35.284496+0000","last_active":"2023-11-26T07:17:36.291259+0000","last_peered":"2023-11-26T07:17:36.291259+0000","last_clean":"2023-11-26T07:17:36.291259+0000","last_became_active":"2023-11-26T07:17:35.283640+0000","last_became_peered":"2023-11-26T07:17:35.283640+0000","last_unstale":"2023-11-26T07:17:36.291259+0000","last_undegraded":"2023-11-26T07:17:36.291259+0000","last_fullsized":"2023-11-26T07:17:36.291259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312542+0000","last_change":"2023-11-26T07:17:34.270854+0000","last_active":"2023-11-26T07:17:35.312542+0000","last_peered":"2023-11-26T07:17:35.312542+0000","last_clean":"2023-11-26T07:17:35.312542+0000","last_became_active":"2023-11-26T07:17:34.270525+0000","last_became_peered":"2023-11-26T07:17:34.270525+0000","last_unstale":"2023-11-26T07:17:35.312542+0000","last_undegraded":"2023-11-26T07:17:35.312542+0000","last_fullsized":"2023-11-26T07:17:35.312542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.854803+0000","last_change":"2023-11-26T07:17:35.288782+0000","last_active":"2023-11-26T07:17:36.854803+0000","last_peered":"2023-11-26T07:17:36.854803+0000","last_clean":"2023-11-26T07:17:36.854803+0000","last_became_active":"2023-11-26T07:17:35.287263+0000","last_became_peered":"2023-11-26T07:17:35.287263+0000","last_unstale":"2023-11-26T07:17:36.854803+0000","last_undegraded":"2023-11-26T07:17:36.854803+0000","last_fullsized":"2023-11-26T07:17:36.854803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291873+0000","last_change":"2023-11-26T07:17:35.303027+0000","last_active":"2023-11-26T07:17:36.291873+0000","last_peered":"2023-11-26T07:17:36.291873+0000","last_clean":"2023-11-26T07:17:36.291873+0000","last_became_active":"2023-11-26T07:17:35.302802+0000","last_became_peered":"2023-11-26T07:17:35.302802+0000","last_unstale":"2023-11-26T07:17:36.291873+0000","last_undegraded":"2023-11-26T07:17:36.291873+0000","last_fullsized":"2023-11-26T07:17:36.291873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:01:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.310109+0000","last_change":"2023-11-26T07:17:34.275614+0000","last_active":"2023-11-26T07:17:35.310109+0000","last_peered":"2023-11-26T07:17:35.310109+0000","last_clean":"2023-11-26T07:17:35.310109+0000","last_became_active":"2023-11-26T07:17:34.274852+0000","last_became_peered":"2023-11-26T07:17:34.274852+0000","last_unstale":"2023-11-26T07:17:35.310109+0000","last_undegraded":"2023-11-26T07:17:35.310109+0000","last_fullsized":"2023-11-26T07:17:35.310109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291376+0000","last_change":"2023-11-26T07:17:35.302995+0000","last_active":"2023-11-26T07:17:36.291376+0000","last_peered":"2023-11-26T07:17:36.291376+0000","last_clean":"2023-11-26T07:17:36.291376+0000","last_became_active":"2023-11-26T07:17:35.302669+0000","last_became_peered":"2023-11-26T07:17:35.302669+0000","last_unstale":"2023-11-26T07:17:36.291376+0000","last_undegraded":"2023-11-26T07:17:36.291376+0000","last_fullsized":"2023-11-26T07:17:36.291376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:31.633994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308916+0000","last_change":"2023-11-26T07:17:34.275105+0000","last_active":"2023-11-26T07:17:35.308916+0000","last_peered":"2023-11-26T07:17:35.308916+0000","last_clean":"2023-11-26T07:17:35.308916+0000","last_became_active":"2023-11-26T07:17:34.274649+0000","last_became_peered":"2023-11-26T07:17:34.274649+0000","last_unstale":"2023-11-26T07:17:35.308916+0000","last_undegraded":"2023-11-26T07:17:35.308916+0000","last_fullsized":"2023-11-26T07:17:35.308916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:04.297880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289574+0000","last_change":"2023-11-26T07:17:35.286325+0000","last_active":"2023-11-26T07:17:36.289574+0000","last_peered":"2023-11-26T07:17:36.289574+0000","last_clean":"2023-11-26T07:17:36.289574+0000","last_became_active":"2023-11-26T07:17:35.286007+0000","last_became_peered":"2023-11-26T07:17:35.286007+0000","last_unstale":"2023-11-26T07:17:36.289574+0000","last_undegraded":"2023-11-26T07:17:36.289574+0000","last_fullsized":"2023-11-26T07:17:36.289574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.307875+0000","last_change":"2023-11-26T07:17:34.258227+0000","last_active":"2023-11-26T07:17:35.307875+0000","last_peered":"2023-11-26T07:17:35.307875+0000","last_clean":"2023-11-26T07:17:35.307875+0000","last_became_active":"2023-11-26T07:17:34.257930+0000","last_became_peered":"2023-11-26T07:17:34.257930+0000","last_unstale":"2023-11-26T07:17:35.307875+0000","last_undegraded":"2023-11-26T07:17:35.307875+0000","last_fullsized":"2023-11-26T07:17:35.307875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291071+0000","last_change":"2023-11-26T07:17:35.286743+0000","last_active":"2023-11-26T07:17:36.291071+0000","last_peered":"2023-11-26T07:17:36.291071+0000","last_clean":"2023-11-26T07:17:36.291071+0000","last_became_active":"2023-11-26T07:17:35.286436+0000","last_became_peered":"2023-11-26T07:17:35.286436+0000","last_unstale":"2023-11-26T07:17:36.291071+0000","last_undegraded":"2023-11-26T07:17:36.291071+0000","last_fullsized":"2023-11-26T07:17:36.291071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.310076+0000","last_change":"2023-11-26T07:17:34.271042+0000","last_active":"2023-11-26T07:17:35.310076+0000","last_peered":"2023-11-26T07:17:35.310076+0000","last_clean":"2023-11-26T07:17:35.310076+0000","last_became_active":"2023-11-26T07:17:34.270720+0000","last_became_peered":"2023-11-26T07:17:34.270720+0000","last_unstale":"2023-11-26T07:17:35.310076+0000","last_undegraded":"2023-11-26T07:17:35.310076+0000","last_fullsized":"2023-11-26T07:17:35.310076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6080000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.76}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.931}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1030000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9239999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1749999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.966}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:17:40.159 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:17:40.159 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-26T07:17:40.159 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-26T07:17:40.160 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-26T07:17:40.160 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-26T07:17:40.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.417+0000 7f898a333640 1 Processor -- start 2023-11-26T07:17:40.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.417+0000 7f898a333640 1 -- start start 2023-11-26T07:17:40.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.419+0000 7f898a333640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f898415df80 0x7f89840ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.419+0000 7f898a333640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89840cd470 0x7f898415b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.419+0000 7f898a333640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898415e3f0 con 0x7f89840b2250 2023-11-26T07:17:40.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.419+0000 7f898a333640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898415a990 con 0x7f898415df80 2023-11-26T07:17:40.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.419+0000 7f898a333640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898415ab80 con 0x7f89840cd470 2023-11-26T07:17:40.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.419+0000 7f8983fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f89840b2250 0x7f89840b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54320/0 (socket says 172.21.15.77:54320) 2023-11-26T07:17:40.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.419+0000 7f8983fff640 1 -- 172.21.15.77:0/2474513642 learned_addr learned my addr 172.21.15.77:0/2474513642 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:40.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.419+0000 7f897b7fe640 1 --2- 172.21.15.77:0/2474513642 >> v2:172.21.15.77:3300/0 conn(0x7f898415df80 0x7f89840ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.420+0000 7f89888d0640 1 --2- 172.21.15.77:0/2474513642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89840cd470 0x7f898415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.420+0000 7f89837fe640 1 -- 172.21.15.77:0/2474513642 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011317773 0 0) 0x7f898415e3f0 con 0x7f89840b2250 2023-11-26T07:17:40.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.420+0000 7f89837fe640 1 -- 172.21.15.77:0/2474513642 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8970003520 con 0x7f89840b2250 2023-11-26T07:17:40.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.420+0000 7f897b7fe640 1 -- 172.21.15.77:0/2474513642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89840cd470 msgr2=0x7f898415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:40.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.420+0000 7f897b7fe640 1 --2- 172.21.15.77:0/2474513642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89840cd470 0x7f898415b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.420+0000 7f897b7fe640 1 -- 172.21.15.77:0/2474513642 >> v1:172.21.15.77:6789/0 conn(0x7f89840b2250 legacy=0x7f89840b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.420+0000 7f897b7fe640 1 -- 172.21.15.77:0/2474513642 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89840b2d40 con 0x7f898415df80 2023-11-26T07:17:40.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.421+0000 7f897b7fe640 1 --2- 172.21.15.77:0/2474513642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f898415df80 0x7f89840ccf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f896c0097a0 tx=0x7f896c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2c5e282f025f25 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.421+0000 7f89837fe640 1 -- 172.21.15.77:0/2474513642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c031830 con 0x7f898415df80 2023-11-26T07:17:40.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.421+0000 7f89837fe640 1 -- 172.21.15.77:0/2474513642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c031990 con 0x7f898415df80 2023-11-26T07:17:40.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.421+0000 7f89837fe640 1 -- 172.21.15.77:0/2474513642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c031d00 con 0x7f898415df80 2023-11-26T07:17:40.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.422+0000 7f898a333640 1 -- 172.21.15.77:0/2474513642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f898415df80 msgr2=0x7f89840ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.422+0000 7f898a333640 1 --2- 172.21.15.77:0/2474513642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f898415df80 0x7f89840ccf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f896c0097a0 tx=0x7f896c02b8d0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.422+0000 7f898a333640 1 -- 172.21.15.77:0/2474513642 shutdown_connections 2023-11-26T07:17:40.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.422+0000 7f898a333640 1 --2- 172.21.15.77:0/2474513642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89840cd470 0x7f898415b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.422+0000 7f898a333640 1 --2- 172.21.15.77:0/2474513642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f898415df80 0x7f89840ccf30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.422+0000 7f898a333640 1 -- 172.21.15.77:0/2474513642 >> 172.21.15.77:0/2474513642 conn(0x7f898406a920 msgr2=0x7f898406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.422+0000 7f898a333640 1 -- 172.21.15.77:0/2474513642 shutdown_connections 2023-11-26T07:17:40.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.422+0000 7f898a333640 1 -- 172.21.15.77:0/2474513642 wait complete. 2023-11-26T07:17:40.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.424+0000 7f898a333640 1 Processor -- start 2023-11-26T07:17:40.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.424+0000 7f898a333640 1 -- start start 2023-11-26T07:17:40.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.425+0000 7f898a333640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89840b2250 0x7f89840c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.425+0000 7f898a333640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89840cd470 0x7f89840c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.425+0000 7f898a333640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f898415df80 0x7f898414c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.425+0000 7f898a333640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89840720c0 con 0x7f89840b2250 2023-11-26T07:17:40.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.425+0000 7f898a333640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8984071b00 con 0x7f89840cd470 2023-11-26T07:17:40.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.425+0000 7f898a333640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8984071de0 con 0x7f898415df80 2023-11-26T07:17:40.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.425+0000 7f8983fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89840b2250 0x7f89840c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.425+0000 7f8983fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89840b2250 0x7f89840c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34678/0 (socket says 172.21.15.77:34678) 2023-11-26T07:17:40.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.425+0000 7f8983fff640 1 -- 172.21.15.77:0/2541250299 learned_addr learned my addr 172.21.15.77:0/2541250299 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:40.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f897b7fe640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89840cd470 0x7f89840c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f89888d0640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f898415df80 0x7f898414c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f8983fff640 1 -- 172.21.15.77:0/2541250299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f898415df80 msgr2=0x7f898414c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f8983fff640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f898415df80 0x7f898414c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f8983fff640 1 -- 172.21.15.77:0/2541250299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89840cd470 msgr2=0x7f89840c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f8983fff640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89840cd470 0x7f89840c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f8983fff640 1 -- 172.21.15.77:0/2541250299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c009400 con 0x7f89840b2250 2023-11-26T07:17:40.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f89888d0640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f898415df80 0x7f898414c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:40.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f8983fff640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89840b2250 0x7f89840c8360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f897400c430 tx=0x7f897400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f89817fa640 1 -- 172.21.15.77:0/2541250299 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974005ce0 con 0x7f89840b2250 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f89817fa640 1 -- 172.21.15.77:0/2541250299 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8974005e40 con 0x7f89840b2250 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f89817fa640 1 -- 172.21.15.77:0/2541250299 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89740072f0 con 0x7f89840b2250 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f898a333640 1 -- 172.21.15.77:0/2541250299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89840afc40 con 0x7f89840b2250 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.426+0000 7f898a333640 1 -- 172.21.15.77:0/2541250299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89840c88a0 con 0x7f89840b2250 2023-11-26T07:17:40.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.428+0000 7f898a333640 1 -- 172.21.15.77:0/2541250299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89840c8a30 con 0x7f89840b2250 2023-11-26T07:17:40.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.429+0000 7f89817fa640 1 -- 172.21.15.77:0/2541250299 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8974007450 con 0x7f89840b2250 2023-11-26T07:17:40.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.429+0000 7f89817fa640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f896406ae40 0x7f896406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.430+0000 7f89817fa640 1 -- 172.21.15.77:0/2541250299 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8974088ca0 con 0x7f89840b2250 2023-11-26T07:17:40.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.430+0000 7f897b7fe640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f896406ae40 0x7f896406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.430+0000 7f897b7fe640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f896406ae40 0x7f896406d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f896c036000 tx=0x7f896c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.434+0000 7f89817fa640 1 -- 172.21.15.77:0/2541250299 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8974053d50 con 0x7f89840b2250 2023-11-26T07:17:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.671+0000 7f898a333640 1 -- 172.21.15.77:0/2541250299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8984067470 con 0x7f89840b2250 2023-11-26T07:17:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.677+0000 7f89817fa640 1 -- 172.21.15.77:0/2541250299 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171031 (secure 0 0 0) 0x7f8974017020 con 0x7f89840b2250 2023-11-26T07:17:40.681 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 -- 172.21.15.77:0/2541250299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f896406ae40 msgr2=0x7f896406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f896406ae40 0x7f896406d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f896c036000 tx=0x7f896c03c040 comp rx=0 tx=0).stop 2023-11-26T07:17:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 -- 172.21.15.77:0/2541250299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89840b2250 msgr2=0x7f89840c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89840b2250 0x7f89840c8360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f897400c430 tx=0x7f897400c8f0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 -- 172.21.15.77:0/2541250299 shutdown_connections 2023-11-26T07:17:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f896406ae40 0x7f896406d300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f898415df80 0x7f898414c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89840cd470 0x7f89840c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 --2- 172.21.15.77:0/2541250299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89840b2250 0x7f89840c8360 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 -- 172.21.15.77:0/2541250299 >> 172.21.15.77:0/2541250299 conn(0x7f898406a920 msgr2=0x7f89841596a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 -- 172.21.15.77:0/2541250299 shutdown_connections 2023-11-26T07:17:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.681+0000 7f898a333640 1 -- 172.21.15.77:0/2541250299 wait complete. 2023-11-26T07:17:40.701 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2342497679},{"type":"v1","addr":"172.21.15.77:6833","nonce":2342497679}]},"active_addr":"172.21.15.77:6833/2342497679","active_change":"2023-11-26T07:17:15.587224+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":470114936}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1918655166}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":3286555064}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":4249928863}]}]} 2023-11-26T07:17:40.705 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-26T07:17:40.705 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-26T07:17:40.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:40.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.909+0000 7f1418c3d640 1 Processor -- start 2023-11-26T07:17:40.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.909+0000 7f1418c3d640 1 -- start start 2023-11-26T07:17:40.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.910+0000 7f1418c3d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f141415c7f0 0x7f141406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.910+0000 7f1418c3d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f14140ce6c0 0x7f14140cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.910+0000 7f1418c3d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14140cece0 con 0x7f14140cf450 2023-11-26T07:17:40.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.910+0000 7f1418c3d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1414156010 con 0x7f14140ce6c0 2023-11-26T07:17:40.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.910+0000 7f1418c3d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141406ce30 con 0x7f141415c7f0 2023-11-26T07:17:40.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.911+0000 7f1412d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f14140ce6c0 0x7f14140cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.911+0000 7f1412d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f14140ce6c0 0x7f14140cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34680/0 (socket says 172.21.15.77:34680) 2023-11-26T07:17:40.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.911+0000 7f1412d9d640 1 -- 172.21.15.77:0/1667735327 learned_addr learned my addr 172.21.15.77:0/1667735327 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:40.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.911+0000 7f141259c640 1 --2- 172.21.15.77:0/1667735327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f141415c7f0 0x7f141406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.911+0000 7f1412d9d640 1 -- 172.21.15.77:0/1667735327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f141415c7f0 msgr2=0x7f141406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.911+0000 7f1412d9d640 1 --2- 172.21.15.77:0/1667735327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f141415c7f0 0x7f141406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.911+0000 7f1412d9d640 1 -- 172.21.15.77:0/1667735327 >> v1:172.21.15.77:6789/0 conn(0x7f14140cf450 legacy=0x7f14140cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.911+0000 7f1412d9d640 1 -- 172.21.15.77:0/1667735327 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141406d040 con 0x7f14140ce6c0 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.913+0000 7f1412d9d640 1 --2- 172.21.15.77:0/1667735327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14140ce6c0 0x7f14140cf8d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f140c009e50 tx=0x7f140c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977f44aceaf0c7f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.913+0000 7f1411d9b640 1 -- 172.21.15.77:0/1667735327 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c02cb00 con 0x7f14140ce6c0 2023-11-26T07:17:40.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.913+0000 7f1411d9b640 1 -- 172.21.15.77:0/1667735327 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c02cc60 con 0x7f14140ce6c0 2023-11-26T07:17:40.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.913+0000 7f1411d9b640 1 -- 172.21.15.77:0/1667735327 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c0343f0 con 0x7f14140ce6c0 2023-11-26T07:17:40.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.914+0000 7f1418c3d640 1 -- 172.21.15.77:0/1667735327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14140ce6c0 msgr2=0x7f14140cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.914+0000 7f1418c3d640 1 --2- 172.21.15.77:0/1667735327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14140ce6c0 0x7f14140cf8d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f140c009e50 tx=0x7f140c02bf60 comp rx=0 tx=0).stop 2023-11-26T07:17:40.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.914+0000 7f1418c3d640 1 -- 172.21.15.77:0/1667735327 shutdown_connections 2023-11-26T07:17:40.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.914+0000 7f1418c3d640 1 --2- 172.21.15.77:0/1667735327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14140ce6c0 0x7f14140cf8d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.914+0000 7f1418c3d640 1 --2- 172.21.15.77:0/1667735327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f141415c7f0 0x7f141406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.914+0000 7f1418c3d640 1 -- 172.21.15.77:0/1667735327 >> 172.21.15.77:0/1667735327 conn(0x7f141406a920 msgr2=0x7f141406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.914+0000 7f1418c3d640 1 -- 172.21.15.77:0/1667735327 shutdown_connections 2023-11-26T07:17:40.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.914+0000 7f1418c3d640 1 -- 172.21.15.77:0/1667735327 wait complete. 2023-11-26T07:17:40.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.915+0000 7f1418c3d640 1 Processor -- start 2023-11-26T07:17:40.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.916+0000 7f1418c3d640 1 -- start start 2023-11-26T07:17:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.916+0000 7f1418c3d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14140ce6c0 0x7f14141474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.916+0000 7f1418c3d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14140cf450 0x7f1414099e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f1418c3d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f141415c7f0 0x7f1414099140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f1418c3d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1414147a00 con 0x7f14140ce6c0 2023-11-26T07:17:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f1418c3d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141409abd0 con 0x7f141415c7f0 2023-11-26T07:17:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f1418c3d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141409a8f0 con 0x7f14140cf450 2023-11-26T07:17:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f141259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14140ce6c0 0x7f14141474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f141259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14140ce6c0 0x7f14141474c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34686/0 (socket says 172.21.15.77:34686) 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f141259c640 1 -- 172.21.15.77:0/3254295840 learned_addr learned my addr 172.21.15.77:0/3254295840 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f141259c640 1 -- 172.21.15.77:0/3254295840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14140cf450 msgr2=0x7f1414099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f141259c640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14140cf450 0x7f1414099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f141259c640 1 -- 172.21.15.77:0/3254295840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f141415c7f0 msgr2=0x7f1414099140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f141259c640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f141415c7f0 0x7f1414099140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f141259c640 1 -- 172.21.15.77:0/3254295840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c009b30 con 0x7f14140ce6c0 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.917+0000 7f141259c640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14140ce6c0 0x7f14141474c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f140400d5f0 tx=0x7f140400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.918+0000 7f140affd640 1 -- 172.21.15.77:0/3254295840 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040125f0 con 0x7f14140ce6c0 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.918+0000 7f140affd640 1 -- 172.21.15.77:0/3254295840 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404012750 con 0x7f14140ce6c0 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.918+0000 7f1418c3d640 1 -- 172.21.15.77:0/3254295840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141409c330 con 0x7f14140ce6c0 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.918+0000 7f140affd640 1 -- 172.21.15.77:0/3254295840 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404012b00 con 0x7f14140ce6c0 2023-11-26T07:17:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.918+0000 7f1418c3d640 1 -- 172.21.15.77:0/3254295840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141409c8f0 con 0x7f14140ce6c0 2023-11-26T07:17:40.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.919+0000 7f1418c3d640 1 -- 172.21.15.77:0/3254295840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141409ca80 con 0x7f14140ce6c0 2023-11-26T07:17:40.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.920+0000 7f140affd640 1 -- 172.21.15.77:0/3254295840 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1404012c60 con 0x7f14140ce6c0 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.920+0000 7f140affd640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13f406ae40 0x7f13f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.920+0000 7f140affd640 1 -- 172.21.15.77:0/3254295840 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14040899c0 con 0x7f14140ce6c0 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.921+0000 7f140bfff640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13f406ae40 0x7f13f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.921+0000 7f140bfff640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13f406ae40 0x7f13f406d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13fc000f60 tx=0x7f13fc0079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:40.925+0000 7f140affd640 1 -- 172.21.15.77:0/3254295840 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1404054b00 con 0x7f14140ce6c0 2023-11-26T07:17:41.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.115+0000 7f1418c3d640 1 -- 172.21.15.77:0/3254295840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1414067470 con 0x7f14140ce6c0 2023-11-26T07:17:41.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.118+0000 7f140affd640 1 -- 172.21.15.77:0/3254295840 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f1404058120 con 0x7f14140ce6c0 2023-11-26T07:17:41.120 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:41.120 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:36.274387+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:41.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.120+0000 7f1418c3d640 1 -- 172.21.15.77:0/3254295840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13f406ae40 msgr2=0x7f13f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.120+0000 7f1418c3d640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13f406ae40 0x7f13f406d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13fc000f60 tx=0x7f13fc0079d0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.120+0000 7f1418c3d640 1 -- 172.21.15.77:0/3254295840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14140ce6c0 msgr2=0x7f14141474c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.120+0000 7f1418c3d640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14140ce6c0 0x7f14141474c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f140400d5f0 tx=0x7f140400dab0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.120+0000 7f1418c3d640 1 -- 172.21.15.77:0/3254295840 shutdown_connections 2023-11-26T07:17:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.120+0000 7f1418c3d640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13f406ae40 0x7f13f406d300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.120+0000 7f1418c3d640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f141415c7f0 0x7f1414099140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.120+0000 7f1418c3d640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14140cf450 0x7f1414099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.120+0000 7f1418c3d640 1 --2- 172.21.15.77:0/3254295840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14140ce6c0 0x7f14141474c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.120+0000 7f1418c3d640 1 -- 172.21.15.77:0/3254295840 >> 172.21.15.77:0/3254295840 conn(0x7f141406a920 msgr2=0x7f14140cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.120+0000 7f1418c3d640 1 -- 172.21.15.77:0/3254295840 shutdown_connections 2023-11-26T07:17:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.121+0000 7f1418c3d640 1 -- 172.21.15.77:0/3254295840 wait complete. 2023-11-26T07:17:41.141 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-26T07:17:41.142 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:41.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.353+0000 7fb84c15a640 1 Processor -- start 2023-11-26T07:17:41.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.354+0000 7fb84c15a640 1 -- start start 2023-11-26T07:17:41.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.355+0000 7fb84c15a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 0x7fb8440ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.355+0000 7fb84c15a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8440ce710 0x7fb8440cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.355+0000 7fb84c15a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8440b2d90 con 0x7fb8440d1ed0 2023-11-26T07:17:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.355+0000 7fb84c15a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8440ceb80 con 0x7fb8440ce710 2023-11-26T07:17:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.355+0000 7fb84c15a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440b45f0 con 0x7fb8440d22b0 2023-11-26T07:17:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.355+0000 7fb849ef6640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb8440d1ed0 0x7fb8440d1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54334/0 (socket says 172.21.15.77:54334) 2023-11-26T07:17:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.355+0000 7fb849ef6640 1 -- 172.21.15.77:0/3788016183 learned_addr learned my addr 172.21.15.77:0/3788016183 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.355+0000 7fb84a6f7640 1 --2- 172.21.15.77:0/3788016183 >> v2:172.21.15.77:3300/0 conn(0x7fb8440ce710 0x7fb8440cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.356+0000 7fb8496f5640 1 --2- 172.21.15.77:0/3788016183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 0x7fb8440ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.356+0000 7fb84a6f7640 1 -- 172.21.15.77:0/3788016183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 msgr2=0x7fb8440ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.356+0000 7fb84a6f7640 1 --2- 172.21.15.77:0/3788016183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 0x7fb8440ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.356+0000 7fb84a6f7640 1 -- 172.21.15.77:0/3788016183 >> v1:172.21.15.77:6789/0 conn(0x7fb8440d1ed0 legacy=0x7fb8440d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.356+0000 7fb84a6f7640 1 -- 172.21.15.77:0/3788016183 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440ced90 con 0x7fb8440ce710 2023-11-26T07:17:41.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.356+0000 7fb8496f5640 1 --2- 172.21.15.77:0/3788016183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 0x7fb8440ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:41.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.356+0000 7fb848ef4640 1 -- 172.21.15.77:0/3788016183 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818627092 0 0) 0x7fb8440b2d90 con 0x7fb8440d1ed0 2023-11-26T07:17:41.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.357+0000 7fb84a6f7640 1 --2- 172.21.15.77:0/3788016183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8440ce710 0x7fb8440cfdb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0097a0 tx=0x7fb83c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396d74669c3518fb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.357+0000 7fb848ef4640 1 -- 172.21.15.77:0/3788016183 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c02e070 con 0x7fb8440ce710 2023-11-26T07:17:41.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.357+0000 7fb848ef4640 1 -- 172.21.15.77:0/3788016183 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c0315a0 con 0x7fb8440ce710 2023-11-26T07:17:41.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.357+0000 7fb848ef4640 1 -- 172.21.15.77:0/3788016183 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c031930 con 0x7fb8440ce710 2023-11-26T07:17:41.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.358+0000 7fb84c15a640 1 -- 172.21.15.77:0/3788016183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8440ce710 msgr2=0x7fb8440cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.358+0000 7fb84c15a640 1 --2- 172.21.15.77:0/3788016183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8440ce710 0x7fb8440cfdb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0097a0 tx=0x7fb83c02b840 comp rx=0 tx=0).stop 2023-11-26T07:17:41.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.358+0000 7fb84c15a640 1 -- 172.21.15.77:0/3788016183 shutdown_connections 2023-11-26T07:17:41.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.358+0000 7fb84c15a640 1 --2- 172.21.15.77:0/3788016183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8440ce710 0x7fb8440cfdb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.358+0000 7fb84c15a640 1 --2- 172.21.15.77:0/3788016183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 0x7fb8440ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.358+0000 7fb84c15a640 1 -- 172.21.15.77:0/3788016183 >> 172.21.15.77:0/3788016183 conn(0x7fb84408af60 msgr2=0x7fb8440d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.358+0000 7fb84c15a640 1 -- 172.21.15.77:0/3788016183 shutdown_connections 2023-11-26T07:17:41.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.358+0000 7fb84c15a640 1 -- 172.21.15.77:0/3788016183 wait complete. 2023-11-26T07:17:41.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.360+0000 7fb84c15a640 1 Processor -- start 2023-11-26T07:17:41.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.360+0000 7fb84c15a640 1 -- start start 2023-11-26T07:17:41.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.361+0000 7fb84c15a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8440ce710 0x7fb84406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.361+0000 7fb84c15a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8440d1ed0 0x7fb8441d8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.361+0000 7fb84c15a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 0x7fb8441d8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.361+0000 7fb84c15a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440c9420 con 0x7fb8440ce710 2023-11-26T07:17:41.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.361+0000 7fb84c15a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440c9700 con 0x7fb8440d1ed0 2023-11-26T07:17:41.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.361+0000 7fb84c15a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440c99e0 con 0x7fb8440d22b0 2023-11-26T07:17:41.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.361+0000 7fb849ef6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8440ce710 0x7fb84406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.361+0000 7fb849ef6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8440ce710 0x7fb84406bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34694/0 (socket says 172.21.15.77:34694) 2023-11-26T07:17:41.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.361+0000 7fb849ef6640 1 -- 172.21.15.77:0/2938726323 learned_addr learned my addr 172.21.15.77:0/2938726323 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.361+0000 7fb8496f5640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8440d1ed0 0x7fb8441d8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb84a6f7640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 0x7fb8441d8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb849ef6640 1 -- 172.21.15.77:0/2938726323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 msgr2=0x7fb8441d8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb849ef6640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 0x7fb8441d8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb849ef6640 1 -- 172.21.15.77:0/2938726323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8440d1ed0 msgr2=0x7fb8441d8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb849ef6640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8440d1ed0 0x7fb8441d8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb849ef6640 1 -- 172.21.15.77:0/2938726323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009400 con 0x7fb8440ce710 2023-11-26T07:17:41.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb84a6f7640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 0x7fb8441d8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:41.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb849ef6640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8440ce710 0x7fb84406bcb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb83400c890 tx=0x7fb83400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb8427fc640 1 -- 172.21.15.77:0/2938726323 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83400a640 con 0x7fb8440ce710 2023-11-26T07:17:41.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb8427fc640 1 -- 172.21.15.77:0/2938726323 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83400a7c0 con 0x7fb8440ce710 2023-11-26T07:17:41.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb8427fc640 1 -- 172.21.15.77:0/2938726323 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83400ab70 con 0x7fb8440ce710 2023-11-26T07:17:41.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb84c15a640 1 -- 172.21.15.77:0/2938726323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8440c9cc0 con 0x7fb8440ce710 2023-11-26T07:17:41.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.362+0000 7fb84c15a640 1 -- 172.21.15.77:0/2938726323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84406c1f0 con 0x7fb8440ce710 2023-11-26T07:17:41.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.364+0000 7fb84c15a640 1 -- 172.21.15.77:0/2938726323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8440ca7e0 con 0x7fb8440ce710 2023-11-26T07:17:41.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.365+0000 7fb8427fc640 1 -- 172.21.15.77:0/2938726323 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb83400acd0 con 0x7fb8440ce710 2023-11-26T07:17:41.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.366+0000 7fb8427fc640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb83006ae40 0x7fb83006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.366+0000 7fb8427fc640 1 -- 172.21.15.77:0/2938726323 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb834088ba0 con 0x7fb8440ce710 2023-11-26T07:17:41.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.366+0000 7fb8496f5640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb83006ae40 0x7fb83006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.366+0000 7fb8496f5640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb83006ae40 0x7fb83006d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb84406ced0 tx=0x7fb838008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.370+0000 7fb8427fc640 1 -- 172.21.15.77:0/2938726323 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8440ca7e0 con 0x7fb8440ce710 2023-11-26T07:17:41.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.563+0000 7fb84c15a640 1 -- 172.21.15.77:0/2938726323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8440ca7e0 con 0x7fb8440ce710 2023-11-26T07:17:41.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.564+0000 7fb8427fc640 1 -- 172.21.15.77:0/2938726323 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7fb8440ca7e0 con 0x7fb8440ce710 2023-11-26T07:17:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:41.566 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:36.274387+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:41.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.567+0000 7fb84c15a640 1 -- 172.21.15.77:0/2938726323 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb83006ae40 msgr2=0x7fb83006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.567+0000 7fb84c15a640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb83006ae40 0x7fb83006d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb84406ced0 tx=0x7fb838008040 comp rx=0 tx=0).stop 2023-11-26T07:17:41.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.567+0000 7fb84c15a640 1 -- 172.21.15.77:0/2938726323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8440ce710 msgr2=0x7fb84406bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.567+0000 7fb84c15a640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8440ce710 0x7fb84406bcb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb83400c890 tx=0x7fb83400cd50 comp rx=0 tx=0).stop 2023-11-26T07:17:41.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.567+0000 7fb84c15a640 1 -- 172.21.15.77:0/2938726323 shutdown_connections 2023-11-26T07:17:41.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.567+0000 7fb84c15a640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb83006ae40 0x7fb83006d300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.567+0000 7fb84c15a640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8440d22b0 0x7fb8441d8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.567+0000 7fb84c15a640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8440d1ed0 0x7fb8441d8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.567+0000 7fb84c15a640 1 --2- 172.21.15.77:0/2938726323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8440ce710 0x7fb84406bcb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.567+0000 7fb84c15a640 1 -- 172.21.15.77:0/2938726323 >> 172.21.15.77:0/2938726323 conn(0x7fb84408af60 msgr2=0x7fb8441e4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.568+0000 7fb84c15a640 1 -- 172.21.15.77:0/2938726323 shutdown_connections 2023-11-26T07:17:41.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.568+0000 7fb84c15a640 1 -- 172.21.15.77:0/2938726323 wait complete. 2023-11-26T07:17:41.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-26T07:17:41.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-26T07:17:41.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-26T07:17:41.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-26T07:17:41.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-26T07:17:41.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-26T07:17:41.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-26T07:17:41.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-26T07:17:41.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.892+0000 7f9fa3383640 1 Processor -- start 2023-11-26T07:17:41.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.893+0000 7f9fa3383640 1 -- start start 2023-11-26T07:17:41.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.894+0000 7f9fa3383640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9f9403c060 0x7f9f940e7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.895+0000 7f9fa3383640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f94053c70 0x7f9f94054100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.895+0000 7f9fa3383640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f94054640 con 0x7f9f940e3120 2023-11-26T07:17:41.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.895+0000 7f9fa3383640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f94007b30 con 0x7f9f9403c060 2023-11-26T07:17:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.895+0000 7f9fa3383640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940587d0 con 0x7f9f94053c70 2023-11-26T07:17:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.895+0000 7f9fa091e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9f9403c060 0x7f9f940e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.895+0000 7f9fa091e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9f9403c060 0x7f9f940e7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34706/0 (socket says 172.21.15.77:34706) 2023-11-26T07:17:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.895+0000 7f9fa091e640 1 -- 172.21.15.77:0/661750363 learned_addr learned my addr 172.21.15.77:0/661750363 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.896+0000 7f9fa1920640 1 --2- 172.21.15.77:0/661750363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f94053c70 0x7f9f94054100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.896+0000 7fc9564e0640 1 Processor -- start 2023-11-26T07:17:41.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.896+0000 7f9fa091e640 1 -- 172.21.15.77:0/661750363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f94053c70 msgr2=0x7f9f94054100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.896+0000 7f9fa091e640 1 --2- 172.21.15.77:0/661750363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f94053c70 0x7f9f94054100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.896+0000 7f9fa091e640 1 -- 172.21.15.77:0/661750363 >> v1:172.21.15.159:6789/0 conn(0x7f9f940e3120 legacy=0x7f9f94058010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.896+0000 7f9fa091e640 1 -- 172.21.15.77:0/661750363 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94058ab0 con 0x7f9f9403c060 2023-11-26T07:17:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.896+0000 7f9f93fff640 1 -- 172.21.15.77:0/661750363 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089341786 0 0) 0x7f9f94054640 con 0x7f9f940e3120 2023-11-26T07:17:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.897+0000 7fc9564e0640 1 -- start start 2023-11-26T07:17:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.897+0000 7fc60b71d640 1 Processor -- start 2023-11-26T07:17:41.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.898+0000 7f9fa091e640 1 --2- 172.21.15.77:0/661750363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9403c060 0x7f9f940e7740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009870 tx=0x7f9f8c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c67a24a5e3aa7e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.897+0000 7fc60b71d640 1 -- start start 2023-11-26T07:17:41.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.898+0000 7f9f93fff640 1 -- 172.21.15.77:0/661750363 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c030840 con 0x7f9f9403c060 2023-11-26T07:17:41.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.898+0000 7f9f93fff640 1 -- 172.21.15.77:0/661750363 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c0309a0 con 0x7f9f9403c060 2023-11-26T07:17:41.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.898+0000 7f9f93fff640 1 -- 172.21.15.77:0/661750363 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c030d30 con 0x7f9f9403c060 2023-11-26T07:17:41.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.899+0000 7fc9564e0640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc9500cf2a0 0x7fc9500b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.899+0000 7fc9564e0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9500b4140 0x7fc9500b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.899+0000 7fc9564e0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc950071490 con 0x7fc95015d3b0 2023-11-26T07:17:41.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.899+0000 7fc9564e0640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9500703f0 con 0x7fc9500cf2a0 2023-11-26T07:17:41.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.899+0000 7fc9564e0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9500706d0 con 0x7fc9500b4140 2023-11-26T07:17:41.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.899+0000 7fc60b71d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6041539b0 0x7fc6040709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7f9fa3383640 1 -- 172.21.15.77:0/661750363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9403c060 msgr2=0x7f9f940e7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7f9fa3383640 1 --2- 172.21.15.77:0/661750363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9403c060 0x7f9f940e7740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009870 tx=0x7f9f8c02b980 comp rx=0 tx=0).stop 2023-11-26T07:17:41.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7fc94ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc95015d3b0 0x7fc9500ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54338/0 (socket says 172.21.15.77:54338) 2023-11-26T07:17:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7fc94ffff640 1 -- 172.21.15.77:0/1176568624 learned_addr learned my addr 172.21.15.77:0/1176568624 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7fc94f7fe640 1 --2- 172.21.15.77:0/1176568624 >> v2:172.21.15.159:3300/0 conn(0x7fc9500cf2a0 0x7fc9500b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7fc954a7d640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9500b4140 0x7fc9500b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7fc60b71d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc6040b30e0 0x7fc60406e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7fc60b71d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60415aa20 con 0x7fc6040cefd0 2023-11-26T07:17:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7fc60b71d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc604159da0 con 0x7fc6041539b0 2023-11-26T07:17:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7fc60b71d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60415a080 con 0x7fc6040b30e0 2023-11-26T07:17:41.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7f9fa3383640 1 -- 172.21.15.77:0/661750363 shutdown_connections 2023-11-26T07:17:41.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7f9fa3383640 1 --2- 172.21.15.77:0/661750363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f94053c70 0x7f9f94054100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7f9fa3383640 1 --2- 172.21.15.77:0/661750363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9403c060 0x7f9f940e7740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7f9fa3383640 1 -- 172.21.15.77:0/661750363 >> 172.21.15.77:0/661750363 conn(0x7f9f94058ea0 msgr2=0x7f9f94059280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7fc6094b9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6041539b0 0x7fc6040709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7fc6094b9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6041539b0 0x7fc6040709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34722/0 (socket says 172.21.15.77:34722) 2023-11-26T07:17:41.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.900+0000 7fc6094b9640 1 -- 172.21.15.77:0/1053613479 learned_addr learned my addr 172.21.15.77:0/1053613479 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7fc609cba640 1 --2- 172.21.15.77:0/1053613479 >> v2:172.21.15.159:3300/0 conn(0x7fc6040b30e0 0x7fc60406e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7f9fa3383640 1 -- 172.21.15.77:0/661750363 shutdown_connections 2023-11-26T07:17:41.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517826812 0 0) 0x7fc950071490 con 0x7fc95015d3b0 2023-11-26T07:17:41.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc944003520 con 0x7fc95015d3b0 2023-11-26T07:17:41.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7f9fa3383640 1 -- 172.21.15.77:0/661750363 wait complete. 2023-11-26T07:17:41.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1730745341 0 0) 0x7fc944003520 con 0x7fc95015d3b0 2023-11-26T07:17:41.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9500b4140 msgr2=0x7fc9500b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7fc94effd640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9500b4140 0x7fc9500b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7fc6094b9640 1 -- 172.21.15.77:0/1053613479 >> v2:172.21.15.159:3300/0 conn(0x7fc6040b30e0 msgr2=0x7fc60406e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7fc6094b9640 1 --2- 172.21.15.77:0/1053613479 >> v2:172.21.15.159:3300/0 conn(0x7fc6040b30e0 0x7fc60406e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.901+0000 7fc6094b9640 1 -- 172.21.15.77:0/1053613479 >> v1:172.21.15.159:6789/0 conn(0x7fc6040cefd0 legacy=0x7fc6040b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.902+0000 7fc6094b9640 1 -- 172.21.15.77:0/1053613479 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60415a360 con 0x7fc6041539b0 2023-11-26T07:17:41.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.903+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 >> v2:172.21.15.159:3300/0 conn(0x7fc9500cf2a0 msgr2=0x7fc9500b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.903+0000 7fc94effd640 1 --2- 172.21.15.77:0/1176568624 >> v2:172.21.15.159:3300/0 conn(0x7fc9500cf2a0 0x7fc9500b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.903+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9500709b0 con 0x7fc95015d3b0 2023-11-26T07:17:41.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.903+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fc938001670 con 0x7fc95015d3b0 2023-11-26T07:17:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.903+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 >> v1:172.21.15.77:6789/0 conn(0x7fc95015d3b0 legacy=0x7fc9500ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.903+0000 7fc94effd640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc944003970 0x7fc944003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.903+0000 7fc94effd640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9440047c0 0x7fc944004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.903+0000 7fc94effd640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc944005180 0x7fc94400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.903+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9500703f0 con 0x7fc9440047c0 2023-11-26T07:17:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.903+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9500706d0 con 0x7fc944003970 2023-11-26T07:17:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.903+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94400bec0 con 0x7fc944005180 2023-11-26T07:17:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.904+0000 7fc94f7fe640 1 --2- 172.21.15.77:0/1176568624 >> v2:172.21.15.159:3300/0 conn(0x7fc9500cf2a0 0x7fc9500b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.904+0000 7fc94ffff640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc944003970 0x7fc944003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.905+0000 7f9fa3383640 1 Processor -- start 2023-11-26T07:17:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.905+0000 7fc94f7fe640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9440047c0 0x7fc944004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.904+0000 7fc6094b9640 1 --2- 172.21.15.77:0/1053613479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6041539b0 0x7fc6040709a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc604157620 tx=0x7fc5fc02bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc88e2788b8a240 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.905+0000 7fc5fbfff640 1 -- 172.21.15.77:0/1053613479 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc02cb30 con 0x7fc6041539b0 2023-11-26T07:17:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.905+0000 7fc5fbfff640 1 -- 172.21.15.77:0/1053613479 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc02cc90 con 0x7fc6041539b0 2023-11-26T07:17:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.905+0000 7fc5fbfff640 1 -- 172.21.15.77:0/1053613479 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc034610 con 0x7fc6041539b0 2023-11-26T07:17:41.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.905+0000 7fc94ffff640 1 -- 172.21.15.77:0/1176568624 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc944005180 msgr2=0x7fc94400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.905+0000 7fc94ffff640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc944005180 0x7fc94400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.905+0000 7fc94ffff640 1 -- 172.21.15.77:0/1176568624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9440047c0 msgr2=0x7fc944004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.905+0000 7fc94ffff640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9440047c0 0x7fc944004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.905+0000 7fc94ffff640 1 -- 172.21.15.77:0/1176568624 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9500709b0 con 0x7fc944003970 2023-11-26T07:17:41.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.905+0000 7fc94f7fe640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9440047c0 0x7fc944004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:41.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.906+0000 7fc60b71d640 1 -- 172.21.15.77:0/1053613479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6041539b0 msgr2=0x7fc6040709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.906+0000 7fc60b71d640 1 --2- 172.21.15.77:0/1053613479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6041539b0 0x7fc6040709a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc604157620 tx=0x7fc5fc02bf90 comp rx=0 tx=0).stop 2023-11-26T07:17:41.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.906+0000 7f9fa3383640 1 -- start start 2023-11-26T07:17:41.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.906+0000 7fc60b71d640 1 -- 172.21.15.77:0/1053613479 shutdown_connections 2023-11-26T07:17:41.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.906+0000 7fc60b71d640 1 --2- 172.21.15.77:0/1053613479 >> v2:172.21.15.159:3300/0 conn(0x7fc6040b30e0 0x7fc60406e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.906+0000 7fc60b71d640 1 --2- 172.21.15.77:0/1053613479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6041539b0 0x7fc6040709a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.906+0000 7fc60b71d640 1 -- 172.21.15.77:0/1053613479 >> 172.21.15.77:0/1053613479 conn(0x7fc60406ae10 msgr2=0x7fc6040b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.907+0000 7fc60b71d640 1 -- 172.21.15.77:0/1053613479 shutdown_connections 2023-11-26T07:17:41.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.907+0000 7fc60b71d640 1 -- 172.21.15.77:0/1053613479 wait complete. 2023-11-26T07:17:41.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.907+0000 7fe6eeb43640 1 Processor -- start 2023-11-26T07:17:41.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.907+0000 7fc94ffff640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc944003970 0x7fc944003d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c270 tx=0x7fc9440057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57280672ace0163e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.908+0000 7f9fa3383640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9403c060 0x7f9f9404e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.908+0000 7f9fa3383640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f94053c70 0x7f9f940e0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.908+0000 7f9fa3383640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f940e3120 0x7f9f9404d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.908+0000 7f9fa3383640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940e1280 con 0x7f9f9403c060 2023-11-26T07:17:41.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.908+0000 7f9fa3383640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9417bf80 con 0x7f9f94053c70 2023-11-26T07:17:41.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.908+0000 7f9fa3383640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9404dab0 con 0x7f9f940e3120 2023-11-26T07:17:41.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.908+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93802cb30 con 0x7fc944003970 2023-11-26T07:17:41.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.908+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93802cc90 con 0x7fc944003970 2023-11-26T07:17:41.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.908+0000 7fc94effd640 1 -- 172.21.15.77:0/1176568624 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380058d0 con 0x7fc944003970 2023-11-26T07:17:41.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.907+0000 7fe6eeb43640 1 -- start start 2023-11-26T07:17:41.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7fe6eeb43640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe6e80ccbd0 0x7fe6e81660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7fe6eeb43640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe6e80c9650 0x7fe6e80c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7fe6eeb43640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e81655f0 con 0x7fe6e80ccfb0 2023-11-26T07:17:41.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7fe6eeb43640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e80cc380 con 0x7fe6e80c9650 2023-11-26T07:17:41.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7fe6eeb43640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e8162b30 con 0x7fe6e80ccbd0 2023-11-26T07:17:41.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7fc9564e0640 1 -- 172.21.15.77:0/1176568624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc944003970 msgr2=0x7fc944003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7f9fa111f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9403c060 0x7f9f9404e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7fc9564e0640 1 --2- 172.21.15.77:0/1176568624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc944003970 0x7fc944003d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c270 tx=0x7fc9440057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7f9fa111f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9403c060 0x7f9f9404e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34730/0 (socket says 172.21.15.77:34730) 2023-11-26T07:17:41.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7f9fa111f640 1 -- 172.21.15.77:0/3728213198 learned_addr learned my addr 172.21.15.77:0/3728213198 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7fc954a7d640 1 -- 172.21.15.77:0/1176568624 reap_dead start 2023-11-26T07:17:41.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7fe6e7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe6e80ccfb0 0x7fe6e8162000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54340/0 (socket says 172.21.15.77:54340) 2023-11-26T07:17:41.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7fe6e7fff640 1 -- 172.21.15.77:0/624966441 learned_addr learned my addr 172.21.15.77:0/624966441 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:41.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7fe6ec8df640 1 --2- 172.21.15.77:0/624966441 >> v2:172.21.15.159:3300/0 conn(0x7fe6e80ccbd0 0x7fe6e81660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7fc9564e0640 1 -- 172.21.15.77:0/1176568624 shutdown_connections 2023-11-26T07:17:41.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7fc9564e0640 1 -- 172.21.15.77:0/1176568624 >> 172.21.15.77:0/1176568624 conn(0x7fc95006ae10 msgr2=0x7fc9500b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7fe6ed0e0640 1 --2- 172.21.15.77:0/624966441 >> v2:172.21.15.77:3300/0 conn(0x7fe6e80c9650 0x7fe6e80c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370726603 0 0) 0x7fe6e81655f0 con 0x7fe6e80ccfb0 2023-11-26T07:17:41.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d8003520 con 0x7fe6e80ccfb0 2023-11-26T07:17:41.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7fbc01b43640 1 Processor -- start 2023-11-26T07:17:41.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7fc9564e0640 1 -- 172.21.15.77:0/1176568624 shutdown_connections 2023-11-26T07:17:41.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7f9fa1920640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f940e3120 0x7f9f9404d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.909+0000 7f9fa091e640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f94053c70 0x7f9f940e0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7f9fa1920640 1 -- 172.21.15.77:0/3728213198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f94053c70 msgr2=0x7f9f940e0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7fc60b71d640 1 Processor -- start 2023-11-26T07:17:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7f9fa1920640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f94053c70 0x7f9f940e0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.910+0000 7f9fa1920640 1 -- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9403c060 msgr2=0x7f9f9404e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1354544072 0 0) 0x7fe6d8003520 con 0x7fe6e80ccfb0 2023-11-26T07:17:41.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 >> v2:172.21.15.159:3300/0 conn(0x7fe6e80ccbd0 msgr2=0x7fe6e81660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7fe6e77fe640 1 --2- 172.21.15.77:0/624966441 >> v2:172.21.15.159:3300/0 conn(0x7fe6e80ccbd0 0x7fe6e81660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 >> v2:172.21.15.77:3300/0 conn(0x7fe6e80c9650 msgr2=0x7fe6e80c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7fe6e77fe640 1 --2- 172.21.15.77:0/624966441 >> v2:172.21.15.77:3300/0 conn(0x7fe6e80c9650 0x7fe6e80c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7fc9564e0640 1 -- 172.21.15.77:0/1176568624 wait complete. 2023-11-26T07:17:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8162e10 con 0x7fe6e80ccfb0 2023-11-26T07:17:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7fbc01b43640 1 -- start start 2023-11-26T07:17:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7f9fa1920640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9403c060 0x7f9f9404e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7f9fa1920640 1 -- 172.21.15.77:0/3728213198 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0094d0 con 0x7f9f940e3120 2023-11-26T07:17:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fe6d4001670 con 0x7fe6e80ccfb0 2023-11-26T07:17:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 >> v1:172.21.15.77:6789/0 conn(0x7fe6e80ccfb0 legacy=0x7fe6e8162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7fe6e77fe640 1 --2- 172.21.15.77:0/624966441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d80039c0 0x7fe6d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7fe6e77fe640 1 --2- 172.21.15.77:0/624966441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6d80047c0 0x7fe6d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7fe6e77fe640 1 --2- 172.21.15.77:0/624966441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6d8005180 0x7fe6d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80cc380 con 0x7fe6d80039c0 2023-11-26T07:17:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8162b30 con 0x7fe6d8005180 2023-11-26T07:17:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d800bf70 con 0x7fe6d80047c0 2023-11-26T07:17:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.913+0000 7fe6ed0e0640 1 --2- 172.21.15.77:0/624966441 >> v2:172.21.15.77:3300/0 conn(0x7fe6e80c9650 0x7fe6e80c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7fc60b71d640 1 -- start start 2023-11-26T07:17:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.913+0000 7fc60b71d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6040b30e0 0x7fc604071a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.913+0000 7fc60b71d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6040cefd0 0x7fc604144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.913+0000 7fc60b71d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6041539b0 0x7fc6041431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.913+0000 7fc60b71d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc604145290 con 0x7fc6041539b0 2023-11-26T07:17:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.913+0000 7fc60b71d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc604145570 con 0x7fc6040b30e0 2023-11-26T07:17:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.913+0000 7fc60b71d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc604145850 con 0x7fc6040cefd0 2023-11-26T07:17:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.911+0000 7f9fa111f640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9403c060 0x7f9f9404e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7f9fa1920640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f940e3120 0x7f9f9404d570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c064180 tx=0x7f9f9c068090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7f9f91ffb640 1 -- 172.21.15.77:0/3728213198 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c0723d0 con 0x7f9f940e3120 2023-11-26T07:17:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7f9f91ffb640 1 -- 172.21.15.77:0/3728213198 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c072550 con 0x7f9f940e3120 2023-11-26T07:17:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.912+0000 7f9f91ffb640 1 -- 172.21.15.77:0/3728213198 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c072900 con 0x7f9f940e3120 2023-11-26T07:17:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.913+0000 7f9fa3383640 1 -- 172.21.15.77:0/3728213198 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f940e3fb0 con 0x7f9f940e3120 2023-11-26T07:17:41.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.913+0000 7fe6ed0e0640 1 --2- 172.21.15.77:0/624966441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6d8005180 0x7fe6d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fe6ec8df640 1 --2- 172.21.15.77:0/624966441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d80039c0 0x7fe6d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fe6e7fff640 1 --2- 172.21.15.77:0/624966441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6d80047c0 0x7fe6d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7f6c327db640 1 Processor -- start 2023-11-26T07:17:41.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fc609cba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6041539b0 0x7fc6041431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fc6094b9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6040b30e0 0x7fc604071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fc609cba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6041539b0 0x7fc6041431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34756/0 (socket says 172.21.15.77:34756) 2023-11-26T07:17:41.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fc609cba640 1 -- 172.21.15.77:0/1482516121 learned_addr learned my addr 172.21.15.77:0/1482516121 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.913+0000 7f9fa3383640 1 -- 172.21.15.77:0/3728213198 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f940e3680 con 0x7f9f940e3120 2023-11-26T07:17:41.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7f6c327db640 1 -- start start 2023-11-26T07:17:41.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fc9564e0640 1 Processor -- start 2023-11-26T07:17:41.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fc608cb8640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6040cefd0 0x7fc604144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fe6ec8df640 1 -- 172.21.15.77:0/624966441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6d80047c0 msgr2=0x7fe6d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fe6ec8df640 1 --2- 172.21.15.77:0/624966441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6d80047c0 0x7fe6d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fe6ec8df640 1 -- 172.21.15.77:0/624966441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6d8005180 msgr2=0x7fe6d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fe6ec8df640 1 --2- 172.21.15.77:0/624966441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6d8005180 0x7fe6d800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.914+0000 7fe6ec8df640 1 -- 172.21.15.77:0/624966441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8003520 con 0x7fe6d80039c0 2023-11-26T07:17:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.915+0000 7f9fa3383640 1 -- 172.21.15.77:0/3728213198 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f940e3500 con 0x7f9f940e3120 2023-11-26T07:17:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.915+0000 7fe6ed0e0640 1 -- 172.21.15.77:0/624966441 reap_dead start 2023-11-26T07:17:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.915+0000 7fbc01b43640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbbfc15d490 0x7fbbfc0cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fc609cba640 1 -- 172.21.15.77:0/1482516121 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6040cefd0 msgr2=0x7fc604144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fc609cba640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6040cefd0 0x7fc604144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fe6ec8df640 1 --2- 172.21.15.77:0/624966441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d80039c0 0x7fe6d8003de0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009ac0 tx=0x7fe6d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67417ecddcd3820f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fc9564e0640 1 -- start start 2023-11-26T07:17:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fc609cba640 1 -- 172.21.15.77:0/1482516121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6040b30e0 msgr2=0x7fc604071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fc609cba640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6040b30e0 0x7fc604071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fc609cba640 1 -- 172.21.15.77:0/1482516121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc009b30 con 0x7fc6041539b0 2023-11-26T07:17:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fbc01b43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbfc0b63d0 0x7fbbfc0d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fbc01b43640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc0cea30 con 0x7fbbfc0ce270 2023-11-26T07:17:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fbc01b43640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0d0450 con 0x7fbbfc15d490 2023-11-26T07:17:41.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fbc01b43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0d0bf0 con 0x7fbbfc0b63d0 2023-11-26T07:17:41.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc02c6d0 con 0x7fe6d80039c0 2023-11-26T07:17:41.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc02c830 con 0x7fe6d80039c0 2023-11-26T07:17:41.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7fe6e77fe640 1 -- 172.21.15.77:0/624966441 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc02cbc0 con 0x7fe6d80039c0 2023-11-26T07:17:41.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7f6c327db640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c240e7b90 0x7f6c24039ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7f6c327db640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2403b830 con 0x7f6c240e3610 2023-11-26T07:17:41.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7f6c327db640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2403bb10 con 0x7f6c240e7700 2023-11-26T07:17:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7f6c327db640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2403bdf0 con 0x7f6c240e7b90 2023-11-26T07:17:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.916+0000 7fbc00b41640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbbfc15d490 0x7fbbfc0cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7fbc00b41640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbbfc15d490 0x7fbbfc0cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34758/0 (socket says 172.21.15.77:34758) 2023-11-26T07:17:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7fbc00b41640 1 -- 172.21.15.77:0/824399368 learned_addr learned my addr 172.21.15.77:0/824399368 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7fbbfbfff640 1 --2- 172.21.15.77:0/824399368 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbfc0b63d0 0x7fbbfc0d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7fc609cba640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6041539b0 0x7fc6041431c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400d800 tx=0x7fc5f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7fc5f9ffb640 1 -- 172.21.15.77:0/1482516121 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400b6c0 con 0x7fc6041539b0 2023-11-26T07:17:41.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.917+0000 7f6c31fda640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c240e7b90 0x7f6c24039ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7fc5f9ffb640 1 -- 172.21.15.77:0/1482516121 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f400b820 con 0x7fc6041539b0 2023-11-26T07:17:41.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7fc5f9ffb640 1 -- 172.21.15.77:0/1482516121 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400b6c0 con 0x7fc6041539b0 2023-11-26T07:17:41.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7f6c31fda640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c240e7b90 0x7f6c24039ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34764/0 (socket says 172.21.15.77:34764) 2023-11-26T07:17:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7f6c31fda640 1 -- 172.21.15.77:0/808789959 learned_addr learned my addr 172.21.15.77:0/808789959 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7f6c317d9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6c240e3610 0x7f6c240e6ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54346/0 (socket says 172.21.15.77:54346) 2023-11-26T07:17:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7f6c31fda640 1 -- 172.21.15.77:0/808789959 >> v1:172.21.15.159:6789/0 conn(0x7f6c240e7700 legacy=0x7f6c24054860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7fbc00b41640 1 -- 172.21.15.77:0/824399368 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbfc0b63d0 msgr2=0x7fbbfc0d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7fbc00b41640 1 --2- 172.21.15.77:0/824399368 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbfc0b63d0 0x7fbbfc0d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7fbc00b41640 1 -- 172.21.15.77:0/824399368 >> v1:172.21.15.159:6789/0 conn(0x7fbbfc0ce270 legacy=0x7fbbfc160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7fbc00b41640 1 -- 172.21.15.77:0/824399368 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc0d2260 con 0x7fbbfc15d490 2023-11-26T07:17:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7f6c31fda640 1 -- 172.21.15.77:0/808789959 >> v1:172.21.15.77:6789/0 conn(0x7f6c240e3610 legacy=0x7f6c240e6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7f6c31fda640 1 -- 172.21.15.77:0/808789959 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2403c0d0 con 0x7f6c240e7b90 2023-11-26T07:17:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.919+0000 7fc60b71d640 1 -- 172.21.15.77:0/1482516121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc604145b30 con 0x7fc6041539b0 2023-11-26T07:17:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.918+0000 7f9f91ffb640 1 -- 172.21.15.77:0/3728213198 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f9c074940 con 0x7f9f940e3120 2023-11-26T07:17:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.919+0000 7f9f91ffb640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f800736a0 0x7f9f80075b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.919+0000 7f9f91ffb640 1 -- 172.21.15.77:0/3728213198 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f9c104040 con 0x7f9f940e3120 2023-11-26T07:17:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.919+0000 7fc60b71d640 1 -- 172.21.15.77:0/1482516121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc604146580 con 0x7fc6041539b0 2023-11-26T07:17:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.919+0000 7fc9564e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc944003970 0x7fc95014b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.919+0000 7fc9564e0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9500cd980 0x7fc950161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.919+0000 7fc9564e0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc950161570 0x7fc9500aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.919+0000 7fc9564e0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9501619f0 con 0x7fc944003970 2023-11-26T07:17:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.919+0000 7fc9564e0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9500cc4c0 con 0x7fc9500cd980 2023-11-26T07:17:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.919+0000 7fc9564e0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9500cc030 con 0x7fc950161570 2023-11-26T07:17:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7fbc00b41640 1 --2- 172.21.15.77:0/824399368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc15d490 0x7fbbfc0cd8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009870 tx=0x7fbbe402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6480aa08e4702a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7fc954a7d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc950161570 0x7fc9500aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7fc94f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9500cd980 0x7fc950161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7fc94f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9500cd980 0x7fc950161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:55160/0 (socket says 172.21.15.77:55160) 2023-11-26T07:17:41.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7fc94f7fe640 1 -- 172.21.15.77:0/1430296454 learned_addr learned my addr 172.21.15.77:0/1430296454 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7f9f91ffb640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] conn(0x7f9f8007b8c0 0x7f9f8007dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7f3c2bfff640 1 Processor -- start 2023-11-26T07:17:41.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7fc94ffff640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc944003970 0x7fc95014b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7fbbfb7fe640 1 -- 172.21.15.77:0/824399368 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4030840 con 0x7fbbfc15d490 2023-11-26T07:17:41.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.921+0000 7fc60b71d640 1 -- 172.21.15.77:0/1482516121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc604153d90 con 0x7fc6041539b0 2023-11-26T07:17:41.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7fbbfb7fe640 1 -- 172.21.15.77:0/824399368 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe40309a0 con 0x7fbbfc15d490 2023-11-26T07:17:41.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7fbbfb7fe640 1 -- 172.21.15.77:0/824399368 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4030d30 con 0x7fbbfc15d490 2023-11-26T07:17:41.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7fe6eeb43640 1 -- 172.21.15.77:0/624966441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d80039c0 msgr2=0x7fe6d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7fe6eeb43640 1 --2- 172.21.15.77:0/624966441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d80039c0 0x7fe6d8003de0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009ac0 tx=0x7fe6d80057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7f9f91ffb640 1 -- 172.21.15.77:0/3728213198 --> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f8007e390 con 0x7f9f8007b8c0 2023-11-26T07:17:41.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7f9f91ffb640 1 -- 172.21.15.77:0/3728213198 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f9c1044e0 con 0x7f9f940e3120 2023-11-26T07:17:41.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.921+0000 7f9fa111f640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f800736a0 0x7f9f80075b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.921+0000 7f6c31fda640 1 --2- 172.21.15.77:0/808789959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c240e7b90 0x7f6c24039ae0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0620a0 tx=0x7f6c2c0a6600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb8f43b7072c68b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.921+0000 7fbc01b43640 1 -- 172.21.15.77:0/824399368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc15d490 msgr2=0x7fbbfc0cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.921+0000 7fbc01b43640 1 --2- 172.21.15.77:0/824399368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc15d490 0x7fbbfc0cd8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009870 tx=0x7fbbe402b980 comp rx=0 tx=0).stop 2023-11-26T07:17:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7fc94ffff640 1 -- 172.21.15.77:0/1430296454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc950161570 msgr2=0x7fc9500aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7fc94ffff640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc950161570 0x7fc9500aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7fc94ffff640 1 -- 172.21.15.77:0/1430296454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9500cd980 msgr2=0x7fc950161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7fc94ffff640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9500cd980 0x7fc950161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7fc94ffff640 1 -- 172.21.15.77:0/1430296454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9500cb140 con 0x7fc944003970 2023-11-26T07:17:41.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7fbc01b43640 1 -- 172.21.15.77:0/824399368 shutdown_connections 2023-11-26T07:17:41.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7fbc01b43640 1 --2- 172.21.15.77:0/824399368 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbfc0b63d0 0x7fbbfc0d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7f6c23fff640 1 -- 172.21.15.77:0/808789959 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0ad600 con 0x7f6c240e7b90 2023-11-26T07:17:41.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7f6c23fff640 1 -- 172.21.15.77:0/808789959 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c0a9050 con 0x7f6c240e7b90 2023-11-26T07:17:41.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7f6c23fff640 1 -- 172.21.15.77:0/808789959 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0ada20 con 0x7f6c240e7b90 2023-11-26T07:17:41.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7fbc01b43640 1 --2- 172.21.15.77:0/824399368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc15d490 0x7fbbfc0cd8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7fbc01b43640 1 -- 172.21.15.77:0/824399368 >> 172.21.15.77:0/824399368 conn(0x7fbbfc061340 msgr2=0x7fbbfc061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7fbc01b43640 1 -- 172.21.15.77:0/824399368 shutdown_connections 2023-11-26T07:17:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.921+0000 7f9fa111f640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f800736a0 0x7f9f80075b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9f98007fd0 tx=0x7f9f98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7f9fa091e640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] conn(0x7f9f8007b8c0 0x7f9f8007dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.922+0000 7fc94ffff640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc944003970 0x7fc95014b5e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc938031000 tx=0x7fc938001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7fe6eeb43640 1 -- 172.21.15.77:0/624966441 shutdown_connections 2023-11-26T07:17:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7fe6eeb43640 1 --2- 172.21.15.77:0/624966441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d80039c0 0x7fe6d8003de0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7fe6eeb43640 1 -- 172.21.15.77:0/624966441 >> 172.21.15.77:0/624966441 conn(0x7fe6e80b0c50 msgr2=0x7fe6e80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.920+0000 7f3c2bfff640 1 -- start start 2023-11-26T07:17:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7f3c2bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c240ebb10 0x7f3c240552c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7f3c2bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3c24006160 0x7f3c240065f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7f3c2bfff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c24057df0 con 0x7f3c240eb020 2023-11-26T07:17:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7f3c2bfff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c24057960 con 0x7f3c24006160 2023-11-26T07:17:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7f3c2bfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240387a0 con 0x7f3c240ebb10 2023-11-26T07:17:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7f3c2affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3c240eb020 0x7f3c240eb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54352/0 (socket says 172.21.15.77:54352) 2023-11-26T07:17:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7f3c2affd640 1 -- 172.21.15.77:0/801224832 learned_addr learned my addr 172.21.15.77:0/801224832 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:41.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7fc5f9ffb640 1 -- 172.21.15.77:0/1482516121 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5f400b990 con 0x7fc6041539b0 2023-11-26T07:17:41.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7fc94cff9640 1 -- 172.21.15.77:0/1430296454 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938001c10 con 0x7fc944003970 2023-11-26T07:17:41.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7fc94cff9640 1 -- 172.21.15.77:0/1430296454 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938005e30 con 0x7fc944003970 2023-11-26T07:17:41.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7fe6eeb43640 1 -- 172.21.15.77:0/624966441 shutdown_connections 2023-11-26T07:17:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7fc94cff9640 1 -- 172.21.15.77:0/1430296454 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380072b0 con 0x7fc944003970 2023-11-26T07:17:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7fbc01b43640 1 -- 172.21.15.77:0/824399368 wait complete. 2023-11-26T07:17:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7fe6eeb43640 1 -- 172.21.15.77:0/624966441 wait complete. 2023-11-26T07:17:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.924+0000 7f3c2b7fe640 1 --2- 172.21.15.77:0/801224832 >> v2:172.21.15.77:3300/0 conn(0x7f3c24006160 0x7f3c240065f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.924+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108718950 0 0) 0x7f3c24057df0 con 0x7f3c240eb020 2023-11-26T07:17:41.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.924+0000 7f999a32c640 1 Processor -- start 2023-11-26T07:17:41.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.924+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c18003520 con 0x7f3c240eb020 2023-11-26T07:17:41.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.924+0000 7f999a32c640 1 -- start start 2023-11-26T07:17:41.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.924+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3181121983 0 0) 0x7f3c18003520 con 0x7f3c240eb020 2023-11-26T07:17:41.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.924+0000 7fc5f9ffb640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc5e806aea0 0x7fc5e806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7fc5f9ffb640 1 -- 172.21.15.77:0/1482516121 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5f4059f10 con 0x7fc6041539b0 2023-11-26T07:17:41.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7fc5f9ffb640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] conn(0x7fc5e8073d20 0x7fc5e80761c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7fc5f9ffb640 1 -- 172.21.15.77:0/1482516121 --> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5e8076890 con 0x7fc5e8073d20 2023-11-26T07:17:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7fc5f9ffb640 1 -- 172.21.15.77:0/1482516121 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5f4059ce0 con 0x7fc6041539b0 2023-11-26T07:17:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7fc6094b9640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc5e806aea0 0x7fc5e806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.924+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c240ebb10 msgr2=0x7f3c240552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.924+0000 7f3c2a7fc640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c240ebb10 0x7f3c240552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c240ebb10 0x7f3c240552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 >> v2:172.21.15.77:3300/0 conn(0x7f3c24006160 msgr2=0x7f3c240065f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 --2- 172.21.15.77:0/801224832 >> v2:172.21.15.77:3300/0 conn(0x7f3c24006160 0x7f3c240065f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240ebf90 con 0x7f3c240eb020 2023-11-26T07:17:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f3c2c04ed60 con 0x7f3c240eb020 2023-11-26T07:17:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c2a7fc640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c240ebb10 0x7f3c240552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 >> v1:172.21.15.77:6789/0 conn(0x7f3c240eb020 legacy=0x7f3c240eb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c240ebb10 0x7f3c18003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c18003eb0 0x7f3c180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c18004d00 0x7f3c18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c24057960 con 0x7f3c18003eb0 2023-11-26T07:17:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240387a0 con 0x7f3c18004d00 2023-11-26T07:17:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1800ba30 con 0x7f3c240ebb10 2023-11-26T07:17:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7f3c2b7fe640 1 --2- 172.21.15.77:0/801224832 >> v2:172.21.15.77:3300/0 conn(0x7f3c24006160 0x7f3c240065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:41.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7fc9564e0640 1 -- 172.21.15.77:0/1430296454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9500cb420 con 0x7fc944003970 2023-11-26T07:17:41.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.925+0000 7fc9564e0640 1 -- 172.21.15.77:0/1430296454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9500cb9e0 con 0x7fc944003970 2023-11-26T07:17:41.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f3c2affd640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c240ebb10 0x7f3c18003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7fc608cb8640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] conn(0x7fc5e8073d20 0x7fc5e80761c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7fbc01b43640 1 Processor -- start 2023-11-26T07:17:41.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f3c2a7fc640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c18003eb0 0x7f3c180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f6c327db640 1 -- 172.21.15.77:0/808789959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c240e7b90 msgr2=0x7f6c24039ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f6c327db640 1 --2- 172.21.15.77:0/808789959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c240e7b90 0x7f6c24039ae0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0620a0 tx=0x7f6c2c0a6600 comp rx=0 tx=0).stop 2023-11-26T07:17:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7fbc01b43640 1 -- start start 2023-11-26T07:17:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f999a32c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f999415b2f0 0x7f99940c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f999a32c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99940cc150 0x7f99940c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f999a32c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999406d0c0 con 0x7f99940cbcc0 2023-11-26T07:17:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f999a32c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99940c5a80 con 0x7f999415b2f0 2023-11-26T07:17:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f999a32c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99940cc5e0 con 0x7f99940cc150 2023-11-26T07:17:41.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f3c2affd640 1 -- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c18004d00 msgr2=0x7f3c18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f3c2affd640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c18004d00 0x7f3c18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f3c2affd640 1 -- 172.21.15.77:0/801224832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c18003eb0 msgr2=0x7f3c180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7fc6094b9640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc5e806aea0 0x7fc5e806d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc035000 tx=0x7fc5fc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.926+0000 7f3c2affd640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c18003eb0 0x7f3c180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.923+0000 7f9fa091e640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] conn(0x7f9f8007b8c0 0x7f9f8007dce0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.927+0000 7f9f91ffb640 1 -- 172.21.15.77:0/3728213198 <== osd.0 v2:172.21.15.77:6800/2431818917 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9f8007e390 con 0x7f9f8007b8c0 2023-11-26T07:17:41.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.927+0000 7fc93e7fc640 1 -- 172.21.15.77:0/1430296454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc928000fc0 con 0x7fc944003970 2023-11-26T07:17:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.927+0000 7f9993fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f999415b2f0 0x7f99940c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.927+0000 7f9993fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f999415b2f0 0x7f99940c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:55170/0 (socket says 172.21.15.77:55170) 2023-11-26T07:17:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.927+0000 7f9993fff640 1 -- 172.21.15.77:0/2277949442 learned_addr learned my addr 172.21.15.77:0/2277949442 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.927+0000 7f3c2affd640 1 -- 172.21.15.77:0/801224832 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240ebf90 con 0x7f3c240ebb10 2023-11-26T07:17:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.927+0000 7f99988c9640 1 --2- 172.21.15.77:0/2277949442 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99940cc150 0x7f99940c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fbc01b43640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbfc0ce270 0x7fbbfc1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fbc01b43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc15d490 0x7fbbfc0cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fbc01b43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbfc151710 0x7fbbfc160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fbc01b43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc1fa920 con 0x7fbbfc15d490 2023-11-26T07:17:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fbc01b43640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc1fabc0 con 0x7fbbfc0ce270 2023-11-26T07:17:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fbc01b43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc1faea0 con 0x7fbbfc151710 2023-11-26T07:17:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7f3c2a7fc640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c18003eb0 0x7f3c180047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:41.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fe6eeb43640 1 Processor -- start 2023-11-26T07:17:41.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fe6eeb43640 1 -- start start 2023-11-26T07:17:41.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fbbfbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc15d490 0x7fbbfc0cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fbc00b41640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbfc0ce270 0x7fbbfc1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7f6c327db640 1 -- 172.21.15.77:0/808789959 shutdown_connections 2023-11-26T07:17:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7f6c327db640 1 --2- 172.21.15.77:0/808789959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c240e7b90 0x7f6c24039ae0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7f6c327db640 1 -- 172.21.15.77:0/808789959 >> 172.21.15.77:0/808789959 conn(0x7f6c24056c90 msgr2=0x7f6c240570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7f3c2affd640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c240ebb10 0x7f3c18003970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c000b60 tx=0x7f3c180057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd513a5b6a5b140b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7f9993fff640 1 -- 172.21.15.77:0/2277949442 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99940cc150 msgr2=0x7f99940c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7f9993fff640 1 --2- 172.21.15.77:0/2277949442 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99940cc150 0x7f99940c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7f9993fff640 1 -- 172.21.15.77:0/2277949442 >> v1:172.21.15.159:6789/0 conn(0x7f99940cbcc0 legacy=0x7f99940c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7f9993fff640 1 -- 172.21.15.77:0/2277949442 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999406c790 con 0x7f999415b2f0 2023-11-26T07:17:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fbbfbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc15d490 0x7fbbfc0cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34820/0 (socket says 172.21.15.77:34820) 2023-11-26T07:17:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.928+0000 7fbbfbfff640 1 -- 172.21.15.77:0/2187841588 learned_addr learned my addr 172.21.15.77:0/2187841588 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7f99988c9640 1 --2- 172.21.15.77:0/2277949442 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99940cc150 0x7f99940c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7f6c327db640 1 -- 172.21.15.77:0/808789959 shutdown_connections 2023-11-26T07:17:41.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7fbc01342640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbfc151710 0x7fbbfc160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0ab5f0 con 0x7f3c240ebb10 2023-11-26T07:17:41.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7f6c327db640 1 -- 172.21.15.77:0/808789959 wait complete. 2023-11-26T07:17:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c0ab750 con 0x7f3c240ebb10 2023-11-26T07:17:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7f3c29ffb640 1 -- 172.21.15.77:0/801224832 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0abb40 con 0x7f3c240ebb10 2023-11-26T07:17:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7fe6eeb43640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6d80039c0 0x7fe6e80ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7fe6eeb43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6e8159db0 0x7fe6e8164880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7fe6eeb43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6e8164dc0 0x7fe6e809b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7fe6eeb43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8165240 con 0x7fe6e8164dc0 2023-11-26T07:17:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7fe6eeb43640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8159770 con 0x7fe6d80039c0 2023-11-26T07:17:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.929+0000 7fe6eeb43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e81588e0 con 0x7fe6e8159db0 2023-11-26T07:17:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fbbfbfff640 1 -- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbfc151710 msgr2=0x7fbbfc160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fbbfbfff640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbfc151710 0x7fbbfc160cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fbbfbfff640 1 -- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbfc0ce270 msgr2=0x7fbbfc1510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fbbfbfff640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbfc0ce270 0x7fbbfc1510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fbbfbfff640 1 -- 172.21.15.77:0/2187841588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40094d0 con 0x7fbbfc15d490 2023-11-26T07:17:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fe6ed0e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6e8164dc0 0x7fe6e809b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fe6ed0e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6e8164dc0 0x7fe6e809b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34824/0 (socket says 172.21.15.77:34824) 2023-11-26T07:17:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fe6ed0e0640 1 -- 172.21.15.77:0/3224828060 learned_addr learned my addr 172.21.15.77:0/3224828060 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fe6e7fff640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6e8159db0 0x7fe6e8164880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fbc00b41640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbfc0ce270 0x7fbbfc1510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fbbfbfff640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc15d490 0x7fbbfc0cc0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400e9b0 tx=0x7fbbf400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fbc01342640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbfc151710 0x7fbbfc160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7fbbf97fa640 1 -- 172.21.15.77:0/2187841588 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400c9a0 con 0x7fbbfc15d490 2023-11-26T07:17:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fbbf97fa640 1 -- 172.21.15.77:0/2187841588 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf400cb00 con 0x7fbbfc15d490 2023-11-26T07:17:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fbbf97fa640 1 -- 172.21.15.77:0/2187841588 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400c9a0 con 0x7fbbfc15d490 2023-11-26T07:17:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fbc01b43640 1 -- 172.21.15.77:0/2187841588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc1fb180 con 0x7fbbfc15d490 2023-11-26T07:17:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fc94cff9640 1 -- 172.21.15.77:0/1430296454 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc938032070 con 0x7fc944003970 2023-11-26T07:17:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7f3c2bfff640 1 -- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c240ebb10 msgr2=0x7f3c18003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.930+0000 7f3c2bfff640 1 --2- 172.21.15.77:0/801224832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c240ebb10 0x7f3c18003970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c000b60 tx=0x7f3c180057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7f3c2b7fe640 1 -- 172.21.15.77:0/801224832 reap_dead start 2023-11-26T07:17:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7f3c2bfff640 1 -- 172.21.15.77:0/801224832 shutdown_connections 2023-11-26T07:17:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7f3c2bfff640 1 -- 172.21.15.77:0/801224832 >> 172.21.15.77:0/801224832 conn(0x7f3c240559a0 msgr2=0x7f3c24055db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fbc01b43640 1 -- 172.21.15.77:0/2187841588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc155c20 con 0x7fbbfc15d490 2023-11-26T07:17:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fe6ec8df640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6d80039c0 0x7fe6e80ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fe6e7fff640 1 -- 172.21.15.77:0/3224828060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6d80039c0 msgr2=0x7fe6e80ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fe6e7fff640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6d80039c0 0x7fe6e80ad1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fe6e7fff640 1 -- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6e8164dc0 msgr2=0x7fe6e809b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fe6e7fff640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6e8164dc0 0x7fe6e809b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fe6e7fff640 1 -- 172.21.15.77:0/3224828060 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8158b60 con 0x7fe6e8159db0 2023-11-26T07:17:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7fe6e7fff640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6e8159db0 0x7fe6e8164880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4001050 tx=0x7fe6d40076e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.931+0000 7f9993fff640 1 --2- 172.21.15.77:0/2277949442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f999415b2f0 0x7f99940c50e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9984009870 tx=0x7f998402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de4e89a37325e848 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.932+0000 7f6c327db640 1 Processor -- start 2023-11-26T07:17:41.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.932+0000 7fc608cb8640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] conn(0x7fc5e8073d20 0x7fc5e80761c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.932+0000 7f9992ffd640 1 -- 172.21.15.77:0/2277949442 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9984030840 con 0x7f999415b2f0 2023-11-26T07:17:41.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.932+0000 7f9992ffd640 1 -- 172.21.15.77:0/2277949442 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99840309a0 con 0x7f999415b2f0 2023-11-26T07:17:41.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.932+0000 7f9992ffd640 1 -- 172.21.15.77:0/2277949442 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9984030d30 con 0x7f999415b2f0 2023-11-26T07:17:41.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.932+0000 7f6c327db640 1 -- start start 2023-11-26T07:17:41.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.932+0000 7f3c2bfff640 1 -- 172.21.15.77:0/801224832 shutdown_connections 2023-11-26T07:17:41.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.932+0000 7f3c2bfff640 1 -- 172.21.15.77:0/801224832 wait complete. 2023-11-26T07:17:41.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7f999a32c640 1 -- 172.21.15.77:0/2277949442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f999415b2f0 msgr2=0x7f99940c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7f999a32c640 1 --2- 172.21.15.77:0/2277949442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f999415b2f0 0x7f99940c50e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9984009870 tx=0x7f998402b980 comp rx=0 tx=0).stop 2023-11-26T07:17:41.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7f999a32c640 1 -- 172.21.15.77:0/2277949442 shutdown_connections 2023-11-26T07:17:41.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7f999a32c640 1 --2- 172.21.15.77:0/2277949442 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99940cc150 0x7f99940c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7f999a32c640 1 --2- 172.21.15.77:0/2277949442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f999415b2f0 0x7f99940c50e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7f999a32c640 1 -- 172.21.15.77:0/2277949442 >> 172.21.15.77:0/2277949442 conn(0x7f99940b0c50 msgr2=0x7f99940b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7fc94cff9640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc93006af10 0x7fc93006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7fc94cff9640 1 -- 172.21.15.77:0/1430296454 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9380aa4c0 con 0x7fc944003970 2023-11-26T07:17:41.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7fc94cff9640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] conn(0x7fc930073130 0x7fc930075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7fc94cff9640 1 -- 172.21.15.77:0/1430296454 --> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc930075c00 con 0x7fc930073130 2023-11-26T07:17:41.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7fc94cff9640 1 -- 172.21.15.77:0/1430296454 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9380acae0 con 0x7fc944003970 2023-11-26T07:17:41.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.932+0000 7fe6e57fa640 1 -- 172.21.15.77:0/3224828060 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4001670 con 0x7fe6e8159db0 2023-11-26T07:17:41.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.932+0000 7fe6e57fa640 1 -- 172.21.15.77:0/3224828060 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d400f9c0 con 0x7fe6e8159db0 2023-11-26T07:17:41.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.932+0000 7fe6e57fa640 1 -- 172.21.15.77:0/3224828060 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400fd70 con 0x7fe6e8159db0 2023-11-26T07:17:41.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7fe6eeb43640 1 -- 172.21.15.77:0/3224828060 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e8158e40 con 0x7fe6e8159db0 2023-11-26T07:17:41.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.933+0000 7fe6eeb43640 1 -- 172.21.15.77:0/3224828060 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e8159400 con 0x7fe6e8159db0 2023-11-26T07:17:41.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.934+0000 7fbc01b43640 1 -- 172.21.15.77:0/2187841588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbbfc0d0910 con 0x7fbbfc15d490 2023-11-26T07:17:41.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.934+0000 7f999a32c640 1 -- 172.21.15.77:0/2277949442 shutdown_connections 2023-11-26T07:17:41.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7fc94f7fe640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc93006af10 0x7fc93006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7fe6eeb43640 1 -- 172.21.15.77:0/3224828060 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6e80cb180 con 0x7fe6e8159db0 2023-11-26T07:17:41.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7f3c2bfff640 1 Processor -- start 2023-11-26T07:17:41.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.934+0000 7f999a32c640 1 -- 172.21.15.77:0/2277949442 wait complete. 2023-11-26T07:17:41.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7fc5f9ffb640 1 -- 172.21.15.77:0/1482516121 <== osd.2 v2:172.21.15.77:6808/2586530941 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc5e8076890 con 0x7fc5e8073d20 2023-11-26T07:17:41.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7f3c2bfff640 1 -- start start 2023-11-26T07:17:41.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7fc954a7d640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] conn(0x7fc930073130 0x7fc930075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.936+0000 7fc954a7d640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] conn(0x7fc930073130 0x7fc930075550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.934+0000 7f6c327db640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c240e3610 0x7f6c240d9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7f6c327db640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c240e7700 0x7f6c240e23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7f6c327db640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c240e7b90 0x7f6c240e2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7f6c327db640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240092f0 con 0x7f6c240e7700 2023-11-26T07:17:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7f6c327db640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240095d0 con 0x7f6c240e7b90 2023-11-26T07:17:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7f6c327db640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240098b0 con 0x7f6c240e3610 2023-11-26T07:17:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7f6c31fda640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c240e7b90 0x7f6c240e2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7f6c31fda640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c240e7b90 0x7f6c240e2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:55196/0 (socket says 172.21.15.77:55196) 2023-11-26T07:17:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7f6c31fda640 1 -- 172.21.15.77:0/1723779537 learned_addr learned my addr 172.21.15.77:0/1723779537 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.936+0000 7f6c31fda640 1 -- 172.21.15.77:0/1723779537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c240e3610 msgr2=0x7f6c240d9250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:17:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.936+0000 7f6c31fda640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c240e3610 0x7f6c240d9250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.936+0000 7f6c31fda640 1 -- 172.21.15.77:0/1723779537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c240e7700 msgr2=0x7f6c240e23c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-26T07:17:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.937+0000 7f6c30fd8640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c240e7700 0x7f6c240e23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.937+0000 7fc94f7fe640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc93006af10 0x7fc93006d3d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc9501f6030 tx=0x7fc940008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.937+0000 7fe6e57fa640 1 -- 172.21.15.77:0/3224828060 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6d4027430 con 0x7fe6e8159db0 2023-11-26T07:17:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.936+0000 7f3c2bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c2404bb70 0x7f3c24052900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.937+0000 7f6c31fda640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c240e7700 0x7f6c240e23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.937+0000 7f6c31fda640 1 -- 172.21.15.77:0/1723779537 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c04f730 con 0x7f6c240e7b90 2023-11-26T07:17:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.937+0000 7f6c30fd8640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c240e7700 0x7f6c240e23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.936+0000 7f3c2bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c240d34f0 0x7f3c2404bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.936+0000 7f3c2bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c24049420 0x7f3c240498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.936+0000 7f3c2bfff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2404b020 con 0x7f3c24049420 2023-11-26T07:17:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.938+0000 7f999a32c640 1 Processor -- start 2023-11-26T07:17:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.938+0000 7f6c31fda640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c240e7b90 0x7f6c240e2900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c050020 tx=0x7f6c2c06a3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.938+0000 7f999a32c640 1 -- start start 2023-11-26T07:17:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.938+0000 7fc94cff9640 1 -- 172.21.15.77:0/1430296454 <== osd.1 v2:172.21.15.77:6817/674756385 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc930075c00 con 0x7fc930073130 2023-11-26T07:17:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.936+0000 7f3c2bfff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2404b7f0 con 0x7f3c240d34f0 2023-11-26T07:17:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.936+0000 7f3c2bfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c24050090 con 0x7f3c2404bb70 2023-11-26T07:17:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.938+0000 7fe6e57fa640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe6cc06ae90 0x7fe6cc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.938+0000 7fe6e57fa640 1 -- 172.21.15.77:0/3224828060 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6d4089fe0 con 0x7fe6e8159db0 2023-11-26T07:17:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7fe6e57fa640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] conn(0x7fe6cc0730b0 0x7fe6cc0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7fe6e57fa640 1 -- 172.21.15.77:0/3224828060 --> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6cc075b80 con 0x7fe6cc0730b0 2023-11-26T07:17:41.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7fe6e57fa640 1 -- 172.21.15.77:0/3224828060 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6d408a480 con 0x7fe6e8159db0 2023-11-26T07:17:41.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f6c21ffb640 1 -- 172.21.15.77:0/1723779537 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0ae960 con 0x7f6c240e7b90 2023-11-26T07:17:41.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f6c21ffb640 1 -- 172.21.15.77:0/1723779537 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c0aeac0 con 0x7f6c240e7b90 2023-11-26T07:17:41.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f6c21ffb640 1 -- 172.21.15.77:0/1723779537 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0aee30 con 0x7f6c240e7b90 2023-11-26T07:17:41.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f6c327db640 1 -- 172.21.15.77:0/1723779537 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c24009b90 con 0x7f6c240e7b90 2023-11-26T07:17:41.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f999a32c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99940cbcc0 0x7f99941504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f999a32c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99940cc150 0x7f99940cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f999a32c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f999415b2f0 0x7f99940c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f999a32c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940cddd0 con 0x7f99940cc150 2023-11-26T07:17:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f999a32c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940cf990 con 0x7f99940cbcc0 2023-11-26T07:17:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f999a32c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99940cf6b0 con 0x7f999415b2f0 2023-11-26T07:17:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f3c2affd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c2404bb70 0x7f3c24052900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f3c2affd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c2404bb70 0x7f3c24052900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45598/0 (socket says 172.21.15.77:45598) 2023-11-26T07:17:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.935+0000 7fbbf97fa640 1 -- 172.21.15.77:0/2187841588 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbbf400cc70 con 0x7fbbfc15d490 2023-11-26T07:17:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7fbbf97fa640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbbdc06aea0 0x7fbbdc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7fbbf97fa640 1 -- 172.21.15.77:0/2187841588 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbf40893f0 con 0x7fbbfc15d490 2023-11-26T07:17:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7fbbf97fa640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] conn(0x7fbbdc073040 0x7fbbdc075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7fe6ec8df640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe6cc06ae90 0x7fe6cc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.940+0000 7fbbf97fa640 1 -- 172.21.15.77:0/2187841588 --> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbbdc075b10 con 0x7fbbdc073040 2023-11-26T07:17:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.940+0000 7fbbf97fa640 1 -- 172.21.15.77:0/2187841588 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbf408bab0 con 0x7fbbfc15d490 2023-11-26T07:17:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.939+0000 7f3c2affd640 1 -- 172.21.15.77:0/1242139002 learned_addr learned my addr 172.21.15.77:0/1242139002 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.940+0000 7f3c2a7fc640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c240d34f0 0x7f3c2404bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.940+0000 7f6c327db640 1 -- 172.21.15.77:0/1723779537 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c24009e70 con 0x7f6c240e7b90 2023-11-26T07:17:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.940+0000 7f9993fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99940cbcc0 0x7f99941504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.940+0000 7fbc00b41640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbbdc06aea0 0x7fbbdc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.940+0000 7f3c2b7fe640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c24049420 0x7f3c240498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.940+0000 7f99937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99940cc150 0x7f99940cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.940+0000 7f9993fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99940cbcc0 0x7f99941504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:55214/0 (socket says 172.21.15.77:55214) 2023-11-26T07:17:41.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.940+0000 7f9993fff640 1 -- 172.21.15.77:0/3195308877 learned_addr learned my addr 172.21.15.77:0/3195308877 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:41.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.940+0000 7f99988c9640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f999415b2f0 0x7f99940c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.941+0000 7fe6ed0e0640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] conn(0x7fe6cc0730b0 0x7fe6cc0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.941+0000 7fbc01342640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] conn(0x7fbbdc073040 0x7fbbdc075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.941+0000 7f3c2b7fe640 1 -- 172.21.15.77:0/1242139002 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c2404bb70 msgr2=0x7f3c24052900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.941+0000 7f3c2b7fe640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c2404bb70 0x7f3c24052900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.941+0000 7f3c2b7fe640 1 -- 172.21.15.77:0/1242139002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c240d34f0 msgr2=0x7f3c2404bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.941+0000 7f3c2b7fe640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c240d34f0 0x7f3c2404bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.941+0000 7f3c2b7fe640 1 -- 172.21.15.77:0/1242139002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240d3970 con 0x7f3c24049420 2023-11-26T07:17:41.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.941+0000 7fe6ec8df640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe6cc06ae90 0x7fe6cc06d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc036000 tx=0x7fe6dc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.941+0000 7f9993fff640 1 -- 172.21.15.77:0/3195308877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f999415b2f0 msgr2=0x7f99940c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.942+0000 7f3c2b7fe640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c24049420 0x7f3c240498a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400f510 tx=0x7f3c1c00eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.941+0000 7f9993fff640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f999415b2f0 0x7f99940c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.942+0000 7f9993fff640 1 -- 172.21.15.77:0/3195308877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99940cc150 msgr2=0x7f99940cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.942+0000 7f9993fff640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99940cc150 0x7f99940cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.942+0000 7f9993fff640 1 -- 172.21.15.77:0/3195308877 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c009a70 con 0x7f99940cbcc0 2023-11-26T07:17:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.942+0000 7f6c327db640 1 -- 172.21.15.77:0/1723779537 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c24009740 con 0x7f6c240e7b90 2023-11-26T07:17:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.942+0000 7f9993fff640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99940cbcc0 0x7f99941504f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f998402b9c0 tx=0x7f9984004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.942+0000 7f3c237fe640 1 -- 172.21.15.77:0/1242139002 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c004030 con 0x7f3c24049420 2023-11-26T07:17:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.942+0000 7fbc00b41640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbbdc06aea0 0x7fbbdc06d360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4036000 tx=0x7fbbe4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.942+0000 7f3c237fe640 1 -- 172.21.15.77:0/1242139002 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c004190 con 0x7f3c24049420 2023-11-26T07:17:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.942+0000 7f3c237fe640 1 -- 172.21.15.77:0/1242139002 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c003610 con 0x7f3c24049420 2023-11-26T07:17:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.941+0000 7fe6ed0e0640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] conn(0x7fe6cc0730b0 0x7fe6cc0754d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.943+0000 7f3c2bfff640 1 -- 172.21.15.77:0/1242139002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2404c490 con 0x7f3c24049420 2023-11-26T07:17:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.943+0000 7fbc01342640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] conn(0x7fbbdc073040 0x7fbbdc075460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.943+0000 7f3c2bfff640 1 -- 172.21.15.77:0/1242139002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2404b230 con 0x7f3c24049420 2023-11-26T07:17:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.943+0000 7f9990ff9640 1 -- 172.21.15.77:0/3195308877 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9984039c90 con 0x7f99940cbcc0 2023-11-26T07:17:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.943+0000 7f9990ff9640 1 -- 172.21.15.77:0/3195308877 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9984039e10 con 0x7f99940cbcc0 2023-11-26T07:17:41.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.943+0000 7f9990ff9640 1 -- 172.21.15.77:0/3195308877 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99840446c0 con 0x7f99940cbcc0 2023-11-26T07:17:41.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.943+0000 7fe6e57fa640 1 -- 172.21.15.77:0/3224828060 <== osd.3 v2:172.21.15.77:6809/243154578 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe6cc075b80 con 0x7fe6cc0730b0 2023-11-26T07:17:41.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.943+0000 7f999a32c640 1 -- 172.21.15.77:0/3195308877 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99840094d0 con 0x7f99940cbcc0 2023-11-26T07:17:41.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.944+0000 7f999a32c640 1 -- 172.21.15.77:0/3195308877 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99940cda60 con 0x7f99940cbcc0 2023-11-26T07:17:41.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.944+0000 7f3c2bfff640 1 -- 172.21.15.77:0/1242139002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c24057310 con 0x7f3c24049420 2023-11-26T07:17:41.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.945+0000 7fbbf97fa640 1 -- 172.21.15.77:0/2187841588 <== osd.5 v2:172.21.15.159:6800/3212169486 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbbdc075b10 con 0x7fbbdc073040 2023-11-26T07:17:41.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.946+0000 7f3c237fe640 1 -- 172.21.15.77:0/1242139002 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c1c003770 con 0x7f3c24049420 2023-11-26T07:17:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.945+0000 7f6c21ffb640 1 -- 172.21.15.77:0/1723779537 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c2c074940 con 0x7f6c240e7b90 2023-11-26T07:17:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.946+0000 7f6c21ffb640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6c1006ae90 0x7f6c1006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.947+0000 7f6c21ffb640 1 -- 172.21.15.77:0/1723779537 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c2c0c8300 con 0x7f6c240e7b90 2023-11-26T07:17:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.947+0000 7f6c317d9640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6c1006ae90 0x7f6c1006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.947+0000 7f6c21ffb640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] conn(0x7f6c10073d90 0x7f6c10076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.947+0000 7f6c21ffb640 1 -- 172.21.15.77:0/1723779537 --> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c10076900 con 0x7f6c10073d90 2023-11-26T07:17:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.947+0000 7f6c21ffb640 1 -- 172.21.15.77:0/1723779537 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c2c0f5370 con 0x7f6c240e7b90 2023-11-26T07:17:41.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.947+0000 7f3c237fe640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c0c06ae70 0x7f3c0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.946+0000 7f999a32c640 1 -- 172.21.15.77:0/3195308877 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f999415b6d0 con 0x7f99940cbcc0 2023-11-26T07:17:41.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.948+0000 7f3c237fe640 1 -- 172.21.15.77:0/1242139002 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c1c089280 con 0x7f3c24049420 2023-11-26T07:17:41.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.948+0000 7f3c237fe640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] conn(0x7f3c0c073010 0x7f3c0c075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.948+0000 7f3c237fe640 1 -- 172.21.15.77:0/1242139002 --> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c0c075ae0 con 0x7f3c0c073010 2023-11-26T07:17:41.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.948+0000 7f3c237fe640 1 -- 172.21.15.77:0/1242139002 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c1c0895f0 con 0x7f3c24049420 2023-11-26T07:17:41.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.948+0000 7f6c317d9640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6c1006ae90 0x7f6c1006d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c280015c0 tx=0x7f6c280079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.949+0000 7f3c2affd640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c0c06ae70 0x7f3c0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.949+0000 7f3c2a7fc640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] conn(0x7f3c0c073010 0x7f3c0c075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.949+0000 7f6c30fd8640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] conn(0x7f6c10073d90 0x7f6c10076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.949+0000 7f3c2affd640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c0c06ae70 0x7f3c0c06d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0a6ed0 tx=0x7f3c2c06d030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.950+0000 7f3c2a7fc640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] conn(0x7f3c0c073010 0x7f3c0c075430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.949+0000 7f9990ff9640 1 -- 172.21.15.77:0/3195308877 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f998402f390 con 0x7f99940cbcc0 2023-11-26T07:17:41.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.950+0000 7f9990ff9640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f998006ae40 0x7f998006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.950+0000 7f9990ff9640 1 -- 172.21.15.77:0/3195308877 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f998403e070 con 0x7f99940cbcc0 2023-11-26T07:17:41.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.950+0000 7f9990ff9640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] conn(0x7f9980072fe0 0x7f9980075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.950+0000 7f9990ff9640 1 -- 172.21.15.77:0/3195308877 --> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9980075ab0 con 0x7f9980072fe0 2023-11-26T07:17:41.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.950+0000 7f9990ff9640 1 -- 172.21.15.77:0/3195308877 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99840b02a0 con 0x7f99940cbcc0 2023-11-26T07:17:41.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.951+0000 7f99937fe640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f998006ae40 0x7f998006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.951+0000 7f99988c9640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] conn(0x7f9980072fe0 0x7f9980075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.951+0000 7f99937fe640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f998006ae40 0x7f998006d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f999409cf70 tx=0x7f9988009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.952+0000 7f6c30fd8640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] conn(0x7f6c10073d90 0x7f6c10076230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.952+0000 7f3c237fe640 1 -- 172.21.15.77:0/1242139002 <== osd.6 v2:172.21.15.159:6808/4233966301 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3c0c075ae0 con 0x7f3c0c073010 2023-11-26T07:17:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.954+0000 7f99988c9640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] conn(0x7f9980072fe0 0x7f9980075400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.954+0000 7f6c21ffb640 1 -- 172.21.15.77:0/1723779537 <== osd.4 v2:172.21.15.159:6816/3986384485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6c10076900 con 0x7f6c10073d90 2023-11-26T07:17:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.955+0000 7f9fa3383640 1 -- 172.21.15.77:0/3728213198 --> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f94006600 con 0x7f9f8007b8c0 2023-11-26T07:17:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.956+0000 7f9990ff9640 1 -- 172.21.15.77:0/3195308877 <== osd.7 v2:172.21.15.159:6817/162809389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9980075ab0 con 0x7f9980072fe0 2023-11-26T07:17:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.958+0000 7f9f91ffb640 1 -- 172.21.15.77:0/3728213198 <== osd.0 v2:172.21.15.77:6800/2431818917 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9f8c030c10 con 0x7f9f8007b8c0 2023-11-26T07:17:42.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.960+0000 7f9fa3383640 1 -- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] conn(0x7f9f8007b8c0 msgr2=0x7f9f8007dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.960+0000 7f9fa3383640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] conn(0x7f9f8007b8c0 0x7f9f8007dce0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.960+0000 7f9fa3383640 1 -- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f800736a0 msgr2=0x7f9f80075b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.960+0000 7f9fa3383640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f800736a0 0x7f9f80075b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9f98007fd0 tx=0x7f9f98009040 comp rx=0 tx=0).stop 2023-11-26T07:17:42.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.960+0000 7f9fa3383640 1 -- 172.21.15.77:0/3728213198 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f940e3120 msgr2=0x7f9f9404d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.960+0000 7f9fa3383640 1 --2- 172.21.15.77:0/3728213198 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f940e3120 0x7f9f9404d570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c064180 tx=0x7f9f9c068090 comp rx=0 tx=0).stop 2023-11-26T07:17:42.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.963+0000 7f9fa1920640 1 -- 172.21.15.77:0/3728213198 reap_dead start 2023-11-26T07:17:42.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.963+0000 7f9fa3383640 1 -- 172.21.15.77:0/3728213198 shutdown_connections 2023-11-26T07:17:42.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.963+0000 7f9fa3383640 1 -- 172.21.15.77:0/3728213198 >> 172.21.15.77:0/3728213198 conn(0x7f9f94058ea0 msgr2=0x7f9f94039ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.966+0000 7f9fa3383640 1 -- 172.21.15.77:0/3728213198 shutdown_connections 2023-11-26T07:17:42.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.966+0000 7f9fa3383640 1 -- 172.21.15.77:0/3728213198 wait complete. 2023-11-26T07:17:42.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.970+0000 7fc60b71d640 1 -- 172.21.15.77:0/1482516121 --> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc604153d90 con 0x7fc5e8073d20 2023-11-26T07:17:42.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.971+0000 7fe6eeb43640 1 -- 172.21.15.77:0/3224828060 --> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6e80cd410 con 0x7fe6cc0730b0 2023-11-26T07:17:42.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.971+0000 7fc5f9ffb640 1 -- 172.21.15.77:0/1482516121 <== osd.2 v2:172.21.15.77:6808/2586530941 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc600001890 con 0x7fc5e8073d20 2023-11-26T07:17:42.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.972+0000 7fe6e57fa640 1 -- 172.21.15.77:0/3224828060 <== osd.3 v2:172.21.15.77:6809/243154578 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6e000f040 con 0x7fe6cc0730b0 2023-11-26T07:17:42.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.972+0000 7fc60b71d640 1 -- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] conn(0x7fc5e8073d20 msgr2=0x7fc5e80761c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.972+0000 7fc60b71d640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] conn(0x7fc5e8073d20 0x7fc5e80761c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.972+0000 7fc60b71d640 1 -- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc5e806aea0 msgr2=0x7fc5e806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.972+0000 7fc60b71d640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc5e806aea0 0x7fc5e806d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc035000 tx=0x7fc5fc030000 comp rx=0 tx=0).stop 2023-11-26T07:17:42.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.972+0000 7fc60b71d640 1 -- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6041539b0 msgr2=0x7fc6041431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.972+0000 7fc60b71d640 1 --2- 172.21.15.77:0/1482516121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6041539b0 0x7fc6041431c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400d800 tx=0x7fc5f400dcc0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.972+0000 7fc609cba640 1 -- 172.21.15.77:0/1482516121 reap_dead start 2023-11-26T07:17:42.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.972+0000 7fc60b71d640 1 -- 172.21.15.77:0/1482516121 shutdown_connections 2023-11-26T07:17:42.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.972+0000 7fc60b71d640 1 -- 172.21.15.77:0/1482516121 >> 172.21.15.77:0/1482516121 conn(0x7fc60406ae10 msgr2=0x7fc60414a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.973+0000 7fc60b71d640 1 -- 172.21.15.77:0/1482516121 shutdown_connections 2023-11-26T07:17:42.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.973+0000 7fc60b71d640 1 -- 172.21.15.77:0/1482516121 wait complete. 2023-11-26T07:17:42.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.973+0000 7fe6eeb43640 1 -- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] conn(0x7fe6cc0730b0 msgr2=0x7fe6cc0754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.973+0000 7fe6eeb43640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] conn(0x7fe6cc0730b0 0x7fe6cc0754d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.974+0000 7fe6eeb43640 1 -- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe6cc06ae90 msgr2=0x7fe6cc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.974+0000 7fe6eeb43640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe6cc06ae90 0x7fe6cc06d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc036000 tx=0x7fe6dc030000 comp rx=0 tx=0).stop 2023-11-26T07:17:42.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.974+0000 7fe6eeb43640 1 -- 172.21.15.77:0/3224828060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6e8159db0 msgr2=0x7fe6e8164880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.974+0000 7fe6eeb43640 1 --2- 172.21.15.77:0/3224828060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6e8159db0 0x7fe6e8164880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4001050 tx=0x7fe6d40076e0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.974+0000 7fe6ed0e0640 1 -- 172.21.15.77:0/3224828060 reap_dead start 2023-11-26T07:17:42.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.974+0000 7fe6eeb43640 1 -- 172.21.15.77:0/3224828060 shutdown_connections 2023-11-26T07:17:42.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.974+0000 7fe6eeb43640 1 -- 172.21.15.77:0/3224828060 >> 172.21.15.77:0/3224828060 conn(0x7fe6e80b0c50 msgr2=0x7fe6e80c9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.974+0000 7fe6eeb43640 1 -- 172.21.15.77:0/3224828060 shutdown_connections 2023-11-26T07:17:42.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.974+0000 7fe6eeb43640 1 -- 172.21.15.77:0/3224828060 wait complete. 2023-11-26T07:17:42.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.976+0000 7f999a32c640 1 -- 172.21.15.77:0/3195308877 --> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f999406cd50 con 0x7f9980072fe0 2023-11-26T07:17:42.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.980+0000 7f9990ff9640 1 -- 172.21.15.77:0/3195308877 <== osd.7 v2:172.21.15.159:6817/162809389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f998c00f040 con 0x7f9980072fe0 2023-11-26T07:17:42.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.980+0000 7f3c2bfff640 1 -- 172.21.15.77:0/1242139002 --> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c24057030 con 0x7f3c0c073010 2023-11-26T07:17:42.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.981+0000 7f999a32c640 1 -- 172.21.15.77:0/3195308877 >> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] conn(0x7f9980072fe0 msgr2=0x7f9980075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.981+0000 7f999a32c640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] conn(0x7f9980072fe0 0x7f9980075400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.981+0000 7f999a32c640 1 -- 172.21.15.77:0/3195308877 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f998006ae40 msgr2=0x7f998006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.981+0000 7f999a32c640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f998006ae40 0x7f998006d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f999409cf70 tx=0x7f9988009040 comp rx=0 tx=0).stop 2023-11-26T07:17:42.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.981+0000 7f999a32c640 1 -- 172.21.15.77:0/3195308877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99940cbcc0 msgr2=0x7f99941504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.981+0000 7f999a32c640 1 --2- 172.21.15.77:0/3195308877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99940cbcc0 0x7f99941504f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f998402b9c0 tx=0x7f9984004730 comp rx=0 tx=0).stop 2023-11-26T07:17:42.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.981+0000 7f99988c9640 1 -- 172.21.15.77:0/3195308877 reap_dead start 2023-11-26T07:17:42.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.982+0000 7f999a32c640 1 -- 172.21.15.77:0/3195308877 shutdown_connections 2023-11-26T07:17:42.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.982+0000 7f999a32c640 1 -- 172.21.15.77:0/3195308877 >> 172.21.15.77:0/3195308877 conn(0x7f99940b0c50 msgr2=0x7f99940c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.982+0000 7f999a32c640 1 -- 172.21.15.77:0/3195308877 shutdown_connections 2023-11-26T07:17:42.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.982+0000 7f999a32c640 1 -- 172.21.15.77:0/3195308877 wait complete. 2023-11-26T07:17:42.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.982+0000 7fc93e7fc640 1 -- 172.21.15.77:0/1430296454 --> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc928002cb0 con 0x7fc930073130 2023-11-26T07:17:42.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.983+0000 7fc94cff9640 1 -- 172.21.15.77:0/1430296454 <== osd.1 v2:172.21.15.77:6817/674756385 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc928002cb0 con 0x7fc930073130 2023-11-26T07:17:42.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.983+0000 7fc93e7fc640 1 -- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] conn(0x7fc930073130 msgr2=0x7fc930075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.984+0000 7f3c237fe640 1 -- 172.21.15.77:0/1242139002 <== osd.6 v2:172.21.15.159:6808/4233966301 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3c1400c040 con 0x7f3c0c073010 2023-11-26T07:17:42.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.983+0000 7fc93e7fc640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] conn(0x7fc930073130 0x7fc930075550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.984+0000 7fc93e7fc640 1 -- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc93006af10 msgr2=0x7fc93006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.984+0000 7fc93e7fc640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc93006af10 0x7fc93006d3d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc9501f6030 tx=0x7fc940008040 comp rx=0 tx=0).stop 2023-11-26T07:17:42.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.984+0000 7fc93e7fc640 1 -- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc944003970 msgr2=0x7fc95014b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.984+0000 7fc93e7fc640 1 --2- 172.21.15.77:0/1430296454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc944003970 0x7fc95014b5e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc938031000 tx=0x7fc938001930 comp rx=0 tx=0).stop 2023-11-26T07:17:42.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.984+0000 7fc954a7d640 1 -- 172.21.15.77:0/1430296454 reap_dead start 2023-11-26T07:17:42.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.984+0000 7fbc01b43640 1 -- 172.21.15.77:0/2187841588 --> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbbfc0d0630 con 0x7fbbdc073040 2023-11-26T07:17:42.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.984+0000 7f3c2bfff640 1 -- 172.21.15.77:0/1242139002 >> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] conn(0x7f3c0c073010 msgr2=0x7f3c0c075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.984+0000 7f3c2bfff640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] conn(0x7f3c0c073010 0x7f3c0c075430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.984+0000 7fc93e7fc640 1 -- 172.21.15.77:0/1430296454 shutdown_connections 2023-11-26T07:17:42.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.984+0000 7fc93e7fc640 1 -- 172.21.15.77:0/1430296454 >> 172.21.15.77:0/1430296454 conn(0x7fc95006ae10 msgr2=0x7fc9501552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.985+0000 7fc93e7fc640 1 -- 172.21.15.77:0/1430296454 shutdown_connections 2023-11-26T07:17:42.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.985+0000 7f3c2bfff640 1 -- 172.21.15.77:0/1242139002 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c0c06ae70 msgr2=0x7f3c0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.985+0000 7f3c2bfff640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c0c06ae70 0x7f3c0c06d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0a6ed0 tx=0x7f3c2c06d030 comp rx=0 tx=0).stop 2023-11-26T07:17:42.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.985+0000 7f3c2bfff640 1 -- 172.21.15.77:0/1242139002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c24049420 msgr2=0x7f3c240498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.985+0000 7f3c2bfff640 1 --2- 172.21.15.77:0/1242139002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c24049420 0x7f3c240498a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400f510 tx=0x7f3c1c00eb40 comp rx=0 tx=0).stop 2023-11-26T07:17:42.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.985+0000 7f3c2b7fe640 1 -- 172.21.15.77:0/1242139002 reap_dead start 2023-11-26T07:17:42.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.985+0000 7fc93e7fc640 1 -- 172.21.15.77:0/1430296454 wait complete. 2023-11-26T07:17:42.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.987+0000 7f3c2bfff640 1 -- 172.21.15.77:0/1242139002 shutdown_connections 2023-11-26T07:17:42.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.987+0000 7f3c2bfff640 1 -- 172.21.15.77:0/1242139002 >> 172.21.15.77:0/1242139002 conn(0x7f3c240559a0 msgr2=0x7f3c240076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.987+0000 7f3c2bfff640 1 -- 172.21.15.77:0/1242139002 shutdown_connections 2023-11-26T07:17:42.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.987+0000 7f3c2bfff640 1 -- 172.21.15.77:0/1242139002 wait complete. 2023-11-26T07:17:42.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.988+0000 7f6c327db640 1 -- 172.21.15.77:0/1723779537 --> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6c240e0970 con 0x7f6c10073d90 2023-11-26T07:17:42.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.989+0000 7fbbf97fa640 1 -- 172.21.15.77:0/2187841588 <== osd.5 v2:172.21.15.159:6800/3212169486 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbbec001f20 con 0x7fbbdc073040 2023-11-26T07:17:42.014 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2023-11-26T07:17:42.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.989+0000 7f6c21ffb640 1 -- 172.21.15.77:0/1723779537 <== osd.4 v2:172.21.15.159:6816/3986384485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6c240e0970 con 0x7f6c10073d90 2023-11-26T07:17:42.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-26T07:17:42.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.990+0000 7fbc01b43640 1 -- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] conn(0x7fbbdc073040 msgr2=0x7fbbdc075460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.990+0000 7fbc01b43640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] conn(0x7fbbdc073040 0x7fbbdc075460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.990+0000 7fbc01b43640 1 -- 172.21.15.77:0/2187841588 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbbdc06aea0 msgr2=0x7fbbdc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.990+0000 7fbc01b43640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbbdc06aea0 0x7fbbdc06d360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4036000 tx=0x7fbbe4008030 comp rx=0 tx=0).stop 2023-11-26T07:17:42.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.990+0000 7fbc01b43640 1 -- 172.21.15.77:0/2187841588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc15d490 msgr2=0x7fbbfc0cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.990+0000 7fbc01b43640 1 --2- 172.21.15.77:0/2187841588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc15d490 0x7fbbfc0cc0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400e9b0 tx=0x7fbbf400ee70 comp rx=0 tx=0).stop 2023-11-26T07:17:42.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.990+0000 7fbc01342640 1 -- 172.21.15.77:0/2187841588 reap_dead start 2023-11-26T07:17:42.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.990+0000 7fbc01b43640 1 -- 172.21.15.77:0/2187841588 shutdown_connections 2023-11-26T07:17:42.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.990+0000 7f6c327db640 1 -- 172.21.15.77:0/1723779537 >> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] conn(0x7f6c10073d90 msgr2=0x7f6c10076230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.990+0000 7f6c327db640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] conn(0x7f6c10073d90 0x7f6c10076230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.990+0000 7fbc01b43640 1 -- 172.21.15.77:0/2187841588 >> 172.21.15.77:0/2187841588 conn(0x7fbbfc061340 msgr2=0x7fbbfc0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.991+0000 7fbc01b43640 1 -- 172.21.15.77:0/2187841588 shutdown_connections 2023-11-26T07:17:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.991+0000 7fbc01b43640 1 -- 172.21.15.77:0/2187841588 wait complete. 2023-11-26T07:17:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.991+0000 7f6c327db640 1 -- 172.21.15.77:0/1723779537 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6c1006ae90 msgr2=0x7f6c1006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.991+0000 7f6c327db640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6c1006ae90 0x7f6c1006d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c280015c0 tx=0x7f6c280079c0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.991+0000 7f6c327db640 1 -- 172.21.15.77:0/1723779537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c240e7b90 msgr2=0x7f6c240e2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.991+0000 7f6c327db640 1 --2- 172.21.15.77:0/1723779537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c240e7b90 0x7f6c240e2900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c050020 tx=0x7f6c2c06a3b0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.991+0000 7f6c31fda640 1 -- 172.21.15.77:0/1723779537 reap_dead start 2023-11-26T07:17:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.991+0000 7f6c327db640 1 -- 172.21.15.77:0/1723779537 shutdown_connections 2023-11-26T07:17:42.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.991+0000 7f6c327db640 1 -- 172.21.15.77:0/1723779537 >> 172.21.15.77:0/1723779537 conn(0x7f6c24056c90 msgr2=0x7f6c24037a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.991+0000 7f6c327db640 1 -- 172.21.15.77:0/1723779537 shutdown_connections 2023-11-26T07:17:42.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:41.991+0000 7f6c327db640 1 -- 172.21.15.77:0/1723779537 wait complete. 2023-11-26T07:17:42.019 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2023-11-26T07:17:42.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-26T07:17:42.020 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2023-11-26T07:17:42.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-26T07:17:42.021 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-11-26T07:17:42.022 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-26T07:17:42.022 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2023-11-26T07:17:42.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-26T07:17:42.023 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2023-11-26T07:17:42.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-26T07:17:42.024 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-11-26T07:17:42.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-26T07:17:42.025 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-11-26T07:17:42.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-26T07:17:42.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.352+0000 7f608d63d640 1 Processor -- start 2023-11-26T07:17:42.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.352+0000 7f608d63d640 1 -- start start 2023-11-26T07:17:42.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.354+0000 7f608d63d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60880ce450 0x7f60880ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.354+0000 7f608d63d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f608806c560 0x7f608815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.355+0000 7f608d63d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60880cff70 con 0x7f608806da40 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.355+0000 7f608d63d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60880b3970 con 0x7f608806c560 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.355+0000 7f608d63d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60880b3c50 con 0x7f60880ce450 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.355+0000 7f6086ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f608806da40 0x7f608806de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54356/0 (socket says 172.21.15.77:54356) 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.355+0000 7f6086ffd640 1 -- 172.21.15.77:0/518766571 learned_addr learned my addr 172.21.15.77:0/518766571 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.356+0000 7f60867fc640 1 --2- 172.21.15.77:0/518766571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60880ce450 0x7f60880ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.356+0000 7f60877fe640 1 --2- 172.21.15.77:0/518766571 >> v2:172.21.15.159:3300/0 conn(0x7f608806c560 0x7f608815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.357+0000 7f6085ffb640 1 -- 172.21.15.77:0/518766571 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971118709 0 0) 0x7f60880cff70 con 0x7f608806da40 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.357+0000 7f6085ffb640 1 -- 172.21.15.77:0/518766571 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6070005730 con 0x7f608806da40 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.357+0000 7f60877fe640 1 -- 172.21.15.77:0/518766571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60880ce450 msgr2=0x7f60880ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.357+0000 7f60877fe640 1 --2- 172.21.15.77:0/518766571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60880ce450 0x7f60880ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.357+0000 7f60877fe640 1 -- 172.21.15.77:0/518766571 >> v1:172.21.15.77:6789/0 conn(0x7f608806da40 legacy=0x7f608806de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.357+0000 7f60877fe640 1 -- 172.21.15.77:0/518766571 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880b3f30 con 0x7f608806c560 2023-11-26T07:17:42.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.357+0000 7fb41b147640 1 Processor -- start 2023-11-26T07:17:42.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.358+0000 7fb41b147640 1 -- start start 2023-11-26T07:17:42.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.359+0000 7f60877fe640 1 --2- 172.21.15.77:0/518766571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f608806c560 0x7f608815a2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f607c0090e0 tx=0x7f607c02bb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb9480d036dbc1f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.359+0000 7fb41b147640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb40c0e32a0 0x7fb40c052c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.359+0000 7fb41b147640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 0x7fb40c04f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.360+0000 7f6085ffb640 1 -- 172.21.15.77:0/518766571 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c02d8c0 con 0x7f608806c560 2023-11-26T07:17:42.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.360+0000 7f6085ffb640 1 -- 172.21.15.77:0/518766571 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c02da20 con 0x7f608806c560 2023-11-26T07:17:42.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.360+0000 7f6085ffb640 1 -- 172.21.15.77:0/518766571 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c02ddb0 con 0x7f608806c560 2023-11-26T07:17:42.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.360+0000 7fb419944640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 0x7fb40c04f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.360+0000 7fb41b147640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40c0e3680 con 0x7fb40c04fd80 2023-11-26T07:17:42.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.360+0000 7fb41b147640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c050230 con 0x7fb40c0e32a0 2023-11-26T07:17:42.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.360+0000 7fb41b147640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c053670 con 0x7fb40c053160 2023-11-26T07:17:42.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.360+0000 7fb419944640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 0x7fb40c04f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45628/0 (socket says 172.21.15.77:45628) 2023-11-26T07:17:42.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.360+0000 7fb419944640 1 -- 172.21.15.77:0/3456344894 learned_addr learned my addr 172.21.15.77:0/3456344894 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:42.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.360+0000 7fb41a145640 1 --2- 172.21.15.77:0/3456344894 >> v2:172.21.15.77:3300/0 conn(0x7fb40c0e32a0 0x7fb40c052c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.361+0000 7fb41a145640 1 -- 172.21.15.77:0/3456344894 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 msgr2=0x7fb40c04f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.361+0000 7fb41a145640 1 --2- 172.21.15.77:0/3456344894 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 0x7fb40c04f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.361+0000 7fb41a145640 1 -- 172.21.15.77:0/3456344894 >> v1:172.21.15.77:6789/0 conn(0x7fb40c04fd80 legacy=0x7fb40c005e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.361+0000 7f608d63d640 1 -- 172.21.15.77:0/518766571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f608806c560 msgr2=0x7f608815a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.361+0000 7fb41a145640 1 -- 172.21.15.77:0/3456344894 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c053950 con 0x7fb40c0e32a0 2023-11-26T07:17:42.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.361+0000 7f608d63d640 1 --2- 172.21.15.77:0/518766571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f608806c560 0x7f608815a2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f607c0090e0 tx=0x7f607c02bb00 comp rx=0 tx=0).stop 2023-11-26T07:17:42.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.362+0000 7f608d63d640 1 -- 172.21.15.77:0/518766571 shutdown_connections 2023-11-26T07:17:42.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.362+0000 7f608d63d640 1 --2- 172.21.15.77:0/518766571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f608806c560 0x7f608815a2d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.362+0000 7f608d63d640 1 --2- 172.21.15.77:0/518766571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60880ce450 0x7f60880ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.362+0000 7f608d63d640 1 -- 172.21.15.77:0/518766571 >> 172.21.15.77:0/518766571 conn(0x7f608806a920 msgr2=0x7f608806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.363+0000 7fb41a145640 1 --2- 172.21.15.77:0/3456344894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32a0 0x7fb40c052c20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb410011fc0 tx=0x7fb4100340d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1911b77d503c024 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.363+0000 7fb419143640 1 -- 172.21.15.77:0/3456344894 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410034e80 con 0x7fb40c0e32a0 2023-11-26T07:17:42.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.364+0000 7fb419143640 1 -- 172.21.15.77:0/3456344894 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4100110d0 con 0x7fb40c0e32a0 2023-11-26T07:17:42.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.364+0000 7fb419143640 1 -- 172.21.15.77:0/3456344894 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410011440 con 0x7fb40c0e32a0 2023-11-26T07:17:42.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.364+0000 7f608d63d640 1 -- 172.21.15.77:0/518766571 shutdown_connections 2023-11-26T07:17:42.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.364+0000 7f608d63d640 1 -- 172.21.15.77:0/518766571 wait complete. 2023-11-26T07:17:42.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.365+0000 7fb41b147640 1 -- 172.21.15.77:0/3456344894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32a0 msgr2=0x7fb40c052c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.365+0000 7fb41b147640 1 --2- 172.21.15.77:0/3456344894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32a0 0x7fb40c052c20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb410011fc0 tx=0x7fb4100340d0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.365+0000 7fb41b147640 1 -- 172.21.15.77:0/3456344894 shutdown_connections 2023-11-26T07:17:42.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.365+0000 7fb41b147640 1 --2- 172.21.15.77:0/3456344894 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 0x7fb40c04f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.365+0000 7fb41b147640 1 --2- 172.21.15.77:0/3456344894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32a0 0x7fb40c052c20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.365+0000 7fb41b147640 1 -- 172.21.15.77:0/3456344894 >> 172.21.15.77:0/3456344894 conn(0x7fb40c009f80 msgr2=0x7fb40c00a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.366+0000 7fb41b147640 1 -- 172.21.15.77:0/3456344894 shutdown_connections 2023-11-26T07:17:42.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.366+0000 7fb41b147640 1 -- 172.21.15.77:0/3456344894 wait complete. 2023-11-26T07:17:42.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.368+0000 7f608d63d640 1 Processor -- start 2023-11-26T07:17:42.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.368+0000 7fb41b147640 1 Processor -- start 2023-11-26T07:17:42.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.369+0000 7fb41b147640 1 -- start start 2023-11-26T07:17:42.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.368+0000 7f608d63d640 1 -- start start 2023-11-26T07:17:42.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.370+0000 7f608d63d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f608806c560 0x7f608809b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.370+0000 7f608d63d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f608806da40 0x7f6088099140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.370+0000 7f608d63d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6088099680 0x7f60881f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.370+0000 7f608d63d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6088099b30 con 0x7f608806c560 2023-11-26T07:17:42.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.370+0000 7f608d63d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608815baf0 con 0x7f6088099680 2023-11-26T07:17:42.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.370+0000 7f608d63d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608809b710 con 0x7f608806da40 2023-11-26T07:17:42.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.370+0000 7f60867fc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f608806da40 0x7f6088099140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.370+0000 7f60867fc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f608806da40 0x7f6088099140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45642/0 (socket says 172.21.15.77:45642) 2023-11-26T07:17:42.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.370+0000 7f60867fc640 1 -- 172.21.15.77:0/1054061536 learned_addr learned my addr 172.21.15.77:0/1054061536 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:42.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.371+0000 7f6086ffd640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f608806c560 0x7f608809b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.371+0000 7f60867fc640 1 -- 172.21.15.77:0/1054061536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6088099680 msgr2=0x7f60881f8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.371+0000 7f60867fc640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6088099680 0x7f60881f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.371+0000 7f60867fc640 1 -- 172.21.15.77:0/1054061536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f608806c560 msgr2=0x7f608809b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.371+0000 7f60867fc640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f608806c560 0x7f608809b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.371+0000 7f60867fc640 1 -- 172.21.15.77:0/1054061536 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c009c90 con 0x7f608806da40 2023-11-26T07:17:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.372+0000 7fb41b147640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c04fd80 0x7fb40c0db240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.372+0000 7f60867fc640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f608806da40 0x7f6088099140 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f607800d560 tx=0x7f607800da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.372+0000 7fb41b147640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 0x7fb40c185980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7fb41b147640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32a0 0x7fb40c0e5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7f606f7fe640 1 -- 172.21.15.77:0/1054061536 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780125f0 con 0x7f608806da40 2023-11-26T07:17:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7f606f7fe640 1 -- 172.21.15.77:0/1054061536 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6078012750 con 0x7f608806da40 2023-11-26T07:17:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7f606f7fe640 1 -- 172.21.15.77:0/1054061536 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6078012b00 con 0x7f608806da40 2023-11-26T07:17:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7fb419944640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 0x7fb40c185980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7fb419944640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 0x7fb40c185980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45646/0 (socket says 172.21.15.77:45646) 2023-11-26T07:17:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7fb41a946640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32a0 0x7fb40c0e5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7fb41a946640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32a0 0x7fb40c0e5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34898/0 (socket says 172.21.15.77:34898) 2023-11-26T07:17:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7fb41a145640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c04fd80 0x7fb40c0db240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7fb41a145640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c04fd80 0x7fb40c0db240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:55246/0 (socket says 172.21.15.77:55246) 2023-11-26T07:17:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7fb419944640 1 -- 172.21.15.77:0/4254620375 learned_addr learned my addr 172.21.15.77:0/4254620375 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.373+0000 7f608d63d640 1 -- 172.21.15.77:0/1054061536 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608809b9f0 con 0x7f608806da40 2023-11-26T07:17:42.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.374+0000 7f608d63d640 1 -- 172.21.15.77:0/1054061536 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608809bfb0 con 0x7f608806da40 2023-11-26T07:17:42.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.374+0000 7f839a7b0640 1 Processor -- start 2023-11-26T07:17:42.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.375+0000 7f839a7b0640 1 -- start start 2023-11-26T07:17:42.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.374+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c0d93d0 con 0x7fb40c0e32a0 2023-11-26T07:17:42.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.374+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c0e3bf0 con 0x7fb40c04fd80 2023-11-26T07:17:42.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.374+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c0e3ed0 con 0x7fb40c053160 2023-11-26T07:17:42.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.375+0000 7fb419944640 1 -- 172.21.15.77:0/4254620375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c04fd80 msgr2=0x7fb40c0db240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.375+0000 7fb419944640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c04fd80 0x7fb40c0db240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.375+0000 7fb419944640 1 -- 172.21.15.77:0/4254620375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32a0 msgr2=0x7fb40c0e5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.375+0000 7fb41a145640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c04fd80 0x7fb40c0db240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-11-26T07:17:42.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.375+0000 7fb419944640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32a0 0x7fb40c0e5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.375+0000 7fb419944640 1 -- 172.21.15.77:0/4254620375 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb410011ca0 con 0x7fb40c053160 2023-11-26T07:17:42.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.375+0000 7fb41a946640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32a0 0x7fb40c0e5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:42.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.377+0000 7f839a7b0640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f83940cc1d0 0x7f8394060f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.377+0000 7f839a7b0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f83940cc5b0 0x7f83940b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.377+0000 7f839a7b0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83940b3160 con 0x7f83940b5520 2023-11-26T07:17:42.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.377+0000 7f839a7b0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83940b59d0 con 0x7f83940cc5b0 2023-11-26T07:17:42.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.377+0000 7f839a7b0640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8394160840 con 0x7f83940cc1d0 2023-11-26T07:17:42.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.377+0000 7f8393fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f83940cc1d0 0x7f8394060f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.377+0000 7f8398d4d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f83940b5520 0x7f83940cdca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54370/0 (socket says 172.21.15.77:54370) 2023-11-26T07:17:42.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.377+0000 7f8398d4d640 1 -- 172.21.15.77:0/3757586322 learned_addr learned my addr 172.21.15.77:0/3757586322 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:42.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.378+0000 7f838b7fe640 1 --2- 172.21.15.77:0/3757586322 >> v2:172.21.15.77:3300/0 conn(0x7f83940cc5b0 0x7f83940b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.378+0000 7f9e915fb640 1 Processor -- start 2023-11-26T07:17:42.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.378+0000 7f8ea1d0f640 1 Processor -- start 2023-11-26T07:17:42.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.378+0000 7f9e915fb640 1 -- start start 2023-11-26T07:17:42.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.378+0000 7fb419944640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 0x7fb40c185980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb40400e900 tx=0x7fb40400edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.379+0000 7f8ea1d0f640 1 -- start start 2023-11-26T07:17:42.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.379+0000 7fb40affd640 1 -- 172.21.15.77:0/4254620375 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400ca00 con 0x7fb40c053160 2023-11-26T07:17:42.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.376+0000 7f606d7fa640 1 -- 172.21.15.77:0/1054061536 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6068005250 con 0x7f608806da40 2023-11-26T07:17:42.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.379+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40c0e41b0 con 0x7fb40c053160 2023-11-26T07:17:42.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.378+0000 7f8393fff640 1 -- 172.21.15.77:0/3757586322 >> v2:172.21.15.77:3300/0 conn(0x7f83940cc5b0 msgr2=0x7f83940b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.379+0000 7f8393fff640 1 --2- 172.21.15.77:0/3757586322 >> v2:172.21.15.77:3300/0 conn(0x7f83940cc5b0 0x7f83940b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.379+0000 7f8393fff640 1 -- 172.21.15.77:0/3757586322 >> v1:172.21.15.77:6789/0 conn(0x7f83940b5520 legacy=0x7f83940cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.379+0000 7f8393fff640 1 -- 172.21.15.77:0/3757586322 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940cea00 con 0x7f83940cc1d0 2023-11-26T07:17:42.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.379+0000 7f606f7fe640 1 -- 172.21.15.77:0/1054061536 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6078012c60 con 0x7f608806da40 2023-11-26T07:17:42.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.380+0000 7f8ea1d0f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e9c157c70 0x7f8e9c161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.380+0000 7f8ea1d0f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8e9c0cf450 0x7f8e9c0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.379+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40c04bb60 con 0x7fb40c053160 2023-11-26T07:17:42.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.380+0000 7f838b7fe640 1 --2- 172.21.15.77:0/3757586322 >> v2:172.21.15.77:3300/0 conn(0x7f83940cc5b0 0x7f83940b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:42.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.380+0000 7fb40affd640 1 -- 172.21.15.77:0/4254620375 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40400cb60 con 0x7fb40c053160 2023-11-26T07:17:42.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.381+0000 7f9e915fb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e8c0ce450 0x7f9e8c0ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.381+0000 7f8ea1d0f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9c0ce0b0 con 0x7f8e9c15dc80 2023-11-26T07:17:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.381+0000 7f8ea1d0f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9c0cfe10 con 0x7f8e9c0cf450 2023-11-26T07:17:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.381+0000 7f8ea1d0f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c161960 con 0x7f8e9c157c70 2023-11-26T07:17:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.381+0000 7f9e915fb640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9e8c06c560 0x7f9e8c15a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.381+0000 7f9e915fb640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c0cff70 con 0x7f9e8c06da40 2023-11-26T07:17:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.381+0000 7f9e915fb640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c0b3970 con 0x7f9e8c06c560 2023-11-26T07:17:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.381+0000 7f9e915fb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0b3c50 con 0x7f9e8c0ce450 2023-11-26T07:17:42.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.380+0000 7fb40affd640 1 -- 172.21.15.77:0/4254620375 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400ca00 con 0x7fb40c053160 2023-11-26T07:17:42.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.381+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40c0507e0 con 0x7fb40c053160 2023-11-26T07:17:42.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.382+0000 7f8e9bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8e9c15dc80 0x7f8e9c15e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54384/0 (socket says 172.21.15.77:54384) 2023-11-26T07:17:42.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.382+0000 7f8e9bfff640 1 -- 172.21.15.77:0/953969177 learned_addr learned my addr 172.21.15.77:0/953969177 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:42.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.381+0000 7f606f7fe640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f607406ae40 0x7f607406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.381+0000 7f606f7fe640 1 -- 172.21.15.77:0/1054061536 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60780899d0 con 0x7f608806da40 2023-11-26T07:17:42.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.382+0000 7f8e9affd640 1 --2- 172.21.15.77:0/953969177 >> v2:172.21.15.77:3300/0 conn(0x7f8e9c0cf450 0x7f8e9c0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.382+0000 7f8e9b7fe640 1 --2- 172.21.15.77:0/953969177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e9c157c70 0x7f8e9c161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.382+0000 7f9e8affd640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f9e8c06da40 0x7f9e8c06de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:38636/0 (socket says 172.21.15.77:38636) 2023-11-26T07:17:42.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.382+0000 7f9e8affd640 1 -- 172.21.15.77:0/3819256202 learned_addr learned my addr 172.21.15.77:0/3819256202 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:42.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.382+0000 7f9e8a7fc640 1 --2- 172.21.15.77:0/3819256202 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e8c0ce450 0x7f9e8c0ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.382+0000 7f9e8b7fe640 1 --2- 172.21.15.77:0/3819256202 >> v2:172.21.15.159:3300/0 conn(0x7f9e8c06c560 0x7f9e8c15a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.382+0000 7f8393fff640 1 --2- 172.21.15.77:0/3757586322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940cc1d0 0x7f8394060f20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f839406bff0 tx=0x7f837c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c87c8b98af72c1b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f8e9affd640 1 -- 172.21.15.77:0/953969177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e9c157c70 msgr2=0x7f8e9c161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f8e9affd640 1 --2- 172.21.15.77:0/953969177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e9c157c70 0x7f8e9c161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f8e9affd640 1 -- 172.21.15.77:0/953969177 >> v1:172.21.15.77:6789/0 conn(0x7f8e9c15dc80 legacy=0x7f8e9c15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f8e9affd640 1 -- 172.21.15.77:0/953969177 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c15e8d0 con 0x7f8e9c0cf450 2023-11-26T07:17:42.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f1f8f085640 1 Processor -- start 2023-11-26T07:17:42.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f6086ffd640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f607406ae40 0x7f607406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f83937fe640 1 -- 172.21.15.77:0/3757586322 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c030840 con 0x7f83940cc1d0 2023-11-26T07:17:42.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f83937fe640 1 -- 172.21.15.77:0/3757586322 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c0309a0 con 0x7f83940cc1d0 2023-11-26T07:17:42.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f83937fe640 1 -- 172.21.15.77:0/3757586322 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c030d30 con 0x7f83940cc1d0 2023-11-26T07:17:42.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f1f8f085640 1 -- start start 2023-11-26T07:17:42.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f9e89ffb640 1 -- 172.21.15.77:0/3819256202 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883093624 0 0) 0x7f9e8c0cff70 con 0x7f9e8c06da40 2023-11-26T07:17:42.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f9e8a7fc640 1 -- 172.21.15.77:0/3819256202 >> v2:172.21.15.159:3300/0 conn(0x7f9e8c06c560 msgr2=0x7f9e8c15a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f9e8a7fc640 1 --2- 172.21.15.77:0/3819256202 >> v2:172.21.15.159:3300/0 conn(0x7f9e8c06c560 0x7f9e8c15a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f9e8a7fc640 1 -- 172.21.15.77:0/3819256202 >> v1:172.21.15.159:6789/0 conn(0x7f9e8c06da40 legacy=0x7f9e8c06de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.383+0000 7f9e8a7fc640 1 -- 172.21.15.77:0/3819256202 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0b3f30 con 0x7f9e8c0ce450 2023-11-26T07:17:42.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.384+0000 7f839a7b0640 1 -- 172.21.15.77:0/3757586322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940cc1d0 msgr2=0x7f8394060f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.384+0000 7f839a7b0640 1 --2- 172.21.15.77:0/3757586322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940cc1d0 0x7f8394060f20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f839406bff0 tx=0x7f837c02b980 comp rx=0 tx=0).stop 2023-11-26T07:17:42.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.384+0000 7f839a7b0640 1 -- 172.21.15.77:0/3757586322 shutdown_connections 2023-11-26T07:17:42.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.384+0000 7f839a7b0640 1 --2- 172.21.15.77:0/3757586322 >> v2:172.21.15.77:3300/0 conn(0x7f83940cc5b0 0x7f83940b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.384+0000 7f839a7b0640 1 --2- 172.21.15.77:0/3757586322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940cc1d0 0x7f8394060f20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.384+0000 7f839a7b0640 1 -- 172.21.15.77:0/3757586322 >> 172.21.15.77:0/3757586322 conn(0x7f8394071d40 msgr2=0x7f839406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.384+0000 7f8e9affd640 1 --2- 172.21.15.77:0/953969177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9c0cf450 0x7f8e9c0cf8d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0097a0 tx=0x7f8e8c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bf538a730e6ad4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.385+0000 7f8e9a7fc640 1 -- 172.21.15.77:0/953969177 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c031780 con 0x7f8e9c0cf450 2023-11-26T07:17:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.385+0000 7f839a7b0640 1 -- 172.21.15.77:0/3757586322 shutdown_connections 2023-11-26T07:17:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.385+0000 7f8e9a7fc640 1 -- 172.21.15.77:0/953969177 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c0318e0 con 0x7f8e9c0cf450 2023-11-26T07:17:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.385+0000 7f8e9a7fc640 1 -- 172.21.15.77:0/953969177 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c031c70 con 0x7f8e9c0cf450 2023-11-26T07:17:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.385+0000 7f839a7b0640 1 -- 172.21.15.77:0/3757586322 wait complete. 2023-11-26T07:17:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.385+0000 7f6086ffd640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f607406ae40 0x7f607406d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6080005c00 tx=0x7f6080009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.385+0000 7f9e8a7fc640 1 --2- 172.21.15.77:0/3819256202 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e8c0ce450 0x7f9e8c0ae480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000ba40 tx=0x7f9e80030280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e64a4853147f1f59 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/953969177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9c0cf450 msgr2=0x7f8e9c0cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f8ea1d0f640 1 --2- 172.21.15.77:0/953969177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9c0cf450 0x7f8e9c0cf8d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0097a0 tx=0x7f8e8c02b820 comp rx=0 tx=0).stop 2023-11-26T07:17:42.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f1f8f085640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1f88071b20 0x7f1f8806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f1f8f085640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1f8806ca30 0x7f1f88162270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f1f8f085640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f88161de0 con 0x7f1f8814b240 2023-11-26T07:17:42.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f1f8f085640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f88070830 con 0x7f1f88071b20 2023-11-26T07:17:42.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f1f8f085640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8806cea0 con 0x7f1f8806ca30 2023-11-26T07:17:42.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f899e00e640 1 Processor -- start 2023-11-26T07:17:42.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/953969177 shutdown_connections 2023-11-26T07:17:42.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f8ea1d0f640 1 --2- 172.21.15.77:0/953969177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9c0cf450 0x7f8e9c0cf8d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f8ea1d0f640 1 --2- 172.21.15.77:0/953969177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e9c157c70 0x7f8e9c161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/953969177 >> 172.21.15.77:0/953969177 conn(0x7f8e9c06a920 msgr2=0x7f8e9c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f899e00e640 1 -- start start 2023-11-26T07:17:42.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.386+0000 7f1f8d882640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1f88071b20 0x7f1f8806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.387+0000 7f1f8d882640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1f88071b20 0x7f1f8806c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34930/0 (socket says 172.21.15.77:34930) 2023-11-26T07:17:42.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.387+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/953969177 shutdown_connections 2023-11-26T07:17:42.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.387+0000 7f1f8d882640 1 -- 172.21.15.77:0/3725140059 learned_addr learned my addr 172.21.15.77:0/3725140059 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:42.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.387+0000 7f1f8e884640 1 --2- 172.21.15.77:0/3725140059 >> v2:172.21.15.159:3300/0 conn(0x7f1f8806ca30 0x7f1f88162270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.387+0000 7f1f8d882640 1 -- 172.21.15.77:0/3725140059 >> v2:172.21.15.159:3300/0 conn(0x7f1f8806ca30 msgr2=0x7f1f88162270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.387+0000 7f1f8d882640 1 --2- 172.21.15.77:0/3725140059 >> v2:172.21.15.159:3300/0 conn(0x7f1f8806ca30 0x7f1f88162270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.387+0000 7f1f8d882640 1 -- 172.21.15.77:0/3725140059 >> v1:172.21.15.159:6789/0 conn(0x7f1f8814b240 legacy=0x7f1f88071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.387+0000 7f839a7b0640 1 Processor -- start 2023-11-26T07:17:42.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.387+0000 7f1f8d882640 1 -- 172.21.15.77:0/3725140059 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8814b620 con 0x7f1f88071b20 2023-11-26T07:17:42.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.387+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/953969177 wait complete. 2023-11-26T07:17:42.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.387+0000 7f839a7b0640 1 -- start start 2023-11-26T07:17:42.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.388+0000 7f899e00e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f89981609e0 0x7f899806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.388+0000 7f899e00e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980d31a0 0x7f89980d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.388+0000 7f899e00e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89980ceb90 con 0x7f89980ce010 2023-11-26T07:17:42.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.388+0000 7f899e00e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899806c1f0 con 0x7f89981609e0 2023-11-26T07:17:42.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.388+0000 7f899e00e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89980d1070 con 0x7f89980d31a0 2023-11-26T07:17:42.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.388+0000 7f8997fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f89980ce010 0x7f89980ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54386/0 (socket says 172.21.15.77:54386) 2023-11-26T07:17:42.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.388+0000 7f8997fff640 1 -- 172.21.15.77:0/3120921224 learned_addr learned my addr 172.21.15.77:0/3120921224 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:42.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.388+0000 7f1f8d882640 1 --2- 172.21.15.77:0/3725140059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88071b20 0x7f1f8806c4f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1f880b1f50 tx=0x7f1f7802b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49307a14767d1919 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.388+0000 7f89977fe640 1 --2- 172.21.15.77:0/3120921224 >> v2:172.21.15.159:3300/0 conn(0x7f89981609e0 0x7f899806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.388+0000 7f898ffff640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980d31a0 0x7f89980d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634264362 0 0) 0x7f89980ceb90 con 0x7f89980ce010 2023-11-26T07:17:42.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8984003520 con 0x7f89980ce010 2023-11-26T07:17:42.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f839a7b0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83940b5520 0x7f83941414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f839a7b0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940cc1d0 0x7f839406af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3738871102 0 0) 0x7f8984003520 con 0x7f89980ce010 2023-11-26T07:17:42.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980d31a0 msgr2=0x7f89980d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980d31a0 0x7f89980d3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 >> v2:172.21.15.159:3300/0 conn(0x7f89981609e0 msgr2=0x7f899806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 --2- 172.21.15.77:0/3120921224 >> v2:172.21.15.159:3300/0 conn(0x7f89981609e0 0x7f899806bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89980d3b40 con 0x7f89980ce010 2023-11-26T07:17:42.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f839a7b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83940cc5b0 0x7f839415fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f839a7b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83941407f0 con 0x7f83940cc5b0 2023-11-26T07:17:42.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f839a7b0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83941f7080 con 0x7f83940cc1d0 2023-11-26T07:17:42.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f89900019f0 con 0x7f89980ce010 2023-11-26T07:17:42.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 >> v1:172.21.15.77:6789/0 conn(0x7f89980ce010 legacy=0x7f89980ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f839a7b0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8394140a00 con 0x7f83940b5520 2023-11-26T07:17:42.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8984003970 0x7f8984003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980d31a0 0x7f89840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 0x7f8984005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899806c1f0 con 0x7f8984004d00 2023-11-26T07:17:42.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89980d1070 con 0x7f8984003970 2023-11-26T07:17:42.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898400b980 con 0x7f89980d31a0 2023-11-26T07:17:42.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.389+0000 7f8ea1d0f640 1 Processor -- start 2023-11-26T07:17:42.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f8393fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83940b5520 0x7f83941414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f1f8d081640 1 -- 172.21.15.77:0/3725140059 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78031890 con 0x7f1f88071b20 2023-11-26T07:17:42.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f1f8d081640 1 -- 172.21.15.77:0/3725140059 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f780319f0 con 0x7f1f88071b20 2023-11-26T07:17:42.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f1f8d081640 1 -- 172.21.15.77:0/3725140059 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78031d80 con 0x7f1f88071b20 2023-11-26T07:17:42.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f8997fff640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 0x7f8984005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f8393fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83940b5520 0x7f83941414e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45682/0 (socket says 172.21.15.77:45682) 2023-11-26T07:17:42.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f8393fff640 1 -- 172.21.15.77:0/2622555602 learned_addr learned my addr 172.21.15.77:0/2622555602 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:42.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f838b7fe640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940cc1d0 0x7f839406af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f8398d4d640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83940cc5b0 0x7f839415fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f898ffff640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980d31a0 0x7f89840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f89977fe640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8984003970 0x7f8984003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f8997fff640 1 -- 172.21.15.77:0/3120921224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980d31a0 msgr2=0x7f89840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f8997fff640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980d31a0 0x7f89840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f8997fff640 1 -- 172.21.15.77:0/3120921224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8984003970 msgr2=0x7f8984003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f8997fff640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8984003970 0x7f8984003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f8997fff640 1 -- 172.21.15.77:0/3120921224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89980d3b40 con 0x7f8984004d00 2023-11-26T07:17:42.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8393fff640 1 -- 172.21.15.77:0/2622555602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940cc1d0 msgr2=0x7f839406af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8393fff640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940cc1d0 0x7f839406af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8393fff640 1 -- 172.21.15.77:0/2622555602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83940cc5b0 msgr2=0x7f839415fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8393fff640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83940cc5b0 0x7f839415fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8393fff640 1 -- 172.21.15.77:0/2622555602 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009400 con 0x7f83940b5520 2023-11-26T07:17:42.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f1f8f085640 1 -- 172.21.15.77:0/3725140059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88071b20 msgr2=0x7f1f8806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f1f8f085640 1 --2- 172.21.15.77:0/3725140059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88071b20 0x7f1f8806c4f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1f880b1f50 tx=0x7f1f7802b930 comp rx=0 tx=0).stop 2023-11-26T07:17:42.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f1f8f085640 1 -- 172.21.15.77:0/3725140059 shutdown_connections 2023-11-26T07:17:42.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f1f8f085640 1 --2- 172.21.15.77:0/3725140059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f88071b20 0x7f1f8806c4f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f1f8f085640 1 --2- 172.21.15.77:0/3725140059 >> v2:172.21.15.159:3300/0 conn(0x7f1f8806ca30 0x7f1f88162270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f1f8f085640 1 -- 172.21.15.77:0/3725140059 >> 172.21.15.77:0/3725140059 conn(0x7f1f8806dc30 msgr2=0x7f1f8806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.390+0000 7f8ea1d0f640 1 -- start start 2023-11-26T07:17:42.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8ea1d0f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9c0cf450 0x7f8e9c1f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8ea1d0f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e9c157c70 0x7f8e9c0aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8ea1d0f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e9c15dc80 0x7f8e9c1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8ea1d0f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c1584e0 con 0x7f8e9c0cf450 2023-11-26T07:17:42.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8ea1d0f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0acd90 con 0x7f8e9c15dc80 2023-11-26T07:17:42.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8ea1d0f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0ad070 con 0x7f8e9c157c70 2023-11-26T07:17:42.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f1f8f085640 1 -- 172.21.15.77:0/3725140059 shutdown_connections 2023-11-26T07:17:42.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f1f8f085640 1 -- 172.21.15.77:0/3725140059 wait complete. 2023-11-26T07:17:42.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.391+0000 7f8398d4d640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83940cc5b0 0x7f839415fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:42.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8e9b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9c0cf450 0x7f8e9c1f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8e9bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e9c15dc80 0x7f8e9c1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8e9bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e9c15dc80 0x7f8e9c1600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:55310/0 (socket says 172.21.15.77:55310) 2023-11-26T07:17:42.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8e9bfff640 1 -- 172.21.15.77:0/2184282611 learned_addr learned my addr 172.21.15.77:0/2184282611 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:42.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8997fff640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 0x7f8984005180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f899000a8d0 tx=0x7f89840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d38625d6cda5d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8393fff640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83940b5520 0x7f83941414e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f837c009890 tx=0x7f837c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8e9affd640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e9c157c70 0x7f8e9c0aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990034630 con 0x7f8984004d00 2023-11-26T07:17:42.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899002f070 con 0x7f8984004d00 2023-11-26T07:17:42.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8996ffd640 1 -- 172.21.15.77:0/3120921224 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990034a30 con 0x7f8984004d00 2023-11-26T07:17:42.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8e9b7fe640 1 -- 172.21.15.77:0/2184282611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e9c157c70 msgr2=0x7f8e9c0aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8e9b7fe640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e9c157c70 0x7f8e9c0aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8e9b7fe640 1 -- 172.21.15.77:0/2184282611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e9c15dc80 msgr2=0x7f8e9c1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8e9b7fe640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e9c15dc80 0x7f8e9c1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.392+0000 7f8e9b7fe640 1 -- 172.21.15.77:0/2184282611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c009400 con 0x7f8e9c0cf450 2023-11-26T07:17:42.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.393+0000 7f8e9affd640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e9c157c70 0x7f8e9c0aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:42.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.393+0000 7f8e9b7fe640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9c0cf450 0x7f8e9c1f6510 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000d5f0 tx=0x7f8e9000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.393+0000 7f899e00e640 1 -- 172.21.15.77:0/3120921224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 msgr2=0x7f8984005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.393+0000 7f899e00e640 1 --2- 172.21.15.77:0/3120921224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 0x7f8984005180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f899000a8d0 tx=0x7f89840057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.393+0000 7f8997fff640 1 -- 172.21.15.77:0/3120921224 reap_dead start 2023-11-26T07:17:42.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.393+0000 7f8e83fff640 1 -- 172.21.15.77:0/2184282611 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900125f0 con 0x7f8e9c0cf450 2023-11-26T07:17:42.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.393+0000 7f8e83fff640 1 -- 172.21.15.77:0/2184282611 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e90012750 con 0x7f8e9c0cf450 2023-11-26T07:17:42.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.393+0000 7f8e83fff640 1 -- 172.21.15.77:0/2184282611 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e90012b00 con 0x7f8e9c0cf450 2023-11-26T07:17:42.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.393+0000 7f1f8f085640 1 Processor -- start 2023-11-26T07:17:42.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.394+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/2184282611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c0ad350 con 0x7f8e9c0cf450 2023-11-26T07:17:42.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.394+0000 7f899e00e640 1 -- 172.21.15.77:0/3120921224 shutdown_connections 2023-11-26T07:17:42.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.394+0000 7f899e00e640 1 -- 172.21.15.77:0/3120921224 >> 172.21.15.77:0/3120921224 conn(0x7f899808af60 msgr2=0x7f899809c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.394+0000 7f1f8f085640 1 -- start start 2023-11-26T07:17:42.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.394+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/2184282611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c0ad910 con 0x7f8e9c0cf450 2023-11-26T07:17:42.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.394+0000 7f899e00e640 1 -- 172.21.15.77:0/3120921224 shutdown_connections 2023-11-26T07:17:42.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.394+0000 7f899e00e640 1 -- 172.21.15.77:0/3120921224 wait complete. 2023-11-26T07:17:42.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.395+0000 7f5dfd861640 1 Processor -- start 2023-11-26T07:17:42.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.395+0000 7f5dfd861640 1 -- start start 2023-11-26T07:17:42.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.395+0000 7f1f8f085640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ca30 0x7f1f881610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.395+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/2184282611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9c0adb30 con 0x7f8e9c0cf450 2023-11-26T07:17:42.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.395+0000 7f1f8f085640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f8814b240 0x7f1f881419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.395+0000 7f1f8f085640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f88145470 0x7f1f88145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.395+0000 7f1f8f085640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f88141f30 con 0x7f1f8806ca30 2023-11-26T07:17:42.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.395+0000 7f1f8f085640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f881fa520 con 0x7f1f8814b240 2023-11-26T07:17:42.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.395+0000 7f1f8f085640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f881fa800 con 0x7f1f88145470 2023-11-26T07:17:42.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.396+0000 7f1f8e083640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ca30 0x7f1f881610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.396+0000 7f1f8e884640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f88145470 0x7f1f88145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.396+0000 7f1f8e083640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ca30 0x7f1f881610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34952/0 (socket says 172.21.15.77:34952) 2023-11-26T07:17:42.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.396+0000 7f1f8e083640 1 -- 172.21.15.77:0/3081759769 learned_addr learned my addr 172.21.15.77:0/3081759769 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:42.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.396+0000 7f899e00e640 1 Processor -- start 2023-11-26T07:17:42.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.396+0000 7f1f8e083640 1 -- 172.21.15.77:0/3081759769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f88145470 msgr2=0x7f1f88145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.396+0000 7f1f8e083640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f88145470 0x7f1f88145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.396+0000 7f1f8e083640 1 -- 172.21.15.77:0/3081759769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f8814b240 msgr2=0x7f1f881419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.396+0000 7f1f8e083640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f8814b240 0x7f1f881419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.396+0000 7f1f8e083640 1 -- 172.21.15.77:0/3081759769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f780094d0 con 0x7f1f8806ca30 2023-11-26T07:17:42.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.397+0000 7f899e00e640 1 -- start start 2023-11-26T07:17:42.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.397+0000 7f1f8e083640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ca30 0x7f1f881610e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c3c0 tx=0x7f1f8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.397+0000 7f5dfd861640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5df80d0320 0x7f5df806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.397+0000 7f5dfd861640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5df80d3160 0x7f5df80d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.397+0000 7f5dfd861640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df80d1ae0 con 0x7f5df80d0700 2023-11-26T07:17:42.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.397+0000 7f5dfd861640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df80d18f0 con 0x7f5df80d3160 2023-11-26T07:17:42.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.397+0000 7f5dfd861640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80d1dc0 con 0x7f5df80d0320 2023-11-26T07:17:42.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f5df77fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5df80d3160 0x7f5df80d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f8e83fff640 1 -- 172.21.15.77:0/2184282611 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e90012c60 con 0x7f8e9c0cf450 2023-11-26T07:17:42.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f5df6ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5df80d0320 0x7f5df806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f5df77fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5df80d3160 0x7f5df80d35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:55322/0 (socket says 172.21.15.77:55322) 2023-11-26T07:17:42.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f5df77fe640 1 -- 172.21.15.77:0/1768536048 learned_addr learned my addr 172.21.15.77:0/1768536048 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:42.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f899e00e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 0x7f89980b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f899e00e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980b87f0 0x7f899815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f899e00e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f899815a550 0x7f89980cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f899e00e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899815c4c0 con 0x7f8984004d00 2023-11-26T07:17:42.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f899e00e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89980b82a0 con 0x7f899815a550 2023-11-26T07:17:42.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f899e00e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899815b1c0 con 0x7f89980b87f0 2023-11-26T07:17:42.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f89977fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 0x7f89980b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f89977fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 0x7f89980b7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34966/0 (socket says 172.21.15.77:34966) 2023-11-26T07:17:42.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f89977fe640 1 -- 172.21.15.77:0/1503189595 learned_addr learned my addr 172.21.15.77:0/1503189595 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:42.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f9e89ffb640 1 -- 172.21.15.77:0/3819256202 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80038640 con 0x7f9e8c0ce450 2023-11-26T07:17:42.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f606f7fe640 1 -- 172.21.15.77:0/1054061536 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6078054a80 con 0x7f608806da40 2023-11-26T07:17:42.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f9e89ffb640 1 -- 172.21.15.77:0/3819256202 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e800387a0 con 0x7f9e8c0ce450 2023-11-26T07:17:42.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f9e89ffb640 1 -- 172.21.15.77:0/3819256202 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80038640 con 0x7f9e8c0ce450 2023-11-26T07:17:42.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f8e83fff640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e8806af10 0x7f8e8806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f8e83fff640 1 -- 172.21.15.77:0/2184282611 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e9008a5c0 con 0x7f8e9c0cf450 2023-11-26T07:17:42.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f8e9affd640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e8806af10 0x7f8e8806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f8997fff640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f899815a550 0x7f89980cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f89977fe640 1 -- 172.21.15.77:0/1503189595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980b87f0 msgr2=0x7f899815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f89977fe640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980b87f0 0x7f899815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f89977fe640 1 -- 172.21.15.77:0/1503189595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f899815a550 msgr2=0x7f89980cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f89977fe640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f899815a550 0x7f89980cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.399+0000 7f89977fe640 1 -- 172.21.15.77:0/1503189595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899815b4a0 con 0x7f8984004d00 2023-11-26T07:17:42.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f5df77fe640 1 -- 172.21.15.77:0/1768536048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5df80d0320 msgr2=0x7f5df806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f5df77fe640 1 --2- 172.21.15.77:0/1768536048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5df80d0320 0x7f5df806bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f5df77fe640 1 -- 172.21.15.77:0/1768536048 >> v1:172.21.15.77:6789/0 conn(0x7f5df80d0700 legacy=0x7f5df80d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.398+0000 7f5df77fe640 1 -- 172.21.15.77:0/1768536048 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80d20a0 con 0x7f5df80d3160 2023-11-26T07:17:42.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.400+0000 7f9e915fb640 1 -- 172.21.15.77:0/3819256202 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e8c0ce450 msgr2=0x7f9e8c0ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.400+0000 7f9e915fb640 1 --2- 172.21.15.77:0/3819256202 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e8c0ce450 0x7f9e8c0ae480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000ba40 tx=0x7f9e80030280 comp rx=0 tx=0).stop 2023-11-26T07:17:42.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.400+0000 7f83917fa640 1 -- 172.21.15.77:0/2622555602 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c03e040 con 0x7f83940b5520 2023-11-26T07:17:42.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.400+0000 7f83917fa640 1 -- 172.21.15.77:0/2622555602 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c039d20 con 0x7f83940b5520 2023-11-26T07:17:42.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.400+0000 7f83917fa640 1 -- 172.21.15.77:0/2622555602 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c044630 con 0x7f83940b5520 2023-11-26T07:17:42.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.400+0000 7f8e9affd640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e8806af10 0x7f8e8806d3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c036000 tx=0x7f8e8c03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.401+0000 7f5df77fe640 1 --2- 172.21.15.77:0/1768536048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5df80d3160 0x7f5df80d35f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009e50 tx=0x7f5df002bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ba99991e89dd0e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.401+0000 7f89977fe640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 0x7f89980b7c10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f898800f5a0 tx=0x7f898800fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.401+0000 7f9e915fb640 1 -- 172.21.15.77:0/3819256202 shutdown_connections 2023-11-26T07:17:42.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.401+0000 7f9e915fb640 1 --2- 172.21.15.77:0/3819256202 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e8c0ce450 0x7f9e8c0ae480 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.401+0000 7f9e915fb640 1 --2- 172.21.15.77:0/3819256202 >> v2:172.21.15.159:3300/0 conn(0x7f9e8c06c560 0x7f9e8c15a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.401+0000 7f9e915fb640 1 -- 172.21.15.77:0/3819256202 >> 172.21.15.77:0/3819256202 conn(0x7f9e8c06a920 msgr2=0x7f9e8c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.401+0000 7f839a7b0640 1 -- 172.21.15.77:0/2622555602 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8394140ce0 con 0x7f83940b5520 2023-11-26T07:17:42.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.401+0000 7f5df67fc640 1 -- 172.21.15.77:0/1768536048 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df002caa0 con 0x7f5df80d3160 2023-11-26T07:17:42.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.401+0000 7f9e915fb640 1 -- 172.21.15.77:0/3819256202 shutdown_connections 2023-11-26T07:17:42.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.402+0000 7f839a7b0640 1 -- 172.21.15.77:0/2622555602 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839406b470 con 0x7f83940b5520 2023-11-26T07:17:42.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.402+0000 7f5df67fc640 1 -- 172.21.15.77:0/1768536048 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df002cc00 con 0x7f5df80d3160 2023-11-26T07:17:42.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.402+0000 7f5df67fc640 1 -- 172.21.15.77:0/1768536048 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00343f0 con 0x7f5df80d3160 2023-11-26T07:17:42.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.402+0000 7f9e915fb640 1 -- 172.21.15.77:0/3819256202 wait complete. 2023-11-26T07:17:42.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.402+0000 7fb40affd640 1 -- 172.21.15.77:0/4254620375 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb40400ccd0 con 0x7fb40c053160 2023-11-26T07:17:42.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.403+0000 7f5dfd861640 1 -- 172.21.15.77:0/1768536048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5df80d3160 msgr2=0x7f5df80d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.403+0000 7f5dfd861640 1 --2- 172.21.15.77:0/1768536048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5df80d3160 0x7f5df80d35f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009e50 tx=0x7f5df002bf00 comp rx=0 tx=0).stop 2023-11-26T07:17:42.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.403+0000 7f5dfd861640 1 -- 172.21.15.77:0/1768536048 shutdown_connections 2023-11-26T07:17:42.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.403+0000 7f5dfd861640 1 --2- 172.21.15.77:0/1768536048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5df80d3160 0x7f5df80d35f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.403+0000 7f5dfd861640 1 --2- 172.21.15.77:0/1768536048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5df80d0320 0x7f5df806bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.403+0000 7f5dfd861640 1 -- 172.21.15.77:0/1768536048 >> 172.21.15.77:0/1768536048 conn(0x7f5df808af60 msgr2=0x7f5df809c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.403+0000 7f839a7b0640 1 -- 172.21.15.77:0/2622555602 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8394141200 con 0x7f83940b5520 2023-11-26T07:17:42.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.403+0000 7f5dfd861640 1 -- 172.21.15.77:0/1768536048 shutdown_connections 2023-11-26T07:17:42.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.403+0000 7fb40affd640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3f806aea0 0x7fb3f806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.404+0000 7fb40affd640 1 -- 172.21.15.77:0/4254620375 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb404089bf0 con 0x7fb40c053160 2023-11-26T07:17:42.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.404+0000 7fb41a145640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3f806aea0 0x7fb3f806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f9e915fb640 1 Processor -- start 2023-11-26T07:17:42.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7fb41a145640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3f806aea0 0x7fb3f806d360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb41003d000 tx=0x7fb410008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f1f7effd640 1 -- 172.21.15.77:0/3081759769 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f840052d0 con 0x7f1f8806ca30 2023-11-26T07:17:42.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f1f7effd640 1 -- 172.21.15.77:0/3081759769 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84005450 con 0x7f1f8806ca30 2023-11-26T07:17:42.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f1f7effd640 1 -- 172.21.15.77:0/3081759769 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84007260 con 0x7f1f8806ca30 2023-11-26T07:17:42.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f1f8f085640 1 -- 172.21.15.77:0/3081759769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f881faae0 con 0x7f1f8806ca30 2023-11-26T07:17:42.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f1f8f085640 1 -- 172.21.15.77:0/3081759769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f881fb0a0 con 0x7f1f8806ca30 2023-11-26T07:17:42.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f8e83fff640 1 -- 172.21.15.77:0/2184282611 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e90055650 con 0x7f8e9c0cf450 2023-11-26T07:17:42.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f9e915fb640 1 -- start start 2023-11-26T07:17:42.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f8994ff9640 1 -- 172.21.15.77:0/1503189595 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988014870 con 0x7f8984004d00 2023-11-26T07:17:42.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f8994ff9640 1 -- 172.21.15.77:0/1503189595 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89880149d0 con 0x7f8984004d00 2023-11-26T07:17:42.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f8994ff9640 1 -- 172.21.15.77:0/1503189595 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988014d40 con 0x7f8984004d00 2023-11-26T07:17:42.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f899e00e640 1 -- 172.21.15.77:0/1503189595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899815b780 con 0x7f8984004d00 2023-11-26T07:17:42.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f899e00e640 1 -- 172.21.15.77:0/1503189595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899815af00 con 0x7f8984004d00 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.403+0000 7f5dfd861640 1 -- 172.21.15.77:0/1768536048 wait complete. 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.405+0000 7f5dfd861640 1 Processor -- start 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.406+0000 7f5dfd861640 1 -- start start 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.407+0000 7f5dfd861640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5df80d0320 0x7f5df80b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.407+0000 7f5dfd861640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5df80d0700 0x7f5df8164660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.407+0000 7f5dfd861640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5df80d3160 0x7f5df80cf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.407+0000 7f5dfd861640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80b6da0 con 0x7f5df80d3160 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.407+0000 7f5dfd861640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80b7080 con 0x7f5df80d0700 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.407+0000 7f5dfd861640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80b7360 con 0x7f5df80d0320 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.408+0000 7f5df6ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5df80d0320 0x7f5df80b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.408+0000 7f5df6ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5df80d0320 0x7f5df80b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45724/0 (socket says 172.21.15.77:45724) 2023-11-26T07:17:42.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.408+0000 7f5df6ffd640 1 -- 172.21.15.77:0/3975765561 learned_addr learned my addr 172.21.15.77:0/3975765561 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:42.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.408+0000 7f5deffff640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5df80d0700 0x7f5df8164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.408+0000 7f5df77fe640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5df80d3160 0x7f5df80cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.408+0000 7f5df77fe640 1 -- 172.21.15.77:0/3975765561 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5df80d0320 msgr2=0x7f5df80b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.408+0000 7f5df77fe640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5df80d0320 0x7f5df80b7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.408+0000 7f5df77fe640 1 -- 172.21.15.77:0/3975765561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5df80d0700 msgr2=0x7f5df8164660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.408+0000 7f5df77fe640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5df80d0700 0x7f5df8164660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.408+0000 7f5df77fe640 1 -- 172.21.15.77:0/3975765561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0009b30 con 0x7f5df80d3160 2023-11-26T07:17:42.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.409+0000 7f8994ff9640 1 -- 172.21.15.77:0/1503189595 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8988015410 con 0x7f8984004d00 2023-11-26T07:17:42.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.409+0000 7f899e00e640 1 -- 172.21.15.77:0/1503189595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899815bca0 con 0x7f8984004d00 2023-11-26T07:17:42.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.409+0000 7f5df77fe640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5df80d3160 0x7f5df80cf190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5df0032000 tx=0x7f5df0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.409+0000 7f1f8f085640 1 -- 172.21.15.77:0/3081759769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f881f6fa0 con 0x7f1f8806ca30 2023-11-26T07:17:42.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.409+0000 7f5df4ff9640 1 -- 172.21.15.77:0/3975765561 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df003e450 con 0x7f5df80d3160 2023-11-26T07:17:42.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.409+0000 7f9e915fb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e8c06c560 0x7f9e8c099b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.409+0000 7f9e915fb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e8c06da40 0x7f9e8c0987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.409+0000 7f9e915fb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0ce450 0x7f9e8c1444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.410+0000 7f9e915fb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c143450 con 0x7f9e8c0ce450 2023-11-26T07:17:42.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.410+0000 7f5dfd861640 1 -- 172.21.15.77:0/3975765561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df80d0d00 con 0x7f5df80d3160 2023-11-26T07:17:42.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.410+0000 7f9e915fb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c143730 con 0x7f9e8c06da40 2023-11-26T07:17:42.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.410+0000 7f9e915fb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c143a10 con 0x7f9e8c06c560 2023-11-26T07:17:42.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.410+0000 7f5dfd861640 1 -- 172.21.15.77:0/3975765561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df80b7920 con 0x7f5df80d3160 2023-11-26T07:17:42.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.410+0000 7f9e8b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0ce450 0x7f9e8c1444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.410+0000 7f9e8b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0ce450 0x7f9e8c1444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34978/0 (socket says 172.21.15.77:34978) 2023-11-26T07:17:42.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.410+0000 7f9e8b7fe640 1 -- 172.21.15.77:0/1553723906 learned_addr learned my addr 172.21.15.77:0/1553723906 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:42.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.410+0000 7f8994ff9640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f897806aec0 0x7f897806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.411+0000 7f9e8b7fe640 1 -- 172.21.15.77:0/1553723906 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e8c06c560 msgr2=0x7f9e8c099b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:17:42.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.411+0000 7f9e8b7fe640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e8c06c560 0x7f9e8c099b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.411+0000 7f9e8b7fe640 1 -- 172.21.15.77:0/1553723906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e8c06da40 msgr2=0x7f9e8c0987f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:17:42.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.411+0000 7f9e8b7fe640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e8c06da40 0x7f9e8c0987f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.411+0000 7f9e8b7fe640 1 -- 172.21.15.77:0/1553723906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8000b6a0 con 0x7f9e8c0ce450 2023-11-26T07:17:42.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.411+0000 7f9e8b7fe640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0ce450 0x7f9e8c1444f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400efc0 tx=0x7f9e8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.411+0000 7f5dfd861640 1 -- 172.21.15.77:0/3975765561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df8067470 con 0x7f5df80d3160 2023-11-26T07:17:42.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.411+0000 7f8994ff9640 1 -- 172.21.15.77:0/1503189595 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f898808a9f0 con 0x7f8984004d00 2023-11-26T07:17:42.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.412+0000 7f898ffff640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f897806aec0 0x7f897806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.413+0000 7f1f7effd640 1 -- 172.21.15.77:0/3081759769 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f840073c0 con 0x7f1f8806ca30 2023-11-26T07:17:42.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.413+0000 7f898ffff640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f897806aec0 0x7f897806d380 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8980009890 tx=0x7f8980008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.414+0000 7f1f7effd640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f6c06ae90 0x7f1f6c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.414+0000 7f1f7effd640 1 -- 172.21.15.77:0/3081759769 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f840887d0 con 0x7f1f8806ca30 2023-11-26T07:17:42.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.415+0000 7fb40affd640 1 -- 172.21.15.77:0/4254620375 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb404054d80 con 0x7fb40c053160 2023-11-26T07:17:42.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.415+0000 7f1f8d882640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f6c06ae90 0x7f1f6c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.416+0000 7f5df4ff9640 1 -- 172.21.15.77:0/3975765561 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df003e5b0 con 0x7f5df80d3160 2023-11-26T07:17:42.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.416+0000 7f9e737fe640 1 -- 172.21.15.77:0/1553723906 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84014480 con 0x7f9e8c0ce450 2023-11-26T07:17:42.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.416+0000 7f9e915fb640 1 -- 172.21.15.77:0/1553723906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c143cf0 con 0x7f9e8c0ce450 2023-11-26T07:17:42.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.416+0000 7f1f8d882640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f6c06ae90 0x7f1f6c06d350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f78036000 tx=0x7f1f78030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.417+0000 7f9e915fb640 1 -- 172.21.15.77:0/1553723906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c09a090 con 0x7f9e8c0ce450 2023-11-26T07:17:42.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.417+0000 7f5df4ff9640 1 -- 172.21.15.77:0/3975765561 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df003e960 con 0x7f5df80d3160 2023-11-26T07:17:42.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.417+0000 7f8994ff9640 1 -- 172.21.15.77:0/1503189595 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f899815bca0 con 0x7f8984004d00 2023-11-26T07:17:42.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.418+0000 7f9e915fb640 1 -- 172.21.15.77:0/1553723906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c144210 con 0x7f9e8c0ce450 2023-11-26T07:17:42.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.416+0000 7f83917fa640 1 -- 172.21.15.77:0/2622555602 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f837c04d3b0 con 0x7f83940b5520 2023-11-26T07:17:42.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.418+0000 7f83917fa640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406af10 0x7f837406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.418+0000 7f83917fa640 1 -- 172.21.15.77:0/2622555602 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f837c0ac090 con 0x7f83940b5520 2023-11-26T07:17:42.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.418+0000 7f838b7fe640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406af10 0x7f837406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.419+0000 7f838b7fe640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406af10 0x7f837406d3d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8394061330 tx=0x7f8384008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.424+0000 7f9e737fe640 1 -- 172.21.15.77:0/1553723906 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8400f040 con 0x7f9e8c0ce450 2023-11-26T07:17:42.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.424+0000 7f9e737fe640 1 -- 172.21.15.77:0/1553723906 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840147e0 con 0x7f9e8c0ce450 2023-11-26T07:17:42.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.424+0000 7f1f7effd640 1 -- 172.21.15.77:0/3081759769 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f881f6fa0 con 0x7f1f8806ca30 2023-11-26T07:17:42.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.426+0000 7f5df4ff9640 1 -- 172.21.15.77:0/3975765561 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5df003eac0 con 0x7f5df80d3160 2023-11-26T07:17:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.427+0000 7f5df4ff9640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5dd806aed0 0x7f5dd806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.427+0000 7f5df4ff9640 1 -- 172.21.15.77:0/3975765561 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5df00ac630 con 0x7f5df80d3160 2023-11-26T07:17:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.427+0000 7f83917fa640 1 -- 172.21.15.77:0/2622555602 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f837c0771d0 con 0x7f83940b5520 2023-11-26T07:17:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.428+0000 7f5df6ffd640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5dd806aed0 0x7f5dd806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.427+0000 7f9e737fe640 1 -- 172.21.15.77:0/1553723906 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e84014940 con 0x7f9e8c0ce450 2023-11-26T07:17:42.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.429+0000 7f9e737fe640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9e7806ae40 0x7f9e7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.429+0000 7f9e8affd640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9e7806ae40 0x7f9e7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.431+0000 7f5df6ffd640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5dd806aed0 0x7f5dd806d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009b90 tx=0x7f5de8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.431+0000 7f9e8affd640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9e7806ae40 0x7f9e7806d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0011e0 tx=0x7f9e7c0078b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.433+0000 7f9e737fe640 1 -- 172.21.15.77:0/1553723906 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e84059b80 con 0x7f9e8c0ce450 2023-11-26T07:17:42.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.435+0000 7f5df4ff9640 1 -- 172.21.15.77:0/3975765561 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5df0077640 con 0x7f5df80d3160 2023-11-26T07:17:42.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.443+0000 7f9e737fe640 1 -- 172.21.15.77:0/1553723906 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e840557c0 con 0x7f9e8c0ce450 2023-11-26T07:17:42.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.812+0000 7f606d7fa640 1 -- 172.21.15.77:0/1054061536 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f60680057d0 con 0x7f608806da40 2023-11-26T07:17:42.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.811+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/2184282611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8e9c0cde80 con 0x7f8e9c0cf450 2023-11-26T07:17:42.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.812+0000 7f8e83fff640 1 -- 172.21.15.77:0/2184282611 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e90058c70 con 0x7f8e9c0cf450 2023-11-26T07:17:42.814 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-11-26T07:17:42.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.812+0000 7f606f7fe640 1 -- 172.21.15.77:0/1054061536 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f60780580a0 con 0x7f608806da40 2023-11-26T07:17:42.817 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2023-11-26T07:17:42.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.815+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/2184282611 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e8806af10 msgr2=0x7f8e8806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.815+0000 7f8ea1d0f640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e8806af10 0x7f8e8806d3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c036000 tx=0x7f8e8c03d040 comp rx=0 tx=0).stop 2023-11-26T07:17:42.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.816+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/2184282611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9c0cf450 msgr2=0x7f8e9c1f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.816+0000 7f8ea1d0f640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9c0cf450 0x7f8e9c1f6510 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000d5f0 tx=0x7f8e9000dab0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.816+0000 7f606d7fa640 1 -- 172.21.15.77:0/1054061536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f607406ae40 msgr2=0x7f607406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.816+0000 7f606d7fa640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f607406ae40 0x7f607406d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6080005c00 tx=0x7f6080009040 comp rx=0 tx=0).stop 2023-11-26T07:17:42.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.816+0000 7f606d7fa640 1 -- 172.21.15.77:0/1054061536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f608806da40 msgr2=0x7f6088099140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.816+0000 7f606d7fa640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f608806da40 0x7f6088099140 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f607800d560 tx=0x7f607800da20 comp rx=0 tx=0).stop 2023-11-26T07:17:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.816+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/2184282611 shutdown_connections 2023-11-26T07:17:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f8ea1d0f640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e8806af10 0x7f8e8806d3d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f8ea1d0f640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e9c15dc80 0x7f8e9c1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f606d7fa640 1 -- 172.21.15.77:0/1054061536 shutdown_connections 2023-11-26T07:17:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f606d7fa640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f607406ae40 0x7f607406d300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f606d7fa640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6088099680 0x7f60881f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f606d7fa640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f608806da40 0x7f6088099140 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f606d7fa640 1 --2- 172.21.15.77:0/1054061536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f608806c560 0x7f608809b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f606d7fa640 1 -- 172.21.15.77:0/1054061536 >> 172.21.15.77:0/1054061536 conn(0x7f608806a920 msgr2=0x7f608806c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f8ea1d0f640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e9c157c70 0x7f8e9c0aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f8ea1d0f640 1 --2- 172.21.15.77:0/2184282611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9c0cf450 0x7f8e9c1f6510 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/2184282611 >> 172.21.15.77:0/2184282611 conn(0x7f8e9c06a920 msgr2=0x7f8e9c0ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f606d7fa640 1 -- 172.21.15.77:0/1054061536 shutdown_connections 2023-11-26T07:17:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f606d7fa640 1 -- 172.21.15.77:0/1054061536 wait complete. 2023-11-26T07:17:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/2184282611 shutdown_connections 2023-11-26T07:17:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.817+0000 7f8ea1d0f640 1 -- 172.21.15.77:0/2184282611 wait complete. 2023-11-26T07:17:42.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.827+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb40c0e46d0 con 0x7fb40c053160 2023-11-26T07:17:42.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.828+0000 7fb40affd640 1 -- 172.21.15.77:0/4254620375 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb404017090 con 0x7fb40c053160 2023-11-26T07:17:42.833 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2023-11-26T07:17:42.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.832+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3f806aea0 msgr2=0x7fb3f806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.832+0000 7fb41b147640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3f806aea0 0x7fb3f806d360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb41003d000 tx=0x7fb410008040 comp rx=0 tx=0).stop 2023-11-26T07:17:42.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.832+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 msgr2=0x7fb40c185980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.832+0000 7fb41b147640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 0x7fb40c185980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb40400e900 tx=0x7fb40400edc0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.833+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 shutdown_connections 2023-11-26T07:17:42.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.833+0000 7fb41b147640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3f806aea0 0x7fb3f806d360 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.833+0000 7fb41b147640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32a0 0x7fb40c0e5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.833+0000 7fb41b147640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb40c053160 0x7fb40c185980 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.833+0000 7f899e00e640 1 -- 172.21.15.77:0/1503189595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f899815bca0 con 0x7f8984004d00 2023-11-26T07:17:42.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.833+0000 7fb41b147640 1 --2- 172.21.15.77:0/4254620375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c04fd80 0x7fb40c0db240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.833+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 >> 172.21.15.77:0/4254620375 conn(0x7fb40c009f80 msgr2=0x7fb40c047dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.834+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 shutdown_connections 2023-11-26T07:17:42.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.834+0000 7fb41b147640 1 -- 172.21.15.77:0/4254620375 wait complete. 2023-11-26T07:17:42.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.834+0000 7f8994ff9640 1 -- 172.21.15.77:0/1503189595 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89880550b0 con 0x7f8984004d00 2023-11-26T07:17:42.837 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2023-11-26T07:17:42.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.838+0000 7f899e00e640 1 -- 172.21.15.77:0/1503189595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f897806aec0 msgr2=0x7f897806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.838+0000 7f899e00e640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f897806aec0 0x7f897806d380 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8980009890 tx=0x7f8980008040 comp rx=0 tx=0).stop 2023-11-26T07:17:42.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.838+0000 7f899e00e640 1 -- 172.21.15.77:0/1503189595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 msgr2=0x7f89980b7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.838+0000 7f899e00e640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 0x7f89980b7c10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f898800f5a0 tx=0x7f898800fa60 comp rx=0 tx=0).stop 2023-11-26T07:17:42.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.839+0000 7f899e00e640 1 -- 172.21.15.77:0/1503189595 shutdown_connections 2023-11-26T07:17:42.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.839+0000 7f899e00e640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f897806aec0 0x7f897806d380 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.839+0000 7f899e00e640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f899815a550 0x7f89980cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.839+0000 7f899e00e640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89980b87f0 0x7f899815bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.839+0000 7f899e00e640 1 --2- 172.21.15.77:0/1503189595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8984004d00 0x7f89980b7c10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.839+0000 7f899e00e640 1 -- 172.21.15.77:0/1503189595 >> 172.21.15.77:0/1503189595 conn(0x7f899808af60 msgr2=0x7f89980ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.841+0000 7f899e00e640 1 -- 172.21.15.77:0/1503189595 shutdown_connections 2023-11-26T07:17:42.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.841+0000 7f899e00e640 1 -- 172.21.15.77:0/1503189595 wait complete. 2023-11-26T07:17:42.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.844+0000 7f839a7b0640 1 -- 172.21.15.77:0/2622555602 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8394140b40 con 0x7f83940b5520 2023-11-26T07:17:42.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.845+0000 7f83917fa640 1 -- 172.21.15.77:0/2622555602 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8394140b40 con 0x7f83940b5520 2023-11-26T07:17:42.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-11-26T07:17:42.848 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2023-11-26T07:17:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.846+0000 7f5dfd861640 1 -- 172.21.15.77:0/3975765561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5df806b750 con 0x7f5df80d3160 2023-11-26T07:17:42.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-11-26T07:17:42.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.846+0000 7f1f8f085640 1 -- 172.21.15.77:0/3081759769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1f881f6fa0 con 0x7f1f8806ca30 2023-11-26T07:17:42.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.846+0000 7f5df4ff9640 1 -- 172.21.15.77:0/3975765561 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5df007ac60 con 0x7f5df80d3160 2023-11-26T07:17:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.847+0000 7f1f7effd640 1 -- 172.21.15.77:0/3081759769 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f881f6fa0 con 0x7f1f8806ca30 2023-11-26T07:17:42.850 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-11-26T07:17:42.850 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2023-11-26T07:17:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.849+0000 7f839a7b0640 1 -- 172.21.15.77:0/2622555602 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406af10 msgr2=0x7f837406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.849+0000 7f839a7b0640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406af10 0x7f837406d3d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8394061330 tx=0x7f8384008040 comp rx=0 tx=0).stop 2023-11-26T07:17:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.849+0000 7f839a7b0640 1 -- 172.21.15.77:0/2622555602 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83940b5520 msgr2=0x7f83941414e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.849+0000 7f839a7b0640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83940b5520 0x7f83941414e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f837c009890 tx=0x7f837c004730 comp rx=0 tx=0).stop 2023-11-26T07:17:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.849+0000 7f839a7b0640 1 -- 172.21.15.77:0/2622555602 shutdown_connections 2023-11-26T07:17:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.849+0000 7f839a7b0640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406af10 0x7f837406d3d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.849+0000 7f839a7b0640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83940cc5b0 0x7f839415fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.849+0000 7f839a7b0640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940cc1d0 0x7f839406af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.849+0000 7f839a7b0640 1 --2- 172.21.15.77:0/2622555602 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83940b5520 0x7f83941414e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f839a7b0640 1 -- 172.21.15.77:0/2622555602 >> 172.21.15.77:0/2622555602 conn(0x7f8394071d40 msgr2=0x7f83940cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f839a7b0640 1 -- 172.21.15.77:0/2622555602 shutdown_connections 2023-11-26T07:17:42.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f839a7b0640 1 -- 172.21.15.77:0/2622555602 wait complete. 2023-11-26T07:17:42.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f1f8f085640 1 -- 172.21.15.77:0/3081759769 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f6c06ae90 msgr2=0x7f1f6c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f1f8f085640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f6c06ae90 0x7f1f6c06d350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f78036000 tx=0x7f1f78030000 comp rx=0 tx=0).stop 2023-11-26T07:17:42.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f1f8f085640 1 -- 172.21.15.77:0/3081759769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ca30 msgr2=0x7f1f881610e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f1f8f085640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ca30 0x7f1f881610e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c3c0 tx=0x7f1f8400c880 comp rx=0 tx=0).stop 2023-11-26T07:17:42.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f5dfd861640 1 -- 172.21.15.77:0/3975765561 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5dd806aed0 msgr2=0x7f5dd806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f5dfd861640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5dd806aed0 0x7f5dd806d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009b90 tx=0x7f5de8008040 comp rx=0 tx=0).stop 2023-11-26T07:17:42.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f5dfd861640 1 -- 172.21.15.77:0/3975765561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5df80d3160 msgr2=0x7f5df80cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f5dfd861640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5df80d3160 0x7f5df80cf190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5df0032000 tx=0x7f5df0004a40 comp rx=0 tx=0).stop 2023-11-26T07:17:42.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f1f8f085640 1 -- 172.21.15.77:0/3081759769 shutdown_connections 2023-11-26T07:17:42.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f1f8f085640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f6c06ae90 0x7f1f6c06d350 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f1f8f085640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f88145470 0x7f1f88145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f1f8f085640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f8814b240 0x7f1f881419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f1f8f085640 1 --2- 172.21.15.77:0/3081759769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ca30 0x7f1f881610e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.850+0000 7f1f8f085640 1 -- 172.21.15.77:0/3081759769 >> 172.21.15.77:0/3081759769 conn(0x7f1f8806dc30 msgr2=0x7f1f88148cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.851+0000 7f5dfd861640 1 -- 172.21.15.77:0/3975765561 shutdown_connections 2023-11-26T07:17:42.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.851+0000 7f5dfd861640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5dd806aed0 0x7f5dd806d390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.851+0000 7f5dfd861640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5df80d3160 0x7f5df80cf190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.851+0000 7f5dfd861640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5df80d0700 0x7f5df8164660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.851+0000 7f5dfd861640 1 --2- 172.21.15.77:0/3975765561 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5df80d0320 0x7f5df80b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.851+0000 7f5dfd861640 1 -- 172.21.15.77:0/3975765561 >> 172.21.15.77:0/3975765561 conn(0x7f5df808af60 msgr2=0x7f5df80b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.851+0000 7f1f8f085640 1 -- 172.21.15.77:0/3081759769 shutdown_connections 2023-11-26T07:17:42.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.851+0000 7f5dfd861640 1 -- 172.21.15.77:0/3975765561 shutdown_connections 2023-11-26T07:17:42.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.851+0000 7f1f8f085640 1 -- 172.21.15.77:0/3081759769 wait complete. 2023-11-26T07:17:42.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.851+0000 7f5dfd861640 1 -- 172.21.15.77:0/3975765561 wait complete. 2023-11-26T07:17:42.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.857+0000 7f9e915fb640 1 -- 172.21.15.77:0/1553723906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9e8c144210 con 0x7f9e8c0ce450 2023-11-26T07:17:42.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.858+0000 7f9e737fe640 1 -- 172.21.15.77:0/1553723906 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e8c144210 con 0x7f9e8c0ce450 2023-11-26T07:17:42.859 INFO:teuthology.orchestra.run.smithi077.stdout:55834574852 2023-11-26T07:17:42.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.861+0000 7f9e915fb640 1 -- 172.21.15.77:0/1553723906 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9e7806ae40 msgr2=0x7f9e7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.861+0000 7f9e915fb640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9e7806ae40 0x7f9e7806d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0011e0 tx=0x7f9e7c0078b0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.861+0000 7f9e915fb640 1 -- 172.21.15.77:0/1553723906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0ce450 msgr2=0x7f9e8c1444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.861+0000 7f9e915fb640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0ce450 0x7f9e8c1444f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400efc0 tx=0x7f9e8400c490 comp rx=0 tx=0).stop 2023-11-26T07:17:42.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-11-26T07:17:42.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.861+0000 7f9e915fb640 1 -- 172.21.15.77:0/1553723906 shutdown_connections 2023-11-26T07:17:42.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.861+0000 7f9e915fb640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9e7806ae40 0x7f9e7806d300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.861+0000 7f9e915fb640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0ce450 0x7f9e8c1444f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.861+0000 7f9e915fb640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e8c06da40 0x7f9e8c0987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.861+0000 7f9e915fb640 1 --2- 172.21.15.77:0/1553723906 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e8c06c560 0x7f9e8c099b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.861+0000 7f9e915fb640 1 -- 172.21.15.77:0/1553723906 >> 172.21.15.77:0/1553723906 conn(0x7f9e8c06a920 msgr2=0x7f9e8c15caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.862+0000 7f9e915fb640 1 -- 172.21.15.77:0/1553723906 shutdown_connections 2023-11-26T07:17:42.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:42.862+0000 7f9e915fb640 1 -- 172.21.15.77:0/1553723906 wait complete. 2023-11-26T07:17:42.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-11-26T07:17:42.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-11-26T07:17:42.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-26T07:17:42.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-11-26T07:17:42.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-11-26T07:17:43.849 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-26T07:17:43.849 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-26T07:17:43.865 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-26T07:17:43.871 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-26T07:17:43.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-26T07:17:43.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-26T07:17:43.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-26T07:17:43.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-26T07:17:44.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.120+0000 7fb8c149b640 1 Processor -- start 2023-11-26T07:17:44.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.120+0000 7fb8c149b640 1 -- start start 2023-11-26T07:17:44.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.122+0000 7fb8c149b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b40e7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.122+0000 7fb8c149b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb8b4053c70 0x7fb8b40540e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.122+0000 7fb8c149b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b4054620 con 0x7fb8b403c060 2023-11-26T07:17:44.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.122+0000 7fb8c149b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b4007b30 con 0x7fb8b4053c70 2023-11-26T07:17:44.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.122+0000 7fb8c149b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40587d0 con 0x7fb8b40e3120 2023-11-26T07:17:44.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.123+0000 7fb8baffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b40e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.123+0000 7fb8baffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b40e7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45746/0 (socket says 172.21.15.77:45746) 2023-11-26T07:17:44.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.123+0000 7fb8baffd640 1 -- 172.21.15.77:0/932391057 learned_addr learned my addr 172.21.15.77:0/932391057 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.124+0000 7fb8bb7fe640 1 --2- 172.21.15.77:0/932391057 >> v2:172.21.15.159:3300/0 conn(0x7fb8b4053c70 0x7fb8b40540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.124+0000 7f12fe5d4640 1 Processor -- start 2023-11-26T07:17:44.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.125+0000 7fb8baffd640 1 -- 172.21.15.77:0/932391057 >> v2:172.21.15.159:3300/0 conn(0x7fb8b4053c70 msgr2=0x7fb8b40540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:44.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.125+0000 7fb8baffd640 1 --2- 172.21.15.77:0/932391057 >> v2:172.21.15.159:3300/0 conn(0x7fb8b4053c70 0x7fb8b40540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.125+0000 7fb8baffd640 1 -- 172.21.15.77:0/932391057 >> v1:172.21.15.77:6789/0 conn(0x7fb8b403c060 legacy=0x7fb8b4058010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.125+0000 7fb8baffd640 1 -- 172.21.15.77:0/932391057 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4058ab0 con 0x7fb8b40e3120 2023-11-26T07:17:44.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.124+0000 7f12fe5d4640 1 -- start start 2023-11-26T07:17:44.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.126+0000 7f12fe5d4640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f12f00e76e0 0x7f12f004ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.126+0000 7f12fe5d4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f0057d60 con 0x7f12f0053c10 2023-11-26T07:17:44.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.126+0000 7f12fe5d4640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f0006230 con 0x7f12f0058990 2023-11-26T07:17:44.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.126+0000 7f12fe5d4640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f0006510 con 0x7f12f00e76e0 2023-11-26T07:17:44.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.127+0000 7fb8baffd640 1 --2- 172.21.15.77:0/932391057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b40e7740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009870 tx=0x7fb8ac02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb61d412d9d0679a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.127+0000 7f12fd5d2640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f12f00e76e0 0x7f12f004ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.127+0000 7f12fddd3640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f12f0053c10 0x7f12f0006ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54414/0 (socket says 172.21.15.77:54414) 2023-11-26T07:17:44.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.127+0000 7f12fddd3640 1 -- 172.21.15.77:0/364607028 learned_addr learned my addr 172.21.15.77:0/364607028 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:44.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.128+0000 7fb8b9ffb640 1 -- 172.21.15.77:0/932391057 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac030840 con 0x7fb8b40e3120 2023-11-26T07:17:44.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.128+0000 7f12effff640 1 -- 172.21.15.77:0/364607028 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681307607 0 0) 0x7f12f0006230 con 0x7f12f0058990 2023-11-26T07:17:44.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.128+0000 7f12effff640 1 -- 172.21.15.77:0/364607028 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12e4003520 con 0x7f12f0058990 2023-11-26T07:17:44.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.128+0000 7fb8b9ffb640 1 -- 172.21.15.77:0/932391057 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac0309a0 con 0x7fb8b40e3120 2023-11-26T07:17:44.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.128+0000 7fb8b9ffb640 1 -- 172.21.15.77:0/932391057 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac030d30 con 0x7fb8b40e3120 2023-11-26T07:17:44.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.129+0000 7f12fd5d2640 1 -- 172.21.15.77:0/364607028 >> v1:172.21.15.159:6789/0 conn(0x7f12f0058990 legacy=0x7f12f0053500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.130+0000 7fb8c149b640 1 -- 172.21.15.77:0/932391057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 msgr2=0x7fb8b40e7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.130+0000 7fb8c149b640 1 --2- 172.21.15.77:0/932391057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b40e7740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009870 tx=0x7fb8ac02b980 comp rx=0 tx=0).stop 2023-11-26T07:17:44.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.130+0000 7fb8c149b640 1 -- 172.21.15.77:0/932391057 shutdown_connections 2023-11-26T07:17:44.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.130+0000 7fb8c149b640 1 --2- 172.21.15.77:0/932391057 >> v2:172.21.15.159:3300/0 conn(0x7fb8b4053c70 0x7fb8b40540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.130+0000 7fb8c149b640 1 --2- 172.21.15.77:0/932391057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b40e7740 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.130+0000 7fb8c149b640 1 -- 172.21.15.77:0/932391057 >> 172.21.15.77:0/932391057 conn(0x7fb8b4058ea0 msgr2=0x7fb8b4059280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.130+0000 7fb8c149b640 1 -- 172.21.15.77:0/932391057 shutdown_connections 2023-11-26T07:17:44.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.130+0000 7fb8c149b640 1 -- 172.21.15.77:0/932391057 wait complete. 2023-11-26T07:17:44.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.129+0000 7f12fd5d2640 1 -- 172.21.15.77:0/364607028 >> v1:172.21.15.77:6789/0 conn(0x7f12f0053c10 legacy=0x7f12f0006ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.129+0000 7f12fd5d2640 1 -- 172.21.15.77:0/364607028 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f00067f0 con 0x7f12f00e76e0 2023-11-26T07:17:44.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.131+0000 7f12fd5d2640 1 --2- 172.21.15.77:0/364607028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f00e76e0 0x7f12f004ca00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12f40097a0 tx=0x7f12f402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69a7f1dafb50aeed server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.132+0000 7f12effff640 1 -- 172.21.15.77:0/364607028 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4033640 con 0x7f12f00e76e0 2023-11-26T07:17:44.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.132+0000 7f12effff640 1 -- 172.21.15.77:0/364607028 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f40337a0 con 0x7f12f00e76e0 2023-11-26T07:17:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.132+0000 7f12effff640 1 -- 172.21.15.77:0/364607028 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4033b70 con 0x7f12f00e76e0 2023-11-26T07:17:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.133+0000 7f31d7ee0640 1 Processor -- start 2023-11-26T07:17:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.133+0000 7f12fe5d4640 1 -- 172.21.15.77:0/364607028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f00e76e0 msgr2=0x7f12f004ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.133+0000 7f12fe5d4640 1 --2- 172.21.15.77:0/364607028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f00e76e0 0x7f12f004ca00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12f40097a0 tx=0x7f12f402b7a0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.134+0000 7fb8c149b640 1 Processor -- start 2023-11-26T07:17:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.134+0000 7fb8c149b640 1 -- start start 2023-11-26T07:17:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.133+0000 7f31d7ee0640 1 -- start start 2023-11-26T07:17:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.135+0000 7f31d7ee0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f31d015b450 0x7f31d00cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.135+0000 7f31d7ee0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31d00cffb0 0x7f31d00cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.135+0000 7f31d7ee0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d00cda70 con 0x7f31d00d0b10 2023-11-26T07:17:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.135+0000 7f31d7ee0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d0070180 con 0x7f31d015b450 2023-11-26T07:17:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.135+0000 7f31d7ee0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0070460 con 0x7f31d00cffb0 2023-11-26T07:17:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.136+0000 7f12fe5d4640 1 -- 172.21.15.77:0/364607028 shutdown_connections 2023-11-26T07:17:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.136+0000 7f12fe5d4640 1 --2- 172.21.15.77:0/364607028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f00e76e0 0x7f12f004ca00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.136+0000 7f12fe5d4640 1 -- 172.21.15.77:0/364607028 >> 172.21.15.77:0/364607028 conn(0x7f12f0058eb0 msgr2=0x7f12f0059290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.136+0000 7f31d5c7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f31d015b450 0x7f31d00cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.136+0000 7f31d5c7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f31d015b450 0x7f31d00cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34986/0 (socket says 172.21.15.77:34986) 2023-11-26T07:17:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.136+0000 7f31d5c7c640 1 -- 172.21.15.77:0/3605807571 learned_addr learned my addr 172.21.15.77:0/3605807571 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.136+0000 7f12fe5d4640 1 -- 172.21.15.77:0/364607028 shutdown_connections 2023-11-26T07:17:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.136+0000 7f12fe5d4640 1 -- 172.21.15.77:0/364607028 wait complete. 2023-11-26T07:17:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.136+0000 7f31d647d640 1 --2- 172.21.15.77:0/3605807571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31d00cffb0 0x7f31d00cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.137+0000 7f31d4c7a640 1 -- 172.21.15.77:0/3605807571 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373906252 0 0) 0x7f31d00cda70 con 0x7f31d00d0b10 2023-11-26T07:17:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.137+0000 7f31d4c7a640 1 -- 172.21.15.77:0/3605807571 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31bc003520 con 0x7f31d00d0b10 2023-11-26T07:17:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.138+0000 7f31d4c7a640 1 -- 172.21.15.77:0/3605807571 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1124792592 0 0) 0x7f31bc003520 con 0x7f31d00d0b10 2023-11-26T07:17:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.138+0000 7f31d5c7c640 1 -- 172.21.15.77:0/3605807571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31d00cffb0 msgr2=0x7f31d00cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.138+0000 7f31d5c7c640 1 --2- 172.21.15.77:0/3605807571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31d00cffb0 0x7f31d00cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.139+0000 7f12fe5d4640 1 Processor -- start 2023-11-26T07:17:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.139+0000 7f12fe5d4640 1 -- start start 2023-11-26T07:17:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.139+0000 7f31d5c7c640 1 -- 172.21.15.77:0/3605807571 >> v1:172.21.15.77:6789/0 conn(0x7f31d00d0b10 legacy=0x7f31d015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7fb8c149b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b403c060 0x7fb8b40e4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7fb8c149b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b4053c70 0x7fb8b40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7fb8c149b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b4051f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7fb8c149b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40e5b60 con 0x7fb8b4053c70 2023-11-26T07:17:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7fb8c149b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40e48f0 con 0x7fb8b403c060 2023-11-26T07:17:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7fb8c149b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40e4d10 con 0x7fb8b40e3120 2023-11-26T07:17:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7f12fe5d4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f0053c10 0x7f12f00e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7f12fe5d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12f0058990 0x7f12f003d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7f12fe5d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f00e76e0 0x7f12f00e0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7f12fe5d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f00e9780 con 0x7f12f0058990 2023-11-26T07:17:44.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7f12fe5d4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f00e9a60 con 0x7f12f00e76e0 2023-11-26T07:17:44.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.140+0000 7f12fe5d4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f00e9d40 con 0x7f12f0053c10 2023-11-26T07:17:44.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.139+0000 7f31d5c7c640 1 -- 172.21.15.77:0/3605807571 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d0070740 con 0x7f31d015b450 2023-11-26T07:17:44.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.141+0000 7f12fd5d2640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f0053c10 0x7f12f00e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.141+0000 7f12fd5d2640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f0053c10 0x7f12f00e9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45764/0 (socket says 172.21.15.77:45764) 2023-11-26T07:17:44.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.141+0000 7f12fd5d2640 1 -- 172.21.15.77:0/2814192024 learned_addr learned my addr 172.21.15.77:0/2814192024 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.141+0000 7f12fddd3640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f00e76e0 0x7f12f00e0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.142+0000 7fb8bb7fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b4051f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.142+0000 7fb8ba7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b4053c70 0x7fb8b40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.142+0000 7fb8bb7fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b4051f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45766/0 (socket says 172.21.15.77:45766) 2023-11-26T07:17:44.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.142+0000 7fb8bb7fe640 1 -- 172.21.15.77:0/3275002656 learned_addr learned my addr 172.21.15.77:0/3275002656 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.142+0000 7f12fd5d2640 1 -- 172.21.15.77:0/2814192024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f00e76e0 msgr2=0x7f12f00e0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.142+0000 7f12fd5d2640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f00e76e0 0x7f12f00e0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.142+0000 7f12fd5d2640 1 -- 172.21.15.77:0/2814192024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12f0058990 msgr2=0x7f12f003d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.142+0000 7f12fd5d2640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12f0058990 0x7f12f003d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.142+0000 7f12fd5d2640 1 -- 172.21.15.77:0/2814192024 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4009400 con 0x7f12f0053c10 2023-11-26T07:17:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.143+0000 7fb8baffd640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b403c060 0x7fb8b40e4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.143+0000 7fb8bb7fe640 1 -- 172.21.15.77:0/3275002656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b403c060 msgr2=0x7fb8b40e4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.143+0000 7fb8bb7fe640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b403c060 0x7fb8b40e4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.143+0000 7fb8bb7fe640 1 -- 172.21.15.77:0/3275002656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b4053c70 msgr2=0x7fb8b40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.143+0000 7f12fd5d2640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f0053c10 0x7f12f00e9130 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12f40098c0 tx=0x7f12f40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.143+0000 7f12edffb640 1 -- 172.21.15.77:0/2814192024 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4030a80 con 0x7f12f0053c10 2023-11-26T07:17:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.143+0000 7f31d5c7c640 1 --2- 172.21.15.77:0/3605807571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d015b450 0x7f31d00cb940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009870 tx=0x7f31c002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f849452843958806 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.144+0000 7f12fe5d4640 1 -- 172.21.15.77:0/2814192024 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f00ea020 con 0x7f12f0053c10 2023-11-26T07:17:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.144+0000 7f12edffb640 1 -- 172.21.15.77:0/2814192024 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f4030be0 con 0x7f12f0053c10 2023-11-26T07:17:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.143+0000 7fb8bb7fe640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b4053c70 0x7fb8b40cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.143+0000 7fb8bb7fe640 1 -- 172.21.15.77:0/3275002656 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0094d0 con 0x7fb8b40e3120 2023-11-26T07:17:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.144+0000 7fb8baffd640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b403c060 0x7fb8b40e4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.144+0000 7f31d4c7a640 1 -- 172.21.15.77:0/3605807571 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc001650 con 0x7f31d015b450 2023-11-26T07:17:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.144+0000 7f31d4c7a640 1 -- 172.21.15.77:0/3605807571 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c0031540 con 0x7f31d015b450 2023-11-26T07:17:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.144+0000 7f31d4c7a640 1 -- 172.21.15.77:0/3605807571 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00318d0 con 0x7f31d015b450 2023-11-26T07:17:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.144+0000 7f12edffb640 1 -- 172.21.15.77:0/2814192024 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f403e480 con 0x7f12f0053c10 2023-11-26T07:17:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.144+0000 7fb8ba7fc640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b4053c70 0x7fb8b40cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.145+0000 7fb8bb7fe640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b4051f80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc079ba0 tx=0x7fb8bc06b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.144+0000 7f12fe5d4640 1 -- 172.21.15.77:0/2814192024 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f003d590 con 0x7f12f0053c10 2023-11-26T07:17:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.145+0000 7fb8a37fe640 1 -- 172.21.15.77:0/3275002656 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc0725d0 con 0x7fb8b40e3120 2023-11-26T07:17:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.145+0000 7fb8a37fe640 1 -- 172.21.15.77:0/3275002656 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc072730 con 0x7fb8b40e3120 2023-11-26T07:17:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.145+0000 7fb8a37fe640 1 -- 172.21.15.77:0/3275002656 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc072ae0 con 0x7fb8b40e3120 2023-11-26T07:17:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.146+0000 7fb8c149b640 1 -- 172.21.15.77:0/3275002656 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b40e3fb0 con 0x7fb8b40e3120 2023-11-26T07:17:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.147+0000 7f31d7ee0640 1 -- 172.21.15.77:0/3605807571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d015b450 msgr2=0x7f31d00cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.147+0000 7f31d7ee0640 1 --2- 172.21.15.77:0/3605807571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d015b450 0x7f31d00cb940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009870 tx=0x7f31c002b860 comp rx=0 tx=0).stop 2023-11-26T07:17:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.146+0000 7fb8c149b640 1 -- 172.21.15.77:0/3275002656 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b40e4230 con 0x7fb8b40e3120 2023-11-26T07:17:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.147+0000 7fb8c149b640 1 -- 172.21.15.77:0/3275002656 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b40e4a30 con 0x7fb8b40e3120 2023-11-26T07:17:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.148+0000 7f31d7ee0640 1 -- 172.21.15.77:0/3605807571 shutdown_connections 2023-11-26T07:17:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.148+0000 7f31d7ee0640 1 --2- 172.21.15.77:0/3605807571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31d00cffb0 0x7f31d00cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.148+0000 7f31d7ee0640 1 --2- 172.21.15.77:0/3605807571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d015b450 0x7f31d00cb940 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.148+0000 7f31d7ee0640 1 -- 172.21.15.77:0/3605807571 >> 172.21.15.77:0/3605807571 conn(0x7f31d006e7f0 msgr2=0x7f31d006ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.148+0000 7f31d7ee0640 1 -- 172.21.15.77:0/3605807571 shutdown_connections 2023-11-26T07:17:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.148+0000 7f31d7ee0640 1 -- 172.21.15.77:0/3605807571 wait complete. 2023-11-26T07:17:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.150+0000 7f12edffb640 1 -- 172.21.15.77:0/2814192024 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f12f403a040 con 0x7f12f0053c10 2023-11-26T07:17:44.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.150+0000 7f12e37fe640 1 -- 172.21.15.77:0/2814192024 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f0005360 con 0x7f12f0053c10 2023-11-26T07:17:44.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.151+0000 7fb8a37fe640 1 -- 172.21.15.77:0/3275002656 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8bc074940 con 0x7fb8b40e3120 2023-11-26T07:17:44.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.152+0000 7f31d7ee0640 1 Processor -- start 2023-11-26T07:17:44.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.152+0000 7f12edffb640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12dc06ae40 0x7f12dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.152+0000 7f31d7ee0640 1 -- start start 2023-11-26T07:17:44.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.152+0000 7f12edffb640 1 -- 172.21.15.77:0/2814192024 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12f40ab840 con 0x7f12f0053c10 2023-11-26T07:17:44.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.153+0000 7f12fcdd1640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12dc06ae40 0x7f12dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.152+0000 7fb8a37fe640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8a806ae90 0x7fb8a806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.153+0000 7fb8a37fe640 1 -- 172.21.15.77:0/3275002656 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8bc1035e0 con 0x7fb8b40e3120 2023-11-26T07:17:44.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.154+0000 7fb8baffd640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8a806ae90 0x7fb8a806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.154+0000 7f31d7ee0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d00cffb0 0x7f31d0159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.154+0000 7f31d7ee0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31d00d0b10 0x7f31d00b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.154+0000 7f31d7ee0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d015b450 0x7f31d015f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.154+0000 7f31d7ee0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00b4ce0 con 0x7f31d00cffb0 2023-11-26T07:17:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.155+0000 7f31d7ee0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d015a420 con 0x7f31d015b450 2023-11-26T07:17:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.155+0000 7f31d5c7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d00cffb0 0x7f31d0159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.155+0000 7f31d5c7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d00cffb0 0x7f31d0159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35002/0 (socket says 172.21.15.77:35002) 2023-11-26T07:17:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.155+0000 7f31d5c7c640 1 -- 172.21.15.77:0/536968984 learned_addr learned my addr 172.21.15.77:0/536968984 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.155+0000 7f31d647d640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d015b450 0x7f31d015f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.155+0000 7f31d547b640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31d00d0b10 0x7f31d00b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.155+0000 7f31d7ee0640 1 -- 172.21.15.77:0/536968984 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00b40d0 con 0x7f31d00d0b10 2023-11-26T07:17:44.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.156+0000 7f12fcdd1640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12dc06ae40 0x7f12dc06d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12e80010e0 tx=0x7f12e8007950 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.156+0000 7f31d5c7c640 1 -- 172.21.15.77:0/536968984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31d00d0b10 msgr2=0x7f31d00b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.156+0000 7f31d5c7c640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31d00d0b10 0x7f31d00b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.156+0000 7f31d5c7c640 1 -- 172.21.15.77:0/536968984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d015b450 msgr2=0x7f31d015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.156+0000 7f31d5c7c640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d015b450 0x7f31d015f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.156+0000 7f31d5c7c640 1 -- 172.21.15.77:0/536968984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c00094d0 con 0x7f31d00cffb0 2023-11-26T07:17:44.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.156+0000 7f31d647d640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d015b450 0x7f31d015f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:44.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.157+0000 7fb8baffd640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8a806ae90 0x7fb8a806d350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac036000 tx=0x7fb8ac03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.157+0000 7f31d5c7c640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d00cffb0 0x7f31d0159ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009870 tx=0x7f31c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.157+0000 7f31c67fc640 1 -- 172.21.15.77:0/536968984 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0033a60 con 0x7f31d00cffb0 2023-11-26T07:17:44.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.157+0000 7f31d7ee0640 1 -- 172.21.15.77:0/536968984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d00b43b0 con 0x7f31d00cffb0 2023-11-26T07:17:44.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.158+0000 7f31d7ee0640 1 -- 172.21.15.77:0/536968984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d00b4970 con 0x7f31d00cffb0 2023-11-26T07:17:44.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.158+0000 7f31c67fc640 1 -- 172.21.15.77:0/536968984 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c0033bc0 con 0x7f31d00cffb0 2023-11-26T07:17:44.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.158+0000 7f31c67fc640 1 -- 172.21.15.77:0/536968984 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0033a60 con 0x7f31d00cffb0 2023-11-26T07:17:44.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.162+0000 7f31d7ee0640 1 -- 172.21.15.77:0/536968984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d0067470 con 0x7f31d00cffb0 2023-11-26T07:17:44.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.162+0000 7f31c67fc640 1 -- 172.21.15.77:0/536968984 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31c003a040 con 0x7f31d00cffb0 2023-11-26T07:17:44.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.163+0000 7fb8a37fe640 1 -- 172.21.15.77:0/3275002656 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8bc0ce8b0 con 0x7fb8b40e3120 2023-11-26T07:17:44.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.164+0000 7f31c67fc640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31b406aea0 0x7f31b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.165+0000 7f31c67fc640 1 -- 172.21.15.77:0/536968984 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31c00aaad0 con 0x7f31d00cffb0 2023-11-26T07:17:44.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.167+0000 7f31d547b640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31b406aea0 0x7f31b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.169+0000 7f31d547b640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31b406aea0 0x7f31b406d360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31cc001eb0 tx=0x7f31cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.172+0000 7f31c67fc640 1 -- 172.21.15.77:0/536968984 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31c0075bf0 con 0x7f31d00cffb0 2023-11-26T07:17:44.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.176+0000 7f12edffb640 1 -- 172.21.15.77:0/2814192024 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f12f4076ac0 con 0x7f12f0053c10 2023-11-26T07:17:44.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.202+0000 7fd0208d3640 1 Processor -- start 2023-11-26T07:17:44.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.202+0000 7fd0208d3640 1 -- start start 2023-11-26T07:17:44.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.204+0000 7fd0208d3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd01c1609e0 0x7fd01c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.205+0000 7fd0208d3640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd01c0ce010 0x7fd01c0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.205+0000 7fd0208d3640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01c06c1f0 con 0x7fd01c0d31a0 2023-11-26T07:17:44.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.205+0000 7fd0208d3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c0d1070 con 0x7fd01c1609e0 2023-11-26T07:17:44.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.205+0000 7fd0208d3640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c0cedc0 con 0x7fd01c0ce010 2023-11-26T07:17:44.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.205+0000 7fd01ad9d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd01c0ce010 0x7fd01c0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.206+0000 7fd01ad9d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd01c0ce010 0x7fd01c0ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:55384/0 (socket says 172.21.15.77:55384) 2023-11-26T07:17:44.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.206+0000 7fd01ad9d640 1 -- 172.21.15.77:0/3967065509 learned_addr learned my addr 172.21.15.77:0/3967065509 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.206+0000 7fd01a59c640 1 --2- 172.21.15.77:0/3967065509 >> v2:172.21.15.77:3300/0 conn(0x7fd01c1609e0 0x7fd01c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.206+0000 7fd01a59c640 1 -- 172.21.15.77:0/3967065509 >> v2:172.21.15.159:3300/0 conn(0x7fd01c0ce010 msgr2=0x7fd01c0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:44.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.206+0000 7fd01a59c640 1 --2- 172.21.15.77:0/3967065509 >> v2:172.21.15.159:3300/0 conn(0x7fd01c0ce010 0x7fd01c0ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.206+0000 7fd01a59c640 1 -- 172.21.15.77:0/3967065509 >> v1:172.21.15.77:6789/0 conn(0x7fd01c0d31a0 legacy=0x7fd01c0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.206+0000 7fd01a59c640 1 -- 172.21.15.77:0/3967065509 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c0cf0a0 con 0x7fd01c1609e0 2023-11-26T07:17:44.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.208+0000 7fd01a59c640 1 --2- 172.21.15.77:0/3967065509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd01c1609e0 0x7fd01c06bcb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0b2b20 tx=0x7fd01002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67094ef28c189b88 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.209+0000 7fd01959a640 1 -- 172.21.15.77:0/3967065509 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010031830 con 0x7fd01c1609e0 2023-11-26T07:17:44.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.209+0000 7fd01959a640 1 -- 172.21.15.77:0/3967065509 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd010031990 con 0x7fd01c1609e0 2023-11-26T07:17:44.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.210+0000 7fd0208d3640 1 -- 172.21.15.77:0/3967065509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd01c1609e0 msgr2=0x7fd01c06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.210+0000 7fd0208d3640 1 --2- 172.21.15.77:0/3967065509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd01c1609e0 0x7fd01c06bcb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0b2b20 tx=0x7fd01002b8d0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.210+0000 7fd0208d3640 1 -- 172.21.15.77:0/3967065509 shutdown_connections 2023-11-26T07:17:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.210+0000 7fd0208d3640 1 --2- 172.21.15.77:0/3967065509 >> v2:172.21.15.159:3300/0 conn(0x7fd01c0ce010 0x7fd01c0ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.210+0000 7fd0208d3640 1 --2- 172.21.15.77:0/3967065509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd01c1609e0 0x7fd01c06bcb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.210+0000 7fd0208d3640 1 -- 172.21.15.77:0/3967065509 >> 172.21.15.77:0/3967065509 conn(0x7fd01c08af60 msgr2=0x7fd01c09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.211+0000 7fd0208d3640 1 -- 172.21.15.77:0/3967065509 shutdown_connections 2023-11-26T07:17:44.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.211+0000 7f8b5d809640 1 Processor -- start 2023-11-26T07:17:44.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.211+0000 7f8b5d809640 1 -- start start 2023-11-26T07:17:44.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.211+0000 7fd0208d3640 1 -- 172.21.15.77:0/3967065509 wait complete. 2023-11-26T07:17:44.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.213+0000 7f909069b640 1 Processor -- start 2023-11-26T07:17:44.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.213+0000 7f909069b640 1 -- start start 2023-11-26T07:17:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.213+0000 7f8b5d809640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806da40 0x7f8b580ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.213+0000 7f8b5d809640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8b5806c560 0x7f8b5815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.213+0000 7f8b5d809640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b580cff70 con 0x7f8b580ce450 2023-11-26T07:17:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.213+0000 7f8b5d809640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b580b3970 con 0x7f8b5806c560 2023-11-26T07:17:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.213+0000 7f8b5d809640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580b3c50 con 0x7f8b5806da40 2023-11-26T07:17:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.214+0000 7f8b4e7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8b580ce450 0x7f8b5806de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54444/0 (socket says 172.21.15.77:54444) 2023-11-26T07:17:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.214+0000 7f8b4e7fc640 1 -- 172.21.15.77:0/1948186326 learned_addr learned my addr 172.21.15.77:0/1948186326 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.214+0000 7f8b577fe640 1 --2- 172.21.15.77:0/1948186326 >> v2:172.21.15.159:3300/0 conn(0x7f8b5806c560 0x7f8b5815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.214+0000 7f8b56ffd640 1 --2- 172.21.15.77:0/1948186326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806da40 0x7f8b580ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.215+0000 7fd0208d3640 1 Processor -- start 2023-11-26T07:17:44.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.215+0000 7f8b567fc640 1 -- 172.21.15.77:0/1948186326 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008234919 0 0) 0x7f8b580cff70 con 0x7f8b580ce450 2023-11-26T07:17:44.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.215+0000 7fd0208d3640 1 -- start start 2023-11-26T07:17:44.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.215+0000 7f909069b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880ce010 0x7f90880ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.215+0000 7f909069b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90880d1070 con 0x7f90881609e0 2023-11-26T07:17:44.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.215+0000 7f909069b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90880cedc0 con 0x7f90880d31a0 2023-11-26T07:17:44.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.215+0000 7f909069b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90880cf0a0 con 0x7f90880ce010 2023-11-26T07:17:44.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.216+0000 7f908e437640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f90881609e0 0x7f908806bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54448/0 (socket says 172.21.15.77:54448) 2023-11-26T07:17:44.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.216+0000 7f908e437640 1 -- 172.21.15.77:0/2692681777 learned_addr learned my addr 172.21.15.77:0/2692681777 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:44.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.215+0000 7f8b577fe640 1 -- 172.21.15.77:0/1948186326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806da40 msgr2=0x7f8b580ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:44.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.215+0000 7f8b577fe640 1 --2- 172.21.15.77:0/1948186326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806da40 0x7f8b580ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.215+0000 7f8b577fe640 1 -- 172.21.15.77:0/1948186326 >> v1:172.21.15.77:6789/0 conn(0x7f8b580ce450 legacy=0x7f8b5806de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.215+0000 7f8b577fe640 1 -- 172.21.15.77:0/1948186326 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580b3f30 con 0x7f8b5806c560 2023-11-26T07:17:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7f908ec38640 1 --2- 172.21.15.77:0/2692681777 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880ce010 0x7f90880ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25961683 0 0) 0x7f90880d1070 con 0x7f90881609e0 2023-11-26T07:17:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9074003520 con 0x7f90881609e0 2023-11-26T07:17:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7fd0208d3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd01c0ce010 0x7fd01c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7f8b577fe640 1 --2- 172.21.15.77:0/1948186326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5806c560 0x7f8b5815a2d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009fb0 tx=0x7f8b5002dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc439c3a047fa511 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7fd0208d3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd01c0d31a0 0x7fd01c0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3290621963 0 0) 0x7f9074003520 con 0x7f90881609e0 2023-11-26T07:17:44.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880ce010 msgr2=0x7f90880ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:44.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7f908d435640 1 --2- 172.21.15.77:0/2692681777 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880ce010 0x7f90880ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 >> v1:172.21.15.159:6789/0 conn(0x7f90880d31a0 legacy=0x7f90880d3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90880d1310 con 0x7f90881609e0 2023-11-26T07:17:44.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f90800019f0 con 0x7f90881609e0 2023-11-26T07:17:44.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.217+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 >> v1:172.21.15.77:6789/0 conn(0x7f90881609e0 legacy=0x7f908806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7fd0208d3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd01c0b6510 0x7fd01c0b8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7fd01a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd01c0ce010 0x7fd01c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7fd01a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd01c0ce010 0x7fd01c15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:55398/0 (socket says 172.21.15.77:55398) 2023-11-26T07:17:44.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7fd019d9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd01c0d31a0 0x7fd01c0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c15ca60 con 0x7fd01c0b6510 2023-11-26T07:17:44.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c0b6b40 con 0x7fd01c0ce010 2023-11-26T07:17:44.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c0b6e20 con 0x7fd01c0d31a0 2023-11-26T07:17:44.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7fd01a59c640 1 -- 172.21.15.77:0/111467096 learned_addr learned my addr 172.21.15.77:0/111467096 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7fd01ad9d640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd01c0b6510 0x7fd01c0b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f908d435640 1 --2- 172.21.15.77:0/2692681777 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880ce010 0x7f90740039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f908d435640 1 --2- 172.21.15.77:0/2692681777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9074004020 0x7f90740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f908d435640 1 --2- 172.21.15.77:0/2692681777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 0x7f9074005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90880cf0a0 con 0x7f9074004d00 2023-11-26T07:17:44.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907400bbc0 con 0x7f9074004020 2023-11-26T07:17:44.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907400bd80 con 0x7f90880ce010 2023-11-26T07:17:44.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f908ec38640 1 --2- 172.21.15.77:0/2692681777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 0x7f9074005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f908e437640 1 --2- 172.21.15.77:0/2692681777 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880ce010 0x7f90740039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f8b567fc640 1 -- 172.21.15.77:0/1948186326 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5002f8a0 con 0x7f8b5806c560 2023-11-26T07:17:44.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f8b567fc640 1 -- 172.21.15.77:0/1948186326 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5002fa00 con 0x7f8b5806c560 2023-11-26T07:17:44.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f8b567fc640 1 -- 172.21.15.77:0/1948186326 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5002fd90 con 0x7f8b5806c560 2023-11-26T07:17:44.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.218+0000 7f16ed95a640 1 Processor -- start 2023-11-26T07:17:44.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7f908ec38640 1 -- 172.21.15.77:0/2692681777 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880ce010 msgr2=0x7f90740039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:44.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7f908ec38640 1 --2- 172.21.15.77:0/2692681777 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880ce010 0x7f90740039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7f908ec38640 1 -- 172.21.15.77:0/2692681777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9074004020 msgr2=0x7f90740047c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:17:44.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7f908ec38640 1 --2- 172.21.15.77:0/2692681777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9074004020 0x7f90740047c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7f908ec38640 1 -- 172.21.15.77:0/2692681777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9074003520 con 0x7f9074004d00 2023-11-26T07:17:44.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7fd01ad9d640 1 -- 172.21.15.77:0/111467096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd01c0d31a0 msgr2=0x7fd01c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7f8b5d809640 1 -- 172.21.15.77:0/1948186326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5806c560 msgr2=0x7f8b5815a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7f8b5d809640 1 --2- 172.21.15.77:0/1948186326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5806c560 0x7f8b5815a2d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009fb0 tx=0x7f8b5002dae0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7f16ed95a640 1 -- start start 2023-11-26T07:17:44.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7fd01ad9d640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd01c0d31a0 0x7fd01c0b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7fd01ad9d640 1 -- 172.21.15.77:0/111467096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd01c0ce010 msgr2=0x7fd01c15acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7fd01ad9d640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd01c0ce010 0x7fd01c15acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7fd01ad9d640 1 -- 172.21.15.77:0/111467096 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd010009400 con 0x7fd01c0b6510 2023-11-26T07:17:44.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.219+0000 7fd019d9b640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd01c0d31a0 0x7fd01c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:44.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.220+0000 7f8b5d809640 1 -- 172.21.15.77:0/1948186326 shutdown_connections 2023-11-26T07:17:44.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.220+0000 7f8b5d809640 1 --2- 172.21.15.77:0/1948186326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5806c560 0x7f8b5815a2d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.220+0000 7f8b5d809640 1 --2- 172.21.15.77:0/1948186326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806da40 0x7f8b580ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.220+0000 7f8b5d809640 1 -- 172.21.15.77:0/1948186326 >> 172.21.15.77:0/1948186326 conn(0x7f8b5806a920 msgr2=0x7f8b5806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.220+0000 7fd01ad9d640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd01c0b6510 0x7fd01c0b8490 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd01400eeb0 tx=0x7fd01400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.220+0000 7f8b5d809640 1 -- 172.21.15.77:0/1948186326 shutdown_connections 2023-11-26T07:17:44.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.220+0000 7fd00affd640 1 -- 172.21.15.77:0/111467096 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014010040 con 0x7fd01c0b6510 2023-11-26T07:17:44.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.221+0000 7f8b5d809640 1 -- 172.21.15.77:0/1948186326 wait complete. 2023-11-26T07:17:44.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.221+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01c0b7100 con 0x7fd01c0b6510 2023-11-26T07:17:44.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.221+0000 7f16ed95a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f16e80d31a0 0x7f16e80d3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.221+0000 7f16ed95a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f16e80ce010 0x7f16e80ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.221+0000 7f16ed95a640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e80d1070 con 0x7f16e81609e0 2023-11-26T07:17:44.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.221+0000 7f16ed95a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e80d3b50 con 0x7f16e80ce010 2023-11-26T07:17:44.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.221+0000 7f16ed95a640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e80cedc0 con 0x7f16e80d31a0 2023-11-26T07:17:44.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.221+0000 7f908ec38640 1 --2- 172.21.15.77:0/2692681777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 0x7f9074005180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f907800ba30 tx=0x7f90740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aec706365dde23 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.222+0000 7f16e6ffd640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f16e81609e0 0x7f16e806bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:38670/0 (socket says 172.21.15.77:38670) 2023-11-26T07:17:44.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.222+0000 7f16e6ffd640 1 -- 172.21.15.77:0/3799029004 learned_addr learned my addr 172.21.15.77:0/3799029004 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:44.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.222+0000 7f16e77fe640 1 --2- 172.21.15.77:0/3799029004 >> v2:172.21.15.77:3300/0 conn(0x7f16e80ce010 0x7f16e80ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.221+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c0b76c0 con 0x7fd01c0b6510 2023-11-26T07:17:44.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.221+0000 7fd00affd640 1 -- 172.21.15.77:0/111467096 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01400bbd0 con 0x7fd01c0b6510 2023-11-26T07:17:44.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.223+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078032650 con 0x7f9074004d00 2023-11-26T07:17:44.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.221+0000 7fd00affd640 1 -- 172.21.15.77:0/111467096 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014003990 con 0x7fd01c0b6510 2023-11-26T07:17:44.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.223+0000 7f908d435640 1 -- 172.21.15.77:0/2692681777 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90780327b0 con 0x7f9074004d00 2023-11-26T07:17:44.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.223+0000 7fd01a59c640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd01c0ce010 0x7fd01c15acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:44.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.222+0000 7f16e67fc640 1 --2- 172.21.15.77:0/3799029004 >> v2:172.21.15.159:3300/0 conn(0x7f16e80d31a0 0x7f16e80d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.223+0000 7f16e77fe640 1 -- 172.21.15.77:0/3799029004 >> v2:172.21.15.159:3300/0 conn(0x7f16e80d31a0 msgr2=0x7f16e80d3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:44.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.223+0000 7f16e77fe640 1 --2- 172.21.15.77:0/3799029004 >> v2:172.21.15.159:3300/0 conn(0x7f16e80d31a0 0x7f16e80d3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.223+0000 7f16e77fe640 1 -- 172.21.15.77:0/3799029004 >> v1:172.21.15.159:6789/0 conn(0x7f16e81609e0 legacy=0x7f16e806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.223+0000 7f16e77fe640 1 -- 172.21.15.77:0/3799029004 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e80cf0a0 con 0x7f16e80ce010 2023-11-26T07:17:44.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.223+0000 7f16e5ffb640 1 -- 172.21.15.77:0/3799029004 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215472944 0 0) 0x7f16e80d1070 con 0x7f16e81609e0 2023-11-26T07:17:44.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.224+0000 7f909069b640 1 -- 172.21.15.77:0/2692681777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 msgr2=0x7f9074005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.224+0000 7f909069b640 1 --2- 172.21.15.77:0/2692681777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 0x7f9074005180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f907800ba30 tx=0x7f90740057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.224+0000 7f908ec38640 1 -- 172.21.15.77:0/2692681777 reap_dead start 2023-11-26T07:17:44.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.224+0000 7f16e77fe640 1 --2- 172.21.15.77:0/3799029004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16e80ce010 0x7f16e80ce430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f16e80d43c0 tx=0x7f16d802bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19d5cadbdec459e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.225+0000 7f909069b640 1 -- 172.21.15.77:0/2692681777 shutdown_connections 2023-11-26T07:17:44.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.225+0000 7f909069b640 1 -- 172.21.15.77:0/2692681777 >> 172.21.15.77:0/2692681777 conn(0x7f908808af60 msgr2=0x7f908809c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.225+0000 7f16e5ffb640 1 -- 172.21.15.77:0/3799029004 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d802d6e0 con 0x7f16e80ce010 2023-11-26T07:17:44.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.225+0000 7f8b5d809640 1 Processor -- start 2023-11-26T07:17:44.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.225+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd000005250 con 0x7fd01c0b6510 2023-11-26T07:17:44.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.225+0000 7f909069b640 1 -- 172.21.15.77:0/2692681777 shutdown_connections 2023-11-26T07:17:44.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.225+0000 7f8b5d809640 1 -- start start 2023-11-26T07:17:44.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.225+0000 7f16e5ffb640 1 -- 172.21.15.77:0/3799029004 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d802d840 con 0x7f16e80ce010 2023-11-26T07:17:44.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.225+0000 7f16e5ffb640 1 -- 172.21.15.77:0/3799029004 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d802dbd0 con 0x7f16e80ce010 2023-11-26T07:17:44.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.226+0000 7f16ed95a640 1 -- 172.21.15.77:0/3799029004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16e80ce010 msgr2=0x7f16e80ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.226+0000 7f16ed95a640 1 --2- 172.21.15.77:0/3799029004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16e80ce010 0x7f16e80ce430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f16e80d43c0 tx=0x7f16d802bb30 comp rx=0 tx=0).stop 2023-11-26T07:17:44.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.227+0000 7f16ed95a640 1 -- 172.21.15.77:0/3799029004 shutdown_connections 2023-11-26T07:17:44.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.227+0000 7f8b5d809640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806c560 0x7f8b580cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.227+0000 7f16ed95a640 1 --2- 172.21.15.77:0/3799029004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16e80ce010 0x7f16e80ce430 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.227+0000 7f8b5d809640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5806da40 0x7f8b5809c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.227+0000 7f16ed95a640 1 --2- 172.21.15.77:0/3799029004 >> v2:172.21.15.159:3300/0 conn(0x7f16e80d31a0 0x7f16e80d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.227+0000 7f16ed95a640 1 -- 172.21.15.77:0/3799029004 >> 172.21.15.77:0/3799029004 conn(0x7f16e808af60 msgr2=0x7f16e809c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.227+0000 7f8b5d809640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b580ce450 0x7f8b5815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.227+0000 7f8b5d809640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b581f3420 con 0x7f8b580ce450 2023-11-26T07:17:44.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.227+0000 7f8b5d809640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580cc300 con 0x7f8b5806da40 2023-11-26T07:17:44.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.227+0000 7f8b5d809640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b58147fb0 con 0x7f8b5806c560 2023-11-26T07:17:44.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.225+0000 7f909069b640 1 -- 172.21.15.77:0/2692681777 wait complete. 2023-11-26T07:17:44.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.228+0000 7f8b56ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806c560 0x7f8b580cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.228+0000 7f909069b640 1 Processor -- start 2023-11-26T07:17:44.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.228+0000 7f8b56ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806c560 0x7f8b580cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45810/0 (socket says 172.21.15.77:45810) 2023-11-26T07:17:44.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.228+0000 7f8b56ffd640 1 -- 172.21.15.77:0/41996417 learned_addr learned my addr 172.21.15.77:0/41996417 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.228+0000 7fd00affd640 1 -- 172.21.15.77:0/111467096 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd014003af0 con 0x7fd01c0b6510 2023-11-26T07:17:44.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.228+0000 7f909069b640 1 -- start start 2023-11-26T07:17:44.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.229+0000 7f16ed95a640 1 -- 172.21.15.77:0/3799029004 shutdown_connections 2023-11-26T07:17:44.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.228+0000 7f8b4e7fc640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5806da40 0x7f8b5809c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.229+0000 7f8b56ffd640 1 -- 172.21.15.77:0/41996417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5806da40 msgr2=0x7f8b5809c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.229+0000 7f8b56ffd640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5806da40 0x7f8b5809c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.229+0000 7f8b56ffd640 1 -- 172.21.15.77:0/41996417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b580ce450 msgr2=0x7f8b5815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.229+0000 7f8b56ffd640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b580ce450 0x7f8b5815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.229+0000 7f8b56ffd640 1 -- 172.21.15.77:0/41996417 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50009c90 con 0x7f8b5806c560 2023-11-26T07:17:44.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.229+0000 7f16ed95a640 1 -- 172.21.15.77:0/3799029004 wait complete. 2023-11-26T07:17:44.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.230+0000 7f909069b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 0x7f9088154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.229+0000 7f8b56ffd640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806c560 0x7f8b580cbdc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800efc0 tx=0x7f8b4800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.230+0000 7f8b54ff9640 1 -- 172.21.15.77:0/41996417 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48014480 con 0x7f8b5806c560 2023-11-26T07:17:44.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.230+0000 7f8b54ff9640 1 -- 172.21.15.77:0/41996417 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4800f040 con 0x7f8b5806c560 2023-11-26T07:17:44.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.230+0000 7f8b54ff9640 1 -- 172.21.15.77:0/41996417 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48014800 con 0x7f8b5806c560 2023-11-26T07:17:44.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.229+0000 7fd00affd640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcffc06af10 0x7fcffc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.230+0000 7fd00affd640 1 -- 172.21.15.77:0/111467096 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0140897f0 con 0x7fd01c0b6510 2023-11-26T07:17:44.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.231+0000 7fd01a59c640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcffc06af10 0x7fcffc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.231+0000 7f909069b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880b4a70 0x7f90880b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.231+0000 7f909069b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880c8b30 0x7f90880c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.231+0000 7f908e437640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 0x7f9088154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.231+0000 7f909069b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9088155180 con 0x7f9074004d00 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.231+0000 7f908e437640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 0x7f9088154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35040/0 (socket says 172.21.15.77:35040) 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.231+0000 7f909069b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908815b7b0 con 0x7f90880c8b30 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.231+0000 7f909069b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90880c94f0 con 0x7f90880b4a70 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.231+0000 7f908e437640 1 -- 172.21.15.77:0/2507335274 learned_addr learned my addr 172.21.15.77:0/2507335274 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.231+0000 7f908dc36640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880b4a70 0x7f90880b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.231+0000 7f908ec38640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880c8b30 0x7f90880c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.232+0000 7f908e437640 1 -- 172.21.15.77:0/2507335274 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880b4a70 msgr2=0x7f90880b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.232+0000 7f908e437640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880b4a70 0x7f90880b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.232+0000 7f908e437640 1 -- 172.21.15.77:0/2507335274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880c8b30 msgr2=0x7f90880c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.232+0000 7f908e437640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880c8b30 0x7f90880c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.232+0000 7f908e437640 1 -- 172.21.15.77:0/2507335274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9088157b90 con 0x7f9074004d00 2023-11-26T07:17:44.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.232+0000 7f8b5d809640 1 -- 172.21.15.77:0/41996417 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b58148290 con 0x7f8b5806c560 2023-11-26T07:17:44.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.232+0000 7f8b5d809640 1 -- 172.21.15.77:0/41996417 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b58148850 con 0x7f8b5806c560 2023-11-26T07:17:44.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.233+0000 7f908e437640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 0x7f9088154c40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90800013d0 tx=0x7f908000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.233+0000 7f16ed95a640 1 Processor -- start 2023-11-26T07:17:44.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.233+0000 7f908ec38640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880c8b30 0x7f90880c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:44.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.233+0000 7fd01a59c640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcffc06af10 0x7fcffc06d3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd01002b910 tx=0x7fd01003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.233+0000 7f8b5d809640 1 -- 172.21.15.77:0/41996417 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b58067470 con 0x7f8b5806c560 2023-11-26T07:17:44.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.234+0000 7f16ed95a640 1 -- start start 2023-11-26T07:17:44.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.235+0000 7f16ed95a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80ce010 0x7f16e814f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.235+0000 7f16ed95a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f16e80d31a0 0x7f16e8153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.235+0000 7f16ed95a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16e81609e0 0x7f16e80c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.235+0000 7f16ed95a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8154820 con 0x7f16e81609e0 2023-11-26T07:17:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.235+0000 7f16ed95a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80c7cb0 con 0x7f16e80ce010 2023-11-26T07:17:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.235+0000 7f16ed95a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80c79d0 con 0x7f16e80d31a0 2023-11-26T07:17:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.236+0000 7f16e77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16e81609e0 0x7f16e80c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.236+0000 7f16e6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80ce010 0x7f16e814f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.236+0000 7f16e6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80ce010 0x7f16e814f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:55426/0 (socket says 172.21.15.77:55426) 2023-11-26T07:17:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.236+0000 7f16e6ffd640 1 -- 172.21.15.77:0/2232616251 learned_addr learned my addr 172.21.15.77:0/2232616251 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.236+0000 7f16e67fc640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f16e80d31a0 0x7f16e8153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.236+0000 7f907effd640 1 -- 172.21.15.77:0/2507335274 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080013420 con 0x7f9074004d00 2023-11-26T07:17:44.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.236+0000 7f907effd640 1 -- 172.21.15.77:0/2507335274 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9080013580 con 0x7f9074004d00 2023-11-26T07:17:44.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.236+0000 7f907effd640 1 -- 172.21.15.77:0/2507335274 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080013930 con 0x7f9074004d00 2023-11-26T07:17:44.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.236+0000 7f909069b640 1 -- 172.21.15.77:0/2507335274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90880b6910 con 0x7f9074004d00 2023-11-26T07:17:44.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.237+0000 7f909069b640 1 -- 172.21.15.77:0/2507335274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90880b6e90 con 0x7f9074004d00 2023-11-26T07:17:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.237+0000 7f16e77fe640 1 -- 172.21.15.77:0/2232616251 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f16e80d31a0 msgr2=0x7f16e8153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.237+0000 7f16e77fe640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f16e80d31a0 0x7f16e8153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.237+0000 7f16e77fe640 1 -- 172.21.15.77:0/2232616251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80ce010 msgr2=0x7f16e814f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.237+0000 7f16e77fe640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80ce010 0x7f16e814f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.237+0000 7f16e77fe640 1 -- 172.21.15.77:0/2232616251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d8009400 con 0x7f16e81609e0 2023-11-26T07:17:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.238+0000 7f16e67fc640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f16e80d31a0 0x7f16e8153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.237+0000 7fd00affd640 1 -- 172.21.15.77:0/111467096 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd014054910 con 0x7fd01c0b6510 2023-11-26T07:17:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.238+0000 7f16e77fe640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16e81609e0 0x7f16e80c6ef0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16d8033000 tx=0x7f16d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.238+0000 7f8b54ff9640 1 -- 172.21.15.77:0/41996417 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b48014960 con 0x7f8b5806c560 2023-11-26T07:17:44.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.239+0000 7f909069b640 1 -- 172.21.15.77:0/2507335274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9088067470 con 0x7f9074004d00 2023-11-26T07:17:44.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.239+0000 7fb0d9048640 1 Processor -- start 2023-11-26T07:17:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.239+0000 7fb0d9048640 1 -- start start 2023-11-26T07:17:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.239+0000 7f16dffff640 1 -- 172.21.15.77:0/2232616251 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8003810 con 0x7f16e81609e0 2023-11-26T07:17:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.239+0000 7f16dffff640 1 -- 172.21.15.77:0/2232616251 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8003970 con 0x7f16e81609e0 2023-11-26T07:17:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.239+0000 7f16dffff640 1 -- 172.21.15.77:0/2232616251 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8003d00 con 0x7f16e81609e0 2023-11-26T07:17:44.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.239+0000 7f16ed95a640 1 -- 172.21.15.77:0/2232616251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e8153350 con 0x7f16e81609e0 2023-11-26T07:17:44.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.239+0000 7f16ed95a640 1 -- 172.21.15.77:0/2232616251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e8153910 con 0x7f16e81609e0 2023-11-26T07:17:44.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.240+0000 7f8b54ff9640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b3806ae90 0x7f8b3806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.240+0000 7f8b54ff9640 1 -- 172.21.15.77:0/41996417 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b4808a900 con 0x7f8b5806c560 2023-11-26T07:17:44.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.241+0000 7fb0d9048640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb0d40ce120 0x7fb0d40cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.241+0000 7fb0d9048640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d4159e30 con 0x7fb0d40b0ce0 2023-11-26T07:17:44.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.241+0000 7fb0d9048640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d40cc690 con 0x7fb0d40b0380 2023-11-26T07:17:44.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.241+0000 7fb0d9048640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d40cc970 con 0x7fb0d40ce120 2023-11-26T07:17:44.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.240+0000 7f907effd640 1 -- 172.21.15.77:0/2507335274 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9080013a90 con 0x7f9074004d00 2023-11-26T07:17:44.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.241+0000 7f8b4e7fc640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b3806ae90 0x7f8b3806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.242+0000 7f907effd640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f906c06aec0 0x7f906c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.242+0000 7fb0cbfff640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fb0d40b0380 0x7fb0d4159720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:38680/0 (socket says 172.21.15.77:38680) 2023-11-26T07:17:44.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.242+0000 7fb0cbfff640 1 -- 172.21.15.77:0/3257675098 learned_addr learned my addr 172.21.15.77:0/3257675098 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:44.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.242+0000 7f16ed95a640 1 -- 172.21.15.77:0/2232616251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e80c91e0 con 0x7f16e81609e0 2023-11-26T07:17:44.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.243+0000 7fb0d2d9d640 1 --2- 172.21.15.77:0/3257675098 >> v2:172.21.15.77:3300/0 conn(0x7fb0d40ce120 0x7fb0d40cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.243+0000 7f908dc36640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f906c06aec0 0x7f906c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.243+0000 7f907effd640 1 -- 172.21.15.77:0/2507335274 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f908008a9b0 con 0x7f9074004d00 2023-11-26T07:17:44.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.243+0000 7fb0d259c640 1 -- 172.21.15.77:0/3257675098 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794721571 0 0) 0x7fb0d40cc690 con 0x7fb0d40b0380 2023-11-26T07:17:44.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.244+0000 7f8b4e7fc640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b3806ae90 0x7f8b3806d350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b581473d0 tx=0x7f8b40009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.244+0000 7fb0d2d9d640 1 -- 172.21.15.77:0/3257675098 >> v1:172.21.15.159:6789/0 conn(0x7fb0d40b0380 legacy=0x7fb0d4159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.244+0000 7fb0d2d9d640 1 -- 172.21.15.77:0/3257675098 >> v1:172.21.15.77:6789/0 conn(0x7fb0d40b0ce0 legacy=0x7fb0d40b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.244+0000 7fb0d2d9d640 1 -- 172.21.15.77:0/3257675098 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d40b2180 con 0x7fb0d40ce120 2023-11-26T07:17:44.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.244+0000 7f908dc36640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f906c06aec0 0x7f906c06d380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90881580d0 tx=0x7f9084009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.246+0000 7fb0d2d9d640 1 --2- 172.21.15.77:0/3257675098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d40ce120 0x7fb0d40cbd20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40097a0 tx=0x7fb0c402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41bff3fa3ba7c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.244+0000 7f16dffff640 1 -- 172.21.15.77:0/2232616251 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16d8041470 con 0x7f16e81609e0 2023-11-26T07:17:44.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.246+0000 7f16dffff640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f16c806ae90 0x7f16c806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.246+0000 7f16dffff640 1 -- 172.21.15.77:0/2232616251 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16d8031070 con 0x7f16e81609e0 2023-11-26T07:17:44.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.247+0000 7f16e6ffd640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f16c806ae90 0x7f16c806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.248+0000 7f16e6ffd640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f16c806ae90 0x7f16c806d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f16d0000f60 tx=0x7f16d0007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.250+0000 7f8b54ff9640 1 -- 172.21.15.77:0/41996417 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b48055a90 con 0x7f8b5806c560 2023-11-26T07:17:44.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.251+0000 7f907effd640 1 -- 172.21.15.77:0/2507335274 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9080054ed0 con 0x7f9074004d00 2023-11-26T07:17:44.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.253+0000 7f16dffff640 1 -- 172.21.15.77:0/2232616251 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16d80dee90 con 0x7f16e81609e0 2023-11-26T07:17:44.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.254+0000 7fb0d259c640 1 -- 172.21.15.77:0/3257675098 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c402f810 con 0x7fb0d40ce120 2023-11-26T07:17:44.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.254+0000 7fb0d259c640 1 -- 172.21.15.77:0/3257675098 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c402f970 con 0x7fb0d40ce120 2023-11-26T07:17:44.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.254+0000 7fb0d259c640 1 -- 172.21.15.77:0/3257675098 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c402fd00 con 0x7fb0d40ce120 2023-11-26T07:17:44.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.255+0000 7fb0d9048640 1 -- 172.21.15.77:0/3257675098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d40ce120 msgr2=0x7fb0d40cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.255+0000 7fb0d9048640 1 --2- 172.21.15.77:0/3257675098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d40ce120 0x7fb0d40cbd20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40097a0 tx=0x7fb0c402b9f0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.255+0000 7fb0d9048640 1 -- 172.21.15.77:0/3257675098 shutdown_connections 2023-11-26T07:17:44.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.255+0000 7fb0d9048640 1 --2- 172.21.15.77:0/3257675098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d40ce120 0x7fb0d40cbd20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.255+0000 7fb0d9048640 1 -- 172.21.15.77:0/3257675098 >> 172.21.15.77:0/3257675098 conn(0x7fb0d40b4500 msgr2=0x7fb0d40b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.255+0000 7fb0d9048640 1 -- 172.21.15.77:0/3257675098 shutdown_connections 2023-11-26T07:17:44.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.255+0000 7fb0d9048640 1 -- 172.21.15.77:0/3257675098 wait complete. 2023-11-26T07:17:44.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.258+0000 7fb0d9048640 1 Processor -- start 2023-11-26T07:17:44.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.259+0000 7fb0d9048640 1 -- start start 2023-11-26T07:17:44.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.261+0000 7fb0d9048640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d40b0380 0x7fb0d413be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.261+0000 7fb0d9048640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0d40b0ce0 0x7fb0d415bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.262+0000 7fb0d9048640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0d40ce120 0x7fb0d413dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.262+0000 7fb0d9048640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d415c920 con 0x7fb0d40b0380 2023-11-26T07:17:44.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.262+0000 7fb0d9048640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d413c420 con 0x7fb0d40ce120 2023-11-26T07:17:44.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.262+0000 7fb0d9048640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d415c2d0 con 0x7fb0d40b0ce0 2023-11-26T07:17:44.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.262+0000 7fb0d359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0d40ce120 0x7fb0d413dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.262+0000 7fb0d359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0d40ce120 0x7fb0d413dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:55432/0 (socket says 172.21.15.77:55432) 2023-11-26T07:17:44.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.262+0000 7fb0d359e640 1 -- 172.21.15.77:0/4168998674 learned_addr learned my addr 172.21.15.77:0/4168998674 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.263+0000 7fb0d2d9d640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d40b0380 0x7fb0d413be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.263+0000 7fb0d359e640 1 -- 172.21.15.77:0/4168998674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0d40b0ce0 msgr2=0x7fb0d415bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.263+0000 7fb0d359e640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0d40b0ce0 0x7fb0d415bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.263+0000 7fb0d359e640 1 -- 172.21.15.77:0/4168998674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d40b0380 msgr2=0x7fb0d413be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.263+0000 7fb0d359e640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d40b0380 0x7fb0d413be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.263+0000 7fb0d359e640 1 -- 172.21.15.77:0/4168998674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c4009400 con 0x7fb0d40ce120 2023-11-26T07:17:44.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.264+0000 7fb0d359e640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0d40ce120 0x7fb0d413dfc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c7a0 tx=0x7fb0cc00cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.265+0000 7fb0cb7fe640 1 -- 172.21.15.77:0/4168998674 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc003b70 con 0x7fb0d40ce120 2023-11-26T07:17:44.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.265+0000 7fb0d9048640 1 -- 172.21.15.77:0/4168998674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d415c5b0 con 0x7fb0d40ce120 2023-11-26T07:17:44.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.265+0000 7fb0d9048640 1 -- 172.21.15.77:0/4168998674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d413e500 con 0x7fb0d40ce120 2023-11-26T07:17:44.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.265+0000 7fb0cb7fe640 1 -- 172.21.15.77:0/4168998674 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc003cd0 con 0x7fb0d40ce120 2023-11-26T07:17:44.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.265+0000 7fb0cb7fe640 1 -- 172.21.15.77:0/4168998674 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc00aa50 con 0x7fb0d40ce120 2023-11-26T07:17:44.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.267+0000 7fb0d9048640 1 -- 172.21.15.77:0/4168998674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b8005250 con 0x7fb0d40ce120 2023-11-26T07:17:44.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.270+0000 7fb0cb7fe640 1 -- 172.21.15.77:0/4168998674 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0cc00abb0 con 0x7fb0d40ce120 2023-11-26T07:17:44.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.271+0000 7fb0cb7fe640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb0b406ae90 0x7fb0b406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.272+0000 7fb0d2d9d640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb0b406ae90 0x7fb0b406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.273+0000 7fb0d2d9d640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb0b406ae90 0x7fb0b406d350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4036000 tx=0x7fb0c4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.273+0000 7fb0cb7fe640 1 -- 172.21.15.77:0/4168998674 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0cc089390 con 0x7fb0d40ce120 2023-11-26T07:17:44.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.287+0000 7fb0cb7fe640 1 -- 172.21.15.77:0/4168998674 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb0cc0544b0 con 0x7fb0d40ce120 2023-11-26T07:17:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.555+0000 7fb8c149b640 1 -- 172.21.15.77:0/3275002656 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb8b40e4a30 con 0x7fb8b40e3120 2023-11-26T07:17:44.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.556+0000 7fb8a37fe640 1 -- 172.21.15.77:0/3275002656 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8b40e4a30 con 0x7fb8b40e3120 2023-11-26T07:17:44.559 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2023-11-26T07:17:44.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.560+0000 7fb8c149b640 1 -- 172.21.15.77:0/3275002656 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8a806ae90 msgr2=0x7fb8a806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.560+0000 7fb8c149b640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8a806ae90 0x7fb8a806d350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac036000 tx=0x7fb8ac03b040 comp rx=0 tx=0).stop 2023-11-26T07:17:44.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.560+0000 7fb8c149b640 1 -- 172.21.15.77:0/3275002656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 msgr2=0x7fb8b4051f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.560+0000 7fb8c149b640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b4051f80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc079ba0 tx=0x7fb8bc06b8e0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.561+0000 7fb8c149b640 1 -- 172.21.15.77:0/3275002656 shutdown_connections 2023-11-26T07:17:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.561+0000 7fb8c149b640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8a806ae90 0x7fb8a806d350 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.561+0000 7fb8c149b640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40e3120 0x7fb8b4051f80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.561+0000 7fb8c149b640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b4053c70 0x7fb8b40cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.561+0000 7fb8c149b640 1 --2- 172.21.15.77:0/3275002656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b403c060 0x7fb8b40e4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.561+0000 7fb8c149b640 1 -- 172.21.15.77:0/3275002656 >> 172.21.15.77:0/3275002656 conn(0x7fb8b4058ea0 msgr2=0x7fb8b4038900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.561+0000 7fb8c149b640 1 -- 172.21.15.77:0/3275002656 shutdown_connections 2023-11-26T07:17:44.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.562+0000 7fb8c149b640 1 -- 172.21.15.77:0/3275002656 wait complete. 2023-11-26T07:17:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.568+0000 7f31d7ee0640 1 -- 172.21.15.77:0/536968984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f31d00b18a0 con 0x7f31d00cffb0 2023-11-26T07:17:44.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.568+0000 7f31c67fc640 1 -- 172.21.15.77:0/536968984 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f31c002f090 con 0x7f31d00cffb0 2023-11-26T07:17:44.570 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2023-11-26T07:17:44.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.572+0000 7f31d7ee0640 1 -- 172.21.15.77:0/536968984 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31b406aea0 msgr2=0x7f31b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.572+0000 7f31d7ee0640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31b406aea0 0x7f31b406d360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31cc001eb0 tx=0x7f31cc009040 comp rx=0 tx=0).stop 2023-11-26T07:17:44.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.572+0000 7f31d7ee0640 1 -- 172.21.15.77:0/536968984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d00cffb0 msgr2=0x7f31d0159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.572+0000 7f31d7ee0640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d00cffb0 0x7f31d0159ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009870 tx=0x7f31c00046c0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.573+0000 7f31d7ee0640 1 -- 172.21.15.77:0/536968984 shutdown_connections 2023-11-26T07:17:44.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.573+0000 7f31d7ee0640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31b406aea0 0x7f31b406d360 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.573+0000 7f31d7ee0640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d015b450 0x7f31d015f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.573+0000 7f31d7ee0640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31d00d0b10 0x7f31d00b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.573+0000 7f31d7ee0640 1 --2- 172.21.15.77:0/536968984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d00cffb0 0x7f31d0159ee0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.573+0000 7f31d7ee0640 1 -- 172.21.15.77:0/536968984 >> 172.21.15.77:0/536968984 conn(0x7f31d006e7f0 msgr2=0x7f31d00ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.574+0000 7f31d7ee0640 1 -- 172.21.15.77:0/536968984 shutdown_connections 2023-11-26T07:17:44.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.574+0000 7f31d7ee0640 1 -- 172.21.15.77:0/536968984 wait complete. 2023-11-26T07:17:44.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.583+0000 7f12e37fe640 1 -- 172.21.15.77:0/2814192024 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f12f00072b0 con 0x7f12f0053c10 2023-11-26T07:17:44.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.584+0000 7f12edffb640 1 -- 172.21.15.77:0/2814192024 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12f404e090 con 0x7f12f0053c10 2023-11-26T07:17:44.586 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-11-26T07:17:44.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.588+0000 7f12e37fe640 1 -- 172.21.15.77:0/2814192024 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12dc06ae40 msgr2=0x7f12dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.588+0000 7f12e37fe640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12dc06ae40 0x7f12dc06d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12e80010e0 tx=0x7f12e8007950 comp rx=0 tx=0).stop 2023-11-26T07:17:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.588+0000 7f12e37fe640 1 -- 172.21.15.77:0/2814192024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f0053c10 msgr2=0x7f12f00e9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.588+0000 7f12e37fe640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f0053c10 0x7f12f00e9130 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12f40098c0 tx=0x7f12f40046c0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.588+0000 7f12e37fe640 1 -- 172.21.15.77:0/2814192024 shutdown_connections 2023-11-26T07:17:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.588+0000 7f12e37fe640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12dc06ae40 0x7f12dc06d300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.588+0000 7f12e37fe640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f00e76e0 0x7f12f00e0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.588+0000 7f12e37fe640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12f0058990 0x7f12f003d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.588+0000 7f12e37fe640 1 --2- 172.21.15.77:0/2814192024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f0053c10 0x7f12f00e9130 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12f40098c0 tx=0x7f12f40046c0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.588+0000 7f12e37fe640 1 -- 172.21.15.77:0/2814192024 >> 172.21.15.77:0/2814192024 conn(0x7f12f0058eb0 msgr2=0x7f12f003a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-11-26T07:17:44.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.589+0000 7f12e37fe640 1 -- 172.21.15.77:0/2814192024 shutdown_connections 2023-11-26T07:17:44.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.590+0000 7f12e37fe640 1 -- 172.21.15.77:0/2814192024 wait complete. 2023-11-26T07:17:44.593 DEBUG:teuthology.parallel:result is None 2023-11-26T07:17:44.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-11-26T07:17:44.603 DEBUG:teuthology.parallel:result is None 2023-11-26T07:17:44.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-11-26T07:17:44.616 DEBUG:teuthology.parallel:result is None 2023-11-26T07:17:44.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.622+0000 7f8b5d809640 1 -- 172.21.15.77:0/41996417 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b580cdd20 con 0x7f8b5806c560 2023-11-26T07:17:44.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.623+0000 7f8b54ff9640 1 -- 172.21.15.77:0/41996417 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b480590b0 con 0x7f8b5806c560 2023-11-26T07:17:44.625 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2023-11-26T07:17:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.626+0000 7f8b5d809640 1 -- 172.21.15.77:0/41996417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b3806ae90 msgr2=0x7f8b3806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.626+0000 7f8b5d809640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b3806ae90 0x7f8b3806d350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b581473d0 tx=0x7f8b40009040 comp rx=0 tx=0).stop 2023-11-26T07:17:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.626+0000 7f8b5d809640 1 -- 172.21.15.77:0/41996417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806c560 msgr2=0x7f8b580cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.626+0000 7f8b5d809640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806c560 0x7f8b580cbdc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800efc0 tx=0x7f8b4800c490 comp rx=0 tx=0).stop 2023-11-26T07:17:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.626+0000 7f8b5d809640 1 -- 172.21.15.77:0/41996417 shutdown_connections 2023-11-26T07:17:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.626+0000 7f8b5d809640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b3806ae90 0x7f8b3806d350 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.626+0000 7f8b5d809640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b580ce450 0x7f8b5815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.626+0000 7f8b5d809640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b5806da40 0x7f8b5809c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.626+0000 7f8b5d809640 1 --2- 172.21.15.77:0/41996417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b5806c560 0x7f8b580cbdc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.626+0000 7f8b5d809640 1 -- 172.21.15.77:0/41996417 >> 172.21.15.77:0/41996417 conn(0x7f8b5806a920 msgr2=0x7f8b580abfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.627+0000 7f8b5d809640 1 -- 172.21.15.77:0/41996417 shutdown_connections 2023-11-26T07:17:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.627+0000 7f8b5d809640 1 -- 172.21.15.77:0/41996417 wait complete. 2023-11-26T07:17:44.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.629+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd0000050c0 con 0x7fd01c0b6510 2023-11-26T07:17:44.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.630+0000 7fd00affd640 1 -- 172.21.15.77:0/111467096 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd014057f30 con 0x7fd01c0b6510 2023-11-26T07:17:44.631 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-11-26T07:17:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcffc06af10 msgr2=0x7fcffc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcffc06af10 0x7fcffc06d3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd01002b910 tx=0x7fd01003c040 comp rx=0 tx=0).stop 2023-11-26T07:17:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd01c0b6510 msgr2=0x7fd01c0b8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd01c0b6510 0x7fd01c0b8490 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd01400eeb0 tx=0x7fd01400b480 comp rx=0 tx=0).stop 2023-11-26T07:17:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 shutdown_connections 2023-11-26T07:17:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcffc06af10 0x7fcffc06d3d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd01c0b6510 0x7fd01c0b8490 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd01c0d31a0 0x7fd01c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 --2- 172.21.15.77:0/111467096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd01c0ce010 0x7fd01c15acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 >> 172.21.15.77:0/111467096 conn(0x7fd01c08af60 msgr2=0x7fd01c0b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 shutdown_connections 2023-11-26T07:17:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.632+0000 7fd0208d3640 1 -- 172.21.15.77:0/111467096 wait complete. 2023-11-26T07:17:44.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-11-26T07:17:44.650 DEBUG:teuthology.parallel:result is None 2023-11-26T07:17:44.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.652+0000 7fb0d9048640 1 -- 172.21.15.77:0/4168998674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb0b8005500 con 0x7fb0d40ce120 2023-11-26T07:17:44.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-11-26T07:17:44.654 DEBUG:teuthology.parallel:result is None 2023-11-26T07:17:44.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.660+0000 7fb0cb7fe640 1 -- 172.21.15.77:0/4168998674 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0cc00ae60 con 0x7fb0d40ce120 2023-11-26T07:17:44.662 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2023-11-26T07:17:44.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.662+0000 7fb0d9048640 1 -- 172.21.15.77:0/4168998674 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb0b406ae90 msgr2=0x7fb0b406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.662+0000 7fb0d9048640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb0b406ae90 0x7fb0b406d350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4036000 tx=0x7fb0c4008030 comp rx=0 tx=0).stop 2023-11-26T07:17:44.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.662+0000 7fb0d9048640 1 -- 172.21.15.77:0/4168998674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0d40ce120 msgr2=0x7fb0d413dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.662+0000 7fb0d9048640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0d40ce120 0x7fb0d413dfc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c7a0 tx=0x7fb0cc00cc60 comp rx=0 tx=0).stop 2023-11-26T07:17:44.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.662+0000 7fb0d9048640 1 -- 172.21.15.77:0/4168998674 shutdown_connections 2023-11-26T07:17:44.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.662+0000 7fb0d9048640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb0b406ae90 0x7fb0b406d350 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.662+0000 7fb0d9048640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0d40ce120 0x7fb0d413dfc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.662+0000 7fb0d9048640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0d40b0ce0 0x7fb0d415bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.662+0000 7fb0d9048640 1 --2- 172.21.15.77:0/4168998674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d40b0380 0x7fb0d413be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.662+0000 7fb0d9048640 1 -- 172.21.15.77:0/4168998674 >> 172.21.15.77:0/4168998674 conn(0x7fb0d40b4500 msgr2=0x7fb0d40ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.662+0000 7fb0d9048640 1 -- 172.21.15.77:0/4168998674 shutdown_connections 2023-11-26T07:17:44.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.663+0000 7fb0d9048640 1 -- 172.21.15.77:0/4168998674 wait complete. 2023-11-26T07:17:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.668+0000 7f16ed95a640 1 -- 172.21.15.77:0/2232616251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f16e81534e0 con 0x7f16e81609e0 2023-11-26T07:17:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.668+0000 7f16dffff640 1 -- 172.21.15.77:0/2232616251 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16d8077280 con 0x7f16e81609e0 2023-11-26T07:17:44.670 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2023-11-26T07:17:44.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.669+0000 7f909069b640 1 -- 172.21.15.77:0/2507335274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f908806b750 con 0x7f9074004d00 2023-11-26T07:17:44.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.669+0000 7f907effd640 1 -- 172.21.15.77:0/2507335274 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90800584f0 con 0x7f9074004d00 2023-11-26T07:17:44.671 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-11-26T07:17:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 -- 172.21.15.77:0/2232616251 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f16c806ae90 msgr2=0x7f16c806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f16c806ae90 0x7f16c806d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f16d0000f60 tx=0x7f16d0007ea0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 -- 172.21.15.77:0/2232616251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16e81609e0 msgr2=0x7f16e80c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16e81609e0 0x7f16e80c6ef0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16d8033000 tx=0x7f16d80046c0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 -- 172.21.15.77:0/2232616251 shutdown_connections 2023-11-26T07:17:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f16c806ae90 0x7f16c806d350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16e81609e0 0x7f16e80c6ef0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f16e80d31a0 0x7f16e8153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 --2- 172.21.15.77:0/2232616251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16e80ce010 0x7f16e814f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 -- 172.21.15.77:0/2232616251 >> 172.21.15.77:0/2232616251 conn(0x7f16e808af60 msgr2=0x7f16e80ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 -- 172.21.15.77:0/2232616251 shutdown_connections 2023-11-26T07:17:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.671+0000 7f16ed95a640 1 -- 172.21.15.77:0/2232616251 wait complete. 2023-11-26T07:17:44.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 -- 172.21.15.77:0/2507335274 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f906c06aec0 msgr2=0x7f906c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f906c06aec0 0x7f906c06d380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90881580d0 tx=0x7f9084009040 comp rx=0 tx=0).stop 2023-11-26T07:17:44.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 -- 172.21.15.77:0/2507335274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 msgr2=0x7f9088154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 0x7f9088154c40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90800013d0 tx=0x7f908000e530 comp rx=0 tx=0).stop 2023-11-26T07:17:44.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 -- 172.21.15.77:0/2507335274 shutdown_connections 2023-11-26T07:17:44.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f906c06aec0 0x7f906c06d380 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90880c8b30 0x7f90880c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90880b4a70 0x7f90880b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 --2- 172.21.15.77:0/2507335274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9074004d00 0x7f9088154c40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 -- 172.21.15.77:0/2507335274 >> 172.21.15.77:0/2507335274 conn(0x7f908808af60 msgr2=0x7f90880b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 -- 172.21.15.77:0/2507335274 shutdown_connections 2023-11-26T07:17:44.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.672+0000 7f909069b640 1 -- 172.21.15.77:0/2507335274 wait complete. 2023-11-26T07:17:44.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-11-26T07:17:44.682 DEBUG:teuthology.parallel:result is None 2023-11-26T07:17:44.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-11-26T07:17:44.689 DEBUG:teuthology.parallel:result is None 2023-11-26T07:17:44.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-11-26T07:17:44.692 DEBUG:teuthology.parallel:result is None 2023-11-26T07:17:44.692 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-26T07:17:44.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:17:44.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.939+0000 7fb818e2e640 1 Processor -- start 2023-11-26T07:17:44.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.939+0000 7fb818e2e640 1 -- start start 2023-11-26T07:17:44.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.940+0000 7fb818e2e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb81406d6c0 0x7fb81406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.940+0000 7fb818e2e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8140cdbf0 0x7fb8140ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.940+0000 7fb818e2e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81406e060 con 0x7fb81413d120 2023-11-26T07:17:44.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.940+0000 7fb818e2e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81413f9e0 con 0x7fb8140cdbf0 2023-11-26T07:17:44.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.940+0000 7fb818e2e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81413fcc0 con 0x7fb81406d6c0 2023-11-26T07:17:44.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.941+0000 7fb8137fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb81413d120 0x7fb81415af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54462/0 (socket says 172.21.15.77:54462) 2023-11-26T07:17:44.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.941+0000 7fb8137fe640 1 -- 172.21.15.77:0/3630248012 learned_addr learned my addr 172.21.15.77:0/3630248012 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:44.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.941+0000 7fb813fff640 1 --2- 172.21.15.77:0/3630248012 >> v2:172.21.15.77:3300/0 conn(0x7fb8140cdbf0 0x7fb8140ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.941+0000 7fb812ffd640 1 -- 172.21.15.77:0/3630248012 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348658473 0 0) 0x7fb81406e060 con 0x7fb81413d120 2023-11-26T07:17:44.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.941+0000 7fb812ffd640 1 -- 172.21.15.77:0/3630248012 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb800003520 con 0x7fb81413d120 2023-11-26T07:17:44.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.941+0000 7fb80affd640 1 --2- 172.21.15.77:0/3630248012 >> v2:172.21.15.159:3300/0 conn(0x7fb81406d6c0 0x7fb81406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.941+0000 7fb813fff640 1 -- 172.21.15.77:0/3630248012 >> v2:172.21.15.159:3300/0 conn(0x7fb81406d6c0 msgr2=0x7fb81406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:44.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.941+0000 7fb813fff640 1 --2- 172.21.15.77:0/3630248012 >> v2:172.21.15.159:3300/0 conn(0x7fb81406d6c0 0x7fb81406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.941+0000 7fb813fff640 1 -- 172.21.15.77:0/3630248012 >> v1:172.21.15.77:6789/0 conn(0x7fb81413d120 legacy=0x7fb81415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.941+0000 7fb813fff640 1 -- 172.21.15.77:0/3630248012 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81413ffa0 con 0x7fb8140cdbf0 2023-11-26T07:17:44.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.942+0000 7fb813fff640 1 --2- 172.21.15.77:0/3630248012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8140cdbf0 0x7fb8140ce020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb814072a70 tx=0x7fb80c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cfc01a755dfba server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.942+0000 7fb812ffd640 1 -- 172.21.15.77:0/3630248012 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c02cbf0 con 0x7fb8140cdbf0 2023-11-26T07:17:44.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.943+0000 7fb812ffd640 1 -- 172.21.15.77:0/3630248012 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c02cd50 con 0x7fb8140cdbf0 2023-11-26T07:17:44.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.943+0000 7fb812ffd640 1 -- 172.21.15.77:0/3630248012 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c034660 con 0x7fb8140cdbf0 2023-11-26T07:17:44.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.943+0000 7fb818e2e640 1 -- 172.21.15.77:0/3630248012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8140cdbf0 msgr2=0x7fb8140ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.943+0000 7fb818e2e640 1 --2- 172.21.15.77:0/3630248012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8140cdbf0 0x7fb8140ce020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb814072a70 tx=0x7fb80c02be40 comp rx=0 tx=0).stop 2023-11-26T07:17:44.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.943+0000 7fb818e2e640 1 -- 172.21.15.77:0/3630248012 shutdown_connections 2023-11-26T07:17:44.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.943+0000 7fb818e2e640 1 --2- 172.21.15.77:0/3630248012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8140cdbf0 0x7fb8140ce020 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.943+0000 7fb818e2e640 1 --2- 172.21.15.77:0/3630248012 >> v2:172.21.15.159:3300/0 conn(0x7fb81406d6c0 0x7fb81406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.943+0000 7fb818e2e640 1 -- 172.21.15.77:0/3630248012 >> 172.21.15.77:0/3630248012 conn(0x7fb8140cb830 msgr2=0x7fb8140cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.943+0000 7fb818e2e640 1 -- 172.21.15.77:0/3630248012 shutdown_connections 2023-11-26T07:17:44.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.943+0000 7fb818e2e640 1 -- 172.21.15.77:0/3630248012 wait complete. 2023-11-26T07:17:44.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.945+0000 7fb818e2e640 1 Processor -- start 2023-11-26T07:17:44.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.945+0000 7fb818e2e640 1 -- start start 2023-11-26T07:17:44.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.946+0000 7fb818e2e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb81406d6c0 0x7fb814139b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.946+0000 7fb818e2e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8140cdbf0 0x7fb81413c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.946+0000 7fb818e2e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb81413d120 0x7fb814143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.946+0000 7fb818e2e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8141436c0 con 0x7fb8140cdbf0 2023-11-26T07:17:44.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.946+0000 7fb818e2e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8141420e0 con 0x7fb81413d120 2023-11-26T07:17:44.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.946+0000 7fb818e2e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8141423c0 con 0x7fb81406d6c0 2023-11-26T07:17:44.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.946+0000 7fb80affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8140cdbf0 0x7fb81413c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.946+0000 7fb80affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8140cdbf0 0x7fb81413c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35080/0 (socket says 172.21.15.77:35080) 2023-11-26T07:17:44.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.946+0000 7fb80affd640 1 -- 172.21.15.77:0/3672833279 learned_addr learned my addr 172.21.15.77:0/3672833279 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:44.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.947+0000 7fb80affd640 1 -- 172.21.15.77:0/3672833279 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb81406d6c0 msgr2=0x7fb814139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.947+0000 7fb80affd640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb81406d6c0 0x7fb814139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.947+0000 7fb80affd640 1 -- 172.21.15.77:0/3672833279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb81413d120 msgr2=0x7fb814143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.947+0000 7fb80affd640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb81413d120 0x7fb814143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.947+0000 7fb80affd640 1 -- 172.21.15.77:0/3672833279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c009a70 con 0x7fb8140cdbf0 2023-11-26T07:17:44.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.947+0000 7fb80affd640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8140cdbf0 0x7fb81413c600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00d800 tx=0x7fb7fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.947+0000 7fb810ff9640 1 -- 172.21.15.77:0/3672833279 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc00b6c0 con 0x7fb8140cdbf0 2023-11-26T07:17:44.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.947+0000 7fb810ff9640 1 -- 172.21.15.77:0/3672833279 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc00b820 con 0x7fb8140cdbf0 2023-11-26T07:17:44.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.947+0000 7fb818e2e640 1 -- 172.21.15.77:0/3672833279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81415a9d0 con 0x7fb8140cdbf0 2023-11-26T07:17:44.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.947+0000 7fb810ff9640 1 -- 172.21.15.77:0/3672833279 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc00bbb0 con 0x7fb8140cdbf0 2023-11-26T07:17:44.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.947+0000 7fb818e2e640 1 -- 172.21.15.77:0/3672833279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb814142980 con 0x7fb8140cdbf0 2023-11-26T07:17:44.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.948+0000 7fb818e2e640 1 -- 172.21.15.77:0/3672833279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81404e840 con 0x7fb8140cdbf0 2023-11-26T07:17:44.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.949+0000 7fb810ff9640 1 -- 172.21.15.77:0/3672833279 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7fc00bd10 con 0x7fb8140cdbf0 2023-11-26T07:17:44.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.950+0000 7fb810ff9640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb7f406ae70 0x7fb7f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.950+0000 7fb810ff9640 1 -- 172.21.15.77:0/3672833279 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7fc089be0 con 0x7fb8140cdbf0 2023-11-26T07:17:44.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.950+0000 7fb8137fe640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb7f406ae70 0x7fb7f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.951+0000 7fb8137fe640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb7f406ae70 0x7fb7f406d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb81413ed40 tx=0x7fb804007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:44.954+0000 7fb810ff9640 1 -- 172.21.15.77:0/3672833279 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb7fc054bf0 con 0x7fb8140cdbf0 2023-11-26T07:17:45.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.125+0000 7fb818e2e640 1 -- 172.21.15.77:0/3672833279 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb81415a850 con 0x7fb7f406ae70 2023-11-26T07:17:45.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.146+0000 7fb810ff9640 1 -- 172.21.15.77:0/3672833279 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264422 (secure 0 0 0) 0x7fb8040058b0 con 0x7fb7f406ae70 2023-11-26T07:17:45.151 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:17:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.151+0000 7fb818e2e640 1 -- 172.21.15.77:0/3672833279 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb7f406ae70 msgr2=0x7fb7f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.151+0000 7fb818e2e640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb7f406ae70 0x7fb7f406d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb81413ed40 tx=0x7fb804007930 comp rx=0 tx=0).stop 2023-11-26T07:17:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.151+0000 7fb818e2e640 1 -- 172.21.15.77:0/3672833279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8140cdbf0 msgr2=0x7fb81413c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.151+0000 7fb818e2e640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8140cdbf0 0x7fb81413c600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00d800 tx=0x7fb7fc00dcc0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.152+0000 7fb818e2e640 1 -- 172.21.15.77:0/3672833279 shutdown_connections 2023-11-26T07:17:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.152+0000 7fb818e2e640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb7f406ae70 0x7fb7f406d330 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.152+0000 7fb818e2e640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb81413d120 0x7fb814143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.152+0000 7fb818e2e640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8140cdbf0 0x7fb81413c600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.152+0000 7fb818e2e640 1 --2- 172.21.15.77:0/3672833279 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb81406d6c0 0x7fb814139b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.152+0000 7fb818e2e640 1 -- 172.21.15.77:0/3672833279 >> 172.21.15.77:0/3672833279 conn(0x7fb8140cb830 msgr2=0x7fb81406cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:45.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.152+0000 7fb818e2e640 1 -- 172.21.15.77:0/3672833279 shutdown_connections 2023-11-26T07:17:45.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.152+0000 7fb818e2e640 1 -- 172.21.15.77:0/3672833279 wait complete. 2023-11-26T07:17:45.170 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-26T07:17:43.606741+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.354640"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857536+0000","last_change":"2023-11-26T07:17:35.294616+0000","last_active":"2023-11-26T07:17:36.857536+0000","last_peered":"2023-11-26T07:17:36.857536+0000","last_clean":"2023-11-26T07:17:36.857536+0000","last_became_active":"2023-11-26T07:17:35.294223+0000","last_became_peered":"2023-11-26T07:17:35.294223+0000","last_unstale":"2023-11-26T07:17:36.857536+0000","last_undegraded":"2023-11-26T07:17:36.857536+0000","last_fullsized":"2023-11-26T07:17:36.857536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:01:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853243+0000","last_change":"2023-11-26T07:17:35.285291+0000","last_active":"2023-11-26T07:17:36.853243+0000","last_peered":"2023-11-26T07:17:36.853243+0000","last_clean":"2023-11-26T07:17:36.853243+0000","last_became_active":"2023-11-26T07:17:35.285002+0000","last_became_peered":"2023-11-26T07:17:35.285002+0000","last_unstale":"2023-11-26T07:17:36.853243+0000","last_undegraded":"2023-11-26T07:17:36.853243+0000","last_fullsized":"2023-11-26T07:17:36.853243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289017+0000","last_change":"2023-11-26T07:17:35.289003+0000","last_active":"2023-11-26T07:17:36.289017+0000","last_peered":"2023-11-26T07:17:36.289017+0000","last_clean":"2023-11-26T07:17:36.289017+0000","last_became_active":"2023-11-26T07:17:35.288628+0000","last_became_peered":"2023-11-26T07:17:35.288628+0000","last_unstale":"2023-11-26T07:17:36.289017+0000","last_undegraded":"2023-11-26T07:17:36.289017+0000","last_fullsized":"2023-11-26T07:17:36.289017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291198+0000","last_change":"2023-11-26T07:17:35.299669+0000","last_active":"2023-11-26T07:17:36.291198+0000","last_peered":"2023-11-26T07:17:36.291198+0000","last_clean":"2023-11-26T07:17:36.291198+0000","last_became_active":"2023-11-26T07:17:35.298175+0000","last_became_peered":"2023-11-26T07:17:35.298175+0000","last_unstale":"2023-11-26T07:17:36.291198+0000","last_undegraded":"2023-11-26T07:17:36.291198+0000","last_fullsized":"2023-11-26T07:17:36.291198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853732+0000","last_change":"2023-11-26T07:17:35.290182+0000","last_active":"2023-11-26T07:17:36.853732+0000","last_peered":"2023-11-26T07:17:36.853732+0000","last_clean":"2023-11-26T07:17:36.853732+0000","last_became_active":"2023-11-26T07:17:35.289848+0000","last_became_peered":"2023-11-26T07:17:35.289848+0000","last_unstale":"2023-11-26T07:17:36.853732+0000","last_undegraded":"2023-11-26T07:17:36.853732+0000","last_fullsized":"2023-11-26T07:17:36.853732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290790+0000","last_change":"2023-11-26T07:17:35.275633+0000","last_active":"2023-11-26T07:17:36.290790+0000","last_peered":"2023-11-26T07:17:36.290790+0000","last_clean":"2023-11-26T07:17:36.290790+0000","last_became_active":"2023-11-26T07:17:35.275245+0000","last_became_peered":"2023-11-26T07:17:35.275245+0000","last_unstale":"2023-11-26T07:17:36.290790+0000","last_undegraded":"2023-11-26T07:17:36.290790+0000","last_fullsized":"2023-11-26T07:17:36.290790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853372+0000","last_change":"2023-11-26T07:17:35.289664+0000","last_active":"2023-11-26T07:17:36.853372+0000","last_peered":"2023-11-26T07:17:36.853372+0000","last_clean":"2023-11-26T07:17:36.853372+0000","last_became_active":"2023-11-26T07:17:35.289347+0000","last_became_peered":"2023-11-26T07:17:35.289347+0000","last_unstale":"2023-11-26T07:17:36.853372+0000","last_undegraded":"2023-11-26T07:17:36.853372+0000","last_fullsized":"2023-11-26T07:17:36.853372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290077+0000","last_change":"2023-11-26T07:17:35.285314+0000","last_active":"2023-11-26T07:17:36.290077+0000","last_peered":"2023-11-26T07:17:36.290077+0000","last_clean":"2023-11-26T07:17:36.290077+0000","last_became_active":"2023-11-26T07:17:35.283583+0000","last_became_peered":"2023-11-26T07:17:35.283583+0000","last_unstale":"2023-11-26T07:17:36.290077+0000","last_undegraded":"2023-11-26T07:17:36.290077+0000","last_fullsized":"2023-11-26T07:17:36.290077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857606+0000","last_change":"2023-11-26T07:17:35.294791+0000","last_active":"2023-11-26T07:17:36.857606+0000","last_peered":"2023-11-26T07:17:36.857606+0000","last_clean":"2023-11-26T07:17:36.857606+0000","last_became_active":"2023-11-26T07:17:35.294267+0000","last_became_peered":"2023-11-26T07:17:35.294267+0000","last_unstale":"2023-11-26T07:17:36.857606+0000","last_undegraded":"2023-11-26T07:17:36.857606+0000","last_fullsized":"2023-11-26T07:17:36.857606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:14:14.039125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856211+0000","last_change":"2023-11-26T07:17:35.291521+0000","last_active":"2023-11-26T07:17:36.856211+0000","last_peered":"2023-11-26T07:17:36.856211+0000","last_clean":"2023-11-26T07:17:36.856211+0000","last_became_active":"2023-11-26T07:17:35.290900+0000","last_became_peered":"2023-11-26T07:17:35.290900+0000","last_unstale":"2023-11-26T07:17:36.856211+0000","last_undegraded":"2023-11-26T07:17:36.856211+0000","last_fullsized":"2023-11-26T07:17:36.856211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855424+0000","last_change":"2023-11-26T07:17:35.293941+0000","last_active":"2023-11-26T07:17:36.855424+0000","last_peered":"2023-11-26T07:17:36.855424+0000","last_clean":"2023-11-26T07:17:36.855424+0000","last_became_active":"2023-11-26T07:17:35.293485+0000","last_became_peered":"2023-11-26T07:17:35.293485+0000","last_unstale":"2023-11-26T07:17:36.855424+0000","last_undegraded":"2023-11-26T07:17:36.855424+0000","last_fullsized":"2023-11-26T07:17:36.855424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856924+0000","last_change":"2023-11-26T07:17:35.302079+0000","last_active":"2023-11-26T07:17:36.856924+0000","last_peered":"2023-11-26T07:17:36.856924+0000","last_clean":"2023-11-26T07:17:36.856924+0000","last_became_active":"2023-11-26T07:17:35.297582+0000","last_became_peered":"2023-11-26T07:17:35.297582+0000","last_unstale":"2023-11-26T07:17:36.856924+0000","last_undegraded":"2023-11-26T07:17:36.856924+0000","last_fullsized":"2023-11-26T07:17:36.856924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:31.406679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291168+0000","last_change":"2023-11-26T07:17:35.286562+0000","last_active":"2023-11-26T07:17:36.291168+0000","last_peered":"2023-11-26T07:17:36.291168+0000","last_clean":"2023-11-26T07:17:36.291168+0000","last_became_active":"2023-11-26T07:17:35.286252+0000","last_became_peered":"2023-11-26T07:17:35.286252+0000","last_unstale":"2023-11-26T07:17:36.291168+0000","last_undegraded":"2023-11-26T07:17:36.291168+0000","last_fullsized":"2023-11-26T07:17:36.291168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288118+0000","last_change":"2023-11-26T07:17:35.281910+0000","last_active":"2023-11-26T07:17:36.288118+0000","last_peered":"2023-11-26T07:17:36.288118+0000","last_clean":"2023-11-26T07:17:36.288118+0000","last_became_active":"2023-11-26T07:17:35.281535+0000","last_became_peered":"2023-11-26T07:17:35.281535+0000","last_unstale":"2023-11-26T07:17:36.288118+0000","last_undegraded":"2023-11-26T07:17:36.288118+0000","last_fullsized":"2023-11-26T07:17:36.288118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:59.107380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852568+0000","last_change":"2023-11-26T07:17:35.305449+0000","last_active":"2023-11-26T07:17:36.852568+0000","last_peered":"2023-11-26T07:17:36.852568+0000","last_clean":"2023-11-26T07:17:36.852568+0000","last_became_active":"2023-11-26T07:17:35.305109+0000","last_became_peered":"2023-11-26T07:17:35.305109+0000","last_unstale":"2023-11-26T07:17:36.852568+0000","last_undegraded":"2023-11-26T07:17:36.852568+0000","last_fullsized":"2023-11-26T07:17:36.852568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290585+0000","last_change":"2023-11-26T07:17:35.278078+0000","last_active":"2023-11-26T07:17:36.290585+0000","last_peered":"2023-11-26T07:17:36.290585+0000","last_clean":"2023-11-26T07:17:36.290585+0000","last_became_active":"2023-11-26T07:17:35.277756+0000","last_became_peered":"2023-11-26T07:17:35.277756+0000","last_unstale":"2023-11-26T07:17:36.290585+0000","last_undegraded":"2023-11-26T07:17:36.290585+0000","last_fullsized":"2023-11-26T07:17:36.290585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.292426+0000","last_change":"2023-11-26T07:17:35.292521+0000","last_active":"2023-11-26T07:17:36.292426+0000","last_peered":"2023-11-26T07:17:36.292426+0000","last_clean":"2023-11-26T07:17:36.292426+0000","last_became_active":"2023-11-26T07:17:35.290387+0000","last_became_peered":"2023-11-26T07:17:35.290387+0000","last_unstale":"2023-11-26T07:17:36.292426+0000","last_undegraded":"2023-11-26T07:17:36.292426+0000","last_fullsized":"2023-11-26T07:17:36.292426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:37:30.364077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.348275+0000","last_change":"2023-11-26T07:17:35.289305+0000","last_active":"2023-11-26T07:17:36.348275+0000","last_peered":"2023-11-26T07:17:36.348275+0000","last_clean":"2023-11-26T07:17:36.348275+0000","last_became_active":"2023-11-26T07:17:35.288484+0000","last_became_peered":"2023-11-26T07:17:35.288484+0000","last_unstale":"2023-11-26T07:17:36.348275+0000","last_undegraded":"2023-11-26T07:17:36.348275+0000","last_fullsized":"2023-11-26T07:17:36.348275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:44:59.432835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.854493+0000","last_change":"2023-11-26T07:17:35.295513+0000","last_active":"2023-11-26T07:17:36.854493+0000","last_peered":"2023-11-26T07:17:36.854493+0000","last_clean":"2023-11-26T07:17:36.854493+0000","last_became_active":"2023-11-26T07:17:35.295339+0000","last_became_peered":"2023-11-26T07:17:35.295339+0000","last_unstale":"2023-11-26T07:17:36.854493+0000","last_undegraded":"2023-11-26T07:17:36.854493+0000","last_fullsized":"2023-11-26T07:17:36.854493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:51:44.669299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856229+0000","last_change":"2023-11-26T07:17:35.304162+0000","last_active":"2023-11-26T07:17:36.856229+0000","last_peered":"2023-11-26T07:17:36.856229+0000","last_clean":"2023-11-26T07:17:36.856229+0000","last_became_active":"2023-11-26T07:17:35.303775+0000","last_became_peered":"2023-11-26T07:17:35.303775+0000","last_unstale":"2023-11-26T07:17:36.856229+0000","last_undegraded":"2023-11-26T07:17:36.856229+0000","last_fullsized":"2023-11-26T07:17:36.856229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288359+0000","last_change":"2023-11-26T07:17:35.289136+0000","last_active":"2023-11-26T07:17:36.288359+0000","last_peered":"2023-11-26T07:17:36.288359+0000","last_clean":"2023-11-26T07:17:36.288359+0000","last_became_active":"2023-11-26T07:17:35.288824+0000","last_became_peered":"2023-11-26T07:17:35.288824+0000","last_unstale":"2023-11-26T07:17:36.288359+0000","last_undegraded":"2023-11-26T07:17:36.288359+0000","last_fullsized":"2023-11-26T07:17:36.288359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:51.436807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290977+0000","last_change":"2023-11-26T07:17:35.299639+0000","last_active":"2023-11-26T07:17:36.290977+0000","last_peered":"2023-11-26T07:17:36.290977+0000","last_clean":"2023-11-26T07:17:36.290977+0000","last_became_active":"2023-11-26T07:17:35.298838+0000","last_became_peered":"2023-11-26T07:17:35.298838+0000","last_unstale":"2023-11-26T07:17:36.290977+0000","last_undegraded":"2023-11-26T07:17:36.290977+0000","last_fullsized":"2023-11-26T07:17:36.290977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290258+0000","last_change":"2023-11-26T07:17:35.288263+0000","last_active":"2023-11-26T07:17:36.290258+0000","last_peered":"2023-11-26T07:17:36.290258+0000","last_clean":"2023-11-26T07:17:36.290258+0000","last_became_active":"2023-11-26T07:17:35.287907+0000","last_became_peered":"2023-11-26T07:17:35.287907+0000","last_unstale":"2023-11-26T07:17:36.290258+0000","last_undegraded":"2023-11-26T07:17:36.290258+0000","last_fullsized":"2023-11-26T07:17:36.290258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290741+0000","last_change":"2023-11-26T07:17:35.298420+0000","last_active":"2023-11-26T07:17:36.290741+0000","last_peered":"2023-11-26T07:17:36.290741+0000","last_clean":"2023-11-26T07:17:36.290741+0000","last_became_active":"2023-11-26T07:17:35.297672+0000","last_became_peered":"2023-11-26T07:17:35.297672+0000","last_unstale":"2023-11-26T07:17:36.290741+0000","last_undegraded":"2023-11-26T07:17:36.290741+0000","last_fullsized":"2023-11-26T07:17:36.290741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291207+0000","last_change":"2023-11-26T07:17:35.299072+0000","last_active":"2023-11-26T07:17:36.291207+0000","last_peered":"2023-11-26T07:17:36.291207+0000","last_clean":"2023-11-26T07:17:36.291207+0000","last_became_active":"2023-11-26T07:17:35.298748+0000","last_became_peered":"2023-11-26T07:17:35.298748+0000","last_unstale":"2023-11-26T07:17:36.291207+0000","last_undegraded":"2023-11-26T07:17:36.291207+0000","last_fullsized":"2023-11-26T07:17:36.291207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855537+0000","last_change":"2023-11-26T07:17:35.295203+0000","last_active":"2023-11-26T07:17:36.855537+0000","last_peered":"2023-11-26T07:17:36.855537+0000","last_clean":"2023-11-26T07:17:36.855537+0000","last_became_active":"2023-11-26T07:17:35.294921+0000","last_became_peered":"2023-11-26T07:17:35.294921+0000","last_unstale":"2023-11-26T07:17:36.855537+0000","last_undegraded":"2023-11-26T07:17:36.855537+0000","last_fullsized":"2023-11-26T07:17:36.855537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852945+0000","last_change":"2023-11-26T07:17:35.288826+0000","last_active":"2023-11-26T07:17:36.852945+0000","last_peered":"2023-11-26T07:17:36.852945+0000","last_clean":"2023-11-26T07:17:36.852945+0000","last_became_active":"2023-11-26T07:17:35.288535+0000","last_became_peered":"2023-11-26T07:17:35.288535+0000","last_unstale":"2023-11-26T07:17:36.852945+0000","last_undegraded":"2023-11-26T07:17:36.852945+0000","last_fullsized":"2023-11-26T07:17:36.852945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291234+0000","last_change":"2023-11-26T07:17:35.299788+0000","last_active":"2023-11-26T07:17:36.291234+0000","last_peered":"2023-11-26T07:17:36.291234+0000","last_clean":"2023-11-26T07:17:36.291234+0000","last_became_active":"2023-11-26T07:17:35.299537+0000","last_became_peered":"2023-11-26T07:17:35.299537+0000","last_unstale":"2023-11-26T07:17:36.291234+0000","last_undegraded":"2023-11-26T07:17:36.291234+0000","last_fullsized":"2023-11-26T07:17:36.291234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288966+0000","last_change":"2023-11-26T07:17:35.291110+0000","last_active":"2023-11-26T07:17:36.288966+0000","last_peered":"2023-11-26T07:17:36.288966+0000","last_clean":"2023-11-26T07:17:36.288966+0000","last_became_active":"2023-11-26T07:17:35.290817+0000","last_became_peered":"2023-11-26T07:17:35.290817+0000","last_unstale":"2023-11-26T07:17:36.288966+0000","last_undegraded":"2023-11-26T07:17:36.288966+0000","last_fullsized":"2023-11-26T07:17:36.288966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291138+0000","last_change":"2023-11-26T07:17:35.299321+0000","last_active":"2023-11-26T07:17:36.291138+0000","last_peered":"2023-11-26T07:17:36.291138+0000","last_clean":"2023-11-26T07:17:36.291138+0000","last_became_active":"2023-11-26T07:17:35.296813+0000","last_became_peered":"2023-11-26T07:17:35.296813+0000","last_unstale":"2023-11-26T07:17:36.291138+0000","last_undegraded":"2023-11-26T07:17:36.291138+0000","last_fullsized":"2023-11-26T07:17:36.291138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.347730+0000","last_change":"2023-11-26T07:17:35.298470+0000","last_active":"2023-11-26T07:17:36.347730+0000","last_peered":"2023-11-26T07:17:36.347730+0000","last_clean":"2023-11-26T07:17:36.347730+0000","last_became_active":"2023-11-26T07:17:35.298120+0000","last_became_peered":"2023-11-26T07:17:35.298120+0000","last_unstale":"2023-11-26T07:17:36.347730+0000","last_undegraded":"2023-11-26T07:17:36.347730+0000","last_fullsized":"2023-11-26T07:17:36.347730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:01.790753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853467+0000","last_change":"2023-11-26T07:17:35.286010+0000","last_active":"2023-11-26T07:17:36.853467+0000","last_peered":"2023-11-26T07:17:36.853467+0000","last_clean":"2023-11-26T07:17:36.853467+0000","last_became_active":"2023-11-26T07:17:35.284996+0000","last_became_peered":"2023-11-26T07:17:35.284996+0000","last_unstale":"2023-11-26T07:17:36.853467+0000","last_undegraded":"2023-11-26T07:17:36.853467+0000","last_fullsized":"2023-11-26T07:17:36.853467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:51.436807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855545+0000","last_change":"2023-11-26T07:17:35.287101+0000","last_active":"2023-11-26T07:17:36.855545+0000","last_peered":"2023-11-26T07:17:36.855545+0000","last_clean":"2023-11-26T07:17:36.855545+0000","last_became_active":"2023-11-26T07:17:35.286319+0000","last_became_peered":"2023-11-26T07:17:35.286319+0000","last_unstale":"2023-11-26T07:17:36.855545+0000","last_undegraded":"2023-11-26T07:17:36.855545+0000","last_fullsized":"2023-11-26T07:17:36.855545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:27.986808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308605+0000","last_change":"2023-11-26T07:17:34.260424+0000","last_active":"2023-11-26T07:17:35.308605+0000","last_peered":"2023-11-26T07:17:35.308605+0000","last_clean":"2023-11-26T07:17:35.308605+0000","last_became_active":"2023-11-26T07:17:34.260186+0000","last_became_peered":"2023-11-26T07:17:34.260186+0000","last_unstale":"2023-11-26T07:17:35.308605+0000","last_undegraded":"2023-11-26T07:17:35.308605+0000","last_fullsized":"2023-11-26T07:17:35.308605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:50.431819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289063+0000","last_change":"2023-11-26T07:17:35.296870+0000","last_active":"2023-11-26T07:17:36.289063+0000","last_peered":"2023-11-26T07:17:36.289063+0000","last_clean":"2023-11-26T07:17:36.289063+0000","last_became_active":"2023-11-26T07:17:35.296511+0000","last_became_peered":"2023-11-26T07:17:35.296511+0000","last_unstale":"2023-11-26T07:17:36.289063+0000","last_undegraded":"2023-11-26T07:17:36.289063+0000","last_fullsized":"2023-11-26T07:17:36.289063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312260+0000","last_change":"2023-11-26T07:17:34.272272+0000","last_active":"2023-11-26T07:17:35.312260+0000","last_peered":"2023-11-26T07:17:35.312260+0000","last_clean":"2023-11-26T07:17:35.312260+0000","last_became_active":"2023-11-26T07:17:34.271546+0000","last_became_peered":"2023-11-26T07:17:34.271546+0000","last_unstale":"2023-11-26T07:17:35.312260+0000","last_undegraded":"2023-11-26T07:17:35.312260+0000","last_fullsized":"2023-11-26T07:17:35.312260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:07.401822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.263326+0000","last_change":"2023-11-26T07:17:34.270516+0000","last_active":"2023-11-26T07:17:35.263326+0000","last_peered":"2023-11-26T07:17:35.263326+0000","last_clean":"2023-11-26T07:17:35.263326+0000","last_became_active":"2023-11-26T07:17:34.270272+0000","last_became_peered":"2023-11-26T07:17:34.270272+0000","last_unstale":"2023-11-26T07:17:35.263326+0000","last_undegraded":"2023-11-26T07:17:35.263326+0000","last_fullsized":"2023-11-26T07:17:35.263326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:31.214665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290438+0000","last_change":"2023-11-26T07:17:35.282691+0000","last_active":"2023-11-26T07:17:36.290438+0000","last_peered":"2023-11-26T07:17:36.290438+0000","last_clean":"2023-11-26T07:17:36.290438+0000","last_became_active":"2023-11-26T07:17:35.282434+0000","last_became_peered":"2023-11-26T07:17:35.282434+0000","last_unstale":"2023-11-26T07:17:36.290438+0000","last_undegraded":"2023-11-26T07:17:36.290438+0000","last_fullsized":"2023-11-26T07:17:36.290438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.263324+0000","last_change":"2023-11-26T07:17:34.264012+0000","last_active":"2023-11-26T07:17:35.263324+0000","last_peered":"2023-11-26T07:17:35.263324+0000","last_clean":"2023-11-26T07:17:35.263324+0000","last_became_active":"2023-11-26T07:17:34.262939+0000","last_became_peered":"2023-11-26T07:17:34.262939+0000","last_unstale":"2023-11-26T07:17:35.263324+0000","last_undegraded":"2023-11-26T07:17:35.263324+0000","last_fullsized":"2023-11-26T07:17:35.263324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:47.932199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852561+0000","last_change":"2023-11-26T07:17:35.290951+0000","last_active":"2023-11-26T07:17:36.852561+0000","last_peered":"2023-11-26T07:17:36.852561+0000","last_clean":"2023-11-26T07:17:36.852561+0000","last_became_active":"2023-11-26T07:17:35.290575+0000","last_became_peered":"2023-11-26T07:17:35.290575+0000","last_unstale":"2023-11-26T07:17:36.852561+0000","last_undegraded":"2023-11-26T07:17:36.852561+0000","last_fullsized":"2023-11-26T07:17:36.852561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.274062+0000","last_change":"2023-11-26T07:17:34.270339+0000","last_active":"2023-11-26T07:17:35.274062+0000","last_peered":"2023-11-26T07:17:35.274062+0000","last_clean":"2023-11-26T07:17:35.274062+0000","last_became_active":"2023-11-26T07:17:34.270058+0000","last_became_peered":"2023-11-26T07:17:34.270058+0000","last_unstale":"2023-11-26T07:17:35.274062+0000","last_undegraded":"2023-11-26T07:17:35.274062+0000","last_fullsized":"2023-11-26T07:17:35.274062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:00.785765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.292197+0000","last_change":"2023-11-26T07:17:35.292487+0000","last_active":"2023-11-26T07:17:36.292197+0000","last_peered":"2023-11-26T07:17:36.292197+0000","last_clean":"2023-11-26T07:17:36.292197+0000","last_became_active":"2023-11-26T07:17:35.291651+0000","last_became_peered":"2023-11-26T07:17:35.291651+0000","last_unstale":"2023-11-26T07:17:36.292197+0000","last_undegraded":"2023-11-26T07:17:36.292197+0000","last_fullsized":"2023-11-26T07:17:36.292197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:14:14.039125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.264303+0000","last_change":"2023-11-26T07:17:34.271134+0000","last_active":"2023-11-26T07:17:35.264303+0000","last_peered":"2023-11-26T07:17:35.264303+0000","last_clean":"2023-11-26T07:17:35.264303+0000","last_became_active":"2023-11-26T07:17:34.270420+0000","last_became_peered":"2023-11-26T07:17:34.270420+0000","last_unstale":"2023-11-26T07:17:35.264303+0000","last_undegraded":"2023-11-26T07:17:35.264303+0000","last_fullsized":"2023-11-26T07:17:35.264303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:39.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289872+0000","last_change":"2023-11-26T07:17:35.290019+0000","last_active":"2023-11-26T07:17:36.289872+0000","last_peered":"2023-11-26T07:17:36.289872+0000","last_clean":"2023-11-26T07:17:36.289872+0000","last_became_active":"2023-11-26T07:17:35.289735+0000","last_became_peered":"2023-11-26T07:17:35.289735+0000","last_unstale":"2023-11-26T07:17:36.289872+0000","last_undegraded":"2023-11-26T07:17:36.289872+0000","last_fullsized":"2023-11-26T07:17:36.289872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.309286+0000","last_change":"2023-11-26T07:17:34.253890+0000","last_active":"2023-11-26T07:17:35.309286+0000","last_peered":"2023-11-26T07:17:35.309286+0000","last_clean":"2023-11-26T07:17:35.309286+0000","last_became_active":"2023-11-26T07:17:34.252298+0000","last_became_peered":"2023-11-26T07:17:34.252298+0000","last_unstale":"2023-11-26T07:17:35.309286+0000","last_undegraded":"2023-11-26T07:17:35.309286+0000","last_fullsized":"2023-11-26T07:17:35.309286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:04.297880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857233+0000","last_change":"2023-11-26T07:17:35.299159+0000","last_active":"2023-11-26T07:17:36.857233+0000","last_peered":"2023-11-26T07:17:36.857233+0000","last_clean":"2023-11-26T07:17:36.857233+0000","last_became_active":"2023-11-26T07:17:35.298172+0000","last_became_peered":"2023-11-26T07:17:35.298172+0000","last_unstale":"2023-11-26T07:17:36.857233+0000","last_undegraded":"2023-11-26T07:17:36.857233+0000","last_fullsized":"2023-11-26T07:17:36.857233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:01.790753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.313145+0000","last_change":"2023-11-26T07:17:34.269809+0000","last_active":"2023-11-26T07:17:35.313145+0000","last_peered":"2023-11-26T07:17:35.313145+0000","last_clean":"2023-11-26T07:17:35.313145+0000","last_became_active":"2023-11-26T07:17:34.264015+0000","last_became_peered":"2023-11-26T07:17:34.264015+0000","last_unstale":"2023-11-26T07:17:35.313145+0000","last_undegraded":"2023-11-26T07:17:35.313145+0000","last_fullsized":"2023-11-26T07:17:35.313145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853444+0000","last_change":"2023-11-26T07:17:35.290779+0000","last_active":"2023-11-26T07:17:36.853444+0000","last_peered":"2023-11-26T07:17:36.853444+0000","last_clean":"2023-11-26T07:17:36.853444+0000","last_became_active":"2023-11-26T07:17:35.290504+0000","last_became_peered":"2023-11-26T07:17:35.290504+0000","last_unstale":"2023-11-26T07:17:36.853444+0000","last_undegraded":"2023-11-26T07:17:36.853444+0000","last_fullsized":"2023-11-26T07:17:36.853444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312451+0000","last_change":"2023-11-26T07:17:34.261601+0000","last_active":"2023-11-26T07:17:35.312451+0000","last_peered":"2023-11-26T07:17:35.312451+0000","last_clean":"2023-11-26T07:17:35.312451+0000","last_became_active":"2023-11-26T07:17:34.261232+0000","last_became_peered":"2023-11-26T07:17:34.261232+0000","last_unstale":"2023-11-26T07:17:35.312451+0000","last_undegraded":"2023-11-26T07:17:35.312451+0000","last_fullsized":"2023-11-26T07:17:35.312451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:30.401691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288255+0000","last_change":"2023-11-26T07:17:35.290421+0000","last_active":"2023-11-26T07:17:36.288255+0000","last_peered":"2023-11-26T07:17:36.288255+0000","last_clean":"2023-11-26T07:17:36.288255+0000","last_became_active":"2023-11-26T07:17:35.290069+0000","last_became_peered":"2023-11-26T07:17:35.290069+0000","last_unstale":"2023-11-26T07:17:36.288255+0000","last_undegraded":"2023-11-26T07:17:36.288255+0000","last_fullsized":"2023-11-26T07:17:36.288255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:05.302868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.266362+0000","last_change":"2023-11-26T07:17:34.263984+0000","last_active":"2023-11-26T07:17:35.266362+0000","last_peered":"2023-11-26T07:17:35.266362+0000","last_clean":"2023-11-26T07:17:35.266362+0000","last_became_active":"2023-11-26T07:17:34.263647+0000","last_became_peered":"2023-11-26T07:17:34.263647+0000","last_unstale":"2023-11-26T07:17:35.266362+0000","last_undegraded":"2023-11-26T07:17:35.266362+0000","last_fullsized":"2023-11-26T07:17:35.266362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:50.841460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853983+0000","last_change":"2023-11-26T07:17:35.307695+0000","last_active":"2023-11-26T07:17:36.853983+0000","last_peered":"2023-11-26T07:17:36.853983+0000","last_clean":"2023-11-26T07:17:36.853983+0000","last_became_active":"2023-11-26T07:17:35.307322+0000","last_became_peered":"2023-11-26T07:17:35.307322+0000","last_unstale":"2023-11-26T07:17:36.853983+0000","last_undegraded":"2023-11-26T07:17:36.853983+0000","last_fullsized":"2023-11-26T07:17:36.853983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:31.633994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.271599+0000","last_change":"2023-11-26T07:17:34.267209+0000","last_active":"2023-11-26T07:17:35.271599+0000","last_peered":"2023-11-26T07:17:35.271599+0000","last_clean":"2023-11-26T07:17:35.271599+0000","last_became_active":"2023-11-26T07:17:34.266896+0000","last_became_peered":"2023-11-26T07:17:34.266896+0000","last_unstale":"2023-11-26T07:17:35.271599+0000","last_undegraded":"2023-11-26T07:17:35.271599+0000","last_fullsized":"2023-11-26T07:17:35.271599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:26.981820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853828+0000","last_change":"2023-11-26T07:17:35.285662+0000","last_active":"2023-11-26T07:17:36.853828+0000","last_peered":"2023-11-26T07:17:36.853828+0000","last_clean":"2023-11-26T07:17:36.853828+0000","last_became_active":"2023-11-26T07:17:35.285344+0000","last_became_peered":"2023-11-26T07:17:35.285344+0000","last_unstale":"2023-11-26T07:17:36.853828+0000","last_undegraded":"2023-11-26T07:17:36.853828+0000","last_fullsized":"2023-11-26T07:17:36.853828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.313128+0000","last_change":"2023-11-26T07:17:34.255794+0000","last_active":"2023-11-26T07:17:35.313128+0000","last_peered":"2023-11-26T07:17:35.313128+0000","last_clean":"2023-11-26T07:17:35.313128+0000","last_became_active":"2023-11-26T07:17:34.255495+0000","last_became_peered":"2023-11-26T07:17:34.255495+0000","last_unstale":"2023-11-26T07:17:35.313128+0000","last_undegraded":"2023-11-26T07:17:35.313128+0000","last_fullsized":"2023-11-26T07:17:35.313128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:26.981820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853750+0000","last_change":"2023-11-26T07:17:35.299739+0000","last_active":"2023-11-26T07:17:36.853750+0000","last_peered":"2023-11-26T07:17:36.853750+0000","last_clean":"2023-11-26T07:17:36.853750+0000","last_became_active":"2023-11-26T07:17:35.299412+0000","last_became_peered":"2023-11-26T07:17:35.299412+0000","last_unstale":"2023-11-26T07:17:36.853750+0000","last_undegraded":"2023-11-26T07:17:36.853750+0000","last_fullsized":"2023-11-26T07:17:36.853750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.311528+0000","last_change":"2023-11-26T07:17:34.261567+0000","last_active":"2023-11-26T07:17:35.311528+0000","last_peered":"2023-11-26T07:17:35.311528+0000","last_clean":"2023-11-26T07:17:35.311528+0000","last_became_active":"2023-11-26T07:17:34.261083+0000","last_became_peered":"2023-11-26T07:17:34.261083+0000","last_unstale":"2023-11-26T07:17:35.311528+0000","last_undegraded":"2023-11-26T07:17:35.311528+0000","last_fullsized":"2023-11-26T07:17:35.311528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:33:02.627652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857599+0000","last_change":"2023-11-26T07:17:35.307619+0000","last_active":"2023-11-26T07:17:36.857599+0000","last_peered":"2023-11-26T07:17:36.857599+0000","last_clean":"2023-11-26T07:17:36.857599+0000","last_became_active":"2023-11-26T07:17:35.307322+0000","last_became_peered":"2023-11-26T07:17:35.307322+0000","last_unstale":"2023-11-26T07:17:36.857599+0000","last_undegraded":"2023-11-26T07:17:36.857599+0000","last_fullsized":"2023-11-26T07:17:36.857599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:59:08.684829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308810+0000","last_change":"2023-11-26T07:17:34.259965+0000","last_active":"2023-11-26T07:17:35.308810+0000","last_peered":"2023-11-26T07:17:35.308810+0000","last_clean":"2023-11-26T07:17:35.308810+0000","last_became_active":"2023-11-26T07:17:34.259453+0000","last_became_peered":"2023-11-26T07:17:34.259453+0000","last_unstale":"2023-11-26T07:17:35.308810+0000","last_undegraded":"2023-11-26T07:17:35.308810+0000","last_fullsized":"2023-11-26T07:17:35.308810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:31.214665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857855+0000","last_change":"2023-11-26T07:17:35.305671+0000","last_active":"2023-11-26T07:17:36.857855+0000","last_peered":"2023-11-26T07:17:36.857855+0000","last_clean":"2023-11-26T07:17:36.857855+0000","last_became_active":"2023-11-26T07:17:35.304797+0000","last_became_peered":"2023-11-26T07:17:35.304797+0000","last_unstale":"2023-11-26T07:17:36.857855+0000","last_undegraded":"2023-11-26T07:17:36.857855+0000","last_fullsized":"2023-11-26T07:17:36.857855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:37:30.364077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312107+0000","last_change":"2023-11-26T07:17:34.260843+0000","last_active":"2023-11-26T07:17:35.312107+0000","last_peered":"2023-11-26T07:17:35.312107+0000","last_clean":"2023-11-26T07:17:35.312107+0000","last_became_active":"2023-11-26T07:17:34.260492+0000","last_became_peered":"2023-11-26T07:17:34.260492+0000","last_unstale":"2023-11-26T07:17:35.312107+0000","last_undegraded":"2023-11-26T07:17:35.312107+0000","last_fullsized":"2023-11-26T07:17:35.312107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:56.938162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291587+0000","last_change":"2023-11-26T07:17:35.299197+0000","last_active":"2023-11-26T07:17:36.291587+0000","last_peered":"2023-11-26T07:17:36.291587+0000","last_clean":"2023-11-26T07:17:36.291587+0000","last_became_active":"2023-11-26T07:17:35.297708+0000","last_became_peered":"2023-11-26T07:17:35.297708+0000","last_unstale":"2023-11-26T07:17:36.291587+0000","last_undegraded":"2023-11-26T07:17:36.291587+0000","last_fullsized":"2023-11-26T07:17:36.291587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:51:44.669299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275592+0000","last_change":"2023-11-26T07:17:34.263596+0000","last_active":"2023-11-26T07:17:35.275592+0000","last_peered":"2023-11-26T07:17:35.275592+0000","last_clean":"2023-11-26T07:17:35.275592+0000","last_became_active":"2023-11-26T07:17:34.263296+0000","last_became_peered":"2023-11-26T07:17:34.263296+0000","last_unstale":"2023-11-26T07:17:35.275592+0000","last_undegraded":"2023-11-26T07:17:35.275592+0000","last_fullsized":"2023-11-26T07:17:35.275592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:07.401822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853854+0000","last_change":"2023-11-26T07:17:35.295518+0000","last_active":"2023-11-26T07:17:36.853854+0000","last_peered":"2023-11-26T07:17:36.853854+0000","last_clean":"2023-11-26T07:17:36.853854+0000","last_became_active":"2023-11-26T07:17:35.295352+0000","last_became_peered":"2023-11-26T07:17:35.295352+0000","last_unstale":"2023-11-26T07:17:36.853854+0000","last_undegraded":"2023-11-26T07:17:36.853854+0000","last_fullsized":"2023-11-26T07:17:36.853854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275660+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:17:35.275660+0000","last_peered":"2023-11-26T07:17:35.275660+0000","last_clean":"2023-11-26T07:17:35.275660+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:17:35.275660+0000","last_undegraded":"2023-11-26T07:17:35.275660+0000","last_fullsized":"2023-11-26T07:17:35.275660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.260546+0000","last_change":"2023-11-26T07:17:34.260166+0000","last_active":"2023-11-26T07:17:35.260546+0000","last_peered":"2023-11-26T07:17:35.260546+0000","last_clean":"2023-11-26T07:17:35.260546+0000","last_became_active":"2023-11-26T07:17:34.259813+0000","last_became_peered":"2023-11-26T07:17:34.259813+0000","last_unstale":"2023-11-26T07:17:35.260546+0000","last_undegraded":"2023-11-26T07:17:35.260546+0000","last_fullsized":"2023-11-26T07:17:35.260546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290730+0000","last_change":"2023-11-26T07:17:35.287427+0000","last_active":"2023-11-26T07:17:36.290730+0000","last_peered":"2023-11-26T07:17:36.290730+0000","last_clean":"2023-11-26T07:17:36.290730+0000","last_became_active":"2023-11-26T07:17:35.287153+0000","last_became_peered":"2023-11-26T07:17:35.287153+0000","last_unstale":"2023-11-26T07:17:36.290730+0000","last_undegraded":"2023-11-26T07:17:36.290730+0000","last_fullsized":"2023-11-26T07:17:36.290730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275512+0000","last_change":"2023-11-26T07:17:34.271952+0000","last_active":"2023-11-26T07:17:35.275512+0000","last_peered":"2023-11-26T07:17:35.275512+0000","last_clean":"2023-11-26T07:17:35.275512+0000","last_became_active":"2023-11-26T07:17:34.271686+0000","last_became_peered":"2023-11-26T07:17:34.271686+0000","last_unstale":"2023-11-26T07:17:35.275512+0000","last_undegraded":"2023-11-26T07:17:35.275512+0000","last_fullsized":"2023-11-26T07:17:35.275512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.287880+0000","last_change":"2023-11-26T07:17:35.289335+0000","last_active":"2023-11-26T07:17:36.287880+0000","last_peered":"2023-11-26T07:17:36.287880+0000","last_clean":"2023-11-26T07:17:36.287880+0000","last_became_active":"2023-11-26T07:17:35.288975+0000","last_became_peered":"2023-11-26T07:17:35.288975+0000","last_unstale":"2023-11-26T07:17:36.287880+0000","last_undegraded":"2023-11-26T07:17:36.287880+0000","last_fullsized":"2023-11-26T07:17:36.287880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:35.805458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.271170+0000","last_change":"2023-11-26T07:17:34.259717+0000","last_active":"2023-11-26T07:17:35.271170+0000","last_peered":"2023-11-26T07:17:35.271170+0000","last_clean":"2023-11-26T07:17:35.271170+0000","last_became_active":"2023-11-26T07:17:34.259440+0000","last_became_peered":"2023-11-26T07:17:34.259440+0000","last_unstale":"2023-11-26T07:17:35.271170+0000","last_undegraded":"2023-11-26T07:17:35.271170+0000","last_fullsized":"2023-11-26T07:17:35.271170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:19:01.400658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852532+0000","last_change":"2023-11-26T07:17:35.284821+0000","last_active":"2023-11-26T07:17:36.852532+0000","last_peered":"2023-11-26T07:17:36.852532+0000","last_clean":"2023-11-26T07:17:36.852532+0000","last_became_active":"2023-11-26T07:17:35.283626+0000","last_became_peered":"2023-11-26T07:17:35.283626+0000","last_unstale":"2023-11-26T07:17:36.852532+0000","last_undegraded":"2023-11-26T07:17:36.852532+0000","last_fullsized":"2023-11-26T07:17:36.852532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.265947+0000","last_change":"2023-11-26T07:17:34.258767+0000","last_active":"2023-11-26T07:17:35.265947+0000","last_peered":"2023-11-26T07:17:35.265947+0000","last_clean":"2023-11-26T07:17:35.265947+0000","last_became_active":"2023-11-26T07:17:34.257967+0000","last_became_peered":"2023-11-26T07:17:34.257967+0000","last_unstale":"2023-11-26T07:17:35.265947+0000","last_undegraded":"2023-11-26T07:17:35.265947+0000","last_fullsized":"2023-11-26T07:17:35.265947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:13.669938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856130+0000","last_change":"2023-11-26T07:17:35.303810+0000","last_active":"2023-11-26T07:17:36.856130+0000","last_peered":"2023-11-26T07:17:36.856130+0000","last_clean":"2023-11-26T07:17:36.856130+0000","last_became_active":"2023-11-26T07:17:35.303085+0000","last_became_peered":"2023-11-26T07:17:35.303085+0000","last_unstale":"2023-11-26T07:17:36.856130+0000","last_undegraded":"2023-11-26T07:17:36.856130+0000","last_fullsized":"2023-11-26T07:17:36.856130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:08.406810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.278333+0000","last_change":"2023-11-26T07:17:34.256005+0000","last_active":"2023-11-26T07:17:35.278333+0000","last_peered":"2023-11-26T07:17:35.278333+0000","last_clean":"2023-11-26T07:17:35.278333+0000","last_became_active":"2023-11-26T07:17:34.255598+0000","last_became_peered":"2023-11-26T07:17:34.255598+0000","last_unstale":"2023-11-26T07:17:35.278333+0000","last_undegraded":"2023-11-26T07:17:35.278333+0000","last_fullsized":"2023-11-26T07:17:35.278333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:47.932199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291901+0000","last_change":"2023-11-26T07:17:35.293918+0000","last_active":"2023-11-26T07:17:36.291901+0000","last_peered":"2023-11-26T07:17:36.291901+0000","last_clean":"2023-11-26T07:17:36.291901+0000","last_became_active":"2023-11-26T07:17:35.293651+0000","last_became_peered":"2023-11-26T07:17:35.293651+0000","last_unstale":"2023-11-26T07:17:36.291901+0000","last_undegraded":"2023-11-26T07:17:36.291901+0000","last_fullsized":"2023-11-26T07:17:36.291901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:59:08.684829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.285652+0000","last_change":"2023-11-26T07:17:34.274703+0000","last_active":"2023-11-26T07:17:35.285652+0000","last_peered":"2023-11-26T07:17:35.285652+0000","last_clean":"2023-11-26T07:17:35.285652+0000","last_became_active":"2023-11-26T07:17:34.274347+0000","last_became_peered":"2023-11-26T07:17:34.274347+0000","last_unstale":"2023-11-26T07:17:35.285652+0000","last_undegraded":"2023-11-26T07:17:35.285652+0000","last_fullsized":"2023-11-26T07:17:35.285652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:13.669938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852897+0000","last_change":"2023-11-26T07:17:35.282993+0000","last_active":"2023-11-26T07:17:36.852897+0000","last_peered":"2023-11-26T07:17:36.852897+0000","last_clean":"2023-11-26T07:17:36.852897+0000","last_became_active":"2023-11-26T07:17:35.282727+0000","last_became_peered":"2023-11-26T07:17:35.282727+0000","last_unstale":"2023-11-26T07:17:36.852897+0000","last_undegraded":"2023-11-26T07:17:36.852897+0000","last_fullsized":"2023-11-26T07:17:36.852897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853237+0000","last_change":"2023-11-26T07:17:34.271447+0000","last_active":"2023-11-26T07:17:36.853237+0000","last_peered":"2023-11-26T07:17:36.853237+0000","last_clean":"2023-11-26T07:17:36.853237+0000","last_became_active":"2023-11-26T07:17:34.270049+0000","last_became_peered":"2023-11-26T07:17:34.270049+0000","last_unstale":"2023-11-26T07:17:36.853237+0000","last_undegraded":"2023-11-26T07:17:36.853237+0000","last_fullsized":"2023-11-26T07:17:36.853237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291300+0000","last_change":"2023-11-26T07:17:35.296985+0000","last_active":"2023-11-26T07:17:36.291300+0000","last_peered":"2023-11-26T07:17:36.291300+0000","last_clean":"2023-11-26T07:17:36.291300+0000","last_became_active":"2023-11-26T07:17:35.296635+0000","last_became_peered":"2023-11-26T07:17:35.296635+0000","last_unstale":"2023-11-26T07:17:36.291300+0000","last_undegraded":"2023-11-26T07:17:36.291300+0000","last_fullsized":"2023-11-26T07:17:36.291300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.309336+0000","last_change":"2023-11-26T07:17:34.272765+0000","last_active":"2023-11-26T07:17:35.309336+0000","last_peered":"2023-11-26T07:17:35.309336+0000","last_clean":"2023-11-26T07:17:35.309336+0000","last_became_active":"2023-11-26T07:17:34.272359+0000","last_became_peered":"2023-11-26T07:17:34.272359+0000","last_unstale":"2023-11-26T07:17:35.309336+0000","last_undegraded":"2023-11-26T07:17:35.309336+0000","last_fullsized":"2023-11-26T07:17:35.309336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289184+0000","last_change":"2023-11-26T07:17:35.280353+0000","last_active":"2023-11-26T07:17:36.289184+0000","last_peered":"2023-11-26T07:17:36.289184+0000","last_clean":"2023-11-26T07:17:36.289184+0000","last_became_active":"2023-11-26T07:17:35.280060+0000","last_became_peered":"2023-11-26T07:17:35.280060+0000","last_unstale":"2023-11-26T07:17:36.289184+0000","last_undegraded":"2023-11-26T07:17:36.289184+0000","last_fullsized":"2023-11-26T07:17:36.289184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275318+0000","last_change":"2023-11-26T07:17:34.275747+0000","last_active":"2023-11-26T07:17:35.275318+0000","last_peered":"2023-11-26T07:17:35.275318+0000","last_clean":"2023-11-26T07:17:35.275318+0000","last_became_active":"2023-11-26T07:17:34.275273+0000","last_became_peered":"2023-11-26T07:17:34.275273+0000","last_unstale":"2023-11-26T07:17:35.275318+0000","last_undegraded":"2023-11-26T07:17:35.275318+0000","last_fullsized":"2023-11-26T07:17:35.275318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:44:58.427847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853734+0000","last_change":"2023-11-26T07:17:35.287995+0000","last_active":"2023-11-26T07:17:36.853734+0000","last_peered":"2023-11-26T07:17:36.853734+0000","last_clean":"2023-11-26T07:17:36.853734+0000","last_became_active":"2023-11-26T07:17:35.287690+0000","last_became_peered":"2023-11-26T07:17:35.287690+0000","last_unstale":"2023-11-26T07:17:36.853734+0000","last_undegraded":"2023-11-26T07:17:36.853734+0000","last_fullsized":"2023-11-26T07:17:36.853734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:32.219653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.276561+0000","last_change":"2023-11-26T07:17:34.261040+0000","last_active":"2023-11-26T07:17:35.276561+0000","last_peered":"2023-11-26T07:17:35.276561+0000","last_clean":"2023-11-26T07:17:35.276561+0000","last_became_active":"2023-11-26T07:17:34.260678+0000","last_became_peered":"2023-11-26T07:17:34.260678+0000","last_unstale":"2023-11-26T07:17:35.276561+0000","last_undegraded":"2023-11-26T07:17:35.276561+0000","last_fullsized":"2023-11-26T07:17:35.276561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290254+0000","last_change":"2023-11-26T07:17:35.280159+0000","last_active":"2023-11-26T07:17:36.290254+0000","last_peered":"2023-11-26T07:17:36.290254+0000","last_clean":"2023-11-26T07:17:36.290254+0000","last_became_active":"2023-11-26T07:17:35.279819+0000","last_became_peered":"2023-11-26T07:17:35.279819+0000","last_unstale":"2023-11-26T07:17:36.290254+0000","last_undegraded":"2023-11-26T07:17:36.290254+0000","last_fullsized":"2023-11-26T07:17:36.290254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.278229+0000","last_change":"2023-11-26T07:17:34.248282+0000","last_active":"2023-11-26T07:17:35.278229+0000","last_peered":"2023-11-26T07:17:35.278229+0000","last_clean":"2023-11-26T07:17:35.278229+0000","last_became_active":"2023-11-26T07:17:34.247565+0000","last_became_peered":"2023-11-26T07:17:34.247565+0000","last_unstale":"2023-11-26T07:17:35.278229+0000","last_undegraded":"2023-11-26T07:17:35.278229+0000","last_fullsized":"2023-11-26T07:17:35.278229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:50.431819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291259+0000","last_change":"2023-11-26T07:17:35.284496+0000","last_active":"2023-11-26T07:17:36.291259+0000","last_peered":"2023-11-26T07:17:36.291259+0000","last_clean":"2023-11-26T07:17:36.291259+0000","last_became_active":"2023-11-26T07:17:35.283640+0000","last_became_peered":"2023-11-26T07:17:35.283640+0000","last_unstale":"2023-11-26T07:17:36.291259+0000","last_undegraded":"2023-11-26T07:17:36.291259+0000","last_fullsized":"2023-11-26T07:17:36.291259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312542+0000","last_change":"2023-11-26T07:17:34.270854+0000","last_active":"2023-11-26T07:17:35.312542+0000","last_peered":"2023-11-26T07:17:35.312542+0000","last_clean":"2023-11-26T07:17:35.312542+0000","last_became_active":"2023-11-26T07:17:34.270525+0000","last_became_peered":"2023-11-26T07:17:34.270525+0000","last_unstale":"2023-11-26T07:17:35.312542+0000","last_undegraded":"2023-11-26T07:17:35.312542+0000","last_fullsized":"2023-11-26T07:17:35.312542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.854803+0000","last_change":"2023-11-26T07:17:35.288782+0000","last_active":"2023-11-26T07:17:36.854803+0000","last_peered":"2023-11-26T07:17:36.854803+0000","last_clean":"2023-11-26T07:17:36.854803+0000","last_became_active":"2023-11-26T07:17:35.287263+0000","last_became_peered":"2023-11-26T07:17:35.287263+0000","last_unstale":"2023-11-26T07:17:36.854803+0000","last_undegraded":"2023-11-26T07:17:36.854803+0000","last_fullsized":"2023-11-26T07:17:36.854803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291873+0000","last_change":"2023-11-26T07:17:35.303027+0000","last_active":"2023-11-26T07:17:36.291873+0000","last_peered":"2023-11-26T07:17:36.291873+0000","last_clean":"2023-11-26T07:17:36.291873+0000","last_became_active":"2023-11-26T07:17:35.302802+0000","last_became_peered":"2023-11-26T07:17:35.302802+0000","last_unstale":"2023-11-26T07:17:36.291873+0000","last_undegraded":"2023-11-26T07:17:36.291873+0000","last_fullsized":"2023-11-26T07:17:36.291873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:01:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.310109+0000","last_change":"2023-11-26T07:17:34.275614+0000","last_active":"2023-11-26T07:17:35.310109+0000","last_peered":"2023-11-26T07:17:35.310109+0000","last_clean":"2023-11-26T07:17:35.310109+0000","last_became_active":"2023-11-26T07:17:34.274852+0000","last_became_peered":"2023-11-26T07:17:34.274852+0000","last_unstale":"2023-11-26T07:17:35.310109+0000","last_undegraded":"2023-11-26T07:17:35.310109+0000","last_fullsized":"2023-11-26T07:17:35.310109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291376+0000","last_change":"2023-11-26T07:17:35.302995+0000","last_active":"2023-11-26T07:17:36.291376+0000","last_peered":"2023-11-26T07:17:36.291376+0000","last_clean":"2023-11-26T07:17:36.291376+0000","last_became_active":"2023-11-26T07:17:35.302669+0000","last_became_peered":"2023-11-26T07:17:35.302669+0000","last_unstale":"2023-11-26T07:17:36.291376+0000","last_undegraded":"2023-11-26T07:17:36.291376+0000","last_fullsized":"2023-11-26T07:17:36.291376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:31.633994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308916+0000","last_change":"2023-11-26T07:17:34.275105+0000","last_active":"2023-11-26T07:17:35.308916+0000","last_peered":"2023-11-26T07:17:35.308916+0000","last_clean":"2023-11-26T07:17:35.308916+0000","last_became_active":"2023-11-26T07:17:34.274649+0000","last_became_peered":"2023-11-26T07:17:34.274649+0000","last_unstale":"2023-11-26T07:17:35.308916+0000","last_undegraded":"2023-11-26T07:17:35.308916+0000","last_fullsized":"2023-11-26T07:17:35.308916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:04.297880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289574+0000","last_change":"2023-11-26T07:17:35.286325+0000","last_active":"2023-11-26T07:17:36.289574+0000","last_peered":"2023-11-26T07:17:36.289574+0000","last_clean":"2023-11-26T07:17:36.289574+0000","last_became_active":"2023-11-26T07:17:35.286007+0000","last_became_peered":"2023-11-26T07:17:35.286007+0000","last_unstale":"2023-11-26T07:17:36.289574+0000","last_undegraded":"2023-11-26T07:17:36.289574+0000","last_fullsized":"2023-11-26T07:17:36.289574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.307875+0000","last_change":"2023-11-26T07:17:34.258227+0000","last_active":"2023-11-26T07:17:35.307875+0000","last_peered":"2023-11-26T07:17:35.307875+0000","last_clean":"2023-11-26T07:17:35.307875+0000","last_became_active":"2023-11-26T07:17:34.257930+0000","last_became_peered":"2023-11-26T07:17:34.257930+0000","last_unstale":"2023-11-26T07:17:35.307875+0000","last_undegraded":"2023-11-26T07:17:35.307875+0000","last_fullsized":"2023-11-26T07:17:35.307875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291071+0000","last_change":"2023-11-26T07:17:35.286743+0000","last_active":"2023-11-26T07:17:36.291071+0000","last_peered":"2023-11-26T07:17:36.291071+0000","last_clean":"2023-11-26T07:17:36.291071+0000","last_became_active":"2023-11-26T07:17:35.286436+0000","last_became_peered":"2023-11-26T07:17:35.286436+0000","last_unstale":"2023-11-26T07:17:36.291071+0000","last_undegraded":"2023-11-26T07:17:36.291071+0000","last_fullsized":"2023-11-26T07:17:36.291071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.310076+0000","last_change":"2023-11-26T07:17:34.271042+0000","last_active":"2023-11-26T07:17:35.310076+0000","last_peered":"2023-11-26T07:17:35.310076+0000","last_clean":"2023-11-26T07:17:35.310076+0000","last_became_active":"2023-11-26T07:17:34.270720+0000","last_became_peered":"2023-11-26T07:17:34.270720+0000","last_unstale":"2023-11-26T07:17:35.310076+0000","last_undegraded":"2023-11-26T07:17:35.310076+0000","last_fullsized":"2023-11-26T07:17:35.310076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2029999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.76}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.931}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1030000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5329999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8180000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6180000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:17:45.175 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:17:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.417+0000 7fea1a69f640 1 Processor -- start 2023-11-26T07:17:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.417+0000 7fea1a69f640 1 -- start start 2023-11-26T07:17:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.418+0000 7fea1a69f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea1415d4e0 0x7fea140d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.418+0000 7fea1a69f640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fea140d38e0 0x7fea140cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.418+0000 7fea1a69f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140d0070 0x7fea140d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.418+0000 7fea1a69f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea140d4110 con 0x7fea1415d4e0 2023-11-26T07:17:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.418+0000 7fea1a69f640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea140d04e0 con 0x7fea140d38e0 2023-11-26T07:17:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.418+0000 7fea1a69f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea140ce990 con 0x7fea140d0070 2023-11-26T07:17:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.419+0000 7fea1969d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea1415d4e0 0x7fea140d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.419+0000 7fea1969d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea1415d4e0 0x7fea140d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35082/0 (socket says 172.21.15.77:35082) 2023-11-26T07:17:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.419+0000 7fea1969d640 1 -- 172.21.15.77:0/3426497817 learned_addr learned my addr 172.21.15.77:0/3426497817 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.419+0000 7fea1969d640 1 -- 172.21.15.77:0/3426497817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140d0070 msgr2=0x7fea140d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.419+0000 7fea1969d640 1 --2- 172.21.15.77:0/3426497817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140d0070 0x7fea140d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.419+0000 7fea1969d640 1 -- 172.21.15.77:0/3426497817 >> v2:172.21.15.159:3300/0 conn(0x7fea140d38e0 msgr2=0x7fea140cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.419+0000 7fea1969d640 1 --2- 172.21.15.77:0/3426497817 >> v2:172.21.15.159:3300/0 conn(0x7fea140d38e0 0x7fea140cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.419+0000 7fea1969d640 1 -- 172.21.15.77:0/3426497817 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140cec70 con 0x7fea1415d4e0 2023-11-26T07:17:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.420+0000 7fea1969d640 1 --2- 172.21.15.77:0/3426497817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1415d4e0 0x7fea140d1e20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fea140b9280 tx=0x7fea1002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31cee23143c8aa0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.420+0000 7fea0bfff640 1 -- 172.21.15.77:0/3426497817 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10031870 con 0x7fea1415d4e0 2023-11-26T07:17:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.421+0000 7fea0bfff640 1 -- 172.21.15.77:0/3426497817 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea100319d0 con 0x7fea1415d4e0 2023-11-26T07:17:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.421+0000 7fea0bfff640 1 -- 172.21.15.77:0/3426497817 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10031d60 con 0x7fea1415d4e0 2023-11-26T07:17:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.421+0000 7fea1a69f640 1 -- 172.21.15.77:0/3426497817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1415d4e0 msgr2=0x7fea140d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.421+0000 7fea1a69f640 1 --2- 172.21.15.77:0/3426497817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1415d4e0 0x7fea140d1e20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fea140b9280 tx=0x7fea1002b910 comp rx=0 tx=0).stop 2023-11-26T07:17:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.421+0000 7fea1a69f640 1 -- 172.21.15.77:0/3426497817 shutdown_connections 2023-11-26T07:17:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.421+0000 7fea1a69f640 1 --2- 172.21.15.77:0/3426497817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140d0070 0x7fea140d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.421+0000 7fea1a69f640 1 --2- 172.21.15.77:0/3426497817 >> v2:172.21.15.159:3300/0 conn(0x7fea140d38e0 0x7fea140cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.421+0000 7fea1a69f640 1 --2- 172.21.15.77:0/3426497817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1415d4e0 0x7fea140d1e20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.421+0000 7fea1a69f640 1 -- 172.21.15.77:0/3426497817 >> 172.21.15.77:0/3426497817 conn(0x7fea1409c510 msgr2=0x7fea140d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.421+0000 7fea1a69f640 1 -- 172.21.15.77:0/3426497817 shutdown_connections 2023-11-26T07:17:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.421+0000 7fea1a69f640 1 -- 172.21.15.77:0/3426497817 wait complete. 2023-11-26T07:17:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.423+0000 7fea1a69f640 1 Processor -- start 2023-11-26T07:17:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.423+0000 7fea1a69f640 1 -- start start 2023-11-26T07:17:45.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.424+0000 7fea1a69f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea140d0070 0x7fea14152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.424+0000 7fea1a69f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140d38e0 0x7fea1415ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.424+0000 7fea1a69f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1415d4e0 0x7fea141f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.424+0000 7fea1a69f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140cd350 con 0x7fea140d0070 2023-11-26T07:17:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.424+0000 7fea1a69f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea14160400 con 0x7fea1415d4e0 2023-11-26T07:17:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.424+0000 7fea1a69f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415f7f0 con 0x7fea140d38e0 2023-11-26T07:17:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.424+0000 7fea1969d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea140d0070 0x7fea14152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.424+0000 7fea1969d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea140d0070 0x7fea14152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35098/0 (socket says 172.21.15.77:35098) 2023-11-26T07:17:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.424+0000 7fea1969d640 1 -- 172.21.15.77:0/4230586659 learned_addr learned my addr 172.21.15.77:0/4230586659 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:45.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea1969d640 1 -- 172.21.15.77:0/4230586659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140d38e0 msgr2=0x7fea1415ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea18e9c640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140d38e0 0x7fea1415ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea1969d640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140d38e0 0x7fea1415ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea19e9e640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1415d4e0 0x7fea141f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea1969d640 1 -- 172.21.15.77:0/4230586659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1415d4e0 msgr2=0x7fea141f2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea1969d640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1415d4e0 0x7fea141f2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea1969d640 1 -- 172.21.15.77:0/4230586659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100094d0 con 0x7fea140d0070 2023-11-26T07:17:45.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea18e9c640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140d38e0 0x7fea1415ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:45.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea19e9e640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1415d4e0 0x7fea141f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:45.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea1969d640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea140d0070 0x7fea14152b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fea10000c00 tx=0x7fea100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea09ffb640 1 -- 172.21.15.77:0/4230586659 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1003ad10 con 0x7fea140d0070 2023-11-26T07:17:45.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea09ffb640 1 -- 172.21.15.77:0/4230586659 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1003ae70 con 0x7fea140d0070 2023-11-26T07:17:45.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea1a69f640 1 -- 172.21.15.77:0/4230586659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1415fad0 con 0x7fea140d0070 2023-11-26T07:17:45.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea09ffb640 1 -- 172.21.15.77:0/4230586659 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10044610 con 0x7fea140d0070 2023-11-26T07:17:45.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.425+0000 7fea1a69f640 1 -- 172.21.15.77:0/4230586659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea14160090 con 0x7fea140d0070 2023-11-26T07:17:45.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.426+0000 7fea1a69f640 1 -- 172.21.15.77:0/4230586659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1404e840 con 0x7fea140d0070 2023-11-26T07:17:45.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.427+0000 7fea09ffb640 1 -- 172.21.15.77:0/4230586659 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea1004d450 con 0x7fea140d0070 2023-11-26T07:17:45.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.428+0000 7fea09ffb640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9f806ae70 0x7fe9f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.428+0000 7fea09ffb640 1 -- 172.21.15.77:0/4230586659 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea1002d040 con 0x7fea140d0070 2023-11-26T07:17:45.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.428+0000 7fea18e9c640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9f806ae70 0x7fe9f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.429+0000 7fea18e9c640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9f806ae70 0x7fe9f806d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea04006fd0 tx=0x7fea04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.432+0000 7fea09ffb640 1 -- 172.21.15.77:0/4230586659 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea10076d50 con 0x7fea140d0070 2023-11-26T07:17:45.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.608+0000 7fea1a69f640 1 -- 172.21.15.77:0/4230586659 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea1415d8c0 con 0x7fe9f806ae70 2023-11-26T07:17:45.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.619+0000 7fea09ffb640 1 -- 172.21.15.77:0/4230586659 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264403 (secure 0 0 0) 0x7fea0400ae20 con 0x7fe9f806ae70 2023-11-26T07:17:45.624 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:45.625 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:17:45.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.623+0000 7fea1a69f640 1 -- 172.21.15.77:0/4230586659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9f806ae70 msgr2=0x7fe9f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.623+0000 7fea1a69f640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9f806ae70 0x7fe9f806d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea04006fd0 tx=0x7fea04008040 comp rx=0 tx=0).stop 2023-11-26T07:17:45.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.624+0000 7fea1a69f640 1 -- 172.21.15.77:0/4230586659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea140d0070 msgr2=0x7fea14152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.624+0000 7fea1a69f640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea140d0070 0x7fea14152b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fea10000c00 tx=0x7fea100046c0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.624+0000 7fea1a69f640 1 -- 172.21.15.77:0/4230586659 shutdown_connections 2023-11-26T07:17:45.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.624+0000 7fea1a69f640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9f806ae70 0x7fe9f806d330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.624+0000 7fea1a69f640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1415d4e0 0x7fea141f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.624+0000 7fea1a69f640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140d38e0 0x7fea1415ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.624+0000 7fea1a69f640 1 --2- 172.21.15.77:0/4230586659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea140d0070 0x7fea14152b50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.624+0000 7fea1a69f640 1 -- 172.21.15.77:0/4230586659 >> 172.21.15.77:0/4230586659 conn(0x7fea1409c510 msgr2=0x7fea140afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:45.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.624+0000 7fea1a69f640 1 -- 172.21.15.77:0/4230586659 shutdown_connections 2023-11-26T07:17:45.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.624+0000 7fea1a69f640 1 -- 172.21.15.77:0/4230586659 wait complete. 2023-11-26T07:17:45.642 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-26T07:17:45.607664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003655"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857536+0000","last_change":"2023-11-26T07:17:35.294616+0000","last_active":"2023-11-26T07:17:36.857536+0000","last_peered":"2023-11-26T07:17:36.857536+0000","last_clean":"2023-11-26T07:17:36.857536+0000","last_became_active":"2023-11-26T07:17:35.294223+0000","last_became_peered":"2023-11-26T07:17:35.294223+0000","last_unstale":"2023-11-26T07:17:36.857536+0000","last_undegraded":"2023-11-26T07:17:36.857536+0000","last_fullsized":"2023-11-26T07:17:36.857536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:01:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853243+0000","last_change":"2023-11-26T07:17:35.285291+0000","last_active":"2023-11-26T07:17:36.853243+0000","last_peered":"2023-11-26T07:17:36.853243+0000","last_clean":"2023-11-26T07:17:36.853243+0000","last_became_active":"2023-11-26T07:17:35.285002+0000","last_became_peered":"2023-11-26T07:17:35.285002+0000","last_unstale":"2023-11-26T07:17:36.853243+0000","last_undegraded":"2023-11-26T07:17:36.853243+0000","last_fullsized":"2023-11-26T07:17:36.853243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289017+0000","last_change":"2023-11-26T07:17:35.289003+0000","last_active":"2023-11-26T07:17:36.289017+0000","last_peered":"2023-11-26T07:17:36.289017+0000","last_clean":"2023-11-26T07:17:36.289017+0000","last_became_active":"2023-11-26T07:17:35.288628+0000","last_became_peered":"2023-11-26T07:17:35.288628+0000","last_unstale":"2023-11-26T07:17:36.289017+0000","last_undegraded":"2023-11-26T07:17:36.289017+0000","last_fullsized":"2023-11-26T07:17:36.289017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291198+0000","last_change":"2023-11-26T07:17:35.299669+0000","last_active":"2023-11-26T07:17:36.291198+0000","last_peered":"2023-11-26T07:17:36.291198+0000","last_clean":"2023-11-26T07:17:36.291198+0000","last_became_active":"2023-11-26T07:17:35.298175+0000","last_became_peered":"2023-11-26T07:17:35.298175+0000","last_unstale":"2023-11-26T07:17:36.291198+0000","last_undegraded":"2023-11-26T07:17:36.291198+0000","last_fullsized":"2023-11-26T07:17:36.291198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853732+0000","last_change":"2023-11-26T07:17:35.290182+0000","last_active":"2023-11-26T07:17:36.853732+0000","last_peered":"2023-11-26T07:17:36.853732+0000","last_clean":"2023-11-26T07:17:36.853732+0000","last_became_active":"2023-11-26T07:17:35.289848+0000","last_became_peered":"2023-11-26T07:17:35.289848+0000","last_unstale":"2023-11-26T07:17:36.853732+0000","last_undegraded":"2023-11-26T07:17:36.853732+0000","last_fullsized":"2023-11-26T07:17:36.853732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290790+0000","last_change":"2023-11-26T07:17:35.275633+0000","last_active":"2023-11-26T07:17:36.290790+0000","last_peered":"2023-11-26T07:17:36.290790+0000","last_clean":"2023-11-26T07:17:36.290790+0000","last_became_active":"2023-11-26T07:17:35.275245+0000","last_became_peered":"2023-11-26T07:17:35.275245+0000","last_unstale":"2023-11-26T07:17:36.290790+0000","last_undegraded":"2023-11-26T07:17:36.290790+0000","last_fullsized":"2023-11-26T07:17:36.290790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853372+0000","last_change":"2023-11-26T07:17:35.289664+0000","last_active":"2023-11-26T07:17:36.853372+0000","last_peered":"2023-11-26T07:17:36.853372+0000","last_clean":"2023-11-26T07:17:36.853372+0000","last_became_active":"2023-11-26T07:17:35.289347+0000","last_became_peered":"2023-11-26T07:17:35.289347+0000","last_unstale":"2023-11-26T07:17:36.853372+0000","last_undegraded":"2023-11-26T07:17:36.853372+0000","last_fullsized":"2023-11-26T07:17:36.853372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290077+0000","last_change":"2023-11-26T07:17:35.285314+0000","last_active":"2023-11-26T07:17:36.290077+0000","last_peered":"2023-11-26T07:17:36.290077+0000","last_clean":"2023-11-26T07:17:36.290077+0000","last_became_active":"2023-11-26T07:17:35.283583+0000","last_became_peered":"2023-11-26T07:17:35.283583+0000","last_unstale":"2023-11-26T07:17:36.290077+0000","last_undegraded":"2023-11-26T07:17:36.290077+0000","last_fullsized":"2023-11-26T07:17:36.290077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857606+0000","last_change":"2023-11-26T07:17:35.294791+0000","last_active":"2023-11-26T07:17:36.857606+0000","last_peered":"2023-11-26T07:17:36.857606+0000","last_clean":"2023-11-26T07:17:36.857606+0000","last_became_active":"2023-11-26T07:17:35.294267+0000","last_became_peered":"2023-11-26T07:17:35.294267+0000","last_unstale":"2023-11-26T07:17:36.857606+0000","last_undegraded":"2023-11-26T07:17:36.857606+0000","last_fullsized":"2023-11-26T07:17:36.857606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:14:14.039125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856211+0000","last_change":"2023-11-26T07:17:35.291521+0000","last_active":"2023-11-26T07:17:36.856211+0000","last_peered":"2023-11-26T07:17:36.856211+0000","last_clean":"2023-11-26T07:17:36.856211+0000","last_became_active":"2023-11-26T07:17:35.290900+0000","last_became_peered":"2023-11-26T07:17:35.290900+0000","last_unstale":"2023-11-26T07:17:36.856211+0000","last_undegraded":"2023-11-26T07:17:36.856211+0000","last_fullsized":"2023-11-26T07:17:36.856211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855424+0000","last_change":"2023-11-26T07:17:35.293941+0000","last_active":"2023-11-26T07:17:36.855424+0000","last_peered":"2023-11-26T07:17:36.855424+0000","last_clean":"2023-11-26T07:17:36.855424+0000","last_became_active":"2023-11-26T07:17:35.293485+0000","last_became_peered":"2023-11-26T07:17:35.293485+0000","last_unstale":"2023-11-26T07:17:36.855424+0000","last_undegraded":"2023-11-26T07:17:36.855424+0000","last_fullsized":"2023-11-26T07:17:36.855424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856924+0000","last_change":"2023-11-26T07:17:35.302079+0000","last_active":"2023-11-26T07:17:36.856924+0000","last_peered":"2023-11-26T07:17:36.856924+0000","last_clean":"2023-11-26T07:17:36.856924+0000","last_became_active":"2023-11-26T07:17:35.297582+0000","last_became_peered":"2023-11-26T07:17:35.297582+0000","last_unstale":"2023-11-26T07:17:36.856924+0000","last_undegraded":"2023-11-26T07:17:36.856924+0000","last_fullsized":"2023-11-26T07:17:36.856924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:31.406679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291168+0000","last_change":"2023-11-26T07:17:35.286562+0000","last_active":"2023-11-26T07:17:36.291168+0000","last_peered":"2023-11-26T07:17:36.291168+0000","last_clean":"2023-11-26T07:17:36.291168+0000","last_became_active":"2023-11-26T07:17:35.286252+0000","last_became_peered":"2023-11-26T07:17:35.286252+0000","last_unstale":"2023-11-26T07:17:36.291168+0000","last_undegraded":"2023-11-26T07:17:36.291168+0000","last_fullsized":"2023-11-26T07:17:36.291168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288118+0000","last_change":"2023-11-26T07:17:35.281910+0000","last_active":"2023-11-26T07:17:36.288118+0000","last_peered":"2023-11-26T07:17:36.288118+0000","last_clean":"2023-11-26T07:17:36.288118+0000","last_became_active":"2023-11-26T07:17:35.281535+0000","last_became_peered":"2023-11-26T07:17:35.281535+0000","last_unstale":"2023-11-26T07:17:36.288118+0000","last_undegraded":"2023-11-26T07:17:36.288118+0000","last_fullsized":"2023-11-26T07:17:36.288118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:59.107380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852568+0000","last_change":"2023-11-26T07:17:35.305449+0000","last_active":"2023-11-26T07:17:36.852568+0000","last_peered":"2023-11-26T07:17:36.852568+0000","last_clean":"2023-11-26T07:17:36.852568+0000","last_became_active":"2023-11-26T07:17:35.305109+0000","last_became_peered":"2023-11-26T07:17:35.305109+0000","last_unstale":"2023-11-26T07:17:36.852568+0000","last_undegraded":"2023-11-26T07:17:36.852568+0000","last_fullsized":"2023-11-26T07:17:36.852568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290585+0000","last_change":"2023-11-26T07:17:35.278078+0000","last_active":"2023-11-26T07:17:36.290585+0000","last_peered":"2023-11-26T07:17:36.290585+0000","last_clean":"2023-11-26T07:17:36.290585+0000","last_became_active":"2023-11-26T07:17:35.277756+0000","last_became_peered":"2023-11-26T07:17:35.277756+0000","last_unstale":"2023-11-26T07:17:36.290585+0000","last_undegraded":"2023-11-26T07:17:36.290585+0000","last_fullsized":"2023-11-26T07:17:36.290585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.292426+0000","last_change":"2023-11-26T07:17:35.292521+0000","last_active":"2023-11-26T07:17:36.292426+0000","last_peered":"2023-11-26T07:17:36.292426+0000","last_clean":"2023-11-26T07:17:36.292426+0000","last_became_active":"2023-11-26T07:17:35.290387+0000","last_became_peered":"2023-11-26T07:17:35.290387+0000","last_unstale":"2023-11-26T07:17:36.292426+0000","last_undegraded":"2023-11-26T07:17:36.292426+0000","last_fullsized":"2023-11-26T07:17:36.292426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:37:30.364077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.348275+0000","last_change":"2023-11-26T07:17:35.289305+0000","last_active":"2023-11-26T07:17:36.348275+0000","last_peered":"2023-11-26T07:17:36.348275+0000","last_clean":"2023-11-26T07:17:36.348275+0000","last_became_active":"2023-11-26T07:17:35.288484+0000","last_became_peered":"2023-11-26T07:17:35.288484+0000","last_unstale":"2023-11-26T07:17:36.348275+0000","last_undegraded":"2023-11-26T07:17:36.348275+0000","last_fullsized":"2023-11-26T07:17:36.348275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:44:59.432835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.854493+0000","last_change":"2023-11-26T07:17:35.295513+0000","last_active":"2023-11-26T07:17:36.854493+0000","last_peered":"2023-11-26T07:17:36.854493+0000","last_clean":"2023-11-26T07:17:36.854493+0000","last_became_active":"2023-11-26T07:17:35.295339+0000","last_became_peered":"2023-11-26T07:17:35.295339+0000","last_unstale":"2023-11-26T07:17:36.854493+0000","last_undegraded":"2023-11-26T07:17:36.854493+0000","last_fullsized":"2023-11-26T07:17:36.854493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:51:44.669299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856229+0000","last_change":"2023-11-26T07:17:35.304162+0000","last_active":"2023-11-26T07:17:36.856229+0000","last_peered":"2023-11-26T07:17:36.856229+0000","last_clean":"2023-11-26T07:17:36.856229+0000","last_became_active":"2023-11-26T07:17:35.303775+0000","last_became_peered":"2023-11-26T07:17:35.303775+0000","last_unstale":"2023-11-26T07:17:36.856229+0000","last_undegraded":"2023-11-26T07:17:36.856229+0000","last_fullsized":"2023-11-26T07:17:36.856229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288359+0000","last_change":"2023-11-26T07:17:35.289136+0000","last_active":"2023-11-26T07:17:36.288359+0000","last_peered":"2023-11-26T07:17:36.288359+0000","last_clean":"2023-11-26T07:17:36.288359+0000","last_became_active":"2023-11-26T07:17:35.288824+0000","last_became_peered":"2023-11-26T07:17:35.288824+0000","last_unstale":"2023-11-26T07:17:36.288359+0000","last_undegraded":"2023-11-26T07:17:36.288359+0000","last_fullsized":"2023-11-26T07:17:36.288359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:51.436807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290977+0000","last_change":"2023-11-26T07:17:35.299639+0000","last_active":"2023-11-26T07:17:36.290977+0000","last_peered":"2023-11-26T07:17:36.290977+0000","last_clean":"2023-11-26T07:17:36.290977+0000","last_became_active":"2023-11-26T07:17:35.298838+0000","last_became_peered":"2023-11-26T07:17:35.298838+0000","last_unstale":"2023-11-26T07:17:36.290977+0000","last_undegraded":"2023-11-26T07:17:36.290977+0000","last_fullsized":"2023-11-26T07:17:36.290977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290258+0000","last_change":"2023-11-26T07:17:35.288263+0000","last_active":"2023-11-26T07:17:36.290258+0000","last_peered":"2023-11-26T07:17:36.290258+0000","last_clean":"2023-11-26T07:17:36.290258+0000","last_became_active":"2023-11-26T07:17:35.287907+0000","last_became_peered":"2023-11-26T07:17:35.287907+0000","last_unstale":"2023-11-26T07:17:36.290258+0000","last_undegraded":"2023-11-26T07:17:36.290258+0000","last_fullsized":"2023-11-26T07:17:36.290258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290741+0000","last_change":"2023-11-26T07:17:35.298420+0000","last_active":"2023-11-26T07:17:36.290741+0000","last_peered":"2023-11-26T07:17:36.290741+0000","last_clean":"2023-11-26T07:17:36.290741+0000","last_became_active":"2023-11-26T07:17:35.297672+0000","last_became_peered":"2023-11-26T07:17:35.297672+0000","last_unstale":"2023-11-26T07:17:36.290741+0000","last_undegraded":"2023-11-26T07:17:36.290741+0000","last_fullsized":"2023-11-26T07:17:36.290741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291207+0000","last_change":"2023-11-26T07:17:35.299072+0000","last_active":"2023-11-26T07:17:36.291207+0000","last_peered":"2023-11-26T07:17:36.291207+0000","last_clean":"2023-11-26T07:17:36.291207+0000","last_became_active":"2023-11-26T07:17:35.298748+0000","last_became_peered":"2023-11-26T07:17:35.298748+0000","last_unstale":"2023-11-26T07:17:36.291207+0000","last_undegraded":"2023-11-26T07:17:36.291207+0000","last_fullsized":"2023-11-26T07:17:36.291207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855537+0000","last_change":"2023-11-26T07:17:35.295203+0000","last_active":"2023-11-26T07:17:36.855537+0000","last_peered":"2023-11-26T07:17:36.855537+0000","last_clean":"2023-11-26T07:17:36.855537+0000","last_became_active":"2023-11-26T07:17:35.294921+0000","last_became_peered":"2023-11-26T07:17:35.294921+0000","last_unstale":"2023-11-26T07:17:36.855537+0000","last_undegraded":"2023-11-26T07:17:36.855537+0000","last_fullsized":"2023-11-26T07:17:36.855537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852945+0000","last_change":"2023-11-26T07:17:35.288826+0000","last_active":"2023-11-26T07:17:36.852945+0000","last_peered":"2023-11-26T07:17:36.852945+0000","last_clean":"2023-11-26T07:17:36.852945+0000","last_became_active":"2023-11-26T07:17:35.288535+0000","last_became_peered":"2023-11-26T07:17:35.288535+0000","last_unstale":"2023-11-26T07:17:36.852945+0000","last_undegraded":"2023-11-26T07:17:36.852945+0000","last_fullsized":"2023-11-26T07:17:36.852945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:10:53.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291234+0000","last_change":"2023-11-26T07:17:35.299788+0000","last_active":"2023-11-26T07:17:36.291234+0000","last_peered":"2023-11-26T07:17:36.291234+0000","last_clean":"2023-11-26T07:17:36.291234+0000","last_became_active":"2023-11-26T07:17:35.299537+0000","last_became_peered":"2023-11-26T07:17:35.299537+0000","last_unstale":"2023-11-26T07:17:36.291234+0000","last_undegraded":"2023-11-26T07:17:36.291234+0000","last_fullsized":"2023-11-26T07:17:36.291234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:59:06.736618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288966+0000","last_change":"2023-11-26T07:17:35.291110+0000","last_active":"2023-11-26T07:17:36.288966+0000","last_peered":"2023-11-26T07:17:36.288966+0000","last_clean":"2023-11-26T07:17:36.288966+0000","last_became_active":"2023-11-26T07:17:35.290817+0000","last_became_peered":"2023-11-26T07:17:35.290817+0000","last_unstale":"2023-11-26T07:17:36.288966+0000","last_undegraded":"2023-11-26T07:17:36.288966+0000","last_fullsized":"2023-11-26T07:17:36.288966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291138+0000","last_change":"2023-11-26T07:17:35.299321+0000","last_active":"2023-11-26T07:17:36.291138+0000","last_peered":"2023-11-26T07:17:36.291138+0000","last_clean":"2023-11-26T07:17:36.291138+0000","last_became_active":"2023-11-26T07:17:35.296813+0000","last_became_peered":"2023-11-26T07:17:35.296813+0000","last_unstale":"2023-11-26T07:17:36.291138+0000","last_undegraded":"2023-11-26T07:17:36.291138+0000","last_fullsized":"2023-11-26T07:17:36.291138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.347730+0000","last_change":"2023-11-26T07:17:35.298470+0000","last_active":"2023-11-26T07:17:36.347730+0000","last_peered":"2023-11-26T07:17:36.347730+0000","last_clean":"2023-11-26T07:17:36.347730+0000","last_became_active":"2023-11-26T07:17:35.298120+0000","last_became_peered":"2023-11-26T07:17:35.298120+0000","last_unstale":"2023-11-26T07:17:36.347730+0000","last_undegraded":"2023-11-26T07:17:36.347730+0000","last_fullsized":"2023-11-26T07:17:36.347730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:01.790753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853467+0000","last_change":"2023-11-26T07:17:35.286010+0000","last_active":"2023-11-26T07:17:36.853467+0000","last_peered":"2023-11-26T07:17:36.853467+0000","last_clean":"2023-11-26T07:17:36.853467+0000","last_became_active":"2023-11-26T07:17:35.284996+0000","last_became_peered":"2023-11-26T07:17:35.284996+0000","last_unstale":"2023-11-26T07:17:36.853467+0000","last_undegraded":"2023-11-26T07:17:36.853467+0000","last_fullsized":"2023-11-26T07:17:36.853467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:51.436807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.855545+0000","last_change":"2023-11-26T07:17:35.287101+0000","last_active":"2023-11-26T07:17:36.855545+0000","last_peered":"2023-11-26T07:17:36.855545+0000","last_clean":"2023-11-26T07:17:36.855545+0000","last_became_active":"2023-11-26T07:17:35.286319+0000","last_became_peered":"2023-11-26T07:17:35.286319+0000","last_unstale":"2023-11-26T07:17:36.855545+0000","last_undegraded":"2023-11-26T07:17:36.855545+0000","last_fullsized":"2023-11-26T07:17:36.855545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:27.986808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308605+0000","last_change":"2023-11-26T07:17:34.260424+0000","last_active":"2023-11-26T07:17:35.308605+0000","last_peered":"2023-11-26T07:17:35.308605+0000","last_clean":"2023-11-26T07:17:35.308605+0000","last_became_active":"2023-11-26T07:17:34.260186+0000","last_became_peered":"2023-11-26T07:17:34.260186+0000","last_unstale":"2023-11-26T07:17:35.308605+0000","last_undegraded":"2023-11-26T07:17:35.308605+0000","last_fullsized":"2023-11-26T07:17:35.308605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:50.431819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289063+0000","last_change":"2023-11-26T07:17:35.296870+0000","last_active":"2023-11-26T07:17:36.289063+0000","last_peered":"2023-11-26T07:17:36.289063+0000","last_clean":"2023-11-26T07:17:36.289063+0000","last_became_active":"2023-11-26T07:17:35.296511+0000","last_became_peered":"2023-11-26T07:17:35.296511+0000","last_unstale":"2023-11-26T07:17:36.289063+0000","last_undegraded":"2023-11-26T07:17:36.289063+0000","last_fullsized":"2023-11-26T07:17:36.289063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312260+0000","last_change":"2023-11-26T07:17:34.272272+0000","last_active":"2023-11-26T07:17:35.312260+0000","last_peered":"2023-11-26T07:17:35.312260+0000","last_clean":"2023-11-26T07:17:35.312260+0000","last_became_active":"2023-11-26T07:17:34.271546+0000","last_became_peered":"2023-11-26T07:17:34.271546+0000","last_unstale":"2023-11-26T07:17:35.312260+0000","last_undegraded":"2023-11-26T07:17:35.312260+0000","last_fullsized":"2023-11-26T07:17:35.312260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:07.401822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.263326+0000","last_change":"2023-11-26T07:17:34.270516+0000","last_active":"2023-11-26T07:17:35.263326+0000","last_peered":"2023-11-26T07:17:35.263326+0000","last_clean":"2023-11-26T07:17:35.263326+0000","last_became_active":"2023-11-26T07:17:34.270272+0000","last_became_peered":"2023-11-26T07:17:34.270272+0000","last_unstale":"2023-11-26T07:17:35.263326+0000","last_undegraded":"2023-11-26T07:17:35.263326+0000","last_fullsized":"2023-11-26T07:17:35.263326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:31.214665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290438+0000","last_change":"2023-11-26T07:17:35.282691+0000","last_active":"2023-11-26T07:17:36.290438+0000","last_peered":"2023-11-26T07:17:36.290438+0000","last_clean":"2023-11-26T07:17:36.290438+0000","last_became_active":"2023-11-26T07:17:35.282434+0000","last_became_peered":"2023-11-26T07:17:35.282434+0000","last_unstale":"2023-11-26T07:17:36.290438+0000","last_undegraded":"2023-11-26T07:17:36.290438+0000","last_fullsized":"2023-11-26T07:17:36.290438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.263324+0000","last_change":"2023-11-26T07:17:34.264012+0000","last_active":"2023-11-26T07:17:35.263324+0000","last_peered":"2023-11-26T07:17:35.263324+0000","last_clean":"2023-11-26T07:17:35.263324+0000","last_became_active":"2023-11-26T07:17:34.262939+0000","last_became_peered":"2023-11-26T07:17:34.262939+0000","last_unstale":"2023-11-26T07:17:35.263324+0000","last_undegraded":"2023-11-26T07:17:35.263324+0000","last_fullsized":"2023-11-26T07:17:35.263324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:47.932199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852561+0000","last_change":"2023-11-26T07:17:35.290951+0000","last_active":"2023-11-26T07:17:36.852561+0000","last_peered":"2023-11-26T07:17:36.852561+0000","last_clean":"2023-11-26T07:17:36.852561+0000","last_became_active":"2023-11-26T07:17:35.290575+0000","last_became_peered":"2023-11-26T07:17:35.290575+0000","last_unstale":"2023-11-26T07:17:36.852561+0000","last_undegraded":"2023-11-26T07:17:36.852561+0000","last_fullsized":"2023-11-26T07:17:36.852561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.274062+0000","last_change":"2023-11-26T07:17:34.270339+0000","last_active":"2023-11-26T07:17:35.274062+0000","last_peered":"2023-11-26T07:17:35.274062+0000","last_clean":"2023-11-26T07:17:35.274062+0000","last_became_active":"2023-11-26T07:17:34.270058+0000","last_became_peered":"2023-11-26T07:17:34.270058+0000","last_unstale":"2023-11-26T07:17:35.274062+0000","last_undegraded":"2023-11-26T07:17:35.274062+0000","last_fullsized":"2023-11-26T07:17:35.274062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:00.785765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.292197+0000","last_change":"2023-11-26T07:17:35.292487+0000","last_active":"2023-11-26T07:17:36.292197+0000","last_peered":"2023-11-26T07:17:36.292197+0000","last_clean":"2023-11-26T07:17:36.292197+0000","last_became_active":"2023-11-26T07:17:35.291651+0000","last_became_peered":"2023-11-26T07:17:35.291651+0000","last_unstale":"2023-11-26T07:17:36.292197+0000","last_undegraded":"2023-11-26T07:17:36.292197+0000","last_fullsized":"2023-11-26T07:17:36.292197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:14:14.039125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.264303+0000","last_change":"2023-11-26T07:17:34.271134+0000","last_active":"2023-11-26T07:17:35.264303+0000","last_peered":"2023-11-26T07:17:35.264303+0000","last_clean":"2023-11-26T07:17:35.264303+0000","last_became_active":"2023-11-26T07:17:34.270420+0000","last_became_peered":"2023-11-26T07:17:34.270420+0000","last_unstale":"2023-11-26T07:17:35.264303+0000","last_undegraded":"2023-11-26T07:17:35.264303+0000","last_fullsized":"2023-11-26T07:17:35.264303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:39.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289872+0000","last_change":"2023-11-26T07:17:35.290019+0000","last_active":"2023-11-26T07:17:36.289872+0000","last_peered":"2023-11-26T07:17:36.289872+0000","last_clean":"2023-11-26T07:17:36.289872+0000","last_became_active":"2023-11-26T07:17:35.289735+0000","last_became_peered":"2023-11-26T07:17:35.289735+0000","last_unstale":"2023-11-26T07:17:36.289872+0000","last_undegraded":"2023-11-26T07:17:36.289872+0000","last_fullsized":"2023-11-26T07:17:36.289872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.309286+0000","last_change":"2023-11-26T07:17:34.253890+0000","last_active":"2023-11-26T07:17:35.309286+0000","last_peered":"2023-11-26T07:17:35.309286+0000","last_clean":"2023-11-26T07:17:35.309286+0000","last_became_active":"2023-11-26T07:17:34.252298+0000","last_became_peered":"2023-11-26T07:17:34.252298+0000","last_unstale":"2023-11-26T07:17:35.309286+0000","last_undegraded":"2023-11-26T07:17:35.309286+0000","last_fullsized":"2023-11-26T07:17:35.309286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:04.297880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857233+0000","last_change":"2023-11-26T07:17:35.299159+0000","last_active":"2023-11-26T07:17:36.857233+0000","last_peered":"2023-11-26T07:17:36.857233+0000","last_clean":"2023-11-26T07:17:36.857233+0000","last_became_active":"2023-11-26T07:17:35.298172+0000","last_became_peered":"2023-11-26T07:17:35.298172+0000","last_unstale":"2023-11-26T07:17:36.857233+0000","last_undegraded":"2023-11-26T07:17:36.857233+0000","last_fullsized":"2023-11-26T07:17:36.857233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:09:01.790753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.313145+0000","last_change":"2023-11-26T07:17:34.269809+0000","last_active":"2023-11-26T07:17:35.313145+0000","last_peered":"2023-11-26T07:17:35.313145+0000","last_clean":"2023-11-26T07:17:35.313145+0000","last_became_active":"2023-11-26T07:17:34.264015+0000","last_became_peered":"2023-11-26T07:17:34.264015+0000","last_unstale":"2023-11-26T07:17:35.313145+0000","last_undegraded":"2023-11-26T07:17:35.313145+0000","last_fullsized":"2023-11-26T07:17:35.313145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853444+0000","last_change":"2023-11-26T07:17:35.290779+0000","last_active":"2023-11-26T07:17:36.853444+0000","last_peered":"2023-11-26T07:17:36.853444+0000","last_clean":"2023-11-26T07:17:36.853444+0000","last_became_active":"2023-11-26T07:17:35.290504+0000","last_became_peered":"2023-11-26T07:17:35.290504+0000","last_unstale":"2023-11-26T07:17:36.853444+0000","last_undegraded":"2023-11-26T07:17:36.853444+0000","last_fullsized":"2023-11-26T07:17:36.853444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:08.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312451+0000","last_change":"2023-11-26T07:17:34.261601+0000","last_active":"2023-11-26T07:17:35.312451+0000","last_peered":"2023-11-26T07:17:35.312451+0000","last_clean":"2023-11-26T07:17:35.312451+0000","last_became_active":"2023-11-26T07:17:34.261232+0000","last_became_peered":"2023-11-26T07:17:34.261232+0000","last_unstale":"2023-11-26T07:17:35.312451+0000","last_undegraded":"2023-11-26T07:17:35.312451+0000","last_fullsized":"2023-11-26T07:17:35.312451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:30.401691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.288255+0000","last_change":"2023-11-26T07:17:35.290421+0000","last_active":"2023-11-26T07:17:36.288255+0000","last_peered":"2023-11-26T07:17:36.288255+0000","last_clean":"2023-11-26T07:17:36.288255+0000","last_became_active":"2023-11-26T07:17:35.290069+0000","last_became_peered":"2023-11-26T07:17:35.290069+0000","last_unstale":"2023-11-26T07:17:36.288255+0000","last_undegraded":"2023-11-26T07:17:36.288255+0000","last_fullsized":"2023-11-26T07:17:36.288255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:05.302868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.266362+0000","last_change":"2023-11-26T07:17:34.263984+0000","last_active":"2023-11-26T07:17:35.266362+0000","last_peered":"2023-11-26T07:17:35.266362+0000","last_clean":"2023-11-26T07:17:35.266362+0000","last_became_active":"2023-11-26T07:17:34.263647+0000","last_became_peered":"2023-11-26T07:17:34.263647+0000","last_unstale":"2023-11-26T07:17:35.266362+0000","last_undegraded":"2023-11-26T07:17:35.266362+0000","last_fullsized":"2023-11-26T07:17:35.266362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:50.841460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853983+0000","last_change":"2023-11-26T07:17:35.307695+0000","last_active":"2023-11-26T07:17:36.853983+0000","last_peered":"2023-11-26T07:17:36.853983+0000","last_clean":"2023-11-26T07:17:36.853983+0000","last_became_active":"2023-11-26T07:17:35.307322+0000","last_became_peered":"2023-11-26T07:17:35.307322+0000","last_unstale":"2023-11-26T07:17:36.853983+0000","last_undegraded":"2023-11-26T07:17:36.853983+0000","last_fullsized":"2023-11-26T07:17:36.853983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:31.633994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.271599+0000","last_change":"2023-11-26T07:17:34.267209+0000","last_active":"2023-11-26T07:17:35.271599+0000","last_peered":"2023-11-26T07:17:35.271599+0000","last_clean":"2023-11-26T07:17:35.271599+0000","last_became_active":"2023-11-26T07:17:34.266896+0000","last_became_peered":"2023-11-26T07:17:34.266896+0000","last_unstale":"2023-11-26T07:17:35.271599+0000","last_undegraded":"2023-11-26T07:17:35.271599+0000","last_fullsized":"2023-11-26T07:17:35.271599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:26.981820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853828+0000","last_change":"2023-11-26T07:17:35.285662+0000","last_active":"2023-11-26T07:17:36.853828+0000","last_peered":"2023-11-26T07:17:36.853828+0000","last_clean":"2023-11-26T07:17:36.853828+0000","last_became_active":"2023-11-26T07:17:35.285344+0000","last_became_peered":"2023-11-26T07:17:35.285344+0000","last_unstale":"2023-11-26T07:17:36.853828+0000","last_undegraded":"2023-11-26T07:17:36.853828+0000","last_fullsized":"2023-11-26T07:17:36.853828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:57.943150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.313128+0000","last_change":"2023-11-26T07:17:34.255794+0000","last_active":"2023-11-26T07:17:35.313128+0000","last_peered":"2023-11-26T07:17:35.313128+0000","last_clean":"2023-11-26T07:17:35.313128+0000","last_became_active":"2023-11-26T07:17:34.255495+0000","last_became_peered":"2023-11-26T07:17:34.255495+0000","last_unstale":"2023-11-26T07:17:35.313128+0000","last_undegraded":"2023-11-26T07:17:35.313128+0000","last_fullsized":"2023-11-26T07:17:35.313128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:26.981820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853750+0000","last_change":"2023-11-26T07:17:35.299739+0000","last_active":"2023-11-26T07:17:36.853750+0000","last_peered":"2023-11-26T07:17:36.853750+0000","last_clean":"2023-11-26T07:17:36.853750+0000","last_became_active":"2023-11-26T07:17:35.299412+0000","last_became_peered":"2023-11-26T07:17:35.299412+0000","last_unstale":"2023-11-26T07:17:36.853750+0000","last_undegraded":"2023-11-26T07:17:36.853750+0000","last_fullsized":"2023-11-26T07:17:36.853750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.311528+0000","last_change":"2023-11-26T07:17:34.261567+0000","last_active":"2023-11-26T07:17:35.311528+0000","last_peered":"2023-11-26T07:17:35.311528+0000","last_clean":"2023-11-26T07:17:35.311528+0000","last_became_active":"2023-11-26T07:17:34.261083+0000","last_became_peered":"2023-11-26T07:17:34.261083+0000","last_unstale":"2023-11-26T07:17:35.311528+0000","last_undegraded":"2023-11-26T07:17:35.311528+0000","last_fullsized":"2023-11-26T07:17:35.311528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:33:02.627652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857599+0000","last_change":"2023-11-26T07:17:35.307619+0000","last_active":"2023-11-26T07:17:36.857599+0000","last_peered":"2023-11-26T07:17:36.857599+0000","last_clean":"2023-11-26T07:17:36.857599+0000","last_became_active":"2023-11-26T07:17:35.307322+0000","last_became_peered":"2023-11-26T07:17:35.307322+0000","last_unstale":"2023-11-26T07:17:36.857599+0000","last_undegraded":"2023-11-26T07:17:36.857599+0000","last_fullsized":"2023-11-26T07:17:36.857599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:59:08.684829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308810+0000","last_change":"2023-11-26T07:17:34.259965+0000","last_active":"2023-11-26T07:17:35.308810+0000","last_peered":"2023-11-26T07:17:35.308810+0000","last_clean":"2023-11-26T07:17:35.308810+0000","last_became_active":"2023-11-26T07:17:34.259453+0000","last_became_peered":"2023-11-26T07:17:34.259453+0000","last_unstale":"2023-11-26T07:17:35.308810+0000","last_undegraded":"2023-11-26T07:17:35.308810+0000","last_fullsized":"2023-11-26T07:17:35.308810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:31.214665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.857855+0000","last_change":"2023-11-26T07:17:35.305671+0000","last_active":"2023-11-26T07:17:36.857855+0000","last_peered":"2023-11-26T07:17:36.857855+0000","last_clean":"2023-11-26T07:17:36.857855+0000","last_became_active":"2023-11-26T07:17:35.304797+0000","last_became_peered":"2023-11-26T07:17:35.304797+0000","last_unstale":"2023-11-26T07:17:36.857855+0000","last_undegraded":"2023-11-26T07:17:36.857855+0000","last_fullsized":"2023-11-26T07:17:36.857855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:37:30.364077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312107+0000","last_change":"2023-11-26T07:17:34.260843+0000","last_active":"2023-11-26T07:17:35.312107+0000","last_peered":"2023-11-26T07:17:35.312107+0000","last_clean":"2023-11-26T07:17:35.312107+0000","last_became_active":"2023-11-26T07:17:34.260492+0000","last_became_peered":"2023-11-26T07:17:34.260492+0000","last_unstale":"2023-11-26T07:17:35.312107+0000","last_undegraded":"2023-11-26T07:17:35.312107+0000","last_fullsized":"2023-11-26T07:17:35.312107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:56.938162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291587+0000","last_change":"2023-11-26T07:17:35.299197+0000","last_active":"2023-11-26T07:17:36.291587+0000","last_peered":"2023-11-26T07:17:36.291587+0000","last_clean":"2023-11-26T07:17:36.291587+0000","last_became_active":"2023-11-26T07:17:35.297708+0000","last_became_peered":"2023-11-26T07:17:35.297708+0000","last_unstale":"2023-11-26T07:17:36.291587+0000","last_undegraded":"2023-11-26T07:17:36.291587+0000","last_fullsized":"2023-11-26T07:17:36.291587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:51:44.669299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275592+0000","last_change":"2023-11-26T07:17:34.263596+0000","last_active":"2023-11-26T07:17:35.275592+0000","last_peered":"2023-11-26T07:17:35.275592+0000","last_clean":"2023-11-26T07:17:35.275592+0000","last_became_active":"2023-11-26T07:17:34.263296+0000","last_became_peered":"2023-11-26T07:17:34.263296+0000","last_unstale":"2023-11-26T07:17:35.275592+0000","last_undegraded":"2023-11-26T07:17:35.275592+0000","last_fullsized":"2023-11-26T07:17:35.275592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:07.401822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853854+0000","last_change":"2023-11-26T07:17:35.295518+0000","last_active":"2023-11-26T07:17:36.853854+0000","last_peered":"2023-11-26T07:17:36.853854+0000","last_clean":"2023-11-26T07:17:36.853854+0000","last_became_active":"2023-11-26T07:17:35.295352+0000","last_became_peered":"2023-11-26T07:17:35.295352+0000","last_unstale":"2023-11-26T07:17:36.853854+0000","last_undegraded":"2023-11-26T07:17:36.853854+0000","last_fullsized":"2023-11-26T07:17:36.853854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275660+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:17:35.275660+0000","last_peered":"2023-11-26T07:17:35.275660+0000","last_clean":"2023-11-26T07:17:35.275660+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:17:35.275660+0000","last_undegraded":"2023-11-26T07:17:35.275660+0000","last_fullsized":"2023-11-26T07:17:35.275660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.260546+0000","last_change":"2023-11-26T07:17:34.260166+0000","last_active":"2023-11-26T07:17:35.260546+0000","last_peered":"2023-11-26T07:17:35.260546+0000","last_clean":"2023-11-26T07:17:35.260546+0000","last_became_active":"2023-11-26T07:17:34.259813+0000","last_became_peered":"2023-11-26T07:17:34.259813+0000","last_unstale":"2023-11-26T07:17:35.260546+0000","last_undegraded":"2023-11-26T07:17:35.260546+0000","last_fullsized":"2023-11-26T07:17:35.260546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290730+0000","last_change":"2023-11-26T07:17:35.287427+0000","last_active":"2023-11-26T07:17:36.290730+0000","last_peered":"2023-11-26T07:17:36.290730+0000","last_clean":"2023-11-26T07:17:36.290730+0000","last_became_active":"2023-11-26T07:17:35.287153+0000","last_became_peered":"2023-11-26T07:17:35.287153+0000","last_unstale":"2023-11-26T07:17:36.290730+0000","last_undegraded":"2023-11-26T07:17:36.290730+0000","last_fullsized":"2023-11-26T07:17:36.290730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275512+0000","last_change":"2023-11-26T07:17:34.271952+0000","last_active":"2023-11-26T07:17:35.275512+0000","last_peered":"2023-11-26T07:17:35.275512+0000","last_clean":"2023-11-26T07:17:35.275512+0000","last_became_active":"2023-11-26T07:17:34.271686+0000","last_became_peered":"2023-11-26T07:17:34.271686+0000","last_unstale":"2023-11-26T07:17:35.275512+0000","last_undegraded":"2023-11-26T07:17:35.275512+0000","last_fullsized":"2023-11-26T07:17:35.275512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.287880+0000","last_change":"2023-11-26T07:17:35.289335+0000","last_active":"2023-11-26T07:17:36.287880+0000","last_peered":"2023-11-26T07:17:36.287880+0000","last_clean":"2023-11-26T07:17:36.287880+0000","last_became_active":"2023-11-26T07:17:35.288975+0000","last_became_peered":"2023-11-26T07:17:35.288975+0000","last_unstale":"2023-11-26T07:17:36.287880+0000","last_undegraded":"2023-11-26T07:17:36.287880+0000","last_fullsized":"2023-11-26T07:17:36.287880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:35.805458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.271170+0000","last_change":"2023-11-26T07:17:34.259717+0000","last_active":"2023-11-26T07:17:35.271170+0000","last_peered":"2023-11-26T07:17:35.271170+0000","last_clean":"2023-11-26T07:17:35.271170+0000","last_became_active":"2023-11-26T07:17:34.259440+0000","last_became_peered":"2023-11-26T07:17:34.259440+0000","last_unstale":"2023-11-26T07:17:35.271170+0000","last_undegraded":"2023-11-26T07:17:35.271170+0000","last_fullsized":"2023-11-26T07:17:35.271170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:19:01.400658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852532+0000","last_change":"2023-11-26T07:17:35.284821+0000","last_active":"2023-11-26T07:17:36.852532+0000","last_peered":"2023-11-26T07:17:36.852532+0000","last_clean":"2023-11-26T07:17:36.852532+0000","last_became_active":"2023-11-26T07:17:35.283626+0000","last_became_peered":"2023-11-26T07:17:35.283626+0000","last_unstale":"2023-11-26T07:17:36.852532+0000","last_undegraded":"2023-11-26T07:17:36.852532+0000","last_fullsized":"2023-11-26T07:17:36.852532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:18:40.959410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.265947+0000","last_change":"2023-11-26T07:17:34.258767+0000","last_active":"2023-11-26T07:17:35.265947+0000","last_peered":"2023-11-26T07:17:35.265947+0000","last_clean":"2023-11-26T07:17:35.265947+0000","last_became_active":"2023-11-26T07:17:34.257967+0000","last_became_peered":"2023-11-26T07:17:34.257967+0000","last_unstale":"2023-11-26T07:17:35.265947+0000","last_undegraded":"2023-11-26T07:17:35.265947+0000","last_fullsized":"2023-11-26T07:17:35.265947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:13.669938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.856130+0000","last_change":"2023-11-26T07:17:35.303810+0000","last_active":"2023-11-26T07:17:36.856130+0000","last_peered":"2023-11-26T07:17:36.856130+0000","last_clean":"2023-11-26T07:17:36.856130+0000","last_became_active":"2023-11-26T07:17:35.303085+0000","last_became_peered":"2023-11-26T07:17:35.303085+0000","last_unstale":"2023-11-26T07:17:36.856130+0000","last_undegraded":"2023-11-26T07:17:36.856130+0000","last_fullsized":"2023-11-26T07:17:36.856130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:08.406810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.278333+0000","last_change":"2023-11-26T07:17:34.256005+0000","last_active":"2023-11-26T07:17:35.278333+0000","last_peered":"2023-11-26T07:17:35.278333+0000","last_clean":"2023-11-26T07:17:35.278333+0000","last_became_active":"2023-11-26T07:17:34.255598+0000","last_became_peered":"2023-11-26T07:17:34.255598+0000","last_unstale":"2023-11-26T07:17:35.278333+0000","last_undegraded":"2023-11-26T07:17:35.278333+0000","last_fullsized":"2023-11-26T07:17:35.278333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:47.932199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291901+0000","last_change":"2023-11-26T07:17:35.293918+0000","last_active":"2023-11-26T07:17:36.291901+0000","last_peered":"2023-11-26T07:17:36.291901+0000","last_clean":"2023-11-26T07:17:36.291901+0000","last_became_active":"2023-11-26T07:17:35.293651+0000","last_became_peered":"2023-11-26T07:17:35.293651+0000","last_unstale":"2023-11-26T07:17:36.291901+0000","last_undegraded":"2023-11-26T07:17:36.291901+0000","last_fullsized":"2023-11-26T07:17:36.291901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:59:08.684829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.285652+0000","last_change":"2023-11-26T07:17:34.274703+0000","last_active":"2023-11-26T07:17:35.285652+0000","last_peered":"2023-11-26T07:17:35.285652+0000","last_clean":"2023-11-26T07:17:35.285652+0000","last_became_active":"2023-11-26T07:17:34.274347+0000","last_became_peered":"2023-11-26T07:17:34.274347+0000","last_unstale":"2023-11-26T07:17:35.285652+0000","last_undegraded":"2023-11-26T07:17:35.285652+0000","last_fullsized":"2023-11-26T07:17:35.285652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:13.669938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.852897+0000","last_change":"2023-11-26T07:17:35.282993+0000","last_active":"2023-11-26T07:17:36.852897+0000","last_peered":"2023-11-26T07:17:36.852897+0000","last_clean":"2023-11-26T07:17:36.852897+0000","last_became_active":"2023-11-26T07:17:35.282727+0000","last_became_peered":"2023-11-26T07:17:35.282727+0000","last_unstale":"2023-11-26T07:17:36.852897+0000","last_undegraded":"2023-11-26T07:17:36.852897+0000","last_fullsized":"2023-11-26T07:17:36.852897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853237+0000","last_change":"2023-11-26T07:17:34.271447+0000","last_active":"2023-11-26T07:17:36.853237+0000","last_peered":"2023-11-26T07:17:36.853237+0000","last_clean":"2023-11-26T07:17:36.853237+0000","last_became_active":"2023-11-26T07:17:34.270049+0000","last_became_peered":"2023-11-26T07:17:34.270049+0000","last_unstale":"2023-11-26T07:17:36.853237+0000","last_undegraded":"2023-11-26T07:17:36.853237+0000","last_fullsized":"2023-11-26T07:17:36.853237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291300+0000","last_change":"2023-11-26T07:17:35.296985+0000","last_active":"2023-11-26T07:17:36.291300+0000","last_peered":"2023-11-26T07:17:36.291300+0000","last_clean":"2023-11-26T07:17:36.291300+0000","last_became_active":"2023-11-26T07:17:35.296635+0000","last_became_peered":"2023-11-26T07:17:35.296635+0000","last_unstale":"2023-11-26T07:17:36.291300+0000","last_undegraded":"2023-11-26T07:17:36.291300+0000","last_fullsized":"2023-11-26T07:17:36.291300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:42:54.638987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.309336+0000","last_change":"2023-11-26T07:17:34.272765+0000","last_active":"2023-11-26T07:17:35.309336+0000","last_peered":"2023-11-26T07:17:35.309336+0000","last_clean":"2023-11-26T07:17:35.309336+0000","last_became_active":"2023-11-26T07:17:34.272359+0000","last_became_peered":"2023-11-26T07:17:34.272359+0000","last_unstale":"2023-11-26T07:17:35.309336+0000","last_undegraded":"2023-11-26T07:17:35.309336+0000","last_fullsized":"2023-11-26T07:17:35.309336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289184+0000","last_change":"2023-11-26T07:17:35.280353+0000","last_active":"2023-11-26T07:17:36.289184+0000","last_peered":"2023-11-26T07:17:36.289184+0000","last_clean":"2023-11-26T07:17:36.289184+0000","last_became_active":"2023-11-26T07:17:35.280060+0000","last_became_peered":"2023-11-26T07:17:35.280060+0000","last_unstale":"2023-11-26T07:17:36.289184+0000","last_undegraded":"2023-11-26T07:17:36.289184+0000","last_fullsized":"2023-11-26T07:17:36.289184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:14.674926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.275318+0000","last_change":"2023-11-26T07:17:34.275747+0000","last_active":"2023-11-26T07:17:35.275318+0000","last_peered":"2023-11-26T07:17:35.275318+0000","last_clean":"2023-11-26T07:17:35.275318+0000","last_became_active":"2023-11-26T07:17:34.275273+0000","last_became_peered":"2023-11-26T07:17:34.275273+0000","last_unstale":"2023-11-26T07:17:35.275318+0000","last_undegraded":"2023-11-26T07:17:35.275318+0000","last_fullsized":"2023-11-26T07:17:35.275318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:44:58.427847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.853734+0000","last_change":"2023-11-26T07:17:35.287995+0000","last_active":"2023-11-26T07:17:36.853734+0000","last_peered":"2023-11-26T07:17:36.853734+0000","last_clean":"2023-11-26T07:17:36.853734+0000","last_became_active":"2023-11-26T07:17:35.287690+0000","last_became_peered":"2023-11-26T07:17:35.287690+0000","last_unstale":"2023-11-26T07:17:36.853734+0000","last_undegraded":"2023-11-26T07:17:36.853734+0000","last_fullsized":"2023-11-26T07:17:36.853734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:32.219653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.276561+0000","last_change":"2023-11-26T07:17:34.261040+0000","last_active":"2023-11-26T07:17:35.276561+0000","last_peered":"2023-11-26T07:17:35.276561+0000","last_clean":"2023-11-26T07:17:35.276561+0000","last_became_active":"2023-11-26T07:17:34.260678+0000","last_became_peered":"2023-11-26T07:17:34.260678+0000","last_unstale":"2023-11-26T07:17:35.276561+0000","last_undegraded":"2023-11-26T07:17:35.276561+0000","last_fullsized":"2023-11-26T07:17:35.276561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.290254+0000","last_change":"2023-11-26T07:17:35.280159+0000","last_active":"2023-11-26T07:17:36.290254+0000","last_peered":"2023-11-26T07:17:36.290254+0000","last_clean":"2023-11-26T07:17:36.290254+0000","last_became_active":"2023-11-26T07:17:35.279819+0000","last_became_peered":"2023-11-26T07:17:35.279819+0000","last_unstale":"2023-11-26T07:17:36.290254+0000","last_undegraded":"2023-11-26T07:17:36.290254+0000","last_fullsized":"2023-11-26T07:17:36.290254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.278229+0000","last_change":"2023-11-26T07:17:34.248282+0000","last_active":"2023-11-26T07:17:35.278229+0000","last_peered":"2023-11-26T07:17:35.278229+0000","last_clean":"2023-11-26T07:17:35.278229+0000","last_became_active":"2023-11-26T07:17:34.247565+0000","last_became_peered":"2023-11-26T07:17:34.247565+0000","last_unstale":"2023-11-26T07:17:35.278229+0000","last_undegraded":"2023-11-26T07:17:35.278229+0000","last_fullsized":"2023-11-26T07:17:35.278229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:50.431819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291259+0000","last_change":"2023-11-26T07:17:35.284496+0000","last_active":"2023-11-26T07:17:36.291259+0000","last_peered":"2023-11-26T07:17:36.291259+0000","last_clean":"2023-11-26T07:17:36.291259+0000","last_became_active":"2023-11-26T07:17:35.283640+0000","last_became_peered":"2023-11-26T07:17:35.283640+0000","last_unstale":"2023-11-26T07:17:36.291259+0000","last_undegraded":"2023-11-26T07:17:36.291259+0000","last_fullsized":"2023-11-26T07:17:36.291259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:51.204895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.312542+0000","last_change":"2023-11-26T07:17:34.270854+0000","last_active":"2023-11-26T07:17:35.312542+0000","last_peered":"2023-11-26T07:17:35.312542+0000","last_clean":"2023-11-26T07:17:35.312542+0000","last_became_active":"2023-11-26T07:17:34.270525+0000","last_became_peered":"2023-11-26T07:17:34.270525+0000","last_unstale":"2023-11-26T07:17:35.312542+0000","last_undegraded":"2023-11-26T07:17:35.312542+0000","last_fullsized":"2023-11-26T07:17:35.312542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:34.800470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.854803+0000","last_change":"2023-11-26T07:17:35.288782+0000","last_active":"2023-11-26T07:17:36.854803+0000","last_peered":"2023-11-26T07:17:36.854803+0000","last_clean":"2023-11-26T07:17:36.854803+0000","last_became_active":"2023-11-26T07:17:35.287263+0000","last_became_peered":"2023-11-26T07:17:35.287263+0000","last_unstale":"2023-11-26T07:17:36.854803+0000","last_undegraded":"2023-11-26T07:17:36.854803+0000","last_fullsized":"2023-11-26T07:17:36.854803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:48.937187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291873+0000","last_change":"2023-11-26T07:17:35.303027+0000","last_active":"2023-11-26T07:17:36.291873+0000","last_peered":"2023-11-26T07:17:36.291873+0000","last_clean":"2023-11-26T07:17:36.291873+0000","last_became_active":"2023-11-26T07:17:35.302802+0000","last_became_peered":"2023-11-26T07:17:35.302802+0000","last_unstale":"2023-11-26T07:17:36.291873+0000","last_undegraded":"2023-11-26T07:17:36.291873+0000","last_fullsized":"2023-11-26T07:17:36.291873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:01:13.104649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.310109+0000","last_change":"2023-11-26T07:17:34.275614+0000","last_active":"2023-11-26T07:17:35.310109+0000","last_peered":"2023-11-26T07:17:35.310109+0000","last_clean":"2023-11-26T07:17:35.310109+0000","last_became_active":"2023-11-26T07:17:34.274852+0000","last_became_peered":"2023-11-26T07:17:34.274852+0000","last_unstale":"2023-11-26T07:17:35.310109+0000","last_undegraded":"2023-11-26T07:17:35.310109+0000","last_fullsized":"2023-11-26T07:17:35.310109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291376+0000","last_change":"2023-11-26T07:17:35.302995+0000","last_active":"2023-11-26T07:17:36.291376+0000","last_peered":"2023-11-26T07:17:36.291376+0000","last_clean":"2023-11-26T07:17:36.291376+0000","last_became_active":"2023-11-26T07:17:35.302669+0000","last_became_peered":"2023-11-26T07:17:35.302669+0000","last_unstale":"2023-11-26T07:17:36.291376+0000","last_undegraded":"2023-11-26T07:17:36.291376+0000","last_fullsized":"2023-11-26T07:17:36.291376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:31.633994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.308916+0000","last_change":"2023-11-26T07:17:34.275105+0000","last_active":"2023-11-26T07:17:35.308916+0000","last_peered":"2023-11-26T07:17:35.308916+0000","last_clean":"2023-11-26T07:17:35.308916+0000","last_became_active":"2023-11-26T07:17:34.274649+0000","last_became_peered":"2023-11-26T07:17:34.274649+0000","last_unstale":"2023-11-26T07:17:35.308916+0000","last_undegraded":"2023-11-26T07:17:35.308916+0000","last_fullsized":"2023-11-26T07:17:35.308916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:04.297880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.289574+0000","last_change":"2023-11-26T07:17:35.286325+0000","last_active":"2023-11-26T07:17:36.289574+0000","last_peered":"2023-11-26T07:17:36.289574+0000","last_clean":"2023-11-26T07:17:36.289574+0000","last_became_active":"2023-11-26T07:17:35.286007+0000","last_became_peered":"2023-11-26T07:17:35.286007+0000","last_unstale":"2023-11-26T07:17:36.289574+0000","last_undegraded":"2023-11-26T07:17:36.289574+0000","last_fullsized":"2023-11-26T07:17:36.289574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:27:51.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.307875+0000","last_change":"2023-11-26T07:17:34.258227+0000","last_active":"2023-11-26T07:17:35.307875+0000","last_peered":"2023-11-26T07:17:35.307875+0000","last_clean":"2023-11-26T07:17:35.307875+0000","last_became_active":"2023-11-26T07:17:34.257930+0000","last_became_peered":"2023-11-26T07:17:34.257930+0000","last_unstale":"2023-11-26T07:17:35.307875+0000","last_undegraded":"2023-11-26T07:17:35.307875+0000","last_fullsized":"2023-11-26T07:17:35.307875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:05:58.102392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:17:36.291071+0000","last_change":"2023-11-26T07:17:35.286743+0000","last_active":"2023-11-26T07:17:36.291071+0000","last_peered":"2023-11-26T07:17:36.291071+0000","last_clean":"2023-11-26T07:17:36.291071+0000","last_became_active":"2023-11-26T07:17:35.286436+0000","last_became_peered":"2023-11-26T07:17:35.286436+0000","last_unstale":"2023-11-26T07:17:36.291071+0000","last_undegraded":"2023-11-26T07:17:36.291071+0000","last_fullsized":"2023-11-26T07:17:36.291071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:34.219606+0000","last_clean_scrub_stamp":"2023-11-26T07:17:34.219606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:09:20.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:17:35.310076+0000","last_change":"2023-11-26T07:17:34.271042+0000","last_active":"2023-11-26T07:17:35.310076+0000","last_peered":"2023-11-26T07:17:35.310076+0000","last_clean":"2023-11-26T07:17:35.310076+0000","last_became_active":"2023-11-26T07:17:34.270720+0000","last_became_peered":"2023-11-26T07:17:34.270720+0000","last_unstale":"2023-11-26T07:17:35.310076+0000","last_undegraded":"2023-11-26T07:17:35.310076+0000","last_fullsized":"2023-11-26T07:17:35.310076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:33.214618+0000","last_clean_scrub_stamp":"2023-11-26T07:17:33.214618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:49:42.109088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.647}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.827}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5329999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8180000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:17:45.647 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-26T07:17:45.647 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-26T07:17:45.647 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-26T07:17:45.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-26T07:17:45.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.890+0000 7f5e899ce640 1 Processor -- start 2023-11-26T07:17:45.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.890+0000 7f5e899ce640 1 -- start start 2023-11-26T07:17:45.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.892+0000 7f5e899ce640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5e84157c70 0x7f5e84161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.892+0000 7f5e899ce640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8415e390 0x7f5e840cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.892+0000 7f5e899ce640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e840ce0b0 con 0x7f5e840cf450 2023-11-26T07:17:45.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.892+0000 7f5e899ce640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840cfe40 con 0x7f5e84157c70 2023-11-26T07:17:45.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.892+0000 7f5e899ce640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84161960 con 0x7f5e8415e390 2023-11-26T07:17:45.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.892+0000 7f5e7a7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5e840cf450 0x7f5e8415dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40616/0 (socket says 172.21.15.77:40616) 2023-11-26T07:17:45.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.892+0000 7f5e7a7fc640 1 -- 172.21.15.77:0/1432398603 learned_addr learned my addr 172.21.15.77:0/1432398603 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:45.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.892+0000 7f5e82ffd640 1 --2- 172.21.15.77:0/1432398603 >> v2:172.21.15.159:3300/0 conn(0x7f5e84157c70 0x7f5e84161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.892+0000 7f5e837fe640 1 --2- 172.21.15.77:0/1432398603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8415e390 0x7f5e840cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.892+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194129773 0 0) 0x7f5e840ce0b0 con 0x7f5e840cf450 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.892+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e70003520 con 0x7f5e840cf450 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3059038885 0 0) 0x7f5e70003520 con 0x7f5e840cf450 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8415e390 msgr2=0x7f5e840cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 --2- 172.21.15.77:0/1432398603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8415e390 0x7f5e840cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 >> v2:172.21.15.159:3300/0 conn(0x7f5e84157c70 msgr2=0x7f5e84161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 --2- 172.21.15.77:0/1432398603 >> v2:172.21.15.159:3300/0 conn(0x7f5e84157c70 0x7f5e84161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8415e8d0 con 0x7f5e840cf450 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f5e6c001670 con 0x7f5e840cf450 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 >> v1:172.21.15.77:6789/0 conn(0x7f5e840cf450 legacy=0x7f5e8415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 --2- 172.21.15.77:0/1432398603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8415e390 0x7f5e70003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 --2- 172.21.15.77:0/1432398603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e70003f40 0x7f5e700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 --2- 172.21.15.77:0/1432398603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e70004d00 0x7f5e70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840cfe40 con 0x7f5e70004d00 2023-11-26T07:17:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84161960 con 0x7f5e70003f40 2023-11-26T07:17:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7000ba30 con 0x7f5e8415e390 2023-11-26T07:17:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e837fe640 1 --2- 172.21.15.77:0/1432398603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e70004d00 0x7f5e70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e837fe640 1 -- 172.21.15.77:0/1432398603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8415e390 msgr2=0x7f5e70003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e837fe640 1 --2- 172.21.15.77:0/1432398603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8415e390 0x7f5e70003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e837fe640 1 -- 172.21.15.77:0/1432398603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e70003f40 msgr2=0x7f5e700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e837fe640 1 --2- 172.21.15.77:0/1432398603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e70003f40 0x7f5e700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.893+0000 7f5e837fe640 1 -- 172.21.15.77:0/1432398603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e70003520 con 0x7f5e70004d00 2023-11-26T07:17:45.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.894+0000 7f5e837fe640 1 --2- 172.21.15.77:0/1432398603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e70004d00 0x7f5e70005180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009f90 tx=0x7f5e700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc52126b2f29c80f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.895+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c02cc20 con 0x7f5e70004d00 2023-11-26T07:17:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.895+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c00f040 con 0x7f5e70004d00 2023-11-26T07:17:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.895+0000 7f5e827fc640 1 -- 172.21.15.77:0/1432398603 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c034440 con 0x7f5e70004d00 2023-11-26T07:17:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.895+0000 7f5e899ce640 1 -- 172.21.15.77:0/1432398603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e70004d00 msgr2=0x7f5e70005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.895+0000 7f5e899ce640 1 --2- 172.21.15.77:0/1432398603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e70004d00 0x7f5e70005180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009f90 tx=0x7f5e700057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.895+0000 7f5e837fe640 1 -- 172.21.15.77:0/1432398603 reap_dead start 2023-11-26T07:17:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.895+0000 7f5e899ce640 1 -- 172.21.15.77:0/1432398603 shutdown_connections 2023-11-26T07:17:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.895+0000 7f5e899ce640 1 -- 172.21.15.77:0/1432398603 >> 172.21.15.77:0/1432398603 conn(0x7f5e8406a920 msgr2=0x7f5e8406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.895+0000 7f5e899ce640 1 -- 172.21.15.77:0/1432398603 shutdown_connections 2023-11-26T07:17:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.895+0000 7f5e899ce640 1 -- 172.21.15.77:0/1432398603 wait complete. 2023-11-26T07:17:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.897+0000 7f5e899ce640 1 Processor -- start 2023-11-26T07:17:45.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.897+0000 7f5e899ce640 1 -- start start 2023-11-26T07:17:45.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.898+0000 7f5e899ce640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e70004d00 0x7f5e840ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.898+0000 7f5e899ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e84155930 0x7f5e840c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.898+0000 7f5e899ce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e840b3170 0x7f5e840b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.898+0000 7f5e899ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840992e0 con 0x7f5e84155930 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.898+0000 7f5e899ce640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840caef0 con 0x7f5e840b3170 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.898+0000 7f5e899ce640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840b3b30 con 0x7f5e70004d00 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.898+0000 7f5e7a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e84155930 0x7f5e840c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.898+0000 7f5e7a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e84155930 0x7f5e840c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40600/0 (socket says 172.21.15.77:40600) 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.898+0000 7f5e7a7fc640 1 -- 172.21.15.77:0/2953814942 learned_addr learned my addr 172.21.15.77:0/2953814942 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e82ffd640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e70004d00 0x7f5e840ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e7a7fc640 1 -- 172.21.15.77:0/2953814942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e70004d00 msgr2=0x7f5e840ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e7a7fc640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e70004d00 0x7f5e840ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e837fe640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e840b3170 0x7f5e840b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e7a7fc640 1 -- 172.21.15.77:0/2953814942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e840b3170 msgr2=0x7f5e840b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e7a7fc640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e840b3170 0x7f5e840b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e7a7fc640 1 -- 172.21.15.77:0/2953814942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840c88a0 con 0x7f5e84155930 2023-11-26T07:17:45.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e7a7fc640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e84155930 0x7f5e840c8360 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00c7a0 tx=0x7f5e6c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e80ff9640 1 -- 172.21.15.77:0/2953814942 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0074e0 con 0x7f5e84155930 2023-11-26T07:17:45.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e80ff9640 1 -- 172.21.15.77:0/2953814942 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c007640 con 0x7f5e84155930 2023-11-26T07:17:45.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e80ff9640 1 -- 172.21.15.77:0/2953814942 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c004a20 con 0x7f5e84155930 2023-11-26T07:17:45.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e899ce640 1 -- 172.21.15.77:0/2953814942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e840c93e0 con 0x7f5e84155930 2023-11-26T07:17:45.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.899+0000 7f5e899ce640 1 -- 172.21.15.77:0/2953814942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e840c8e20 con 0x7f5e84155930 2023-11-26T07:17:45.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.900+0000 7f5e899ce640 1 -- 172.21.15.77:0/2953814942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e84099420 con 0x7f5e84155930 2023-11-26T07:17:45.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.901+0000 7f5e80ff9640 1 -- 172.21.15.77:0/2953814942 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e6c004c40 con 0x7f5e84155930 2023-11-26T07:17:45.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.902+0000 7f5e80ff9640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5e6406ae40 0x7f5e6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.902+0000 7f5e80ff9640 1 -- 172.21.15.77:0/2953814942 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e6c088b40 con 0x7f5e84155930 2023-11-26T07:17:45.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.902+0000 7f5e82ffd640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5e6406ae40 0x7f5e6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.903+0000 7f5e82ffd640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5e6406ae40 0x7f5e6406d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5e74004770 tx=0x7f5e74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:45.907+0000 7f5e80ff9640 1 -- 172.21.15.77:0/2953814942 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e84099420 con 0x7f5e84155930 2023-11-26T07:17:46.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.133+0000 7f5e899ce640 1 -- 172.21.15.77:0/2953814942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5e84099420 con 0x7f5e84155930 2023-11-26T07:17:46.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.134+0000 7f5e80ff9640 1 -- 172.21.15.77:0/2953814942 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5e84099420 con 0x7f5e84155930 2023-11-26T07:17:46.136 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:46.136 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-26T07:17:46.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.136+0000 7f5e899ce640 1 -- 172.21.15.77:0/2953814942 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5e6406ae40 msgr2=0x7f5e6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.136+0000 7f5e899ce640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5e6406ae40 0x7f5e6406d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5e74004770 tx=0x7f5e74008040 comp rx=0 tx=0).stop 2023-11-26T07:17:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.136+0000 7f5e899ce640 1 -- 172.21.15.77:0/2953814942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e84155930 msgr2=0x7f5e840c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.136+0000 7f5e899ce640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e84155930 0x7f5e840c8360 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00c7a0 tx=0x7f5e6c00cc60 comp rx=0 tx=0).stop 2023-11-26T07:17:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.137+0000 7f5e899ce640 1 -- 172.21.15.77:0/2953814942 shutdown_connections 2023-11-26T07:17:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.137+0000 7f5e899ce640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5e6406ae40 0x7f5e6406d300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.137+0000 7f5e899ce640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e840b3170 0x7f5e840b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.137+0000 7f5e899ce640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e84155930 0x7f5e840c8360 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.137+0000 7f5e899ce640 1 --2- 172.21.15.77:0/2953814942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e70004d00 0x7f5e840ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.137+0000 7f5e899ce640 1 -- 172.21.15.77:0/2953814942 >> 172.21.15.77:0/2953814942 conn(0x7f5e8406a920 msgr2=0x7f5e840b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.137+0000 7f5e899ce640 1 -- 172.21.15.77:0/2953814942 shutdown_connections 2023-11-26T07:17:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.137+0000 7f5e899ce640 1 -- 172.21.15.77:0/2953814942 wait complete. 2023-11-26T07:17:46.156 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-26T07:17:46.157 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:46.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.375+0000 7ff359d33640 1 Processor -- start 2023-11-26T07:17:46.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.375+0000 7ff359d33640 1 -- start start 2023-11-26T07:17:46.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.376+0000 7ff359d33640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff35415c7f0 0x7ff35406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.376+0000 7ff359d33640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff3540cf450 0x7ff3540cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.377+0000 7ff359d33640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3540cece0 con 0x7ff3540cdfb0 2023-11-26T07:17:46.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.377+0000 7ff359d33640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff354156010 con 0x7ff35415c7f0 2023-11-26T07:17:46.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.377+0000 7ff359d33640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35406ce30 con 0x7ff3540cf450 2023-11-26T07:17:46.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.377+0000 7ff352ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff3540cf450 0x7ff3540cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.377+0000 7ff352ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff3540cf450 0x7ff3540cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:37928/0 (socket says 172.21.15.77:37928) 2023-11-26T07:17:46.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.377+0000 7ff352ffd640 1 -- 172.21.15.77:0/848130453 learned_addr learned my addr 172.21.15.77:0/848130453 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:46.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.377+0000 7ff3537fe640 1 --2- 172.21.15.77:0/848130453 >> v2:172.21.15.159:3300/0 conn(0x7ff35415c7f0 0x7ff35406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.378+0000 7ff352ffd640 1 -- 172.21.15.77:0/848130453 >> v2:172.21.15.159:3300/0 conn(0x7ff35415c7f0 msgr2=0x7ff35406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:46.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.378+0000 7ff352ffd640 1 --2- 172.21.15.77:0/848130453 >> v2:172.21.15.159:3300/0 conn(0x7ff35415c7f0 0x7ff35406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.378+0000 7ff352ffd640 1 -- 172.21.15.77:0/848130453 >> v1:172.21.15.159:6789/0 conn(0x7ff3540cdfb0 legacy=0x7ff3540ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.378+0000 7ff352ffd640 1 -- 172.21.15.77:0/848130453 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35406d040 con 0x7ff3540cf450 2023-11-26T07:17:46.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.379+0000 7ff352ffd640 1 --2- 172.21.15.77:0/848130453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff3540cf450 0x7ff3540cf8d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff348009870 tx=0x7ff34802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65dcd0c4f0aad8ad server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:46.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.380+0000 7ff3527fc640 1 -- 172.21.15.77:0/848130453 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348030840 con 0x7ff3540cf450 2023-11-26T07:17:46.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.380+0000 7ff3527fc640 1 -- 172.21.15.77:0/848130453 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3480309a0 con 0x7ff3540cf450 2023-11-26T07:17:46.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.380+0000 7ff3527fc640 1 -- 172.21.15.77:0/848130453 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348030d30 con 0x7ff3540cf450 2023-11-26T07:17:46.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.380+0000 7ff359d33640 1 -- 172.21.15.77:0/848130453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff3540cf450 msgr2=0x7ff3540cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.380+0000 7ff359d33640 1 --2- 172.21.15.77:0/848130453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff3540cf450 0x7ff3540cf8d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff348009870 tx=0x7ff34802b980 comp rx=0 tx=0).stop 2023-11-26T07:17:46.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.381+0000 7ff359d33640 1 -- 172.21.15.77:0/848130453 shutdown_connections 2023-11-26T07:17:46.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.381+0000 7ff359d33640 1 --2- 172.21.15.77:0/848130453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff3540cf450 0x7ff3540cf8d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.381+0000 7ff359d33640 1 --2- 172.21.15.77:0/848130453 >> v2:172.21.15.159:3300/0 conn(0x7ff35415c7f0 0x7ff35406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.381+0000 7ff359d33640 1 -- 172.21.15.77:0/848130453 >> 172.21.15.77:0/848130453 conn(0x7ff35406a920 msgr2=0x7ff35406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:46.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.381+0000 7ff359d33640 1 -- 172.21.15.77:0/848130453 shutdown_connections 2023-11-26T07:17:46.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.381+0000 7ff359d33640 1 -- 172.21.15.77:0/848130453 wait complete. 2023-11-26T07:17:46.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.382+0000 7ff359d33640 1 Processor -- start 2023-11-26T07:17:46.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.382+0000 7ff359d33640 1 -- start start 2023-11-26T07:17:46.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.383+0000 7ff359d33640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3540cdfb0 0x7ff354156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.383+0000 7ff359d33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3540cf450 0x7ff3541f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.383+0000 7ff359d33640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff35415c7f0 0x7ff35415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.383+0000 7ff359d33640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff354157d10 con 0x7ff3540cf450 2023-11-26T07:17:46.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.383+0000 7ff359d33640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff354157f40 con 0x7ff3540cdfb0 2023-11-26T07:17:46.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.383+0000 7ff359d33640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff354158220 con 0x7ff35415c7f0 2023-11-26T07:17:46.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.384+0000 7ff352ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3540cf450 0x7ff3541f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.384+0000 7ff352ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3540cf450 0x7ff3541f3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40608/0 (socket says 172.21.15.77:40608) 2023-11-26T07:17:46.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.384+0000 7ff352ffd640 1 -- 172.21.15.77:0/815217644 learned_addr learned my addr 172.21.15.77:0/815217644 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:46.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.384+0000 7ff353fff640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff35415c7f0 0x7ff35415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.384+0000 7ff3537fe640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3540cdfb0 0x7ff354156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.384+0000 7ff352ffd640 1 -- 172.21.15.77:0/815217644 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff35415c7f0 msgr2=0x7ff35415ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.384+0000 7ff352ffd640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff35415c7f0 0x7ff35415ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.384+0000 7ff352ffd640 1 -- 172.21.15.77:0/815217644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3540cdfb0 msgr2=0x7ff354156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.384+0000 7ff352ffd640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3540cdfb0 0x7ff354156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.384+0000 7ff352ffd640 1 -- 172.21.15.77:0/815217644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3480094d0 con 0x7ff3540cf450 2023-11-26T07:17:46.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.385+0000 7ff352ffd640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3540cf450 0x7ff3541f3fd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff348000c00 tx=0x7ff348004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:46.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.385+0000 7ff33bfff640 1 -- 172.21.15.77:0/815217644 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348039c90 con 0x7ff3540cf450 2023-11-26T07:17:46.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.385+0000 7ff33bfff640 1 -- 172.21.15.77:0/815217644 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff348039df0 con 0x7ff3540cf450 2023-11-26T07:17:46.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.385+0000 7ff33bfff640 1 -- 172.21.15.77:0/815217644 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348043640 con 0x7ff3540cf450 2023-11-26T07:17:46.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.385+0000 7ff359d33640 1 -- 172.21.15.77:0/815217644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff354158500 con 0x7ff3540cf450 2023-11-26T07:17:46.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.385+0000 7ff359d33640 1 -- 172.21.15.77:0/815217644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff354158ac0 con 0x7ff3540cf450 2023-11-26T07:17:46.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.386+0000 7ff359d33640 1 -- 172.21.15.77:0/815217644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff354067470 con 0x7ff3540cf450 2023-11-26T07:17:46.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.387+0000 7ff33bfff640 1 -- 172.21.15.77:0/815217644 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3480437a0 con 0x7ff3540cf450 2023-11-26T07:17:46.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.388+0000 7ff33bfff640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff34006ae40 0x7ff34006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.389+0000 7ff33bfff640 1 -- 172.21.15.77:0/815217644 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff34803e070 con 0x7ff3540cf450 2023-11-26T07:17:46.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.389+0000 7ff3537fe640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff34006ae40 0x7ff34006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.389+0000 7ff3537fe640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff34006ae40 0x7ff34006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff344009a30 tx=0x7ff344008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:46.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.393+0000 7ff33bfff640 1 -- 172.21.15.77:0/815217644 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3480776f0 con 0x7ff3540cf450 2023-11-26T07:17:46.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.589+0000 7ff359d33640 1 -- 172.21.15.77:0/815217644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff354073b10 con 0x7ff3540cf450 2023-11-26T07:17:46.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.591+0000 7ff33bfff640 1 -- 172.21.15.77:0/815217644 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7ff34807ad10 con 0x7ff3540cf450 2023-11-26T07:17:46.593 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:46.594 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:36.274387+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:46.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.594+0000 7ff359d33640 1 -- 172.21.15.77:0/815217644 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff34006ae40 msgr2=0x7ff34006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.594+0000 7ff359d33640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff34006ae40 0x7ff34006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff344009a30 tx=0x7ff344008040 comp rx=0 tx=0).stop 2023-11-26T07:17:46.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.594+0000 7ff359d33640 1 -- 172.21.15.77:0/815217644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3540cf450 msgr2=0x7ff3541f3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.594+0000 7ff359d33640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3540cf450 0x7ff3541f3fd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff348000c00 tx=0x7ff348004730 comp rx=0 tx=0).stop 2023-11-26T07:17:46.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.594+0000 7ff359d33640 1 -- 172.21.15.77:0/815217644 shutdown_connections 2023-11-26T07:17:46.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.594+0000 7ff359d33640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff34006ae40 0x7ff34006d300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.594+0000 7ff359d33640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff35415c7f0 0x7ff35415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.594+0000 7ff359d33640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3540cf450 0x7ff3541f3fd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.594+0000 7ff359d33640 1 --2- 172.21.15.77:0/815217644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3540cdfb0 0x7ff354156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.594+0000 7ff359d33640 1 -- 172.21.15.77:0/815217644 >> 172.21.15.77:0/815217644 conn(0x7ff35406a920 msgr2=0x7ff3540ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:46.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.595+0000 7ff359d33640 1 -- 172.21.15.77:0/815217644 shutdown_connections 2023-11-26T07:17:46.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.595+0000 7ff359d33640 1 -- 172.21.15.77:0/815217644 wait complete. 2023-11-26T07:17:46.614 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:17:46.614 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:17:46.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.824+0000 7f82b759e640 1 Processor -- start 2023-11-26T07:17:46.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.825+0000 7f82b759e640 1 -- start start 2023-11-26T07:17:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.826+0000 7f82b759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b815a1c0 0x7f82b806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.826+0000 7f82b759e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f82b80b0b40 0x7f82b80b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.826+0000 7f82b759e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b806d430 con 0x7f82b815ded0 2023-11-26T07:17:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.826+0000 7f82b759e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b815ea70 con 0x7f82b80b0b40 2023-11-26T07:17:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.826+0000 7f82b759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b815ec50 con 0x7f82b815a1c0 2023-11-26T07:17:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.826+0000 7f82b6d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f82b815ded0 0x7f82b815e360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40618/0 (socket says 172.21.15.77:40618) 2023-11-26T07:17:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.826+0000 7f82b6d9d640 1 -- 172.21.15.77:0/1808458963 learned_addr learned my addr 172.21.15.77:0/1808458963 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:46.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b659c640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b815a1c0 0x7f82b806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82affff640 1 --2- 172.21.15.77:0/1808458963 >> v2:172.21.15.159:3300/0 conn(0x7f82b80b0b40 0x7f82b80b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787752573 0 0) 0x7f82b806d430 con 0x7f82b815ded0 2023-11-26T07:17:46.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a4003520 con 0x7f82b815ded0 2023-11-26T07:17:46.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3166526709 0 0) 0x7f82a4003520 con 0x7f82b815ded0 2023-11-26T07:17:46.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b815a1c0 msgr2=0x7f82b806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:46.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b815a1c0 0x7f82b806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 >> v2:172.21.15.159:3300/0 conn(0x7f82b80b0b40 msgr2=0x7f82b80b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:46.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 --2- 172.21.15.77:0/1808458963 >> v2:172.21.15.159:3300/0 conn(0x7f82b80b0b40 0x7f82b80b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80b14e0 con 0x7f82b815ded0 2023-11-26T07:17:46.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f82b00019f0 con 0x7f82b815ded0 2023-11-26T07:17:46.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 >> v1:172.21.15.77:6789/0 conn(0x7f82b815ded0 legacy=0x7f82b815e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82a4003970 0x7f82a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82a40047c0 0x7f82a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b815a1c0 0x7f82a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b815ea70 con 0x7f82a40047c0 2023-11-26T07:17:46.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b815ec50 con 0x7f82a4003970 2023-11-26T07:17:46.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.827+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a400b980 con 0x7f82b815a1c0 2023-11-26T07:17:46.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.828+0000 7f82affff640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82a40047c0 0x7f82a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.828+0000 7f82affff640 1 -- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b815a1c0 msgr2=0x7f82a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:46.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.828+0000 7f82b659c640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82a4003970 0x7f82a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.828+0000 7f82b6d9d640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b815a1c0 0x7f82a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.828+0000 7f82affff640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b815a1c0 0x7f82a4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.828+0000 7f82affff640 1 -- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82a4003970 msgr2=0x7f82a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:46.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.828+0000 7f82affff640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82a4003970 0x7f82a4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.828+0000 7f82affff640 1 -- 172.21.15.77:0/1808458963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a4003520 con 0x7f82a40047c0 2023-11-26T07:17:46.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.828+0000 7f82b659c640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82a4003970 0x7f82a4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:46.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.829+0000 7f82affff640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82a40047c0 0x7f82a4004c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009ac0 tx=0x7f82a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f019e64f285ac841 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:46.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.829+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a002c710 con 0x7f82a40047c0 2023-11-26T07:17:46.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.829+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a002c870 con 0x7f82a40047c0 2023-11-26T07:17:46.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.829+0000 7f82b5d9b640 1 -- 172.21.15.77:0/1808458963 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a002cc00 con 0x7f82a40047c0 2023-11-26T07:17:46.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.830+0000 7f82b759e640 1 -- 172.21.15.77:0/1808458963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82a40047c0 msgr2=0x7f82a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.830+0000 7f82b759e640 1 --2- 172.21.15.77:0/1808458963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82a40047c0 0x7f82a4004c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009ac0 tx=0x7f82a40057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.830+0000 7f82b6d9d640 1 -- 172.21.15.77:0/1808458963 reap_dead start 2023-11-26T07:17:46.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.830+0000 7f82b759e640 1 -- 172.21.15.77:0/1808458963 shutdown_connections 2023-11-26T07:17:46.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.830+0000 7f82b759e640 1 -- 172.21.15.77:0/1808458963 >> 172.21.15.77:0/1808458963 conn(0x7f82b80cbb40 msgr2=0x7f82b80cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:46.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.830+0000 7f82b759e640 1 -- 172.21.15.77:0/1808458963 shutdown_connections 2023-11-26T07:17:46.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.830+0000 7f82b759e640 1 -- 172.21.15.77:0/1808458963 wait complete. 2023-11-26T07:17:46.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.832+0000 7f82b759e640 1 Processor -- start 2023-11-26T07:17:46.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.832+0000 7f82b759e640 1 -- start start 2023-11-26T07:17:46.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.833+0000 7f82b759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82a40047c0 0x7f82b81f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.833+0000 7f82b759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b8151140 0x7f82b815b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.833+0000 7f82b759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b815b8b0 0x7f82b815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.833+0000 7f82b759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80c8bf0 con 0x7f82b815b8b0 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.833+0000 7f82b759e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80c7d20 con 0x7f82a40047c0 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.833+0000 7f82b759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80b4ec0 con 0x7f82b8151140 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.833+0000 7f82b6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b815b8b0 0x7f82b815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.833+0000 7f82b6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b815b8b0 0x7f82b815bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40628/0 (socket says 172.21.15.77:40628) 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.833+0000 7f82b6d9d640 1 -- 172.21.15.77:0/4086446699 learned_addr learned my addr 172.21.15.77:0/4086446699 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82b659c640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82a40047c0 0x7f82b81f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82affff640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b8151140 0x7f82b815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82b6d9d640 1 -- 172.21.15.77:0/4086446699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b8151140 msgr2=0x7f82b815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82b6d9d640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b8151140 0x7f82b815b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82b6d9d640 1 -- 172.21.15.77:0/4086446699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82a40047c0 msgr2=0x7f82b81f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82b6d9d640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82a40047c0 0x7f82b81f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82b6d9d640 1 -- 172.21.15.77:0/4086446699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80c7f70 con 0x7f82b815b8b0 2023-11-26T07:17:46.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82affff640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b8151140 0x7f82b815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:46.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82b6d9d640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b815b8b0 0x7f82b815bd30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f82b8070310 tx=0x7f82b000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:46.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82aeffd640 1 -- 172.21.15.77:0/4086446699 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0004d60 con 0x7f82b815b8b0 2023-11-26T07:17:46.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82aeffd640 1 -- 172.21.15.77:0/4086446699 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b000bb80 con 0x7f82b815b8b0 2023-11-26T07:17:46.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82aeffd640 1 -- 172.21.15.77:0/4086446699 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0007110 con 0x7f82b815b8b0 2023-11-26T07:17:46.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.834+0000 7f82b759e640 1 -- 172.21.15.77:0/4086446699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b80c8250 con 0x7f82b815b8b0 2023-11-26T07:17:46.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.835+0000 7f82b759e640 1 -- 172.21.15.77:0/4086446699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b80c8810 con 0x7f82b815b8b0 2023-11-26T07:17:46.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.836+0000 7f82b759e640 1 -- 172.21.15.77:0/4086446699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b804e840 con 0x7f82b815b8b0 2023-11-26T07:17:46.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.837+0000 7f82aeffd640 1 -- 172.21.15.77:0/4086446699 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82b0007270 con 0x7f82b815b8b0 2023-11-26T07:17:46.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.838+0000 7f82aeffd640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f829806ae40 0x7f829806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:46.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.838+0000 7f82aeffd640 1 -- 172.21.15.77:0/4086446699 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82b00899b0 con 0x7f82b815b8b0 2023-11-26T07:17:46.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.838+0000 7f82b659c640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f829806ae40 0x7f829806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:46.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.839+0000 7f82b659c640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f829806ae40 0x7f829806d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f82a80099c0 tx=0x7f82a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:46.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:46.842+0000 7f82aeffd640 1 -- 172.21.15.77:0/4086446699 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82b0054af0 con 0x7f82b815b8b0 2023-11-26T07:17:47.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.030+0000 7f82b759e640 1 -- 172.21.15.77:0/4086446699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82b80cc170 con 0x7f82b815b8b0 2023-11-26T07:17:47.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.031+0000 7f82aeffd640 1 -- 172.21.15.77:0/4086446699 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82b0058110 con 0x7f82b815b8b0 2023-11-26T07:17:47.033 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:17:47.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.033+0000 7f82b759e640 1 -- 172.21.15.77:0/4086446699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f829806ae40 msgr2=0x7f829806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.034+0000 7f82b759e640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f829806ae40 0x7f829806d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f82a80099c0 tx=0x7f82a8008040 comp rx=0 tx=0).stop 2023-11-26T07:17:47.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.034+0000 7f82b759e640 1 -- 172.21.15.77:0/4086446699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b815b8b0 msgr2=0x7f82b815bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.034+0000 7f82b759e640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b815b8b0 0x7f82b815bd30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f82b8070310 tx=0x7f82b000b4a0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.034+0000 7f82b759e640 1 -- 172.21.15.77:0/4086446699 shutdown_connections 2023-11-26T07:17:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.034+0000 7f82b759e640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f829806ae40 0x7f829806d300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.034+0000 7f82b759e640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b815b8b0 0x7f82b815bd30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.034+0000 7f82b759e640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82b8151140 0x7f82b815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.034+0000 7f82b759e640 1 --2- 172.21.15.77:0/4086446699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82a40047c0 0x7f82b81f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.034+0000 7f82b759e640 1 -- 172.21.15.77:0/4086446699 >> 172.21.15.77:0/4086446699 conn(0x7f82b80cbb40 msgr2=0x7f82b815caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.034+0000 7f82b759e640 1 -- 172.21.15.77:0/4086446699 shutdown_connections 2023-11-26T07:17:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.034+0000 7f82b759e640 1 -- 172.21.15.77:0/4086446699 wait complete. 2023-11-26T07:17:47.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:17:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.267+0000 7fd47b89b640 1 Processor -- start 2023-11-26T07:17:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.268+0000 7fd47b89b640 1 -- start start 2023-11-26T07:17:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.269+0000 7fd47b89b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd47415d720 0x7fd4740d3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.269+0000 7fd47b89b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd4740d3870 0x7fd4740b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.269+0000 7fd47b89b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47415db00 con 0x7fd4740b1400 2023-11-26T07:17:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.269+0000 7fd47b89b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4740d3d20 con 0x7fd47415d720 2023-11-26T07:17:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.269+0000 7fd47b89b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4740d0ce0 con 0x7fd4740d3870 2023-11-26T07:17:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.270+0000 7fd479637640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd47415d720 0x7fd4740d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.270+0000 7fd479637640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd47415d720 0x7fd4740d3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40640/0 (socket says 172.21.15.77:40640) 2023-11-26T07:17:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.270+0000 7fd479637640 1 -- 172.21.15.77:0/3252938526 learned_addr learned my addr 172.21.15.77:0/3252938526 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.270+0000 7fd478e36640 1 --2- 172.21.15.77:0/3252938526 >> v2:172.21.15.159:3300/0 conn(0x7fd4740d3870 0x7fd4740b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.270+0000 7fd479637640 1 -- 172.21.15.77:0/3252938526 >> v2:172.21.15.159:3300/0 conn(0x7fd4740d3870 msgr2=0x7fd4740b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:47.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.270+0000 7fd479637640 1 --2- 172.21.15.77:0/3252938526 >> v2:172.21.15.159:3300/0 conn(0x7fd4740d3870 0x7fd4740b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.270+0000 7fd479637640 1 -- 172.21.15.77:0/3252938526 >> v1:172.21.15.77:6789/0 conn(0x7fd4740b1400 legacy=0x7fd4740b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.270+0000 7fd479637640 1 -- 172.21.15.77:0/3252938526 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47406d400 con 0x7fd47415d720 2023-11-26T07:17:47.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.270+0000 7fd478e36640 1 --2- 172.21.15.77:0/3252938526 >> v2:172.21.15.159:3300/0 conn(0x7fd4740d3870 0x7fd4740b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.271+0000 7fd479637640 1 --2- 172.21.15.77:0/3252938526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47415d720 0x7fd4740d3330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd47408d370 tx=0x7fd46402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a9f15a41a32ac4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.271+0000 7fd473fff640 1 -- 172.21.15.77:0/3252938526 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46402ca80 con 0x7fd47415d720 2023-11-26T07:17:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.272+0000 7fd473fff640 1 -- 172.21.15.77:0/3252938526 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46402cbe0 con 0x7fd47415d720 2023-11-26T07:17:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.272+0000 7fd473fff640 1 -- 172.21.15.77:0/3252938526 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4640343f0 con 0x7fd47415d720 2023-11-26T07:17:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.272+0000 7fd47b89b640 1 -- 172.21.15.77:0/3252938526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47415d720 msgr2=0x7fd4740d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.272+0000 7fd47b89b640 1 --2- 172.21.15.77:0/3252938526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47415d720 0x7fd4740d3330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd47408d370 tx=0x7fd46402bee0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.272+0000 7fd47b89b640 1 -- 172.21.15.77:0/3252938526 shutdown_connections 2023-11-26T07:17:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.272+0000 7fd47b89b640 1 --2- 172.21.15.77:0/3252938526 >> v2:172.21.15.159:3300/0 conn(0x7fd4740d3870 0x7fd4740b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.272+0000 7fd47b89b640 1 --2- 172.21.15.77:0/3252938526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47415d720 0x7fd4740d3330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.272+0000 7fd47b89b640 1 -- 172.21.15.77:0/3252938526 >> 172.21.15.77:0/3252938526 conn(0x7fd47408af60 msgr2=0x7fd47409c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.272+0000 7fd47b89b640 1 -- 172.21.15.77:0/3252938526 shutdown_connections 2023-11-26T07:17:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.272+0000 7fd47b89b640 1 -- 172.21.15.77:0/3252938526 wait complete. 2023-11-26T07:17:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.274+0000 7fd47b89b640 1 Processor -- start 2023-11-26T07:17:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.274+0000 7fd47b89b640 1 -- start start 2023-11-26T07:17:47.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.275+0000 7fd47b89b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740b1400 0x7fd474157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.275+0000 7fd47b89b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4740d3870 0x7fd4740cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.275+0000 7fd47b89b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47415d720 0x7fd4741f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.275+0000 7fd47b89b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740ca4f0 con 0x7fd4740b1400 2023-11-26T07:17:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.275+0000 7fd47b89b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4741f65a0 con 0x7fd4740d3870 2023-11-26T07:17:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.275+0000 7fd47b89b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740ca740 con 0x7fd47415d720 2023-11-26T07:17:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.275+0000 7fd479637640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740b1400 0x7fd474157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.275+0000 7fd479637640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740b1400 0x7fd474157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40646/0 (socket says 172.21.15.77:40646) 2023-11-26T07:17:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.275+0000 7fd479637640 1 -- 172.21.15.77:0/1657922607 learned_addr learned my addr 172.21.15.77:0/1657922607 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.276+0000 7fd479637640 1 -- 172.21.15.77:0/1657922607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47415d720 msgr2=0x7fd4741f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.276+0000 7fd479637640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47415d720 0x7fd4741f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.276+0000 7fd479637640 1 -- 172.21.15.77:0/1657922607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4740d3870 msgr2=0x7fd4740cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.276+0000 7fd479637640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4740d3870 0x7fd4740cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.276+0000 7fd479637640 1 -- 172.21.15.77:0/1657922607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd464009b30 con 0x7fd4740b1400 2023-11-26T07:17:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.276+0000 7fd479637640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740b1400 0x7fd474157dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd464036040 tx=0x7fd464004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.276+0000 7fd471ffb640 1 -- 172.21.15.77:0/1657922607 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46403e450 con 0x7fd4740b1400 2023-11-26T07:17:47.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.276+0000 7fd471ffb640 1 -- 172.21.15.77:0/1657922607 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46403e5f0 con 0x7fd4740b1400 2023-11-26T07:17:47.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.276+0000 7fd471ffb640 1 -- 172.21.15.77:0/1657922607 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46403e9a0 con 0x7fd4740b1400 2023-11-26T07:17:47.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.276+0000 7fd47b89b640 1 -- 172.21.15.77:0/1657922607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4740caa20 con 0x7fd4740b1400 2023-11-26T07:17:47.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.277+0000 7fd47b89b640 1 -- 172.21.15.77:0/1657922607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4741f6ad0 con 0x7fd4740b1400 2023-11-26T07:17:47.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.278+0000 7fd47b89b640 1 -- 172.21.15.77:0/1657922607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4741f6c60 con 0x7fd4740b1400 2023-11-26T07:17:47.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.279+0000 7fd471ffb640 1 -- 172.21.15.77:0/1657922607 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd46402cd50 con 0x7fd4740b1400 2023-11-26T07:17:47.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.280+0000 7fd471ffb640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd46006ae40 0x7fd46006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.280+0000 7fd471ffb640 1 -- 172.21.15.77:0/1657922607 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4640ac280 con 0x7fd4740b1400 2023-11-26T07:17:47.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.280+0000 7fd478e36640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd46006ae40 0x7fd46006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.281+0000 7fd478e36640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd46006ae40 0x7fd46006d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd468006fd0 tx=0x7fd468008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.285+0000 7fd471ffb640 1 -- 172.21.15.77:0/1657922607 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd464077440 con 0x7fd4740b1400 2023-11-26T07:17:47.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.477+0000 7fd47b89b640 1 -- 172.21.15.77:0/1657922607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd47404e8b0 con 0x7fd4740b1400 2023-11-26T07:17:47.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.478+0000 7fd471ffb640 1 -- 172.21.15.77:0/1657922607 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd46407aa60 con 0x7fd4740b1400 2023-11-26T07:17:47.480 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:17:47.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.480+0000 7fd47b89b640 1 -- 172.21.15.77:0/1657922607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd46006ae40 msgr2=0x7fd46006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.480+0000 7fd47b89b640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd46006ae40 0x7fd46006d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd468006fd0 tx=0x7fd468008040 comp rx=0 tx=0).stop 2023-11-26T07:17:47.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.480+0000 7fd47b89b640 1 -- 172.21.15.77:0/1657922607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740b1400 msgr2=0x7fd474157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.480+0000 7fd47b89b640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740b1400 0x7fd474157dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd464036040 tx=0x7fd464004a40 comp rx=0 tx=0).stop 2023-11-26T07:17:47.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.481+0000 7fd47b89b640 1 -- 172.21.15.77:0/1657922607 shutdown_connections 2023-11-26T07:17:47.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.481+0000 7fd47b89b640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd46006ae40 0x7fd46006d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.481+0000 7fd47b89b640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47415d720 0x7fd4741f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.481+0000 7fd47b89b640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4740d3870 0x7fd4740cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.481+0000 7fd47b89b640 1 --2- 172.21.15.77:0/1657922607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740b1400 0x7fd474157dd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.481+0000 7fd47b89b640 1 -- 172.21.15.77:0/1657922607 >> 172.21.15.77:0/1657922607 conn(0x7fd47408af60 msgr2=0x7fd4740b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:47.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.481+0000 7fd47b89b640 1 -- 172.21.15.77:0/1657922607 shutdown_connections 2023-11-26T07:17:47.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.481+0000 7fd47b89b640 1 -- 172.21.15.77:0/1657922607 wait complete. 2023-11-26T07:17:47.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:17:47.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.720+0000 7fc0f6743640 1 Processor -- start 2023-11-26T07:17:47.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.720+0000 7fc0f6743640 1 -- start start 2023-11-26T07:17:47.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.722+0000 7fc0f6743640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f01660b0 0x7fc0f0162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.722+0000 7fc0f6743640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f0166510 con 0x7fc0f0162540 2023-11-26T07:17:47.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.722+0000 7fc0f6743640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f01655f0 con 0x7fc0f00ccbd0 2023-11-26T07:17:47.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.722+0000 7fc0f6743640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00cc380 con 0x7fc0f01660b0 2023-11-26T07:17:47.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.722+0000 7fc0f4ce0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc0f0162540 0x7fc0f00c9650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40650/0 (socket says 172.21.15.77:40650) 2023-11-26T07:17:47.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.722+0000 7fc0f4ce0640 1 -- 172.21.15.77:0/3076817328 learned_addr learned my addr 172.21.15.77:0/3076817328 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:47.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.722+0000 7fc0ef7fe640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f01660b0 0x7fc0f0162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843383239 0 0) 0x7fc0e8001490 con 0x7fc0f0162540 2023-11-26T07:17:47.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0d8003520 con 0x7fc0f0162540 2023-11-26T07:17:47.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3413092150 0 0) 0x7fc0d8003520 con 0x7fc0f0162540 2023-11-26T07:17:47.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f01660b0 msgr2=0x7fc0f0162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:47.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f01660b0 0x7fc0f0162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 >> v1:172.21.15.159:6789/0 conn(0x7fc0f00ccbd0 legacy=0x7fc0f00ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f0162b30 con 0x7fc0f0162540 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fc0e8001b80 con 0x7fc0f0162540 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 >> v1:172.21.15.77:6789/0 conn(0x7fc0f0162540 legacy=0x7fc0f00c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f01660b0 0x7fc0d80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d8003f40 0x7fc0d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0d8004d00 0x7fc0d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00cc380 con 0x7fc0d8003f40 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d800ba90 con 0x7fc0d8004d00 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d800bc50 con 0x7fc0f01660b0 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.723+0000 7fc0ef7fe640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d8003f40 0x7fc0d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.724+0000 7fc0effff640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f01660b0 0x7fc0d80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.724+0000 7fc0ef7fe640 1 -- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f01660b0 msgr2=0x7fc0d80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.724+0000 7fc0ef7fe640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f01660b0 0x7fc0d80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.724+0000 7fc0ef7fe640 1 -- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0d8004d00 msgr2=0x7fc0d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.724+0000 7fc0f4ce0640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0d8004d00 0x7fc0d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.724+0000 7fc0ef7fe640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0d8004d00 0x7fc0d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.724+0000 7fc0ef7fe640 1 -- 172.21.15.77:0/3076817328 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8003520 con 0x7fc0d8003f40 2023-11-26T07:17:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.724+0000 7fc0f4ce0640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0d8004d00 0x7fc0d8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.725+0000 7fc0ef7fe640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d8003f40 0x7fc0d80047c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009a90 tx=0x7fc0d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a26baa460f30fc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.725+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e402c680 con 0x7fc0d8003f40 2023-11-26T07:17:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.725+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e402c7e0 con 0x7fc0d8003f40 2023-11-26T07:17:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.725+0000 7fc0eeffd640 1 -- 172.21.15.77:0/3076817328 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e402cb70 con 0x7fc0d8003f40 2023-11-26T07:17:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.726+0000 7fc0f6743640 1 -- 172.21.15.77:0/3076817328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d8003f40 msgr2=0x7fc0d80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.726+0000 7fc0f6743640 1 --2- 172.21.15.77:0/3076817328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d8003f40 0x7fc0d80047c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009a90 tx=0x7fc0d80057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.726+0000 7fc0f4ce0640 1 -- 172.21.15.77:0/3076817328 reap_dead start 2023-11-26T07:17:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.726+0000 7fc0f6743640 1 -- 172.21.15.77:0/3076817328 shutdown_connections 2023-11-26T07:17:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.726+0000 7fc0f6743640 1 -- 172.21.15.77:0/3076817328 >> 172.21.15.77:0/3076817328 conn(0x7fc0f00b0c50 msgr2=0x7fc0f00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.726+0000 7fc0f6743640 1 -- 172.21.15.77:0/3076817328 shutdown_connections 2023-11-26T07:17:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.726+0000 7fc0f6743640 1 -- 172.21.15.77:0/3076817328 wait complete. 2023-11-26T07:17:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.728+0000 7fc0f6743640 1 Processor -- start 2023-11-26T07:17:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.728+0000 7fc0f6743640 1 -- start start 2023-11-26T07:17:47.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.729+0000 7fc0f6743640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0d8003f40 0x7fc0f01584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.729+0000 7fc0f6743640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f00ad480 0x7fc0f015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.729+0000 7fc0f6743640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f015bb70 0x7fc0f01591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.729+0000 7fc0f6743640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00ac9e0 con 0x7fc0f00ad480 2023-11-26T07:17:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.729+0000 7fc0f6743640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f0164680 con 0x7fc0d8003f40 2023-11-26T07:17:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.729+0000 7fc0f6743640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00acc80 con 0x7fc0f015bb70 2023-11-26T07:17:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.729+0000 7fc0ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f00ad480 0x7fc0f015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.729+0000 7fc0ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f00ad480 0x7fc0f015b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40670/0 (socket says 172.21.15.77:40670) 2023-11-26T07:17:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.729+0000 7fc0ef7fe640 1 -- 172.21.15.77:0/2463255411 learned_addr learned my addr 172.21.15.77:0/2463255411 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0effff640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0d8003f40 0x7fc0f01584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0f4ce0640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f015bb70 0x7fc0f01591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0ef7fe640 1 -- 172.21.15.77:0/2463255411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f015bb70 msgr2=0x7fc0f01591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0ef7fe640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f015bb70 0x7fc0f01591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0ef7fe640 1 -- 172.21.15.77:0/2463255411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0d8003f40 msgr2=0x7fc0f01584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0ef7fe640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0d8003f40 0x7fc0f01584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0ef7fe640 1 -- 172.21.15.77:0/2463255411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f00acf60 con 0x7fc0f00ad480 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0f4ce0640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f015bb70 0x7fc0f01591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0effff640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0d8003f40 0x7fc0f01584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0ef7fe640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f00ad480 0x7fc0f015b630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc0e40099e0 tx=0x7fc0e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0ecff9640 1 -- 172.21.15.77:0/2463255411 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4003810 con 0x7fc0f00ad480 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0ecff9640 1 -- 172.21.15.77:0/2463255411 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e4003970 con 0x7fc0f00ad480 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0ecff9640 1 -- 172.21.15.77:0/2463255411 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4003d20 con 0x7fc0f00ad480 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0f6743640 1 -- 172.21.15.77:0/2463255411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f0164960 con 0x7fc0f00ad480 2023-11-26T07:17:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.730+0000 7fc0f6743640 1 -- 172.21.15.77:0/2463255411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f00adae0 con 0x7fc0f00ad480 2023-11-26T07:17:47.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.732+0000 7fc0f6743640 1 -- 172.21.15.77:0/2463255411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f00c94a0 con 0x7fc0f00ad480 2023-11-26T07:17:47.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.732+0000 7fc0ecff9640 1 -- 172.21.15.77:0/2463255411 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0e4034440 con 0x7fc0f00ad480 2023-11-26T07:17:47.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.734+0000 7fc0ecff9640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc0dc06ae40 0x7fc0dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.734+0000 7fc0ecff9640 1 -- 172.21.15.77:0/2463255411 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0e40ab5f0 con 0x7fc0f00ad480 2023-11-26T07:17:47.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.734+0000 7fc0effff640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc0dc06ae40 0x7fc0dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.735+0000 7fc0effff640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc0dc06ae40 0x7fc0dc06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00016b0 tx=0x7fc0e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.738+0000 7fc0ecff9640 1 -- 172.21.15.77:0/2463255411 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc0e40766b0 con 0x7fc0f00ad480 2023-11-26T07:17:47.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.928+0000 7fc0f6743640 1 -- 172.21.15.77:0/2463255411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0f004e8b0 con 0x7fc0f00ad480 2023-11-26T07:17:47.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.929+0000 7fc0ecff9640 1 -- 172.21.15.77:0/2463255411 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc0e40044e0 con 0x7fc0f00ad480 2023-11-26T07:17:47.930 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:17:47.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.931+0000 7fc0f6743640 1 -- 172.21.15.77:0/2463255411 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc0dc06ae40 msgr2=0x7fc0dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.931+0000 7fc0f6743640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc0dc06ae40 0x7fc0dc06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00016b0 tx=0x7fc0e0009040 comp rx=0 tx=0).stop 2023-11-26T07:17:47.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.931+0000 7fc0f6743640 1 -- 172.21.15.77:0/2463255411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f00ad480 msgr2=0x7fc0f015b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.931+0000 7fc0f6743640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f00ad480 0x7fc0f015b630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc0e40099e0 tx=0x7fc0e4004730 comp rx=0 tx=0).stop 2023-11-26T07:17:47.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.931+0000 7fc0f6743640 1 -- 172.21.15.77:0/2463255411 shutdown_connections 2023-11-26T07:17:47.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.931+0000 7fc0f6743640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc0dc06ae40 0x7fc0dc06d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.931+0000 7fc0f6743640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0f015bb70 0x7fc0f01591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.931+0000 7fc0f6743640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f00ad480 0x7fc0f015b630 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.931+0000 7fc0f6743640 1 --2- 172.21.15.77:0/2463255411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0d8003f40 0x7fc0f01584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.931+0000 7fc0f6743640 1 -- 172.21.15.77:0/2463255411 >> 172.21.15.77:0/2463255411 conn(0x7fc0f00b0c50 msgr2=0x7fc0f00c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:47.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.931+0000 7fc0f6743640 1 -- 172.21.15.77:0/2463255411 shutdown_connections 2023-11-26T07:17:47.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:47.932+0000 7fc0f6743640 1 -- 172.21.15.77:0/2463255411 wait complete. 2023-11-26T07:17:47.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:17:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.159+0000 7f84fb59e640 1 Processor -- start 2023-11-26T07:17:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.160+0000 7f84fb59e640 1 -- start start 2023-11-26T07:17:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.161+0000 7f84fb59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f84fc144b30 0x7f84fc15f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.161+0000 7f84fb59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 0x7f84fc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.161+0000 7f84fb59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc15bf80 con 0x7f84fc15c410 2023-11-26T07:17:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.161+0000 7f84fb59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc0b27b0 con 0x7f84fc144b30 2023-11-26T07:17:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.161+0000 7f84fb59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc0b1560 con 0x7f84fc0b1de0 2023-11-26T07:17:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.162+0000 7f84fad9d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 0x7f84fc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.162+0000 7f84fad9d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 0x7f84fc0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:38016/0 (socket says 172.21.15.77:38016) 2023-11-26T07:17:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.162+0000 7f84fad9d640 1 -- 172.21.15.77:0/549552226 learned_addr learned my addr 172.21.15.77:0/549552226 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.162+0000 7f84fa59c640 1 --2- 172.21.15.77:0/549552226 >> v2:172.21.15.159:3300/0 conn(0x7f84fc144b30 0x7f84fc15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.163+0000 7f84fad9d640 1 -- 172.21.15.77:0/549552226 >> v2:172.21.15.159:3300/0 conn(0x7f84fc144b30 msgr2=0x7f84fc15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.163+0000 7f84fad9d640 1 --2- 172.21.15.77:0/549552226 >> v2:172.21.15.159:3300/0 conn(0x7f84fc144b30 0x7f84fc15f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.163+0000 7f84fad9d640 1 -- 172.21.15.77:0/549552226 >> v1:172.21.15.159:6789/0 conn(0x7f84fc15c410 legacy=0x7f84fc0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.163+0000 7f84fad9d640 1 -- 172.21.15.77:0/549552226 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0b1280 con 0x7f84fc0b1de0 2023-11-26T07:17:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.164+0000 7f84fad9d640 1 --2- 172.21.15.77:0/549552226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 0x7f84fc0b2270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009e50 tx=0x7f84f402bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31b36502aa8c3080 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.164+0000 7f84f9d9b640 1 -- 172.21.15.77:0/549552226 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f402caf0 con 0x7f84fc0b1de0 2023-11-26T07:17:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.164+0000 7f84f9d9b640 1 -- 172.21.15.77:0/549552226 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f402cc50 con 0x7f84fc0b1de0 2023-11-26T07:17:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.164+0000 7f84f9d9b640 1 -- 172.21.15.77:0/549552226 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40343f0 con 0x7f84fc0b1de0 2023-11-26T07:17:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.165+0000 7f84fb59e640 1 -- 172.21.15.77:0/549552226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 msgr2=0x7f84fc0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.165+0000 7f84fb59e640 1 --2- 172.21.15.77:0/549552226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 0x7f84fc0b2270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009e50 tx=0x7f84f402bf50 comp rx=0 tx=0).stop 2023-11-26T07:17:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.165+0000 7f84fb59e640 1 -- 172.21.15.77:0/549552226 shutdown_connections 2023-11-26T07:17:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.165+0000 7f84fb59e640 1 --2- 172.21.15.77:0/549552226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 0x7f84fc0b2270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.165+0000 7f84fb59e640 1 --2- 172.21.15.77:0/549552226 >> v2:172.21.15.159:3300/0 conn(0x7f84fc144b30 0x7f84fc15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.165+0000 7f84fb59e640 1 -- 172.21.15.77:0/549552226 >> 172.21.15.77:0/549552226 conn(0x7f84fc0cb830 msgr2=0x7f84fc0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.165+0000 7f84fb59e640 1 -- 172.21.15.77:0/549552226 shutdown_connections 2023-11-26T07:17:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.165+0000 7f84fb59e640 1 -- 172.21.15.77:0/549552226 wait complete. 2023-11-26T07:17:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.167+0000 7f84fb59e640 1 Processor -- start 2023-11-26T07:17:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.167+0000 7f84fb59e640 1 -- start start 2023-11-26T07:17:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.168+0000 7f84fb59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 0x7f84fc0a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.168+0000 7f84fb59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84fc144b30 0x7f84fc0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.168+0000 7f84fb59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84fc15c410 0x7f84fc071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.168+0000 7f84fb59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc0c9c50 con 0x7f84fc144b30 2023-11-26T07:17:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.168+0000 7f84fb59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc0c90b0 con 0x7f84fc15c410 2023-11-26T07:17:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.168+0000 7f84fb59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc0a9320 con 0x7f84fc0b1de0 2023-11-26T07:17:48.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.168+0000 7f84f3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84fc144b30 0x7f84fc0c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.168+0000 7f84f3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84fc144b30 0x7f84fc0c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40680/0 (socket says 172.21.15.77:40680) 2023-11-26T07:17:48.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84f3fff640 1 -- 172.21.15.77:0/501812156 learned_addr learned my addr 172.21.15.77:0/501812156 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84fa59c640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 0x7f84fc0a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84fad9d640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84fc15c410 0x7f84fc071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84f3fff640 1 -- 172.21.15.77:0/501812156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 msgr2=0x7f84fc0a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84f3fff640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 0x7f84fc0a8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84f3fff640 1 -- 172.21.15.77:0/501812156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84fc15c410 msgr2=0x7f84fc071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84f3fff640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84fc15c410 0x7f84fc071590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84f3fff640 1 -- 172.21.15.77:0/501812156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f4009b30 con 0x7f84fc144b30 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84fad9d640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84fc15c410 0x7f84fc071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84f3fff640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84fc144b30 0x7f84fc0c8b70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c430 tx=0x7f84e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84f2ffd640 1 -- 172.21.15.77:0/501812156 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40052d0 con 0x7f84fc144b30 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.169+0000 7f84f2ffd640 1 -- 172.21.15.77:0/501812156 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e4005430 con 0x7f84fc144b30 2023-11-26T07:17:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.170+0000 7f84fb59e640 1 -- 172.21.15.77:0/501812156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc0c9320 con 0x7f84fc144b30 2023-11-26T07:17:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.170+0000 7f84f2ffd640 1 -- 172.21.15.77:0/501812156 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e4003830 con 0x7f84fc144b30 2023-11-26T07:17:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.170+0000 7f84fb59e640 1 -- 172.21.15.77:0/501812156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc0c98e0 con 0x7f84fc144b30 2023-11-26T07:17:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.171+0000 7f84fb59e640 1 -- 172.21.15.77:0/501812156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc04e840 con 0x7f84fc144b30 2023-11-26T07:17:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.172+0000 7f84f2ffd640 1 -- 172.21.15.77:0/501812156 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f84e4003990 con 0x7f84fc144b30 2023-11-26T07:17:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.173+0000 7f84f2ffd640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84dc06ae40 0x7f84dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.173+0000 7f84f2ffd640 1 -- 172.21.15.77:0/501812156 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84e4088c10 con 0x7f84fc144b30 2023-11-26T07:17:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.173+0000 7f84fa59c640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84dc06ae40 0x7f84dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.174+0000 7f84fa59c640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84dc06ae40 0x7f84dc06d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009ad0 tx=0x7f84ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.177+0000 7f84f2ffd640 1 -- 172.21.15.77:0/501812156 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f84e4053c20 con 0x7f84fc144b30 2023-11-26T07:17:48.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.404+0000 7f84fb59e640 1 -- 172.21.15.77:0/501812156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84fc06d860 con 0x7f84fc144b30 2023-11-26T07:17:48.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.405+0000 7f84f2ffd640 1 -- 172.21.15.77:0/501812156 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f84e4017090 con 0x7f84fc144b30 2023-11-26T07:17:48.408 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:48.408 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2517793456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2517793456},{"type":"v1","addr":"172.21.15.77:6835","nonce":2517793456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/169772143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":169772143},{"type":"v1","addr":"172.21.15.77:6837","nonce":169772143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3797973649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3797973649},{"type":"v1","addr":"172.21.15.159:6834","nonce":3797973649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:17:34.699805+0000","modified":"2023-11-26T07:17:37.771915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/2168278307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2168278307},{"type":"v1","addr":"172.21.15.159:6835","nonce":2168278307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:17:48.408 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-11-26T07:17:48.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.408+0000 7f84fb59e640 1 -- 172.21.15.77:0/501812156 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84dc06ae40 msgr2=0x7f84dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.408+0000 7f84fb59e640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84dc06ae40 0x7f84dc06d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009ad0 tx=0x7f84ec008040 comp rx=0 tx=0).stop 2023-11-26T07:17:48.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.408+0000 7f84fb59e640 1 -- 172.21.15.77:0/501812156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84fc144b30 msgr2=0x7f84fc0c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.408+0000 7f84fb59e640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84fc144b30 0x7f84fc0c8b70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c430 tx=0x7f84e400c8f0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.408+0000 7f84fb59e640 1 -- 172.21.15.77:0/501812156 shutdown_connections 2023-11-26T07:17:48.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.408+0000 7f84fb59e640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84dc06ae40 0x7f84dc06d300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.408+0000 7f84fb59e640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84fc15c410 0x7f84fc071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.408+0000 7f84fb59e640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84fc144b30 0x7f84fc0c8b70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.408+0000 7f84fb59e640 1 --2- 172.21.15.77:0/501812156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84fc0b1de0 0x7f84fc0a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.408+0000 7f84fb59e640 1 -- 172.21.15.77:0/501812156 >> 172.21.15.77:0/501812156 conn(0x7f84fc0cb830 msgr2=0x7f84fc15d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.408+0000 7f84fb59e640 1 -- 172.21.15.77:0/501812156 shutdown_connections 2023-11-26T07:17:48.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.409+0000 7f84fb59e640 1 -- 172.21.15.77:0/501812156 wait complete. 2023-11-26T07:17:48.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:48.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.639+0000 7f01c1133640 1 Processor -- start 2023-11-26T07:17:48.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.639+0000 7f01c1133640 1 -- start start 2023-11-26T07:17:48.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.641+0000 7f01c1133640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f01bc0cf450 0x7f01bc0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.641+0000 7f01c1133640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 0x7f01bc0ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.641+0000 7f01c1133640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01bc0cece0 con 0x7f01bc15c7f0 2023-11-26T07:17:48.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.641+0000 7f01c1133640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01bc0cfe40 con 0x7f01bc0cf450 2023-11-26T07:17:48.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.641+0000 7f01c1133640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc156010 con 0x7f01bc0cdfb0 2023-11-26T07:17:48.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.642+0000 7f01bb59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 0x7f01bc0ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.642+0000 7f01bb59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 0x7f01bc0ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:38026/0 (socket says 172.21.15.77:38026) 2023-11-26T07:17:48.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.642+0000 7f01bb59e640 1 -- 172.21.15.77:0/629568041 learned_addr learned my addr 172.21.15.77:0/629568041 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:48.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.642+0000 7f01ba59c640 1 --2- 172.21.15.77:0/629568041 >> v2:172.21.15.159:3300/0 conn(0x7f01bc0cf450 0x7f01bc0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.642+0000 7f01bb59e640 1 -- 172.21.15.77:0/629568041 >> v2:172.21.15.159:3300/0 conn(0x7f01bc0cf450 msgr2=0x7f01bc0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:48.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.642+0000 7f01bb59e640 1 --2- 172.21.15.77:0/629568041 >> v2:172.21.15.159:3300/0 conn(0x7f01bc0cf450 0x7f01bc0cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.642+0000 7f01bb59e640 1 -- 172.21.15.77:0/629568041 >> v1:172.21.15.159:6789/0 conn(0x7f01bc15c7f0 legacy=0x7f01bc06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.642+0000 7f01bb59e640 1 -- 172.21.15.77:0/629568041 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc06d040 con 0x7f01bc0cdfb0 2023-11-26T07:17:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.644+0000 7f01bb59e640 1 --2- 172.21.15.77:0/629568041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 0x7f01bc0ce420 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009e50 tx=0x7f01b402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=608754e82792ee52 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.644+0000 7f01b9d9b640 1 -- 172.21.15.77:0/629568041 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b402cb00 con 0x7f01bc0cdfb0 2023-11-26T07:17:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.644+0000 7f01b9d9b640 1 -- 172.21.15.77:0/629568041 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b402cc60 con 0x7f01bc0cdfb0 2023-11-26T07:17:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.644+0000 7f01b9d9b640 1 -- 172.21.15.77:0/629568041 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b40343f0 con 0x7f01bc0cdfb0 2023-11-26T07:17:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.645+0000 7f01c1133640 1 -- 172.21.15.77:0/629568041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 msgr2=0x7f01bc0ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.645+0000 7f01c1133640 1 --2- 172.21.15.77:0/629568041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 0x7f01bc0ce420 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009e50 tx=0x7f01b402bf60 comp rx=0 tx=0).stop 2023-11-26T07:17:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.645+0000 7f01c1133640 1 -- 172.21.15.77:0/629568041 shutdown_connections 2023-11-26T07:17:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.645+0000 7f01c1133640 1 --2- 172.21.15.77:0/629568041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 0x7f01bc0ce420 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.645+0000 7f01c1133640 1 --2- 172.21.15.77:0/629568041 >> v2:172.21.15.159:3300/0 conn(0x7f01bc0cf450 0x7f01bc0cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.645+0000 7f01c1133640 1 -- 172.21.15.77:0/629568041 >> 172.21.15.77:0/629568041 conn(0x7f01bc06a920 msgr2=0x7f01bc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.645+0000 7f01c1133640 1 -- 172.21.15.77:0/629568041 shutdown_connections 2023-11-26T07:17:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.645+0000 7f01c1133640 1 -- 172.21.15.77:0/629568041 wait complete. 2023-11-26T07:17:48.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.647+0000 7f01c1133640 1 Processor -- start 2023-11-26T07:17:48.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.648+0000 7f01c1133640 1 -- start start 2023-11-26T07:17:48.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.649+0000 7f01c1133640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 0x7f01bc1f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.649+0000 7f01c1133640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01bc0cf450 0x7f01bc150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.649+0000 7f01c1133640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01bc15c7f0 0x7f01bc152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.649+0000 7f01c1133640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc144cd0 con 0x7f01bc0cf450 2023-11-26T07:17:48.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.649+0000 7f01c1133640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc15e3a0 con 0x7f01bc15c7f0 2023-11-26T07:17:48.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.649+0000 7f01c1133640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc15e680 con 0x7f01bc0cdfb0 2023-11-26T07:17:48.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.649+0000 7f01ba59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01bc0cf450 0x7f01bc150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.649+0000 7f01ba59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01bc0cf450 0x7f01bc150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40688/0 (socket says 172.21.15.77:40688) 2023-11-26T07:17:48.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.649+0000 7f01ba59c640 1 -- 172.21.15.77:0/4192511385 learned_addr learned my addr 172.21.15.77:0/4192511385 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:48.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01bb59e640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01bc15c7f0 0x7f01bc152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01bad9d640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 0x7f01bc1f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01ba59c640 1 -- 172.21.15.77:0/4192511385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 msgr2=0x7f01bc1f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01ba59c640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 0x7f01bc1f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01ba59c640 1 -- 172.21.15.77:0/4192511385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01bc15c7f0 msgr2=0x7f01bc152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01ba59c640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01bc15c7f0 0x7f01bc152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01ba59c640 1 -- 172.21.15.77:0/4192511385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4009b30 con 0x7f01bc0cf450 2023-11-26T07:17:48.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01ba59c640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01bc0cf450 0x7f01bc150d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f01b000e9b0 tx=0x7f01b000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01a37fe640 1 -- 172.21.15.77:0/4192511385 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0009670 con 0x7f01bc0cf450 2023-11-26T07:17:48.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01a37fe640 1 -- 172.21.15.77:0/4192511385 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b000c9a0 con 0x7f01bc0cf450 2023-11-26T07:17:48.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01a37fe640 1 -- 172.21.15.77:0/4192511385 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b000cd50 con 0x7f01bc0cf450 2023-11-26T07:17:48.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.650+0000 7f01c1133640 1 -- 172.21.15.77:0/4192511385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01bc15e960 con 0x7f01bc0cf450 2023-11-26T07:17:48.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.651+0000 7f01c1133640 1 -- 172.21.15.77:0/4192511385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc1f46c0 con 0x7f01bc0cf450 2023-11-26T07:17:48.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.652+0000 7f01c1133640 1 -- 172.21.15.77:0/4192511385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01bc067470 con 0x7f01bc0cf450 2023-11-26T07:17:48.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.653+0000 7f01a37fe640 1 -- 172.21.15.77:0/4192511385 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01b0013470 con 0x7f01bc0cf450 2023-11-26T07:17:48.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.653+0000 7f01a37fe640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f01a806ae40 0x7f01a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.654+0000 7f01a37fe640 1 -- 172.21.15.77:0/4192511385 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01b0089860 con 0x7f01bc0cf450 2023-11-26T07:17:48.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.654+0000 7f01bad9d640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f01a806ae40 0x7f01a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.654+0000 7f01bad9d640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f01a806ae40 0x7f01a806d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f01ac000f60 tx=0x7f01ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.658+0000 7f01a37fe640 1 -- 172.21.15.77:0/4192511385 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f01b0054910 con 0x7f01bc0cf450 2023-11-26T07:17:48.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.850+0000 7f01c1133640 1 -- 172.21.15.77:0/4192511385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01bc0cd730 con 0x7f01bc0cf450 2023-11-26T07:17:48.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.853+0000 7f01a37fe640 1 -- 172.21.15.77:0/4192511385 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f01b0017090 con 0x7f01bc0cf450 2023-11-26T07:17:48.856 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:48.856 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:36.274387+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:48.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.855+0000 7f01c1133640 1 -- 172.21.15.77:0/4192511385 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f01a806ae40 msgr2=0x7f01a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.855+0000 7f01c1133640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f01a806ae40 0x7f01a806d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f01ac000f60 tx=0x7f01ac009040 comp rx=0 tx=0).stop 2023-11-26T07:17:48.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.855+0000 7f01c1133640 1 -- 172.21.15.77:0/4192511385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01bc0cf450 msgr2=0x7f01bc150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.855+0000 7f01c1133640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01bc0cf450 0x7f01bc150d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f01b000e9b0 tx=0x7f01b000ee70 comp rx=0 tx=0).stop 2023-11-26T07:17:48.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.855+0000 7f01c1133640 1 -- 172.21.15.77:0/4192511385 shutdown_connections 2023-11-26T07:17:48.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.855+0000 7f01c1133640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f01a806ae40 0x7f01a806d300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.855+0000 7f01c1133640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01bc15c7f0 0x7f01bc152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.855+0000 7f01c1133640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01bc0cf450 0x7f01bc150d50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.855+0000 7f01c1133640 1 --2- 172.21.15.77:0/4192511385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01bc0cdfb0 0x7f01bc1f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.855+0000 7f01c1133640 1 -- 172.21.15.77:0/4192511385 >> 172.21.15.77:0/4192511385 conn(0x7f01bc06a920 msgr2=0x7f01bc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.856+0000 7f01c1133640 1 -- 172.21.15.77:0/4192511385 shutdown_connections 2023-11-26T07:17:48.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:48.856+0000 7f01c1133640 1 -- 172.21.15.77:0/4192511385 wait complete. 2023-11-26T07:17:48.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:17:48.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:17:49.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.083+0000 7fd839052640 1 Processor -- start 2023-11-26T07:17:49.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.083+0000 7fd839052640 1 -- start start 2023-11-26T07:17:49.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd839052640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd83415d7d0 0x7fd8340cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd839052640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd8340d1f40 0x7fd8340ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd839052640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340d15e0 con 0x7fd83415d3f0 2023-11-26T07:17:49.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd839052640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340d0280 con 0x7fd8340d1f40 2023-11-26T07:17:49.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd839052640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340b0eb0 con 0x7fd83415d7d0 2023-11-26T07:17:49.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd838851640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd8340d1f40 0x7fd8340ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd838851640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd8340d1f40 0x7fd8340ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40700/0 (socket says 172.21.15.77:40700) 2023-11-26T07:17:49.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd838851640 1 -- 172.21.15.77:0/500688317 learned_addr learned my addr 172.21.15.77:0/500688317 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:49.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd838851640 1 -- 172.21.15.77:0/500688317 >> v2:172.21.15.159:3300/0 conn(0x7fd83415d7d0 msgr2=0x7fd8340cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd838851640 1 --2- 172.21.15.77:0/500688317 >> v2:172.21.15.159:3300/0 conn(0x7fd83415d7d0 0x7fd8340cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd838851640 1 -- 172.21.15.77:0/500688317 >> v1:172.21.15.159:6789/0 conn(0x7fd83415d3f0 legacy=0x7fd8340d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.085+0000 7fd838851640 1 -- 172.21.15.77:0/500688317 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340d1300 con 0x7fd8340d1f40 2023-11-26T07:17:49.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.086+0000 7fd838851640 1 --2- 172.21.15.77:0/500688317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8340d1f40 0x7fd8340ce280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd834067bd0 tx=0x7fd82c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a689d8c12dc622ce server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.087+0000 7fd832ffd640 1 -- 172.21.15.77:0/500688317 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c02ca80 con 0x7fd8340d1f40 2023-11-26T07:17:49.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.087+0000 7fd832ffd640 1 -- 172.21.15.77:0/500688317 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c02cbe0 con 0x7fd8340d1f40 2023-11-26T07:17:49.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.087+0000 7fd832ffd640 1 -- 172.21.15.77:0/500688317 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c0343f0 con 0x7fd8340d1f40 2023-11-26T07:17:49.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.087+0000 7fd839052640 1 -- 172.21.15.77:0/500688317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8340d1f40 msgr2=0x7fd8340ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.087+0000 7fd839052640 1 --2- 172.21.15.77:0/500688317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8340d1f40 0x7fd8340ce280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd834067bd0 tx=0x7fd82c02bee0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.087+0000 7fd839052640 1 -- 172.21.15.77:0/500688317 shutdown_connections 2023-11-26T07:17:49.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.087+0000 7fd839052640 1 --2- 172.21.15.77:0/500688317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8340d1f40 0x7fd8340ce280 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.087+0000 7fd839052640 1 --2- 172.21.15.77:0/500688317 >> v2:172.21.15.159:3300/0 conn(0x7fd83415d7d0 0x7fd8340cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.087+0000 7fd839052640 1 -- 172.21.15.77:0/500688317 >> 172.21.15.77:0/500688317 conn(0x7fd83409c5b0 msgr2=0x7fd8340d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.087+0000 7fd839052640 1 -- 172.21.15.77:0/500688317 shutdown_connections 2023-11-26T07:17:49.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.088+0000 7fd839052640 1 -- 172.21.15.77:0/500688317 wait complete. 2023-11-26T07:17:49.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.089+0000 7fd839052640 1 Processor -- start 2023-11-26T07:17:49.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.089+0000 7fd839052640 1 -- start start 2023-11-26T07:17:49.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.090+0000 7fd839052640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8340d1f40 0x7fd8340b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.090+0000 7fd839052640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd83415d3f0 0x7fd834149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.090+0000 7fd839052640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83415d7d0 0x7fd83415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.090+0000 7fd839052640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd834147120 con 0x7fd83415d7d0 2023-11-26T07:17:49.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.090+0000 7fd839052640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340b36c0 con 0x7fd83415d3f0 2023-11-26T07:17:49.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.090+0000 7fd839052640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd834149a00 con 0x7fd8340d1f40 2023-11-26T07:17:49.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.090+0000 7fd838851640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83415d7d0 0x7fd83415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.090+0000 7fd838851640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83415d7d0 0x7fd83415ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40710/0 (socket says 172.21.15.77:40710) 2023-11-26T07:17:49.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.090+0000 7fd838851640 1 -- 172.21.15.77:0/1090061468 learned_addr learned my addr 172.21.15.77:0/1090061468 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:49.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd8337fe640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd83415d3f0 0x7fd834149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd833fff640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8340d1f40 0x7fd8340b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd838851640 1 -- 172.21.15.77:0/1090061468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8340d1f40 msgr2=0x7fd8340b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd838851640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8340d1f40 0x7fd8340b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd838851640 1 -- 172.21.15.77:0/1090061468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd83415d3f0 msgr2=0x7fd834149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd838851640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd83415d3f0 0x7fd834149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd838851640 1 -- 172.21.15.77:0/1090061468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009b30 con 0x7fd83415d7d0 2023-11-26T07:17:49.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd838851640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83415d7d0 0x7fd83415ac30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd82c036040 tx=0x7fd82c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd830ff9640 1 -- 172.21.15.77:0/1090061468 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c03e450 con 0x7fd83415d7d0 2023-11-26T07:17:49.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd830ff9640 1 -- 172.21.15.77:0/1090061468 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c03e5d0 con 0x7fd83415d7d0 2023-11-26T07:17:49.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd839052640 1 -- 172.21.15.77:0/1090061468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd834149ce0 con 0x7fd83415d7d0 2023-11-26T07:17:49.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd830ff9640 1 -- 172.21.15.77:0/1090061468 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c03e980 con 0x7fd83415d7d0 2023-11-26T07:17:49.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.091+0000 7fd839052640 1 -- 172.21.15.77:0/1090061468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8341473c0 con 0x7fd83415d7d0 2023-11-26T07:17:49.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.093+0000 7fd839052640 1 -- 172.21.15.77:0/1090061468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83404e840 con 0x7fd83415d7d0 2023-11-26T07:17:49.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.093+0000 7fd830ff9640 1 -- 172.21.15.77:0/1090061468 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd82c02cd50 con 0x7fd83415d7d0 2023-11-26T07:17:49.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.094+0000 7fd830ff9640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd82006ae40 0x7fd82006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.094+0000 7fd830ff9640 1 -- 172.21.15.77:0/1090061468 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd82c0ac2e0 con 0x7fd83415d7d0 2023-11-26T07:17:49.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.094+0000 7fd833fff640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd82006ae40 0x7fd82006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.095+0000 7fd833fff640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd82006ae40 0x7fd82006d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd824003d90 tx=0x7fd824009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.098+0000 7fd830ff9640 1 -- 172.21.15.77:0/1090061468 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd82c0772f0 con 0x7fd83415d7d0 2023-11-26T07:17:49.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.272+0000 7fd839052640 1 -- 172.21.15.77:0/1090061468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8340d06f0 con 0x7fd83415d7d0 2023-11-26T07:17:49.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.273+0000 7fd830ff9640 1 -- 172.21.15.77:0/1090061468 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8340d06f0 con 0x7fd83415d7d0 2023-11-26T07:17:49.276 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:17:49.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.275+0000 7fd839052640 1 -- 172.21.15.77:0/1090061468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd82006ae40 msgr2=0x7fd82006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.275+0000 7fd839052640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd82006ae40 0x7fd82006d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd824003d90 tx=0x7fd824009040 comp rx=0 tx=0).stop 2023-11-26T07:17:49.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.275+0000 7fd839052640 1 -- 172.21.15.77:0/1090061468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83415d7d0 msgr2=0x7fd83415ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.276+0000 7fd839052640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83415d7d0 0x7fd83415ac30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd82c036040 tx=0x7fd82c004a40 comp rx=0 tx=0).stop 2023-11-26T07:17:49.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.276+0000 7fd839052640 1 -- 172.21.15.77:0/1090061468 shutdown_connections 2023-11-26T07:17:49.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.276+0000 7fd839052640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd82006ae40 0x7fd82006d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.276+0000 7fd839052640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83415d7d0 0x7fd83415ac30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.276+0000 7fd839052640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd83415d3f0 0x7fd834149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.276+0000 7fd839052640 1 --2- 172.21.15.77:0/1090061468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8340d1f40 0x7fd8340b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.276+0000 7fd839052640 1 -- 172.21.15.77:0/1090061468 >> 172.21.15.77:0/1090061468 conn(0x7fd83409c5b0 msgr2=0x7fd8340d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.276+0000 7fd839052640 1 -- 172.21.15.77:0/1090061468 shutdown_connections 2023-11-26T07:17:49.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.276+0000 7fd839052640 1 -- 172.21.15.77:0/1090061468 wait complete. 2023-11-26T07:17:49.296 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:17:49.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.500+0000 7fb8b8c02640 1 Processor -- start 2023-11-26T07:17:49.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.500+0000 7fb8b8c02640 1 -- start start 2023-11-26T07:17:49.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.501+0000 7fb8b8c02640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b415b440 0x7fb8b40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.501+0000 7fb8b8c02640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8b40cbf20 0x7fb8b40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.501+0000 7fb8b8c02640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb8b40c57e0 0x7fb8b40c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.501+0000 7fb8b8c02640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b415b820 con 0x7fb8b40cbf20 2023-11-26T07:17:49.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.501+0000 7fb8b8c02640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b40cc3a0 con 0x7fb8b40c57e0 2023-11-26T07:17:49.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.501+0000 7fb8b8c02640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b415eea0 con 0x7fb8b415b440 2023-11-26T07:17:49.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.502+0000 7fb8abfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8b40cbf20 0x7fb8b40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.502+0000 7fb8abfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8b40cbf20 0x7fb8b40c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40724/0 (socket says 172.21.15.77:40724) 2023-11-26T07:17:49.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.502+0000 7fb8abfff640 1 -- 172.21.15.77:0/1402332516 learned_addr learned my addr 172.21.15.77:0/1402332516 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:49.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.502+0000 7fb8b2d9d640 1 --2- 172.21.15.77:0/1402332516 >> v2:172.21.15.159:3300/0 conn(0x7fb8b40c57e0 0x7fb8b40c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.502+0000 7fb8abfff640 1 -- 172.21.15.77:0/1402332516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b415b440 msgr2=0x7fb8b40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.502+0000 7fb8abfff640 1 --2- 172.21.15.77:0/1402332516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b415b440 0x7fb8b40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.502+0000 7fb8abfff640 1 -- 172.21.15.77:0/1402332516 >> v2:172.21.15.159:3300/0 conn(0x7fb8b40c57e0 msgr2=0x7fb8b40c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.502+0000 7fb8abfff640 1 --2- 172.21.15.77:0/1402332516 >> v2:172.21.15.159:3300/0 conn(0x7fb8b40c57e0 0x7fb8b40c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.502+0000 7fb8abfff640 1 -- 172.21.15.77:0/1402332516 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40abf30 con 0x7fb8b40cbf20 2023-11-26T07:17:49.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.502+0000 7fb8b2d9d640 1 --2- 172.21.15.77:0/1402332516 >> v2:172.21.15.159:3300/0 conn(0x7fb8b40c57e0 0x7fb8b40c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:49.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.503+0000 7fb8abfff640 1 --2- 172.21.15.77:0/1402332516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b40cbf20 0x7fb8b40c52a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40cb910 tx=0x7fb89c02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08ec9db7a941c2f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b1d9b640 1 -- 172.21.15.77:0/1402332516 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0317d0 con 0x7fb8b40cbf20 2023-11-26T07:17:49.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b1d9b640 1 -- 172.21.15.77:0/1402332516 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c031930 con 0x7fb8b40cbf20 2023-11-26T07:17:49.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b1d9b640 1 -- 172.21.15.77:0/1402332516 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c031cc0 con 0x7fb8b40cbf20 2023-11-26T07:17:49.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b8c02640 1 -- 172.21.15.77:0/1402332516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b40cbf20 msgr2=0x7fb8b40c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b8c02640 1 --2- 172.21.15.77:0/1402332516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b40cbf20 0x7fb8b40c52a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40cb910 tx=0x7fb89c02b870 comp rx=0 tx=0).stop 2023-11-26T07:17:49.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b8c02640 1 -- 172.21.15.77:0/1402332516 shutdown_connections 2023-11-26T07:17:49.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b8c02640 1 --2- 172.21.15.77:0/1402332516 >> v2:172.21.15.159:3300/0 conn(0x7fb8b40c57e0 0x7fb8b40c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b8c02640 1 --2- 172.21.15.77:0/1402332516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b40cbf20 0x7fb8b40c52a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b8c02640 1 --2- 172.21.15.77:0/1402332516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b415b440 0x7fb8b40cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b8c02640 1 -- 172.21.15.77:0/1402332516 >> 172.21.15.77:0/1402332516 conn(0x7fb8b40b0c50 msgr2=0x7fb8b40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b8c02640 1 -- 172.21.15.77:0/1402332516 shutdown_connections 2023-11-26T07:17:49.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.504+0000 7fb8b8c02640 1 -- 172.21.15.77:0/1402332516 wait complete. 2023-11-26T07:17:49.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.506+0000 7fb8b8c02640 1 Processor -- start 2023-11-26T07:17:49.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.506+0000 7fb8b8c02640 1 -- start start 2023-11-26T07:17:49.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.507+0000 7fb8b8c02640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40c57e0 0x7fb8b414fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.507+0000 7fb8b8c02640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b40cbf20 0x7fb8b4153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.507+0000 7fb8b8c02640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b415b440 0x7fb8b4157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.507+0000 7fb8b8c02640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b41f6530 con 0x7fb8b415b440 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.507+0000 7fb8b8c02640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40cd0d0 con 0x7fb8b40cbf20 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.507+0000 7fb8b8c02640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40cd3b0 con 0x7fb8b40c57e0 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.507+0000 7fb8b2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b415b440 0x7fb8b4157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.507+0000 7fb8b2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b415b440 0x7fb8b4157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40726/0 (socket says 172.21.15.77:40726) 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.507+0000 7fb8b2d9d640 1 -- 172.21.15.77:0/3862732490 learned_addr learned my addr 172.21.15.77:0/3862732490 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8abfff640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b40cbf20 0x7fb8b4153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8b259c640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40c57e0 0x7fb8b414fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8b2d9d640 1 -- 172.21.15.77:0/3862732490 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40c57e0 msgr2=0x7fb8b414fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8b2d9d640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40c57e0 0x7fb8b414fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8b2d9d640 1 -- 172.21.15.77:0/3862732490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b40cbf20 msgr2=0x7fb8b4153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8b2d9d640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b40cbf20 0x7fb8b4153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8b2d9d640 1 -- 172.21.15.77:0/3862732490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c0094d0 con 0x7fb8b415b440 2023-11-26T07:17:49.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8abfff640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b40cbf20 0x7fb8b4153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:49.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8b2d9d640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b415b440 0x7fb8b4157020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00cef0 tx=0x7fb8ac00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8aaffd640 1 -- 172.21.15.77:0/3862732490 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00d840 con 0x7fb8b415b440 2023-11-26T07:17:49.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8aaffd640 1 -- 172.21.15.77:0/3862732490 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac00d9c0 con 0x7fb8b415b440 2023-11-26T07:17:49.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8aaffd640 1 -- 172.21.15.77:0/3862732490 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00dd70 con 0x7fb8b415b440 2023-11-26T07:17:49.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.508+0000 7fb8b8c02640 1 -- 172.21.15.77:0/3862732490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b40cd690 con 0x7fb8b415b440 2023-11-26T07:17:49.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.509+0000 7fb8b8c02640 1 -- 172.21.15.77:0/3862732490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b4150530 con 0x7fb8b415b440 2023-11-26T07:17:49.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.510+0000 7fb8b8c02640 1 -- 172.21.15.77:0/3862732490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b41f66a0 con 0x7fb8b415b440 2023-11-26T07:17:49.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.511+0000 7fb8aaffd640 1 -- 172.21.15.77:0/3862732490 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8ac01e3b0 con 0x7fb8b415b440 2023-11-26T07:17:49.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.512+0000 7fb8aaffd640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb89406ae40 0x7fb89406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.512+0000 7fb8aaffd640 1 -- 172.21.15.77:0/3862732490 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8ac08a190 con 0x7fb8b415b440 2023-11-26T07:17:49.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.512+0000 7fb8b259c640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb89406ae40 0x7fb89406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.513+0000 7fb8b259c640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb89406ae40 0x7fb89406d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400a770 tx=0x7fb8a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.517+0000 7fb8aaffd640 1 -- 172.21.15.77:0/3862732490 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8ac055260 con 0x7fb8b415b440 2023-11-26T07:17:49.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.708+0000 7fb8b8c02640 1 -- 172.21.15.77:0/3862732490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8b404e8b0 con 0x7fb8b415b440 2023-11-26T07:17:49.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.709+0000 7fb8aaffd640 1 -- 172.21.15.77:0/3862732490 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8ac058880 con 0x7fb8b415b440 2023-11-26T07:17:49.711 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:17:49.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.711+0000 7fb8b8c02640 1 -- 172.21.15.77:0/3862732490 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb89406ae40 msgr2=0x7fb89406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.711+0000 7fb8b8c02640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb89406ae40 0x7fb89406d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400a770 tx=0x7fb8a4008040 comp rx=0 tx=0).stop 2023-11-26T07:17:49.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.712+0000 7fb8b8c02640 1 -- 172.21.15.77:0/3862732490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b415b440 msgr2=0x7fb8b4157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.712+0000 7fb8b8c02640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b415b440 0x7fb8b4157020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00cef0 tx=0x7fb8ac00a710 comp rx=0 tx=0).stop 2023-11-26T07:17:49.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.712+0000 7fb8b8c02640 1 -- 172.21.15.77:0/3862732490 shutdown_connections 2023-11-26T07:17:49.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.712+0000 7fb8b8c02640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb89406ae40 0x7fb89406d300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.712+0000 7fb8b8c02640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8b415b440 0x7fb8b4157020 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.712+0000 7fb8b8c02640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8b40cbf20 0x7fb8b4153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.712+0000 7fb8b8c02640 1 --2- 172.21.15.77:0/3862732490 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8b40c57e0 0x7fb8b414fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.712+0000 7fb8b8c02640 1 -- 172.21.15.77:0/3862732490 >> 172.21.15.77:0/3862732490 conn(0x7fb8b40b0c50 msgr2=0x7fb8b4158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.712+0000 7fb8b8c02640 1 -- 172.21.15.77:0/3862732490 shutdown_connections 2023-11-26T07:17:49.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.712+0000 7fb8b8c02640 1 -- 172.21.15.77:0/3862732490 wait complete. 2023-11-26T07:17:49.732 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:17:49.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.946+0000 7fb8f6fa9640 1 Processor -- start 2023-11-26T07:17:49.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.946+0000 7fb8f6fa9640 1 -- start start 2023-11-26T07:17:49.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.948+0000 7fb8f6fa9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8f006e160 0x7fb8f00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.948+0000 7fb8f6fa9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8f00cd110 0x7fb8f0070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.948+0000 7fb8f6fa9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f00cd510 con 0x7fb8f0146eb0 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.948+0000 7fb8f6fa9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f0161a10 con 0x7fb8f00cd110 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.948+0000 7fb8f6fa9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0161cf0 con 0x7fb8f006e160 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.948+0000 7fb8f4d45640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb8f0146eb0 0x7fb8f0161150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40660/0 (socket says 172.21.15.77:40660) 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.948+0000 7fb8f4d45640 1 -- 172.21.15.77:0/2484479108 learned_addr learned my addr 172.21.15.77:0/2484479108 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.948+0000 7fb8f5546640 1 --2- 172.21.15.77:0/2484479108 >> v2:172.21.15.77:3300/0 conn(0x7fb8f00cd110 0x7fb8f0070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.949+0000 7fb8effff640 1 --2- 172.21.15.77:0/2484479108 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8f006e160 0x7fb8f00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.949+0000 7fb8ef7fe640 1 -- 172.21.15.77:0/2484479108 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694142646 0 0) 0x7fb8f00cd510 con 0x7fb8f0146eb0 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.949+0000 7fb8ef7fe640 1 -- 172.21.15.77:0/2484479108 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e0003520 con 0x7fb8f0146eb0 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.949+0000 7fb8f5546640 1 -- 172.21.15.77:0/2484479108 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8f006e160 msgr2=0x7fb8f00ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.949+0000 7fb8f5546640 1 --2- 172.21.15.77:0/2484479108 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8f006e160 0x7fb8f00ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.949+0000 7fb8f5546640 1 -- 172.21.15.77:0/2484479108 >> v1:172.21.15.77:6789/0 conn(0x7fb8f0146eb0 legacy=0x7fb8f0161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.949+0000 7fb8f5546640 1 -- 172.21.15.77:0/2484479108 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f0161fd0 con 0x7fb8f00cd110 2023-11-26T07:17:49.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.949+0000 7fb8effff640 1 --2- 172.21.15.77:0/2484479108 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8f006e160 0x7fb8f00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:49.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.950+0000 7fb8f5546640 1 --2- 172.21.15.77:0/2484479108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8f00cd110 0x7fb8f0070e40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009d90 tx=0x7fb8e802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4f59f507fbc4f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.950+0000 7fb8ef7fe640 1 -- 172.21.15.77:0/2484479108 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e802cc60 con 0x7fb8f00cd110 2023-11-26T07:17:49.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.950+0000 7fb8ef7fe640 1 -- 172.21.15.77:0/2484479108 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e802cdc0 con 0x7fb8f00cd110 2023-11-26T07:17:49.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.950+0000 7fb8ef7fe640 1 -- 172.21.15.77:0/2484479108 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8034660 con 0x7fb8f00cd110 2023-11-26T07:17:49.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.951+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/2484479108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8f00cd110 msgr2=0x7fb8f0070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.951+0000 7fb8f6fa9640 1 --2- 172.21.15.77:0/2484479108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8f00cd110 0x7fb8f0070e40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009d90 tx=0x7fb8e802beb0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.951+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/2484479108 shutdown_connections 2023-11-26T07:17:49.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.951+0000 7fb8f6fa9640 1 --2- 172.21.15.77:0/2484479108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8f00cd110 0x7fb8f0070e40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.951+0000 7fb8f6fa9640 1 --2- 172.21.15.77:0/2484479108 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8f006e160 0x7fb8f00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.951+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/2484479108 >> 172.21.15.77:0/2484479108 conn(0x7fb8f00b0c50 msgr2=0x7fb8f00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.951+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/2484479108 shutdown_connections 2023-11-26T07:17:49.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.951+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/2484479108 wait complete. 2023-11-26T07:17:49.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.953+0000 7fb8f6fa9640 1 Processor -- start 2023-11-26T07:17:49.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.953+0000 7fb8f6fa9640 1 -- start start 2023-11-26T07:17:49.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f6fa9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8f006e160 0x7fb8f00b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f6fa9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8f00cd110 0x7fb8f01e8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f6fa9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f0146eb0 0x7fb8f00acf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f6fa9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0142ba0 con 0x7fb8f006e160 2023-11-26T07:17:49.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f6fa9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0142e80 con 0x7fb8f0146eb0 2023-11-26T07:17:49.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f6fa9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f01e7e70 con 0x7fb8f00cd110 2023-11-26T07:17:49.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f4d45640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8f006e160 0x7fb8f00b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f4d45640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8f006e160 0x7fb8f00b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40740/0 (socket says 172.21.15.77:40740) 2023-11-26T07:17:49.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f4d45640 1 -- 172.21.15.77:0/3676225586 learned_addr learned my addr 172.21.15.77:0/3676225586 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f4d45640 1 -- 172.21.15.77:0/3676225586 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8f00cd110 msgr2=0x7fb8f01e8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f4d45640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8f00cd110 0x7fb8f01e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f4d45640 1 -- 172.21.15.77:0/3676225586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f0146eb0 msgr2=0x7fb8f00acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f4d45640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f0146eb0 0x7fb8f00acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.954+0000 7fb8f4d45640 1 -- 172.21.15.77:0/3676225586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8009a70 con 0x7fb8f006e160 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.955+0000 7fb8f4d45640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8f006e160 0x7fb8f00b4040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c410 tx=0x7fb8e400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.955+0000 7fb8ed7fa640 1 -- 172.21.15.77:0/3676225586 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4005ce0 con 0x7fb8f006e160 2023-11-26T07:17:49.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.955+0000 7fb8ed7fa640 1 -- 172.21.15.77:0/3676225586 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e4005e40 con 0x7fb8f006e160 2023-11-26T07:17:49.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.955+0000 7fb8ed7fa640 1 -- 172.21.15.77:0/3676225586 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40072f0 con 0x7fb8f006e160 2023-11-26T07:17:49.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.955+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/3676225586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f01e8150 con 0x7fb8f006e160 2023-11-26T07:17:49.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.955+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/3676225586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f00b4580 con 0x7fb8f006e160 2023-11-26T07:17:49.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.956+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/3676225586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f01e7cd0 con 0x7fb8f006e160 2023-11-26T07:17:49.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.957+0000 7fb8ed7fa640 1 -- 172.21.15.77:0/3676225586 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8e4007510 con 0x7fb8f006e160 2023-11-26T07:17:49.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.958+0000 7fb8ed7fa640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8d406ae40 0x7fb8d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.958+0000 7fb8ed7fa640 1 -- 172.21.15.77:0/3676225586 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8e4088d80 con 0x7fb8f006e160 2023-11-26T07:17:49.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.958+0000 7fb8effff640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8d406ae40 0x7fb8d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.959+0000 7fb8effff640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8d406ae40 0x7fb8d406d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc006fd0 tx=0x7fb8dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:49.962+0000 7fb8ed7fa640 1 -- 172.21.15.77:0/3676225586 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8f01e7cd0 con 0x7fb8f006e160 2023-11-26T07:17:50.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.151+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/3676225586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8f01e7cd0 con 0x7fb8f006e160 2023-11-26T07:17:50.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.152+0000 7fb8ed7fa640 1 -- 172.21.15.77:0/3676225586 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8f01e7cd0 con 0x7fb8f006e160 2023-11-26T07:17:50.155 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:17:50.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/3676225586 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8d406ae40 msgr2=0x7fb8d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8d406ae40 0x7fb8d406d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc006fd0 tx=0x7fb8dc008040 comp rx=0 tx=0).stop 2023-11-26T07:17:50.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/3676225586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8f006e160 msgr2=0x7fb8f00b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8f006e160 0x7fb8f00b4040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c410 tx=0x7fb8e400c8d0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/3676225586 shutdown_connections 2023-11-26T07:17:50.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8d406ae40 0x7fb8d406d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f0146eb0 0x7fb8f00acf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8f00cd110 0x7fb8f01e8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 --2- 172.21.15.77:0/3676225586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8f006e160 0x7fb8f00b4040 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/3676225586 >> 172.21.15.77:0/3676225586 conn(0x7fb8f00b0c50 msgr2=0x7fb8f0144df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/3676225586 shutdown_connections 2023-11-26T07:17:50.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.155+0000 7fb8f6fa9640 1 -- 172.21.15.77:0/3676225586 wait complete. 2023-11-26T07:17:50.176 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:17:50.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.388+0000 7f36c5dce640 1 Processor -- start 2023-11-26T07:17:50.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.388+0000 7f36c5dce640 1 -- start start 2023-11-26T07:17:50.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.389+0000 7f36c5dce640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 0x7f36c0161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.389+0000 7f36c5dce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36c00cf450 0x7f36c00cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36c5dce640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f36c015dc80 0x7f36c015e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36c5dce640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c00cfe10 con 0x7f36c00cf450 2023-11-26T07:17:50.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36c5dce640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c00ce0b0 con 0x7f36c015dc80 2023-11-26T07:17:50.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36c5dce640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c0161960 con 0x7f36c0157c70 2023-11-26T07:17:50.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36b7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36c00cf450 0x7f36c00cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36b7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36c00cf450 0x7f36c00cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40754/0 (socket says 172.21.15.77:40754) 2023-11-26T07:17:50.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36b7fff640 1 -- 172.21.15.77:0/3029475156 learned_addr learned my addr 172.21.15.77:0/3029475156 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:50.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36bf7fe640 1 --2- 172.21.15.77:0/3029475156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 0x7f36c0161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36bffff640 1 --2- 172.21.15.77:0/3029475156 >> v2:172.21.15.159:3300/0 conn(0x7f36c015dc80 0x7f36c015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36b7fff640 1 -- 172.21.15.77:0/3029475156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 msgr2=0x7f36c0161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36b7fff640 1 --2- 172.21.15.77:0/3029475156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 0x7f36c0161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36b7fff640 1 -- 172.21.15.77:0/3029475156 >> v2:172.21.15.159:3300/0 conn(0x7f36c015dc80 msgr2=0x7f36c015e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36b7fff640 1 --2- 172.21.15.77:0/3029475156 >> v2:172.21.15.159:3300/0 conn(0x7f36c015dc80 0x7f36c015e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36b7fff640 1 -- 172.21.15.77:0/3029475156 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c015e650 con 0x7f36c00cf450 2023-11-26T07:17:50.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.390+0000 7f36bf7fe640 1 --2- 172.21.15.77:0/3029475156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 0x7f36c0161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:50.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.391+0000 7f36b7fff640 1 --2- 172.21.15.77:0/3029475156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c00cf450 0x7f36c00cf8d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f36c00cefc0 tx=0x7f36a802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cf09e84dee3d62 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.392+0000 7f36beffd640 1 -- 172.21.15.77:0/3029475156 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a80317e0 con 0x7f36c00cf450 2023-11-26T07:17:50.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.392+0000 7f36beffd640 1 -- 172.21.15.77:0/3029475156 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a8031940 con 0x7f36c00cf450 2023-11-26T07:17:50.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.392+0000 7f36beffd640 1 -- 172.21.15.77:0/3029475156 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8031cd0 con 0x7f36c00cf450 2023-11-26T07:17:50.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.392+0000 7f36c5dce640 1 -- 172.21.15.77:0/3029475156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c00cf450 msgr2=0x7f36c00cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.392+0000 7f36c5dce640 1 --2- 172.21.15.77:0/3029475156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c00cf450 0x7f36c00cf8d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f36c00cefc0 tx=0x7f36a802b880 comp rx=0 tx=0).stop 2023-11-26T07:17:50.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.392+0000 7f36c5dce640 1 -- 172.21.15.77:0/3029475156 shutdown_connections 2023-11-26T07:17:50.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.392+0000 7f36c5dce640 1 --2- 172.21.15.77:0/3029475156 >> v2:172.21.15.159:3300/0 conn(0x7f36c015dc80 0x7f36c015e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.392+0000 7f36c5dce640 1 --2- 172.21.15.77:0/3029475156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c00cf450 0x7f36c00cf8d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.392+0000 7f36c5dce640 1 --2- 172.21.15.77:0/3029475156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 0x7f36c0161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.392+0000 7f36c5dce640 1 -- 172.21.15.77:0/3029475156 >> 172.21.15.77:0/3029475156 conn(0x7f36c006a920 msgr2=0x7f36c006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.393+0000 7f36c5dce640 1 -- 172.21.15.77:0/3029475156 shutdown_connections 2023-11-26T07:17:50.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.393+0000 7f36c5dce640 1 -- 172.21.15.77:0/3029475156 wait complete. 2023-11-26T07:17:50.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.394+0000 7f36c5dce640 1 Processor -- start 2023-11-26T07:17:50.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.394+0000 7f36c5dce640 1 -- start start 2023-11-26T07:17:50.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.395+0000 7f36c5dce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36c00cf450 0x7f36c01445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.395+0000 7f36c5dce640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 0x7f36c015efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.395+0000 7f36c5dce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015dc80 0x7f36c015f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.395+0000 7f36c5dce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c01f6790 con 0x7f36c015dc80 2023-11-26T07:17:50.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.395+0000 7f36c5dce640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c01f69e0 con 0x7f36c00cf450 2023-11-26T07:17:50.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.395+0000 7f36c5dce640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c01f6cc0 con 0x7f36c0157c70 2023-11-26T07:17:50.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015dc80 0x7f36c015f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015dc80 0x7f36c015f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40768/0 (socket says 172.21.15.77:40768) 2023-11-26T07:17:50.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36bffff640 1 -- 172.21.15.77:0/3812159992 learned_addr learned my addr 172.21.15.77:0/3812159992 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:50.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36bf7fe640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36c00cf450 0x7f36c01445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36b7fff640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 0x7f36c015efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36bffff640 1 -- 172.21.15.77:0/3812159992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 msgr2=0x7f36c015efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36bffff640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 0x7f36c015efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36bffff640 1 -- 172.21.15.77:0/3812159992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36c00cf450 msgr2=0x7f36c01445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36bffff640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36c00cf450 0x7f36c01445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36bffff640 1 -- 172.21.15.77:0/3812159992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80094d0 con 0x7f36c015dc80 2023-11-26T07:17:50.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36b7fff640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 0x7f36c015efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:50.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.396+0000 7f36bffff640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015dc80 0x7f36c015f510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f36b800cd20 tx=0x7f36b800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.397+0000 7f36bcff9640 1 -- 172.21.15.77:0/3812159992 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8003b90 con 0x7f36c015dc80 2023-11-26T07:17:50.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.397+0000 7f36bcff9640 1 -- 172.21.15.77:0/3812159992 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b8003cf0 con 0x7f36c015dc80 2023-11-26T07:17:50.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.397+0000 7f36bcff9640 1 -- 172.21.15.77:0/3812159992 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8004240 con 0x7f36c015dc80 2023-11-26T07:17:50.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.397+0000 7f36c5dce640 1 -- 172.21.15.77:0/3812159992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c01f6fa0 con 0x7f36c015dc80 2023-11-26T07:17:50.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.397+0000 7f36c5dce640 1 -- 172.21.15.77:0/3812159992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c0144af0 con 0x7f36c015dc80 2023-11-26T07:17:50.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.398+0000 7f36c5dce640 1 -- 172.21.15.77:0/3812159992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c00b08c0 con 0x7f36c015dc80 2023-11-26T07:17:50.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.399+0000 7f36bcff9640 1 -- 172.21.15.77:0/3812159992 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36b80043a0 con 0x7f36c015dc80 2023-11-26T07:17:50.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.400+0000 7f36bcff9640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a006ae40 0x7f36a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.400+0000 7f36bcff9640 1 -- 172.21.15.77:0/3812159992 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36b8012070 con 0x7f36c015dc80 2023-11-26T07:17:50.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.400+0000 7f36bf7fe640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a006ae40 0x7f36a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.400+0000 7f36bf7fe640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a006ae40 0x7f36a006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f36c014b610 tx=0x7f36b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.404+0000 7f36bcff9640 1 -- 172.21.15.77:0/3812159992 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36b808d030 con 0x7f36c015dc80 2023-11-26T07:17:50.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.635+0000 7f36c5dce640 1 -- 172.21.15.77:0/3812159992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36c0067470 con 0x7f36c015dc80 2023-11-26T07:17:50.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.636+0000 7f36bcff9640 1 -- 172.21.15.77:0/3812159992 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f36b8054fc0 con 0x7f36c015dc80 2023-11-26T07:17:50.638 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:50.639 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2517793456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2517793456},{"type":"v1","addr":"172.21.15.77:6835","nonce":2517793456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/169772143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":169772143},{"type":"v1","addr":"172.21.15.77:6837","nonce":169772143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3797973649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3797973649},{"type":"v1","addr":"172.21.15.159:6834","nonce":3797973649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:17:34.699805+0000","modified":"2023-11-26T07:17:37.771915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/2168278307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2168278307},{"type":"v1","addr":"172.21.15.159:6835","nonce":2168278307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:17:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-11-26T07:17:50.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.638+0000 7f36c5dce640 1 -- 172.21.15.77:0/3812159992 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a006ae40 msgr2=0x7f36a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.638+0000 7f36c5dce640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a006ae40 0x7f36a006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f36c014b610 tx=0x7f36b0008040 comp rx=0 tx=0).stop 2023-11-26T07:17:50.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.638+0000 7f36c5dce640 1 -- 172.21.15.77:0/3812159992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015dc80 msgr2=0x7f36c015f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.638+0000 7f36c5dce640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015dc80 0x7f36c015f510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f36b800cd20 tx=0x7f36b800a660 comp rx=0 tx=0).stop 2023-11-26T07:17:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.639+0000 7f36c5dce640 1 -- 172.21.15.77:0/3812159992 shutdown_connections 2023-11-26T07:17:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.639+0000 7f36c5dce640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a006ae40 0x7f36a006d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.639+0000 7f36c5dce640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015dc80 0x7f36c015f510 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.639+0000 7f36c5dce640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c0157c70 0x7f36c015efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.639+0000 7f36c5dce640 1 --2- 172.21.15.77:0/3812159992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36c00cf450 0x7f36c01445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.639+0000 7f36c5dce640 1 -- 172.21.15.77:0/3812159992 >> 172.21.15.77:0/3812159992 conn(0x7f36c006a920 msgr2=0x7f36c01602b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.639+0000 7f36c5dce640 1 -- 172.21.15.77:0/3812159992 shutdown_connections 2023-11-26T07:17:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.639+0000 7f36c5dce640 1 -- 172.21.15.77:0/3812159992 wait complete. 2023-11-26T07:17:50.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:50.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.866+0000 7f9120c9b640 1 Processor -- start 2023-11-26T07:17:50.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.866+0000 7f9120c9b640 1 -- start start 2023-11-26T07:17:50.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.867+0000 7f9120c9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f911c15c7f0 0x7f911c06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.867+0000 7f9120c9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f911c0cf450 0x7f911c0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.867+0000 7f9120c9b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c0cece0 con 0x7f911c0cdfb0 2023-11-26T07:17:50.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.867+0000 7f9120c9b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c156010 con 0x7f911c15c7f0 2023-11-26T07:17:50.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.867+0000 7f9120c9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c06ce30 con 0x7f911c0cf450 2023-11-26T07:17:50.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.867+0000 7f911a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f911c15c7f0 0x7f911c06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.868+0000 7f911a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f911c15c7f0 0x7f911c06db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40770/0 (socket says 172.21.15.77:40770) 2023-11-26T07:17:50.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.868+0000 7f911a59c640 1 -- 172.21.15.77:0/1945277616 learned_addr learned my addr 172.21.15.77:0/1945277616 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:50.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.868+0000 7f911a59c640 1 -- 172.21.15.77:0/1945277616 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f911c0cf450 msgr2=0x7f911c0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.868+0000 7f911a59c640 1 --2- 172.21.15.77:0/1945277616 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f911c0cf450 0x7f911c0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.868+0000 7f911a59c640 1 -- 172.21.15.77:0/1945277616 >> v1:172.21.15.159:6789/0 conn(0x7f911c0cdfb0 legacy=0x7f911c0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.868+0000 7f911a59c640 1 -- 172.21.15.77:0/1945277616 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c06d040 con 0x7f911c15c7f0 2023-11-26T07:17:50.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.869+0000 7f911a59c640 1 --2- 172.21.15.77:0/1945277616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911c15c7f0 0x7f911c06db20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f910c009e50 tx=0x7f910c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce028210d551d75 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.869+0000 7f911959a640 1 -- 172.21.15.77:0/1945277616 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c02ca70 con 0x7f911c15c7f0 2023-11-26T07:17:50.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.869+0000 7f911959a640 1 -- 172.21.15.77:0/1945277616 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c02cbd0 con 0x7f911c15c7f0 2023-11-26T07:17:50.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.869+0000 7f911959a640 1 -- 172.21.15.77:0/1945277616 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c0343f0 con 0x7f911c15c7f0 2023-11-26T07:17:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.870+0000 7f9120c9b640 1 -- 172.21.15.77:0/1945277616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911c15c7f0 msgr2=0x7f911c06db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.870+0000 7f9120c9b640 1 --2- 172.21.15.77:0/1945277616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911c15c7f0 0x7f911c06db20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f910c009e50 tx=0x7f910c02bed0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.870+0000 7f9120c9b640 1 -- 172.21.15.77:0/1945277616 shutdown_connections 2023-11-26T07:17:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.870+0000 7f9120c9b640 1 --2- 172.21.15.77:0/1945277616 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f911c0cf450 0x7f911c0cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.870+0000 7f9120c9b640 1 --2- 172.21.15.77:0/1945277616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911c15c7f0 0x7f911c06db20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.870+0000 7f9120c9b640 1 -- 172.21.15.77:0/1945277616 >> 172.21.15.77:0/1945277616 conn(0x7f911c06a920 msgr2=0x7f911c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.870+0000 7f9120c9b640 1 -- 172.21.15.77:0/1945277616 shutdown_connections 2023-11-26T07:17:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.870+0000 7f9120c9b640 1 -- 172.21.15.77:0/1945277616 wait complete. 2023-11-26T07:17:50.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.872+0000 7f9120c9b640 1 Processor -- start 2023-11-26T07:17:50.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.873+0000 7f9120c9b640 1 -- start start 2023-11-26T07:17:50.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9120c9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f911c0cdfb0 0x7f911c154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9120c9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911c0cf450 0x7f911c14eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9120c9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f911c15c7f0 0x7f911c14f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9120c9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c14f920 con 0x7f911c0cf450 2023-11-26T07:17:50.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9120c9b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0b3900 con 0x7f911c15c7f0 2023-11-26T07:17:50.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9120c9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c157570 con 0x7f911c0cdfb0 2023-11-26T07:17:50.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9119d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911c0cf450 0x7f911c14eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9119d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911c0cf450 0x7f911c14eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40782/0 (socket says 172.21.15.77:40782) 2023-11-26T07:17:50.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9119d9b640 1 -- 172.21.15.77:0/2184654933 learned_addr learned my addr 172.21.15.77:0/2184654933 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:50.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f911a59c640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f911c0cdfb0 0x7f911c154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f911ad9d640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f911c15c7f0 0x7f911c14f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9119d9b640 1 -- 172.21.15.77:0/2184654933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f911c0cdfb0 msgr2=0x7f911c154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9119d9b640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f911c0cdfb0 0x7f911c154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9119d9b640 1 -- 172.21.15.77:0/2184654933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f911c15c7f0 msgr2=0x7f911c14f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9119d9b640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f911c15c7f0 0x7f911c14f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.874+0000 7f9119d9b640 1 -- 172.21.15.77:0/2184654933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c009b30 con 0x7f911c0cf450 2023-11-26T07:17:50.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.875+0000 7f9119d9b640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911c0cf450 0x7f911c14eea0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f911000b4a0 tx=0x7f911000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.875+0000 7f910affd640 1 -- 172.21.15.77:0/2184654933 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110010610 con 0x7f911c0cf450 2023-11-26T07:17:50.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.875+0000 7f910affd640 1 -- 172.21.15.77:0/2184654933 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9110010770 con 0x7f911c0cf450 2023-11-26T07:17:50.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.875+0000 7f9120c9b640 1 -- 172.21.15.77:0/2184654933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911c0b2d80 con 0x7f911c0cf450 2023-11-26T07:17:50.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.875+0000 7f910affd640 1 -- 172.21.15.77:0/2184654933 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110010b20 con 0x7f911c0cf450 2023-11-26T07:17:50.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.875+0000 7f9120c9b640 1 -- 172.21.15.77:0/2184654933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c0b3340 con 0x7f911c0cf450 2023-11-26T07:17:50.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.876+0000 7f9120c9b640 1 -- 172.21.15.77:0/2184654933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c157740 con 0x7f911c0cf450 2023-11-26T07:17:50.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.877+0000 7f910affd640 1 -- 172.21.15.77:0/2184654933 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9110010c80 con 0x7f911c0cf450 2023-11-26T07:17:50.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.878+0000 7f910affd640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f90fc06ae90 0x7f90fc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.878+0000 7f910affd640 1 -- 172.21.15.77:0/2184654933 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91100891d0 con 0x7f911c0cf450 2023-11-26T07:17:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.878+0000 7f911a59c640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f90fc06ae90 0x7f90fc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.879+0000 7f911a59c640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f90fc06ae90 0x7f90fc06d350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f910c035000 tx=0x7f910c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:50.883+0000 7f910affd640 1 -- 172.21.15.77:0/2184654933 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9110054260 con 0x7f911c0cf450 2023-11-26T07:17:51.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.076+0000 7f9120c9b640 1 -- 172.21.15.77:0/2184654933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f911c067470 con 0x7f911c0cf450 2023-11-26T07:17:51.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.078+0000 7f910affd640 1 -- 172.21.15.77:0/2184654933 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f9110057880 con 0x7f911c0cf450 2023-11-26T07:17:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:51.081 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:36.274387+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 -- 172.21.15.77:0/2184654933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f90fc06ae90 msgr2=0x7f90fc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f90fc06ae90 0x7f90fc06d350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f910c035000 tx=0x7f910c030000 comp rx=0 tx=0).stop 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 -- 172.21.15.77:0/2184654933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911c0cf450 msgr2=0x7f911c14eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911c0cf450 0x7f911c14eea0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f911000b4a0 tx=0x7f911000b960 comp rx=0 tx=0).stop 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 -- 172.21.15.77:0/2184654933 shutdown_connections 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f90fc06ae90 0x7f90fc06d350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f911c15c7f0 0x7f911c14f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911c0cf450 0x7f911c14eea0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 --2- 172.21.15.77:0/2184654933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f911c0cdfb0 0x7f911c154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 -- 172.21.15.77:0/2184654933 >> 172.21.15.77:0/2184654933 conn(0x7f911c06a920 msgr2=0x7f911c0af230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 -- 172.21.15.77:0/2184654933 shutdown_connections 2023-11-26T07:17:51.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.081+0000 7f9120c9b640 1 -- 172.21.15.77:0/2184654933 wait complete. 2023-11-26T07:17:51.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:17:51.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.316+0000 7f6923400640 1 Processor -- start 2023-11-26T07:17:51.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.316+0000 7f6923400640 1 -- start start 2023-11-26T07:17:51.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.317+0000 7f6923400640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c0cf450 0x7f691c0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.317+0000 7f6923400640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f691c0cdfb0 0x7f691c0ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.317+0000 7f6923400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691c0cece0 con 0x7f691c15c7f0 2023-11-26T07:17:51.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.317+0000 7f6923400640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691c156010 con 0x7f691c0cdfb0 2023-11-26T07:17:51.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.317+0000 7f6923400640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c06ce30 con 0x7f691c0cf450 2023-11-26T07:17:51.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f692119c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f691c15c7f0 0x7f691c06db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40676/0 (socket says 172.21.15.77:40676) 2023-11-26T07:17:51.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f692119c640 1 -- 172.21.15.77:0/483849311 learned_addr learned my addr 172.21.15.77:0/483849311 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:51.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f692099b640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c0cf450 0x7f691c0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f692199d640 1 --2- 172.21.15.77:0/483849311 >> v2:172.21.15.159:3300/0 conn(0x7f691c0cdfb0 0x7f691c0ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14882940 0 0) 0x7f691c0cece0 con 0x7f691c15c7f0 2023-11-26T07:17:51.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6908003520 con 0x7f691c15c7f0 2023-11-26T07:17:51.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4277903339 0 0) 0x7f6908003520 con 0x7f691c15c7f0 2023-11-26T07:17:51.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c0cf450 msgr2=0x7f691c0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:51.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f690ffff640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c0cf450 0x7f691c0cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 >> v2:172.21.15.159:3300/0 conn(0x7f691c0cdfb0 msgr2=0x7f691c0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:51.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f690ffff640 1 --2- 172.21.15.77:0/483849311 >> v2:172.21.15.159:3300/0 conn(0x7f691c0cdfb0 0x7f691c0ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c06d040 con 0x7f691c15c7f0 2023-11-26T07:17:51.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.318+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f6918001670 con 0x7f691c15c7f0 2023-11-26T07:17:51.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 >> v1:172.21.15.77:6789/0 conn(0x7f691c15c7f0 legacy=0x7f691c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f690ffff640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6908003970 0x7f6908003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f690ffff640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69080047c0 0x7f6908004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f690ffff640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c0cf450 0x7f6908005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c156010 con 0x7f69080047c0 2023-11-26T07:17:51.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c06ce30 con 0x7f6908003970 2023-11-26T07:17:51.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690800b980 con 0x7f691c0cf450 2023-11-26T07:17:51.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f692099b640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69080047c0 0x7f6908004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f692119c640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6908003970 0x7f6908003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f692199d640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c0cf450 0x7f6908005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f692099b640 1 -- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c0cf450 msgr2=0x7f6908005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:51.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f692099b640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c0cf450 0x7f6908005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f692099b640 1 -- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6908003970 msgr2=0x7f6908003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:51.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f692099b640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6908003970 0x7f6908003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f692099b640 1 -- 172.21.15.77:0/483849311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908003520 con 0x7f69080047c0 2023-11-26T07:17:51.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.319+0000 7f692119c640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6908003970 0x7f6908003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:51.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.320+0000 7f692099b640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69080047c0 0x7f6908004c40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6910009ac0 tx=0x7f69080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66183c01e9e1dc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:51.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.321+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691002c6b0 con 0x7f69080047c0 2023-11-26T07:17:51.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.321+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691002c810 con 0x7f69080047c0 2023-11-26T07:17:51.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.321+0000 7f690ffff640 1 -- 172.21.15.77:0/483849311 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691002cba0 con 0x7f69080047c0 2023-11-26T07:17:51.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.321+0000 7f6923400640 1 -- 172.21.15.77:0/483849311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69080047c0 msgr2=0x7f6908004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.321+0000 7f6923400640 1 --2- 172.21.15.77:0/483849311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69080047c0 0x7f6908004c40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6910009ac0 tx=0x7f69080057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.321+0000 7f692199d640 1 -- 172.21.15.77:0/483849311 reap_dead start 2023-11-26T07:17:51.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.321+0000 7f6923400640 1 -- 172.21.15.77:0/483849311 shutdown_connections 2023-11-26T07:17:51.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.321+0000 7f6923400640 1 -- 172.21.15.77:0/483849311 >> 172.21.15.77:0/483849311 conn(0x7f691c06a920 msgr2=0x7f691c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:51.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.321+0000 7f6923400640 1 -- 172.21.15.77:0/483849311 shutdown_connections 2023-11-26T07:17:51.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.321+0000 7f6923400640 1 -- 172.21.15.77:0/483849311 wait complete. 2023-11-26T07:17:51.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.323+0000 7f6923400640 1 Processor -- start 2023-11-26T07:17:51.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.323+0000 7f6923400640 1 -- start start 2023-11-26T07:17:51.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.324+0000 7f6923400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080047c0 0x7f691c0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.324+0000 7f6923400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f691c153070 0x7f691c143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.324+0000 7f6923400640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c144440 0x7f691c06d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.324+0000 7f6923400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c144e90 con 0x7f691c153070 2023-11-26T07:17:51.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.324+0000 7f6923400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c1448d0 con 0x7f69080047c0 2023-11-26T07:17:51.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.324+0000 7f6923400640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c144bb0 con 0x7f691c144440 2023-11-26T07:17:51.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.324+0000 7f692099b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f691c153070 0x7f691c143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.324+0000 7f692099b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f691c153070 0x7f691c143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40798/0 (socket says 172.21.15.77:40798) 2023-11-26T07:17:51.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.324+0000 7f692099b640 1 -- 172.21.15.77:0/4195163690 learned_addr learned my addr 172.21.15.77:0/4195163690 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.325+0000 7f692119c640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080047c0 0x7f691c0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.325+0000 7f692099b640 1 -- 172.21.15.77:0/4195163690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c144440 msgr2=0x7f691c06d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.325+0000 7f692099b640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c144440 0x7f691c06d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.325+0000 7f692099b640 1 -- 172.21.15.77:0/4195163690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080047c0 msgr2=0x7f691c0cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.325+0000 7f692099b640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080047c0 0x7f691c0cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.325+0000 7f692099b640 1 -- 172.21.15.77:0/4195163690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c142000 con 0x7f691c153070 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.325+0000 7f692099b640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f691c153070 0x7f691c143f00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f691002c250 tx=0x7f6910004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.325+0000 7f690dffb640 1 -- 172.21.15.77:0/4195163690 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910003810 con 0x7f691c153070 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.325+0000 7f690dffb640 1 -- 172.21.15.77:0/4195163690 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6910003970 con 0x7f691c153070 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.325+0000 7f690dffb640 1 -- 172.21.15.77:0/4195163690 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910003ce0 con 0x7f691c153070 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.325+0000 7f6923400640 1 -- 172.21.15.77:0/4195163690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691c1422e0 con 0x7f691c153070 2023-11-26T07:17:51.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.326+0000 7f6923400640 1 -- 172.21.15.77:0/4195163690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691c06deb0 con 0x7f691c153070 2023-11-26T07:17:51.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.327+0000 7f6923400640 1 -- 172.21.15.77:0/4195163690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691c067470 con 0x7f691c153070 2023-11-26T07:17:51.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.327+0000 7f690dffb640 1 -- 172.21.15.77:0/4195163690 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6910034440 con 0x7f691c153070 2023-11-26T07:17:51.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.328+0000 7f690dffb640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f690006ae40 0x7f690006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.328+0000 7f690dffb640 1 -- 172.21.15.77:0/4195163690 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69100ab530 con 0x7f691c153070 2023-11-26T07:17:51.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.328+0000 7f692119c640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f690006ae40 0x7f690006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.329+0000 7f692119c640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f690006ae40 0x7f690006d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f69180018e0 tx=0x7f6918009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:51.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.333+0000 7f690dffb640 1 -- 172.21.15.77:0/4195163690 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6910076840 con 0x7f691c153070 2023-11-26T07:17:51.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.561+0000 7f6923400640 1 -- 172.21.15.77:0/4195163690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f691c0cd730 con 0x7f691c153070 2023-11-26T07:17:51.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.562+0000 7f690dffb640 1 -- 172.21.15.77:0/4195163690 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f69100044e0 con 0x7f691c153070 2023-11-26T07:17:51.565 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:17:51.565 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2517793456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2517793456},{"type":"v1","addr":"172.21.15.77:6835","nonce":2517793456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/169772143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":169772143},{"type":"v1","addr":"172.21.15.77:6837","nonce":169772143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3797973649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3797973649},{"type":"v1","addr":"172.21.15.159:6834","nonce":3797973649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:17:34.699805+0000","modified":"2023-11-26T07:17:37.771915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/2168278307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2168278307},{"type":"v1","addr":"172.21.15.159:6835","nonce":2168278307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:17:51.566 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-11-26T07:17:51.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 -- 172.21.15.77:0/4195163690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f690006ae40 msgr2=0x7f690006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f690006ae40 0x7f690006d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f69180018e0 tx=0x7f6918009040 comp rx=0 tx=0).stop 2023-11-26T07:17:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 -- 172.21.15.77:0/4195163690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f691c153070 msgr2=0x7f691c143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f691c153070 0x7f691c143f00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f691002c250 tx=0x7f6910004730 comp rx=0 tx=0).stop 2023-11-26T07:17:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 -- 172.21.15.77:0/4195163690 shutdown_connections 2023-11-26T07:17:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f690006ae40 0x7f690006d300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f691c144440 0x7f691c06d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f691c153070 0x7f691c143f00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 --2- 172.21.15.77:0/4195163690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69080047c0 0x7f691c0cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 -- 172.21.15.77:0/4195163690 >> 172.21.15.77:0/4195163690 conn(0x7f691c06a920 msgr2=0x7f691c0721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 -- 172.21.15.77:0/4195163690 shutdown_connections 2023-11-26T07:17:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:51.565+0000 7f6923400640 1 -- 172.21.15.77:0/4195163690 wait complete. 2023-11-26T07:17:51.989 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:17:34.699805+0000', 'modified': '2023-11-26T07:17:37.771915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.159:6835/2168278307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6833', 'nonce': 2168278307}, {'type': 'v1', 'addr': '172.21.15.159:6835', 'nonce': 2168278307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:17:51.989 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:17:51.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-26T07:17:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.209+0000 7f6cecf6f640 1 Processor -- start 2023-11-26T07:17:52.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.209+0000 7f6cecf6f640 1 -- start start 2023-11-26T07:17:52.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.211+0000 7f6cecf6f640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6ce80cc0f0 0x7f6ce80c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.211+0000 7f6cecf6f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce815eea0 con 0x7f6ce815b440 2023-11-26T07:17:52.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.211+0000 7f6cecf6f640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce80abf30 con 0x7f6ce80c57e0 2023-11-26T07:17:52.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.211+0000 7f6cecf6f640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce815b820 con 0x7f6ce80cc0f0 2023-11-26T07:17:52.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.211+0000 7f6ce659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6ce815b440 0x7f6ce80cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40684/0 (socket says 172.21.15.77:40684) 2023-11-26T07:17:52.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.211+0000 7f6ce659c640 1 -- 172.21.15.77:0/2674836600 learned_addr learned my addr 172.21.15.77:0/2674836600 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.211+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557508883 0 0) 0x7f6ce815eea0 con 0x7f6ce815b440 2023-11-26T07:17:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.211+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd0003520 con 0x7f6ce815b440 2023-11-26T07:17:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/2674836600 >> v2:172.21.15.159:3300/0 conn(0x7f6ce80cc0f0 0x7f6ce80c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1742152342 0 0) 0x7f6cd0003520 con 0x7f6ce815b440 2023-11-26T07:17:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 >> v2:172.21.15.159:3300/0 conn(0x7f6ce80cc0f0 msgr2=0x7f6ce80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 --2- 172.21.15.77:0/2674836600 >> v2:172.21.15.159:3300/0 conn(0x7f6ce80cc0f0 0x7f6ce80c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 >> v1:172.21.15.159:6789/0 conn(0x7f6ce80c57e0 legacy=0x7f6ce806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce815f0f0 con 0x7f6ce815b440 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f6cd8001670 con 0x7f6ce815b440 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 >> v1:172.21.15.77:6789/0 conn(0x7f6ce815b440 legacy=0x7f6ce80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cd0003970 0x7f6cd0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cd00047c0 0x7f6cd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cd00051d0 0x7f6cd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce815b820 con 0x7f6cd0003970 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd000c100 con 0x7f6cd00051d0 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd000c2c0 con 0x7f6cd00047c0 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce659c640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cd0003970 0x7f6cd0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.212+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cd00047c0 0x7f6cd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.213+0000 7f6ce659c640 1 -- 172.21.15.77:0/2674836600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cd00047c0 msgr2=0x7f6cd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.213+0000 7f6ce659c640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cd00047c0 0x7f6cd0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.213+0000 7f6ce6d9d640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cd00051d0 0x7f6cd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.213+0000 7f6ce659c640 1 -- 172.21.15.77:0/2674836600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cd00051d0 msgr2=0x7f6cd000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.213+0000 7f6ce659c640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cd00051d0 0x7f6cd000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.213+0000 7f6ce6d9d640 1 -- 172.21.15.77:0/2674836600 reap_dead start 2023-11-26T07:17:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.213+0000 7f6ce659c640 1 -- 172.21.15.77:0/2674836600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0003520 con 0x7f6cd0003970 2023-11-26T07:17:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.213+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cd00047c0 0x7f6cd0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.214+0000 7f6ce659c640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cd0003970 0x7f6cd0003d70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8007fd0 tx=0x7f6cd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f6a9eee844e0d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:52.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.214+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8005ad0 con 0x7f6cd0003970 2023-11-26T07:17:52.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.214+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd8005c30 con 0x7f6cd0003970 2023-11-26T07:17:52.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.214+0000 7f6ce559a640 1 -- 172.21.15.77:0/2674836600 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd802c870 con 0x7f6cd0003970 2023-11-26T07:17:52.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.214+0000 7f6cecf6f640 1 -- 172.21.15.77:0/2674836600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cd0003970 msgr2=0x7f6cd0003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.214+0000 7f6cecf6f640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cd0003970 0x7f6cd0003d70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8007fd0 tx=0x7f6cd00057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.215+0000 7f6cecf6f640 1 -- 172.21.15.77:0/2674836600 shutdown_connections 2023-11-26T07:17:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.215+0000 7f6cecf6f640 1 --2- 172.21.15.77:0/2674836600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cd0003970 0x7f6cd0003d70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.215+0000 7f6cecf6f640 1 -- 172.21.15.77:0/2674836600 >> 172.21.15.77:0/2674836600 conn(0x7f6ce80b0c50 msgr2=0x7f6ce80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.215+0000 7f6cecf6f640 1 -- 172.21.15.77:0/2674836600 shutdown_connections 2023-11-26T07:17:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.215+0000 7f6cecf6f640 1 -- 172.21.15.77:0/2674836600 wait complete. 2023-11-26T07:17:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.216+0000 7f6cecf6f640 1 Processor -- start 2023-11-26T07:17:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.217+0000 7f6cecf6f640 1 -- start start 2023-11-26T07:17:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.217+0000 7f6cecf6f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cd0003970 0x7f6ce80ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.217+0000 7f6cecf6f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce80999d0 0x7f6ce8158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.217+0000 7f6cecf6f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ce8158f70 0x7f6ce809a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.217+0000 7f6cecf6f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce8159a40 con 0x7f6ce8158f70 2023-11-26T07:17:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.217+0000 7f6cecf6f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce8159480 con 0x7f6ce80999d0 2023-11-26T07:17:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.217+0000 7f6cecf6f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce8159760 con 0x7f6cd0003970 2023-11-26T07:17:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ce8158f70 0x7f6ce809a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ce8158f70 0x7f6ce809a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40822/0 (socket says 172.21.15.77:40822) 2023-11-26T07:17:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce6d9d640 1 -- 172.21.15.77:0/1493040690 learned_addr learned my addr 172.21.15.77:0/1493040690 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce80999d0 0x7f6ce8158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce659c640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cd0003970 0x7f6ce80ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce6d9d640 1 -- 172.21.15.77:0/1493040690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cd0003970 msgr2=0x7f6ce80ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce6d9d640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cd0003970 0x7f6ce80ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce6d9d640 1 -- 172.21.15.77:0/1493040690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce80999d0 msgr2=0x7f6ce8158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce6d9d640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce80999d0 0x7f6ce8158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce6d9d640 1 -- 172.21.15.77:0/1493040690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce815cb40 con 0x7f6ce8158f70 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce80999d0 0x7f6ce8158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.218+0000 7f6ce6d9d640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ce8158f70 0x7f6ce809a5e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6ce809d280 tx=0x7f6ce000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.219+0000 7f6cd6ffd640 1 -- 172.21.15.77:0/1493040690 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0003b70 con 0x7f6ce8158f70 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.219+0000 7f6cd6ffd640 1 -- 172.21.15.77:0/1493040690 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0003cd0 con 0x7f6ce8158f70 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.219+0000 7f6cd6ffd640 1 -- 172.21.15.77:0/1493040690 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0005310 con 0x7f6ce8158f70 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.219+0000 7f6cecf6f640 1 -- 172.21.15.77:0/1493040690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce815ce20 con 0x7f6ce8158f70 2023-11-26T07:17:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.219+0000 7f6cecf6f640 1 -- 172.21.15.77:0/1493040690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce80ad950 con 0x7f6ce8158f70 2023-11-26T07:17:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.221+0000 7f6cd6ffd640 1 -- 172.21.15.77:0/1493040690 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ce0005470 con 0x7f6ce8158f70 2023-11-26T07:17:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.222+0000 7f6cd6ffd640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6cc806ae40 0x7f6cc806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.222+0000 7f6cd6ffd640 1 -- 172.21.15.77:0/1493040690 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ce0088c60 con 0x7f6ce8158f70 2023-11-26T07:17:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.222+0000 7f6ce659c640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6cc806ae40 0x7f6cc806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.222+0000 7f6cefbdf740 1 Processor -- start 2023-11-26T07:17:52.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.223+0000 7f6cefbdf740 1 -- start start 2023-11-26T07:17:52.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.223+0000 7f6ce659c640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6cc806ae40 0x7f6cc806d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8034000 tx=0x7f6cd802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:52.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5de60280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5aba0 0x55fc5de5f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc5ddbe880 con 0x55fc5de5f5e0 2023-11-26T07:17:52.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc5ddcdae0 con 0x55fc5de5aba0 2023-11-26T07:17:52.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc5ddcb1d0 con 0x55fc5de5fea0 2023-11-26T07:17:52.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6ce6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6ce6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40826/0 (socket says 172.21.15.77:40826) 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6ce6d9d640 1 -- 172.21.15.77:0/1419308847 learned_addr learned my addr 172.21.15.77:0/1419308847 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6ce659c640 1 --2- 172.21.15.77:0/1419308847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5de60280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/1419308847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5aba0 0x55fc5de5f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6ce6d9d640 1 -- 172.21.15.77:0/1419308847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 msgr2=0x55fc5de60280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6ce6d9d640 1 --2- 172.21.15.77:0/1419308847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5de60280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6ce6d9d640 1 -- 172.21.15.77:0/1419308847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5aba0 msgr2=0x55fc5de5f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6ce6d9d640 1 --2- 172.21.15.77:0/1419308847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5aba0 0x55fc5de5f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.224+0000 7f6ce6d9d640 1 -- 172.21.15.77:0/1419308847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc5dd8e860 con 0x55fc5de5f5e0 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.225+0000 7f6ce6d9d640 1 --2- 172.21.15.77:0/1419308847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea3560 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0087060 tx=0x7f6ce0058030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112705266cea83e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.225+0000 7f6cc7fff640 1 -- 172.21.15.77:0/1419308847 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce005ba80 con 0x55fc5de5f5e0 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.225+0000 7f6cc7fff640 1 -- 172.21.15.77:0/1419308847 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce005fc30 con 0x55fc5de5f5e0 2023-11-26T07:17:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.225+0000 7f6cc7fff640 1 -- 172.21.15.77:0/1419308847 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0005720 con 0x55fc5de5f5e0 2023-11-26T07:17:52.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.225+0000 7f6cefbdf740 1 -- 172.21.15.77:0/1419308847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 msgr2=0x55fc5dea3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.225+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/1419308847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea3560 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0087060 tx=0x7f6ce0058030 comp rx=0 tx=0).stop 2023-11-26T07:17:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.226+0000 7f6cefbdf740 1 -- 172.21.15.77:0/1419308847 shutdown_connections 2023-11-26T07:17:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.226+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/1419308847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea3560 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.226+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/1419308847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5aba0 0x55fc5de5f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.226+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/1419308847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5de60280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.226+0000 7f6cefbdf740 1 -- 172.21.15.77:0/1419308847 >> 172.21.15.77:0/1419308847 conn(0x55fc5de21c70 msgr2=0x55fc5dea5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.226+0000 7f6cefbdf740 1 -- 172.21.15.77:0/1419308847 shutdown_connections 2023-11-26T07:17:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.226+0000 7f6cefbdf740 1 -- 172.21.15.77:0/1419308847 wait complete. 2023-11-26T07:17:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.226+0000 7f6cefbdf740 1 -- start start 2023-11-26T07:17:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.227+0000 7f6cefbdf740 1 Processor -- start 2023-11-26T07:17:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de9d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5f5e0 0x55fc5deab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5deab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc5ddc6ac0 con 0x55fc5de5aba0 2023-11-26T07:17:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc5dd632f0 con 0x55fc5de5f5e0 2023-11-26T07:17:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc5dd80c70 con 0x55fc5de5fea0 2023-11-26T07:17:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6cefbdf740 10 client.0 _ll_register_callbacks cb 0x55fc5dd853b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:17:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6ce659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de9d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6ce659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de9d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40828/0 (socket says 172.21.15.77:40828) 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6ce659c640 1 -- 172.21.15.77:0/2261776186 learned_addr learned my addr 172.21.15.77:0/2261776186 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5f5e0 0x55fc5deab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6ce6d9d640 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5deab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6ce659c640 1 -- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 msgr2=0x55fc5deab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6ce659c640 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5deab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6ce659c640 1 -- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5f5e0 msgr2=0x55fc5deab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6ce659c640 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5f5e0 0x55fc5deab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6ce659c640 1 -- 172.21.15.77:0/2261776186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce80ad950 con 0x55fc5de5aba0 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.228+0000 7f6ce6d9d640 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5deab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.229+0000 7f6ce659c640 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de9d290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6cd802c4e0 tx=0x7f6cd8007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f8d77458310d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.229+0000 7f6cc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-26T07:17:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.229+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2261776186 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8007070 con 0x55fc5de5aba0 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.229+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2261776186 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cd80071d0 con 0x55fc5de5aba0 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.229+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2261776186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc5ddbfaa0 con 0x55fc5de5aba0 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.229+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2261776186 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cd80073d0 con 0x55fc5de5aba0 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.229+0000 7f6cefbdf740 10 client.4662 fetch_fsmap learned FSMap version 7 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.229+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2261776186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55fc5ddc5140 con 0x55fc5de5aba0 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.229+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2261776186 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc5ddbfaa0 con 0x55fc5de5aba0 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.230+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2261776186 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6cd8007530 con 0x55fc5de5aba0 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.230+0000 7f6cefbdf740 10 client.4662 fetch_fsmap finished waiting for FSMap version 7 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.230+0000 7f6cefbdf740 10 client.4662 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.230+0000 7f6cefbdf740 20 client.4662 populate_metadata read hostname 'smithi077' 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.230+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:6833/2168278307,v1:172.21.15.159:6835/2168278307] conn(0x55fc5dec0a20 0x55fc5dec2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.230+0000 7f6cefbdf740 4 client.4662 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.230+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2261776186 --> [v2:172.21.15.159:6833/2168278307,v1:172.21.15.159:6835/2168278307] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc5ddbf7c0 con 0x55fc5dec0a20 2023-11-26T07:17:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.230+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:6833/2168278307,v1:172.21.15.159:6835/2168278307] conn(0x55fc5dec0a20 0x55fc5dec2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.231+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:6833/2168278307,v1:172.21.15.159:6835/2168278307] conn(0x55fc5dec0a20 0x55fc5dec2e10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86c362a96ff99746 server_cookie=d0af7e502060d9ac in_seq=0 out_seq=0 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.231+0000 7f6cc57fa640 10 client.4662 ms_handle_connect on v2:172.21.15.159:6833/2168278307 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.233+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2261776186 <== mds.0 v2:172.21.15.159:6833/2168278307 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fc5ddbf7c0 con 0x55fc5dec0a20 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.233+0000 7f6cc57fa640 10 client.4662 handle_command_reply: tid=0 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.233+0000 7f6cefbdf740 1 client.4662 shutdown 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2261776186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 msgr2=0x55fc5de9d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de9d290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6cd802c4e0 tx=0x7f6cd8007000 comp rx=0 tx=0).stop 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2261776186 shutdown_connections 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5deab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:6833/2168278307,v1:172.21.15.159:6835/2168278307] conn(0x55fc5dec0a20 0x55fc5dec2e10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5f5e0 0x55fc5deab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2261776186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de9d290 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cc57fa640 0 client.4662 ms_handle_reset on v2:172.21.15.159:6833/2168278307 2023-11-26T07:17:52.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2261776186 >> 172.21.15.77:0/2261776186 conn(0x55fc5de21c70 msgr2=0x55fc5de59b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:52.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2261776186 shutdown_connections 2023-11-26T07:17:52.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2261776186 wait complete. 2023-11-26T07:17:52.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.234+0000 7f6cefbdf740 20 client.4662 trim_cache size 0 max 16384 2023-11-26T07:17:52.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.251+0000 7f6cefbdf740 1 Processor -- start 2023-11-26T07:17:52.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.251+0000 7f6cefbdf740 1 -- start start 2023-11-26T07:17:52.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5aba0 0x55fc5dea4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5deab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc5db29f20 con 0x55fc5de5f5e0 2023-11-26T07:17:52.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc5de61a20 con 0x55fc5de5aba0 2023-11-26T07:17:52.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc5de9e0e0 con 0x55fc5de5fea0 2023-11-26T07:17:52.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6ce5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6ce5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40842/0 (socket says 172.21.15.77:40842) 2023-11-26T07:17:52.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6ce5d9b640 1 -- 172.21.15.77:0/2283310241 learned_addr learned my addr 172.21.15.77:0/2283310241 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:52.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6ce6d9d640 1 --2- 172.21.15.77:0/2283310241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5deab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6ce5d9b640 1 -- 172.21.15.77:0/2283310241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 msgr2=0x55fc5deab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6ce659c640 1 --2- 172.21.15.77:0/2283310241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5aba0 0x55fc5dea4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/2283310241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5deab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6ce5d9b640 1 -- 172.21.15.77:0/2283310241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5aba0 msgr2=0x55fc5dea4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/2283310241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5aba0 0x55fc5dea4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.252+0000 7f6ce5d9b640 1 -- 172.21.15.77:0/2283310241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc5dea0bc0 con 0x55fc5de5f5e0 2023-11-26T07:17:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.253+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/2283310241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea51d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8050140 tx=0x7f6cdc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52916703c5c02e73 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.253+0000 7f6cd4ff9640 1 -- 172.21.15.77:0/2283310241 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc01b070 con 0x55fc5de5f5e0 2023-11-26T07:17:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.253+0000 7f6cd4ff9640 1 -- 172.21.15.77:0/2283310241 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc00c040 con 0x55fc5de5f5e0 2023-11-26T07:17:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.253+0000 7f6cd4ff9640 1 -- 172.21.15.77:0/2283310241 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc016ae0 con 0x55fc5de5f5e0 2023-11-26T07:17:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.253+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2283310241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 msgr2=0x55fc5dea51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:52.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.253+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2283310241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea51d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8050140 tx=0x7f6cdc008040 comp rx=0 tx=0).stop 2023-11-26T07:17:52.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.254+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2283310241 shutdown_connections 2023-11-26T07:17:52.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.254+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2283310241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5deab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.254+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2283310241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5f5e0 0x55fc5dea51d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.254+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2283310241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5aba0 0x55fc5dea4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.254+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2283310241 >> 172.21.15.77:0/2283310241 conn(0x55fc5de21c70 msgr2=0x55fc5dea5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:52.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.254+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2283310241 shutdown_connections 2023-11-26T07:17:52.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.254+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2283310241 wait complete. 2023-11-26T07:17:52.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.254+0000 7f6cefbdf740 1 -- start start 2023-11-26T07:17:52.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.255+0000 7f6cefbdf740 1 Processor -- start 2023-11-26T07:17:52.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de5a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5f5e0 0x55fc5dec6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6cefbdf740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5df0f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc5df13de0 con 0x55fc5de5aba0 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc5df0fde0 con 0x55fc5de5f5e0 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6cefbdf740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc5dead9c0 con 0x55fc5de5fea0 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6cefbdf740 10 client.0 _ll_register_callbacks cb 0x7f6cd00036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6ce659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de5a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6ce659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de5a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40854/0 (socket says 172.21.15.77:40854) 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6ce659c640 1 -- 172.21.15.77:0/2266041940 learned_addr learned my addr 172.21.15.77:0/2266041940 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6ce659c640 1 -- 172.21.15.77:0/2266041940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 msgr2=0x55fc5df0f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6ce659c640 1 --2- 172.21.15.77:0/2266041940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5df0f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6ce659c640 1 -- 172.21.15.77:0/2266041940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5f5e0 msgr2=0x55fc5dec6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6ce659c640 1 --2- 172.21.15.77:0/2266041940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5f5e0 0x55fc5dec6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6ce659c640 1 -- 172.21.15.77:0/2266041940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cdc01bb00 con 0x55fc5de5aba0 2023-11-26T07:17:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6ce659c640 1 --2- 172.21.15.77:0/2266041940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de5a390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8007210 tx=0x7f6cd802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fe52fdd5fd659d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.256+0000 7f6cc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2266041940 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8007540 con 0x55fc5de5aba0 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2266041940 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cd8035650 con 0x55fc5de5aba0 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2266041940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc5de5b2f0 con 0x55fc5de5aba0 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2266041940 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cd80076a0 con 0x55fc5de5aba0 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cefbdf740 10 client.4668 fetch_fsmap learned FSMap version 7 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2266041940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55fc5dd62b80 con 0x55fc5de5aba0 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2266041940 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc5de5b2f0 con 0x55fc5de5aba0 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2266041940 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6cd8035810 con 0x55fc5de5aba0 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cefbdf740 10 client.4668 fetch_fsmap finished waiting for FSMap version 7 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cefbdf740 10 client.4668 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-26T07:17:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cefbdf740 20 client.4668 populate_metadata read hostname 'smithi077' 2023-11-26T07:17:52.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2266041940 >> [v2:172.21.15.159:6833/2168278307,v1:172.21.15.159:6835/2168278307] conn(0x55fc5dea4c90 0x55fc5dea5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:52.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cefbdf740 4 client.4668 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:17:52.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.257+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2266041940 --> [v2:172.21.15.159:6833/2168278307,v1:172.21.15.159:6835/2168278307] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fc5deb8570 con 0x55fc5dea4c90 2023-11-26T07:17:52.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.258+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/2266041940 >> [v2:172.21.15.159:6833/2168278307,v1:172.21.15.159:6835/2168278307] conn(0x55fc5dea4c90 0x55fc5dea5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:52.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.259+0000 7f6ce5d9b640 1 --2- 172.21.15.77:0/2266041940 >> [v2:172.21.15.159:6833/2168278307,v1:172.21.15.159:6835/2168278307] conn(0x55fc5dea4c90 0x55fc5dea5070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4c0a04a11b79e1c server_cookie=dde0339e5d3c7b65 in_seq=0 out_seq=0 2023-11-26T07:17:52.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.259+0000 7f6cc57fa640 10 client.4668 ms_handle_connect on v2:172.21.15.159:6833/2168278307 2023-11-26T07:17:52.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.259+0000 7f6cc57fa640 1 -- 172.21.15.77:0/2266041940 <== mds.0 v2:172.21.15.159:6833/2168278307 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55fc5deb8570 con 0x55fc5dea4c90 2023-11-26T07:17:52.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.259+0000 7f6cc57fa640 10 client.4668 handle_command_reply: tid=0 2023-11-26T07:17:52.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.259+0000 7f6cefbdf740 1 client.4668 shutdown 2023-11-26T07:17:52.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.259+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2266041940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 msgr2=0x55fc5de5a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:52.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.259+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2266041940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de5a390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8007210 tx=0x7f6cd802e000 comp rx=0 tx=0).stop 2023-11-26T07:17:52.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2266041940 shutdown_connections 2023-11-26T07:17:52.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2266041940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55fc5de5fea0 0x55fc5df0f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2266041940 >> [v2:172.21.15.159:6833/2168278307,v1:172.21.15.159:6835/2168278307] conn(0x55fc5dea4c90 0x55fc5dea5070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2266041940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fc5de5f5e0 0x55fc5dec6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cefbdf740 1 --2- 172.21.15.77:0/2266041940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fc5de5aba0 0x55fc5de5a390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cc57fa640 0 client.4668 ms_handle_reset on v2:172.21.15.159:6833/2168278307 2023-11-26T07:17:52.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2266041940 >> 172.21.15.77:0/2266041940 conn(0x55fc5de21c70 msgr2=0x55fc5de562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:52.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2266041940 shutdown_connections 2023-11-26T07:17:52.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cefbdf740 1 -- 172.21.15.77:0/2266041940 wait complete. 2023-11-26T07:17:52.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cefbdf740 20 client.4668 trim_cache size 0 max 16384 2023-11-26T07:17:52.266 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:17:52.266 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "957368bd-e942-499b-9938-86266ae9bafb", 2023-11-26T07:17:52.266 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-26T07:17:52.266 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4275, 2023-11-26T07:17:52.266 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-26T07:17:52.266 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-26T07:17:52.266 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-26T07:17:52.266 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 16.980774880999999, 2023-11-26T07:17:52.266 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 7, 2023-11-26T07:17:52.266 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 20, 2023-11-26T07:17:52.266 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 20, 2023-11-26T07:17:52.267 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 22.196237365000002 2023-11-26T07:17:52.267 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:17:52.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cecf6f640 1 -- 172.21.15.77:0/1493040690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6cc806ae40 msgr2=0x7f6cc806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:52.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cecf6f640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6cc806ae40 0x7f6cc806d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8034000 tx=0x7f6cd802f000 comp rx=0 tx=0).stop 2023-11-26T07:17:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cecf6f640 1 -- 172.21.15.77:0/1493040690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ce8158f70 msgr2=0x7f6ce809a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.260+0000 7f6cecf6f640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ce8158f70 0x7f6ce809a5e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6ce809d280 tx=0x7f6ce000dc00 comp rx=0 tx=0).stop 2023-11-26T07:17:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.261+0000 7f6cecf6f640 1 -- 172.21.15.77:0/1493040690 shutdown_connections 2023-11-26T07:17:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.261+0000 7f6cecf6f640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6cc806ae40 0x7f6cc806d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.261+0000 7f6cecf6f640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ce8158f70 0x7f6ce809a5e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.261+0000 7f6cecf6f640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce80999d0 0x7f6ce8158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.261+0000 7f6cecf6f640 1 --2- 172.21.15.77:0/1493040690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cd0003970 0x7f6ce80ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.261+0000 7f6cecf6f640 1 -- 172.21.15.77:0/1493040690 >> 172.21.15.77:0/1493040690 conn(0x7f6ce80b0c50 msgr2=0x7f6ce80cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.261+0000 7f6cecf6f640 1 -- 172.21.15.77:0/1493040690 shutdown_connections 2023-11-26T07:17:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:52.261+0000 7f6cecf6f640 1 -- 172.21.15.77:0/1493040690 wait complete. 2023-11-26T07:17:52.279 INFO:teuthology.run_tasks:Running task kclient... 2023-11-26T07:17:52.301 INFO:tasks.kclient:Mounting kernel clients... 2023-11-26T07:17:52.301 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-26T07:17:52.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:52.301 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-26T07:17:52.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:52.357 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2023-11-26T07:17:52.454 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2023-11-26T07:17:52.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:52.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:52.458 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-26T07:17:52.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:52.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2023-11-26T07:17:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2023-11-26T07:17:52.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:52.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:52.615 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-11-26T07:17:52.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:52.675 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2023-11-26T07:17:52.772 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2023-11-26T07:17:52.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:52.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:52.776 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-11-26T07:17:52.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:52.828 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2023-11-26T07:17:52.924 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2023-11-26T07:17:52.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:52.928 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-26T07:17:52.928 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:17:52.929 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:17:52.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:17:53.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.146+0000 7f9de0d7c640 1 Processor -- start 2023-11-26T07:17:53.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.146+0000 7f9de0d7c640 1 -- start start 2023-11-26T07:17:53.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.148+0000 7f9de0d7c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc0cf450 0x7f9ddc0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:53.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.148+0000 7f9de0d7c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ddc0cece0 con 0x7f9ddc15c7f0 2023-11-26T07:17:53.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.148+0000 7f9de0d7c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ddc06d040 con 0x7f9ddc0cdfb0 2023-11-26T07:17:53.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.148+0000 7f9de0d7c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc156010 con 0x7f9ddc0cf450 2023-11-26T07:17:53.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.148+0000 7f9dda59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9ddc15c7f0 0x7f9ddc06db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40692/0 (socket says 172.21.15.77:40692) 2023-11-26T07:17:53.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.148+0000 7f9dda59c640 1 -- 172.21.15.77:0/2297643557 learned_addr learned my addr 172.21.15.77:0/2297643557 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:17:53.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.148+0000 7f9dd3fff640 1 --2- 172.21.15.77:0/2297643557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc0cf450 0x7f9ddc0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:53.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867176671 0 0) 0x7f9ddc0cece0 con 0x7f9ddc15c7f0 2023-11-26T07:17:53.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc8003520 con 0x7f9ddc15c7f0 2023-11-26T07:17:53.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3688847263 0 0) 0x7f9dc8003520 con 0x7f9ddc15c7f0 2023-11-26T07:17:53.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc0cf450 msgr2=0x7f9ddc0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:53.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 --2- 172.21.15.77:0/2297643557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc0cf450 0x7f9ddc0cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:53.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 >> v1:172.21.15.159:6789/0 conn(0x7f9ddc0cdfb0 legacy=0x7f9ddc0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:53.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc06d320 con 0x7f9ddc15c7f0 2023-11-26T07:17:53.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f9dcc001670 con 0x7f9ddc15c7f0 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 >> v1:172.21.15.77:6789/0 conn(0x7f9ddc15c7f0 legacy=0x7f9ddc06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 --2- 172.21.15.77:0/2297643557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc0cf450 0x7f9dc80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 --2- 172.21.15.77:0/2297643557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc8003fd0 0x7f9dc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 --2- 172.21.15.77:0/2297643557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc8004d00 0x7f9dc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc156010 con 0x7f9dc8003fd0 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc800bb40 con 0x7f9dc8004d00 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc800bd00 con 0x7f9ddc0cf450 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.149+0000 7f9dd3fff640 1 --2- 172.21.15.77:0/2297643557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc8003fd0 0x7f9dc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.150+0000 7f9dda59c640 1 --2- 172.21.15.77:0/2297643557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc0cf450 0x7f9dc80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.150+0000 7f9dd3fff640 1 -- 172.21.15.77:0/2297643557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc0cf450 msgr2=0x7f9dc80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.150+0000 7f9dd3fff640 1 --2- 172.21.15.77:0/2297643557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc0cf450 0x7f9dc80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.150+0000 7f9dd3fff640 1 -- 172.21.15.77:0/2297643557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc8004d00 msgr2=0x7f9dc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:53.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.150+0000 7f9dd3fff640 1 --2- 172.21.15.77:0/2297643557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc8004d00 0x7f9dc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:53.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.150+0000 7f9dd3fff640 1 -- 172.21.15.77:0/2297643557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc8003520 con 0x7f9dc8003fd0 2023-11-26T07:17:53.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.151+0000 7f9dd3fff640 1 --2- 172.21.15.77:0/2297643557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc8003fd0 0x7f9dc80047c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400ba30 tx=0x7f9dc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c642ef3f8fca02b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:53.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.152+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4032640 con 0x7f9dc8003fd0 2023-11-26T07:17:53.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.152+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc40327a0 con 0x7f9dc8003fd0 2023-11-26T07:17:53.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.152+0000 7f9dd9d9b640 1 -- 172.21.15.77:0/2297643557 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4032b30 con 0x7f9dc8003fd0 2023-11-26T07:17:53.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.152+0000 7f9de0d7c640 1 -- 172.21.15.77:0/2297643557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc8003fd0 msgr2=0x7f9dc80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:53.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.152+0000 7f9de0d7c640 1 --2- 172.21.15.77:0/2297643557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc8003fd0 0x7f9dc80047c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400ba30 tx=0x7f9dc80057f0 comp rx=0 tx=0).stop 2023-11-26T07:17:53.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.152+0000 7f9ddad9d640 1 -- 172.21.15.77:0/2297643557 reap_dead start 2023-11-26T07:17:53.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.152+0000 7f9de0d7c640 1 -- 172.21.15.77:0/2297643557 shutdown_connections 2023-11-26T07:17:53.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.152+0000 7f9de0d7c640 1 -- 172.21.15.77:0/2297643557 >> 172.21.15.77:0/2297643557 conn(0x7f9ddc06a920 msgr2=0x7f9ddc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:53.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.152+0000 7f9de0d7c640 1 -- 172.21.15.77:0/2297643557 shutdown_connections 2023-11-26T07:17:53.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.152+0000 7f9de0d7c640 1 -- 172.21.15.77:0/2297643557 wait complete. 2023-11-26T07:17:53.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.154+0000 7f9de0d7c640 1 Processor -- start 2023-11-26T07:17:53.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.154+0000 7f9de0d7c640 1 -- start start 2023-11-26T07:17:53.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.155+0000 7f9de0d7c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc8003fd0 0x7f9ddc152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:53.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.155+0000 7f9de0d7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ddc0aec50 0x7f9ddc09cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.155+0000 7f9de0d7c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc1547f0 0x7f9ddc0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.155+0000 7f9de0d7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc1543d0 con 0x7f9ddc0aec50 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.155+0000 7f9de0d7c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc153520 con 0x7f9dc8003fd0 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.155+0000 7f9de0d7c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc14ef70 con 0x7f9ddc1547f0 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.155+0000 7f9dd3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ddc0aec50 0x7f9ddc09cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.155+0000 7f9dd3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ddc0aec50 0x7f9ddc09cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40868/0 (socket says 172.21.15.77:40868) 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.155+0000 7f9dd3fff640 1 -- 172.21.15.77:0/1484747232 learned_addr learned my addr 172.21.15.77:0/1484747232 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.156+0000 7f9dd3fff640 1 -- 172.21.15.77:0/1484747232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc1547f0 msgr2=0x7f9ddc0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.156+0000 7f9dd3fff640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc1547f0 0x7f9ddc0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.156+0000 7f9dd3fff640 1 -- 172.21.15.77:0/1484747232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc8003fd0 msgr2=0x7f9ddc152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.156+0000 7f9dd3fff640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc8003fd0 0x7f9ddc152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.156+0000 7f9dd3fff640 1 -- 172.21.15.77:0/1484747232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc09d150 con 0x7f9ddc0aec50 2023-11-26T07:17:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.156+0000 7f9dd3fff640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ddc0aec50 0x7f9ddc09cc10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9dc402bec0 tx=0x7f9dc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:53.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.156+0000 7f9dd2ffd640 1 -- 172.21.15.77:0/1484747232 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc403ba70 con 0x7f9ddc0aec50 2023-11-26T07:17:53.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.156+0000 7f9dd2ffd640 1 -- 172.21.15.77:0/1484747232 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc403bbd0 con 0x7f9ddc0aec50 2023-11-26T07:17:53.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.156+0000 7f9dd2ffd640 1 -- 172.21.15.77:0/1484747232 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4030410 con 0x7f9ddc0aec50 2023-11-26T07:17:53.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.156+0000 7f9de0d7c640 1 -- 172.21.15.77:0/1484747232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ddc153750 con 0x7f9ddc0aec50 2023-11-26T07:17:53.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.157+0000 7f9de0d7c640 1 -- 172.21.15.77:0/1484747232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ddc153d10 con 0x7f9ddc0aec50 2023-11-26T07:17:53.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.158+0000 7f9de0d7c640 1 -- 172.21.15.77:0/1484747232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ddc06eed0 con 0x7f9ddc0aec50 2023-11-26T07:17:53.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.159+0000 7f9dd2ffd640 1 -- 172.21.15.77:0/1484747232 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9dc4030570 con 0x7f9ddc0aec50 2023-11-26T07:17:53.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.159+0000 7f9dd2ffd640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9dbc06ae70 0x7f9dbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:53.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.159+0000 7f9dd2ffd640 1 -- 172.21.15.77:0/1484747232 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9dc40abe90 con 0x7f9ddc0aec50 2023-11-26T07:17:53.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.160+0000 7f9dda59c640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9dbc06ae70 0x7f9dbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:53.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.160+0000 7f9dda59c640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9dbc06ae70 0x7f9dbc06d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001eb0 tx=0x7f9dcc001d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:53.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.164+0000 7f9dd2ffd640 1 -- 172.21.15.77:0/1484747232 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9dc407a9d0 con 0x7f9ddc0aec50 2023-11-26T07:17:53.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.390+0000 7f9de0d7c640 1 -- 172.21.15.77:0/1484747232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9ddc067470 con 0x7f9ddc0aec50 2023-11-26T07:17:53.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.391+0000 7f9dd2ffd640 1 -- 172.21.15.77:0/1484747232 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9dc4036070 con 0x7f9ddc0aec50 2023-11-26T07:17:53.394 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 -- 172.21.15.77:0/1484747232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9dbc06ae70 msgr2=0x7f9dbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9dbc06ae70 0x7f9dbc06d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001eb0 tx=0x7f9dcc001d60 comp rx=0 tx=0).stop 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 -- 172.21.15.77:0/1484747232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ddc0aec50 msgr2=0x7f9ddc09cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ddc0aec50 0x7f9ddc09cc10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9dc402bec0 tx=0x7f9dc4004730 comp rx=0 tx=0).stop 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 -- 172.21.15.77:0/1484747232 shutdown_connections 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9dbc06ae70 0x7f9dbc06d330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ddc1547f0 0x7f9ddc0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ddc0aec50 0x7f9ddc09cc10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 --2- 172.21.15.77:0/1484747232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc8003fd0 0x7f9ddc152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 -- 172.21.15.77:0/1484747232 >> 172.21.15.77:0/1484747232 conn(0x7f9ddc06a920 msgr2=0x7f9ddc15a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 -- 172.21.15.77:0/1484747232 shutdown_connections 2023-11-26T07:17:53.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:53.394+0000 7f9de0d7c640 1 -- 172.21.15.77:0/1484747232 wait complete. 2023-11-26T07:17:53.415 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:17:53.415 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:17:53.415 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-26T07:17:53.415 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:17:53.415 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:17:53.416 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:17:53.416 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:17:53.416 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:17:53.416 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:17:53.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:53.417 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-26T07:17:53.468 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:17:53.468 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:17:53.468 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:17:53.468 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:53.468 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-26T07:17:53.468 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:53.468 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42375sec preferred_lft 42375sec 2023-11-26T07:17:53.469 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-26T07:17:53.470 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:53.470 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-26T07:17:53.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:53.471 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:17:53.471 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:17:53.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2023-11-26T07:17:53.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2023-11-26T07:17:53.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2023-11-26T07:17:53.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-26T07:17:53.471 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:17:53.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:53.944 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:17:54.028 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-26T07:17:54.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:54.032 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-26T07:17:54.094 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-26T07:17:54.094 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:17:54.094 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:17:54.094 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:17:54.094 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:17:54.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:54.095 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:17:54.095 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:17:54.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:17:54.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:17:54.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:17:54.096 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:17:54.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:17:54.737 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:17:54.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:54.828 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-26T07:17:54.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:54.877 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2023-11-26T07:17:54.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:54.976 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:17:54.976 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:17:54.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:17:54.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-26T07:17:54.976 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:17:55.121 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-26T07:17:55.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:55.122 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:17:55.122 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:17:55.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-26T07:17:55.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-26T07:17:55.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-26T07:17:55.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-26T07:17:55.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-26T07:17:55.122 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:17:55.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:55.415 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:17:55.415 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:17:55.415 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-26T07:17:55.415 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2023-11-26T07:17:55.416 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:17:55.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:17:55.572 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:17:55.619 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:17:55.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:17:55.619 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:17:55.663 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:17:55.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:55.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:17:55.888 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:17:55.888 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:17:55.888 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:17:56.372 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:17:56.372 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:17:56.373 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:17:56.373 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:17:56.373 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:17:56.406 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:17:56.406 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:17:56.406 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:17:56.406 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:17:56.406 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:17:56.407 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:17:56.407 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:17:56.407 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:17:56.408 INFO:teuthology.orchestra.run.smithi077.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-26T07:17:56.408 INFO:teuthology.orchestra.run.smithi077.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:17:56.408 INFO:teuthology.orchestra.run.smithi077.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:17:56.408 INFO:teuthology.orchestra.run.smithi077.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:17:56.408 INFO:teuthology.orchestra.run.smithi077.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:17:56.412 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:17:56.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:56.412 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:17:56.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:56.499 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:17:56.573 INFO:teuthology.orchestra.run.smithi077.stdout:client4430 2023-11-26T07:17:56.574 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:56.574 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:56.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:56.631 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:17:56.709 INFO:teuthology.orchestra.run.smithi077.stdout:client4430 2023-11-26T07:17:56.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:56.709 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:17:56.793 INFO:teuthology.orchestra.run.smithi077.stdout:client4430 2023-11-26T07:17:56.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:56.794 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/957368bd-e942-499b-9938-86266ae9bafb.client4430/status') 2023-11-26T07:17:56.903 INFO:teuthology.orchestra.run.smithi077.stdout:instance: client.4430 (3)172.21.15.77:0/3382095077 2023-11-26T07:17:56.903 INFO:teuthology.orchestra.run.smithi077.stdout:blocklisted: false 2023-11-26T07:17:56.903 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records in 2023-11-26T07:17:56.904 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records out 2023-11-26T07:17:56.904 INFO:teuthology.orchestra.run.smithi077.stderr:70 bytes copied, 7.7395e-05 s, 904 kB/s 2023-11-26T07:17:56.907 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-11-26T07:17:56.907 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:17:56.907 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-26T07:17:56.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:17:57.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.116+0000 7fc93359e640 1 Processor -- start 2023-11-26T07:17:57.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.116+0000 7fc93359e640 1 -- start start 2023-11-26T07:17:57.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.118+0000 7fc93359e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc934144b30 0x7fc93415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.118+0000 7fc93359e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc9340b1de0 0x7fc9340b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.118+0000 7fc93359e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93415bf80 con 0x7fc93415c410 2023-11-26T07:17:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.118+0000 7fc93359e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9340b27b0 con 0x7fc934144b30 2023-11-26T07:17:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.118+0000 7fc93359e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9340b1560 con 0x7fc9340b1de0 2023-11-26T07:17:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.118+0000 7fc93259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc934144b30 0x7fc93415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.118+0000 7fc93259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc934144b30 0x7fc93415f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55906/0 (socket says 172.21.15.77:55906) 2023-11-26T07:17:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.118+0000 7fc93259c640 1 -- 172.21.15.77:0/2596401885 learned_addr learned my addr 172.21.15.77:0/2596401885 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:57.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.118+0000 7fc93259c640 1 -- 172.21.15.77:0/2596401885 >> v2:172.21.15.159:3300/0 conn(0x7fc9340b1de0 msgr2=0x7fc9340b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:57.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.119+0000 7fc93259c640 1 --2- 172.21.15.77:0/2596401885 >> v2:172.21.15.159:3300/0 conn(0x7fc9340b1de0 0x7fc9340b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.119+0000 7fc93259c640 1 -- 172.21.15.77:0/2596401885 >> v1:172.21.15.159:6789/0 conn(0x7fc93415c410 legacy=0x7fc9340b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.119+0000 7fc93259c640 1 -- 172.21.15.77:0/2596401885 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9340b1280 con 0x7fc934144b30 2023-11-26T07:17:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.120+0000 7fc93259c640 1 --2- 172.21.15.77:0/2596401885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc934144b30 0x7fc93415f920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc934072a50 tx=0x7fc92402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2fb340c487851c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.120+0000 7fc931d9b640 1 -- 172.21.15.77:0/2596401885 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924031870 con 0x7fc934144b30 2023-11-26T07:17:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.120+0000 7fc931d9b640 1 -- 172.21.15.77:0/2596401885 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9240319d0 con 0x7fc934144b30 2023-11-26T07:17:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.120+0000 7fc931d9b640 1 -- 172.21.15.77:0/2596401885 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924031d60 con 0x7fc934144b30 2023-11-26T07:17:57.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.121+0000 7fc93359e640 1 -- 172.21.15.77:0/2596401885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc934144b30 msgr2=0x7fc93415f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.121+0000 7fc93359e640 1 --2- 172.21.15.77:0/2596401885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc934144b30 0x7fc93415f920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc934072a50 tx=0x7fc92402b910 comp rx=0 tx=0).stop 2023-11-26T07:17:57.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.121+0000 7fc93359e640 1 -- 172.21.15.77:0/2596401885 shutdown_connections 2023-11-26T07:17:57.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.121+0000 7fc93359e640 1 --2- 172.21.15.77:0/2596401885 >> v2:172.21.15.159:3300/0 conn(0x7fc9340b1de0 0x7fc9340b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.121+0000 7fc93359e640 1 --2- 172.21.15.77:0/2596401885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc934144b30 0x7fc93415f920 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.121+0000 7fc93359e640 1 -- 172.21.15.77:0/2596401885 >> 172.21.15.77:0/2596401885 conn(0x7fc9340cb830 msgr2=0x7fc9340cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:57.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.121+0000 7fc93359e640 1 -- 172.21.15.77:0/2596401885 shutdown_connections 2023-11-26T07:17:57.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.121+0000 7fc93359e640 1 -- 172.21.15.77:0/2596401885 wait complete. 2023-11-26T07:17:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.123+0000 7fc93359e640 1 Processor -- start 2023-11-26T07:17:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.123+0000 7fc93359e640 1 -- start start 2023-11-26T07:17:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.124+0000 7fc93359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9340b1de0 0x7fc934130280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.124+0000 7fc93359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc934144b30 0x7fc93415d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.124+0000 7fc93359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93415c410 0x7fc93415d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.124+0000 7fc93359e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc934143ec0 con 0x7fc93415c410 2023-11-26T07:17:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.124+0000 7fc93359e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc934131200 con 0x7fc934144b30 2023-11-26T07:17:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.124+0000 7fc93359e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93413ee80 con 0x7fc9340b1de0 2023-11-26T07:17:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.124+0000 7fc932d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93415c410 0x7fc93415d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.124+0000 7fc932d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93415c410 0x7fc93415d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55920/0 (socket says 172.21.15.77:55920) 2023-11-26T07:17:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.124+0000 7fc932d9d640 1 -- 172.21.15.77:0/3808629809 learned_addr learned my addr 172.21.15.77:0/3808629809 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.124+0000 7fc93259c640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9340b1de0 0x7fc934130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.124+0000 7fc92bfff640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc934144b30 0x7fc93415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.125+0000 7fc932d9d640 1 -- 172.21.15.77:0/3808629809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9340b1de0 msgr2=0x7fc934130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.125+0000 7fc932d9d640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9340b1de0 0x7fc934130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.125+0000 7fc932d9d640 1 -- 172.21.15.77:0/3808629809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc934144b30 msgr2=0x7fc93415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.125+0000 7fc932d9d640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc934144b30 0x7fc93415d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.125+0000 7fc932d9d640 1 -- 172.21.15.77:0/3808629809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9240094d0 con 0x7fc93415c410 2023-11-26T07:17:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.125+0000 7fc932d9d640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93415c410 0x7fc93415d760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00b9a0 tx=0x7fc92c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.125+0000 7fc92affd640 1 -- 172.21.15.77:0/3808629809 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00cba0 con 0x7fc93415c410 2023-11-26T07:17:57.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.125+0000 7fc92affd640 1 -- 172.21.15.77:0/3808629809 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c00cd20 con 0x7fc93415c410 2023-11-26T07:17:57.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.125+0000 7fc92affd640 1 -- 172.21.15.77:0/3808629809 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c014680 con 0x7fc93415c410 2023-11-26T07:17:57.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.125+0000 7fc93359e640 1 -- 172.21.15.77:0/3808629809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9341307c0 con 0x7fc93415c410 2023-11-26T07:17:57.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.125+0000 7fc93359e640 1 -- 172.21.15.77:0/3808629809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9341339f0 con 0x7fc93415c410 2023-11-26T07:17:57.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.127+0000 7fc93359e640 1 -- 172.21.15.77:0/3808629809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc934131340 con 0x7fc93415c410 2023-11-26T07:17:57.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.127+0000 7fc92affd640 1 -- 172.21.15.77:0/3808629809 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc92c01d3b0 con 0x7fc93415c410 2023-11-26T07:17:57.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.128+0000 7fc92affd640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc91406ae40 0x7fc91406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.128+0000 7fc92affd640 1 -- 172.21.15.77:0/3808629809 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc92c089650 con 0x7fc93415c410 2023-11-26T07:17:57.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.129+0000 7fc93259c640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc91406ae40 0x7fc91406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.129+0000 7fc93259c640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc91406ae40 0x7fc91406d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc924036000 tx=0x7fc92403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.133+0000 7fc92affd640 1 -- 172.21.15.77:0/3808629809 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc934131340 con 0x7fc93415c410 2023-11-26T07:17:57.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.362+0000 7fc93359e640 1 -- 172.21.15.77:0/3808629809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc934131340 con 0x7fc93415c410 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.363+0000 7fc92affd640 1 -- 172.21.15.77:0/3808629809 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc92c019060 con 0x7fc93415c410 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.365+0000 7fc93359e640 1 -- 172.21.15.77:0/3808629809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc91406ae40 msgr2=0x7fc91406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.365+0000 7fc93359e640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc91406ae40 0x7fc91406d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc924036000 tx=0x7fc92403c040 comp rx=0 tx=0).stop 2023-11-26T07:17:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.365+0000 7fc93359e640 1 -- 172.21.15.77:0/3808629809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93415c410 msgr2=0x7fc93415d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.365+0000 7fc93359e640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93415c410 0x7fc93415d760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00b9a0 tx=0x7fc92c00be60 comp rx=0 tx=0).stop 2023-11-26T07:17:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.365+0000 7fc93359e640 1 -- 172.21.15.77:0/3808629809 shutdown_connections 2023-11-26T07:17:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.365+0000 7fc93359e640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc91406ae40 0x7fc91406d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.365+0000 7fc93359e640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93415c410 0x7fc93415d760 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.365+0000 7fc93359e640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc934144b30 0x7fc93415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.365+0000 7fc93359e640 1 --2- 172.21.15.77:0/3808629809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9340b1de0 0x7fc934130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.365+0000 7fc93359e640 1 -- 172.21.15.77:0/3808629809 >> 172.21.15.77:0/3808629809 conn(0x7fc9340cb830 msgr2=0x7fc934071950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.366+0000 7fc93359e640 1 -- 172.21.15.77:0/3808629809 shutdown_connections 2023-11-26T07:17:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:57.366+0000 7fc93359e640 1 -- 172.21.15.77:0/3808629809 wait complete. 2023-11-26T07:17:57.386 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:17:57.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:17:57.387 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-26T07:17:57.387 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-26T07:17:57.387 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-26T07:17:57.387 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:17:57.387 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:17:57.387 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:17:57.388 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-26T07:17:57.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:57.388 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-26T07:17:57.438 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:17:57.438 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:17:57.438 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:17:57.438 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:57.438 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-26T07:17:57.439 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:57.439 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:17:57.439 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:57.439 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-26T07:17:57.439 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:17:57.439 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:57.440 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-26T07:17:57.440 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:17:57.440 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:57.440 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:17:57.440 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:57.440 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:17:57.440 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42371sec preferred_lft 42371sec 2023-11-26T07:17:57.441 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-26T07:17:57.441 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:57.441 INFO:teuthology.orchestra.run.smithi077.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:17:57.441 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether ba:55:90:99:11:fe brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:57.441 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:17:57.441 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:57.442 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::609f:3dff:fe4d:944c/64 scope link 2023-11-26T07:17:57.442 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:57.442 INFO:teuthology.orchestra.run.smithi077.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:17:57.442 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether ba:55:90:99:11:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:17:57.442 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::b855:90ff:fe99:11fe/64 scope link 2023-11-26T07:17:57.442 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:57.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:57.444 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:17:57.576 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-26T07:17:57.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:57.580 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-26T07:17:57.631 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-26T07:17:57.632 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:17:57.632 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:17:57.632 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:17:57.632 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:17:57.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:57.632 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:17:57.632 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:17:57.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:17:57.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:17:57.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:17:57.633 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:17:57.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:57.815 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-26T07:17:57.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:17:57.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:57.865 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2023-11-26T07:17:57.918 INFO:teuthology.orchestra.run.smithi077.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-26T07:17:57.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:57.919 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:17:57.919 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:17:57.919 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:17:57.919 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-26T07:17:57.919 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:17:58.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:58.058 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-26T07:17:58.149 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:17:58.149 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:17:58.149 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:17:58.149 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:58.149 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-26T07:17:58.149 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:58.149 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:17:58.150 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 7e:05:9d:22:a3:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:17:58.150 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:17:58.150 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:58.150 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::7c05:9dff:fe22:a357/64 scope link 2023-11-26T07:17:58.150 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:58.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:58.153 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-26T07:17:58.252 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:17:58.252 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:17:58.252 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:17:58.252 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:58.252 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-26T07:17:58.252 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:58.252 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:17:58.252 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 7e:05:9d:22:a3:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:17:58.252 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:17:58.252 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:58.253 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::7c05:9dff:fe22:a357/64 scope link 2023-11-26T07:17:58.253 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:58.256 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-26T07:17:58.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:58.256 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:17:58.256 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:17:58.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-26T07:17:58.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-26T07:17:58.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-26T07:17:58.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-26T07:17:58.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-26T07:17:58.257 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:17:58.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:58.523 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:17:58.523 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:17:58.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.1 up 2023-11-26T07:17:58.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.1 master ceph-brx 2023-11-26T07:17:58.523 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:17:58.688 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:17:58.688 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-26T07:17:58.737 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-26T07:17:58.737 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:17:58.737 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-26T07:17:58.790 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:17:58.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:58.790 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-26T07:17:58.927 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-26T07:17:58.927 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-26T07:17:58.928 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:17:58.950 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-26T07:17:58.950 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-26T07:17:58.950 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:17:58.950 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:17:58.950 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:17:58.978 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-26T07:17:58.979 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-26T07:17:58.979 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:17:58.979 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:17:58.979 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:17:58.979 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:17:58.979 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:17:58.979 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:17:58.981 INFO:teuthology.orchestra.run.smithi077.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2023-11-26T07:17:58.981 INFO:teuthology.orchestra.run.smithi077.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:17:58.981 INFO:teuthology.orchestra.run.smithi077.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:17:58.981 INFO:teuthology.orchestra.run.smithi077.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:17:58.981 INFO:teuthology.orchestra.run.smithi077.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:17:58.986 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:17:58.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:58.986 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-26T07:17:59.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:59.072 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:17:59.131 INFO:teuthology.orchestra.run.smithi077.stdout:client4513 2023-11-26T07:17:59.131 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:17:59.131 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:59.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:59.183 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:17:59.241 INFO:teuthology.orchestra.run.smithi077.stdout:client4513 2023-11-26T07:17:59.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:59.241 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:17:59.302 INFO:teuthology.orchestra.run.smithi077.stdout:client4513 2023-11-26T07:17:59.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:59.303 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/957368bd-e942-499b-9938-86266ae9bafb.client4513/status') 2023-11-26T07:17:59.389 INFO:teuthology.orchestra.run.smithi077.stdout:instance: client.4513 (3)172.21.15.77:0/182151463 2023-11-26T07:17:59.389 INFO:teuthology.orchestra.run.smithi077.stdout:blocklisted: false 2023-11-26T07:17:59.389 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records in 2023-11-26T07:17:59.389 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records out 2023-11-26T07:17:59.389 INFO:teuthology.orchestra.run.smithi077.stderr:69 bytes copied, 7.0839e-05 s, 974 kB/s 2023-11-26T07:17:59.393 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-11-26T07:17:59.393 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:17:59.393 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:17:59.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:17:59.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.602+0000 7f63d0c8a640 1 Processor -- start 2023-11-26T07:17:59.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.602+0000 7f63d0c8a640 1 -- start start 2023-11-26T07:17:59.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.604+0000 7f63d0c8a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f63cc144b30 0x7f63cc15f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:59.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.604+0000 7f63d0c8a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63cc15bf80 con 0x7f63cc0b1de0 2023-11-26T07:17:59.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.604+0000 7f63d0c8a640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63cc0b1560 con 0x7f63cc15c410 2023-11-26T07:17:59.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.604+0000 7f63d0c8a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63cc0b1280 con 0x7f63cc144b30 2023-11-26T07:17:59.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.604+0000 7f63cb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f63cc144b30 0x7f63cc15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:59.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.604+0000 7f63cb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f63cc144b30 0x7f63cc15f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55930/0 (socket says 172.21.15.77:55930) 2023-11-26T07:17:59.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.604+0000 7f63cb7fe640 1 -- 172.21.15.77:0/1622297326 learned_addr learned my addr 172.21.15.77:0/1622297326 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:59.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.605+0000 7f63cb7fe640 1 -- 172.21.15.77:0/1622297326 >> v1:172.21.15.159:6789/0 conn(0x7f63cc15c410 legacy=0x7f63cc0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:59.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.605+0000 7f63cb7fe640 1 -- 172.21.15.77:0/1622297326 >> v1:172.21.15.77:6789/0 conn(0x7f63cc0b1de0 legacy=0x7f63cc0b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:59.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.605+0000 7f63cb7fe640 1 -- 172.21.15.77:0/1622297326 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc15b930 con 0x7f63cc144b30 2023-11-26T07:17:59.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.606+0000 7f63cb7fe640 1 --2- 172.21.15.77:0/1622297326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63cc144b30 0x7f63cc15f920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009870 tx=0x7f63b402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7cfda8a7f19b5c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:59.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.607+0000 7f63ca7fc640 1 -- 172.21.15.77:0/1622297326 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4030860 con 0x7f63cc144b30 2023-11-26T07:17:59.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.607+0000 7f63ca7fc640 1 -- 172.21.15.77:0/1622297326 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b40309c0 con 0x7f63cc144b30 2023-11-26T07:17:59.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.607+0000 7f63ca7fc640 1 -- 172.21.15.77:0/1622297326 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4030d50 con 0x7f63cc144b30 2023-11-26T07:17:59.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.607+0000 7f63d0c8a640 1 -- 172.21.15.77:0/1622297326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63cc144b30 msgr2=0x7f63cc15f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:59.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.607+0000 7f63d0c8a640 1 --2- 172.21.15.77:0/1622297326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63cc144b30 0x7f63cc15f920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009870 tx=0x7f63b402b9a0 comp rx=0 tx=0).stop 2023-11-26T07:17:59.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.607+0000 7f63d0c8a640 1 -- 172.21.15.77:0/1622297326 shutdown_connections 2023-11-26T07:17:59.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.607+0000 7f63d0c8a640 1 --2- 172.21.15.77:0/1622297326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63cc144b30 0x7f63cc15f920 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:59.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.607+0000 7f63d0c8a640 1 -- 172.21.15.77:0/1622297326 >> 172.21.15.77:0/1622297326 conn(0x7f63cc0cb830 msgr2=0x7f63cc0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:59.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.608+0000 7f63d0c8a640 1 -- 172.21.15.77:0/1622297326 shutdown_connections 2023-11-26T07:17:59.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.608+0000 7f63d0c8a640 1 -- 172.21.15.77:0/1622297326 wait complete. 2023-11-26T07:17:59.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.609+0000 7f63d0c8a640 1 Processor -- start 2023-11-26T07:17:59.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.609+0000 7f63d0c8a640 1 -- start start 2023-11-26T07:17:59.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.610+0000 7f63d0c8a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63cc0b1de0 0x7f63cc15ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:59.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.610+0000 7f63d0c8a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63cc144b30 0x7f63cc13dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:59.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.610+0000 7f63d0c8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63cc15c410 0x7f63cc13a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:59.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.610+0000 7f63d0c8a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc13e3e0 con 0x7f63cc15c410 2023-11-26T07:17:59.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.610+0000 7f63d0c8a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc13e100 con 0x7f63cc144b30 2023-11-26T07:17:59.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.610+0000 7f63d0c8a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc13fe90 con 0x7f63cc0b1de0 2023-11-26T07:17:59.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.611+0000 7f63cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63cc15c410 0x7f63cc13a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:59.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.611+0000 7f63cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63cc15c410 0x7f63cc13a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55938/0 (socket says 172.21.15.77:55938) 2023-11-26T07:17:59.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.611+0000 7f63cbfff640 1 -- 172.21.15.77:0/423398341 learned_addr learned my addr 172.21.15.77:0/423398341 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:17:59.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.611+0000 7f63caffd640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63cc144b30 0x7f63cc13dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:59.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.611+0000 7f63cb7fe640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63cc0b1de0 0x7f63cc15ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.611+0000 7f63cbfff640 1 -- 172.21.15.77:0/423398341 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63cc0b1de0 msgr2=0x7f63cc15ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.611+0000 7f63cbfff640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63cc0b1de0 0x7f63cc15ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.611+0000 7f63cbfff640 1 -- 172.21.15.77:0/423398341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63cc144b30 msgr2=0x7f63cc13dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.611+0000 7f63cbfff640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63cc144b30 0x7f63cc13dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.611+0000 7f63cbfff640 1 -- 172.21.15.77:0/423398341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40094d0 con 0x7f63cc15c410 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.612+0000 7f63cbfff640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63cc15c410 0x7f63cc13a800 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c390 tx=0x7f63c400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.612+0000 7f63c3fff640 1 -- 172.21.15.77:0/423398341 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c40052d0 con 0x7f63cc15c410 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.612+0000 7f63c3fff640 1 -- 172.21.15.77:0/423398341 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c4005430 con 0x7f63cc15c410 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.612+0000 7f63c3fff640 1 -- 172.21.15.77:0/423398341 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4003810 con 0x7f63cc15c410 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.612+0000 7f63d0c8a640 1 -- 172.21.15.77:0/423398341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63cc140170 con 0x7f63cc15c410 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.612+0000 7f63d0c8a640 1 -- 172.21.15.77:0/423398341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63cc14de20 con 0x7f63cc15c410 2023-11-26T07:17:59.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.613+0000 7f63d0c8a640 1 -- 172.21.15.77:0/423398341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63cc140690 con 0x7f63cc15c410 2023-11-26T07:17:59.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.614+0000 7f63c3fff640 1 -- 172.21.15.77:0/423398341 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f63c4003970 con 0x7f63cc15c410 2023-11-26T07:17:59.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.615+0000 7f63c3fff640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f63ac06ae70 0x7f63ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:59.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.615+0000 7f63c3fff640 1 -- 172.21.15.77:0/423398341 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63c4088af0 con 0x7f63cc15c410 2023-11-26T07:17:59.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.615+0000 7f63cb7fe640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f63ac06ae70 0x7f63ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:59.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.616+0000 7f63cb7fe640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f63ac06ae70 0x7f63ac06d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f63b4036000 tx=0x7f63b403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:59.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.619+0000 7f63c3fff640 1 -- 172.21.15.77:0/423398341 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f63cc140690 con 0x7f63cc15c410 2023-11-26T07:17:59.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.846+0000 7f63d0c8a640 1 -- 172.21.15.77:0/423398341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f63cc140690 con 0x7f63cc15c410 2023-11-26T07:17:59.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.847+0000 7f63c3fff640 1 -- 172.21.15.77:0/423398341 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f63cc140690 con 0x7f63cc15c410 2023-11-26T07:17:59.850 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:17:59.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.849+0000 7f63d0c8a640 1 -- 172.21.15.77:0/423398341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f63ac06ae70 msgr2=0x7f63ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:59.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.849+0000 7f63d0c8a640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f63ac06ae70 0x7f63ac06d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f63b4036000 tx=0x7f63b403b040 comp rx=0 tx=0).stop 2023-11-26T07:17:59.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.849+0000 7f63d0c8a640 1 -- 172.21.15.77:0/423398341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63cc15c410 msgr2=0x7f63cc13a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:59.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.849+0000 7f63d0c8a640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63cc15c410 0x7f63cc13a800 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c390 tx=0x7f63c400c850 comp rx=0 tx=0).stop 2023-11-26T07:17:59.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.850+0000 7f63d0c8a640 1 -- 172.21.15.77:0/423398341 shutdown_connections 2023-11-26T07:17:59.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.850+0000 7f63d0c8a640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f63ac06ae70 0x7f63ac06d330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:59.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.850+0000 7f63d0c8a640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63cc15c410 0x7f63cc13a800 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:59.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.850+0000 7f63d0c8a640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63cc144b30 0x7f63cc13dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:59.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.850+0000 7f63d0c8a640 1 --2- 172.21.15.77:0/423398341 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63cc0b1de0 0x7f63cc15ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:59.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.850+0000 7f63d0c8a640 1 -- 172.21.15.77:0/423398341 >> 172.21.15.77:0/423398341 conn(0x7f63cc0cb830 msgr2=0x7f63cc0cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:59.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.850+0000 7f63d0c8a640 1 -- 172.21.15.77:0/423398341 shutdown_connections 2023-11-26T07:17:59.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:17:59.850+0000 7f63d0c8a640 1 -- 172.21.15.77:0/423398341 wait complete. 2023-11-26T07:17:59.872 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:17:59.872 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:17:59.872 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-11-26T07:17:59.872 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:17:59.872 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:17:59.872 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:17:59.872 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:17:59.872 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:17:59.873 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:17:59.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:59.873 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-11-26T07:17:59.933 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:17:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:17:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:17:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-11-26T07:17:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:59.934 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:17:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-11-26T07:17:59.934 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:17:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-11-26T07:17:59.934 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:17:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:59.934 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:17:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:17:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:17:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42328sec preferred_lft 42328sec 2023-11-26T07:17:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-11-26T07:17:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:17:59.936 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-26T07:17:59.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:59.936 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:17:59.936 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:17:59.936 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add name ceph-brx type bridge 2023-11-26T07:17:59.936 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr flush dev ceph-brx 2023-11-26T07:17:59.937 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set ceph-brx up 2023-11-26T07:17:59.937 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-26T07:17:59.937 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:18:00.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:00.430 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:18:00.509 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-11-26T07:18:00.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:00.513 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-11-26T07:18:00.564 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-11-26T07:18:00.631 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:18:00.632 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:18:00.633 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:18:00.638 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:18:00.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:00.638 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:18:00.639 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:18:00.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:18:00.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:18:00.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:18:00.639 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:01.407 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-11-26T07:18:01.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:01.462 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2023-11-26T07:18:01.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:01.511 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:18:01.511 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:18:01.511 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:01.512 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-26T07:18:01.512 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:18:01.648 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-26T07:18:01.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:01.648 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:18:01.648 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:18:01.648 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-26T07:18:01.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-26T07:18:01.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-26T07:18:01.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-26T07:18:01.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-26T07:18:01.649 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:18:01.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:01.911 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:18:01.911 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:18:01.911 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-11-26T07:18:01.912 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.0 master ceph-brx 2023-11-26T07:18:01.912 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:18:02.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:02.072 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:02.119 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:18:02.119 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:02.120 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:02.216 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:18:02.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:02.216 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:18:02.376 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:18:02.376 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:18:02.376 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:18:02.793 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:18:02.793 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:18:02.793 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:18:02.793 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:18:02.794 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:18:02.821 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:18:02.822 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:18:02.822 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:18:02.822 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:18:02.822 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:18:02.822 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:18:02.822 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:18:02.822 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:18:02.824 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-26T07:18:02.824 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:18:02.824 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:18:02.824 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:18:02.825 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:18:02.828 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:18:02.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:02.828 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:02.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:02.908 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:18:02.957 INFO:teuthology.orchestra.run.smithi159.stdout:client4439 2023-11-26T07:18:02.958 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:18:02.958 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:03.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:03.055 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:18:03.109 INFO:teuthology.orchestra.run.smithi159.stdout:client4439 2023-11-26T07:18:03.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:03.109 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:18:03.163 INFO:teuthology.orchestra.run.smithi159.stdout:client4439 2023-11-26T07:18:03.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:03.164 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/957368bd-e942-499b-9938-86266ae9bafb.client4439/status') 2023-11-26T07:18:03.247 INFO:teuthology.orchestra.run.smithi159.stdout:instance: client.4439 (3)192.168.0.1:0/2393254440 2023-11-26T07:18:03.248 INFO:teuthology.orchestra.run.smithi159.stdout:blocklisted: false 2023-11-26T07:18:03.248 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records in 2023-11-26T07:18:03.248 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records out 2023-11-26T07:18:03.248 INFO:teuthology.orchestra.run.smithi159.stderr:69 bytes copied, 6.8127e-05 s, 1.0 MB/s 2023-11-26T07:18:03.251 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-11-26T07:18:03.251 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:18:03.251 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:03.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:18:03.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.475+0000 7f857ffff640 1 Processor -- start 2023-11-26T07:18:03.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.475+0000 7f857ffff640 1 -- start start 2023-11-26T07:18:03.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.477+0000 7f857ffff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f85800cf410 0x7f85800705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.477+0000 7f857ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8580070af0 0x7f85800cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.477+0000 7f857ffff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858015d810 con 0x7f858013f8a0 2023-11-26T07:18:03.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.477+0000 7f857ffff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858015a800 con 0x7f8580070af0 2023-11-26T07:18:03.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.477+0000 7f857ffff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8580070f40 con 0x7f85800cf410 2023-11-26T07:18:03.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.478+0000 7f857f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8580070af0 0x7f85800cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.478+0000 7f857f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8580070af0 0x7f85800cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55950/0 (socket says 172.21.15.77:55950) 2023-11-26T07:18:03.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.478+0000 7f857f7fe640 1 -- 172.21.15.77:0/2844706018 learned_addr learned my addr 172.21.15.77:0/2844706018 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:03.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.478+0000 7f85767fc640 1 --2- 172.21.15.77:0/2844706018 >> v2:172.21.15.159:3300/0 conn(0x7f85800cf410 0x7f85800705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.478+0000 7f857f7fe640 1 -- 172.21.15.77:0/2844706018 >> v2:172.21.15.159:3300/0 conn(0x7f85800cf410 msgr2=0x7f85800705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:03.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.478+0000 7f857f7fe640 1 --2- 172.21.15.77:0/2844706018 >> v2:172.21.15.159:3300/0 conn(0x7f85800cf410 0x7f85800705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.478+0000 7f857f7fe640 1 -- 172.21.15.77:0/2844706018 >> v1:172.21.15.159:6789/0 conn(0x7f858013f8a0 legacy=0x7f85800ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:03.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.478+0000 7f857f7fe640 1 -- 172.21.15.77:0/2844706018 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858013fc80 con 0x7f8580070af0 2023-11-26T07:18:03.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.480+0000 7f857f7fe640 1 --2- 172.21.15.77:0/2844706018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8580070af0 0x7f85800cc940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f85800cf9f0 tx=0x7f857802e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab6bd687bc0ffd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:03.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.480+0000 7f857e7fc640 1 -- 172.21.15.77:0/2844706018 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857802eea0 con 0x7f8580070af0 2023-11-26T07:18:03.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.480+0000 7f857e7fc640 1 -- 172.21.15.77:0/2844706018 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8578032070 con 0x7f8580070af0 2023-11-26T07:18:03.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.480+0000 7f857e7fc640 1 -- 172.21.15.77:0/2844706018 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8578038620 con 0x7f8580070af0 2023-11-26T07:18:03.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.481+0000 7f857ffff640 1 -- 172.21.15.77:0/2844706018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8580070af0 msgr2=0x7f85800cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:03.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.481+0000 7f857ffff640 1 --2- 172.21.15.77:0/2844706018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8580070af0 0x7f85800cc940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f85800cf9f0 tx=0x7f857802e0f0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.481+0000 7f857ffff640 1 -- 172.21.15.77:0/2844706018 shutdown_connections 2023-11-26T07:18:03.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.481+0000 7f857ffff640 1 --2- 172.21.15.77:0/2844706018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8580070af0 0x7f85800cc940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.481+0000 7f857ffff640 1 --2- 172.21.15.77:0/2844706018 >> v2:172.21.15.159:3300/0 conn(0x7f85800cf410 0x7f85800705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.481+0000 7f857ffff640 1 -- 172.21.15.77:0/2844706018 >> 172.21.15.77:0/2844706018 conn(0x7f85800cba10 msgr2=0x7f85800cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:03.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.481+0000 7f857ffff640 1 -- 172.21.15.77:0/2844706018 shutdown_connections 2023-11-26T07:18:03.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.481+0000 7f857ffff640 1 -- 172.21.15.77:0/2844706018 wait complete. 2023-11-26T07:18:03.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.483+0000 7f857ffff640 1 Processor -- start 2023-11-26T07:18:03.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.483+0000 7f857ffff640 1 -- start start 2023-11-26T07:18:03.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.484+0000 7f857ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8580070af0 0x7f8580157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.484+0000 7f857ffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85800cf410 0x7f85800cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.484+0000 7f857ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f858013f8a0 0x7f85800a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.484+0000 7f857ffff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85801f0ea0 con 0x7f8580070af0 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.484+0000 7f857ffff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85801f1090 con 0x7f858013f8a0 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.484+0000 7f857ffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85801f1370 con 0x7f85800cf410 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.484+0000 7f857effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8580070af0 0x7f8580157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.484+0000 7f857effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8580070af0 0x7f8580157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55958/0 (socket says 172.21.15.77:55958) 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.484+0000 7f857effd640 1 -- 172.21.15.77:0/1568225426 learned_addr learned my addr 172.21.15.77:0/1568225426 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f857f7fe640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f858013f8a0 0x7f85800a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f857effd640 1 -- 172.21.15.77:0/1568225426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85800cf410 msgr2=0x7f85800cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f85767fc640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85800cf410 0x7f85800cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f857effd640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85800cf410 0x7f85800cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f857effd640 1 -- 172.21.15.77:0/1568225426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f858013f8a0 msgr2=0x7f85800a97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f857effd640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f858013f8a0 0x7f85800a97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f857effd640 1 -- 172.21.15.77:0/1568225426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857800bd40 con 0x7f8580070af0 2023-11-26T07:18:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f857f7fe640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f858013f8a0 0x7f85800a97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:03.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f857effd640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8580070af0 0x7f8580157d20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f857000b3f0 tx=0x7f857000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:03.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f8577fff640 1 -- 172.21.15.77:0/1568225426 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570011830 con 0x7f8580070af0 2023-11-26T07:18:03.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f8577fff640 1 -- 172.21.15.77:0/1568225426 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8570011990 con 0x7f8580070af0 2023-11-26T07:18:03.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f8577fff640 1 -- 172.21.15.77:0/1568225426 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570011d40 con 0x7f8580070af0 2023-11-26T07:18:03.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.485+0000 7f857ffff640 1 -- 172.21.15.77:0/1568225426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85801f1650 con 0x7f8580070af0 2023-11-26T07:18:03.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.486+0000 7f857ffff640 1 -- 172.21.15.77:0/1568225426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85800af5d0 con 0x7f8580070af0 2023-11-26T07:18:03.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.487+0000 7f857ffff640 1 -- 172.21.15.77:0/1568225426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858015cec0 con 0x7f8580070af0 2023-11-26T07:18:03.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.488+0000 7f8577fff640 1 -- 172.21.15.77:0/1568225426 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f857001a400 con 0x7f8580070af0 2023-11-26T07:18:03.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.488+0000 7f8577fff640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f856406ae40 0x7f856406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.489+0000 7f8577fff640 1 -- 172.21.15.77:0/1568225426 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8570089480 con 0x7f8580070af0 2023-11-26T07:18:03.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.489+0000 7f85767fc640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f856406ae40 0x7f856406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.489+0000 7f85767fc640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f856406ae40 0x7f856406d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f858006e6a0 tx=0x7f8568008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:03.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.493+0000 7f8577fff640 1 -- 172.21.15.77:0/1568225426 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f858015cec0 con 0x7f8580070af0 2023-11-26T07:18:03.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.719+0000 7f857ffff640 1 -- 172.21.15.77:0/1568225426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f858015cec0 con 0x7f8580070af0 2023-11-26T07:18:03.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.719+0000 7f8577fff640 1 -- 172.21.15.77:0/1568225426 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f858015cec0 con 0x7f8580070af0 2023-11-26T07:18:03.722 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 -- 172.21.15.77:0/1568225426 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f856406ae40 msgr2=0x7f856406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f856406ae40 0x7f856406d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f858006e6a0 tx=0x7f8568008040 comp rx=0 tx=0).stop 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 -- 172.21.15.77:0/1568225426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8580070af0 msgr2=0x7f8580157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8580070af0 0x7f8580157d20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f857000b3f0 tx=0x7f857000b8b0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 -- 172.21.15.77:0/1568225426 shutdown_connections 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f856406ae40 0x7f856406d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f858013f8a0 0x7f85800a97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85800cf410 0x7f85800cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 --2- 172.21.15.77:0/1568225426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8580070af0 0x7f8580157d20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 -- 172.21.15.77:0/1568225426 >> 172.21.15.77:0/1568225426 conn(0x7f85800cba10 msgr2=0x7f85800afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 -- 172.21.15.77:0/1568225426 shutdown_connections 2023-11-26T07:18:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:03.722+0000 7f857ffff640 1 -- 172.21.15.77:0/1568225426 wait complete. 2023-11-26T07:18:03.744 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:18:03.744 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:18:03.744 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-11-26T07:18:03.744 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-26T07:18:03.744 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:03.744 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:18:03.744 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:18:03.744 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:18:03.744 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-26T07:18:03.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:03.745 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-11-26T07:18:03.807 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:03.807 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:03.807 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:03.807 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:03.807 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:03.807 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:03.807 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:18:03.807 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42324sec preferred_lft 42324sec 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:03.808 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:18:03.809 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether be:e0:26:a8:90:e7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:03.809 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:18:03.809 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:03.809 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::5429:19ff:fe3d:266e/64 scope link 2023-11-26T07:18:03.809 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:03.809 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:18:03.809 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether be:e0:26:a8:90:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:03.809 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::bce0:26ff:fea8:90e7/64 scope link tentative 2023-11-26T07:18:03.809 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:03.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:03.810 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:18:03.899 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-11-26T07:18:03.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:03.904 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-11-26T07:18:03.958 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-11-26T07:18:03.958 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:18:03.958 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:18:03.958 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:18:03.958 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:18:03.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:03.959 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:18:03.959 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:18:03.959 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:18:03.959 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:18:03.960 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:18:03.960 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:18:04.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:04.140 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-11-26T07:18:04.190 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:18:04.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:04.190 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2023-11-26T07:18:04.239 INFO:teuthology.orchestra.run.smithi159.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-26T07:18:04.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:04.240 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:18:04.240 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:18:04.241 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:18:04.241 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-26T07:18:04.241 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:18:04.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:04.381 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-26T07:18:04.469 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:04.469 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:04.469 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:04.470 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:04.470 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:04.470 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:04.470 INFO:teuthology.orchestra.run.smithi159.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:18:04.470 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:ff:14:85:83:ff brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:18:04.470 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:18:04.470 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:04.470 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4ff:14ff:fe85:83ff/64 scope link 2023-11-26T07:18:04.470 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:04.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:04.473 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-26T07:18:04.562 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:04.562 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:04.563 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:04.563 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:04.563 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:04.563 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:04.563 INFO:teuthology.orchestra.run.smithi159.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:18:04.563 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:ff:14:85:83:ff brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:18:04.563 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:18:04.563 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:04.563 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4ff:14ff:fe85:83ff/64 scope link 2023-11-26T07:18:04.563 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:04.566 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-26T07:18:04.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:04.566 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:18:04.567 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:18:04.567 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-26T07:18:04.567 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-26T07:18:04.567 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-26T07:18:04.567 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-26T07:18:04.567 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-26T07:18:04.567 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:18:04.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:04.835 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:18:04.835 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:18:04.835 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.1 up 2023-11-26T07:18:04.835 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.1 master ceph-brx 2023-11-26T07:18:04.836 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:18:05.001 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:05.002 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:05.050 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-26T07:18:05.050 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:05.050 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:05.147 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:18:05.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:05.147 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-26T07:18:05.284 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-26T07:18:05.285 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-26T07:18:05.285 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:18:05.307 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-26T07:18:05.307 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-26T07:18:05.307 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:18:05.307 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:18:05.307 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:18:05.332 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-26T07:18:05.332 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-26T07:18:05.333 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:18:05.333 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:18:05.333 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:18:05.333 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:18:05.333 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:18:05.333 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:18:05.335 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2023-11-26T07:18:05.335 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:18:05.335 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:18:05.335 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:18:05.335 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:18:05.339 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:18:05.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:05.339 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:05.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:05.420 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:18:05.476 INFO:teuthology.orchestra.run.smithi159.stdout:client4442 2023-11-26T07:18:05.477 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:18:05.477 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:05.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:05.526 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:18:05.628 INFO:teuthology.orchestra.run.smithi159.stdout:client4442 2023-11-26T07:18:05.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:05.628 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:18:05.686 INFO:teuthology.orchestra.run.smithi159.stdout:client4442 2023-11-26T07:18:05.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:05.687 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/957368bd-e942-499b-9938-86266ae9bafb.client4442/status') 2023-11-26T07:18:05.778 INFO:teuthology.orchestra.run.smithi159.stdout:instance: client.4442 (3)192.168.0.2:0/809283411 2023-11-26T07:18:05.778 INFO:teuthology.orchestra.run.smithi159.stdout:blocklisted: false 2023-11-26T07:18:05.778 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records in 2023-11-26T07:18:05.778 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records out 2023-11-26T07:18:05.778 INFO:teuthology.orchestra.run.smithi159.stderr:68 bytes copied, 6.5234e-05 s, 1.0 MB/s 2023-11-26T07:18:05.782 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-26T07:18:05.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:06.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.039+0000 7fb9fffff640 1 Processor -- start 2023-11-26T07:18:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.039+0000 7fb9fffff640 1 -- start start 2023-11-26T07:18:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.041+0000 7fb9fffff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fba00144b30 0x7fba0015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.041+0000 7fb9fffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba0015c410 0x7fba000b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.041+0000 7fb9fffff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0015bf80 con 0x7fba000b1de0 2023-11-26T07:18:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.041+0000 7fb9fffff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba000b1560 con 0x7fba0015c410 2023-11-26T07:18:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.041+0000 7fb9fffff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba000b0fb0 con 0x7fba00144b30 2023-11-26T07:18:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.041+0000 7fb9fe7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba0015c410 0x7fba000b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.041+0000 7fb9fe7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba0015c410 0x7fba000b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54092/0 (socket says 172.21.15.77:54092) 2023-11-26T07:18:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.041+0000 7fb9fe7fc640 1 -- 172.21.15.77:0/2984281550 learned_addr learned my addr 172.21.15.77:0/2984281550 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.042+0000 7fb9feffd640 1 --2- 172.21.15.77:0/2984281550 >> v2:172.21.15.159:3300/0 conn(0x7fba00144b30 0x7fba0015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.042+0000 7fb9fe7fc640 1 -- 172.21.15.77:0/2984281550 >> v2:172.21.15.159:3300/0 conn(0x7fba00144b30 msgr2=0x7fba0015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:06.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.042+0000 7fb9fe7fc640 1 --2- 172.21.15.77:0/2984281550 >> v2:172.21.15.159:3300/0 conn(0x7fba00144b30 0x7fba0015f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.042+0000 7fb9fe7fc640 1 -- 172.21.15.77:0/2984281550 >> v1:172.21.15.159:6789/0 conn(0x7fba000b1de0 legacy=0x7fba0006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:06.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.042+0000 7fb9fe7fc640 1 -- 172.21.15.77:0/2984281550 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba000b1280 con 0x7fba0015c410 2023-11-26T07:18:06.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.043+0000 7fb9fe7fc640 1 --2- 172.21.15.77:0/2984281550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba0015c410 0x7fba000b0a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba0006f690 tx=0x7fb9f402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0c93c2ab41fb64 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.043+0000 7fb9fdffb640 1 -- 172.21.15.77:0/2984281550 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4031870 con 0x7fba0015c410 2023-11-26T07:18:06.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.044+0000 7fb9fdffb640 1 -- 172.21.15.77:0/2984281550 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f40319d0 con 0x7fba0015c410 2023-11-26T07:18:06.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.044+0000 7fb9fdffb640 1 -- 172.21.15.77:0/2984281550 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4031d60 con 0x7fba0015c410 2023-11-26T07:18:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.044+0000 7fb9fffff640 1 -- 172.21.15.77:0/2984281550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba0015c410 msgr2=0x7fba000b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.044+0000 7fb9fffff640 1 --2- 172.21.15.77:0/2984281550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba0015c410 0x7fba000b0a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba0006f690 tx=0x7fb9f402b910 comp rx=0 tx=0).stop 2023-11-26T07:18:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.044+0000 7fb9fffff640 1 -- 172.21.15.77:0/2984281550 shutdown_connections 2023-11-26T07:18:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.044+0000 7fb9fffff640 1 --2- 172.21.15.77:0/2984281550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba0015c410 0x7fba000b0a70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.044+0000 7fb9fffff640 1 --2- 172.21.15.77:0/2984281550 >> v2:172.21.15.159:3300/0 conn(0x7fba00144b30 0x7fba0015f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.044+0000 7fb9fffff640 1 -- 172.21.15.77:0/2984281550 >> 172.21.15.77:0/2984281550 conn(0x7fba000cb830 msgr2=0x7fba000cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.044+0000 7fb9fffff640 1 -- 172.21.15.77:0/2984281550 shutdown_connections 2023-11-26T07:18:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.044+0000 7fb9fffff640 1 -- 172.21.15.77:0/2984281550 wait complete. 2023-11-26T07:18:06.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.046+0000 7fb9fffff640 1 Processor -- start 2023-11-26T07:18:06.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.046+0000 7fb9fffff640 1 -- start start 2023-11-26T07:18:06.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.047+0000 7fb9fffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba000b1de0 0x7fba001432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.047+0000 7fb9fffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba00144b30 0x7fba00143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.047+0000 7fb9fffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba0015c410 0x7fba001f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.047+0000 7fb9fffff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba001f3c90 con 0x7fba000b1de0 2023-11-26T07:18:06.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.047+0000 7fb9fffff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba001f3080 con 0x7fba0015c410 2023-11-26T07:18:06.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.047+0000 7fb9fffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba001f3360 con 0x7fba00144b30 2023-11-26T07:18:06.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.047+0000 7fb9feffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba000b1de0 0x7fba001432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.047+0000 7fb9feffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba000b1de0 0x7fba001432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54108/0 (socket says 172.21.15.77:54108) 2023-11-26T07:18:06.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.047+0000 7fb9feffd640 1 -- 172.21.15.77:0/3858565598 learned_addr learned my addr 172.21.15.77:0/3858565598 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:06.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.048+0000 7fb9feffd640 1 -- 172.21.15.77:0/3858565598 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba00144b30 msgr2=0x7fba00143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.048+0000 7fb9feffd640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba00144b30 0x7fba00143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.048+0000 7fb9feffd640 1 -- 172.21.15.77:0/3858565598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba0015c410 msgr2=0x7fba001f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.048+0000 7fb9feffd640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba0015c410 0x7fba001f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.048+0000 7fb9feffd640 1 -- 172.21.15.77:0/3858565598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f40094d0 con 0x7fba000b1de0 2023-11-26T07:18:06.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.048+0000 7fb9feffd640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba000b1de0 0x7fba001432f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000d800 tx=0x7fb9f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.048+0000 7fb9e7fff640 1 -- 172.21.15.77:0/3858565598 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f000b6c0 con 0x7fba000b1de0 2023-11-26T07:18:06.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.048+0000 7fb9e7fff640 1 -- 172.21.15.77:0/3858565598 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f000b820 con 0x7fba000b1de0 2023-11-26T07:18:06.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.048+0000 7fb9e7fff640 1 -- 172.21.15.77:0/3858565598 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f000bbb0 con 0x7fba000b1de0 2023-11-26T07:18:06.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.048+0000 7fb9fffff640 1 -- 172.21.15.77:0/3858565598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba001f3640 con 0x7fba000b1de0 2023-11-26T07:18:06.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.049+0000 7fb9fffff640 1 -- 172.21.15.77:0/3858565598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba001f2d30 con 0x7fba000b1de0 2023-11-26T07:18:06.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.050+0000 7fb9fffff640 1 -- 172.21.15.77:0/3858565598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba000b3610 con 0x7fba000b1de0 2023-11-26T07:18:06.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.051+0000 7fb9e7fff640 1 -- 172.21.15.77:0/3858565598 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9f000bd10 con 0x7fba000b1de0 2023-11-26T07:18:06.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.051+0000 7fb9e7fff640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9ec06ae70 0x7fb9ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.052+0000 7fb9e7fff640 1 -- 172.21.15.77:0/3858565598 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9f0089b60 con 0x7fba000b1de0 2023-11-26T07:18:06.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.052+0000 7fb9fe7fc640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9ec06ae70 0x7fb9ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.052+0000 7fb9fe7fc640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9ec06ae70 0x7fb9ec06d330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4036000 tx=0x7fb9f4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.056+0000 7fb9e7fff640 1 -- 172.21.15.77:0/3858565598 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba000b3610 con 0x7fba000b1de0 2023-11-26T07:18:06.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.253+0000 7fb9fffff640 1 -- 172.21.15.77:0/3858565598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba000b3610 con 0x7fba000b1de0 2023-11-26T07:18:06.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.256+0000 7fb9e7fff640 1 -- 172.21.15.77:0/3858565598 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7fba000b3610 con 0x7fba000b1de0 2023-11-26T07:18:06.258 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:06.259 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:36.274387+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.258+0000 7fb9fffff640 1 -- 172.21.15.77:0/3858565598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9ec06ae70 msgr2=0x7fb9ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.258+0000 7fb9fffff640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9ec06ae70 0x7fb9ec06d330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4036000 tx=0x7fb9f4030000 comp rx=0 tx=0).stop 2023-11-26T07:18:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.258+0000 7fb9fffff640 1 -- 172.21.15.77:0/3858565598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba000b1de0 msgr2=0x7fba001432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.258+0000 7fb9fffff640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba000b1de0 0x7fba001432f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000d800 tx=0x7fb9f000dcc0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.259+0000 7fb9fffff640 1 -- 172.21.15.77:0/3858565598 shutdown_connections 2023-11-26T07:18:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.259+0000 7fb9fffff640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9ec06ae70 0x7fb9ec06d330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.259+0000 7fb9fffff640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba0015c410 0x7fba001f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.259+0000 7fb9fffff640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba00144b30 0x7fba00143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.259+0000 7fb9fffff640 1 --2- 172.21.15.77:0/3858565598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba000b1de0 0x7fba001432f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.259+0000 7fb9fffff640 1 -- 172.21.15.77:0/3858565598 >> 172.21.15.77:0/3858565598 conn(0x7fba000cb830 msgr2=0x7fba000b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:06.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.259+0000 7fb9fffff640 1 -- 172.21.15.77:0/3858565598 shutdown_connections 2023-11-26T07:18:06.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.259+0000 7fb9fffff640 1 -- 172.21.15.77:0/3858565598 wait complete. 2023-11-26T07:18:06.280 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:06.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:06.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.494+0000 7f00a2f1d640 1 Processor -- start 2023-11-26T07:18:06.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.494+0000 7f00a2f1d640 1 -- start start 2023-11-26T07:18:06.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.496+0000 7f00a2f1d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f009c15d720 0x7f009c0d3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.496+0000 7f00a2f1d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f009c06ca90 0x7f009c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.496+0000 7f00a2f1d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009c15db00 con 0x7f009c0d3870 2023-11-26T07:18:06.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.496+0000 7f00a2f1d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009c0d3d20 con 0x7f009c15d720 2023-11-26T07:18:06.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.496+0000 7f00a2f1d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0d0ce0 con 0x7f009c06ca90 2023-11-26T07:18:06.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.497+0000 7f00a0cb9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f009c15d720 0x7f009c0d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.497+0000 7f00a14ba640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f009c06ca90 0x7f009c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.497+0000 7f009bfff640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f009c0d3870 0x7f009c0b0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:53920/0 (socket says 172.21.15.77:53920) 2023-11-26T07:18:06.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.497+0000 7f00a14ba640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f009c06ca90 0x7f009c0b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:37994/0 (socket says 172.21.15.77:37994) 2023-11-26T07:18:06.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.497+0000 7f00a0cb9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f009c15d720 0x7f009c0d3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:37420/0 (socket says 172.21.15.77:37420) 2023-11-26T07:18:06.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.497+0000 7f009bfff640 1 -- 172.21.15.77:0/854750531 learned_addr learned my addr 172.21.15.77:0/854750531 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:06.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.497+0000 7f00a14ba640 1 -- 172.21.15.77:0/854750531 >> v2:172.21.15.159:3300/0 conn(0x7f009c15d720 msgr2=0x7f009c0d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:06.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.497+0000 7f00a14ba640 1 --2- 172.21.15.77:0/854750531 >> v2:172.21.15.159:3300/0 conn(0x7f009c15d720 0x7f009c0d3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.497+0000 7f00a14ba640 1 -- 172.21.15.77:0/854750531 >> v1:172.21.15.159:6789/0 conn(0x7f009c0d3870 legacy=0x7f009c0b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.498+0000 7f00a14ba640 1 -- 172.21.15.77:0/854750531 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c06d400 con 0x7f009c06ca90 2023-11-26T07:18:06.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.498+0000 7f00a0cb9640 1 --2- 172.21.15.77:0/854750531 >> v2:172.21.15.159:3300/0 conn(0x7f009c15d720 0x7f009c0d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:06.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.499+0000 7f00a14ba640 1 --2- 172.21.15.77:0/854750531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f009c06ca90 0x7f009c0b15d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0094009d90 tx=0x7f009402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a8974bf627c1781 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.500+0000 7f009b7fe640 1 -- 172.21.15.77:0/854750531 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009402cbc0 con 0x7f009c06ca90 2023-11-26T07:18:06.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.500+0000 7f009b7fe640 1 -- 172.21.15.77:0/854750531 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009402cd20 con 0x7f009c06ca90 2023-11-26T07:18:06.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.500+0000 7f009b7fe640 1 -- 172.21.15.77:0/854750531 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094034660 con 0x7f009c06ca90 2023-11-26T07:18:06.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.501+0000 7f00a2f1d640 1 -- 172.21.15.77:0/854750531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f009c06ca90 msgr2=0x7f009c0b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.501+0000 7f00a2f1d640 1 --2- 172.21.15.77:0/854750531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f009c06ca90 0x7f009c0b15d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0094009d90 tx=0x7f009402be10 comp rx=0 tx=0).stop 2023-11-26T07:18:06.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.501+0000 7f00a2f1d640 1 -- 172.21.15.77:0/854750531 shutdown_connections 2023-11-26T07:18:06.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.501+0000 7f00a2f1d640 1 --2- 172.21.15.77:0/854750531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f009c06ca90 0x7f009c0b15d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.501+0000 7f00a2f1d640 1 --2- 172.21.15.77:0/854750531 >> v2:172.21.15.159:3300/0 conn(0x7f009c15d720 0x7f009c0d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.501+0000 7f00a2f1d640 1 -- 172.21.15.77:0/854750531 >> 172.21.15.77:0/854750531 conn(0x7f009c08af60 msgr2=0x7f009c09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:06.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.501+0000 7f00a2f1d640 1 -- 172.21.15.77:0/854750531 shutdown_connections 2023-11-26T07:18:06.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.501+0000 7f00a2f1d640 1 -- 172.21.15.77:0/854750531 wait complete. 2023-11-26T07:18:06.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.503+0000 7f00a2f1d640 1 Processor -- start 2023-11-26T07:18:06.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.503+0000 7f00a2f1d640 1 -- start start 2023-11-26T07:18:06.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.504+0000 7f00a2f1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c06ca90 0x7f009c151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.504+0000 7f00a2f1d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f009c0d3870 0x7f009c15dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.504+0000 7f00a2f1d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f009c15d720 0x7f009c15e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.504+0000 7f00a2f1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c152060 con 0x7f009c06ca90 2023-11-26T07:18:06.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.504+0000 7f00a2f1d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0c97d0 con 0x7f009c15d720 2023-11-26T07:18:06.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.504+0000 7f00a2f1d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0c94f0 con 0x7f009c0d3870 2023-11-26T07:18:06.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.505+0000 7f00a0cb9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c06ca90 0x7f009c151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.505+0000 7f00a0cb9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c06ca90 0x7f009c151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54114/0 (socket says 172.21.15.77:54114) 2023-11-26T07:18:06.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.505+0000 7f00a0cb9640 1 -- 172.21.15.77:0/3472535645 learned_addr learned my addr 172.21.15.77:0/3472535645 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.505+0000 7f00a14ba640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f009c15d720 0x7f009c15e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.505+0000 7f00a0cb9640 1 -- 172.21.15.77:0/3472535645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f009c0d3870 msgr2=0x7f009c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.505+0000 7f00a0cb9640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f009c0d3870 0x7f009c15dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.505+0000 7f00a0cb9640 1 -- 172.21.15.77:0/3472535645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f009c15d720 msgr2=0x7f009c15e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.505+0000 7f00a0cb9640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f009c15d720 0x7f009c15e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.505+0000 7f00a0cb9640 1 -- 172.21.15.77:0/3472535645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0090009400 con 0x7f009c06ca90 2023-11-26T07:18:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.505+0000 7f00a0cb9640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c06ca90 0x7f009c151b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f009000ebe0 tx=0x7f009000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.506+0000 7f00997fa640 1 -- 172.21.15.77:0/3472535645 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090009760 con 0x7f009c06ca90 2023-11-26T07:18:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.506+0000 7f00997fa640 1 -- 172.21.15.77:0/3472535645 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009000cc30 con 0x7f009c06ca90 2023-11-26T07:18:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.506+0000 7f00997fa640 1 -- 172.21.15.77:0/3472535645 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000eee0 con 0x7f009c06ca90 2023-11-26T07:18:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.506+0000 7f00a2f1d640 1 -- 172.21.15.77:0/3472535645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0094009a70 con 0x7f009c06ca90 2023-11-26T07:18:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.506+0000 7f00a2f1d640 1 -- 172.21.15.77:0/3472535645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009c15f020 con 0x7f009c06ca90 2023-11-26T07:18:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.507+0000 7f00a2f1d640 1 -- 172.21.15.77:0/3472535645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009c0b3ad0 con 0x7f009c06ca90 2023-11-26T07:18:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.508+0000 7f00997fa640 1 -- 172.21.15.77:0/3472535645 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0090013470 con 0x7f009c06ca90 2023-11-26T07:18:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.509+0000 7f00997fa640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f008006ae40 0x7f008006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.509+0000 7f00997fa640 1 -- 172.21.15.77:0/3472535645 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0090089870 con 0x7f009c06ca90 2023-11-26T07:18:06.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.509+0000 7f009bfff640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f008006ae40 0x7f008006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.510+0000 7f009bfff640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f008006ae40 0x7f008006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f009c0ca410 tx=0x7f0088007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.514+0000 7f00997fa640 1 -- 172.21.15.77:0/3472535645 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f00900549b0 con 0x7f009c06ca90 2023-11-26T07:18:06.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.703+0000 7f00a2f1d640 1 -- 172.21.15.77:0/3472535645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f009c04e8b0 con 0x7f009c06ca90 2023-11-26T07:18:06.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.704+0000 7f00997fa640 1 -- 172.21.15.77:0/3472535645 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0090057fd0 con 0x7f009c06ca90 2023-11-26T07:18:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:18:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.706+0000 7f00a2f1d640 1 -- 172.21.15.77:0/3472535645 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f008006ae40 msgr2=0x7f008006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.706+0000 7f00a2f1d640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f008006ae40 0x7f008006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f009c0ca410 tx=0x7f0088007a40 comp rx=0 tx=0).stop 2023-11-26T07:18:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.706+0000 7f00a2f1d640 1 -- 172.21.15.77:0/3472535645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c06ca90 msgr2=0x7f009c151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.706+0000 7f00a2f1d640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c06ca90 0x7f009c151b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f009000ebe0 tx=0x7f009000c520 comp rx=0 tx=0).stop 2023-11-26T07:18:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.706+0000 7f00a2f1d640 1 -- 172.21.15.77:0/3472535645 shutdown_connections 2023-11-26T07:18:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.707+0000 7f00a2f1d640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f008006ae40 0x7f008006d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.707+0000 7f00a2f1d640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f009c15d720 0x7f009c15e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.707+0000 7f00a2f1d640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f009c0d3870 0x7f009c15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.707+0000 7f00a2f1d640 1 --2- 172.21.15.77:0/3472535645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c06ca90 0x7f009c151b20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.707+0000 7f00a2f1d640 1 -- 172.21.15.77:0/3472535645 >> 172.21.15.77:0/3472535645 conn(0x7f009c08af60 msgr2=0x7f009c0b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:06.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.707+0000 7f00a2f1d640 1 -- 172.21.15.77:0/3472535645 shutdown_connections 2023-11-26T07:18:06.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.707+0000 7f00a2f1d640 1 -- 172.21.15.77:0/3472535645 wait complete. 2023-11-26T07:18:06.727 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:06.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.921+0000 7f3790d73640 1 Processor -- start 2023-11-26T07:18:06.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.921+0000 7f3790d73640 1 -- start start 2023-11-26T07:18:06.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.922+0000 7f3790d73640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f378c15d3f0 0x7f378c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.923+0000 7f3790d73640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f378c0d0e40 0x7f378c0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.923+0000 7f3790d73640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378c0d15e0 con 0x7f378c15d7d0 2023-11-26T07:18:06.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.923+0000 7f3790d73640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378c0d0280 con 0x7f378c0d0e40 2023-11-26T07:18:06.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.923+0000 7f3790d73640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0d1300 con 0x7f378c15d3f0 2023-11-26T07:18:06.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.923+0000 7f378bfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f378c0d0e40 0x7f378c0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.923+0000 7f378b7fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f378c15d3f0 0x7f378c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.923+0000 7f378bfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f378c0d0e40 0x7f378c0d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:37438/0 (socket says 172.21.15.77:37438) 2023-11-26T07:18:06.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.923+0000 7f378bfff640 1 -- 172.21.15.77:0/1882679801 learned_addr learned my addr 172.21.15.77:0/1882679801 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:06.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.924+0000 7f378b7fe640 1 -- 172.21.15.77:0/1882679801 >> v2:172.21.15.159:3300/0 conn(0x7f378c0d0e40 msgr2=0x7f378c0d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:06.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.924+0000 7f378b7fe640 1 --2- 172.21.15.77:0/1882679801 >> v2:172.21.15.159:3300/0 conn(0x7f378c0d0e40 0x7f378c0d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.924+0000 7f378b7fe640 1 -- 172.21.15.77:0/1882679801 >> v1:172.21.15.159:6789/0 conn(0x7f378c15d7d0 legacy=0x7f378c0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.924+0000 7f378b7fe640 1 -- 172.21.15.77:0/1882679801 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c0cfc30 con 0x7f378c15d3f0 2023-11-26T07:18:06.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.924+0000 7f378bfff640 1 --2- 172.21.15.77:0/1882679801 >> v2:172.21.15.159:3300/0 conn(0x7f378c0d0e40 0x7f378c0d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:06.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.925+0000 7f378b7fe640 1 --2- 172.21.15.77:0/1882679801 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f378c15d3f0 0x7f378c0d1830 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f377c0097a0 tx=0x7f377c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61a8d2339e5ec9ce server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.926+0000 7f378affd640 1 -- 172.21.15.77:0/1882679801 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c02d040 con 0x7f378c15d3f0 2023-11-26T07:18:06.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.926+0000 7f378affd640 1 -- 172.21.15.77:0/1882679801 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c031810 con 0x7f378c15d3f0 2023-11-26T07:18:06.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.926+0000 7f378affd640 1 -- 172.21.15.77:0/1882679801 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c031ba0 con 0x7f378c15d3f0 2023-11-26T07:18:06.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.926+0000 7f3790d73640 1 -- 172.21.15.77:0/1882679801 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f378c15d3f0 msgr2=0x7f378c0d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.926+0000 7f3790d73640 1 --2- 172.21.15.77:0/1882679801 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f378c15d3f0 0x7f378c0d1830 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f377c0097a0 tx=0x7f377c02b8b0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.926+0000 7f3790d73640 1 -- 172.21.15.77:0/1882679801 shutdown_connections 2023-11-26T07:18:06.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.926+0000 7f3790d73640 1 --2- 172.21.15.77:0/1882679801 >> v2:172.21.15.159:3300/0 conn(0x7f378c0d0e40 0x7f378c0d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.926+0000 7f3790d73640 1 --2- 172.21.15.77:0/1882679801 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f378c15d3f0 0x7f378c0d1830 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.926+0000 7f3790d73640 1 -- 172.21.15.77:0/1882679801 >> 172.21.15.77:0/1882679801 conn(0x7f378c09c5b0 msgr2=0x7f378c0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:06.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.926+0000 7f3790d73640 1 -- 172.21.15.77:0/1882679801 shutdown_connections 2023-11-26T07:18:06.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.926+0000 7f3790d73640 1 -- 172.21.15.77:0/1882679801 wait complete. 2023-11-26T07:18:06.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.928+0000 7f3790d73640 1 Processor -- start 2023-11-26T07:18:06.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.928+0000 7f3790d73640 1 -- start start 2023-11-26T07:18:06.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.929+0000 7f3790d73640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f378c0d0e40 0x7f378c14d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.929+0000 7f3790d73640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f378c15d3f0 0x7f378c0b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.929+0000 7f3790d73640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c15d7d0 0x7f378c0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.929+0000 7f3790d73640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0c8b70 con 0x7f378c15d7d0 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.929+0000 7f3790d73640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0c8e50 con 0x7f378c15d3f0 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.929+0000 7f3790d73640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0c9130 con 0x7f378c0d0e40 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.930+0000 7f378bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c15d7d0 0x7f378c0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.930+0000 7f378bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c15d7d0 0x7f378c0b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54120/0 (socket says 172.21.15.77:54120) 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.930+0000 7f378bfff640 1 -- 172.21.15.77:0/768520131 learned_addr learned my addr 172.21.15.77:0/768520131 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.930+0000 7f3783fff640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f378c15d3f0 0x7f378c0b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.930+0000 7f378b7fe640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f378c0d0e40 0x7f378c14d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.930+0000 7f378bfff640 1 -- 172.21.15.77:0/768520131 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f378c0d0e40 msgr2=0x7f378c14d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.930+0000 7f378bfff640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f378c0d0e40 0x7f378c14d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.930+0000 7f378bfff640 1 -- 172.21.15.77:0/768520131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f378c15d3f0 msgr2=0x7f378c0b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.930+0000 7f378bfff640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f378c15d3f0 0x7f378c0b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.930+0000 7f378bfff640 1 -- 172.21.15.77:0/768520131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784009b30 con 0x7f378c15d7d0 2023-11-26T07:18:06.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.930+0000 7f378bfff640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c15d7d0 0x7f378c0b63d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f378400efc0 tx=0x7f378400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.931+0000 7f3788ff9640 1 -- 172.21.15.77:0/768520131 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400cdc0 con 0x7f378c15d7d0 2023-11-26T07:18:06.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.931+0000 7f3788ff9640 1 -- 172.21.15.77:0/768520131 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378400f040 con 0x7f378c15d7d0 2023-11-26T07:18:06.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.931+0000 7f3790d73640 1 -- 172.21.15.77:0/768520131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c009400 con 0x7f378c15d7d0 2023-11-26T07:18:06.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.931+0000 7f3788ff9640 1 -- 172.21.15.77:0/768520131 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37840146c0 con 0x7f378c15d7d0 2023-11-26T07:18:06.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.931+0000 7f3790d73640 1 -- 172.21.15.77:0/768520131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378c0c96f0 con 0x7f378c15d7d0 2023-11-26T07:18:06.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.932+0000 7f3790d73640 1 -- 172.21.15.77:0/768520131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378c0d06f0 con 0x7f378c15d7d0 2023-11-26T07:18:06.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.934+0000 7f3788ff9640 1 -- 172.21.15.77:0/768520131 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3784014820 con 0x7f378c15d7d0 2023-11-26T07:18:06.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.935+0000 7f3788ff9640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f376c06ae40 0x7f376c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.935+0000 7f3788ff9640 1 -- 172.21.15.77:0/768520131 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3784089fa0 con 0x7f378c15d7d0 2023-11-26T07:18:06.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.935+0000 7f378b7fe640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f376c06ae40 0x7f376c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.936+0000 7f378b7fe640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f376c06ae40 0x7f376c06d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f377c036000 tx=0x7f377c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:06.940+0000 7f3788ff9640 1 -- 172.21.15.77:0/768520131 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37840bce90 con 0x7f378c15d7d0 2023-11-26T07:18:07.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.122+0000 7f3790d73640 1 -- 172.21.15.77:0/768520131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f378c0b3800 con 0x7f378c15d7d0 2023-11-26T07:18:07.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.123+0000 7f3788ff9640 1 -- 172.21.15.77:0/768520131 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f378c0b3800 con 0x7f378c15d7d0 2023-11-26T07:18:07.126 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:18:07.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.125+0000 7f3790d73640 1 -- 172.21.15.77:0/768520131 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f376c06ae40 msgr2=0x7f376c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.125+0000 7f3790d73640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f376c06ae40 0x7f376c06d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f377c036000 tx=0x7f377c03c040 comp rx=0 tx=0).stop 2023-11-26T07:18:07.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.125+0000 7f3790d73640 1 -- 172.21.15.77:0/768520131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c15d7d0 msgr2=0x7f378c0b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.125+0000 7f3790d73640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c15d7d0 0x7f378c0b63d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f378400efc0 tx=0x7f378400c490 comp rx=0 tx=0).stop 2023-11-26T07:18:07.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.126+0000 7f3790d73640 1 -- 172.21.15.77:0/768520131 shutdown_connections 2023-11-26T07:18:07.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.126+0000 7f3790d73640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f376c06ae40 0x7f376c06d300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.126+0000 7f3790d73640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c15d7d0 0x7f378c0b63d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.126+0000 7f3790d73640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f378c15d3f0 0x7f378c0b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.126+0000 7f3790d73640 1 --2- 172.21.15.77:0/768520131 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f378c0d0e40 0x7f378c14d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.126+0000 7f3790d73640 1 -- 172.21.15.77:0/768520131 >> 172.21.15.77:0/768520131 conn(0x7f378c09c5b0 msgr2=0x7f378c160490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:07.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.126+0000 7f3790d73640 1 -- 172.21.15.77:0/768520131 shutdown_connections 2023-11-26T07:18:07.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.126+0000 7f3790d73640 1 -- 172.21.15.77:0/768520131 wait complete. 2023-11-26T07:18:07.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:07.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.340+0000 7f92bcb99640 1 Processor -- start 2023-11-26T07:18:07.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.341+0000 7f92bcb99640 1 -- start start 2023-11-26T07:18:07.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.342+0000 7f92bcb99640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f92b815b260 0x7f92b806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.342+0000 7f92bcb99640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b815ed20 con 0x7f92b806e580 2023-11-26T07:18:07.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.342+0000 7f92bcb99640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b815f8a0 con 0x7f92b80b1250 2023-11-26T07:18:07.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.342+0000 7f92bcb99640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b815b640 con 0x7f92b815b260 2023-11-26T07:18:07.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.342+0000 7f92b6ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f92b806e580 0x7f92b80b0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49732/0 (socket says 172.21.15.77:49732) 2023-11-26T07:18:07.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.342+0000 7f92b6ffd640 1 -- 172.21.15.77:0/1512636425 learned_addr learned my addr 172.21.15.77:0/1512636425 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b77fe640 1 --2- 172.21.15.77:0/1512636425 >> v2:172.21.15.159:3300/0 conn(0x7f92b815b260 0x7f92b806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349921087 0 0) 0x7f92b815ed20 con 0x7f92b806e580 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92a0003520 con 0x7f92b806e580 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1568683035 0 0) 0x7f92a0003520 con 0x7f92b806e580 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 >> v2:172.21.15.159:3300/0 conn(0x7f92b815b260 msgr2=0x7f92b806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 --2- 172.21.15.77:0/1512636425 >> v2:172.21.15.159:3300/0 conn(0x7f92b815b260 0x7f92b806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 >> v1:172.21.15.159:6789/0 conn(0x7f92b80b1250 legacy=0x7f92b806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b80abe50 con 0x7f92b806e580 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f92ac001670 con 0x7f92b806e580 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 >> v1:172.21.15.77:6789/0 conn(0x7f92b806e580 legacy=0x7f92b80b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 --2- 172.21.15.77:0/1512636425 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92a00039c0 0x7f92a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 --2- 172.21.15.77:0/1512636425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00047c0 0x7f92a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 --2- 172.21.15.77:0/1512636425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a0005380 0x7f92a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b815b640 con 0x7f92a0005380 2023-11-26T07:18:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a000c260 con 0x7f92a00047c0 2023-11-26T07:18:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.343+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a000c420 con 0x7f92a00039c0 2023-11-26T07:18:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.344+0000 7f92b7fff640 1 --2- 172.21.15.77:0/1512636425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a0005380 0x7f92a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.344+0000 7f92b7fff640 1 -- 172.21.15.77:0/1512636425 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92a00039c0 msgr2=0x7f92a0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.344+0000 7f92b7fff640 1 --2- 172.21.15.77:0/1512636425 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92a00039c0 0x7f92a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.344+0000 7f92b7fff640 1 -- 172.21.15.77:0/1512636425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00047c0 msgr2=0x7f92a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.344+0000 7f92b7fff640 1 --2- 172.21.15.77:0/1512636425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a00047c0 0x7f92a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.344+0000 7f92b7fff640 1 -- 172.21.15.77:0/1512636425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a0003520 con 0x7f92a0005380 2023-11-26T07:18:07.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.345+0000 7f92b7fff640 1 -- 172.21.15.77:0/1512636425 reap_dead start 2023-11-26T07:18:07.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.345+0000 7f92b7fff640 1 --2- 172.21.15.77:0/1512636425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a0005380 0x7f92a000b980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f92b0001e20 tx=0x7f92a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9955a9a4a894e186 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.345+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0003b70 con 0x7f92a0005380 2023-11-26T07:18:07.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.345+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b0003cd0 con 0x7f92a0005380 2023-11-26T07:18:07.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.345+0000 7f92b67fc640 1 -- 172.21.15.77:0/1512636425 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0005310 con 0x7f92a0005380 2023-11-26T07:18:07.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.346+0000 7f92bcb99640 1 -- 172.21.15.77:0/1512636425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a0005380 msgr2=0x7f92a000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.346+0000 7f92bcb99640 1 --2- 172.21.15.77:0/1512636425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a0005380 0x7f92a000b980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f92b0001e20 tx=0x7f92a00057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.346+0000 7f92bcb99640 1 -- 172.21.15.77:0/1512636425 shutdown_connections 2023-11-26T07:18:07.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.346+0000 7f92bcb99640 1 --2- 172.21.15.77:0/1512636425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a0005380 0x7f92a000b980 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.346+0000 7f92bcb99640 1 -- 172.21.15.77:0/1512636425 >> 172.21.15.77:0/1512636425 conn(0x7f92b80cbb40 msgr2=0x7f92b80cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:07.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.346+0000 7f92bcb99640 1 -- 172.21.15.77:0/1512636425 shutdown_connections 2023-11-26T07:18:07.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.346+0000 7f92bcb99640 1 -- 172.21.15.77:0/1512636425 wait complete. 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.347+0000 7f92bcb99640 1 Processor -- start 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.348+0000 7f92bcb99640 1 -- start start 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.348+0000 7f92bcb99640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a0005380 0x7f92b81566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.348+0000 7f92bcb99640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b80cf9e0 0x7f92b81f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.348+0000 7f92bcb99640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92b81f4770 0x7f92b81f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92bcb99640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b8156c10 con 0x7f92b80cf9e0 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92bcb99640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b809b5d0 con 0x7f92a0005380 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92bcb99640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b809b8b0 con 0x7f92b81f4770 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92b6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b80cf9e0 0x7f92b81f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92b6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b80cf9e0 0x7f92b81f4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54132/0 (socket says 172.21.15.77:54132) 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92b6ffd640 1 -- 172.21.15.77:0/3790002777 learned_addr learned my addr 172.21.15.77:0/3790002777 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92b77fe640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a0005380 0x7f92b81566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92b6ffd640 1 -- 172.21.15.77:0/3790002777 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92b81f4770 msgr2=0x7f92b81f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92b6ffd640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92b81f4770 0x7f92b81f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92b6ffd640 1 -- 172.21.15.77:0/3790002777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a0005380 msgr2=0x7f92b81566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92b6ffd640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a0005380 0x7f92b81566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92b6ffd640 1 -- 172.21.15.77:0/3790002777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b809bb90 con 0x7f92b80cf9e0 2023-11-26T07:18:07.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.349+0000 7f92b6ffd640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b80cf9e0 0x7f92b81f4230 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c730 tx=0x7f92ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.350+0000 7f929ffff640 1 -- 172.21.15.77:0/3790002777 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0072d0 con 0x7f92b80cf9e0 2023-11-26T07:18:07.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.350+0000 7f929ffff640 1 -- 172.21.15.77:0/3790002777 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac007430 con 0x7f92b80cf9e0 2023-11-26T07:18:07.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.350+0000 7f92bcb99640 1 -- 172.21.15.77:0/3790002777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b809be70 con 0x7f92b80cf9e0 2023-11-26T07:18:07.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.350+0000 7f929ffff640 1 -- 172.21.15.77:0/3790002777 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0047e0 con 0x7f92b80cf9e0 2023-11-26T07:18:07.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.350+0000 7f92bcb99640 1 -- 172.21.15.77:0/3790002777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b80cfe60 con 0x7f92b80cf9e0 2023-11-26T07:18:07.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.351+0000 7f92bcb99640 1 -- 172.21.15.77:0/3790002777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b809c390 con 0x7f92b80cf9e0 2023-11-26T07:18:07.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.353+0000 7f929ffff640 1 -- 172.21.15.77:0/3790002777 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f92ac004b50 con 0x7f92b80cf9e0 2023-11-26T07:18:07.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.354+0000 7f929ffff640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92a406ae70 0x7f92a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.354+0000 7f929ffff640 1 -- 172.21.15.77:0/3790002777 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92ac088ff0 con 0x7f92b80cf9e0 2023-11-26T07:18:07.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.354+0000 7f92b77fe640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92a406ae70 0x7f92a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.355+0000 7f92b77fe640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92a406ae70 0x7f92a406d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92a8006a90 tx=0x7f92a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.358+0000 7f929ffff640 1 -- 172.21.15.77:0/3790002777 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92ac0bbe90 con 0x7f92b80cf9e0 2023-11-26T07:18:07.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.546+0000 7f92bcb99640 1 -- 172.21.15.77:0/3790002777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f92b804e840 con 0x7f92b80cf9e0 2023-11-26T07:18:07.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.547+0000 7f929ffff640 1 -- 172.21.15.77:0/3790002777 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f92ac0180a0 con 0x7f92b80cf9e0 2023-11-26T07:18:07.550 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:18:07.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.549+0000 7f92bcb99640 1 -- 172.21.15.77:0/3790002777 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92a406ae70 msgr2=0x7f92a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.549+0000 7f92bcb99640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92a406ae70 0x7f92a406d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92a8006a90 tx=0x7f92a8008040 comp rx=0 tx=0).stop 2023-11-26T07:18:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.550+0000 7f92bcb99640 1 -- 172.21.15.77:0/3790002777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b80cf9e0 msgr2=0x7f92b81f4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.550+0000 7f92bcb99640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b80cf9e0 0x7f92b81f4230 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c730 tx=0x7f92ac00cbf0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.550+0000 7f92bcb99640 1 -- 172.21.15.77:0/3790002777 shutdown_connections 2023-11-26T07:18:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.550+0000 7f92bcb99640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92a406ae70 0x7f92a406d330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.550+0000 7f92bcb99640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92b81f4770 0x7f92b81f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.550+0000 7f92bcb99640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b80cf9e0 0x7f92b81f4230 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.550+0000 7f92bcb99640 1 --2- 172.21.15.77:0/3790002777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92a0005380 0x7f92b81566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.550+0000 7f92bcb99640 1 -- 172.21.15.77:0/3790002777 >> 172.21.15.77:0/3790002777 conn(0x7f92b80cbb40 msgr2=0x7f92b80b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.550+0000 7f92bcb99640 1 -- 172.21.15.77:0/3790002777 shutdown_connections 2023-11-26T07:18:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.550+0000 7f92bcb99640 1 -- 172.21.15.77:0/3790002777 wait complete. 2023-11-26T07:18:07.570 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:07.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.785+0000 7f9ed759e640 1 Processor -- start 2023-11-26T07:18:07.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.785+0000 7f9ed759e640 1 -- start start 2023-11-26T07:18:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.787+0000 7f9ed759e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ed80b24f0 0x7f9ed815f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.787+0000 7f9ed759e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed815bf80 con 0x7f9ed8144b30 2023-11-26T07:18:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.787+0000 7f9ed759e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed80b1560 con 0x7f9ed815c410 2023-11-26T07:18:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.787+0000 7f9ed759e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed80b1280 con 0x7f9ed80b24f0 2023-11-26T07:18:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.787+0000 7f9ed659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9ed8144b30 0x7f9ed80b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49746/0 (socket says 172.21.15.77:49746) 2023-11-26T07:18:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.787+0000 7f9ed659c640 1 -- 172.21.15.77:0/2380428179 learned_addr learned my addr 172.21.15.77:0/2380428179 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.787+0000 7f9ed6d9d640 1 --2- 172.21.15.77:0/2380428179 >> v2:172.21.15.77:3300/0 conn(0x7f9ed80b24f0 0x7f9ed815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.788+0000 7f9ed6d9d640 1 -- 172.21.15.77:0/2380428179 >> v1:172.21.15.159:6789/0 conn(0x7f9ed815c410 legacy=0x7f9ed80b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:07.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.788+0000 7f9ed6d9d640 1 -- 172.21.15.77:0/2380428179 >> v1:172.21.15.77:6789/0 conn(0x7f9ed8144b30 legacy=0x7f9ed80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.788+0000 7f9ed6d9d640 1 -- 172.21.15.77:0/2380428179 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed815b930 con 0x7f9ed80b24f0 2023-11-26T07:18:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.789+0000 7f9ed6d9d640 1 --2- 172.21.15.77:0/2380428179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed80b24f0 0x7f9ed815f920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009d90 tx=0x7f9ed002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d766d1bde110485c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.789+0000 7f9ed559a640 1 -- 172.21.15.77:0/2380428179 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed002cc60 con 0x7f9ed80b24f0 2023-11-26T07:18:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.789+0000 7f9ed559a640 1 -- 172.21.15.77:0/2380428179 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed002cdc0 con 0x7f9ed80b24f0 2023-11-26T07:18:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.789+0000 7f9ed559a640 1 -- 172.21.15.77:0/2380428179 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0034660 con 0x7f9ed80b24f0 2023-11-26T07:18:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.790+0000 7f9ed759e640 1 -- 172.21.15.77:0/2380428179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed80b24f0 msgr2=0x7f9ed815f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.790+0000 7f9ed759e640 1 --2- 172.21.15.77:0/2380428179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed80b24f0 0x7f9ed815f920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009d90 tx=0x7f9ed002beb0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.790+0000 7f9ed759e640 1 -- 172.21.15.77:0/2380428179 shutdown_connections 2023-11-26T07:18:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.790+0000 7f9ed759e640 1 --2- 172.21.15.77:0/2380428179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed80b24f0 0x7f9ed815f920 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.790+0000 7f9ed759e640 1 -- 172.21.15.77:0/2380428179 >> 172.21.15.77:0/2380428179 conn(0x7f9ed80cb830 msgr2=0x7f9ed80cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.790+0000 7f9ed759e640 1 -- 172.21.15.77:0/2380428179 shutdown_connections 2023-11-26T07:18:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.790+0000 7f9ed759e640 1 -- 172.21.15.77:0/2380428179 wait complete. 2023-11-26T07:18:07.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.792+0000 7f9ed759e640 1 Processor -- start 2023-11-26T07:18:07.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.793+0000 7f9ed759e640 1 -- start start 2023-11-26T07:18:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.794+0000 7f9ed759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ed80b24f0 0x7f9ed815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.794+0000 7f9ed759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ed8144b30 0x7f9ed815a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.794+0000 7f9ed759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed815c410 0x7f9ed81f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.794+0000 7f9ed759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed815aea0 con 0x7f9ed815c410 2023-11-26T07:18:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.794+0000 7f9ed759e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed8136680 con 0x7f9ed80b24f0 2023-11-26T07:18:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.794+0000 7f9ed759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed81343a0 con 0x7f9ed8144b30 2023-11-26T07:18:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.794+0000 7f9ed6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed815c410 0x7f9ed81f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.794+0000 7f9ed6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed815c410 0x7f9ed81f1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54142/0 (socket says 172.21.15.77:54142) 2023-11-26T07:18:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.794+0000 7f9ed6d9d640 1 -- 172.21.15.77:0/1239005126 learned_addr learned my addr 172.21.15.77:0/1239005126 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.794+0000 7f9ed659c640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ed80b24f0 0x7f9ed815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.795+0000 7f9ed5d9b640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ed8144b30 0x7f9ed815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.795+0000 7f9ed6d9d640 1 -- 172.21.15.77:0/1239005126 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ed8144b30 msgr2=0x7f9ed815a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.795+0000 7f9ed6d9d640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ed8144b30 0x7f9ed815a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.795+0000 7f9ed6d9d640 1 -- 172.21.15.77:0/1239005126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ed80b24f0 msgr2=0x7f9ed815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.795+0000 7f9ed6d9d640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ed80b24f0 0x7f9ed815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.795+0000 7f9ed6d9d640 1 -- 172.21.15.77:0/1239005126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed0009a70 con 0x7f9ed815c410 2023-11-26T07:18:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.795+0000 7f9ed6d9d640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed815c410 0x7f9ed81f1400 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009eb0 tx=0x7f9ed0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.795+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/1239005126 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed003e610 con 0x7f9ed815c410 2023-11-26T07:18:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.795+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/1239005126 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed003e770 con 0x7f9ed815c410 2023-11-26T07:18:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.795+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/1239005126 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed003eb20 con 0x7f9ed815c410 2023-11-26T07:18:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.795+0000 7f9ed759e640 1 -- 172.21.15.77:0/1239005126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed8134680 con 0x7f9ed815c410 2023-11-26T07:18:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.796+0000 7f9ed759e640 1 -- 172.21.15.77:0/1239005126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed8134c40 con 0x7f9ed815c410 2023-11-26T07:18:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.797+0000 7f9ed759e640 1 -- 172.21.15.77:0/1239005126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed80b16f0 con 0x7f9ed815c410 2023-11-26T07:18:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.798+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/1239005126 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ed003b050 con 0x7f9ed815c410 2023-11-26T07:18:07.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.798+0000 7f9ec6ffd640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9eb806ae40 0x7f9eb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.798+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/1239005126 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ed00ab9c0 con 0x7f9ed815c410 2023-11-26T07:18:07.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.799+0000 7f9ed659c640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9eb806ae40 0x7f9eb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.799+0000 7f9ed659c640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9eb806ae40 0x7f9eb806d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8165fe0 tx=0x7f9ec8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.804+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/1239005126 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ed0076ba0 con 0x7f9ed815c410 2023-11-26T07:18:07.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.996+0000 7f9ed759e640 1 -- 172.21.15.77:0/1239005126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ed804e840 con 0x7f9ed815c410 2023-11-26T07:18:08.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:07.999+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/1239005126 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f9ed0039090 con 0x7f9ed815c410 2023-11-26T07:18:08.002 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:08.002 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:36.274387+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:08.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.001+0000 7f9ed759e640 1 -- 172.21.15.77:0/1239005126 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9eb806ae40 msgr2=0x7f9eb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.001+0000 7f9ed759e640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9eb806ae40 0x7f9eb806d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8165fe0 tx=0x7f9ec8009040 comp rx=0 tx=0).stop 2023-11-26T07:18:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.001+0000 7f9ed759e640 1 -- 172.21.15.77:0/1239005126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed815c410 msgr2=0x7f9ed81f1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.001+0000 7f9ed759e640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed815c410 0x7f9ed81f1400 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009eb0 tx=0x7f9ed0004a40 comp rx=0 tx=0).stop 2023-11-26T07:18:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.002+0000 7f9ed759e640 1 -- 172.21.15.77:0/1239005126 shutdown_connections 2023-11-26T07:18:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.002+0000 7f9ed759e640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9eb806ae40 0x7f9eb806d300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.002+0000 7f9ed759e640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed815c410 0x7f9ed81f1400 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.002+0000 7f9ed759e640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ed8144b30 0x7f9ed815a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.002+0000 7f9ed759e640 1 --2- 172.21.15.77:0/1239005126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ed80b24f0 0x7f9ed815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.002+0000 7f9ed759e640 1 -- 172.21.15.77:0/1239005126 >> 172.21.15.77:0/1239005126 conn(0x7f9ed80cb830 msgr2=0x7f9ed8138d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.002+0000 7f9ed759e640 1 -- 172.21.15.77:0/1239005126 shutdown_connections 2023-11-26T07:18:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.002+0000 7f9ed759e640 1 -- 172.21.15.77:0/1239005126 wait complete. 2023-11-26T07:18:08.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:08.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:08.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.226+0000 7ff8398cf640 1 Processor -- start 2023-11-26T07:18:08.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.226+0000 7ff8398cf640 1 -- start start 2023-11-26T07:18:08.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.227+0000 7ff8398cf640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8340cc0f0 0x7ff8340c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.227+0000 7ff8398cf640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83415eea0 con 0x7ff8340c57e0 2023-11-26T07:18:08.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.227+0000 7ff8398cf640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8340abf30 con 0x7ff83415b440 2023-11-26T07:18:08.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.227+0000 7ff8398cf640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83415b820 con 0x7ff8340cc0f0 2023-11-26T07:18:08.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.228+0000 7ff8337fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff8340c57e0 0x7ff83406c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49754/0 (socket says 172.21.15.77:49754) 2023-11-26T07:18:08.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.228+0000 7ff8337fe640 1 -- 172.21.15.77:0/2666291960 learned_addr learned my addr 172.21.15.77:0/2666291960 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:08.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.228+0000 7ff8327fc640 1 --2- 172.21.15.77:0/2666291960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8340cc0f0 0x7ff8340c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.228+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115941192 0 0) 0x7ff83415eea0 con 0x7ff8340c57e0 2023-11-26T07:18:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.228+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff81c003520 con 0x7ff8340c57e0 2023-11-26T07:18:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.228+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1748481150 0 0) 0x7ff81c003520 con 0x7ff8340c57e0 2023-11-26T07:18:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8340cc0f0 msgr2=0x7ff8340c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 --2- 172.21.15.77:0/2666291960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8340cc0f0 0x7ff8340c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 >> v1:172.21.15.159:6789/0 conn(0x7ff83415b440 legacy=0x7ff8340cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83415f0f0 con 0x7ff8340c57e0 2023-11-26T07:18:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7ff82c0019f0 con 0x7ff8340c57e0 2023-11-26T07:18:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 >> v1:172.21.15.77:6789/0 conn(0x7ff8340c57e0 legacy=0x7ff83406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 --2- 172.21.15.77:0/2666291960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff81c0039a0 0x7ff81c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 --2- 172.21.15.77:0/2666291960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8340cc0f0 0x7ff81c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 --2- 172.21.15.77:0/2666291960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff81c004d00 0x7ff81c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83415b820 con 0x7ff81c004d00 2023-11-26T07:18:08.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c00bb40 con 0x7ff81c0039a0 2023-11-26T07:18:08.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c00bd00 con 0x7ff8340cc0f0 2023-11-26T07:18:08.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff8337fe640 1 --2- 172.21.15.77:0/2666291960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff81c004d00 0x7ff81c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff832ffd640 1 --2- 172.21.15.77:0/2666291960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff81c0039a0 0x7ff81c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff8337fe640 1 -- 172.21.15.77:0/2666291960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8340cc0f0 msgr2=0x7ff81c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:08.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff8337fe640 1 --2- 172.21.15.77:0/2666291960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8340cc0f0 0x7ff81c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff8337fe640 1 -- 172.21.15.77:0/2666291960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff81c0039a0 msgr2=0x7ff81c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:08.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff8337fe640 1 --2- 172.21.15.77:0/2666291960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff81c0039a0 0x7ff81c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.229+0000 7ff8337fe640 1 -- 172.21.15.77:0/2666291960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81c003520 con 0x7ff81c004d00 2023-11-26T07:18:08.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.230+0000 7ff8337fe640 1 --2- 172.21.15.77:0/2666291960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff81c004d00 0x7ff81c005180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00a760 tx=0x7ff81c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd25aef99571a38a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.231+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c034630 con 0x7ff81c004d00 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.231+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c02f070 con 0x7ff81c004d00 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.231+0000 7ff831ffb640 1 -- 172.21.15.77:0/2666291960 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c034a10 con 0x7ff81c004d00 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.231+0000 7ff8398cf640 1 -- 172.21.15.77:0/2666291960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff81c004d00 msgr2=0x7ff81c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.231+0000 7ff8398cf640 1 --2- 172.21.15.77:0/2666291960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff81c004d00 0x7ff81c005180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00a760 tx=0x7ff81c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.231+0000 7ff8337fe640 1 -- 172.21.15.77:0/2666291960 reap_dead start 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.231+0000 7ff8398cf640 1 -- 172.21.15.77:0/2666291960 shutdown_connections 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.231+0000 7ff8398cf640 1 -- 172.21.15.77:0/2666291960 >> 172.21.15.77:0/2666291960 conn(0x7ff8340b0c50 msgr2=0x7ff8340b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.231+0000 7ff8398cf640 1 -- 172.21.15.77:0/2666291960 shutdown_connections 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.231+0000 7ff8398cf640 1 -- 172.21.15.77:0/2666291960 wait complete. 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.233+0000 7ff8398cf640 1 Processor -- start 2023-11-26T07:18:08.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.233+0000 7ff8398cf640 1 -- start start 2023-11-26T07:18:08.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.234+0000 7ff8398cf640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff81c004d00 0x7ff8340cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.234+0000 7ff8398cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83415bd20 0x7ff834156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.234+0000 7ff8398cf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff83409b840 0x7ff83409bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.234+0000 7ff8398cf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340ce980 con 0x7ff83415bd20 2023-11-26T07:18:08.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.234+0000 7ff8398cf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83409c200 con 0x7ff83409b840 2023-11-26T07:18:08.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.234+0000 7ff8398cf640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340cdb20 con 0x7ff81c004d00 2023-11-26T07:18:08.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.234+0000 7ff8327fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83415bd20 0x7ff834156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.234+0000 7ff8327fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83415bd20 0x7ff834156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54162/0 (socket says 172.21.15.77:54162) 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.234+0000 7ff8327fc640 1 -- 172.21.15.77:0/885067122 learned_addr learned my addr 172.21.15.77:0/885067122 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff8327fc640 1 -- 172.21.15.77:0/885067122 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff81c004d00 msgr2=0x7ff8340cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff8327fc640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff81c004d00 0x7ff8340cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff8337fe640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff83409b840 0x7ff83409bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff8327fc640 1 -- 172.21.15.77:0/885067122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff83409b840 msgr2=0x7ff83409bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff8327fc640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff83409b840 0x7ff83409bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff8327fc640 1 -- 172.21.15.77:0/885067122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83415c290 con 0x7ff83415bd20 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff8327fc640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83415bd20 0x7ff834156b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff82800e7f0 tx=0x7ff82800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff81bfff640 1 -- 172.21.15.77:0/885067122 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800eea0 con 0x7ff83415bd20 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff81bfff640 1 -- 172.21.15.77:0/885067122 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82800c8e0 con 0x7ff83415bd20 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff81bfff640 1 -- 172.21.15.77:0/885067122 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800cc70 con 0x7ff83415bd20 2023-11-26T07:18:08.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff8398cf640 1 -- 172.21.15.77:0/885067122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83415c570 con 0x7ff83415bd20 2023-11-26T07:18:08.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.235+0000 7ff8398cf640 1 -- 172.21.15.77:0/885067122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83415cb30 con 0x7ff83415bd20 2023-11-26T07:18:08.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.236+0000 7ff8398cf640 1 -- 172.21.15.77:0/885067122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8340c4ed0 con 0x7ff83415bd20 2023-11-26T07:18:08.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.237+0000 7ff81bfff640 1 -- 172.21.15.77:0/885067122 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff828013470 con 0x7ff83415bd20 2023-11-26T07:18:08.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.239+0000 7ff81bfff640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff82006ae40 0x7ff82006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.239+0000 7ff81bfff640 1 -- 172.21.15.77:0/885067122 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff828089770 con 0x7ff83415bd20 2023-11-26T07:18:08.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.239+0000 7ff832ffd640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff82006ae40 0x7ff82006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.239+0000 7ff832ffd640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff82006ae40 0x7ff82006d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff824007fd0 tx=0x7ff824009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.243+0000 7ff81bfff640 1 -- 172.21.15.77:0/885067122 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8280546f0 con 0x7ff83415bd20 2023-11-26T07:18:08.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.435+0000 7ff8398cf640 1 -- 172.21.15.77:0/885067122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff83404e8b0 con 0x7ff83415bd20 2023-11-26T07:18:08.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.436+0000 7ff81bfff640 1 -- 172.21.15.77:0/885067122 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8280210a0 con 0x7ff83415bd20 2023-11-26T07:18:08.439 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:18:08.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 -- 172.21.15.77:0/885067122 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff82006ae40 msgr2=0x7ff82006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff82006ae40 0x7ff82006d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff824007fd0 tx=0x7ff824009040 comp rx=0 tx=0).stop 2023-11-26T07:18:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 -- 172.21.15.77:0/885067122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83415bd20 msgr2=0x7ff834156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83415bd20 0x7ff834156b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff82800e7f0 tx=0x7ff82800ecb0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 -- 172.21.15.77:0/885067122 shutdown_connections 2023-11-26T07:18:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff82006ae40 0x7ff82006d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff83409b840 0x7ff83409bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83415bd20 0x7ff834156b10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 --2- 172.21.15.77:0/885067122 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff81c004d00 0x7ff8340cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 -- 172.21.15.77:0/885067122 >> 172.21.15.77:0/885067122 conn(0x7ff8340b0c50 msgr2=0x7ff834071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 -- 172.21.15.77:0/885067122 shutdown_connections 2023-11-26T07:18:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.439+0000 7ff8398cf640 1 -- 172.21.15.77:0/885067122 wait complete. 2023-11-26T07:18:08.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:08.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.667+0000 7fad29abb640 1 Processor -- start 2023-11-26T07:18:08.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.667+0000 7fad29abb640 1 -- start start 2023-11-26T07:18:08.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.669+0000 7fad29abb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad24146eb0 0x7fad24161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.669+0000 7fad29abb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad24161a10 con 0x7fad240cd2e0 2023-11-26T07:18:08.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.669+0000 7fad29abb640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad24161cf0 con 0x7fad2406e160 2023-11-26T07:18:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.669+0000 7fad29abb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad24161fd0 con 0x7fad24146eb0 2023-11-26T07:18:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad23fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fad240cd2e0 0x7fad24070e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49758/0 (socket says 172.21.15.77:49758) 2023-11-26T07:18:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad23fff640 1 -- 172.21.15.77:0/201141048 learned_addr learned my addr 172.21.15.77:0/201141048 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558885350 0 0) 0x7fad24161a10 con 0x7fad240cd2e0 2023-11-26T07:18:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad237fe640 1 --2- 172.21.15.77:0/201141048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad24146eb0 0x7fad24161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad10003520 con 0x7fad240cd2e0 2023-11-26T07:18:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 418524032 0 0) 0x7fad10003520 con 0x7fad240cd2e0 2023-11-26T07:18:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad24146eb0 msgr2=0x7fad24161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad22ffd640 1 --2- 172.21.15.77:0/201141048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad24146eb0 0x7fad24161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 >> v1:172.21.15.159:6789/0 conn(0x7fad2406e160 legacy=0x7fad240ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24070660 con 0x7fad240cd2e0 2023-11-26T07:18:08.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fad1c0019f0 con 0x7fad240cd2e0 2023-11-26T07:18:08.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.670+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 >> v1:172.21.15.77:6789/0 conn(0x7fad240cd2e0 legacy=0x7fad24070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad22ffd640 1 --2- 172.21.15.77:0/201141048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad24146eb0 0x7fad100039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad22ffd640 1 --2- 172.21.15.77:0/201141048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad10003f20 0x7fad100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad22ffd640 1 --2- 172.21.15.77:0/201141048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad10004d00 0x7fad10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad24161fd0 con 0x7fad10004d00 2023-11-26T07:18:08.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1000ba60 con 0x7fad10003f20 2023-11-26T07:18:08.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1000bc20 con 0x7fad24146eb0 2023-11-26T07:18:08.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad23fff640 1 --2- 172.21.15.77:0/201141048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad10004d00 0x7fad10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad1bfff640 1 --2- 172.21.15.77:0/201141048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad10003f20 0x7fad100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad23fff640 1 -- 172.21.15.77:0/201141048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad24146eb0 msgr2=0x7fad100039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad23fff640 1 --2- 172.21.15.77:0/201141048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad24146eb0 0x7fad100039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad23fff640 1 -- 172.21.15.77:0/201141048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad10003f20 msgr2=0x7fad100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad23fff640 1 --2- 172.21.15.77:0/201141048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad10003f20 0x7fad100047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.671+0000 7fad23fff640 1 -- 172.21.15.77:0/201141048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad10003520 con 0x7fad10004d00 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.672+0000 7fad23fff640 1 --2- 172.21.15.77:0/201141048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad10004d00 0x7fad10005180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00a830 tx=0x7fad100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8beea5ef9221d56 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.673+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c0072d0 con 0x7fad10004d00 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.673+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c02f070 con 0x7fad10004d00 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.673+0000 7fad22ffd640 1 -- 172.21.15.77:0/201141048 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c007690 con 0x7fad10004d00 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.673+0000 7fad29abb640 1 -- 172.21.15.77:0/201141048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad10004d00 msgr2=0x7fad10005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.673+0000 7fad29abb640 1 --2- 172.21.15.77:0/201141048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad10004d00 0x7fad10005180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00a830 tx=0x7fad100057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.673+0000 7fad23fff640 1 -- 172.21.15.77:0/201141048 reap_dead start 2023-11-26T07:18:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.673+0000 7fad29abb640 1 -- 172.21.15.77:0/201141048 shutdown_connections 2023-11-26T07:18:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.673+0000 7fad29abb640 1 -- 172.21.15.77:0/201141048 >> 172.21.15.77:0/201141048 conn(0x7fad240b0c50 msgr2=0x7fad240b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.673+0000 7fad29abb640 1 -- 172.21.15.77:0/201141048 shutdown_connections 2023-11-26T07:18:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.674+0000 7fad29abb640 1 -- 172.21.15.77:0/201141048 wait complete. 2023-11-26T07:18:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.675+0000 7fad29abb640 1 Processor -- start 2023-11-26T07:18:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.675+0000 7fad29abb640 1 -- start start 2023-11-26T07:18:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.676+0000 7fad29abb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad10004d00 0x7fad2415cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.676+0000 7fad29abb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad240acda0 0x7fad240ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.676+0000 7fad29abb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24143760 0x7fad24143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.676+0000 7fad29abb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad24144120 con 0x7fad24143760 2023-11-26T07:18:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.676+0000 7fad29abb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2415f8a0 con 0x7fad10004d00 2023-11-26T07:18:08.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.676+0000 7fad29abb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2415fb40 con 0x7fad240acda0 2023-11-26T07:18:08.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.677+0000 7fad23fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24143760 0x7fad24143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.677+0000 7fad23fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24143760 0x7fad24143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54180/0 (socket says 172.21.15.77:54180) 2023-11-26T07:18:08.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.677+0000 7fad23fff640 1 -- 172.21.15.77:0/1197903876 learned_addr learned my addr 172.21.15.77:0/1197903876 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:08.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.677+0000 7fad237fe640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad10004d00 0x7fad2415cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.677+0000 7fad1bfff640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad240acda0 0x7fad240ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.677+0000 7fad23fff640 1 -- 172.21.15.77:0/1197903876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad240acda0 msgr2=0x7fad240ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.677+0000 7fad23fff640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad240acda0 0x7fad240ad220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.677+0000 7fad23fff640 1 -- 172.21.15.77:0/1197903876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad10004d00 msgr2=0x7fad2415cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.677+0000 7fad23fff640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad10004d00 0x7fad2415cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.677+0000 7fad23fff640 1 -- 172.21.15.77:0/1197903876 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2415fe20 con 0x7fad24143760 2023-11-26T07:18:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.677+0000 7fad23fff640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24143760 0x7fad24143be0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00a950 tx=0x7fad1c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.678+0000 7fad20ff9640 1 -- 172.21.15.77:0/1197903876 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c004d60 con 0x7fad24143760 2023-11-26T07:18:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.678+0000 7fad20ff9640 1 -- 172.21.15.77:0/1197903876 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c001250 con 0x7fad24143760 2023-11-26T07:18:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.678+0000 7fad20ff9640 1 -- 172.21.15.77:0/1197903876 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c0072d0 con 0x7fad24143760 2023-11-26T07:18:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.678+0000 7fad29abb640 1 -- 172.21.15.77:0/1197903876 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad24160100 con 0x7fad24143760 2023-11-26T07:18:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.678+0000 7fad29abb640 1 -- 172.21.15.77:0/1197903876 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad24143290 con 0x7fad24143760 2023-11-26T07:18:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.679+0000 7fad29abb640 1 -- 172.21.15.77:0/1197903876 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad24160620 con 0x7fad24143760 2023-11-26T07:18:08.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.680+0000 7fad20ff9640 1 -- 172.21.15.77:0/1197903876 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad1c031030 con 0x7fad24143760 2023-11-26T07:18:08.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.681+0000 7fad20ff9640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0406ae40 0x7fad0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.681+0000 7fad20ff9640 1 -- 172.21.15.77:0/1197903876 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad1c0ab2d0 con 0x7fad24143760 2023-11-26T07:18:08.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.681+0000 7fad237fe640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0406ae40 0x7fad0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.682+0000 7fad237fe640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0406ae40 0x7fad0406d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad14004770 tx=0x7fad14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.686+0000 7fad20ff9640 1 -- 172.21.15.77:0/1197903876 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad1c079d70 con 0x7fad24143760 2023-11-26T07:18:08.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.875+0000 7fad29abb640 1 -- 172.21.15.77:0/1197903876 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad24160620 con 0x7fad24143760 2023-11-26T07:18:08.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.876+0000 7fad20ff9640 1 -- 172.21.15.77:0/1197903876 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad1c079900 con 0x7fad24143760 2023-11-26T07:18:08.879 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:18:08.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.879+0000 7fad29abb640 1 -- 172.21.15.77:0/1197903876 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0406ae40 msgr2=0x7fad0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.879+0000 7fad29abb640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0406ae40 0x7fad0406d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad14004770 tx=0x7fad14008040 comp rx=0 tx=0).stop 2023-11-26T07:18:08.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.879+0000 7fad29abb640 1 -- 172.21.15.77:0/1197903876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24143760 msgr2=0x7fad24143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.879+0000 7fad29abb640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24143760 0x7fad24143be0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00a950 tx=0x7fad1c001d80 comp rx=0 tx=0).stop 2023-11-26T07:18:08.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.879+0000 7fad29abb640 1 -- 172.21.15.77:0/1197903876 shutdown_connections 2023-11-26T07:18:08.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.879+0000 7fad29abb640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0406ae40 0x7fad0406d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.879+0000 7fad29abb640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24143760 0x7fad24143be0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.879+0000 7fad29abb640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad240acda0 0x7fad240ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.879+0000 7fad29abb640 1 --2- 172.21.15.77:0/1197903876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad10004d00 0x7fad2415cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.879+0000 7fad29abb640 1 -- 172.21.15.77:0/1197903876 >> 172.21.15.77:0/1197903876 conn(0x7fad240b0c50 msgr2=0x7fad240ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:08.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.879+0000 7fad29abb640 1 -- 172.21.15.77:0/1197903876 shutdown_connections 2023-11-26T07:18:08.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:08.880+0000 7fad29abb640 1 -- 172.21.15.77:0/1197903876 wait complete. 2023-11-26T07:18:08.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:09.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.117+0000 7f137f74c640 1 Processor -- start 2023-11-26T07:18:09.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.118+0000 7f137f74c640 1 -- start start 2023-11-26T07:18:09.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.119+0000 7f137f74c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f13780d1c20 0x7f137806bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.119+0000 7f137f74c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d2000 0x7f13780cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.119+0000 7f137f74c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780ce410 con 0x7f13780d0200 2023-11-26T07:18:09.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.119+0000 7f137f74c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780d06f0 con 0x7f13780d1c20 2023-11-26T07:18:09.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.119+0000 7f137f74c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780d09d0 con 0x7f13780d2000 2023-11-26T07:18:09.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.119+0000 7f137d4e8640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f13780d1c20 0x7f137806bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.120+0000 7f137d4e8640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f13780d1c20 0x7f137806bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:37528/0 (socket says 172.21.15.77:37528) 2023-11-26T07:18:09.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.120+0000 7f137d4e8640 1 -- 172.21.15.77:0/725598087 learned_addr learned my addr 172.21.15.77:0/725598087 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:09.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.120+0000 7f137cce7640 1 --2- 172.21.15.77:0/725598087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d2000 0x7f13780cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.120+0000 7f137cce7640 1 -- 172.21.15.77:0/725598087 >> v2:172.21.15.159:3300/0 conn(0x7f13780d1c20 msgr2=0x7f137806bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.120+0000 7f137cce7640 1 --2- 172.21.15.77:0/725598087 >> v2:172.21.15.159:3300/0 conn(0x7f13780d1c20 0x7f137806bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.120+0000 7f137cce7640 1 -- 172.21.15.77:0/725598087 >> v1:172.21.15.159:6789/0 conn(0x7f13780d0200 legacy=0x7f13781605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.120+0000 7f137cce7640 1 -- 172.21.15.77:0/725598087 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780ce0a0 con 0x7f13780d2000 2023-11-26T07:18:09.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.120+0000 7f137d4e8640 1 --2- 172.21.15.77:0/725598087 >> v2:172.21.15.159:3300/0 conn(0x7f13780d1c20 0x7f137806bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:09.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.122+0000 7f137cce7640 1 --2- 172.21.15.77:0/725598087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d2000 0x7f13780cfcc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097a0 tx=0x7f136c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa7b7dbd990e65fe server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.122+0000 7f136bfff640 1 -- 172.21.15.77:0/725598087 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c02d040 con 0x7f13780d2000 2023-11-26T07:18:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.122+0000 7f136bfff640 1 -- 172.21.15.77:0/725598087 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c031810 con 0x7f13780d2000 2023-11-26T07:18:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.122+0000 7f136bfff640 1 -- 172.21.15.77:0/725598087 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c031ba0 con 0x7f13780d2000 2023-11-26T07:18:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.123+0000 7f137f74c640 1 -- 172.21.15.77:0/725598087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d2000 msgr2=0x7f13780cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.123+0000 7f137f74c640 1 --2- 172.21.15.77:0/725598087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d2000 0x7f13780cfcc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097a0 tx=0x7f136c02b8b0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.123+0000 7f137f74c640 1 -- 172.21.15.77:0/725598087 shutdown_connections 2023-11-26T07:18:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.123+0000 7f137f74c640 1 --2- 172.21.15.77:0/725598087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d2000 0x7f13780cfcc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.123+0000 7f137f74c640 1 --2- 172.21.15.77:0/725598087 >> v2:172.21.15.159:3300/0 conn(0x7f13780d1c20 0x7f137806bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.123+0000 7f137f74c640 1 -- 172.21.15.77:0/725598087 >> 172.21.15.77:0/725598087 conn(0x7f137808cea0 msgr2=0x7f137809c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.123+0000 7f137f74c640 1 -- 172.21.15.77:0/725598087 shutdown_connections 2023-11-26T07:18:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.123+0000 7f137f74c640 1 -- 172.21.15.77:0/725598087 wait complete. 2023-11-26T07:18:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.125+0000 7f137f74c640 1 Processor -- start 2023-11-26T07:18:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.125+0000 7f137f74c640 1 -- start start 2023-11-26T07:18:09.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.126+0000 7f137f74c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13780d0200 0x7f13781e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.126+0000 7f137f74c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d1c20 0x7f13780b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.126+0000 7f137f74c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13780d2000 0x7f13781e61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.126+0000 7f137f74c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13781e7650 con 0x7f13780d0200 2023-11-26T07:18:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.126+0000 7f137f74c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13781e6720 con 0x7f13780d2000 2023-11-26T07:18:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.126+0000 7f137f74c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13781e69d0 con 0x7f13780d1c20 2023-11-26T07:18:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.126+0000 7f137d4e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13780d0200 0x7f13781e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.126+0000 7f137d4e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13780d0200 0x7f13781e7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54186/0 (socket says 172.21.15.77:54186) 2023-11-26T07:18:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.126+0000 7f137d4e8640 1 -- 172.21.15.77:0/1622813739 learned_addr learned my addr 172.21.15.77:0/1622813739 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:09.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f137dce9640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13780d2000 0x7f13781e61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f137cce7640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d1c20 0x7f13780b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f137d4e8640 1 -- 172.21.15.77:0/1622813739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d1c20 msgr2=0x7f13780b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f137d4e8640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d1c20 0x7f13780b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f137d4e8640 1 -- 172.21.15.77:0/1622813739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13780d2000 msgr2=0x7f13781e61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f137d4e8640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13780d2000 0x7f13781e61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f137d4e8640 1 -- 172.21.15.77:0/1622813739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13740094d0 con 0x7f13780d0200 2023-11-26T07:18:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f137cce7640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d1c20 0x7f13780b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f137d4e8640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13780d0200 0x7f13781e7a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f137400e9d0 tx=0x7f137400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f1369ffb640 1 -- 172.21.15.77:0/1622813739 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137400ca60 con 0x7f13780d0200 2023-11-26T07:18:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f1369ffb640 1 -- 172.21.15.77:0/1622813739 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137400cbc0 con 0x7f13780d0200 2023-11-26T07:18:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f1369ffb640 1 -- 172.21.15.77:0/1622813739 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374013470 con 0x7f13780d0200 2023-11-26T07:18:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.127+0000 7f137f74c640 1 -- 172.21.15.77:0/1622813739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c009400 con 0x7f13780d0200 2023-11-26T07:18:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.128+0000 7f137f74c640 1 -- 172.21.15.77:0/1622813739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13781e6f90 con 0x7f13780d0200 2023-11-26T07:18:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.129+0000 7f137f74c640 1 -- 172.21.15.77:0/1622813739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13781e78c0 con 0x7f13780d0200 2023-11-26T07:18:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.130+0000 7f1369ffb640 1 -- 172.21.15.77:0/1622813739 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13740135d0 con 0x7f13780d0200 2023-11-26T07:18:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.130+0000 7f1369ffb640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f135c06ae70 0x7f135c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.131+0000 7f1369ffb640 1 -- 172.21.15.77:0/1622813739 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1374089920 con 0x7f13780d0200 2023-11-26T07:18:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.131+0000 7f137cce7640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f135c06ae70 0x7f135c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.131+0000 7f137cce7640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f135c06ae70 0x7f135c06d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f136c036000 tx=0x7f136c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.135+0000 7f1369ffb640 1 -- 172.21.15.77:0/1622813739 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13740549c0 con 0x7f13780d0200 2023-11-26T07:18:09.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.322+0000 7f137f74c640 1 -- 172.21.15.77:0/1622813739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f137804e8b0 con 0x7f13780d0200 2023-11-26T07:18:09.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.323+0000 7f1369ffb640 1 -- 172.21.15.77:0/1622813739 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13740170a0 con 0x7f13780d0200 2023-11-26T07:18:09.326 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:18:09.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 -- 172.21.15.77:0/1622813739 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f135c06ae70 msgr2=0x7f135c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f135c06ae70 0x7f135c06d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f136c036000 tx=0x7f136c03c040 comp rx=0 tx=0).stop 2023-11-26T07:18:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 -- 172.21.15.77:0/1622813739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13780d0200 msgr2=0x7f13781e7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13780d0200 0x7f13781e7a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f137400e9d0 tx=0x7f137400ee90 comp rx=0 tx=0).stop 2023-11-26T07:18:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 -- 172.21.15.77:0/1622813739 shutdown_connections 2023-11-26T07:18:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f135c06ae70 0x7f135c06d330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13780d2000 0x7f13781e61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13780d1c20 0x7f13780b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 --2- 172.21.15.77:0/1622813739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13780d0200 0x7f13781e7a70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 -- 172.21.15.77:0/1622813739 >> 172.21.15.77:0/1622813739 conn(0x7f137808cea0 msgr2=0x7f13781569c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 -- 172.21.15.77:0/1622813739 shutdown_connections 2023-11-26T07:18:09.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.326+0000 7f137f74c640 1 -- 172.21.15.77:0/1622813739 wait complete. 2023-11-26T07:18:09.347 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:09.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.554+0000 7f46526bb640 1 Processor -- start 2023-11-26T07:18:09.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.554+0000 7f46526bb640 1 -- start start 2023-11-26T07:18:09.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.556+0000 7f46526bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f464c0b2250 0x7f464c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.556+0000 7f46526bb640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f464c0b2a70 0x7f464c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.556+0000 7f46526bb640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c15ab80 con 0x7f464c0b2630 2023-11-26T07:18:09.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.556+0000 7f46526bb640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c15a990 con 0x7f464c0b2a70 2023-11-26T07:18:09.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.556+0000 7f46526bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c15e680 con 0x7f464c0b2250 2023-11-26T07:18:09.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.556+0000 7f4650c58640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f464c0b2a70 0x7f464c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.556+0000 7f4650c58640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f464c0b2a70 0x7f464c15b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54188/0 (socket says 172.21.15.77:54188) 2023-11-26T07:18:09.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.556+0000 7f4650c58640 1 -- 172.21.15.77:0/1871028787 learned_addr learned my addr 172.21.15.77:0/1871028787 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:09.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.556+0000 7f464bfff640 1 --2- 172.21.15.77:0/1871028787 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f464c0b2250 0x7f464c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.557+0000 7f4650c58640 1 -- 172.21.15.77:0/1871028787 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f464c0b2250 msgr2=0x7f464c15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.557+0000 7f4650c58640 1 --2- 172.21.15.77:0/1871028787 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f464c0b2250 0x7f464c15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.557+0000 7f4650c58640 1 -- 172.21.15.77:0/1871028787 >> v1:172.21.15.159:6789/0 conn(0x7f464c0b2630 legacy=0x7f464c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.557+0000 7f4650c58640 1 -- 172.21.15.77:0/1871028787 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c15e960 con 0x7f464c0b2a70 2023-11-26T07:18:09.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.558+0000 7f4650c58640 1 --2- 172.21.15.77:0/1871028787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0b2a70 0x7f464c15b080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4644009e50 tx=0x7f464402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6f5c093e4d4d58 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.558+0000 7f464b7fe640 1 -- 172.21.15.77:0/1871028787 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464402cb00 con 0x7f464c0b2a70 2023-11-26T07:18:09.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.558+0000 7f464b7fe640 1 -- 172.21.15.77:0/1871028787 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464402cc60 con 0x7f464c0b2a70 2023-11-26T07:18:09.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.558+0000 7f464b7fe640 1 -- 172.21.15.77:0/1871028787 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46440343f0 con 0x7f464c0b2a70 2023-11-26T07:18:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.559+0000 7f46526bb640 1 -- 172.21.15.77:0/1871028787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0b2a70 msgr2=0x7f464c15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.559+0000 7f46526bb640 1 --2- 172.21.15.77:0/1871028787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0b2a70 0x7f464c15b080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4644009e50 tx=0x7f464402bf60 comp rx=0 tx=0).stop 2023-11-26T07:18:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.559+0000 7f46526bb640 1 -- 172.21.15.77:0/1871028787 shutdown_connections 2023-11-26T07:18:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.559+0000 7f46526bb640 1 --2- 172.21.15.77:0/1871028787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0b2a70 0x7f464c15b080 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.559+0000 7f46526bb640 1 --2- 172.21.15.77:0/1871028787 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f464c0b2250 0x7f464c15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.559+0000 7f46526bb640 1 -- 172.21.15.77:0/1871028787 >> 172.21.15.77:0/1871028787 conn(0x7f464c06a920 msgr2=0x7f464c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.559+0000 7f46526bb640 1 -- 172.21.15.77:0/1871028787 shutdown_connections 2023-11-26T07:18:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.559+0000 7f46526bb640 1 -- 172.21.15.77:0/1871028787 wait complete. 2023-11-26T07:18:09.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.560+0000 7f46526bb640 1 Processor -- start 2023-11-26T07:18:09.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.561+0000 7f46526bb640 1 -- start start 2023-11-26T07:18:09.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.561+0000 7f46526bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0b2250 0x7f464c15d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.561+0000 7f46526bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f464c0b2630 0x7f464c09c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.561+0000 7f46526bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f464c0b2a70 0x7f464c09ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.561+0000 7f46526bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c1538f0 con 0x7f464c0b2250 2023-11-26T07:18:09.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.561+0000 7f46526bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0b0580 con 0x7f464c0b2a70 2023-11-26T07:18:09.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.561+0000 7f46526bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c09cfb0 con 0x7f464c0b2630 2023-11-26T07:18:09.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.562+0000 7f464bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0b2250 0x7f464c15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.562+0000 7f464bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0b2250 0x7f464c15d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54204/0 (socket says 172.21.15.77:54204) 2023-11-26T07:18:09.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.562+0000 7f464bfff640 1 -- 172.21.15.77:0/221700559 learned_addr learned my addr 172.21.15.77:0/221700559 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:09.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.562+0000 7f4650c58640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f464c0b2a70 0x7f464c09ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.562+0000 7f464bfff640 1 -- 172.21.15.77:0/221700559 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f464c0b2630 msgr2=0x7f464c09c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.562+0000 7f464bfff640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f464c0b2630 0x7f464c09c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.562+0000 7f464bfff640 1 -- 172.21.15.77:0/221700559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f464c0b2a70 msgr2=0x7f464c09ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.562+0000 7f464bfff640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f464c0b2a70 0x7f464c09ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.562+0000 7f464bfff640 1 -- 172.21.15.77:0/221700559 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644009b30 con 0x7f464c0b2250 2023-11-26T07:18:09.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.563+0000 7f464bfff640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0b2250 0x7f464c15d120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f463c00d800 tx=0x7f463c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.563+0000 7f46497fa640 1 -- 172.21.15.77:0/221700559 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c00b6c0 con 0x7f464c0b2250 2023-11-26T07:18:09.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.563+0000 7f46497fa640 1 -- 172.21.15.77:0/221700559 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c00b820 con 0x7f464c0b2250 2023-11-26T07:18:09.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.563+0000 7f46526bb640 1 -- 172.21.15.77:0/221700559 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c0cd7c0 con 0x7f464c0b2250 2023-11-26T07:18:09.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.563+0000 7f46497fa640 1 -- 172.21.15.77:0/221700559 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c00bbb0 con 0x7f464c0b2250 2023-11-26T07:18:09.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.563+0000 7f46526bb640 1 -- 172.21.15.77:0/221700559 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c0b0d50 con 0x7f464c0b2250 2023-11-26T07:18:09.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.564+0000 7f46526bb640 1 -- 172.21.15.77:0/221700559 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c0b08b0 con 0x7f464c0b2250 2023-11-26T07:18:09.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.565+0000 7f46497fa640 1 -- 172.21.15.77:0/221700559 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f463c00bd10 con 0x7f464c0b2250 2023-11-26T07:18:09.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.566+0000 7f46497fa640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f462c06ae40 0x7f462c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.566+0000 7f46497fa640 1 -- 172.21.15.77:0/221700559 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f463c089ce0 con 0x7f464c0b2250 2023-11-26T07:18:09.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.566+0000 7f4643fff640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f462c06ae40 0x7f462c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.567+0000 7f4643fff640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f462c06ae40 0x7f462c06d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4634000f60 tx=0x7f46340079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.570+0000 7f46497fa640 1 -- 172.21.15.77:0/221700559 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f463c054c60 con 0x7f464c0b2250 2023-11-26T07:18:09.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.762+0000 7f46526bb640 1 -- 172.21.15.77:0/221700559 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f464c0ae3e0 con 0x7f464c0b2250 2023-11-26T07:18:09.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.764+0000 7f46497fa640 1 -- 172.21.15.77:0/221700559 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f463c058280 con 0x7f464c0b2250 2023-11-26T07:18:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:09.767 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:36.274387+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:09.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.767+0000 7f46526bb640 1 -- 172.21.15.77:0/221700559 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f462c06ae40 msgr2=0x7f462c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.767+0000 7f46526bb640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f462c06ae40 0x7f462c06d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4634000f60 tx=0x7f46340079b0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.767+0000 7f46526bb640 1 -- 172.21.15.77:0/221700559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0b2250 msgr2=0x7f464c15d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.767+0000 7f46526bb640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0b2250 0x7f464c15d120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f463c00d800 tx=0x7f463c00dcc0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.767+0000 7f46526bb640 1 -- 172.21.15.77:0/221700559 shutdown_connections 2023-11-26T07:18:09.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.767+0000 7f46526bb640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f462c06ae40 0x7f462c06d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.767+0000 7f46526bb640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f464c0b2a70 0x7f464c09ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.767+0000 7f46526bb640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f464c0b2630 0x7f464c09c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.767+0000 7f46526bb640 1 --2- 172.21.15.77:0/221700559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0b2250 0x7f464c15d120 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.767+0000 7f46526bb640 1 -- 172.21.15.77:0/221700559 >> 172.21.15.77:0/221700559 conn(0x7f464c06a920 msgr2=0x7f464c159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.768+0000 7f46526bb640 1 -- 172.21.15.77:0/221700559 shutdown_connections 2023-11-26T07:18:09.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.768+0000 7f46526bb640 1 -- 172.21.15.77:0/221700559 wait complete. 2023-11-26T07:18:09.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:09.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:10.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.998+0000 7f96037b0640 1 Processor -- start 2023-11-26T07:18:10.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:09.998+0000 7f96037b0640 1 -- start start 2023-11-26T07:18:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.000+0000 7f96037b0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95fc072160 0x7f95fc15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.000+0000 7f96037b0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f95fc0c49f0 0x7f95fc06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.000+0000 7f96037b0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc15ec90 con 0x7f95fc06dc40 2023-11-26T07:18:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.000+0000 7f96037b0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc06e0f0 con 0x7f95fc0c49f0 2023-11-26T07:18:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.000+0000 7f96037b0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0cd530 con 0x7f95fc072160 2023-11-26T07:18:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.000+0000 7f9600d4b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f95fc0c49f0 0x7f95fc06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.000+0000 7f9600d4b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f95fc0c49f0 0x7f95fc06d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54214/0 (socket says 172.21.15.77:54214) 2023-11-26T07:18:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.000+0000 7f9600d4b640 1 -- 172.21.15.77:0/3688300964 learned_addr learned my addr 172.21.15.77:0/3688300964 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.000+0000 7f960154c640 1 --2- 172.21.15.77:0/3688300964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95fc072160 0x7f95fc15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.001+0000 7f9600d4b640 1 -- 172.21.15.77:0/3688300964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95fc072160 msgr2=0x7f95fc15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.001+0000 7f9600d4b640 1 --2- 172.21.15.77:0/3688300964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95fc072160 0x7f95fc15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.001+0000 7f9600d4b640 1 -- 172.21.15.77:0/3688300964 >> v1:172.21.15.77:6789/0 conn(0x7f95fc06dc40 legacy=0x7f95fc0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.001+0000 7f9600d4b640 1 -- 172.21.15.77:0/3688300964 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc0c4ed0 con 0x7f95fc0c49f0 2023-11-26T07:18:10.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.002+0000 7f9600d4b640 1 --2- 172.21.15.77:0/3688300964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95fc0c49f0 0x7f95fc06d700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00bb10 tx=0x7f95ec02e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e76eb6848d738ab server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.002+0000 7f95f3fff640 1 -- 172.21.15.77:0/3688300964 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec036440 con 0x7f95fc0c49f0 2023-11-26T07:18:10.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.002+0000 7f95f3fff640 1 -- 172.21.15.77:0/3688300964 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec0365a0 con 0x7f95fc0c49f0 2023-11-26T07:18:10.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.002+0000 7f95f3fff640 1 -- 172.21.15.77:0/3688300964 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec036930 con 0x7f95fc0c49f0 2023-11-26T07:18:10.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.003+0000 7f96037b0640 1 -- 172.21.15.77:0/3688300964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95fc0c49f0 msgr2=0x7f95fc06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.003+0000 7f96037b0640 1 --2- 172.21.15.77:0/3688300964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95fc0c49f0 0x7f95fc06d700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00bb10 tx=0x7f95ec02e150 comp rx=0 tx=0).stop 2023-11-26T07:18:10.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.003+0000 7f96037b0640 1 -- 172.21.15.77:0/3688300964 shutdown_connections 2023-11-26T07:18:10.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.003+0000 7f96037b0640 1 --2- 172.21.15.77:0/3688300964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95fc0c49f0 0x7f95fc06d700 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.003+0000 7f96037b0640 1 --2- 172.21.15.77:0/3688300964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95fc072160 0x7f95fc15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.003+0000 7f96037b0640 1 -- 172.21.15.77:0/3688300964 >> 172.21.15.77:0/3688300964 conn(0x7f95fc0b0c50 msgr2=0x7f95fc0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.003+0000 7f96037b0640 1 -- 172.21.15.77:0/3688300964 shutdown_connections 2023-11-26T07:18:10.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.003+0000 7f96037b0640 1 -- 172.21.15.77:0/3688300964 wait complete. 2023-11-26T07:18:10.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.005+0000 7f96037b0640 1 Processor -- start 2023-11-26T07:18:10.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.005+0000 7f96037b0640 1 -- start start 2023-11-26T07:18:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f96037b0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95fc06dc40 0x7f95fc0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f96037b0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95fc072160 0x7f95fc09b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f96037b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95fc0c49f0 0x7f95fc0cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f96037b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc09a060 con 0x7f95fc0c49f0 2023-11-26T07:18:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f96037b0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc09a340 con 0x7f95fc06dc40 2023-11-26T07:18:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f96037b0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc09a620 con 0x7f95fc072160 2023-11-26T07:18:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f9601d4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95fc0c49f0 0x7f95fc0cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f9601d4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95fc0c49f0 0x7f95fc0cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54226/0 (socket says 172.21.15.77:54226) 2023-11-26T07:18:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f9601d4d640 1 -- 172.21.15.77:0/1654343701 learned_addr learned my addr 172.21.15.77:0/1654343701 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:10.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f9601d4d640 1 -- 172.21.15.77:0/1654343701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95fc072160 msgr2=0x7f95fc09b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f9601d4d640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95fc072160 0x7f95fc09b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f9601d4d640 1 -- 172.21.15.77:0/1654343701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95fc06dc40 msgr2=0x7f95fc0999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f9601d4d640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95fc06dc40 0x7f95fc0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.006+0000 7f9601d4d640 1 -- 172.21.15.77:0/1654343701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec00b770 con 0x7f95fc0c49f0 2023-11-26T07:18:10.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.007+0000 7f9601d4d640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95fc0c49f0 0x7f95fc0cb5f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f95f400c7a0 tx=0x7f95f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.007+0000 7f95f1ffb640 1 -- 172.21.15.77:0/1654343701 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4003b70 con 0x7f95fc0c49f0 2023-11-26T07:18:10.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.007+0000 7f95f1ffb640 1 -- 172.21.15.77:0/1654343701 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4003cf0 con 0x7f95fc0c49f0 2023-11-26T07:18:10.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.007+0000 7f95f1ffb640 1 -- 172.21.15.77:0/1654343701 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4003ea0 con 0x7f95fc0c49f0 2023-11-26T07:18:10.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.007+0000 7f96037b0640 1 -- 172.21.15.77:0/1654343701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc09a900 con 0x7f95fc0c49f0 2023-11-26T07:18:10.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.007+0000 7f96037b0640 1 -- 172.21.15.77:0/1654343701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc09b640 con 0x7f95fc0c49f0 2023-11-26T07:18:10.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.008+0000 7f96037b0640 1 -- 172.21.15.77:0/1654343701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc09ae20 con 0x7f95fc0c49f0 2023-11-26T07:18:10.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.009+0000 7f95f1ffb640 1 -- 172.21.15.77:0/1654343701 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95f400aa90 con 0x7f95fc0c49f0 2023-11-26T07:18:10.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.010+0000 7f95f1ffb640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f95e006ae40 0x7f95e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.010+0000 7f95f1ffb640 1 -- 172.21.15.77:0/1654343701 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95f4089380 con 0x7f95fc0c49f0 2023-11-26T07:18:10.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.010+0000 7f960154c640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f95e006ae40 0x7f95e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.011+0000 7f960154c640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f95e006ae40 0x7f95e006d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f95f80098f0 tx=0x7f95f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.014+0000 7f95f1ffb640 1 -- 172.21.15.77:0/1654343701 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95fc09ae20 con 0x7f95fc0c49f0 2023-11-26T07:18:10.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.190+0000 7f96037b0640 1 -- 172.21.15.77:0/1654343701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95fc15ec90 con 0x7f95fc0c49f0 2023-11-26T07:18:10.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.191+0000 7f95f1ffb640 1 -- 172.21.15.77:0/1654343701 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95fc15ec90 con 0x7f95fc0c49f0 2023-11-26T07:18:10.194 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:18:10.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 -- 172.21.15.77:0/1654343701 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f95e006ae40 msgr2=0x7f95e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f95e006ae40 0x7f95e006d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f95f80098f0 tx=0x7f95f8008040 comp rx=0 tx=0).stop 2023-11-26T07:18:10.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 -- 172.21.15.77:0/1654343701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95fc0c49f0 msgr2=0x7f95fc0cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95fc0c49f0 0x7f95fc0cb5f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f95f400c7a0 tx=0x7f95f400cc60 comp rx=0 tx=0).stop 2023-11-26T07:18:10.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 -- 172.21.15.77:0/1654343701 shutdown_connections 2023-11-26T07:18:10.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f95e006ae40 0x7f95e006d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95fc0c49f0 0x7f95fc0cb5f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95fc072160 0x7f95fc09b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 --2- 172.21.15.77:0/1654343701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95fc06dc40 0x7f95fc0999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 -- 172.21.15.77:0/1654343701 >> 172.21.15.77:0/1654343701 conn(0x7f95fc0b0c50 msgr2=0x7f95fc0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 -- 172.21.15.77:0/1654343701 shutdown_connections 2023-11-26T07:18:10.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.194+0000 7f96037b0640 1 -- 172.21.15.77:0/1654343701 wait complete. 2023-11-26T07:18:10.214 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:10.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.428+0000 7fd2413bc640 1 Processor -- start 2023-11-26T07:18:10.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.428+0000 7fd2413bc640 1 -- start start 2023-11-26T07:18:10.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.430+0000 7fd2413bc640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd23c0b0b40 0x7fd23c0b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.430+0000 7fd2413bc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd23c06c5b0 0x7fd23c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.430+0000 7fd2413bc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c15ed20 con 0x7fd23c15b260 2023-11-26T07:18:10.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.430+0000 7fd2413bc640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c15b640 con 0x7fd23c0b0b40 2023-11-26T07:18:10.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.430+0000 7fd2413bc640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0b14f0 con 0x7fd23c06c5b0 2023-11-26T07:18:10.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.430+0000 7fd23bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd23c15b260 0x7fd23c06e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49764/0 (socket says 172.21.15.77:49764) 2023-11-26T07:18:10.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.430+0000 7fd23bfff640 1 -- 172.21.15.77:0/37288635 learned_addr learned my addr 172.21.15.77:0/37288635 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.430+0000 7fd23b7fe640 1 --2- 172.21.15.77:0/37288635 >> v2:172.21.15.159:3300/0 conn(0x7fd23c0b0b40 0x7fd23c0b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.430+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028933720 0 0) 0x7fd23c15ed20 con 0x7fd23c15b260 2023-11-26T07:18:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.430+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd224003520 con 0x7fd23c15b260 2023-11-26T07:18:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.430+0000 7fd240bbb640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd23c06c5b0 0x7fd23c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3624076371 0 0) 0x7fd224003520 con 0x7fd23c15b260 2023-11-26T07:18:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd23c06c5b0 msgr2=0x7fd23c06ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd23c06c5b0 0x7fd23c06ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 >> v2:172.21.15.159:3300/0 conn(0x7fd23c0b0b40 msgr2=0x7fd23c0b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 --2- 172.21.15.77:0/37288635 >> v2:172.21.15.159:3300/0 conn(0x7fd23c0b0b40 0x7fd23c0b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c15f8a0 con 0x7fd23c15b260 2023-11-26T07:18:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fd22c001670 con 0x7fd23c15b260 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd240bbb640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd23c06c5b0 0x7fd23c06ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 >> v1:172.21.15.77:6789/0 conn(0x7fd23c15b260 legacy=0x7fd23c06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd23c06c5b0 0x7fd2240039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd224003f30 0x7fd2240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd224004d00 0x7fd224005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c15b640 con 0x7fd224003f30 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0b14f0 con 0x7fd224004d00 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22400bb60 con 0x7fd23c06c5b0 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.431+0000 7fd23b7fe640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd224003f30 0x7fd2240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.432+0000 7fd23b7fe640 1 -- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd23c06c5b0 msgr2=0x7fd2240039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.432+0000 7fd23bfff640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd23c06c5b0 0x7fd2240039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.432+0000 7fd240bbb640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd224004d00 0x7fd224005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.432+0000 7fd23b7fe640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd23c06c5b0 0x7fd2240039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.432+0000 7fd23b7fe640 1 -- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd224004d00 msgr2=0x7fd224005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.432+0000 7fd23b7fe640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd224004d00 0x7fd224005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.432+0000 7fd23b7fe640 1 -- 172.21.15.77:0/37288635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd224003520 con 0x7fd224003f30 2023-11-26T07:18:10.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.433+0000 7fd23b7fe640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd224003f30 0x7fd2240047c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd230009af0 tx=0x7fd2240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923a17197e9f1b68 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.433+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23002c710 con 0x7fd224003f30 2023-11-26T07:18:10.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.433+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23002c870 con 0x7fd224003f30 2023-11-26T07:18:10.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.433+0000 7fd23affd640 1 -- 172.21.15.77:0/37288635 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23002cc00 con 0x7fd224003f30 2023-11-26T07:18:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.433+0000 7fd2413bc640 1 -- 172.21.15.77:0/37288635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd224003f30 msgr2=0x7fd2240047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.434+0000 7fd2413bc640 1 --2- 172.21.15.77:0/37288635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd224003f30 0x7fd2240047c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd230009af0 tx=0x7fd2240057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.434+0000 7fd240bbb640 1 -- 172.21.15.77:0/37288635 reap_dead start 2023-11-26T07:18:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.434+0000 7fd2413bc640 1 -- 172.21.15.77:0/37288635 shutdown_connections 2023-11-26T07:18:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.434+0000 7fd2413bc640 1 -- 172.21.15.77:0/37288635 >> 172.21.15.77:0/37288635 conn(0x7fd23c0cbb40 msgr2=0x7fd23c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.434+0000 7fd2413bc640 1 -- 172.21.15.77:0/37288635 shutdown_connections 2023-11-26T07:18:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.434+0000 7fd2413bc640 1 -- 172.21.15.77:0/37288635 wait complete. 2023-11-26T07:18:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.435+0000 7fd2413bc640 1 Processor -- start 2023-11-26T07:18:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.436+0000 7fd2413bc640 1 -- start start 2023-11-26T07:18:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd2413bc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd224003f30 0x7fd23c0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd2413bc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd23c15d420 0x7fd23c150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd2413bc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd23c09a630 0x7fd23c09aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd2413bc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c09b020 con 0x7fd23c09a630 2023-11-26T07:18:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd2413bc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c150b40 con 0x7fd23c15d420 2023-11-26T07:18:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd2413bc640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c15c230 con 0x7fd224003f30 2023-11-26T07:18:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd240bbb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd23c09a630 0x7fd23c09aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd240bbb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd23c09a630 0x7fd23c09aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54252/0 (socket says 172.21.15.77:54252) 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd240bbb640 1 -- 172.21.15.77:0/1123248817 learned_addr learned my addr 172.21.15.77:0/1123248817 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd23b7fe640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd23c15d420 0x7fd23c150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd240bbb640 1 -- 172.21.15.77:0/1123248817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd224003f30 msgr2=0x7fd23c0999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd240bbb640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd224003f30 0x7fd23c0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd240bbb640 1 -- 172.21.15.77:0/1123248817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd23c15d420 msgr2=0x7fd23c150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd240bbb640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd23c15d420 0x7fd23c150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.437+0000 7fd240bbb640 1 -- 172.21.15.77:0/1123248817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c09cce0 con 0x7fd23c09a630 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.438+0000 7fd240bbb640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd23c09a630 0x7fd23c09aae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd234009fd0 tx=0x7fd2340046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.438+0000 7fd238ff9640 1 -- 172.21.15.77:0/1123248817 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234007d20 con 0x7fd23c09a630 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.438+0000 7fd238ff9640 1 -- 172.21.15.77:0/1123248817 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd234007e80 con 0x7fd23c09a630 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.438+0000 7fd2413bc640 1 -- 172.21.15.77:0/1123248817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c15c4a0 con 0x7fd23c09a630 2023-11-26T07:18:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.438+0000 7fd238ff9640 1 -- 172.21.15.77:0/1123248817 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234014640 con 0x7fd23c09a630 2023-11-26T07:18:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.438+0000 7fd2413bc640 1 -- 172.21.15.77:0/1123248817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c15ca60 con 0x7fd23c09a630 2023-11-26T07:18:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.439+0000 7fd2413bc640 1 -- 172.21.15.77:0/1123248817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c15cc80 con 0x7fd23c09a630 2023-11-26T07:18:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.440+0000 7fd238ff9640 1 -- 172.21.15.77:0/1123248817 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd23401d3b0 con 0x7fd23c09a630 2023-11-26T07:18:10.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.441+0000 7fd238ff9640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd22806ae70 0x7fd22806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.441+0000 7fd238ff9640 1 -- 172.21.15.77:0/1123248817 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd234089320 con 0x7fd23c09a630 2023-11-26T07:18:10.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.441+0000 7fd23bfff640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd22806ae70 0x7fd22806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.442+0000 7fd23bfff640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd22806ae70 0x7fd22806d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0078d0 tx=0x7fd22c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.445+0000 7fd238ff9640 1 -- 172.21.15.77:0/1123248817 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd234054330 con 0x7fd23c09a630 2023-11-26T07:18:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.635+0000 7fd2413bc640 1 -- 172.21.15.77:0/1123248817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd23c04e840 con 0x7fd23c09a630 2023-11-26T07:18:10.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.635+0000 7fd238ff9640 1 -- 172.21.15.77:0/1123248817 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd234057950 con 0x7fd23c09a630 2023-11-26T07:18:10.638 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:18:10.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.638+0000 7fd2413bc640 1 -- 172.21.15.77:0/1123248817 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd22806ae70 msgr2=0x7fd22806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.638+0000 7fd2413bc640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd22806ae70 0x7fd22806d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0078d0 tx=0x7fd22c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.638+0000 7fd2413bc640 1 -- 172.21.15.77:0/1123248817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd23c09a630 msgr2=0x7fd23c09aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.638+0000 7fd2413bc640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd23c09a630 0x7fd23c09aae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd234009fd0 tx=0x7fd2340046e0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.638+0000 7fd2413bc640 1 -- 172.21.15.77:0/1123248817 shutdown_connections 2023-11-26T07:18:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.639+0000 7fd2413bc640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd22806ae70 0x7fd22806d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.639+0000 7fd2413bc640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd23c09a630 0x7fd23c09aae0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.639+0000 7fd2413bc640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd23c15d420 0x7fd23c150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.639+0000 7fd2413bc640 1 --2- 172.21.15.77:0/1123248817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd224003f30 0x7fd23c0999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.639+0000 7fd2413bc640 1 -- 172.21.15.77:0/1123248817 >> 172.21.15.77:0/1123248817 conn(0x7fd23c0cbb40 msgr2=0x7fd23c1590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.639+0000 7fd2413bc640 1 -- 172.21.15.77:0/1123248817 shutdown_connections 2023-11-26T07:18:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.639+0000 7fd2413bc640 1 -- 172.21.15.77:0/1123248817 wait complete. 2023-11-26T07:18:10.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:10.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.870+0000 7f07c367c640 1 Processor -- start 2023-11-26T07:18:10.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.870+0000 7f07c367c640 1 -- start start 2023-11-26T07:18:10.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.872+0000 7f07c367c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07bc0c59b0 0x7f07bc166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.872+0000 7f07c367c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07bc0c5dc0 con 0x7f07bc15b440 2023-11-26T07:18:10.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.872+0000 7f07c367c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07bc15eea0 con 0x7f07bc0cc0f0 2023-11-26T07:18:10.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.872+0000 7f07c367c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07bc15b820 con 0x7f07bc0c59b0 2023-11-26T07:18:10.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.872+0000 7f07c1c19640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07bc0c59b0 0x7f07bc166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.872+0000 7f07c1c19640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07bc0c59b0 0x7f07bc166230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54254/0 (socket says 172.21.15.77:54254) 2023-11-26T07:18:10.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.872+0000 7f07c1c19640 1 -- 172.21.15.77:0/4120924153 learned_addr learned my addr 172.21.15.77:0/4120924153 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:10.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.873+0000 7f07c1c19640 1 -- 172.21.15.77:0/4120924153 >> v1:172.21.15.159:6789/0 conn(0x7f07bc0cc0f0 legacy=0x7f07bc0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.873+0000 7f07c1c19640 1 -- 172.21.15.77:0/4120924153 >> v1:172.21.15.77:6789/0 conn(0x7f07bc15b440 legacy=0x7f07bc0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.873+0000 7f07c1c19640 1 -- 172.21.15.77:0/4120924153 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc06d600 con 0x7f07bc0c59b0 2023-11-26T07:18:10.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.874+0000 7f07c1c19640 1 --2- 172.21.15.77:0/4120924153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07bc0c59b0 0x7f07bc166230 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009e50 tx=0x7f07b402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf3a30380dab77e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.874+0000 7f07b3fff640 1 -- 172.21.15.77:0/4120924153 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b402ca80 con 0x7f07bc0c59b0 2023-11-26T07:18:10.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.874+0000 7f07b3fff640 1 -- 172.21.15.77:0/4120924153 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b402cbe0 con 0x7f07bc0c59b0 2023-11-26T07:18:10.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.874+0000 7f07b3fff640 1 -- 172.21.15.77:0/4120924153 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40343f0 con 0x7f07bc0c59b0 2023-11-26T07:18:10.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.875+0000 7f07c367c640 1 -- 172.21.15.77:0/4120924153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07bc0c59b0 msgr2=0x7f07bc166230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.875+0000 7f07c367c640 1 --2- 172.21.15.77:0/4120924153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07bc0c59b0 0x7f07bc166230 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009e50 tx=0x7f07b402bee0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.875+0000 7f07c367c640 1 -- 172.21.15.77:0/4120924153 shutdown_connections 2023-11-26T07:18:10.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.875+0000 7f07c367c640 1 --2- 172.21.15.77:0/4120924153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07bc0c59b0 0x7f07bc166230 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.875+0000 7f07c367c640 1 -- 172.21.15.77:0/4120924153 >> 172.21.15.77:0/4120924153 conn(0x7f07bc0b0c50 msgr2=0x7f07bc0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.875+0000 7f07c367c640 1 -- 172.21.15.77:0/4120924153 shutdown_connections 2023-11-26T07:18:10.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.875+0000 7f07c367c640 1 -- 172.21.15.77:0/4120924153 wait complete. 2023-11-26T07:18:10.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.877+0000 7f07c367c640 1 Processor -- start 2023-11-26T07:18:10.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.877+0000 7f07c367c640 1 -- start start 2023-11-26T07:18:10.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c367c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07bc0c59b0 0x7f07bc156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c367c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc0cc0f0 0x7f07bc0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c367c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07bc15b440 0x7f07bc155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c367c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc157670 con 0x7f07bc15b440 2023-11-26T07:18:10.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c367c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc1554b0 con 0x7f07bc0cc0f0 2023-11-26T07:18:10.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c367c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc0cdbb0 con 0x7f07bc0c59b0 2023-11-26T07:18:10.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c1c19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07bc15b440 0x7f07bc155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c1c19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07bc15b440 0x7f07bc155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54264/0 (socket says 172.21.15.77:54264) 2023-11-26T07:18:10.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c1c19640 1 -- 172.21.15.77:0/647671492 learned_addr learned my addr 172.21.15.77:0/647671492 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:10.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c0c17640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc0cc0f0 0x7f07bc0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c1418640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07bc0c59b0 0x7f07bc156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c1c19640 1 -- 172.21.15.77:0/647671492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07bc0c59b0 msgr2=0x7f07bc156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.878+0000 7f07c1c19640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07bc0c59b0 0x7f07bc156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.879+0000 7f07c1c19640 1 -- 172.21.15.77:0/647671492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc0cc0f0 msgr2=0x7f07bc0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.879+0000 7f07c1c19640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc0cc0f0 0x7f07bc0cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.879+0000 7f07c1c19640 1 -- 172.21.15.77:0/647671492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4009b30 con 0x7f07bc15b440 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.879+0000 7f07c0c17640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc0cc0f0 0x7f07bc0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.879+0000 7f07c1c19640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07bc15b440 0x7f07bc155c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f07b4036040 tx=0x7f07b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.879+0000 7f07b1ffb640 1 -- 172.21.15.77:0/647671492 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b403e450 con 0x7f07bc15b440 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.879+0000 7f07b1ffb640 1 -- 172.21.15.77:0/647671492 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b403e5d0 con 0x7f07bc15b440 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.879+0000 7f07b1ffb640 1 -- 172.21.15.77:0/647671492 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b403e980 con 0x7f07bc15b440 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.879+0000 7f07c367c640 1 -- 172.21.15.77:0/647671492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07bc0ce170 con 0x7f07bc15b440 2023-11-26T07:18:10.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.879+0000 7f07c367c640 1 -- 172.21.15.77:0/647671492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07bc155700 con 0x7f07bc15b440 2023-11-26T07:18:10.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.881+0000 7f07c367c640 1 -- 172.21.15.77:0/647671492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07bc0ce690 con 0x7f07bc15b440 2023-11-26T07:18:10.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.881+0000 7f07b1ffb640 1 -- 172.21.15.77:0/647671492 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07b402cd50 con 0x7f07bc15b440 2023-11-26T07:18:10.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.882+0000 7f07b1ffb640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f07a006ae70 0x7f07a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.882+0000 7f07b1ffb640 1 -- 172.21.15.77:0/647671492 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07b40abf20 con 0x7f07bc15b440 2023-11-26T07:18:10.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.883+0000 7f07c1418640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f07a006ae70 0x7f07a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.883+0000 7f07c1418640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f07a006ae70 0x7f07a006d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f07b8000f60 tx=0x7f07b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:10.887+0000 7f07b1ffb640 1 -- 172.21.15.77:0/647671492 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07b4076fc0 con 0x7f07bc15b440 2023-11-26T07:18:11.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.080+0000 7f07c367c640 1 -- 172.21.15.77:0/647671492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07bc1558f0 con 0x7f07bc15b440 2023-11-26T07:18:11.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.081+0000 7f07b1ffb640 1 -- 172.21.15.77:0/647671492 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07b407a5e0 con 0x7f07bc15b440 2023-11-26T07:18:11.084 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:18:11.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 -- 172.21.15.77:0/647671492 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f07a006ae70 msgr2=0x7f07a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f07a006ae70 0x7f07a006d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f07b8000f60 tx=0x7f07b8009040 comp rx=0 tx=0).stop 2023-11-26T07:18:11.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 -- 172.21.15.77:0/647671492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07bc15b440 msgr2=0x7f07bc155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07bc15b440 0x7f07bc155c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f07b4036040 tx=0x7f07b4004a40 comp rx=0 tx=0).stop 2023-11-26T07:18:11.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 -- 172.21.15.77:0/647671492 shutdown_connections 2023-11-26T07:18:11.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f07a006ae70 0x7f07a006d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07bc15b440 0x7f07bc155c20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc0cc0f0 0x7f07bc0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 --2- 172.21.15.77:0/647671492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07bc0c59b0 0x7f07bc156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 -- 172.21.15.77:0/647671492 >> 172.21.15.77:0/647671492 conn(0x7f07bc0b0c50 msgr2=0x7f07bc0cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 -- 172.21.15.77:0/647671492 shutdown_connections 2023-11-26T07:18:11.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.084+0000 7f07c367c640 1 -- 172.21.15.77:0/647671492 wait complete. 2023-11-26T07:18:11.106 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:11.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.315+0000 7f206ffff640 1 Processor -- start 2023-11-26T07:18:11.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.315+0000 7f206ffff640 1 -- start start 2023-11-26T07:18:11.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.317+0000 7f206ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f207014b100 0x7f2070162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.317+0000 7f206ffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20700cd160 0x7f20700cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.317+0000 7f206ffff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2070162eb0 con 0x7f20700703f0 2023-11-26T07:18:11.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.317+0000 7f206ffff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20701654a0 con 0x7f207014b100 2023-11-26T07:18:11.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.317+0000 7f206ffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20700ccf00 con 0x7f20700cd160 2023-11-26T07:18:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.317+0000 7f206effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f207014b100 0x7f2070162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.317+0000 7f20667fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f20700703f0 0x7f2070165c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49782/0 (socket says 172.21.15.77:49782) 2023-11-26T07:18:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.317+0000 7f20667fc640 1 -- 172.21.15.77:0/3746826819 learned_addr learned my addr 172.21.15.77:0/3746826819 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.318+0000 7f206f7fe640 1 --2- 172.21.15.77:0/3746826819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20700cd160 0x7f20700cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.318+0000 7f206effd640 1 -- 172.21.15.77:0/3746826819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20700cd160 msgr2=0x7f20700cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.318+0000 7f206effd640 1 --2- 172.21.15.77:0/3746826819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20700cd160 0x7f20700cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.318+0000 7f206effd640 1 -- 172.21.15.77:0/3746826819 >> v1:172.21.15.77:6789/0 conn(0x7f20700703f0 legacy=0x7f2070165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.318+0000 7f206effd640 1 -- 172.21.15.77:0/3746826819 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2070166320 con 0x7f207014b100 2023-11-26T07:18:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.318+0000 7f206f7fe640 1 --2- 172.21.15.77:0/3746826819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20700cd160 0x7f20700cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:11.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.319+0000 7f206effd640 1 --2- 172.21.15.77:0/3746826819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f207014b100 0x7f2070162970 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f20600097a0 tx=0x7f206002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d633087c0840c4c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.319+0000 7f206e7fc640 1 -- 172.21.15.77:0/3746826819 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060031780 con 0x7f207014b100 2023-11-26T07:18:11.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.319+0000 7f206e7fc640 1 -- 172.21.15.77:0/3746826819 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20600318e0 con 0x7f207014b100 2023-11-26T07:18:11.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.319+0000 7f206e7fc640 1 -- 172.21.15.77:0/3746826819 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060031c70 con 0x7f207014b100 2023-11-26T07:18:11.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.320+0000 7f206ffff640 1 -- 172.21.15.77:0/3746826819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f207014b100 msgr2=0x7f2070162970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.320+0000 7f206ffff640 1 --2- 172.21.15.77:0/3746826819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f207014b100 0x7f2070162970 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f20600097a0 tx=0x7f206002b820 comp rx=0 tx=0).stop 2023-11-26T07:18:11.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.320+0000 7f206ffff640 1 -- 172.21.15.77:0/3746826819 shutdown_connections 2023-11-26T07:18:11.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.320+0000 7f206ffff640 1 --2- 172.21.15.77:0/3746826819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20700cd160 0x7f20700cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.320+0000 7f206ffff640 1 --2- 172.21.15.77:0/3746826819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f207014b100 0x7f2070162970 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.320+0000 7f206ffff640 1 -- 172.21.15.77:0/3746826819 >> 172.21.15.77:0/3746826819 conn(0x7f20700cb830 msgr2=0x7f20700cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.320+0000 7f206ffff640 1 -- 172.21.15.77:0/3746826819 shutdown_connections 2023-11-26T07:18:11.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.320+0000 7f206ffff640 1 -- 172.21.15.77:0/3746826819 wait complete. 2023-11-26T07:18:11.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.322+0000 7f206ffff640 1 Processor -- start 2023-11-26T07:18:11.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.322+0000 7f206ffff640 1 -- start start 2023-11-26T07:18:11.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.323+0000 7f206ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700703f0 0x7f20700b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.323+0000 7f206ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20700cd160 0x7f2070149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.323+0000 7f206ffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f207014b100 0x7f20700afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.323+0000 7f206ffff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20700b2e10 con 0x7f20700703f0 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.323+0000 7f206ffff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20700ac220 con 0x7f20700cd160 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.323+0000 7f206ffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20700b38e0 con 0x7f207014b100 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.323+0000 7f206effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700703f0 0x7f20700b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.323+0000 7f206effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700703f0 0x7f20700b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54276/0 (socket says 172.21.15.77:54276) 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.323+0000 7f206effd640 1 -- 172.21.15.77:0/3725119348 learned_addr learned my addr 172.21.15.77:0/3725119348 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.324+0000 7f20667fc640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20700cd160 0x7f2070149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.324+0000 7f206effd640 1 -- 172.21.15.77:0/3725119348 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f207014b100 msgr2=0x7f20700afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.324+0000 7f206effd640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f207014b100 0x7f20700afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.324+0000 7f206effd640 1 -- 172.21.15.77:0/3725119348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20700cd160 msgr2=0x7f2070149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.324+0000 7f206effd640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20700cd160 0x7f2070149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.324+0000 7f206effd640 1 -- 172.21.15.77:0/3725119348 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2060009400 con 0x7f20700703f0 2023-11-26T07:18:11.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.324+0000 7f206effd640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700703f0 0x7f20700b28d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2060034040 tx=0x7f20600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.324+0000 7f2067fff640 1 -- 172.21.15.77:0/3725119348 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060032820 con 0x7f20700703f0 2023-11-26T07:18:11.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.324+0000 7f2067fff640 1 -- 172.21.15.77:0/3725119348 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2060032980 con 0x7f20700703f0 2023-11-26T07:18:11.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.324+0000 7f2067fff640 1 -- 172.21.15.77:0/3725119348 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060032d30 con 0x7f20700703f0 2023-11-26T07:18:11.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.324+0000 7f206ffff640 1 -- 172.21.15.77:0/3725119348 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207014a250 con 0x7f20700703f0 2023-11-26T07:18:11.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.325+0000 7f206ffff640 1 -- 172.21.15.77:0/3725119348 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20700b3320 con 0x7f20700703f0 2023-11-26T07:18:11.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.326+0000 7f206ffff640 1 -- 172.21.15.77:0/3725119348 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207004e840 con 0x7f20700703f0 2023-11-26T07:18:11.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.326+0000 7f2067fff640 1 -- 172.21.15.77:0/3725119348 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f206004e440 con 0x7f20700703f0 2023-11-26T07:18:11.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.327+0000 7f2067fff640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f205006ae40 0x7f205006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.327+0000 7f2067fff640 1 -- 172.21.15.77:0/3725119348 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20600ab700 con 0x7f20700703f0 2023-11-26T07:18:11.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.328+0000 7f20667fc640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f205006ae40 0x7f205006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.328+0000 7f20667fc640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f205006ae40 0x7f205006d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20700b4350 tx=0x7f2058009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.332+0000 7f2067fff640 1 -- 172.21.15.77:0/3725119348 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2060076840 con 0x7f20700703f0 2023-11-26T07:18:11.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.523+0000 7f206ffff640 1 -- 172.21.15.77:0/3725119348 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20700b4b70 con 0x7f20700703f0 2023-11-26T07:18:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.526+0000 7f2067fff640 1 -- 172.21.15.77:0/3725119348 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f2060079e60 con 0x7f20700703f0 2023-11-26T07:18:11.528 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:11.529 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:36.274387+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 -- 172.21.15.77:0/3725119348 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f205006ae40 msgr2=0x7f205006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f205006ae40 0x7f205006d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20700b4350 tx=0x7f2058009040 comp rx=0 tx=0).stop 2023-11-26T07:18:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 -- 172.21.15.77:0/3725119348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700703f0 msgr2=0x7f20700b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700703f0 0x7f20700b28d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2060034040 tx=0x7f20600046c0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 -- 172.21.15.77:0/3725119348 shutdown_connections 2023-11-26T07:18:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f205006ae40 0x7f205006d300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f207014b100 0x7f20700afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20700cd160 0x7f2070149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 --2- 172.21.15.77:0/3725119348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700703f0 0x7f20700b28d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 -- 172.21.15.77:0/3725119348 >> 172.21.15.77:0/3725119348 conn(0x7f20700cb830 msgr2=0x7f20700cd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 -- 172.21.15.77:0/3725119348 shutdown_connections 2023-11-26T07:18:11.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.528+0000 7f206ffff640 1 -- 172.21.15.77:0/3725119348 wait complete. 2023-11-26T07:18:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:11.551 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:11.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.766+0000 7fbae2615640 1 Processor -- start 2023-11-26T07:18:11.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.766+0000 7fbae2615640 1 -- start start 2023-11-26T07:18:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.767+0000 7fbae2615640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbadc0b1ed0 0x7fbadc1681d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.767+0000 7fbae2615640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbadc15db00 con 0x7fbadc0d3a40 2023-11-26T07:18:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.767+0000 7fbae2615640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbadc06d1a0 con 0x7fbadc15d720 2023-11-26T07:18:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.767+0000 7fbae2615640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbadc0d0ce0 con 0x7fbadc0b1ed0 2023-11-26T07:18:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.768+0000 7fbadb7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbadc0d3a40 0x7fbadc06ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49784/0 (socket says 172.21.15.77:49784) 2023-11-26T07:18:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.768+0000 7fbadb7fe640 1 -- 172.21.15.77:0/1892906793 learned_addr learned my addr 172.21.15.77:0/1892906793 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:11.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.768+0000 7fbae0bb2640 1 --2- 172.21.15.77:0/1892906793 >> v2:172.21.15.159:3300/0 conn(0x7fbadc0b1ed0 0x7fbadc1681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.768+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180629531 0 0) 0x7fbadc15db00 con 0x7fbadc0d3a40 2023-11-26T07:18:11.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.768+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbac8003520 con 0x7fbadc0d3a40 2023-11-26T07:18:11.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3690875559 0 0) 0x7fbac8003520 con 0x7fbadc0d3a40 2023-11-26T07:18:11.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 >> v2:172.21.15.159:3300/0 conn(0x7fbadc0b1ed0 msgr2=0x7fbadc1681d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 --2- 172.21.15.77:0/1892906793 >> v2:172.21.15.159:3300/0 conn(0x7fbadc0b1ed0 0x7fbadc1681d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 >> v1:172.21.15.159:6789/0 conn(0x7fbadc15d720 legacy=0x7fbadc0d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc06d400 con 0x7fbadc0d3a40 2023-11-26T07:18:11.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fbac4001670 con 0x7fbadc0d3a40 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 >> v1:172.21.15.77:6789/0 conn(0x7fbadc0d3a40 legacy=0x7fbadc06ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 --2- 172.21.15.77:0/1892906793 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbac8003970 0x7fbac8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 --2- 172.21.15.77:0/1892906793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbac80047c0 0x7fbac8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 --2- 172.21.15.77:0/1892906793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbac8005180 0x7fbac800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc0d0ce0 con 0x7fbac80047c0 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac800c120 con 0x7fbac8005180 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac800c2e0 con 0x7fbac8003970 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadb7fe640 1 --2- 172.21.15.77:0/1892906793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbac80047c0 0x7fbac8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadb7fe640 1 -- 172.21.15.77:0/1892906793 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbac8003970 msgr2=0x7fbac8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadb7fe640 1 --2- 172.21.15.77:0/1892906793 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbac8003970 0x7fbac8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadb7fe640 1 -- 172.21.15.77:0/1892906793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbac8005180 msgr2=0x7fbac800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadb7fe640 1 --2- 172.21.15.77:0/1892906793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbac8005180 0x7fbac800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbae0bb2640 1 -- 172.21.15.77:0/1892906793 reap_dead start 2023-11-26T07:18:11.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.769+0000 7fbadb7fe640 1 -- 172.21.15.77:0/1892906793 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8003520 con 0x7fbac80047c0 2023-11-26T07:18:11.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.770+0000 7fbadb7fe640 1 --2- 172.21.15.77:0/1892906793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbac80047c0 0x7fbac8004c40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbac4007fd0 tx=0x7fbac80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d2918e055d8a4f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.771+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4005ad0 con 0x7fbac80047c0 2023-11-26T07:18:11.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.771+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac4005c30 con 0x7fbac80047c0 2023-11-26T07:18:11.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.771+0000 7fbadaffd640 1 -- 172.21.15.77:0/1892906793 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac402cab0 con 0x7fbac80047c0 2023-11-26T07:18:11.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.771+0000 7fbae2615640 1 -- 172.21.15.77:0/1892906793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbac80047c0 msgr2=0x7fbac8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.771+0000 7fbae2615640 1 --2- 172.21.15.77:0/1892906793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbac80047c0 0x7fbac8004c40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbac4007fd0 tx=0x7fbac80057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.771+0000 7fbae2615640 1 -- 172.21.15.77:0/1892906793 shutdown_connections 2023-11-26T07:18:11.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.771+0000 7fbae2615640 1 --2- 172.21.15.77:0/1892906793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbac80047c0 0x7fbac8004c40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.771+0000 7fbae2615640 1 -- 172.21.15.77:0/1892906793 >> 172.21.15.77:0/1892906793 conn(0x7fbadc08af60 msgr2=0x7fbadc09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.771+0000 7fbae2615640 1 -- 172.21.15.77:0/1892906793 shutdown_connections 2023-11-26T07:18:11.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.772+0000 7fbae2615640 1 -- 172.21.15.77:0/1892906793 wait complete. 2023-11-26T07:18:11.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.773+0000 7fbae2615640 1 Processor -- start 2023-11-26T07:18:11.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.773+0000 7fbae2615640 1 -- start start 2023-11-26T07:18:11.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.774+0000 7fbae2615640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbac80047c0 0x7fbadc1605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.774+0000 7fbae2615640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbadc0cbfc0 0x7fbadc148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.774+0000 7fbae2615640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbadc148ec0 0x7fbadc146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.774+0000 7fbae2615640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc149350 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.774+0000 7fbae2615640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc0cb550 con 0x7fbac80047c0 2023-11-26T07:18:11.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.774+0000 7fbae2615640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc1f3090 con 0x7fbadc148ec0 2023-11-26T07:18:11.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.775+0000 7fbadb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbadc0cbfc0 0x7fbadc148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.775+0000 7fbadb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbadc0cbfc0 0x7fbadc148980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54294/0 (socket says 172.21.15.77:54294) 2023-11-26T07:18:11.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.775+0000 7fbadb7fe640 1 -- 172.21.15.77:0/1880878360 learned_addr learned my addr 172.21.15.77:0/1880878360 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:11.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.775+0000 7fbadb7fe640 1 -- 172.21.15.77:0/1880878360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbadc148ec0 msgr2=0x7fbadc146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.775+0000 7fbadb7fe640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbadc148ec0 0x7fbadc146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.775+0000 7fbadb7fe640 1 -- 172.21.15.77:0/1880878360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbac80047c0 msgr2=0x7fbadc1605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.775+0000 7fbadbfff640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbac80047c0 0x7fbadc1605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.775+0000 7fbadb7fe640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbac80047c0 0x7fbadc1605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.775+0000 7fbadb7fe640 1 -- 172.21.15.77:0/1880878360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc0b6390 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.775+0000 7fbadb7fe640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbadc0cbfc0 0x7fbadc148980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbac402c410 tx=0x7fbac402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.776+0000 7fbad8ff9640 1 -- 172.21.15.77:0/1880878360 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac403c040 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.776+0000 7fbad8ff9640 1 -- 172.21.15.77:0/1880878360 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac402cd40 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.776+0000 7fbad8ff9640 1 -- 172.21.15.77:0/1880878360 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4007290 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.776+0000 7fbae2615640 1 -- 172.21.15.77:0/1880878360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbadc0cb7c0 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.776+0000 7fbae2615640 1 -- 172.21.15.77:0/1880878360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbadc0cc440 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.777+0000 7fbae2615640 1 -- 172.21.15.77:0/1880878360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbadc072000 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.778+0000 7fbad8ff9640 1 -- 172.21.15.77:0/1880878360 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbac4032070 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.779+0000 7fbad8ff9640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbabc06ae40 0x7fbabc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.779+0000 7fbad8ff9640 1 -- 172.21.15.77:0/1880878360 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbac40aabd0 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.780+0000 7fbadbfff640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbabc06ae40 0x7fbabc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.780+0000 7fbadbfff640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbabc06ae40 0x7fbabc06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbacc001d00 tx=0x7fbacc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.784+0000 7fbad8ff9640 1 -- 172.21.15.77:0/1880878360 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbac4075c60 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.974+0000 7fbae2615640 1 -- 172.21.15.77:0/1880878360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbadc04e8b0 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.975+0000 7fbad8ff9640 1 -- 172.21.15.77:0/1880878360 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbac4079280 con 0x7fbadc0cbfc0 2023-11-26T07:18:11.978 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:18:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.977+0000 7fbae2615640 1 -- 172.21.15.77:0/1880878360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbabc06ae40 msgr2=0x7fbabc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.977+0000 7fbae2615640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbabc06ae40 0x7fbabc06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbacc001d00 tx=0x7fbacc009040 comp rx=0 tx=0).stop 2023-11-26T07:18:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.977+0000 7fbae2615640 1 -- 172.21.15.77:0/1880878360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbadc0cbfc0 msgr2=0x7fbadc148980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.977+0000 7fbae2615640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbadc0cbfc0 0x7fbadc148980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbac402c410 tx=0x7fbac402e070 comp rx=0 tx=0).stop 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.977+0000 7fbae2615640 1 -- 172.21.15.77:0/1880878360 shutdown_connections 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.977+0000 7fbae2615640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbabc06ae40 0x7fbabc06d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.977+0000 7fbae2615640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbadc148ec0 0x7fbadc146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.977+0000 7fbae2615640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbadc0cbfc0 0x7fbadc148980 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.977+0000 7fbae2615640 1 --2- 172.21.15.77:0/1880878360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbac80047c0 0x7fbadc1605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.977+0000 7fbae2615640 1 -- 172.21.15.77:0/1880878360 >> 172.21.15.77:0/1880878360 conn(0x7fbadc08af60 msgr2=0x7fbadc0b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.978+0000 7fbae2615640 1 -- 172.21.15.77:0/1880878360 shutdown_connections 2023-11-26T07:18:11.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:11.978+0000 7fbae2615640 1 -- 172.21.15.77:0/1880878360 wait complete. 2023-11-26T07:18:11.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:12.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.209+0000 7f0a2fd68640 1 Processor -- start 2023-11-26T07:18:12.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.209+0000 7f0a2fd68640 1 -- start start 2023-11-26T07:18:12.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.211+0000 7f0a2fd68640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0a280c59b0 0x7f0a28166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.211+0000 7f0a2fd68640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a280c5dc0 con 0x7f0a280cc0f0 2023-11-26T07:18:12.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.211+0000 7f0a2fd68640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2815eea0 con 0x7f0a2815b440 2023-11-26T07:18:12.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.211+0000 7f0a2fd68640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2815b820 con 0x7f0a280c59b0 2023-11-26T07:18:12.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.211+0000 7f0a2d303640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0a280cc0f0 0x7f0a280c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49786/0 (socket says 172.21.15.77:49786) 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.211+0000 7f0a2d303640 1 -- 172.21.15.77:0/2411187371 learned_addr learned my addr 172.21.15.77:0/2411187371 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2e305640 1 --2- 172.21.15.77:0/2411187371 >> v2:172.21.15.159:3300/0 conn(0x7f0a280c59b0 0x7f0a28166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262078681 0 0) 0x7f0a280c5dc0 con 0x7f0a280cc0f0 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a14003520 con 0x7f0a280cc0f0 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3082859931 0 0) 0x7f0a14003520 con 0x7f0a280cc0f0 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 >> v2:172.21.15.159:3300/0 conn(0x7f0a280c59b0 msgr2=0x7f0a28166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 --2- 172.21.15.77:0/2411187371 >> v2:172.21.15.159:3300/0 conn(0x7f0a280c59b0 0x7f0a28166230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 >> v1:172.21.15.159:6789/0 conn(0x7f0a2815b440 legacy=0x7f0a280cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2806d600 con 0x7f0a280cc0f0 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f0a18001670 con 0x7f0a280cc0f0 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 >> v1:172.21.15.77:6789/0 conn(0x7f0a280cc0f0 legacy=0x7f0a280c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 --2- 172.21.15.77:0/2411187371 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a140039c0 0x7f0a14003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 --2- 172.21.15.77:0/2411187371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a140047c0 0x7f0a14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 --2- 172.21.15.77:0/2411187371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a140051d0 0x7f0a1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815b820 con 0x7f0a140047c0 2023-11-26T07:18:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1400c120 con 0x7f0a140051d0 2023-11-26T07:18:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.212+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1400c2e0 con 0x7f0a140039c0 2023-11-26T07:18:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.213+0000 7f0a2d303640 1 --2- 172.21.15.77:0/2411187371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a140047c0 0x7f0a14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.213+0000 7f0a2db04640 1 --2- 172.21.15.77:0/2411187371 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a140039c0 0x7f0a14003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.213+0000 7f0a2e305640 1 --2- 172.21.15.77:0/2411187371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a140051d0 0x7f0a1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.213+0000 7f0a2d303640 1 -- 172.21.15.77:0/2411187371 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a140039c0 msgr2=0x7f0a14003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.213+0000 7f0a2d303640 1 --2- 172.21.15.77:0/2411187371 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a140039c0 0x7f0a14003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.213+0000 7f0a2d303640 1 -- 172.21.15.77:0/2411187371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a140051d0 msgr2=0x7f0a1400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:12.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.213+0000 7f0a2d303640 1 --2- 172.21.15.77:0/2411187371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a140051d0 0x7f0a1400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.213+0000 7f0a2e305640 1 -- 172.21.15.77:0/2411187371 reap_dead start 2023-11-26T07:18:12.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.213+0000 7f0a2d303640 1 -- 172.21.15.77:0/2411187371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a14003520 con 0x7f0a140047c0 2023-11-26T07:18:12.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.214+0000 7f0a2d303640 1 --2- 172.21.15.77:0/2411187371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a140047c0 0x7f0a14004c40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0a18007fb0 tx=0x7f0a140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb3a9cf11d6c026 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.215+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18005ad0 con 0x7f0a140047c0 2023-11-26T07:18:12.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.215+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a18005c50 con 0x7f0a140047c0 2023-11-26T07:18:12.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.215+0000 7f0a2cb02640 1 -- 172.21.15.77:0/2411187371 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1802c7c0 con 0x7f0a140047c0 2023-11-26T07:18:12.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.215+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2411187371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a140047c0 msgr2=0x7f0a14004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.215+0000 7f0a2fd68640 1 --2- 172.21.15.77:0/2411187371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a140047c0 0x7f0a14004c40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0a18007fb0 tx=0x7f0a140057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.215+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2411187371 shutdown_connections 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.215+0000 7f0a2fd68640 1 --2- 172.21.15.77:0/2411187371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a140047c0 0x7f0a14004c40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.215+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2411187371 >> 172.21.15.77:0/2411187371 conn(0x7f0a280b0c50 msgr2=0x7f0a280b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.215+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2411187371 shutdown_connections 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.215+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2411187371 wait complete. 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.217+0000 7f0a2fd68640 1 Processor -- start 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.217+0000 7f0a2fd68640 1 -- start start 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.218+0000 7f0a2fd68640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a140047c0 0x7f0a280c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.218+0000 7f0a2fd68640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a280c83f0 0x7f0a28150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.218+0000 7f0a2fd68640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a28155be0 0x7f0a28156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.218+0000 7f0a2fd68640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280b1f00 con 0x7f0a280c83f0 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.218+0000 7f0a2fd68640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a281565a0 con 0x7f0a28155be0 2023-11-26T07:18:12.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.218+0000 7f0a2fd68640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a281e4c70 con 0x7f0a140047c0 2023-11-26T07:18:12.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.218+0000 7f0a2d303640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a280c83f0 0x7f0a28150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.218+0000 7f0a2d303640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a280c83f0 0x7f0a28150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54318/0 (socket says 172.21.15.77:54318) 2023-11-26T07:18:12.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.218+0000 7f0a2d303640 1 -- 172.21.15.77:0/2250160995 learned_addr learned my addr 172.21.15.77:0/2250160995 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.219+0000 7f0a2d303640 1 -- 172.21.15.77:0/2250160995 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a140047c0 msgr2=0x7f0a280c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.219+0000 7f0a2d303640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a140047c0 0x7f0a280c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.219+0000 7f0a2d303640 1 -- 172.21.15.77:0/2250160995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a28155be0 msgr2=0x7f0a28156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.219+0000 7f0a2e305640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a28155be0 0x7f0a28156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.219+0000 7f0a2d303640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a28155be0 0x7f0a28156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.219+0000 7f0a2d303640 1 -- 172.21.15.77:0/2250160995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a280c8b90 con 0x7f0a280c83f0 2023-11-26T07:18:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.219+0000 7f0a2d303640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a280c83f0 0x7f0a28150a80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a18007fb0 tx=0x7f0a1802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.219+0000 7f0a1e7fc640 1 -- 172.21.15.77:0/2250160995 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1803c040 con 0x7f0a280c83f0 2023-11-26T07:18:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.219+0000 7f0a1e7fc640 1 -- 172.21.15.77:0/2250160995 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1802cc90 con 0x7f0a280c83f0 2023-11-26T07:18:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.219+0000 7f0a1e7fc640 1 -- 172.21.15.77:0/2250160995 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18007070 con 0x7f0a280c83f0 2023-11-26T07:18:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.219+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2250160995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a280c8e70 con 0x7f0a280c83f0 2023-11-26T07:18:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.220+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2250160995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a281e5210 con 0x7f0a280c83f0 2023-11-26T07:18:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.221+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2250160995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2804e8b0 con 0x7f0a280c83f0 2023-11-26T07:18:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.222+0000 7f0a1e7fc640 1 -- 172.21.15.77:0/2250160995 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a18032070 con 0x7f0a280c83f0 2023-11-26T07:18:12.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.222+0000 7f0a1e7fc640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0c06ae40 0x7f0a0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.223+0000 7f0a1e7fc640 1 -- 172.21.15.77:0/2250160995 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a180aaab0 con 0x7f0a280c83f0 2023-11-26T07:18:12.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.223+0000 7f0a2db04640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0c06ae40 0x7f0a0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.223+0000 7f0a2db04640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0c06ae40 0x7f0a0c06d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a24007fd0 tx=0x7f0a24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.227+0000 7f0a1e7fc640 1 -- 172.21.15.77:0/2250160995 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a18075ac0 con 0x7f0a280c83f0 2023-11-26T07:18:12.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.416+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2250160995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a280c9af0 con 0x7f0a280c83f0 2023-11-26T07:18:12.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.417+0000 7f0a1e7fc640 1 -- 172.21.15.77:0/2250160995 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a180790e0 con 0x7f0a280c83f0 2023-11-26T07:18:12.419 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:18:12.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.419+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2250160995 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0c06ae40 msgr2=0x7f0a0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.419+0000 7f0a2fd68640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0c06ae40 0x7f0a0c06d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a24007fd0 tx=0x7f0a24009040 comp rx=0 tx=0).stop 2023-11-26T07:18:12.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.419+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2250160995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a280c83f0 msgr2=0x7f0a28150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.419+0000 7f0a2fd68640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a280c83f0 0x7f0a28150a80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a18007fb0 tx=0x7f0a1802e070 comp rx=0 tx=0).stop 2023-11-26T07:18:12.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.420+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2250160995 shutdown_connections 2023-11-26T07:18:12.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.420+0000 7f0a2fd68640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0c06ae40 0x7f0a0c06d300 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.420+0000 7f0a2fd68640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a28155be0 0x7f0a28156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.420+0000 7f0a2fd68640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a280c83f0 0x7f0a28150a80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.420+0000 7f0a2fd68640 1 --2- 172.21.15.77:0/2250160995 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a140047c0 0x7f0a280c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.420+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2250160995 >> 172.21.15.77:0/2250160995 conn(0x7f0a280b0c50 msgr2=0x7f0a280c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.420+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2250160995 shutdown_connections 2023-11-26T07:18:12.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.420+0000 7f0a2fd68640 1 -- 172.21.15.77:0/2250160995 wait complete. 2023-11-26T07:18:12.440 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:12.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.648+0000 7fe12c4ee640 1 Processor -- start 2023-11-26T07:18:12.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.648+0000 7fe12c4ee640 1 -- start start 2023-11-26T07:18:12.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.650+0000 7fe12c4ee640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe1240cfb90 0x7fe124161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.650+0000 7fe12c4ee640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1241612f0 con 0x7fe124161fa0 2023-11-26T07:18:12.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.650+0000 7fe12c4ee640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12406a850 con 0x7fe1240b2400 2023-11-26T07:18:12.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.650+0000 7fe12c4ee640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1240cff70 con 0x7fe1240cfb90 2023-11-26T07:18:12.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.650+0000 7fe129a89640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe124161fa0 0x7fe12406ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49796/0 (socket says 172.21.15.77:49796) 2023-11-26T07:18:12.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.650+0000 7fe129a89640 1 -- 172.21.15.77:0/3065225852 learned_addr learned my addr 172.21.15.77:0/3065225852 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:12.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe12a28a640 1 --2- 172.21.15.77:0/3065225852 >> v2:172.21.15.159:3300/0 conn(0x7fe1240cfb90 0x7fe124161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576052280 0 0) 0x7fe1241612f0 con 0x7fe124161fa0 2023-11-26T07:18:12.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe110003520 con 0x7fe124161fa0 2023-11-26T07:18:12.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145076988 0 0) 0x7fe110003520 con 0x7fe124161fa0 2023-11-26T07:18:12.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 >> v2:172.21.15.159:3300/0 conn(0x7fe1240cfb90 msgr2=0x7fe124161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:12.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 --2- 172.21.15.77:0/3065225852 >> v2:172.21.15.159:3300/0 conn(0x7fe1240cfb90 0x7fe124161a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 >> v1:172.21.15.159:6789/0 conn(0x7fe1240b2400 legacy=0x7fe1240cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12406ab30 con 0x7fe124161fa0 2023-11-26T07:18:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fe114001670 con 0x7fe124161fa0 2023-11-26T07:18:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 >> v1:172.21.15.77:6789/0 conn(0x7fe124161fa0 legacy=0x7fe12406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe110003970 0x7fe110003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1100047c0 0x7fe110004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.651+0000 7fe129288640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe110005180 0x7fe11000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240cff70 con 0x7fe110005180 2023-11-26T07:18:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11000c030 con 0x7fe1100047c0 2023-11-26T07:18:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11000c1f0 con 0x7fe110003970 2023-11-26T07:18:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe12aa8b640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe110005180 0x7fe11000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe129a89640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1100047c0 0x7fe110004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe12a28a640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe110003970 0x7fe110003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe12aa8b640 1 -- 172.21.15.77:0/3065225852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe110003970 msgr2=0x7fe110003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:12.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe12aa8b640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe110003970 0x7fe110003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe12aa8b640 1 -- 172.21.15.77:0/3065225852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1100047c0 msgr2=0x7fe110004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:12.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe12aa8b640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1100047c0 0x7fe110004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe12aa8b640 1 -- 172.21.15.77:0/3065225852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110003520 con 0x7fe110005180 2023-11-26T07:18:12.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.652+0000 7fe129a89640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1100047c0 0x7fe110004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:12.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.653+0000 7fe12aa8b640 1 -- 172.21.15.77:0/3065225852 reap_dead start 2023-11-26T07:18:12.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.653+0000 7fe12aa8b640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe110005180 0x7fe11000b980 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe11c001e50 tx=0x7fe1100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c714e5adbd958959 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.653+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c003b70 con 0x7fe110005180 2023-11-26T07:18:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.653+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c003d10 con 0x7fe110005180 2023-11-26T07:18:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.653+0000 7fe129288640 1 -- 172.21.15.77:0/3065225852 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c005310 con 0x7fe110005180 2023-11-26T07:18:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.654+0000 7fe12c4ee640 1 -- 172.21.15.77:0/3065225852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe110005180 msgr2=0x7fe11000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.654+0000 7fe12c4ee640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe110005180 0x7fe11000b980 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe11c001e50 tx=0x7fe1100057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.654+0000 7fe12c4ee640 1 -- 172.21.15.77:0/3065225852 shutdown_connections 2023-11-26T07:18:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.654+0000 7fe12c4ee640 1 --2- 172.21.15.77:0/3065225852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe110005180 0x7fe11000b980 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.654+0000 7fe12c4ee640 1 -- 172.21.15.77:0/3065225852 >> 172.21.15.77:0/3065225852 conn(0x7fe1240999d0 msgr2=0x7fe1240b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.654+0000 7fe12c4ee640 1 -- 172.21.15.77:0/3065225852 shutdown_connections 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.654+0000 7fe12c4ee640 1 -- 172.21.15.77:0/3065225852 wait complete. 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.656+0000 7fe12c4ee640 1 Processor -- start 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.656+0000 7fe12c4ee640 1 -- start start 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.657+0000 7fe12c4ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe110005180 0x7fe1240c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.657+0000 7fe12c4ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe124148540 0x7fe1240b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.657+0000 7fe12c4ee640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1240b3f60 0x7fe1240cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.657+0000 7fe12c4ee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240afb20 con 0x7fe124148540 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.657+0000 7fe12c4ee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe124157c60 con 0x7fe110005180 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.657+0000 7fe12c4ee640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe124157f40 con 0x7fe1240b3f60 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.657+0000 7fe129a89640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe124148540 0x7fe1240b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.657+0000 7fe129a89640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe124148540 0x7fe1240b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54340/0 (socket says 172.21.15.77:54340) 2023-11-26T07:18:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.657+0000 7fe129a89640 1 -- 172.21.15.77:0/1027751202 learned_addr learned my addr 172.21.15.77:0/1027751202 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.658+0000 7fe129a89640 1 -- 172.21.15.77:0/1027751202 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1240b3f60 msgr2=0x7fe1240cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.658+0000 7fe129a89640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1240b3f60 0x7fe1240cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.658+0000 7fe12a28a640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe110005180 0x7fe1240c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.658+0000 7fe129a89640 1 -- 172.21.15.77:0/1027751202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe110005180 msgr2=0x7fe1240c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.658+0000 7fe129a89640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe110005180 0x7fe1240c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.658+0000 7fe129a89640 1 -- 172.21.15.77:0/1027751202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124158220 con 0x7fe124148540 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.658+0000 7fe129a89640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe124148540 0x7fe1240b3a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe114001200 tx=0x7fe11400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.658+0000 7fe11affd640 1 -- 172.21.15.77:0/1027751202 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140074e0 con 0x7fe124148540 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.658+0000 7fe11affd640 1 -- 172.21.15.77:0/1027751202 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe114007640 con 0x7fe124148540 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.658+0000 7fe11affd640 1 -- 172.21.15.77:0/1027751202 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140049e0 con 0x7fe124148540 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.658+0000 7fe12c4ee640 1 -- 172.21.15.77:0/1027751202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe124158500 con 0x7fe124148540 2023-11-26T07:18:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.659+0000 7fe12c4ee640 1 -- 172.21.15.77:0/1027751202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1241578f0 con 0x7fe124148540 2023-11-26T07:18:12.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.660+0000 7fe12c4ee640 1 -- 172.21.15.77:0/1027751202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe124061290 con 0x7fe124148540 2023-11-26T07:18:12.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.661+0000 7fe11affd640 1 -- 172.21.15.77:0/1027751202 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe114004b40 con 0x7fe124148540 2023-11-26T07:18:12.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.661+0000 7fe11affd640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe10806ae70 0x7fe10806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.662+0000 7fe11affd640 1 -- 172.21.15.77:0/1027751202 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe114088fc0 con 0x7fe124148540 2023-11-26T07:18:12.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.662+0000 7fe12a28a640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe10806ae70 0x7fe10806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.662+0000 7fe12a28a640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe10806ae70 0x7fe10806d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe120009910 tx=0x7fe120008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.666+0000 7fe11affd640 1 -- 172.21.15.77:0/1027751202 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe114053fd0 con 0x7fe124148540 2023-11-26T07:18:12.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.858+0000 7fe12c4ee640 1 -- 172.21.15.77:0/1027751202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe12404e8b0 con 0x7fe124148540 2023-11-26T07:18:12.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.859+0000 7fe11affd640 1 -- 172.21.15.77:0/1027751202 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1140575f0 con 0x7fe124148540 2023-11-26T07:18:12.862 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:18:12.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 -- 172.21.15.77:0/1027751202 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe10806ae70 msgr2=0x7fe10806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe10806ae70 0x7fe10806d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe120009910 tx=0x7fe120008040 comp rx=0 tx=0).stop 2023-11-26T07:18:12.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 -- 172.21.15.77:0/1027751202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe124148540 msgr2=0x7fe1240b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe124148540 0x7fe1240b3a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe114001200 tx=0x7fe11400dc70 comp rx=0 tx=0).stop 2023-11-26T07:18:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 -- 172.21.15.77:0/1027751202 shutdown_connections 2023-11-26T07:18:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe10806ae70 0x7fe10806d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1240b3f60 0x7fe1240cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe124148540 0x7fe1240b3a20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 --2- 172.21.15.77:0/1027751202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe110005180 0x7fe1240c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 -- 172.21.15.77:0/1027751202 >> 172.21.15.77:0/1027751202 conn(0x7fe1240999d0 msgr2=0x7fe1240b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 -- 172.21.15.77:0/1027751202 shutdown_connections 2023-11-26T07:18:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:12.862+0000 7fe12c4ee640 1 -- 172.21.15.77:0/1027751202 wait complete. 2023-11-26T07:18:12.951 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is in failed state and validate the reason 2023-11-26T07:18:12.951 INFO:tasks.cephfs_test_runner:test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:18:12.951 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:13.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.168+0000 7fa0b99c9640 1 Processor -- start 2023-11-26T07:18:13.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.168+0000 7fa0b99c9640 1 -- start start 2023-11-26T07:18:13.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.170+0000 7fa0b99c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0b40cc260 0x7fa0b40b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.170+0000 7fa0b99c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0b40cc640 0x7fa0b40b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.170+0000 7fa0b99c9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa0b40cdca0 0x7fa0b40ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.170+0000 7fa0b99c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b40b3160 con 0x7fa0b40cc640 2023-11-26T07:18:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.170+0000 7fa0b99c9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b40cea00 con 0x7fa0b40cdca0 2023-11-26T07:18:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.170+0000 7fa0b99c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40cece0 con 0x7fa0b40cc260 2023-11-26T07:18:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.171+0000 7fa0b27fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0b40cc640 0x7fa0b40b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.171+0000 7fa0b27fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0b40cc640 0x7fa0b40b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54344/0 (socket says 172.21.15.77:54344) 2023-11-26T07:18:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.171+0000 7fa0b27fc640 1 -- 172.21.15.77:0/985904781 learned_addr learned my addr 172.21.15.77:0/985904781 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.171+0000 7fa0b2ffd640 1 --2- 172.21.15.77:0/985904781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0b40cc260 0x7fa0b40b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.171+0000 7fa0b37fe640 1 --2- 172.21.15.77:0/985904781 >> v2:172.21.15.159:3300/0 conn(0x7fa0b40cdca0 0x7fa0b40ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.171+0000 7fa0b27fc640 1 -- 172.21.15.77:0/985904781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0b40cc260 msgr2=0x7fa0b40b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.171+0000 7fa0b27fc640 1 --2- 172.21.15.77:0/985904781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0b40cc260 0x7fa0b40b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.171+0000 7fa0b27fc640 1 -- 172.21.15.77:0/985904781 >> v2:172.21.15.159:3300/0 conn(0x7fa0b40cdca0 msgr2=0x7fa0b40ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.171+0000 7fa0b27fc640 1 --2- 172.21.15.77:0/985904781 >> v2:172.21.15.159:3300/0 conn(0x7fa0b40cdca0 0x7fa0b40ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.171+0000 7fa0b27fc640 1 -- 172.21.15.77:0/985904781 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b40b33d0 con 0x7fa0b40cc640 2023-11-26T07:18:13.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.172+0000 7fa0b27fc640 1 --2- 172.21.15.77:0/985904781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b40cc640 0x7fa0b40b5520 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4154530 tx=0x7fa09c02db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ceb00953d4249a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.172+0000 7fa0b1ffb640 1 -- 172.21.15.77:0/985904781 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c02f8e0 con 0x7fa0b40cc640 2023-11-26T07:18:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.173+0000 7fa0b1ffb640 1 -- 172.21.15.77:0/985904781 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c02fa40 con 0x7fa0b40cc640 2023-11-26T07:18:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.173+0000 7fa0b1ffb640 1 -- 172.21.15.77:0/985904781 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c02fdd0 con 0x7fa0b40cc640 2023-11-26T07:18:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.173+0000 7fa0b99c9640 1 -- 172.21.15.77:0/985904781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b40cc640 msgr2=0x7fa0b40b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.173+0000 7fa0b99c9640 1 --2- 172.21.15.77:0/985904781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b40cc640 0x7fa0b40b5520 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4154530 tx=0x7fa09c02db20 comp rx=0 tx=0).stop 2023-11-26T07:18:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.173+0000 7fa0b99c9640 1 -- 172.21.15.77:0/985904781 shutdown_connections 2023-11-26T07:18:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.173+0000 7fa0b99c9640 1 --2- 172.21.15.77:0/985904781 >> v2:172.21.15.159:3300/0 conn(0x7fa0b40cdca0 0x7fa0b40ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.173+0000 7fa0b99c9640 1 --2- 172.21.15.77:0/985904781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b40cc640 0x7fa0b40b5520 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.173+0000 7fa0b99c9640 1 --2- 172.21.15.77:0/985904781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0b40cc260 0x7fa0b40b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.173+0000 7fa0b99c9640 1 -- 172.21.15.77:0/985904781 >> 172.21.15.77:0/985904781 conn(0x7fa0b4071d40 msgr2=0x7fa0b406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:13.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.173+0000 7fa0b99c9640 1 -- 172.21.15.77:0/985904781 shutdown_connections 2023-11-26T07:18:13.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.173+0000 7fa0b99c9640 1 -- 172.21.15.77:0/985904781 wait complete. 2023-11-26T07:18:13.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.175+0000 7fa0b99c9640 1 Processor -- start 2023-11-26T07:18:13.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.175+0000 7fa0b99c9640 1 -- start start 2023-11-26T07:18:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.176+0000 7fa0b99c9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b40cc260 0x7fa0b414bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.176+0000 7fa0b99c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b40cc640 0x7fa0b4155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.176+0000 7fa0b99c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0b40cdca0 0x7fa0b4149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.176+0000 7fa0b99c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b41566a0 con 0x7fa0b40cc640 2023-11-26T07:18:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.176+0000 7fa0b99c9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4148d20 con 0x7fa0b40cc260 2023-11-26T07:18:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.176+0000 7fa0b99c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4155a20 con 0x7fa0b40cdca0 2023-11-26T07:18:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.176+0000 7fa0b27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b40cc640 0x7fa0b4155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.176+0000 7fa0b27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b40cc640 0x7fa0b4155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54346/0 (socket says 172.21.15.77:54346) 2023-11-26T07:18:13.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.176+0000 7fa0b27fc640 1 -- 172.21.15.77:0/1145276965 learned_addr learned my addr 172.21.15.77:0/1145276965 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:13.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.177+0000 7fa0b37fe640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0b40cdca0 0x7fa0b4149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.177+0000 7fa0b2ffd640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b40cc260 0x7fa0b414bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.177+0000 7fa0b27fc640 1 -- 172.21.15.77:0/1145276965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0b40cdca0 msgr2=0x7fa0b4149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.177+0000 7fa0b27fc640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0b40cdca0 0x7fa0b4149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.177+0000 7fa0b27fc640 1 -- 172.21.15.77:0/1145276965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b40cc260 msgr2=0x7fa0b414bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.177+0000 7fa0b27fc640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b40cc260 0x7fa0b414bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.177+0000 7fa0b27fc640 1 -- 172.21.15.77:0/1145276965 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0094d0 con 0x7fa0b40cc640 2023-11-26T07:18:13.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.177+0000 7fa0b27fc640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b40cc640 0x7fa0b4155320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa09c02db60 tx=0x7fa09c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.177+0000 7fa0abfff640 1 -- 172.21.15.77:0/1145276965 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c037d30 con 0x7fa0b40cc640 2023-11-26T07:18:13.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.177+0000 7fa0abfff640 1 -- 172.21.15.77:0/1145276965 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c037e90 con 0x7fa0b40cc640 2023-11-26T07:18:13.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.177+0000 7fa0b99c9640 1 -- 172.21.15.77:0/1145276965 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b4155d00 con 0x7fa0b40cc640 2023-11-26T07:18:13.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.178+0000 7fa0abfff640 1 -- 172.21.15.77:0/1145276965 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0426b0 con 0x7fa0b40cc640 2023-11-26T07:18:13.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.178+0000 7fa0b99c9640 1 -- 172.21.15.77:0/1145276965 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b41562c0 con 0x7fa0b40cc640 2023-11-26T07:18:13.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.179+0000 7fa0b99c9640 1 -- 172.21.15.77:0/1145276965 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b4067470 con 0x7fa0b40cc640 2023-11-26T07:18:13.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.180+0000 7fa0abfff640 1 -- 172.21.15.77:0/1145276965 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa09c042810 con 0x7fa0b40cc640 2023-11-26T07:18:13.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.181+0000 7fa0abfff640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa09406ae40 0x7fa09406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.181+0000 7fa0abfff640 1 -- 172.21.15.77:0/1145276965 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa09c033070 con 0x7fa0b40cc640 2023-11-26T07:18:13.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.181+0000 7fa0b2ffd640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa09406ae40 0x7fa09406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.182+0000 7fa0b2ffd640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa09406ae40 0x7fa09406d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009f30 tx=0x7fa0a400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.185+0000 7fa0abfff640 1 -- 172.21.15.77:0/1145276965 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa09c077870 con 0x7fa0b40cc640 2023-11-26T07:18:13.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.377+0000 7fa0b99c9640 1 -- 172.21.15.77:0/1145276965 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0b40b2c70 con 0x7fa0b40cc640 2023-11-26T07:18:13.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.380+0000 7fa0abfff640 1 -- 172.21.15.77:0/1145276965 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7fa09c07ae90 con 0x7fa0b40cc640 2023-11-26T07:18:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:13.383 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:17:36.274387+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:13.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.383+0000 7fa0b99c9640 1 -- 172.21.15.77:0/1145276965 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa09406ae40 msgr2=0x7fa09406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.383+0000 7fa0b99c9640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa09406ae40 0x7fa09406d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009f30 tx=0x7fa0a400b040 comp rx=0 tx=0).stop 2023-11-26T07:18:13.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.383+0000 7fa0b99c9640 1 -- 172.21.15.77:0/1145276965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b40cc640 msgr2=0x7fa0b4155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.383+0000 7fa0b99c9640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b40cc640 0x7fa0b4155320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa09c02db60 tx=0x7fa09c0046c0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.384+0000 7fa0b99c9640 1 -- 172.21.15.77:0/1145276965 shutdown_connections 2023-11-26T07:18:13.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.384+0000 7fa0b99c9640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa09406ae40 0x7fa09406d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.384+0000 7fa0b99c9640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0b40cdca0 0x7fa0b4149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.384+0000 7fa0b99c9640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b40cc640 0x7fa0b4155320 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.384+0000 7fa0b99c9640 1 --2- 172.21.15.77:0/1145276965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b40cc260 0x7fa0b414bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.384+0000 7fa0b99c9640 1 -- 172.21.15.77:0/1145276965 >> 172.21.15.77:0/1145276965 conn(0x7fa0b4071d40 msgr2=0x7fa0b4149030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:13.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.384+0000 7fa0b99c9640 1 -- 172.21.15.77:0/1145276965 shutdown_connections 2023-11-26T07:18:13.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.384+0000 7fa0b99c9640 1 -- 172.21.15.77:0/1145276965 wait complete. 2023-11-26T07:18:13.404 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:13.405 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:13.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.618+0000 7f312d12e640 1 Processor -- start 2023-11-26T07:18:13.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.619+0000 7f312d12e640 1 -- start start 2023-11-26T07:18:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.620+0000 7f312d12e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3128157850 0x7f31280b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.620+0000 7f312d12e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3128072320 0x7f312806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.620+0000 7f312d12e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312815dce0 con 0x7f3128157c30 2023-11-26T07:18:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.620+0000 7f312d12e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312815dad0 con 0x7f3128072320 2023-11-26T07:18:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.620+0000 7f312d12e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31280b3b70 con 0x7f3128157850 2023-11-26T07:18:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.621+0000 7f312c92d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3128072320 0x7f312806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.621+0000 7f312c92d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3128072320 0x7f312806a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54350/0 (socket says 172.21.15.77:54350) 2023-11-26T07:18:13.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.621+0000 7f312c92d640 1 -- 172.21.15.77:0/3360041520 learned_addr learned my addr 172.21.15.77:0/3360041520 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:13.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.621+0000 7f312c92d640 1 -- 172.21.15.77:0/3360041520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3128157850 msgr2=0x7f31280b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:13.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.621+0000 7f312c92d640 1 --2- 172.21.15.77:0/3360041520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3128157850 0x7f31280b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.621+0000 7f312c92d640 1 -- 172.21.15.77:0/3360041520 >> v1:172.21.15.159:6789/0 conn(0x7f3128157c30 legacy=0x7f312815e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:13.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.621+0000 7f312c92d640 1 -- 172.21.15.77:0/3360041520 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31280b35b0 con 0x7f3128072320 2023-11-26T07:18:13.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.622+0000 7f312c92d640 1 --2- 172.21.15.77:0/3360041520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3128072320 0x7f312806a500 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3120009870 tx=0x7f312002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609ae9ec327d0d8e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.622+0000 7f3126ffd640 1 -- 172.21.15.77:0/3360041520 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3120031640 con 0x7f3128072320 2023-11-26T07:18:13.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.622+0000 7f3126ffd640 1 -- 172.21.15.77:0/3360041520 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31200317a0 con 0x7f3128072320 2023-11-26T07:18:13.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.622+0000 7f3126ffd640 1 -- 172.21.15.77:0/3360041520 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3120031b30 con 0x7f3128072320 2023-11-26T07:18:13.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.623+0000 7f312d12e640 1 -- 172.21.15.77:0/3360041520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3128072320 msgr2=0x7f312806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.623+0000 7f312d12e640 1 --2- 172.21.15.77:0/3360041520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3128072320 0x7f312806a500 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3120009870 tx=0x7f312002b8f0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.623+0000 7f312d12e640 1 -- 172.21.15.77:0/3360041520 shutdown_connections 2023-11-26T07:18:13.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.623+0000 7f312d12e640 1 --2- 172.21.15.77:0/3360041520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3128072320 0x7f312806a500 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.623+0000 7f312d12e640 1 --2- 172.21.15.77:0/3360041520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3128157850 0x7f31280b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.623+0000 7f312d12e640 1 -- 172.21.15.77:0/3360041520 >> 172.21.15.77:0/3360041520 conn(0x7f31280b1bd0 msgr2=0x7f31280b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:13.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.623+0000 7f312d12e640 1 -- 172.21.15.77:0/3360041520 shutdown_connections 2023-11-26T07:18:13.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.623+0000 7f312d12e640 1 -- 172.21.15.77:0/3360041520 wait complete. 2023-11-26T07:18:13.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.625+0000 7f312d12e640 1 Processor -- start 2023-11-26T07:18:13.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.625+0000 7f312d12e640 1 -- start start 2023-11-26T07:18:13.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.626+0000 7f312d12e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3128072320 0x7f31281f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.626+0000 7f312d12e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3128157850 0x7f31281543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.626+0000 7f312d12e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3128157c30 0x7f31280ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.626+0000 7f312d12e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3128159000 con 0x7f3128072320 2023-11-26T07:18:13.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.626+0000 7f312d12e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31281f3ee0 con 0x7f3128157c30 2023-11-26T07:18:13.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.626+0000 7f312d12e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31280cd7d0 con 0x7f3128157850 2023-11-26T07:18:13.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f3127fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3128072320 0x7f31281f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f3127fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3128072320 0x7f31281f39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54366/0 (socket says 172.21.15.77:54366) 2023-11-26T07:18:13.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f3127fff640 1 -- 172.21.15.77:0/565747275 learned_addr learned my addr 172.21.15.77:0/565747275 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:13.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f31277fe640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3128157850 0x7f31281543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f312c92d640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3128157c30 0x7f31280ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f3127fff640 1 -- 172.21.15.77:0/565747275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3128157850 msgr2=0x7f31281543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f3127fff640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3128157850 0x7f31281543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f3127fff640 1 -- 172.21.15.77:0/565747275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3128157c30 msgr2=0x7f31280ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f3127fff640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3128157c30 0x7f31280ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f3127fff640 1 -- 172.21.15.77:0/565747275 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31200094d0 con 0x7f3128072320 2023-11-26T07:18:13.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f312c92d640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3128157c30 0x7f31280ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:13.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.627+0000 7f3127fff640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3128072320 0x7f31281f39a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f311800ba80 tx=0x7f311800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.628+0000 7f3124ff9640 1 -- 172.21.15.77:0/565747275 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311800cc00 con 0x7f3128072320 2023-11-26T07:18:13.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.628+0000 7f3124ff9640 1 -- 172.21.15.77:0/565747275 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311800cd80 con 0x7f3128072320 2023-11-26T07:18:13.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.628+0000 7f312d12e640 1 -- 172.21.15.77:0/565747275 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31280cdab0 con 0x7f3128072320 2023-11-26T07:18:13.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.628+0000 7f3124ff9640 1 -- 172.21.15.77:0/565747275 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3118014680 con 0x7f3128072320 2023-11-26T07:18:13.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.628+0000 7f312d12e640 1 -- 172.21.15.77:0/565747275 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31280ce070 con 0x7f3128072320 2023-11-26T07:18:13.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.629+0000 7f312d12e640 1 -- 172.21.15.77:0/565747275 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312804e840 con 0x7f3128072320 2023-11-26T07:18:13.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.630+0000 7f3124ff9640 1 -- 172.21.15.77:0/565747275 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f311801d3b0 con 0x7f3128072320 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.631+0000 7f3124ff9640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f310806ae40 0x7f310806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.631+0000 7f3124ff9640 1 -- 172.21.15.77:0/565747275 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3118089600 con 0x7f3128072320 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.631+0000 7f31277fe640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f310806ae40 0x7f310806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.632+0000 7f31277fe640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f310806ae40 0x7f310806d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3110006fd0 tx=0x7f3110008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.635+0000 7f3124ff9640 1 -- 172.21.15.77:0/565747275 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31180546a0 con 0x7f3128072320 2023-11-26T07:18:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.826+0000 7f312d12e640 1 -- 172.21.15.77:0/565747275 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3128071970 con 0x7f3128072320 2023-11-26T07:18:13.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.827+0000 7f3124ff9640 1 -- 172.21.15.77:0/565747275 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3118019020 con 0x7f3128072320 2023-11-26T07:18:13.830 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:18:13.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.829+0000 7f312d12e640 1 -- 172.21.15.77:0/565747275 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f310806ae40 msgr2=0x7f310806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.829+0000 7f312d12e640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f310806ae40 0x7f310806d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3110006fd0 tx=0x7f3110008040 comp rx=0 tx=0).stop 2023-11-26T07:18:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.830+0000 7f312d12e640 1 -- 172.21.15.77:0/565747275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3128072320 msgr2=0x7f31281f39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.830+0000 7f312d12e640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3128072320 0x7f31281f39a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f311800ba80 tx=0x7f311800bf40 comp rx=0 tx=0).stop 2023-11-26T07:18:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.830+0000 7f312d12e640 1 -- 172.21.15.77:0/565747275 shutdown_connections 2023-11-26T07:18:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.830+0000 7f312d12e640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f310806ae40 0x7f310806d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.830+0000 7f312d12e640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3128157c30 0x7f31280ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.830+0000 7f312d12e640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3128157850 0x7f31281543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.830+0000 7f312d12e640 1 --2- 172.21.15.77:0/565747275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3128072320 0x7f31281f39a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.830+0000 7f312d12e640 1 -- 172.21.15.77:0/565747275 >> 172.21.15.77:0/565747275 conn(0x7f31280b1bd0 msgr2=0x7f31280b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:13.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.830+0000 7f312d12e640 1 -- 172.21.15.77:0/565747275 shutdown_connections 2023-11-26T07:18:13.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:13.830+0000 7f312d12e640 1 -- 172.21.15.77:0/565747275 wait complete. 2023-11-26T07:18:13.852 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:14.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.057+0000 7f068df73640 1 Processor -- start 2023-11-26T07:18:14.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.057+0000 7f068df73640 1 -- start start 2023-11-26T07:18:14.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.059+0000 7f068df73640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f06880b0b40 0x7f06880b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.059+0000 7f068df73640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06880cce40 0x7f06880cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.059+0000 7f068df73640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06880b14d0 con 0x7f068815d310 2023-11-26T07:18:14.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.059+0000 7f068df73640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068806cd10 con 0x7f06880cce40 2023-11-26T07:18:14.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.059+0000 7f068df73640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06880ae5d0 con 0x7f06880b0b40 2023-11-26T07:18:14.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.059+0000 7f068d772640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06880cce40 0x7f06880cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.059+0000 7f068d772640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06880cce40 0x7f06880cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54376/0 (socket says 172.21.15.77:54376) 2023-11-26T07:18:14.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.059+0000 7f068d772640 1 -- 172.21.15.77:0/336148339 learned_addr learned my addr 172.21.15.77:0/336148339 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:14.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.060+0000 7f068d772640 1 -- 172.21.15.77:0/336148339 >> v2:172.21.15.159:3300/0 conn(0x7f06880b0b40 msgr2=0x7f06880b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:14.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.060+0000 7f0687fff640 1 --2- 172.21.15.77:0/336148339 >> v2:172.21.15.159:3300/0 conn(0x7f06880b0b40 0x7f06880b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.060+0000 7f068d772640 1 --2- 172.21.15.77:0/336148339 >> v2:172.21.15.159:3300/0 conn(0x7f06880b0b40 0x7f06880b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.060+0000 7f068d772640 1 -- 172.21.15.77:0/336148339 >> v1:172.21.15.77:6789/0 conn(0x7f068815d310 legacy=0x7f06880ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.060+0000 7f068d772640 1 -- 172.21.15.77:0/336148339 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06880ae8b0 con 0x7f06880cce40 2023-11-26T07:18:14.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.061+0000 7f068d772640 1 --2- 172.21.15.77:0/336148339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06880cce40 0x7f06880cd2a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06880b1cb0 tx=0x7f068002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bf992674c1a2a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.061+0000 7f06877fe640 1 -- 172.21.15.77:0/336148339 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068002cb10 con 0x7f06880cce40 2023-11-26T07:18:14.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.061+0000 7f06877fe640 1 -- 172.21.15.77:0/336148339 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068002cc70 con 0x7f06880cce40 2023-11-26T07:18:14.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.061+0000 7f06877fe640 1 -- 172.21.15.77:0/336148339 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800343f0 con 0x7f06880cce40 2023-11-26T07:18:14.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.062+0000 7f068df73640 1 -- 172.21.15.77:0/336148339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06880cce40 msgr2=0x7f06880cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.062+0000 7f068df73640 1 --2- 172.21.15.77:0/336148339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06880cce40 0x7f06880cd2a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06880b1cb0 tx=0x7f068002bf70 comp rx=0 tx=0).stop 2023-11-26T07:18:14.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.062+0000 7f068df73640 1 -- 172.21.15.77:0/336148339 shutdown_connections 2023-11-26T07:18:14.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.062+0000 7f068df73640 1 --2- 172.21.15.77:0/336148339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06880cce40 0x7f06880cd2a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.062+0000 7f068df73640 1 --2- 172.21.15.77:0/336148339 >> v2:172.21.15.159:3300/0 conn(0x7f06880b0b40 0x7f06880b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.062+0000 7f068df73640 1 -- 172.21.15.77:0/336148339 >> 172.21.15.77:0/336148339 conn(0x7f06880cbb40 msgr2=0x7f06880cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:14.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.062+0000 7f068df73640 1 -- 172.21.15.77:0/336148339 shutdown_connections 2023-11-26T07:18:14.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.062+0000 7f068df73640 1 -- 172.21.15.77:0/336148339 wait complete. 2023-11-26T07:18:14.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.064+0000 7f068df73640 1 Processor -- start 2023-11-26T07:18:14.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.064+0000 7f068df73640 1 -- start start 2023-11-26T07:18:14.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.065+0000 7f068df73640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06880b0b40 0x7f068809c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.065+0000 7f068df73640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06880cce40 0x7f06880cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.065+0000 7f068df73640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068815d310 0x7f06880cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.065+0000 7f068df73640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068809b530 con 0x7f06880cce40 2023-11-26T07:18:14.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.065+0000 7f068df73640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0688099d70 con 0x7f06880b0b40 2023-11-26T07:18:14.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.065+0000 7f068df73640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068809b740 con 0x7f068815d310 2023-11-26T07:18:14.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.065+0000 7f0687fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06880cce40 0x7f06880cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.065+0000 7f0687fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06880cce40 0x7f06880cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54386/0 (socket says 172.21.15.77:54386) 2023-11-26T07:18:14.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.065+0000 7f0687fff640 1 -- 172.21.15.77:0/370550604 learned_addr learned my addr 172.21.15.77:0/370550604 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:14.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.065+0000 7f068cf71640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06880b0b40 0x7f068809c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.065+0000 7f068d772640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068815d310 0x7f06880cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f0687fff640 1 -- 172.21.15.77:0/370550604 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068815d310 msgr2=0x7f06880cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f0687fff640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068815d310 0x7f06880cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f0687fff640 1 -- 172.21.15.77:0/370550604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06880b0b40 msgr2=0x7f068809c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f0687fff640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06880b0b40 0x7f068809c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f0687fff640 1 -- 172.21.15.77:0/370550604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680009b30 con 0x7f06880cce40 2023-11-26T07:18:14.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f068d772640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068815d310 0x7f06880cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:14.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f0687fff640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06880cce40 0x7f06880cd220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f067400c7f0 tx=0x7f067400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f06857fa640 1 -- 172.21.15.77:0/370550604 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674004220 con 0x7f06880cce40 2023-11-26T07:18:14.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f06857fa640 1 -- 172.21.15.77:0/370550604 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06740043a0 con 0x7f06880cce40 2023-11-26T07:18:14.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f068df73640 1 -- 172.21.15.77:0/370550604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068809ba20 con 0x7f06880cce40 2023-11-26T07:18:14.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f06857fa640 1 -- 172.21.15.77:0/370550604 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674007860 con 0x7f06880cce40 2023-11-26T07:18:14.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.066+0000 7f068df73640 1 -- 172.21.15.77:0/370550604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068809a050 con 0x7f06880cce40 2023-11-26T07:18:14.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.068+0000 7f068df73640 1 -- 172.21.15.77:0/370550604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068809bf40 con 0x7f06880cce40 2023-11-26T07:18:14.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.068+0000 7f06857fa640 1 -- 172.21.15.77:0/370550604 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0674007bd0 con 0x7f06880cce40 2023-11-26T07:18:14.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.069+0000 7f06857fa640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f066c06ae40 0x7f066c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.070+0000 7f06857fa640 1 -- 172.21.15.77:0/370550604 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0674089630 con 0x7f06880cce40 2023-11-26T07:18:14.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.070+0000 7f068cf71640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f066c06ae40 0x7f066c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.070+0000 7f068cf71640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f066c06ae40 0x7f066c06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f067c000f60 tx=0x7f067c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.074+0000 7f06857fa640 1 -- 172.21.15.77:0/370550604 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f068809bf40 con 0x7f06880cce40 2023-11-26T07:18:14.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.266+0000 7f068df73640 1 -- 172.21.15.77:0/370550604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f068809bf40 con 0x7f06880cce40 2023-11-26T07:18:14.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.267+0000 7f06857fa640 1 -- 172.21.15.77:0/370550604 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f068809bf40 con 0x7f06880cce40 2023-11-26T07:18:14.269 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:18:14.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 -- 172.21.15.77:0/370550604 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f066c06ae40 msgr2=0x7f066c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f066c06ae40 0x7f066c06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f067c000f60 tx=0x7f067c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:14.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 -- 172.21.15.77:0/370550604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06880cce40 msgr2=0x7f06880cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06880cce40 0x7f06880cd220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f067400c7f0 tx=0x7f067400ccb0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 -- 172.21.15.77:0/370550604 shutdown_connections 2023-11-26T07:18:14.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f066c06ae40 0x7f066c06d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068815d310 0x7f06880cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06880cce40 0x7f06880cd220 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 --2- 172.21.15.77:0/370550604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06880b0b40 0x7f068809c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 -- 172.21.15.77:0/370550604 >> 172.21.15.77:0/370550604 conn(0x7f06880cbb40 msgr2=0x7f06880afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:14.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 -- 172.21.15.77:0/370550604 shutdown_connections 2023-11-26T07:18:14.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.270+0000 7f068df73640 1 -- 172.21.15.77:0/370550604 wait complete. 2023-11-26T07:18:14.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:14.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.493+0000 7fc17759e640 1 Processor -- start 2023-11-26T07:18:14.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.493+0000 7fc17759e640 1 -- start start 2023-11-26T07:18:14.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.494+0000 7fc17759e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc17815b260 0x7fc17806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.494+0000 7fc17759e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc1780b1250 0x7fc17806c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.494+0000 7fc17759e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17815ed20 con 0x7fc17806e580 2023-11-26T07:18:14.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.494+0000 7fc17759e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17815b640 con 0x7fc1780b1250 2023-11-26T07:18:14.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.494+0000 7fc17759e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17815f8a0 con 0x7fc17815b260 2023-11-26T07:18:14.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.495+0000 7fc176d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc1780b1250 0x7fc17806c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.495+0000 7fc176d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc1780b1250 0x7fc17806c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54392/0 (socket says 172.21.15.77:54392) 2023-11-26T07:18:14.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.495+0000 7fc176d9d640 1 -- 172.21.15.77:0/3785395444 learned_addr learned my addr 172.21.15.77:0/3785395444 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:14.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.495+0000 7fc17659c640 1 --2- 172.21.15.77:0/3785395444 >> v2:172.21.15.159:3300/0 conn(0x7fc17815b260 0x7fc17806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.495+0000 7fc176d9d640 1 -- 172.21.15.77:0/3785395444 >> v2:172.21.15.159:3300/0 conn(0x7fc17815b260 msgr2=0x7fc17806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:14.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.495+0000 7fc176d9d640 1 --2- 172.21.15.77:0/3785395444 >> v2:172.21.15.159:3300/0 conn(0x7fc17815b260 0x7fc17806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.495+0000 7fc176d9d640 1 -- 172.21.15.77:0/3785395444 >> v1:172.21.15.159:6789/0 conn(0x7fc17806e580 legacy=0x7fc1780b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:14.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.495+0000 7fc176d9d640 1 -- 172.21.15.77:0/3785395444 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780abe50 con 0x7fc1780b1250 2023-11-26T07:18:14.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.495+0000 7fc17659c640 1 --2- 172.21.15.77:0/3785395444 >> v2:172.21.15.159:3300/0 conn(0x7fc17815b260 0x7fc17806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:14.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.496+0000 7fc176d9d640 1 --2- 172.21.15.77:0/3785395444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1780b1250 0x7fc17806c5b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc1780d0160 tx=0x7fc17002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4002e9dbfe857c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.497+0000 7fc175d9b640 1 -- 172.21.15.77:0/3785395444 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17002c960 con 0x7fc1780b1250 2023-11-26T07:18:14.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.497+0000 7fc175d9b640 1 -- 172.21.15.77:0/3785395444 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17002cac0 con 0x7fc1780b1250 2023-11-26T07:18:14.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.497+0000 7fc175d9b640 1 -- 172.21.15.77:0/3785395444 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17002ce50 con 0x7fc1780b1250 2023-11-26T07:18:14.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.497+0000 7fc17759e640 1 -- 172.21.15.77:0/3785395444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1780b1250 msgr2=0x7fc17806c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.497+0000 7fc17759e640 1 --2- 172.21.15.77:0/3785395444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1780b1250 0x7fc17806c5b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc1780d0160 tx=0x7fc17002bdc0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.497+0000 7fc17759e640 1 -- 172.21.15.77:0/3785395444 shutdown_connections 2023-11-26T07:18:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.497+0000 7fc17759e640 1 --2- 172.21.15.77:0/3785395444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1780b1250 0x7fc17806c5b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.497+0000 7fc17759e640 1 --2- 172.21.15.77:0/3785395444 >> v2:172.21.15.159:3300/0 conn(0x7fc17815b260 0x7fc17806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.497+0000 7fc17759e640 1 -- 172.21.15.77:0/3785395444 >> 172.21.15.77:0/3785395444 conn(0x7fc1780cbb40 msgr2=0x7fc1780cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.497+0000 7fc17759e640 1 -- 172.21.15.77:0/3785395444 shutdown_connections 2023-11-26T07:18:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.497+0000 7fc17759e640 1 -- 172.21.15.77:0/3785395444 wait complete. 2023-11-26T07:18:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.499+0000 7fc17759e640 1 Processor -- start 2023-11-26T07:18:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.499+0000 7fc17759e640 1 -- start start 2023-11-26T07:18:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.500+0000 7fc17759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc17806e580 0x7fc178158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.500+0000 7fc17759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1780b1250 0x7fc1780ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.500+0000 7fc17759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc17815b260 0x7fc1780c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.500+0000 7fc17759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780cb0c0 con 0x7fc17806e580 2023-11-26T07:18:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.500+0000 7fc17759e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17815caa0 con 0x7fc17815b260 2023-11-26T07:18:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.500+0000 7fc17759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780cab00 con 0x7fc1780b1250 2023-11-26T07:18:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.500+0000 7fc17659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc17806e580 0x7fc178158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.500+0000 7fc17659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc17806e580 0x7fc178158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54406/0 (socket says 172.21.15.77:54406) 2023-11-26T07:18:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.500+0000 7fc17659c640 1 -- 172.21.15.77:0/4188352939 learned_addr learned my addr 172.21.15.77:0/4188352939 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.501+0000 7fc17659c640 1 -- 172.21.15.77:0/4188352939 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1780b1250 msgr2=0x7fc1780ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.501+0000 7fc17659c640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1780b1250 0x7fc1780ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.501+0000 7fc17659c640 1 -- 172.21.15.77:0/4188352939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc17815b260 msgr2=0x7fc1780c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.501+0000 7fc17659c640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc17815b260 0x7fc1780c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.501+0000 7fc17659c640 1 -- 172.21.15.77:0/4188352939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc170009b30 con 0x7fc17806e580 2023-11-26T07:18:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.501+0000 7fc17659c640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc17806e580 0x7fc178158680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc16800c7f0 tx=0x7fc16800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.501+0000 7fc16effd640 1 -- 172.21.15.77:0/4188352939 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168007820 con 0x7fc17806e580 2023-11-26T07:18:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.501+0000 7fc16effd640 1 -- 172.21.15.77:0/4188352939 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc168007980 con 0x7fc17806e580 2023-11-26T07:18:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.501+0000 7fc16effd640 1 -- 172.21.15.77:0/4188352939 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168007cf0 con 0x7fc17806e580 2023-11-26T07:18:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.501+0000 7fc17759e640 1 -- 172.21.15.77:0/4188352939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1780cade0 con 0x7fc17806e580 2023-11-26T07:18:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.502+0000 7fc17759e640 1 -- 172.21.15.77:0/4188352939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17815d020 con 0x7fc17806e580 2023-11-26T07:18:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.503+0000 7fc17759e640 1 -- 172.21.15.77:0/4188352939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17815d1b0 con 0x7fc17806e580 2023-11-26T07:18:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.504+0000 7fc16effd640 1 -- 172.21.15.77:0/4188352939 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1680113f0 con 0x7fc17806e580 2023-11-26T07:18:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.504+0000 7fc16effd640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc15806ae40 0x7fc15806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.505+0000 7fc16effd640 1 -- 172.21.15.77:0/4188352939 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc168089890 con 0x7fc17806e580 2023-11-26T07:18:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.505+0000 7fc16ffff640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc15806ae40 0x7fc15806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.505+0000 7fc16ffff640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc15806ae40 0x7fc15806d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc17815a030 tx=0x7fc1600079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.509+0000 7fc16effd640 1 -- 172.21.15.77:0/4188352939 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1680549d0 con 0x7fc17806e580 2023-11-26T07:18:14.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.698+0000 7fc17759e640 1 -- 172.21.15.77:0/4188352939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1780b4d40 con 0x7fc17806e580 2023-11-26T07:18:14.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.699+0000 7fc16effd640 1 -- 172.21.15.77:0/4188352939 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc16801f0a0 con 0x7fc17806e580 2023-11-26T07:18:14.701 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:18:14.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.701+0000 7fc17759e640 1 -- 172.21.15.77:0/4188352939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc15806ae40 msgr2=0x7fc15806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.701+0000 7fc17759e640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc15806ae40 0x7fc15806d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc17815a030 tx=0x7fc1600079b0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.701+0000 7fc17759e640 1 -- 172.21.15.77:0/4188352939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc17806e580 msgr2=0x7fc178158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.701+0000 7fc17759e640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc17806e580 0x7fc178158680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc16800c7f0 tx=0x7fc16800ccb0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.702+0000 7fc17759e640 1 -- 172.21.15.77:0/4188352939 shutdown_connections 2023-11-26T07:18:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.702+0000 7fc17759e640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc15806ae40 0x7fc15806d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.702+0000 7fc17759e640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc17815b260 0x7fc1780c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.702+0000 7fc17759e640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1780b1250 0x7fc1780ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.702+0000 7fc17759e640 1 --2- 172.21.15.77:0/4188352939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc17806e580 0x7fc178158680 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.702+0000 7fc17759e640 1 -- 172.21.15.77:0/4188352939 >> 172.21.15.77:0/4188352939 conn(0x7fc1780cbb40 msgr2=0x7fc1780aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.702+0000 7fc17759e640 1 -- 172.21.15.77:0/4188352939 shutdown_connections 2023-11-26T07:18:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.702+0000 7fc17759e640 1 -- 172.21.15.77:0/4188352939 wait complete. 2023-11-26T07:18:14.724 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2023-11-26T07:18:14.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.937+0000 7fb379602640 1 Processor -- start 2023-11-26T07:18:14.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.937+0000 7fb379602640 1 -- start start 2023-11-26T07:18:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.938+0000 7fb379602640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb37415df80 0x7fb3740ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.938+0000 7fb379602640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3740cd470 0x7fb37415b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.938+0000 7fb379602640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37415e3f0 con 0x7fb3740b2250 2023-11-26T07:18:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.938+0000 7fb379602640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37415a990 con 0x7fb37415df80 2023-11-26T07:18:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.938+0000 7fb379602640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37415ab80 con 0x7fb3740cd470 2023-11-26T07:18:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.939+0000 7fb36a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb37415df80 0x7fb3740ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.939+0000 7fb36a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb37415df80 0x7fb3740ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54416/0 (socket says 172.21.15.77:54416) 2023-11-26T07:18:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.939+0000 7fb36a7fc640 1 -- 172.21.15.77:0/1860819440 learned_addr learned my addr 172.21.15.77:0/1860819440 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.939+0000 7fb36a7fc640 1 -- 172.21.15.77:0/1860819440 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3740cd470 msgr2=0x7fb37415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.939+0000 7fb36a7fc640 1 --2- 172.21.15.77:0/1860819440 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3740cd470 0x7fb37415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.939+0000 7fb36a7fc640 1 -- 172.21.15.77:0/1860819440 >> v1:172.21.15.159:6789/0 conn(0x7fb3740b2250 legacy=0x7fb3740b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.939+0000 7fb36a7fc640 1 -- 172.21.15.77:0/1860819440 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3740b2d40 con 0x7fb37415df80 2023-11-26T07:18:14.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.940+0000 7fb36a7fc640 1 --2- 172.21.15.77:0/1860819440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb37415df80 0x7fb3740ccf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009870 tx=0x7fb35c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7752f61df7c18 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.940+0000 7fb3727fc640 1 -- 172.21.15.77:0/1860819440 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c031640 con 0x7fb37415df80 2023-11-26T07:18:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.940+0000 7fb3727fc640 1 -- 172.21.15.77:0/1860819440 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c0317a0 con 0x7fb37415df80 2023-11-26T07:18:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.940+0000 7fb3727fc640 1 -- 172.21.15.77:0/1860819440 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c031b30 con 0x7fb37415df80 2023-11-26T07:18:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.941+0000 7fb379602640 1 -- 172.21.15.77:0/1860819440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb37415df80 msgr2=0x7fb3740ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.941+0000 7fb379602640 1 --2- 172.21.15.77:0/1860819440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb37415df80 0x7fb3740ccf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009870 tx=0x7fb35c02b8f0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.941+0000 7fb379602640 1 -- 172.21.15.77:0/1860819440 shutdown_connections 2023-11-26T07:18:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.941+0000 7fb379602640 1 --2- 172.21.15.77:0/1860819440 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3740cd470 0x7fb37415b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.941+0000 7fb379602640 1 --2- 172.21.15.77:0/1860819440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb37415df80 0x7fb3740ccf30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.941+0000 7fb379602640 1 -- 172.21.15.77:0/1860819440 >> 172.21.15.77:0/1860819440 conn(0x7fb37406a920 msgr2=0x7fb37406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.941+0000 7fb379602640 1 -- 172.21.15.77:0/1860819440 shutdown_connections 2023-11-26T07:18:14.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.941+0000 7fb379602640 1 -- 172.21.15.77:0/1860819440 wait complete. 2023-11-26T07:18:14.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.943+0000 7fb379602640 1 Processor -- start 2023-11-26T07:18:14.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.943+0000 7fb379602640 1 -- start start 2023-11-26T07:18:14.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.944+0000 7fb379602640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3740b2250 0x7fb3740c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.944+0000 7fb379602640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3740cd470 0x7fb3740b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.944+0000 7fb379602640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb37415df80 0x7fb374153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.944+0000 7fb379602640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740c88a0 con 0x7fb3740cd470 2023-11-26T07:18:14.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.944+0000 7fb379602640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740c96e0 con 0x7fb3740b2250 2023-11-26T07:18:14.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.944+0000 7fb379602640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37414ea90 con 0x7fb37415df80 2023-11-26T07:18:14.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.944+0000 7fb36a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3740cd470 0x7fb3740b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.944+0000 7fb36a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3740cd470 0x7fb3740b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54422/0 (socket says 172.21.15.77:54422) 2023-11-26T07:18:14.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.944+0000 7fb36a7fc640 1 -- 172.21.15.77:0/1996100638 learned_addr learned my addr 172.21.15.77:0/1996100638 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:14.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.945+0000 7fb36a7fc640 1 -- 172.21.15.77:0/1996100638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb37415df80 msgr2=0x7fb374153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.945+0000 7fb36a7fc640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb37415df80 0x7fb374153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.945+0000 7fb36a7fc640 1 -- 172.21.15.77:0/1996100638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3740b2250 msgr2=0x7fb3740c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.945+0000 7fb36a7fc640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3740b2250 0x7fb3740c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.945+0000 7fb36a7fc640 1 -- 172.21.15.77:0/1996100638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c0094d0 con 0x7fb3740cd470 2023-11-26T07:18:14.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.945+0000 7fb36a7fc640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3740cd470 0x7fb3740b14d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009870 tx=0x7fb35c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.945+0000 7fb36bfff640 1 -- 172.21.15.77:0/1996100638 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c03ac60 con 0x7fb3740cd470 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.945+0000 7fb36bfff640 1 -- 172.21.15.77:0/1996100638 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c03adc0 con 0x7fb3740cd470 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.945+0000 7fb36bfff640 1 -- 172.21.15.77:0/1996100638 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c044630 con 0x7fb3740cd470 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.945+0000 7fb379602640 1 -- 172.21.15.77:0/1996100638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3740c8ad0 con 0x7fb3740cd470 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.945+0000 7fb379602640 1 -- 172.21.15.77:0/1996100638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3740c9090 con 0x7fb3740cd470 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.946+0000 7fb379602640 1 -- 172.21.15.77:0/1996100638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb374067470 con 0x7fb3740cd470 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.947+0000 7fb36bfff640 1 -- 172.21.15.77:0/1996100638 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb35c02f050 con 0x7fb3740cd470 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.948+0000 7fb36bfff640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb35406ae40 0x7fb35406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.948+0000 7fb36bfff640 1 -- 172.21.15.77:0/1996100638 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb35c0ab630 con 0x7fb3740cd470 2023-11-26T07:18:14.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.949+0000 7fb372ffd640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb35406ae40 0x7fb35406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.949+0000 7fb372ffd640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb35406ae40 0x7fb35406d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb364001560 tx=0x7fb364007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:14.952+0000 7fb36bfff640 1 -- 172.21.15.77:0/1996100638 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb35c076640 con 0x7fb3740cd470 2023-11-26T07:18:15.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.211+0000 7fb379602640 1 -- 172.21.15.77:0/1996100638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) v1 -- 0x7fb3740cea00 con 0x7fb3740cd470 2023-11-26T07:18:15.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.815+0000 7fb36bfff640 1 -- 172.21.15.77:0/1996100638 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v62) v1 ==== 168+0+0 (secure 0 0 0) 0x7fb35c079c60 con 0x7fb3740cd470 2023-11-26T07:18:15.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.818+0000 7fb379602640 1 -- 172.21.15.77:0/1996100638 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb35406ae40 msgr2=0x7fb35406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.818+0000 7fb379602640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb35406ae40 0x7fb35406d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb364001560 tx=0x7fb364007990 comp rx=0 tx=0).stop 2023-11-26T07:18:15.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.818+0000 7fb379602640 1 -- 172.21.15.77:0/1996100638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3740cd470 msgr2=0x7fb3740b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.818+0000 7fb379602640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3740cd470 0x7fb3740b14d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009870 tx=0x7fb35c0046c0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.818+0000 7fb379602640 1 -- 172.21.15.77:0/1996100638 shutdown_connections 2023-11-26T07:18:15.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.818+0000 7fb379602640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb35406ae40 0x7fb35406d300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.818+0000 7fb379602640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb37415df80 0x7fb374153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.819+0000 7fb379602640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3740cd470 0x7fb3740b14d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.819+0000 7fb379602640 1 --2- 172.21.15.77:0/1996100638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3740b2250 0x7fb3740c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.819+0000 7fb379602640 1 -- 172.21.15.77:0/1996100638 >> 172.21.15.77:0/1996100638 conn(0x7fb37406a920 msgr2=0x7fb374071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:15.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.819+0000 7fb379602640 1 -- 172.21.15.77:0/1996100638 shutdown_connections 2023-11-26T07:18:15.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:15.819+0000 7fb379602640 1 -- 172.21.15.77:0/1996100638 wait complete. 2023-11-26T07:18:15.847 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:18:16.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.042+0000 7f9f4fc00640 1 Processor -- start 2023-11-26T07:18:16.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.042+0000 7f9f4fc00640 1 -- start start 2023-11-26T07:18:16.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.043+0000 7f9f4fc00640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9f480cc0f0 0x7f9f480c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.043+0000 7f9f4fc00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4815eea0 con 0x7f9f4815b440 2023-11-26T07:18:16.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.043+0000 7f9f4fc00640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f480abf30 con 0x7f9f480c57e0 2023-11-26T07:18:16.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.043+0000 7f9f4fc00640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4815b820 con 0x7f9f480cc0f0 2023-11-26T07:18:16.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.043+0000 7f9f4d99c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9f4815b440 0x7f9f480cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49050/0 (socket says 172.21.15.77:49050) 2023-11-26T07:18:16.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.043+0000 7f9f4d99c640 1 -- 172.21.15.77:0/492279877 learned_addr learned my addr 172.21.15.77:0/492279877 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:16.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902492154 0 0) 0x7f9f4815eea0 con 0x7f9f4815b440 2023-11-26T07:18:16.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f34003520 con 0x7f9f4815b440 2023-11-26T07:18:16.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4d19b640 1 --2- 172.21.15.77:0/492279877 >> v2:172.21.15.159:3300/0 conn(0x7f9f480cc0f0 0x7f9f480c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1984136400 0 0) 0x7f9f34003520 con 0x7f9f4815b440 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 >> v2:172.21.15.159:3300/0 conn(0x7f9f480cc0f0 msgr2=0x7f9f480c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 --2- 172.21.15.77:0/492279877 >> v2:172.21.15.159:3300/0 conn(0x7f9f480cc0f0 0x7f9f480c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 >> v1:172.21.15.159:6789/0 conn(0x7f9f480c57e0 legacy=0x7f9f4806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4815f0f0 con 0x7f9f4815b440 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f9f44001670 con 0x7f9f4815b440 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 >> v1:172.21.15.77:6789/0 conn(0x7f9f4815b440 legacy=0x7f9f480cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f340039c0 0x7f9f34003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f340047c0 0x7f9f34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 0x7f9f3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4815b820 con 0x7f9f34005250 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3400c1a0 con 0x7f9f340047c0 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.044+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3400c360 con 0x7f9f340039c0 2023-11-26T07:18:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.045+0000 7f9f4e19d640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 0x7f9f3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.045+0000 7f9f4d19b640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f340047c0 0x7f9f34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.045+0000 7f9f4d99c640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f340039c0 0x7f9f34003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.045+0000 7f9f4e19d640 1 -- 172.21.15.77:0/492279877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f340039c0 msgr2=0x7f9f34003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:16.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.045+0000 7f9f4e19d640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f340039c0 0x7f9f34003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.045+0000 7f9f4e19d640 1 -- 172.21.15.77:0/492279877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f340047c0 msgr2=0x7f9f34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:16.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.045+0000 7f9f4e19d640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f340047c0 0x7f9f34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.045+0000 7f9f4e19d640 1 -- 172.21.15.77:0/492279877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f34003520 con 0x7f9f34005250 2023-11-26T07:18:16.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.045+0000 7f9f4d99c640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f340039c0 0x7f9f34003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:16.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.046+0000 7f9f4e19d640 1 -- 172.21.15.77:0/492279877 reap_dead start 2023-11-26T07:18:16.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.046+0000 7f9f4e19d640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 0x7f9f3400b980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9f400044b0 tx=0x7f9f340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295d663e4051f5a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.046+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40006d50 con 0x7f9f34005250 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.046+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40007020 con 0x7f9f34005250 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.046+0000 7f9f4c99a640 1 -- 172.21.15.77:0/492279877 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f400073d0 con 0x7f9f34005250 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.047+0000 7f9f4fc00640 1 -- 172.21.15.77:0/492279877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 msgr2=0x7f9f3400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.047+0000 7f9f4fc00640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 0x7f9f3400b980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9f400044b0 tx=0x7f9f340057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.047+0000 7f9f4fc00640 1 -- 172.21.15.77:0/492279877 shutdown_connections 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.047+0000 7f9f4fc00640 1 --2- 172.21.15.77:0/492279877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 0x7f9f3400b980 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.047+0000 7f9f4fc00640 1 -- 172.21.15.77:0/492279877 >> 172.21.15.77:0/492279877 conn(0x7f9f480b0c50 msgr2=0x7f9f480b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.047+0000 7f9f4fc00640 1 -- 172.21.15.77:0/492279877 shutdown_connections 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.047+0000 7f9f4fc00640 1 -- 172.21.15.77:0/492279877 wait complete. 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.049+0000 7f9f4fc00640 1 Processor -- start 2023-11-26T07:18:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.049+0000 7f9f4fc00640 1 -- start start 2023-11-26T07:18:16.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.050+0000 7f9f4fc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 0x7f9f48156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.050+0000 7f9f4fc00640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f480cd5e0 0x7f9f480cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.050+0000 7f9f4fc00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f48159a80 0x7f9f48159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.050+0000 7f9f4fc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480cdfa0 con 0x7f9f34005250 2023-11-26T07:18:16.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.050+0000 7f9f4fc00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4815a440 con 0x7f9f48159a80 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.050+0000 7f9f4fc00640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480b2650 con 0x7f9f480cd5e0 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.050+0000 7f9f4d99c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 0x7f9f48156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.050+0000 7f9f4d99c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 0x7f9f48156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57112/0 (socket says 172.21.15.77:57112) 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.050+0000 7f9f4d99c640 1 -- 172.21.15.77:0/532247682 learned_addr learned my addr 172.21.15.77:0/532247682 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.050+0000 7f9f4d99c640 1 -- 172.21.15.77:0/532247682 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f480cd5e0 msgr2=0x7f9f480cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.050+0000 7f9f4d99c640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f480cd5e0 0x7f9f480cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.051+0000 7f9f4e19d640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f48159a80 0x7f9f48159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.051+0000 7f9f4d99c640 1 -- 172.21.15.77:0/532247682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f48159a80 msgr2=0x7f9f48159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.051+0000 7f9f4d99c640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f48159a80 0x7f9f48159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.051+0000 7f9f4d99c640 1 -- 172.21.15.77:0/532247682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f480ce970 con 0x7f9f34005250 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.051+0000 7f9f4d99c640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 0x7f9f48156b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400d7d0 tx=0x7f9f4400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.051+0000 7f9f3e7fc640 1 -- 172.21.15.77:0/532247682 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f440074e0 con 0x7f9f34005250 2023-11-26T07:18:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.051+0000 7f9f3e7fc640 1 -- 172.21.15.77:0/532247682 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f44007640 con 0x7f9f34005250 2023-11-26T07:18:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.051+0000 7f9f3e7fc640 1 -- 172.21.15.77:0/532247682 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f44004a20 con 0x7f9f34005250 2023-11-26T07:18:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.051+0000 7f9f4fc00640 1 -- 172.21.15.77:0/532247682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f481f2bc0 con 0x7f9f34005250 2023-11-26T07:18:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.051+0000 7f9f4fc00640 1 -- 172.21.15.77:0/532247682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f480b2000 con 0x7f9f34005250 2023-11-26T07:18:16.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.052+0000 7f9f4fc00640 1 -- 172.21.15.77:0/532247682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4804e8b0 con 0x7f9f34005250 2023-11-26T07:18:16.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.053+0000 7f9f3e7fc640 1 -- 172.21.15.77:0/532247682 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f44004b80 con 0x7f9f34005250 2023-11-26T07:18:16.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.054+0000 7f9f3e7fc640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2c06ae40 0x7f9f2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.054+0000 7f9f3e7fc640 1 -- 172.21.15.77:0/532247682 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9f440890b0 con 0x7f9f34005250 2023-11-26T07:18:16.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.054+0000 7f9f4d19b640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2c06ae40 0x7f9f2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.055+0000 7f9f4d19b640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2c06ae40 0x7f9f2c06d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f480cff10 tx=0x7f9f3800d280 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.059+0000 7f9f3e7fc640 1 -- 172.21.15.77:0/532247682 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f44054040 con 0x7f9f34005250 2023-11-26T07:18:16.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.250+0000 7f9f4fc00640 1 -- 172.21.15.77:0/532247682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9f4806dc80 con 0x7f9f34005250 2023-11-26T07:18:16.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.255+0000 7f9f3e7fc640 1 -- 172.21.15.77:0/532247682 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9f44057660 con 0x7f9f34005250 2023-11-26T07:18:16.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.258+0000 7f9f4fc00640 1 -- 172.21.15.77:0/532247682 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2c06ae40 msgr2=0x7f9f2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.258+0000 7f9f4fc00640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2c06ae40 0x7f9f2c06d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f480cff10 tx=0x7f9f3800d280 comp rx=0 tx=0).stop 2023-11-26T07:18:16.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.258+0000 7f9f4fc00640 1 -- 172.21.15.77:0/532247682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 msgr2=0x7f9f48156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.258+0000 7f9f4fc00640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 0x7f9f48156b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400d7d0 tx=0x7f9f4400dc90 comp rx=0 tx=0).stop 2023-11-26T07:18:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.259+0000 7f9f4fc00640 1 -- 172.21.15.77:0/532247682 shutdown_connections 2023-11-26T07:18:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.259+0000 7f9f4fc00640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2c06ae40 0x7f9f2c06d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.259+0000 7f9f4fc00640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f48159a80 0x7f9f48159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.259+0000 7f9f4fc00640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f480cd5e0 0x7f9f480cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.259+0000 7f9f4fc00640 1 --2- 172.21.15.77:0/532247682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34005250 0x7f9f48156b10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.259+0000 7f9f4fc00640 1 -- 172.21.15.77:0/532247682 >> 172.21.15.77:0/532247682 conn(0x7f9f480b0c50 msgr2=0x7f9f48071420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.259+0000 7f9f4fc00640 1 -- 172.21.15.77:0/532247682 shutdown_connections 2023-11-26T07:18:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.259+0000 7f9f4fc00640 1 -- 172.21.15.77:0/532247682 wait complete. 2023-11-26T07:18:16.280 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:18:16.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:18:16.393 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:18:16.520 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:18:16.520 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:18:16.521 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:16.582 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:18:16.582 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:16.634 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:18:16.634 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:16.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:16.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.905+0000 7fd9c359e640 1 Processor -- start 2023-11-26T07:18:16.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.906+0000 7fd9c359e640 1 -- start start 2023-11-26T07:18:16.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c359e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd9c4143870 0x7fd9c4146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c359e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd9c40b1180 0x7fd9c40cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c359e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c4161510 con 0x7fd9c4161080 2023-11-26T07:18:16.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c359e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c4070460 con 0x7fd9c4143870 2023-11-26T07:18:16.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c359e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c41617f0 con 0x7fd9c40b1180 2023-11-26T07:18:16.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd9c4143870 0x7fd9c4146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd9c4143870 0x7fd9c4146970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57116/0 (socket says 172.21.15.77:57116) 2023-11-26T07:18:16.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c259c640 1 -- 172.21.15.77:0/3575909231 learned_addr learned my addr 172.21.15.77:0/3575909231 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:16.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c259c640 1 -- 172.21.15.77:0/3575909231 >> v2:172.21.15.159:3300/0 conn(0x7fd9c40b1180 msgr2=0x7fd9c40cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:16.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c259c640 1 --2- 172.21.15.77:0/3575909231 >> v2:172.21.15.159:3300/0 conn(0x7fd9c40b1180 0x7fd9c40cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c259c640 1 -- 172.21.15.77:0/3575909231 >> v1:172.21.15.77:6789/0 conn(0x7fd9c4161080 legacy=0x7fd9c40b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.907+0000 7fd9c259c640 1 -- 172.21.15.77:0/3575909231 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c4161ad0 con 0x7fd9c4143870 2023-11-26T07:18:16.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.908+0000 7fd9c259c640 1 --2- 172.21.15.77:0/3575909231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c4143870 0x7fd9c4146970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40ae9e0 tx=0x7fd9b402b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ba6a54ea4d8cc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.908+0000 7fd9c1d9b640 1 -- 172.21.15.77:0/3575909231 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4030880 con 0x7fd9c4143870 2023-11-26T07:18:16.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.908+0000 7fd9c1d9b640 1 -- 172.21.15.77:0/3575909231 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b40309e0 con 0x7fd9c4143870 2023-11-26T07:18:16.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.908+0000 7fd9c1d9b640 1 -- 172.21.15.77:0/3575909231 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4030d70 con 0x7fd9c4143870 2023-11-26T07:18:16.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.909+0000 7fd9c359e640 1 -- 172.21.15.77:0/3575909231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c4143870 msgr2=0x7fd9c4146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.909+0000 7fd9c359e640 1 --2- 172.21.15.77:0/3575909231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c4143870 0x7fd9c4146970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40ae9e0 tx=0x7fd9b402b9c0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.909+0000 7fd9c359e640 1 -- 172.21.15.77:0/3575909231 shutdown_connections 2023-11-26T07:18:16.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.909+0000 7fd9c359e640 1 --2- 172.21.15.77:0/3575909231 >> v2:172.21.15.159:3300/0 conn(0x7fd9c40b1180 0x7fd9c40cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.909+0000 7fd9c359e640 1 --2- 172.21.15.77:0/3575909231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c4143870 0x7fd9c4146970 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.909+0000 7fd9c359e640 1 -- 172.21.15.77:0/3575909231 >> 172.21.15.77:0/3575909231 conn(0x7fd9c40cb830 msgr2=0x7fd9c40cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:16.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.909+0000 7fd9c359e640 1 -- 172.21.15.77:0/3575909231 shutdown_connections 2023-11-26T07:18:16.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.909+0000 7fd9c359e640 1 -- 172.21.15.77:0/3575909231 wait complete. 2023-11-26T07:18:16.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.911+0000 7fd9c359e640 1 Processor -- start 2023-11-26T07:18:16.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.911+0000 7fd9c359e640 1 -- start start 2023-11-26T07:18:16.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.912+0000 7fd9c359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b1180 0x7fd9c415f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.912+0000 7fd9c359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c4143870 0x7fd9c415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.912+0000 7fd9c359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c415cf00 0x7fd9c41e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.912+0000 7fd9c359e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c415d370 con 0x7fd9c40b1180 2023-11-26T07:18:16.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.912+0000 7fd9c359e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c41f32f0 con 0x7fd9c4143870 2023-11-26T07:18:16.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.912+0000 7fd9c359e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c4145830 con 0x7fd9c415cf00 2023-11-26T07:18:16.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.912+0000 7fd9c259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b1180 0x7fd9c415f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.912+0000 7fd9c259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b1180 0x7fd9c415f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57128/0 (socket says 172.21.15.77:57128) 2023-11-26T07:18:16.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.912+0000 7fd9c259c640 1 -- 172.21.15.77:0/1208356054 learned_addr learned my addr 172.21.15.77:0/1208356054 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:16.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.912+0000 7fd9bbfff640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c4143870 0x7fd9c415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9c2d9d640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c415cf00 0x7fd9c41e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9c259c640 1 -- 172.21.15.77:0/1208356054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c415cf00 msgr2=0x7fd9c41e7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9c259c640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c415cf00 0x7fd9c41e7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9c259c640 1 -- 172.21.15.77:0/1208356054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c4143870 msgr2=0x7fd9c415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9c259c640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c4143870 0x7fd9c415c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9c259c640 1 -- 172.21.15.77:0/1208356054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b40094d0 con 0x7fd9c40b1180 2023-11-26T07:18:16.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9c2d9d640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c415cf00 0x7fd9c41e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:16.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9c259c640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b1180 0x7fd9c415f660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4000c00 tx=0x7fd9b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9baffd640 1 -- 172.21.15.77:0/1208356054 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4030810 con 0x7fd9c40b1180 2023-11-26T07:18:16.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9baffd640 1 -- 172.21.15.77:0/1208356054 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b4043400 con 0x7fd9c40b1180 2023-11-26T07:18:16.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9c359e640 1 -- 172.21.15.77:0/1208356054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c41e6f40 con 0x7fd9c40b1180 2023-11-26T07:18:16.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.913+0000 7fd9baffd640 1 -- 172.21.15.77:0/1208356054 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4043790 con 0x7fd9c40b1180 2023-11-26T07:18:16.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.914+0000 7fd9c359e640 1 -- 172.21.15.77:0/1208356054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c41e7500 con 0x7fd9c40b1180 2023-11-26T07:18:16.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.915+0000 7fd9c359e640 1 -- 172.21.15.77:0/1208356054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c41e6da0 con 0x7fd9c40b1180 2023-11-26T07:18:16.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.916+0000 7fd9baffd640 1 -- 172.21.15.77:0/1208356054 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9b40438f0 con 0x7fd9c40b1180 2023-11-26T07:18:16.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.916+0000 7fd9baffd640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd9a406ae40 0x7fd9a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.917+0000 7fd9baffd640 1 -- 172.21.15.77:0/1208356054 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd9b403e070 con 0x7fd9c40b1180 2023-11-26T07:18:16.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.917+0000 7fd9bbfff640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd9a406ae40 0x7fd9a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.917+0000 7fd9bbfff640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd9a406ae40 0x7fd9a406d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40ae290 tx=0x7fd9ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:16.921+0000 7fd9baffd640 1 -- 172.21.15.77:0/1208356054 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9c41e6da0 con 0x7fd9c40b1180 2023-11-26T07:18:17.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.118+0000 7fd9c359e640 1 -- 172.21.15.77:0/1208356054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9c41e6da0 con 0x7fd9c40b1180 2023-11-26T07:18:17.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.121+0000 7fd9baffd640 1 -- 172.21.15.77:0/1208356054 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16729 (secure 0 0 0) 0x7fd9c41e6da0 con 0x7fd9c40b1180 2023-11-26T07:18:17.123 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:17.123 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:18:16.826725+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:17.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.125+0000 7fd9c359e640 1 -- 172.21.15.77:0/1208356054 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd9a406ae40 msgr2=0x7fd9a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.125+0000 7fd9c359e640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd9a406ae40 0x7fd9a406d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40ae290 tx=0x7fd9ac009040 comp rx=0 tx=0).stop 2023-11-26T07:18:17.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.125+0000 7fd9c359e640 1 -- 172.21.15.77:0/1208356054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b1180 msgr2=0x7fd9c415f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.125+0000 7fd9c359e640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b1180 0x7fd9c415f660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4000c00 tx=0x7fd9b4004730 comp rx=0 tx=0).stop 2023-11-26T07:18:17.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.125+0000 7fd9c359e640 1 -- 172.21.15.77:0/1208356054 shutdown_connections 2023-11-26T07:18:17.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.125+0000 7fd9c359e640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd9a406ae40 0x7fd9a406d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.125+0000 7fd9c359e640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c415cf00 0x7fd9c41e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.125+0000 7fd9c359e640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c4143870 0x7fd9c415c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.125+0000 7fd9c359e640 1 --2- 172.21.15.77:0/1208356054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b1180 0x7fd9c415f660 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.125+0000 7fd9c359e640 1 -- 172.21.15.77:0/1208356054 >> 172.21.15.77:0/1208356054 conn(0x7fd9c40cb830 msgr2=0x7fd9c40aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:17.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.125+0000 7fd9c359e640 1 -- 172.21.15.77:0/1208356054 shutdown_connections 2023-11-26T07:18:17.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.126+0000 7fd9c359e640 1 -- 172.21.15.77:0/1208356054 wait complete. 2023-11-26T07:18:17.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:17.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:17.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.359+0000 7ff8badb0640 1 Processor -- start 2023-11-26T07:18:17.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.359+0000 7ff8badb0640 1 -- start start 2023-11-26T07:18:17.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.360+0000 7ff8badb0640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff8b4072160 0x7ff8b415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.360+0000 7ff8badb0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8b406de10 0x7ff8b40705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.360+0000 7ff8badb0640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b415ec90 con 0x7ff8b40c49f0 2023-11-26T07:18:17.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.360+0000 7ff8badb0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b40cd530 con 0x7ff8b406de10 2023-11-26T07:18:17.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.360+0000 7ff8badb0640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b40c4ed0 con 0x7ff8b4072160 2023-11-26T07:18:17.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.361+0000 7ff8b934d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8b406de10 0x7ff8b40705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.361+0000 7ff8b934d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8b406de10 0x7ff8b40705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57138/0 (socket says 172.21.15.77:57138) 2023-11-26T07:18:17.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.361+0000 7ff8b934d640 1 -- 172.21.15.77:0/3307305039 learned_addr learned my addr 172.21.15.77:0/3307305039 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:17.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.361+0000 7ff8b8b4c640 1 --2- 172.21.15.77:0/3307305039 >> v2:172.21.15.159:3300/0 conn(0x7ff8b4072160 0x7ff8b415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.361+0000 7ff8b934d640 1 -- 172.21.15.77:0/3307305039 >> v2:172.21.15.159:3300/0 conn(0x7ff8b4072160 msgr2=0x7ff8b415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:17.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.361+0000 7ff8b934d640 1 --2- 172.21.15.77:0/3307305039 >> v2:172.21.15.159:3300/0 conn(0x7ff8b4072160 0x7ff8b415e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.361+0000 7ff8b934d640 1 -- 172.21.15.77:0/3307305039 >> v1:172.21.15.159:6789/0 conn(0x7ff8b40c49f0 legacy=0x7ff8b406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:17.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.361+0000 7ff8b934d640 1 -- 172.21.15.77:0/3307305039 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40c51b0 con 0x7ff8b406de10 2023-11-26T07:18:17.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.362+0000 7ff8b934d640 1 --2- 172.21.15.77:0/3307305039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b406de10 0x7ff8b40705c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40ccae0 tx=0x7ff8ac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcbeb160a3fe0de server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:17.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.363+0000 7ff8b37fe640 1 -- 172.21.15.77:0/3307305039 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac02ca80 con 0x7ff8b406de10 2023-11-26T07:18:17.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.363+0000 7ff8b37fe640 1 -- 172.21.15.77:0/3307305039 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac02cbe0 con 0x7ff8b406de10 2023-11-26T07:18:17.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.363+0000 7ff8b37fe640 1 -- 172.21.15.77:0/3307305039 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0343f0 con 0x7ff8b406de10 2023-11-26T07:18:17.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.363+0000 7ff8badb0640 1 -- 172.21.15.77:0/3307305039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b406de10 msgr2=0x7ff8b40705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.363+0000 7ff8badb0640 1 --2- 172.21.15.77:0/3307305039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b406de10 0x7ff8b40705c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40ccae0 tx=0x7ff8ac02bee0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.363+0000 7ff8badb0640 1 -- 172.21.15.77:0/3307305039 shutdown_connections 2023-11-26T07:18:17.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.363+0000 7ff8badb0640 1 --2- 172.21.15.77:0/3307305039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b406de10 0x7ff8b40705c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.363+0000 7ff8badb0640 1 --2- 172.21.15.77:0/3307305039 >> v2:172.21.15.159:3300/0 conn(0x7ff8b4072160 0x7ff8b415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.363+0000 7ff8badb0640 1 -- 172.21.15.77:0/3307305039 >> 172.21.15.77:0/3307305039 conn(0x7ff8b40b0c50 msgr2=0x7ff8b40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:17.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.363+0000 7ff8badb0640 1 -- 172.21.15.77:0/3307305039 shutdown_connections 2023-11-26T07:18:17.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.363+0000 7ff8badb0640 1 -- 172.21.15.77:0/3307305039 wait complete. 2023-11-26T07:18:17.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.365+0000 7ff8badb0640 1 Processor -- start 2023-11-26T07:18:17.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.365+0000 7ff8badb0640 1 -- start start 2023-11-26T07:18:17.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.366+0000 7ff8badb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b406de10 0x7ff8b409b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.366+0000 7ff8badb0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8b4072160 0x7ff8b415a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.366+0000 7ff8badb0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8b40c49f0 0x7ff8b4149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.366+0000 7ff8badb0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b415b840 con 0x7ff8b406de10 2023-11-26T07:18:17.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.366+0000 7ff8badb0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b415acc0 con 0x7ff8b40c49f0 2023-11-26T07:18:17.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.366+0000 7ff8badb0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b415afa0 con 0x7ff8b4072160 2023-11-26T07:18:17.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.366+0000 7ff8b8b4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b406de10 0x7ff8b409b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.366+0000 7ff8b8b4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b406de10 0x7ff8b409b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57154/0 (socket says 172.21.15.77:57154) 2023-11-26T07:18:17.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.366+0000 7ff8b8b4c640 1 -- 172.21.15.77:0/2174063973 learned_addr learned my addr 172.21.15.77:0/2174063973 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:17.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b3fff640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8b4072160 0x7ff8b415a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b934d640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8b40c49f0 0x7ff8b4149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b8b4c640 1 -- 172.21.15.77:0/2174063973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8b4072160 msgr2=0x7ff8b415a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b8b4c640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8b4072160 0x7ff8b415a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b8b4c640 1 -- 172.21.15.77:0/2174063973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8b40c49f0 msgr2=0x7ff8b4149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b8b4c640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8b40c49f0 0x7ff8b4149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b8b4c640 1 -- 172.21.15.77:0/2174063973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac009b30 con 0x7ff8b406de10 2023-11-26T07:18:17.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b3fff640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8b4072160 0x7ff8b415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:17.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b8b4c640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b406de10 0x7ff8b409b680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800c7f0 tx=0x7ff8a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:17.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b17fa640 1 -- 172.21.15.77:0/2174063973 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8004220 con 0x7ff8b406de10 2023-11-26T07:18:17.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b17fa640 1 -- 172.21.15.77:0/2174063973 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a80043a0 con 0x7ff8b406de10 2023-11-26T07:18:17.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.367+0000 7ff8b17fa640 1 -- 172.21.15.77:0/2174063973 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8007860 con 0x7ff8b406de10 2023-11-26T07:18:17.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.368+0000 7ff8badb0640 1 -- 172.21.15.77:0/2174063973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b415b280 con 0x7ff8b406de10 2023-11-26T07:18:17.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.368+0000 7ff8badb0640 1 -- 172.21.15.77:0/2174063973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b415a9b0 con 0x7ff8b406de10 2023-11-26T07:18:17.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.369+0000 7ff8badb0640 1 -- 172.21.15.77:0/2174063973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b404e8b0 con 0x7ff8b406de10 2023-11-26T07:18:17.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.370+0000 7ff8b17fa640 1 -- 172.21.15.77:0/2174063973 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8a8007bd0 con 0x7ff8b406de10 2023-11-26T07:18:17.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.370+0000 7ff8b17fa640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff89806ae70 0x7ff89806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.371+0000 7ff8b17fa640 1 -- 172.21.15.77:0/2174063973 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff8a8089590 con 0x7ff8b406de10 2023-11-26T07:18:17.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.371+0000 7ff8b3fff640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff89806ae70 0x7ff89806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.371+0000 7ff8b3fff640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff89806ae70 0x7ff89806d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff8b409bbc0 tx=0x7ff8a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:17.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.375+0000 7ff8b17fa640 1 -- 172.21.15.77:0/2174063973 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8a8054650 con 0x7ff8b406de10 2023-11-26T07:18:17.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.567+0000 7ff8badb0640 1 -- 172.21.15.77:0/2174063973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8b415dab0 con 0x7ff8b406de10 2023-11-26T07:18:17.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.568+0000 7ff8b17fa640 1 -- 172.21.15.77:0/2174063973 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8a8087e60 con 0x7ff8b406de10 2023-11-26T07:18:17.570 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:18:17.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 -- 172.21.15.77:0/2174063973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff89806ae70 msgr2=0x7ff89806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff89806ae70 0x7ff89806d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff8b409bbc0 tx=0x7ff8a0008040 comp rx=0 tx=0).stop 2023-11-26T07:18:17.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 -- 172.21.15.77:0/2174063973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b406de10 msgr2=0x7ff8b409b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b406de10 0x7ff8b409b680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800c7f0 tx=0x7ff8a800ccb0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 -- 172.21.15.77:0/2174063973 shutdown_connections 2023-11-26T07:18:17.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff89806ae70 0x7ff89806d330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8b40c49f0 0x7ff8b4149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8b4072160 0x7ff8b415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 --2- 172.21.15.77:0/2174063973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b406de10 0x7ff8b409b680 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 -- 172.21.15.77:0/2174063973 >> 172.21.15.77:0/2174063973 conn(0x7ff8b40b0c50 msgr2=0x7ff8b406c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:17.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 -- 172.21.15.77:0/2174063973 shutdown_connections 2023-11-26T07:18:17.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.571+0000 7ff8badb0640 1 -- 172.21.15.77:0/2174063973 wait complete. 2023-11-26T07:18:17.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.806+0000 7fc3ce61c640 1 Processor -- start 2023-11-26T07:18:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.806+0000 7fc3ce61c640 1 -- start start 2023-11-26T07:18:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.807+0000 7fc3ce61c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3c8072160 0x7fc3c815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.807+0000 7fc3ce61c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3c80c49f0 0x7fc3c806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.808+0000 7fc3ce61c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c815ec90 con 0x7fc3c806dc40 2023-11-26T07:18:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.808+0000 7fc3ce61c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c806e0f0 con 0x7fc3c80c49f0 2023-11-26T07:18:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.808+0000 7fc3ce61c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80cd530 con 0x7fc3c8072160 2023-11-26T07:18:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.808+0000 7fc3bf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3c80c49f0 0x7fc3c806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.808+0000 7fc3bf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3c80c49f0 0x7fc3c806d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57156/0 (socket says 172.21.15.77:57156) 2023-11-26T07:18:17.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.808+0000 7fc3bf7fe640 1 -- 172.21.15.77:0/1709269679 learned_addr learned my addr 172.21.15.77:0/1709269679 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:17.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.808+0000 7fc3c7fff640 1 --2- 172.21.15.77:0/1709269679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3c8072160 0x7fc3c815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.808+0000 7fc3bf7fe640 1 -- 172.21.15.77:0/1709269679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3c8072160 msgr2=0x7fc3c815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:17.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.808+0000 7fc3bf7fe640 1 --2- 172.21.15.77:0/1709269679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3c8072160 0x7fc3c815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.808+0000 7fc3bf7fe640 1 -- 172.21.15.77:0/1709269679 >> v1:172.21.15.159:6789/0 conn(0x7fc3c806dc40 legacy=0x7fc3c80cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:17.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.808+0000 7fc3bf7fe640 1 -- 172.21.15.77:0/1709269679 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80c4ed0 con 0x7fc3c80c49f0 2023-11-26T07:18:17.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.809+0000 7fc3bf7fe640 1 --2- 172.21.15.77:0/1709269679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3c80c49f0 0x7fc3c806d700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000bb10 tx=0x7fc3b002e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3378e6dbc09006 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:17.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.810+0000 7fc3c77fe640 1 -- 172.21.15.77:0/1709269679 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b002ee70 con 0x7fc3c80c49f0 2023-11-26T07:18:17.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.810+0000 7fc3c77fe640 1 -- 172.21.15.77:0/1709269679 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b0036440 con 0x7fc3c80c49f0 2023-11-26T07:18:17.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.810+0000 7fc3c77fe640 1 -- 172.21.15.77:0/1709269679 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00367d0 con 0x7fc3c80c49f0 2023-11-26T07:18:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.810+0000 7fc3ce61c640 1 -- 172.21.15.77:0/1709269679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3c80c49f0 msgr2=0x7fc3c806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.810+0000 7fc3ce61c640 1 --2- 172.21.15.77:0/1709269679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3c80c49f0 0x7fc3c806d700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000bb10 tx=0x7fc3b002e0c0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.810+0000 7fc3ce61c640 1 -- 172.21.15.77:0/1709269679 shutdown_connections 2023-11-26T07:18:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.810+0000 7fc3ce61c640 1 --2- 172.21.15.77:0/1709269679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3c80c49f0 0x7fc3c806d700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.810+0000 7fc3ce61c640 1 --2- 172.21.15.77:0/1709269679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3c8072160 0x7fc3c815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.810+0000 7fc3ce61c640 1 -- 172.21.15.77:0/1709269679 >> 172.21.15.77:0/1709269679 conn(0x7fc3c80b0c50 msgr2=0x7fc3c80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.811+0000 7fc3ce61c640 1 -- 172.21.15.77:0/1709269679 shutdown_connections 2023-11-26T07:18:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.811+0000 7fc3ce61c640 1 -- 172.21.15.77:0/1709269679 wait complete. 2023-11-26T07:18:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.812+0000 7fc3ce61c640 1 Processor -- start 2023-11-26T07:18:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.812+0000 7fc3ce61c640 1 -- start start 2023-11-26T07:18:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.813+0000 7fc3ce61c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3c806dc40 0x7fc3c80b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.813+0000 7fc3ce61c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3c8072160 0x7fc3c809c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.813+0000 7fc3ce61c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3c80c49f0 0x7fc3c815b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.813+0000 7fc3ce61c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80b5080 con 0x7fc3c806dc40 2023-11-26T07:18:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.813+0000 7fc3ce61c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c815a900 con 0x7fc3c8072160 2023-11-26T07:18:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.813+0000 7fc3ce61c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c815aba0 con 0x7fc3c80c49f0 2023-11-26T07:18:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.814+0000 7fc3c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3c806dc40 0x7fc3c80b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.814+0000 7fc3c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3c806dc40 0x7fc3c80b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57164/0 (socket says 172.21.15.77:57164) 2023-11-26T07:18:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.814+0000 7fc3c7fff640 1 -- 172.21.15.77:0/4215387565 learned_addr learned my addr 172.21.15.77:0/4215387565 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.814+0000 7fc3c7fff640 1 -- 172.21.15.77:0/4215387565 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3c80c49f0 msgr2=0x7fc3c815b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.814+0000 7fc3c7fff640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3c80c49f0 0x7fc3c815b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.814+0000 7fc3c7fff640 1 -- 172.21.15.77:0/4215387565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3c8072160 msgr2=0x7fc3c809c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.814+0000 7fc3c7fff640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3c8072160 0x7fc3c809c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.814+0000 7fc3c7fff640 1 -- 172.21.15.77:0/4215387565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b000b770 con 0x7fc3c806dc40 2023-11-26T07:18:17.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.814+0000 7fc3c7fff640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3c806dc40 0x7fc3c80b4b40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800d800 tx=0x7fc3b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.815+0000 7fc3c57fa640 1 -- 172.21.15.77:0/4215387565 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800b6c0 con 0x7fc3c806dc40 2023-11-26T07:18:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.815+0000 7fc3c57fa640 1 -- 172.21.15.77:0/4215387565 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b800b820 con 0x7fc3c806dc40 2023-11-26T07:18:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.815+0000 7fc3ce61c640 1 -- 172.21.15.77:0/4215387565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c815ae80 con 0x7fc3c806dc40 2023-11-26T07:18:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.815+0000 7fc3c57fa640 1 -- 172.21.15.77:0/4215387565 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800bbb0 con 0x7fc3c806dc40 2023-11-26T07:18:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.815+0000 7fc3ce61c640 1 -- 172.21.15.77:0/4215387565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c815b440 con 0x7fc3c806dc40 2023-11-26T07:18:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.816+0000 7fc3ce61c640 1 -- 172.21.15.77:0/4215387565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c815b5d0 con 0x7fc3c806dc40 2023-11-26T07:18:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.817+0000 7fc3c57fa640 1 -- 172.21.15.77:0/4215387565 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc3b800bd10 con 0x7fc3c806dc40 2023-11-26T07:18:17.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.818+0000 7fc3c57fa640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc3a806ae40 0x7fc3a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.818+0000 7fc3c57fa640 1 -- 172.21.15.77:0/4215387565 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc3b8089c50 con 0x7fc3c806dc40 2023-11-26T07:18:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.818+0000 7fc3bf7fe640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc3a806ae40 0x7fc3a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.819+0000 7fc3bf7fe640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc3a806ae40 0x7fc3a806d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0038000 tx=0x7fc3b0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:17.822+0000 7fc3c57fa640 1 -- 172.21.15.77:0/4215387565 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3b808f020 con 0x7fc3c806dc40 2023-11-26T07:18:18.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.013+0000 7fc3ce61c640 1 -- 172.21.15.77:0/4215387565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3c804e8b0 con 0x7fc3c806dc40 2023-11-26T07:18:18.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.014+0000 7fc3c57fa640 1 -- 172.21.15.77:0/4215387565 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3b8058710 con 0x7fc3c806dc40 2023-11-26T07:18:18.016 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:18:18.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 -- 172.21.15.77:0/4215387565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc3a806ae40 msgr2=0x7fc3a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc3a806ae40 0x7fc3a806d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0038000 tx=0x7fc3b0030000 comp rx=0 tx=0).stop 2023-11-26T07:18:18.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 -- 172.21.15.77:0/4215387565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3c806dc40 msgr2=0x7fc3c80b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3c806dc40 0x7fc3c80b4b40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800d800 tx=0x7fc3b800dcc0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 -- 172.21.15.77:0/4215387565 shutdown_connections 2023-11-26T07:18:18.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc3a806ae40 0x7fc3a806d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3c80c49f0 0x7fc3c815b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3c8072160 0x7fc3c809c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 --2- 172.21.15.77:0/4215387565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3c806dc40 0x7fc3c80b4b40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 -- 172.21.15.77:0/4215387565 >> 172.21.15.77:0/4215387565 conn(0x7fc3c80b0c50 msgr2=0x7fc3c80cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 -- 172.21.15.77:0/4215387565 shutdown_connections 2023-11-26T07:18:18.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.017+0000 7fc3ce61c640 1 -- 172.21.15.77:0/4215387565 wait complete. 2023-11-26T07:18:18.038 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:18.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.249+0000 7feb5af78640 1 Processor -- start 2023-11-26T07:18:18.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.249+0000 7feb5af78640 1 -- start start 2023-11-26T07:18:18.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.250+0000 7feb5af78640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb5415b440 0x7feb540cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.250+0000 7feb5af78640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb540cc3a0 con 0x7feb540c59b0 2023-11-26T07:18:18.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.251+0000 7feb5af78640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5415eea0 con 0x7feb540cbf20 2023-11-26T07:18:18.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.251+0000 7feb5af78640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5415b820 con 0x7feb5415b440 2023-11-26T07:18:18.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.251+0000 7feb59515640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7feb540c59b0 0x7feb5406c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49064/0 (socket says 172.21.15.77:49064) 2023-11-26T07:18:18.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.251+0000 7feb59515640 1 -- 172.21.15.77:0/3546991271 learned_addr learned my addr 172.21.15.77:0/3546991271 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.251+0000 7feb58d14640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb5415b440 0x7feb540cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.251+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235317296 0 0) 0x7feb4c001490 con 0x7feb540c59b0 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.251+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb44003520 con 0x7feb540c59b0 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2678462390 0 0) 0x7feb44003520 con 0x7feb540c59b0 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb5415b440 msgr2=0x7feb540cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb5415b440 0x7feb540cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 >> v1:172.21.15.159:6789/0 conn(0x7feb540cbf20 legacy=0x7feb540c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb540abf30 con 0x7feb540c59b0 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7feb4c001b80 con 0x7feb540c59b0 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 >> v1:172.21.15.77:6789/0 conn(0x7feb540c59b0 legacy=0x7feb5406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 0x7feb44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb440047c0 0x7feb44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb5415b440 0x7feb440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5415b820 con 0x7feb440039a0 2023-11-26T07:18:18.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4400bab0 con 0x7feb440047c0 2023-11-26T07:18:18.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4400bc70 con 0x7feb5415b440 2023-11-26T07:18:18.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.252+0000 7feb58d14640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 0x7feb44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.253+0000 7feb59515640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb5415b440 0x7feb440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.253+0000 7feb53fff640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb440047c0 0x7feb44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.253+0000 7feb58d14640 1 -- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb5415b440 msgr2=0x7feb440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.253+0000 7feb58d14640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb5415b440 0x7feb440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.253+0000 7feb58d14640 1 -- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb440047c0 msgr2=0x7feb44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.253+0000 7feb58d14640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb440047c0 0x7feb44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.253+0000 7feb58d14640 1 -- 172.21.15.77:0/3546991271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb44003520 con 0x7feb440039a0 2023-11-26T07:18:18.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.253+0000 7feb53fff640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb440047c0 0x7feb44004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:18.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.253+0000 7feb59515640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb5415b440 0x7feb440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:18.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.254+0000 7feb58d14640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 0x7feb44003dc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feb48009ac0 tx=0x7feb440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c52171431c8971 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.254+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4802c6b0 con 0x7feb440039a0 2023-11-26T07:18:18.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.254+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4802c810 con 0x7feb440039a0 2023-11-26T07:18:18.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.254+0000 7feb537fe640 1 -- 172.21.15.77:0/3546991271 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4802cba0 con 0x7feb440039a0 2023-11-26T07:18:18.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.254+0000 7feb5af78640 1 -- 172.21.15.77:0/3546991271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 msgr2=0x7feb44003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.254+0000 7feb5af78640 1 --2- 172.21.15.77:0/3546991271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 0x7feb44003dc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feb48009ac0 tx=0x7feb440057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.255+0000 7feb59515640 1 -- 172.21.15.77:0/3546991271 reap_dead start 2023-11-26T07:18:18.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.255+0000 7feb5af78640 1 -- 172.21.15.77:0/3546991271 shutdown_connections 2023-11-26T07:18:18.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.255+0000 7feb5af78640 1 -- 172.21.15.77:0/3546991271 >> 172.21.15.77:0/3546991271 conn(0x7feb540b0c50 msgr2=0x7feb540b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.255+0000 7feb5af78640 1 -- 172.21.15.77:0/3546991271 shutdown_connections 2023-11-26T07:18:18.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.255+0000 7feb5af78640 1 -- 172.21.15.77:0/3546991271 wait complete. 2023-11-26T07:18:18.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.257+0000 7feb5af78640 1 Processor -- start 2023-11-26T07:18:18.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.257+0000 7feb5af78640 1 -- start start 2023-11-26T07:18:18.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb5af78640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 0x7feb540b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb5af78640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54156af0 0x7feb540b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb5af78640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb540b21c0 0x7feb540b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb5af78640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb540b4b40 con 0x7feb440039a0 2023-11-26T07:18:18.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb5af78640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5415c010 con 0x7feb54156af0 2023-11-26T07:18:18.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb5af78640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5415ba00 con 0x7feb540b21c0 2023-11-26T07:18:18.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb58d14640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 0x7feb540b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb58d14640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 0x7feb540b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57190/0 (socket says 172.21.15.77:57190) 2023-11-26T07:18:18.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb58d14640 1 -- 172.21.15.77:0/1841871303 learned_addr learned my addr 172.21.15.77:0/1841871303 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:18.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb59515640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb540b21c0 0x7feb540b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb58d14640 1 -- 172.21.15.77:0/1841871303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb540b21c0 msgr2=0x7feb540b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb53fff640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54156af0 0x7feb540b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb58d14640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb540b21c0 0x7feb540b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb58d14640 1 -- 172.21.15.77:0/1841871303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54156af0 msgr2=0x7feb540b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb58d14640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54156af0 0x7feb540b1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb58d14640 1 -- 172.21.15.77:0/1841871303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5409bc10 con 0x7feb440039a0 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.258+0000 7feb59515640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb540b21c0 0x7feb540b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.259+0000 7feb58d14640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 0x7feb540b4600 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feb48037040 tx=0x7feb48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.259+0000 7feb517fa640 1 -- 172.21.15.77:0/1841871303 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48003810 con 0x7feb440039a0 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.259+0000 7feb517fa640 1 -- 172.21.15.77:0/1841871303 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb48003970 con 0x7feb440039a0 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.259+0000 7feb5af78640 1 -- 172.21.15.77:0/1841871303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5415bca0 con 0x7feb440039a0 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.259+0000 7feb517fa640 1 -- 172.21.15.77:0/1841871303 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48003ce0 con 0x7feb440039a0 2023-11-26T07:18:18.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.259+0000 7feb5af78640 1 -- 172.21.15.77:0/1841871303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb54156f70 con 0x7feb440039a0 2023-11-26T07:18:18.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.260+0000 7feb5af78640 1 -- 172.21.15.77:0/1841871303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5404e8b0 con 0x7feb440039a0 2023-11-26T07:18:18.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.261+0000 7feb517fa640 1 -- 172.21.15.77:0/1841871303 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb48047450 con 0x7feb440039a0 2023-11-26T07:18:18.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.262+0000 7feb517fa640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7feb3806ae40 0x7feb3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.262+0000 7feb517fa640 1 -- 172.21.15.77:0/1841871303 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7feb480ab840 con 0x7feb440039a0 2023-11-26T07:18:18.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.262+0000 7feb53fff640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7feb3806ae40 0x7feb3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.263+0000 7feb53fff640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7feb3806ae40 0x7feb3806d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feb40007fd0 tx=0x7feb40009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.266+0000 7feb517fa640 1 -- 172.21.15.77:0/1841871303 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb48076a40 con 0x7feb440039a0 2023-11-26T07:18:18.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.456+0000 7feb5af78640 1 -- 172.21.15.77:0/1841871303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb5415ebc0 con 0x7feb440039a0 2023-11-26T07:18:18.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.457+0000 7feb517fa640 1 -- 172.21.15.77:0/1841871303 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb480044e0 con 0x7feb440039a0 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:18:18.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.459+0000 7feb5af78640 1 -- 172.21.15.77:0/1841871303 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7feb3806ae40 msgr2=0x7feb3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.459+0000 7feb5af78640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7feb3806ae40 0x7feb3806d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feb40007fd0 tx=0x7feb40009040 comp rx=0 tx=0).stop 2023-11-26T07:18:18.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.459+0000 7feb5af78640 1 -- 172.21.15.77:0/1841871303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 msgr2=0x7feb540b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.459+0000 7feb5af78640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 0x7feb540b4600 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feb48037040 tx=0x7feb48004730 comp rx=0 tx=0).stop 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.460+0000 7feb5af78640 1 -- 172.21.15.77:0/1841871303 shutdown_connections 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.460+0000 7feb5af78640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7feb3806ae40 0x7feb3806d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.460+0000 7feb5af78640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb540b21c0 0x7feb540b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.460+0000 7feb5af78640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54156af0 0x7feb540b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.460+0000 7feb5af78640 1 --2- 172.21.15.77:0/1841871303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb440039a0 0x7feb540b4600 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.460+0000 7feb5af78640 1 -- 172.21.15.77:0/1841871303 >> 172.21.15.77:0/1841871303 conn(0x7feb540b0c50 msgr2=0x7feb540cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.460+0000 7feb5af78640 1 -- 172.21.15.77:0/1841871303 shutdown_connections 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.460+0000 7feb5af78640 1 -- 172.21.15.77:0/1841871303 wait complete. 2023-11-26T07:18:18.482 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:18.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.695+0000 7fdb5064b640 1 Processor -- start 2023-11-26T07:18:18.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.695+0000 7fdb5064b640 1 -- start start 2023-11-26T07:18:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.697+0000 7fdb5064b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdb481660b0 0x7fdb48162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.697+0000 7fdb5064b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb48166510 con 0x7fdb480ccbd0 2023-11-26T07:18:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.697+0000 7fdb5064b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb481655f0 con 0x7fdb48162540 2023-11-26T07:18:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.697+0000 7fdb5064b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb480cc380 con 0x7fdb481660b0 2023-11-26T07:18:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.697+0000 7fdb4e3e7640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdb480ccbd0 0x7fdb480ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49070/0 (socket says 172.21.15.77:49070) 2023-11-26T07:18:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.697+0000 7fdb4e3e7640 1 -- 172.21.15.77:0/2394632572 learned_addr learned my addr 172.21.15.77:0/2394632572 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4dbe6640 1 --2- 172.21.15.77:0/2394632572 >> v2:172.21.15.159:3300/0 conn(0x7fdb481660b0 0x7fdb48162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929685566 0 0) 0x7fdb44001490 con 0x7fdb480ccbd0 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb34003520 con 0x7fdb480ccbd0 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1886297892 0 0) 0x7fdb34003520 con 0x7fdb480ccbd0 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 >> v2:172.21.15.159:3300/0 conn(0x7fdb481660b0 msgr2=0x7fdb48162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 --2- 172.21.15.77:0/2394632572 >> v2:172.21.15.159:3300/0 conn(0x7fdb481660b0 0x7fdb48162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 >> v1:172.21.15.159:6789/0 conn(0x7fdb48162540 legacy=0x7fdb480c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48162b30 con 0x7fdb480ccbd0 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fdb44001b80 con 0x7fdb480ccbd0 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 >> v1:172.21.15.77:6789/0 conn(0x7fdb480ccbd0 legacy=0x7fdb480ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 --2- 172.21.15.77:0/2394632572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb340039c0 0x7fdb34003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 --2- 172.21.15.77:0/2394632572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb340047c0 0x7fdb34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 --2- 172.21.15.77:0/2394632572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb340051d0 0x7fdb3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480cc380 con 0x7fdb340039c0 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3400c100 con 0x7fdb340047c0 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3400c2c0 con 0x7fdb340051d0 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.698+0000 7fdb4e3e7640 1 --2- 172.21.15.77:0/2394632572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb340039c0 0x7fdb34003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.699+0000 7fdb4e3e7640 1 -- 172.21.15.77:0/2394632572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb340051d0 msgr2=0x7fdb3400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.699+0000 7fdb4ebe8640 1 --2- 172.21.15.77:0/2394632572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb340051d0 0x7fdb3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.699+0000 7fdb4e3e7640 1 --2- 172.21.15.77:0/2394632572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb340051d0 0x7fdb3400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.699+0000 7fdb4dbe6640 1 --2- 172.21.15.77:0/2394632572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb340047c0 0x7fdb34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.699+0000 7fdb4e3e7640 1 -- 172.21.15.77:0/2394632572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb340047c0 msgr2=0x7fdb34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.699+0000 7fdb4e3e7640 1 --2- 172.21.15.77:0/2394632572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb340047c0 0x7fdb34004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.699+0000 7fdb4e3e7640 1 -- 172.21.15.77:0/2394632572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb34003520 con 0x7fdb340039c0 2023-11-26T07:18:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.699+0000 7fdb4ebe8640 1 -- 172.21.15.77:0/2394632572 reap_dead start 2023-11-26T07:18:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.700+0000 7fdb4e3e7640 1 --2- 172.21.15.77:0/2394632572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb340039c0 0x7fdb34003dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400a750 tx=0x7fdb340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13558c4fdd87d49c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.700+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440072d0 con 0x7fdb340039c0 2023-11-26T07:18:18.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.700+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4402f070 con 0x7fdb340039c0 2023-11-26T07:18:18.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.700+0000 7fdb4d3e5640 1 -- 172.21.15.77:0/2394632572 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440076b0 con 0x7fdb340039c0 2023-11-26T07:18:18.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.701+0000 7fdb5064b640 1 -- 172.21.15.77:0/2394632572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb340039c0 msgr2=0x7fdb34003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.701+0000 7fdb5064b640 1 --2- 172.21.15.77:0/2394632572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb340039c0 0x7fdb34003dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400a750 tx=0x7fdb340057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.701+0000 7fdb5064b640 1 -- 172.21.15.77:0/2394632572 shutdown_connections 2023-11-26T07:18:18.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.701+0000 7fdb5064b640 1 --2- 172.21.15.77:0/2394632572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb340039c0 0x7fdb34003dc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.701+0000 7fdb5064b640 1 -- 172.21.15.77:0/2394632572 >> 172.21.15.77:0/2394632572 conn(0x7fdb480b0c50 msgr2=0x7fdb480b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.701+0000 7fdb5064b640 1 -- 172.21.15.77:0/2394632572 shutdown_connections 2023-11-26T07:18:18.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.701+0000 7fdb5064b640 1 -- 172.21.15.77:0/2394632572 wait complete. 2023-11-26T07:18:18.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.703+0000 7fdb5064b640 1 Processor -- start 2023-11-26T07:18:18.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.703+0000 7fdb5064b640 1 -- start start 2023-11-26T07:18:18.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.704+0000 7fdb5064b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb340039c0 0x7fdb4814b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.704+0000 7fdb5064b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb481ed200 0x7fdb480acf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.704+0000 7fdb5064b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb481ed660 0x7fdb480ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.704+0000 7fdb5064b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48164000 con 0x7fdb481ed200 2023-11-26T07:18:18.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.704+0000 7fdb5064b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48163130 con 0x7fdb481ed660 2023-11-26T07:18:18.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.704+0000 7fdb5064b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48163380 con 0x7fdb340039c0 2023-11-26T07:18:18.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.704+0000 7fdb4dbe6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb481ed200 0x7fdb480acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.704+0000 7fdb4dbe6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb481ed200 0x7fdb480acf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57204/0 (socket says 172.21.15.77:57204) 2023-11-26T07:18:18.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.704+0000 7fdb4dbe6640 1 -- 172.21.15.77:0/1274682855 learned_addr learned my addr 172.21.15.77:0/1274682855 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:18.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.705+0000 7fdb4ebe8640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb481ed660 0x7fdb480ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.705+0000 7fdb4e3e7640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb340039c0 0x7fdb4814b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.705+0000 7fdb4dbe6640 1 -- 172.21.15.77:0/1274682855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb340039c0 msgr2=0x7fdb4814b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.705+0000 7fdb4dbe6640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb340039c0 0x7fdb4814b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.705+0000 7fdb4dbe6640 1 -- 172.21.15.77:0/1274682855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb481ed660 msgr2=0x7fdb480ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.705+0000 7fdb4dbe6640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb481ed660 0x7fdb480ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.705+0000 7fdb4dbe6640 1 -- 172.21.15.77:0/1274682855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48163660 con 0x7fdb481ed200 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.705+0000 7fdb4ebe8640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb481ed660 0x7fdb480ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.705+0000 7fdb4dbe6640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb481ed200 0x7fdb480acf80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800e540 tx=0x7fdb3800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.705+0000 7fdb3effd640 1 -- 172.21.15.77:0/1274682855 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38013610 con 0x7fdb481ed200 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.706+0000 7fdb3effd640 1 -- 172.21.15.77:0/1274682855 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb38013770 con 0x7fdb481ed200 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.706+0000 7fdb3effd640 1 -- 172.21.15.77:0/1274682855 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38013ae0 con 0x7fdb481ed200 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.706+0000 7fdb5064b640 1 -- 172.21.15.77:0/1274682855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb48163940 con 0x7fdb481ed200 2023-11-26T07:18:18.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.706+0000 7fdb5064b640 1 -- 172.21.15.77:0/1274682855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb48158780 con 0x7fdb481ed200 2023-11-26T07:18:18.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.707+0000 7fdb5064b640 1 -- 172.21.15.77:0/1274682855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb48164140 con 0x7fdb481ed200 2023-11-26T07:18:18.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.708+0000 7fdb3effd640 1 -- 172.21.15.77:0/1274682855 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb38013c40 con 0x7fdb481ed200 2023-11-26T07:18:18.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.709+0000 7fdb3effd640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2c06ae40 0x7fdb2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.709+0000 7fdb3effd640 1 -- 172.21.15.77:0/1274682855 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdb38089390 con 0x7fdb481ed200 2023-11-26T07:18:18.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.709+0000 7fdb4e3e7640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2c06ae40 0x7fdb2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.710+0000 7fdb4e3e7640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2c06ae40 0x7fdb2c06d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdb44034000 tx=0x7fdb44007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.713+0000 7fdb3effd640 1 -- 172.21.15.77:0/1274682855 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb38054290 con 0x7fdb481ed200 2023-11-26T07:18:18.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.918+0000 7fdb5064b640 1 -- 172.21.15.77:0/1274682855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdb481599f0 con 0x7fdb481ed200 2023-11-26T07:18:18.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.918+0000 7fdb3effd640 1 -- 172.21.15.77:0/1274682855 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdb380578b0 con 0x7fdb481ed200 2023-11-26T07:18:18.920 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:18:18.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 -- 172.21.15.77:0/1274682855 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2c06ae40 msgr2=0x7fdb2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2c06ae40 0x7fdb2c06d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdb44034000 tx=0x7fdb44007000 comp rx=0 tx=0).stop 2023-11-26T07:18:18.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 -- 172.21.15.77:0/1274682855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb481ed200 msgr2=0x7fdb480acf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb481ed200 0x7fdb480acf80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800e540 tx=0x7fdb3800ea00 comp rx=0 tx=0).stop 2023-11-26T07:18:18.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 -- 172.21.15.77:0/1274682855 shutdown_connections 2023-11-26T07:18:18.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2c06ae40 0x7fdb2c06d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb481ed660 0x7fdb480ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb481ed200 0x7fdb480acf80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 --2- 172.21.15.77:0/1274682855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb340039c0 0x7fdb4814b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 -- 172.21.15.77:0/1274682855 >> 172.21.15.77:0/1274682855 conn(0x7fdb480b0c50 msgr2=0x7fdb480c96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 -- 172.21.15.77:0/1274682855 shutdown_connections 2023-11-26T07:18:18.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:18.921+0000 7fdb5064b640 1 -- 172.21.15.77:0/1274682855 wait complete. 2023-11-26T07:18:18.940 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-26T07:18:18.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:18.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-26T07:18:19.039 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:18:19.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:19.039 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:18:19.113 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:18:19.114 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:19.175 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:18:19.175 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:19.228 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:18:19.228 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:19.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:19.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.498+0000 7f0cbc2ee640 1 Processor -- start 2023-11-26T07:18:19.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.498+0000 7f0cbc2ee640 1 -- start start 2023-11-26T07:18:19.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.499+0000 7f0cbc2ee640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb415b080 0x7f0cb415b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.499+0000 7f0cbc2ee640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb415e3f0 con 0x7f0cb415df80 2023-11-26T07:18:19.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.499+0000 7f0cbc2ee640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb415ab80 con 0x7f0cb40b2250 2023-11-26T07:18:19.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.499+0000 7f0cbc2ee640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb415a990 con 0x7f0cb415b080 2023-11-26T07:18:19.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9889640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0cb415df80 0x7f0cb40ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49086/0 (socket says 172.21.15.77:49086) 2023-11-26T07:18:19.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9889640 1 -- 172.21.15.77:0/3423929689 learned_addr learned my addr 172.21.15.77:0/3423929689 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:19.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cba88b640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb415b080 0x7f0cb415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626224965 0 0) 0x7f0cb415e3f0 con 0x7f0cb415df80 2023-11-26T07:18:19.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca4003520 con 0x7f0cb415df80 2023-11-26T07:18:19.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1506468728 0 0) 0x7f0ca4003520 con 0x7f0cb415df80 2023-11-26T07:18:19.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb415b080 msgr2=0x7f0cb415b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:19.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9088640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb415b080 0x7f0cb415b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 >> v1:172.21.15.159:6789/0 conn(0x7f0cb40b2250 legacy=0x7f0cb40b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb40b2d40 con 0x7f0cb415df80 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f0ca0001670 con 0x7f0cb415df80 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 >> v1:172.21.15.77:6789/0 conn(0x7f0cb415df80 legacy=0x7f0cb40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.500+0000 7f0cb9088640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb415b080 0x7f0ca40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cb9088640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca4003f20 0x7f0ca40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cb9088640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 0x7f0ca4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca400ba30 con 0x7f0ca4004d00 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca400ddb0 con 0x7f0ca4003f20 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca400df70 con 0x7f0cb415b080 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cba88b640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 0x7f0ca4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cb9889640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca4003f20 0x7f0ca40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cba88b640 1 -- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb415b080 msgr2=0x7f0ca40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:19.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cba08a640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb415b080 0x7f0ca40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cba88b640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb415b080 0x7f0ca40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cba88b640 1 -- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca4003f20 msgr2=0x7f0ca40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:19.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cba88b640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca4003f20 0x7f0ca40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cba88b640 1 -- 172.21.15.77:0/3423929689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4003520 con 0x7f0ca4004d00 2023-11-26T07:18:19.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cb9889640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ca4003f20 0x7f0ca40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:19.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.501+0000 7f0cba08a640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb415b080 0x7f0ca40039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:19.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.502+0000 7f0cba88b640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 0x7f0ca4005180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009ac0 tx=0x7f0ca40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8695bc24869165a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:19.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.503+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac02c6b0 con 0x7f0ca4004d00 2023-11-26T07:18:19.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.503+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac02c810 con 0x7f0ca4004d00 2023-11-26T07:18:19.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.503+0000 7f0cb9088640 1 -- 172.21.15.77:0/3423929689 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac02cba0 con 0x7f0ca4004d00 2023-11-26T07:18:19.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.503+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3423929689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 msgr2=0x7f0ca4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.503+0000 7f0cbc2ee640 1 --2- 172.21.15.77:0/3423929689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 0x7f0ca4005180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009ac0 tx=0x7f0ca40057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.503+0000 7f0cba88b640 1 -- 172.21.15.77:0/3423929689 reap_dead start 2023-11-26T07:18:19.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.503+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3423929689 shutdown_connections 2023-11-26T07:18:19.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.503+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3423929689 >> 172.21.15.77:0/3423929689 conn(0x7f0cb406a920 msgr2=0x7f0cb406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:19.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.503+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3423929689 shutdown_connections 2023-11-26T07:18:19.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.504+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3423929689 wait complete. 2023-11-26T07:18:19.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.505+0000 7f0cbc2ee640 1 Processor -- start 2023-11-26T07:18:19.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.505+0000 7f0cbc2ee640 1 -- start start 2023-11-26T07:18:19.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.506+0000 7f0cbc2ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 0x7f0cb4152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.506+0000 7f0cbc2ee640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb4159730 0x7f0cb4099ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.506+0000 7f0cbc2ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cb415c4e0 0x7f0cb415c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.506+0000 7f0cbc2ee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40af830 con 0x7f0ca4004d00 2023-11-26T07:18:19.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.506+0000 7f0cbc2ee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb415cea0 con 0x7f0cb415c4e0 2023-11-26T07:18:19.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.506+0000 7f0cbc2ee640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40aebf0 con 0x7f0cb4159730 2023-11-26T07:18:19.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.507+0000 7f0cba08a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 0x7f0cb4152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.507+0000 7f0cba08a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 0x7f0cb4152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57214/0 (socket says 172.21.15.77:57214) 2023-11-26T07:18:19.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.507+0000 7f0cba08a640 1 -- 172.21.15.77:0/3212431713 learned_addr learned my addr 172.21.15.77:0/3212431713 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:19.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.507+0000 7f0cb9889640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb4159730 0x7f0cb4099ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.507+0000 7f0cba08a640 1 -- 172.21.15.77:0/3212431713 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb4159730 msgr2=0x7f0cb4099ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.507+0000 7f0cba08a640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb4159730 0x7f0cb4099ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.507+0000 7f0cba88b640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cb415c4e0 0x7f0cb415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.507+0000 7f0cba08a640 1 -- 172.21.15.77:0/3212431713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cb415c4e0 msgr2=0x7f0cb415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.507+0000 7f0cba08a640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cb415c4e0 0x7f0cb415c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.507+0000 7f0cba08a640 1 -- 172.21.15.77:0/3212431713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4152bd0 con 0x7f0ca4004d00 2023-11-26T07:18:19.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.507+0000 7f0cba08a640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 0x7f0cb4152690 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800db10 tx=0x7f0ca80020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:19.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.508+0000 7f0cb2ffd640 1 -- 172.21.15.77:0/3212431713 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8003da0 con 0x7f0ca4004d00 2023-11-26T07:18:19.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.508+0000 7f0cb2ffd640 1 -- 172.21.15.77:0/3212431713 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca8006b50 con 0x7f0ca4004d00 2023-11-26T07:18:19.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.508+0000 7f0cb2ffd640 1 -- 172.21.15.77:0/3212431713 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800b6e0 con 0x7f0ca4004d00 2023-11-26T07:18:19.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.508+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3212431713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb40aee90 con 0x7f0ca4004d00 2023-11-26T07:18:19.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.508+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3212431713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb40af450 con 0x7f0ca4004d00 2023-11-26T07:18:19.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.509+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3212431713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb40af610 con 0x7f0ca4004d00 2023-11-26T07:18:19.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.510+0000 7f0cb2ffd640 1 -- 172.21.15.77:0/3212431713 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ca800b840 con 0x7f0ca4004d00 2023-11-26T07:18:19.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.511+0000 7f0cb2ffd640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c9806aec0 0x7f0c9806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.511+0000 7f0cb2ffd640 1 -- 172.21.15.77:0/3212431713 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0ca8088c70 con 0x7f0ca4004d00 2023-11-26T07:18:19.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.511+0000 7f0cb9889640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c9806aec0 0x7f0c9806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.512+0000 7f0cb9889640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c9806aec0 0x7f0c9806d380 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0001200 tx=0x7f0ca0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:19.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.515+0000 7f0cb2ffd640 1 -- 172.21.15.77:0/3212431713 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ca8053d10 con 0x7f0ca4004d00 2023-11-26T07:18:19.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.706+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3212431713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cb40afaa0 con 0x7f0ca4004d00 2023-11-26T07:18:19.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.708+0000 7f0cb2ffd640 1 -- 172.21.15.77:0/3212431713 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16729 (secure 0 0 0) 0x7f0ca8057330 con 0x7f0ca4004d00 2023-11-26T07:18:19.710 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:19.711 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:18:16.826725+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:19.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.711+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3212431713 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c9806aec0 msgr2=0x7f0c9806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.711+0000 7f0cbc2ee640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c9806aec0 0x7f0c9806d380 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0001200 tx=0x7f0ca0009040 comp rx=0 tx=0).stop 2023-11-26T07:18:19.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.711+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3212431713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 msgr2=0x7f0cb4152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.711+0000 7f0cbc2ee640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 0x7f0cb4152690 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800db10 tx=0x7f0ca80020c0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.711+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3212431713 shutdown_connections 2023-11-26T07:18:19.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.711+0000 7f0cbc2ee640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c9806aec0 0x7f0c9806d380 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.711+0000 7f0cbc2ee640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0cb415c4e0 0x7f0cb415c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.711+0000 7f0cbc2ee640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0cb4159730 0x7f0cb4099ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.711+0000 7f0cbc2ee640 1 --2- 172.21.15.77:0/3212431713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ca4004d00 0x7f0cb4152690 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.711+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3212431713 >> 172.21.15.77:0/3212431713 conn(0x7f0cb406a920 msgr2=0x7f0cb40c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:19.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.712+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3212431713 shutdown_connections 2023-11-26T07:18:19.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.712+0000 7f0cbc2ee640 1 -- 172.21.15.77:0/3212431713 wait complete. 2023-11-26T07:18:19.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:19.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:19.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.940+0000 7fd54c31d640 1 Processor -- start 2023-11-26T07:18:19.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.940+0000 7fd54c31d640 1 -- start start 2023-11-26T07:18:19.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.942+0000 7fd54c31d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd5440cc0f0 0x7fd5440c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.942+0000 7fd54c31d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54415eea0 con 0x7fd5440c57e0 2023-11-26T07:18:19.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.942+0000 7fd54c31d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5440abf30 con 0x7fd54415b440 2023-11-26T07:18:19.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.942+0000 7fd54c31d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54415b820 con 0x7fd5440cc0f0 2023-11-26T07:18:19.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.942+0000 7fd54a8ba640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd5440c57e0 0x7fd54406c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49088/0 (socket says 172.21.15.77:49088) 2023-11-26T07:18:19.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.942+0000 7fd54a8ba640 1 -- 172.21.15.77:0/541473797 learned_addr learned my addr 172.21.15.77:0/541473797 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.942+0000 7fd5498b8640 1 --2- 172.21.15.77:0/541473797 >> v2:172.21.15.159:3300/0 conn(0x7fd5440cc0f0 0x7fd5440c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.942+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958922953 0 0) 0x7fd54415eea0 con 0x7fd5440c57e0 2023-11-26T07:18:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.942+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd530003520 con 0x7fd5440c57e0 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279226323 0 0) 0x7fd530003520 con 0x7fd5440c57e0 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 >> v2:172.21.15.159:3300/0 conn(0x7fd5440cc0f0 msgr2=0x7fd5440c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 --2- 172.21.15.77:0/541473797 >> v2:172.21.15.159:3300/0 conn(0x7fd5440cc0f0 0x7fd5440c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 >> v1:172.21.15.159:6789/0 conn(0x7fd54415b440 legacy=0x7fd5440cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54415f0f0 con 0x7fd5440c57e0 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fd53c0019f0 con 0x7fd5440c57e0 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 >> v1:172.21.15.77:6789/0 conn(0x7fd5440c57e0 legacy=0x7fd54406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 --2- 172.21.15.77:0/541473797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd530003970 0x7fd530003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 --2- 172.21.15.77:0/541473797 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5300047c0 0x7fd530004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 --2- 172.21.15.77:0/541473797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd530005180 0x7fd53000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54415b820 con 0x7fd530005180 2023-11-26T07:18:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53000c120 con 0x7fd530003970 2023-11-26T07:18:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53000c2e0 con 0x7fd5300047c0 2023-11-26T07:18:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.943+0000 7fd54a8ba640 1 --2- 172.21.15.77:0/541473797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd530005180 0x7fd53000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.944+0000 7fd54a0b9640 1 --2- 172.21.15.77:0/541473797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd530003970 0x7fd530003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.944+0000 7fd54a8ba640 1 -- 172.21.15.77:0/541473797 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5300047c0 msgr2=0x7fd530004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.944+0000 7fd5498b8640 1 --2- 172.21.15.77:0/541473797 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5300047c0 0x7fd530004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.944+0000 7fd54a8ba640 1 --2- 172.21.15.77:0/541473797 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5300047c0 0x7fd530004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.944+0000 7fd54a8ba640 1 -- 172.21.15.77:0/541473797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd530003970 msgr2=0x7fd530003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.944+0000 7fd54a8ba640 1 --2- 172.21.15.77:0/541473797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd530003970 0x7fd530003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.944+0000 7fd54a8ba640 1 -- 172.21.15.77:0/541473797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530003520 con 0x7fd530005180 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.945+0000 7fd54a8ba640 1 -- 172.21.15.77:0/541473797 reap_dead start 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.945+0000 7fd54a8ba640 1 --2- 172.21.15.77:0/541473797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd530005180 0x7fd53000b980 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00a830 tx=0x7fd5300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee255076eef9edd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.945+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0072d0 con 0x7fd530005180 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.945+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c02f070 con 0x7fd530005180 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.945+0000 7fd5490b7640 1 -- 172.21.15.77:0/541473797 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c007690 con 0x7fd530005180 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.946+0000 7fd54c31d640 1 -- 172.21.15.77:0/541473797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd530005180 msgr2=0x7fd53000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.946+0000 7fd54c31d640 1 --2- 172.21.15.77:0/541473797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd530005180 0x7fd53000b980 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00a830 tx=0x7fd5300057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.946+0000 7fd54c31d640 1 -- 172.21.15.77:0/541473797 shutdown_connections 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.946+0000 7fd54c31d640 1 --2- 172.21.15.77:0/541473797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd530005180 0x7fd53000b980 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.946+0000 7fd54c31d640 1 -- 172.21.15.77:0/541473797 >> 172.21.15.77:0/541473797 conn(0x7fd5440b0c50 msgr2=0x7fd5440b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.946+0000 7fd54c31d640 1 -- 172.21.15.77:0/541473797 shutdown_connections 2023-11-26T07:18:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.946+0000 7fd54c31d640 1 -- 172.21.15.77:0/541473797 wait complete. 2023-11-26T07:18:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.948+0000 7fd54c31d640 1 Processor -- start 2023-11-26T07:18:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.948+0000 7fd54c31d640 1 -- start start 2023-11-26T07:18:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.949+0000 7fd54c31d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd530005180 0x7fd54415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.949+0000 7fd54c31d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd544158170 0x7fd5441455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.949+0000 7fd54c31d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5441585d0 0x7fd544145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.949+0000 7fd54c31d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd544159820 con 0x7fd5441585d0 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.949+0000 7fd54c31d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd544158ba0 con 0x7fd530005180 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.949+0000 7fd54c31d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd544158e80 con 0x7fd544158170 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.949+0000 7fd54a8ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5441585d0 0x7fd544145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.949+0000 7fd54a8ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5441585d0 0x7fd544145b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57230/0 (socket says 172.21.15.77:57230) 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.949+0000 7fd54a8ba640 1 -- 172.21.15.77:0/2237474214 learned_addr learned my addr 172.21.15.77:0/2237474214 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.949+0000 7fd5498b8640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd544158170 0x7fd5441455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.949+0000 7fd54a0b9640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd530005180 0x7fd54415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd54a8ba640 1 -- 172.21.15.77:0/2237474214 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd544158170 msgr2=0x7fd5441455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd54a8ba640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd544158170 0x7fd5441455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd54a8ba640 1 -- 172.21.15.77:0/2237474214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd530005180 msgr2=0x7fd54415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd54a8ba640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd530005180 0x7fd54415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd54a8ba640 1 -- 172.21.15.77:0/2237474214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544159160 con 0x7fd5441585d0 2023-11-26T07:18:19.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd5498b8640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd544158170 0x7fd5441455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:19.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd54a0b9640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd530005180 0x7fd54415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:19.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd54a8ba640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5441585d0 0x7fd544145b20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd53c000f80 tx=0x7fd53c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:19.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd53affd640 1 -- 172.21.15.77:0/2237474214 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c004d60 con 0x7fd5441585d0 2023-11-26T07:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd53affd640 1 -- 172.21.15.77:0/2237474214 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c001250 con 0x7fd5441585d0 2023-11-26T07:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd54c31d640 1 -- 172.21.15.77:0/2237474214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd544159440 con 0x7fd5441585d0 2023-11-26T07:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd53affd640 1 -- 172.21.15.77:0/2237474214 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c007310 con 0x7fd5441585d0 2023-11-26T07:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.950+0000 7fd54c31d640 1 -- 172.21.15.77:0/2237474214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd544157de0 con 0x7fd5441585d0 2023-11-26T07:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.952+0000 7fd54c31d640 1 -- 172.21.15.77:0/2237474214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd544159960 con 0x7fd5441585d0 2023-11-26T07:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.953+0000 7fd53affd640 1 -- 172.21.15.77:0/2237474214 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd53c031030 con 0x7fd5441585d0 2023-11-26T07:18:19.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.953+0000 7fd53affd640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd52806ae70 0x7fd52806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:19.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.954+0000 7fd53affd640 1 -- 172.21.15.77:0/2237474214 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd53c0aaa00 con 0x7fd5441585d0 2023-11-26T07:18:19.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.954+0000 7fd54a0b9640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd52806ae70 0x7fd52806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.954+0000 7fd54a0b9640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd52806ae70 0x7fd52806d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5400015f0 tx=0x7fd540009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:19.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:19.958+0000 7fd53affd640 1 -- 172.21.15.77:0/2237474214 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd544159960 con 0x7fd5441585d0 2023-11-26T07:18:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.148+0000 7fd54c31d640 1 -- 172.21.15.77:0/2237474214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd544159960 con 0x7fd5441585d0 2023-11-26T07:18:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.149+0000 7fd53affd640 1 -- 172.21.15.77:0/2237474214 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd544159960 con 0x7fd5441585d0 2023-11-26T07:18:20.151 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:18:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.151+0000 7fd54c31d640 1 -- 172.21.15.77:0/2237474214 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd52806ae70 msgr2=0x7fd52806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.151+0000 7fd54c31d640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd52806ae70 0x7fd52806d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5400015f0 tx=0x7fd540009040 comp rx=0 tx=0).stop 2023-11-26T07:18:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.151+0000 7fd54c31d640 1 -- 172.21.15.77:0/2237474214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5441585d0 msgr2=0x7fd544145b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.151+0000 7fd54c31d640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5441585d0 0x7fd544145b20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd53c000f80 tx=0x7fd53c001d80 comp rx=0 tx=0).stop 2023-11-26T07:18:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.152+0000 7fd54c31d640 1 -- 172.21.15.77:0/2237474214 shutdown_connections 2023-11-26T07:18:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.152+0000 7fd54c31d640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd52806ae70 0x7fd52806d330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.152+0000 7fd54c31d640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5441585d0 0x7fd544145b20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.152+0000 7fd54c31d640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd544158170 0x7fd5441455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.152+0000 7fd54c31d640 1 --2- 172.21.15.77:0/2237474214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd530005180 0x7fd54415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.152+0000 7fd54c31d640 1 -- 172.21.15.77:0/2237474214 >> 172.21.15.77:0/2237474214 conn(0x7fd5440b0c50 msgr2=0x7fd5440c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.152+0000 7fd54c31d640 1 -- 172.21.15.77:0/2237474214 shutdown_connections 2023-11-26T07:18:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.152+0000 7fd54c31d640 1 -- 172.21.15.77:0/2237474214 wait complete. 2023-11-26T07:18:20.172 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:20.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.377+0000 7fd481f0f640 1 Processor -- start 2023-11-26T07:18:20.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.377+0000 7fd481f0f640 1 -- start start 2023-11-26T07:18:20.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.379+0000 7fd481f0f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47c15b440 0x7fd47c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.379+0000 7fd481f0f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd47c0cbf20 0x7fd47c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.379+0000 7fd481f0f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c0cc3a0 con 0x7fd47c0c57e0 2023-11-26T07:18:20.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.379+0000 7fd481f0f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c15b820 con 0x7fd47c0cbf20 2023-11-26T07:18:20.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.379+0000 7fd481f0f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c15eea0 con 0x7fd47c15b440 2023-11-26T07:18:20.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.379+0000 7fd472ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd47c0cbf20 0x7fd47c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:20.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.379+0000 7fd472ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd47c0cbf20 0x7fd47c0c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57238/0 (socket says 172.21.15.77:57238) 2023-11-26T07:18:20.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.379+0000 7fd472ffd640 1 -- 172.21.15.77:0/1711380141 learned_addr learned my addr 172.21.15.77:0/1711380141 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:20.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.379+0000 7fd47b7fe640 1 --2- 172.21.15.77:0/1711380141 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47c15b440 0x7fd47c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:20.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.380+0000 7fd472ffd640 1 -- 172.21.15.77:0/1711380141 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47c15b440 msgr2=0x7fd47c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:20.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.380+0000 7fd472ffd640 1 --2- 172.21.15.77:0/1711380141 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47c15b440 0x7fd47c0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.380+0000 7fd472ffd640 1 -- 172.21.15.77:0/1711380141 >> v1:172.21.15.77:6789/0 conn(0x7fd47c0c57e0 legacy=0x7fd47c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.380+0000 7fd472ffd640 1 -- 172.21.15.77:0/1711380141 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c06d600 con 0x7fd47c0cbf20 2023-11-26T07:18:20.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.381+0000 7fd472ffd640 1 --2- 172.21.15.77:0/1711380141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47c0cbf20 0x7fd47c0c52a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd464009e50 tx=0x7fd46402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14dbc44c7d32221 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:20.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.381+0000 7fd47affd640 1 -- 172.21.15.77:0/1711380141 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46402ca80 con 0x7fd47c0cbf20 2023-11-26T07:18:20.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.381+0000 7fd47affd640 1 -- 172.21.15.77:0/1711380141 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46402cbe0 con 0x7fd47c0cbf20 2023-11-26T07:18:20.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.381+0000 7fd47affd640 1 -- 172.21.15.77:0/1711380141 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4640343f0 con 0x7fd47c0cbf20 2023-11-26T07:18:20.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.382+0000 7fd481f0f640 1 -- 172.21.15.77:0/1711380141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47c0cbf20 msgr2=0x7fd47c0c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.382+0000 7fd481f0f640 1 --2- 172.21.15.77:0/1711380141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47c0cbf20 0x7fd47c0c52a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd464009e50 tx=0x7fd46402bee0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.382+0000 7fd481f0f640 1 -- 172.21.15.77:0/1711380141 shutdown_connections 2023-11-26T07:18:20.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.382+0000 7fd481f0f640 1 --2- 172.21.15.77:0/1711380141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47c0cbf20 0x7fd47c0c52a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.382+0000 7fd481f0f640 1 --2- 172.21.15.77:0/1711380141 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47c15b440 0x7fd47c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.382+0000 7fd481f0f640 1 -- 172.21.15.77:0/1711380141 >> 172.21.15.77:0/1711380141 conn(0x7fd47c0b0c50 msgr2=0x7fd47c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:20.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.382+0000 7fd481f0f640 1 -- 172.21.15.77:0/1711380141 shutdown_connections 2023-11-26T07:18:20.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.382+0000 7fd481f0f640 1 -- 172.21.15.77:0/1711380141 wait complete. 2023-11-26T07:18:20.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.384+0000 7fd481f0f640 1 Processor -- start 2023-11-26T07:18:20.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.384+0000 7fd481f0f640 1 -- start start 2023-11-26T07:18:20.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd481f0f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47c0c57e0 0x7fd47c15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd481f0f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd47c0cbf20 0x7fd47c09be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd481f0f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47c15b440 0x7fd47c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd481f0f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c09ba30 con 0x7fd47c0c57e0 2023-11-26T07:18:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd481f0f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c1542a0 con 0x7fd47c0cbf20 2023-11-26T07:18:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd481f0f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c09b090 con 0x7fd47c15b440 2023-11-26T07:18:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd47b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47c0c57e0 0x7fd47c15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd47b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47c0c57e0 0x7fd47c15a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57240/0 (socket says 172.21.15.77:57240) 2023-11-26T07:18:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd47b7fe640 1 -- 172.21.15.77:0/1227652900 learned_addr learned my addr 172.21.15.77:0/1227652900 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:20.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd47b7fe640 1 -- 172.21.15.77:0/1227652900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47c15b440 msgr2=0x7fd47c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd47b7fe640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47c15b440 0x7fd47c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd47b7fe640 1 -- 172.21.15.77:0/1227652900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd47c0cbf20 msgr2=0x7fd47c09be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd47b7fe640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd47c0cbf20 0x7fd47c09be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.385+0000 7fd47b7fe640 1 -- 172.21.15.77:0/1227652900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd464009b30 con 0x7fd47c0c57e0 2023-11-26T07:18:20.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.386+0000 7fd47b7fe640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47c0c57e0 0x7fd47c15a720 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00d5f0 tx=0x7fd46c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:20.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.386+0000 7fd478ff9640 1 -- 172.21.15.77:0/1227652900 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0125f0 con 0x7fd47c0c57e0 2023-11-26T07:18:20.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.386+0000 7fd478ff9640 1 -- 172.21.15.77:0/1227652900 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c012750 con 0x7fd47c0c57e0 2023-11-26T07:18:20.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.386+0000 7fd481f0f640 1 -- 172.21.15.77:0/1227652900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c09b370 con 0x7fd47c0c57e0 2023-11-26T07:18:20.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.386+0000 7fd478ff9640 1 -- 172.21.15.77:0/1227652900 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c012b00 con 0x7fd47c0c57e0 2023-11-26T07:18:20.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.386+0000 7fd481f0f640 1 -- 172.21.15.77:0/1227652900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47c09c390 con 0x7fd47c0c57e0 2023-11-26T07:18:20.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.387+0000 7fd481f0f640 1 -- 172.21.15.77:0/1227652900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47c0704c0 con 0x7fd47c0c57e0 2023-11-26T07:18:20.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.388+0000 7fd478ff9640 1 -- 172.21.15.77:0/1227652900 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd46c012c60 con 0x7fd47c0c57e0 2023-11-26T07:18:20.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.389+0000 7fd478ff9640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd45c06ae40 0x7fd45c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.389+0000 7fd478ff9640 1 -- 172.21.15.77:0/1227652900 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd46c089ad0 con 0x7fd47c0c57e0 2023-11-26T07:18:20.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.389+0000 7fd472ffd640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd45c06ae40 0x7fd45c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:20.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.390+0000 7fd472ffd640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd45c06ae40 0x7fd45c06d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd464035000 tx=0x7fd46402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:20.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.393+0000 7fd478ff9640 1 -- 172.21.15.77:0/1227652900 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd46c054b90 con 0x7fd47c0c57e0 2023-11-26T07:18:20.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.583+0000 7fd481f0f640 1 -- 172.21.15.77:0/1227652900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd47c04e8b0 con 0x7fd47c0c57e0 2023-11-26T07:18:20.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.584+0000 7fd478ff9640 1 -- 172.21.15.77:0/1227652900 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd46c0581b0 con 0x7fd47c0c57e0 2023-11-26T07:18:20.587 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:18:20.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.587+0000 7fd481f0f640 1 -- 172.21.15.77:0/1227652900 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd45c06ae40 msgr2=0x7fd45c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.587+0000 7fd481f0f640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd45c06ae40 0x7fd45c06d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd464035000 tx=0x7fd46402e000 comp rx=0 tx=0).stop 2023-11-26T07:18:20.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.587+0000 7fd481f0f640 1 -- 172.21.15.77:0/1227652900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47c0c57e0 msgr2=0x7fd47c15a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.587+0000 7fd481f0f640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47c0c57e0 0x7fd47c15a720 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00d5f0 tx=0x7fd46c00dab0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.588+0000 7fd481f0f640 1 -- 172.21.15.77:0/1227652900 shutdown_connections 2023-11-26T07:18:20.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.588+0000 7fd481f0f640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd45c06ae40 0x7fd45c06d300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.588+0000 7fd481f0f640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd47c15b440 0x7fd47c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.588+0000 7fd481f0f640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd47c0cbf20 0x7fd47c09be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.588+0000 7fd481f0f640 1 --2- 172.21.15.77:0/1227652900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd47c0c57e0 0x7fd47c15a720 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.588+0000 7fd481f0f640 1 -- 172.21.15.77:0/1227652900 >> 172.21.15.77:0/1227652900 conn(0x7fd47c0b0c50 msgr2=0x7fd47c1548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:20.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.588+0000 7fd481f0f640 1 -- 172.21.15.77:0/1227652900 shutdown_connections 2023-11-26T07:18:20.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.588+0000 7fd481f0f640 1 -- 172.21.15.77:0/1227652900 wait complete. 2023-11-26T07:18:20.608 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:20.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.825+0000 7f9f45e9b640 1 Processor -- start 2023-11-26T07:18:20.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.825+0000 7f9f45e9b640 1 -- start start 2023-11-26T07:18:20.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.827+0000 7f9f45e9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f400c4220 0x7f9f400cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.827+0000 7f9f45e9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9f4006d600 0x7f9f400cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.827+0000 7f9f45e9b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4015e400 con 0x7f9f4015d7f0 2023-11-26T07:18:20.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.827+0000 7f9f45e9b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f400ce880 con 0x7f9f4006d600 2023-11-26T07:18:20.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.827+0000 7f9f45e9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400c46e0 con 0x7f9f400c4220 2023-11-26T07:18:20.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.827+0000 7f9f3ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9f4006d600 0x7f9f400cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:20.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.827+0000 7f9f3ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9f4006d600 0x7f9f400cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57256/0 (socket says 172.21.15.77:57256) 2023-11-26T07:18:20.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.827+0000 7f9f3ffff640 1 -- 172.21.15.77:0/1600369521 learned_addr learned my addr 172.21.15.77:0/1600369521 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:20.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.827+0000 7f9f3effd640 1 --2- 172.21.15.77:0/1600369521 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f400c4220 0x7f9f400cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:20.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.828+0000 7f9f3ffff640 1 -- 172.21.15.77:0/1600369521 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f400c4220 msgr2=0x7f9f400cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:20.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.828+0000 7f9f3ffff640 1 --2- 172.21.15.77:0/1600369521 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f400c4220 0x7f9f400cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.828+0000 7f9f3ffff640 1 -- 172.21.15.77:0/1600369521 >> v1:172.21.15.77:6789/0 conn(0x7f9f4015d7f0 legacy=0x7f9f400c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.828+0000 7f9f3ffff640 1 -- 172.21.15.77:0/1600369521 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400c49c0 con 0x7f9f4006d600 2023-11-26T07:18:20.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.829+0000 7f9f3ffff640 1 --2- 172.21.15.77:0/1600369521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f4006d600 0x7f9f400cb0f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009870 tx=0x7f9f3802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a3fe8cd6abcfc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:20.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.829+0000 7f9f3e7fc640 1 -- 172.21.15.77:0/1600369521 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38030840 con 0x7f9f4006d600 2023-11-26T07:18:20.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.829+0000 7f9f3e7fc640 1 -- 172.21.15.77:0/1600369521 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f380309a0 con 0x7f9f4006d600 2023-11-26T07:18:20.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.829+0000 7f9f3e7fc640 1 -- 172.21.15.77:0/1600369521 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38030d30 con 0x7f9f4006d600 2023-11-26T07:18:20.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.830+0000 7f9f45e9b640 1 -- 172.21.15.77:0/1600369521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f4006d600 msgr2=0x7f9f400cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.830+0000 7f9f45e9b640 1 --2- 172.21.15.77:0/1600369521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f4006d600 0x7f9f400cb0f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009870 tx=0x7f9f3802b980 comp rx=0 tx=0).stop 2023-11-26T07:18:20.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.830+0000 7f9f45e9b640 1 -- 172.21.15.77:0/1600369521 shutdown_connections 2023-11-26T07:18:20.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.830+0000 7f9f45e9b640 1 --2- 172.21.15.77:0/1600369521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f4006d600 0x7f9f400cb0f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.830+0000 7f9f45e9b640 1 --2- 172.21.15.77:0/1600369521 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f400c4220 0x7f9f400cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.830+0000 7f9f45e9b640 1 -- 172.21.15.77:0/1600369521 >> 172.21.15.77:0/1600369521 conn(0x7f9f400b0c50 msgr2=0x7f9f400b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:20.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.830+0000 7f9f45e9b640 1 -- 172.21.15.77:0/1600369521 shutdown_connections 2023-11-26T07:18:20.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.830+0000 7f9f45e9b640 1 -- 172.21.15.77:0/1600369521 wait complete. 2023-11-26T07:18:20.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.831+0000 7f9f45e9b640 1 Processor -- start 2023-11-26T07:18:20.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.832+0000 7f9f45e9b640 1 -- start start 2023-11-26T07:18:20.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.832+0000 7f9f45e9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f4006d600 0x7f9f40151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f45e9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f400c4220 0x7f9f40145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f45e9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f4015d7f0 0x7f9f40154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f45e9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f40145b70 con 0x7f9f4015d7f0 2023-11-26T07:18:20.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f45e9b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f40072600 con 0x7f9f400c4220 2023-11-26T07:18:20.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f45e9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400719f0 con 0x7f9f4006d600 2023-11-26T07:18:20.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f3ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f4015d7f0 0x7f9f40154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f3ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f4015d7f0 0x7f9f40154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57270/0 (socket says 172.21.15.77:57270) 2023-11-26T07:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f3ffff640 1 -- 172.21.15.77:0/3749223198 learned_addr learned my addr 172.21.15.77:0/3749223198 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f3f7fe640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f4006d600 0x7f9f40151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f3ffff640 1 -- 172.21.15.77:0/3749223198 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f4006d600 msgr2=0x7f9f40151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f3ffff640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f4006d600 0x7f9f40151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f3ffff640 1 -- 172.21.15.77:0/3749223198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f400c4220 msgr2=0x7f9f40145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f3ffff640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f400c4220 0x7f9f40145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f3ffff640 1 -- 172.21.15.77:0/3749223198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380094d0 con 0x7f9f4015d7f0 2023-11-26T07:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.833+0000 7f9f3f7fe640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f4006d600 0x7f9f40151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:20.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.834+0000 7f9f3ffff640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f4015d7f0 0x7f9f40154480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009870 tx=0x7f9f38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:20.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.834+0000 7f9f37fff640 1 -- 172.21.15.77:0/3749223198 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38039c90 con 0x7f9f4015d7f0 2023-11-26T07:18:20.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.834+0000 7f9f37fff640 1 -- 172.21.15.77:0/3749223198 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f38039df0 con 0x7f9f4015d7f0 2023-11-26T07:18:20.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.834+0000 7f9f37fff640 1 -- 172.21.15.77:0/3749223198 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38043640 con 0x7f9f4015d7f0 2023-11-26T07:18:20.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.834+0000 7f9f45e9b640 1 -- 172.21.15.77:0/3749223198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f40071cd0 con 0x7f9f4015d7f0 2023-11-26T07:18:20.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.834+0000 7f9f45e9b640 1 -- 172.21.15.77:0/3749223198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f40072290 con 0x7f9f4015d7f0 2023-11-26T07:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.835+0000 7f9f45e9b640 1 -- 172.21.15.77:0/3749223198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4004e8b0 con 0x7f9f4015d7f0 2023-11-26T07:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.836+0000 7f9f37fff640 1 -- 172.21.15.77:0/3749223198 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f380437a0 con 0x7f9f4015d7f0 2023-11-26T07:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.838+0000 7f9f37fff640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2006ae70 0x7f9f2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.838+0000 7f9f37fff640 1 -- 172.21.15.77:0/3749223198 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9f3803e070 con 0x7f9f4015d7f0 2023-11-26T07:18:20.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.838+0000 7f9f3f7fe640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2006ae70 0x7f9f2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:20.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.839+0000 7f9f3f7fe640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2006ae70 0x7f9f2006d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9f300012e0 tx=0x7f9f30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:20.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:20.842+0000 7f9f37fff640 1 -- 172.21.15.77:0/3749223198 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f38077740 con 0x7f9f4015d7f0 2023-11-26T07:18:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.032+0000 7f9f45e9b640 1 -- 172.21.15.77:0/3749223198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f40072740 con 0x7f9f4015d7f0 2023-11-26T07:18:21.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.033+0000 7f9f37fff640 1 -- 172.21.15.77:0/3749223198 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f3807ad60 con 0x7f9f4015d7f0 2023-11-26T07:18:21.035 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:18:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 -- 172.21.15.77:0/3749223198 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2006ae70 msgr2=0x7f9f2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2006ae70 0x7f9f2006d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9f300012e0 tx=0x7f9f30009040 comp rx=0 tx=0).stop 2023-11-26T07:18:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 -- 172.21.15.77:0/3749223198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f4015d7f0 msgr2=0x7f9f40154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f4015d7f0 0x7f9f40154480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009870 tx=0x7f9f38004730 comp rx=0 tx=0).stop 2023-11-26T07:18:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 -- 172.21.15.77:0/3749223198 shutdown_connections 2023-11-26T07:18:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f2006ae70 0x7f9f2006d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f4015d7f0 0x7f9f40154480 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f400c4220 0x7f9f40145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 --2- 172.21.15.77:0/3749223198 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f4006d600 0x7f9f40151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 -- 172.21.15.77:0/3749223198 >> 172.21.15.77:0/3749223198 conn(0x7f9f400b0c50 msgr2=0x7f9f400aebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:21.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 -- 172.21.15.77:0/3749223198 shutdown_connections 2023-11-26T07:18:21.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.036+0000 7f9f45e9b640 1 -- 172.21.15.77:0/3749223198 wait complete. 2023-11-26T07:18:21.056 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:21.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.270+0000 7fae6851d640 1 Processor -- start 2023-11-26T07:18:21.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.270+0000 7fae6851d640 1 -- start start 2023-11-26T07:18:21.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae6851d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fae6015d7f0 0x7fae600c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae6851d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae6006d600 0x7fae600cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae6851d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6015e400 con 0x7fae600c4220 2023-11-26T07:18:21.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae6851d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae600ce880 con 0x7fae6006d600 2023-11-26T07:18:21.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae6851d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae600c5ed0 con 0x7fae6015d7f0 2023-11-26T07:18:21.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae66aba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae6006d600 0x7fae600cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae66aba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae6006d600 0x7fae600cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57286/0 (socket says 172.21.15.77:57286) 2023-11-26T07:18:21.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae66aba640 1 -- 172.21.15.77:0/3868693645 learned_addr learned my addr 172.21.15.77:0/3868693645 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:21.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae662b9640 1 --2- 172.21.15.77:0/3868693645 >> v2:172.21.15.159:3300/0 conn(0x7fae6015d7f0 0x7fae600c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae66aba640 1 -- 172.21.15.77:0/3868693645 >> v2:172.21.15.159:3300/0 conn(0x7fae6015d7f0 msgr2=0x7fae600c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:21.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae66aba640 1 --2- 172.21.15.77:0/3868693645 >> v2:172.21.15.159:3300/0 conn(0x7fae6015d7f0 0x7fae600c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae66aba640 1 -- 172.21.15.77:0/3868693645 >> v1:172.21.15.159:6789/0 conn(0x7fae600c4220 legacy=0x7fae600cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:21.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.272+0000 7fae66aba640 1 -- 172.21.15.77:0/3868693645 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae600c46e0 con 0x7fae6006d600 2023-11-26T07:18:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.274+0000 7fae66aba640 1 --2- 172.21.15.77:0/3868693645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6006d600 0x7fae600cb2c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fae6006ea50 tx=0x7fae5802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a964b5fd80e67d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.274+0000 7fae652b7640 1 -- 172.21.15.77:0/3868693645 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5802ca80 con 0x7fae6006d600 2023-11-26T07:18:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.274+0000 7fae652b7640 1 -- 172.21.15.77:0/3868693645 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5802cbe0 con 0x7fae6006d600 2023-11-26T07:18:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.274+0000 7fae652b7640 1 -- 172.21.15.77:0/3868693645 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae580343f0 con 0x7fae6006d600 2023-11-26T07:18:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.274+0000 7fae6851d640 1 -- 172.21.15.77:0/3868693645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6006d600 msgr2=0x7fae600cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.274+0000 7fae6851d640 1 --2- 172.21.15.77:0/3868693645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6006d600 0x7fae600cb2c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fae6006ea50 tx=0x7fae5802bee0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.275+0000 7fae6851d640 1 -- 172.21.15.77:0/3868693645 shutdown_connections 2023-11-26T07:18:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.275+0000 7fae6851d640 1 --2- 172.21.15.77:0/3868693645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6006d600 0x7fae600cb2c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.275+0000 7fae6851d640 1 --2- 172.21.15.77:0/3868693645 >> v2:172.21.15.159:3300/0 conn(0x7fae6015d7f0 0x7fae600c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.275+0000 7fae6851d640 1 -- 172.21.15.77:0/3868693645 >> 172.21.15.77:0/3868693645 conn(0x7fae600b0c50 msgr2=0x7fae600b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.275+0000 7fae6851d640 1 -- 172.21.15.77:0/3868693645 shutdown_connections 2023-11-26T07:18:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.275+0000 7fae6851d640 1 -- 172.21.15.77:0/3868693645 wait complete. 2023-11-26T07:18:21.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.276+0000 7fae6851d640 1 Processor -- start 2023-11-26T07:18:21.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.277+0000 7fae6851d640 1 -- start start 2023-11-26T07:18:21.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.277+0000 7fae6851d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae6006d600 0x7fae60157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.277+0000 7fae6851d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae600c4220 0x7fae601f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae6851d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae6015d7f0 0x7fae600caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae6851d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae600c6df0 con 0x7fae600c4220 2023-11-26T07:18:21.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae6851d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae600c6170 con 0x7fae6006d600 2023-11-26T07:18:21.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae6851d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae600c6450 con 0x7fae6015d7f0 2023-11-26T07:18:21.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae65ab8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae600c4220 0x7fae601f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae65ab8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae600c4220 0x7fae601f45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57294/0 (socket says 172.21.15.77:57294) 2023-11-26T07:18:21.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae65ab8640 1 -- 172.21.15.77:0/1749909795 learned_addr learned my addr 172.21.15.77:0/1749909795 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:21.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae66aba640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae6015d7f0 0x7fae600caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae65ab8640 1 -- 172.21.15.77:0/1749909795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae6015d7f0 msgr2=0x7fae600caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae65ab8640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae6015d7f0 0x7fae600caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae662b9640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae6006d600 0x7fae60157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae65ab8640 1 -- 172.21.15.77:0/1749909795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae6006d600 msgr2=0x7fae60157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae65ab8640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae6006d600 0x7fae60157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.278+0000 7fae65ab8640 1 -- 172.21.15.77:0/1749909795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae58009b30 con 0x7fae600c4220 2023-11-26T07:18:21.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.279+0000 7fae65ab8640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae600c4220 0x7fae601f45f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fae5000c410 tx=0x7fae5000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:21.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.279+0000 7fae56ffd640 1 -- 172.21.15.77:0/1749909795 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500035f0 con 0x7fae600c4220 2023-11-26T07:18:21.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.279+0000 7fae56ffd640 1 -- 172.21.15.77:0/1749909795 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae50003750 con 0x7fae600c4220 2023-11-26T07:18:21.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.279+0000 7fae56ffd640 1 -- 172.21.15.77:0/1749909795 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50003b40 con 0x7fae600c4220 2023-11-26T07:18:21.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.279+0000 7fae6851d640 1 -- 172.21.15.77:0/1749909795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae600c6730 con 0x7fae600c4220 2023-11-26T07:18:21.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.279+0000 7fae6851d640 1 -- 172.21.15.77:0/1749909795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae601581f0 con 0x7fae600c4220 2023-11-26T07:18:21.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.280+0000 7fae6851d640 1 -- 172.21.15.77:0/1749909795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae600cc0f0 con 0x7fae600c4220 2023-11-26T07:18:21.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.281+0000 7fae56ffd640 1 -- 172.21.15.77:0/1749909795 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae50003ca0 con 0x7fae600c4220 2023-11-26T07:18:21.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.282+0000 7fae56ffd640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae4406ae70 0x7fae4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.282+0000 7fae56ffd640 1 -- 172.21.15.77:0/1749909795 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fae50088860 con 0x7fae600c4220 2023-11-26T07:18:21.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.282+0000 7fae662b9640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae4406ae70 0x7fae4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.283+0000 7fae662b9640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae4406ae70 0x7fae4406d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae600affb0 tx=0x7fae5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:21.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.286+0000 7fae56ffd640 1 -- 172.21.15.77:0/1749909795 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fae50053900 con 0x7fae600c4220 2023-11-26T07:18:21.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.474+0000 7fae6851d640 1 -- 172.21.15.77:0/1749909795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fae600c6f30 con 0x7fae600c4220 2023-11-26T07:18:21.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.475+0000 7fae56ffd640 1 -- 172.21.15.77:0/1749909795 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fae600c6f30 con 0x7fae600c4220 2023-11-26T07:18:21.477 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:18:21.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.477+0000 7fae6851d640 1 -- 172.21.15.77:0/1749909795 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae4406ae70 msgr2=0x7fae4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.477+0000 7fae6851d640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae4406ae70 0x7fae4406d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae600affb0 tx=0x7fae5c008040 comp rx=0 tx=0).stop 2023-11-26T07:18:21.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.477+0000 7fae6851d640 1 -- 172.21.15.77:0/1749909795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae600c4220 msgr2=0x7fae601f45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.477+0000 7fae6851d640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae600c4220 0x7fae601f45f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fae5000c410 tx=0x7fae5000c8d0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.478+0000 7fae6851d640 1 -- 172.21.15.77:0/1749909795 shutdown_connections 2023-11-26T07:18:21.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.478+0000 7fae6851d640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae4406ae70 0x7fae4406d330 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.478+0000 7fae6851d640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae6015d7f0 0x7fae600caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.478+0000 7fae6851d640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae600c4220 0x7fae601f45f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.478+0000 7fae6851d640 1 --2- 172.21.15.77:0/1749909795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae6006d600 0x7fae60157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.478+0000 7fae6851d640 1 -- 172.21.15.77:0/1749909795 >> 172.21.15.77:0/1749909795 conn(0x7fae600b0c50 msgr2=0x7fae600ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:21.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.478+0000 7fae6851d640 1 -- 172.21.15.77:0/1749909795 shutdown_connections 2023-11-26T07:18:21.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:21.478+0000 7fae6851d640 1 -- 172.21.15.77:0/1749909795 wait complete. 2023-11-26T07:18:21.497 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-26T07:18:21.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:21.498 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-26T07:18:21.609 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:18:21.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:21.609 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:18:21.668 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:18:21.668 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:21.725 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:18:21.725 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:21.777 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:18:21.777 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:21.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:22.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.084+0000 7f9c9a135640 1 Processor -- start 2023-11-26T07:18:22.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.084+0000 7f9c9a135640 1 -- start start 2023-11-26T07:18:22.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.085+0000 7f9c9a135640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c9406d6c0 0x7f9c9406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.085+0000 7f9c9a135640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9c940cdbf0 0x7f9c940ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.085+0000 7f9c9a135640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9406e060 con 0x7f9c9413d120 2023-11-26T07:18:22.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.085+0000 7f9c9a135640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9413f9e0 con 0x7f9c940cdbf0 2023-11-26T07:18:22.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.085+0000 7f9c9a135640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9413fcc0 con 0x7f9c9406d6c0 2023-11-26T07:18:22.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.086+0000 7f9c99934640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9c940cdbf0 0x7f9c940ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.086+0000 7f9c99934640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9c940cdbf0 0x7f9c940ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:44316/0 (socket says 172.21.15.77:44316) 2023-11-26T07:18:22.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.086+0000 7f9c99934640 1 -- 172.21.15.77:0/1357536997 learned_addr learned my addr 172.21.15.77:0/1357536997 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:22.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.086+0000 7f9c98932640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c9406d6c0 0x7f9c9406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.087+0000 7f9c99934640 1 -- 172.21.15.77:0/1357536997 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c9406d6c0 msgr2=0x7f9c9406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:22.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.087+0000 7f9c99934640 1 --2- 172.21.15.77:0/1357536997 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c9406d6c0 0x7f9c9406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.087+0000 7f9c99934640 1 -- 172.21.15.77:0/1357536997 >> v1:172.21.15.159:6789/0 conn(0x7f9c9413d120 legacy=0x7f9c9415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.087+0000 7f9c99934640 1 -- 172.21.15.77:0/1357536997 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9413ffa0 con 0x7f9c940cdbf0 2023-11-26T07:18:22.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.089+0000 7f9c99934640 1 --2- 172.21.15.77:0/1357536997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c940cdbf0 0x7f9c940ce080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009e50 tx=0x7f9c8c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84350846da92cb08 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:22.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.089+0000 7f9c8bfff640 1 -- 172.21.15.77:0/1357536997 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c02ca80 con 0x7f9c940cdbf0 2023-11-26T07:18:22.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.090+0000 7f9c8bfff640 1 -- 172.21.15.77:0/1357536997 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c02cbe0 con 0x7f9c940cdbf0 2023-11-26T07:18:22.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.090+0000 7f9c8bfff640 1 -- 172.21.15.77:0/1357536997 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0343f0 con 0x7f9c940cdbf0 2023-11-26T07:18:22.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.090+0000 7f9c9a135640 1 -- 172.21.15.77:0/1357536997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c940cdbf0 msgr2=0x7f9c940ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.090+0000 7f9c9a135640 1 --2- 172.21.15.77:0/1357536997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c940cdbf0 0x7f9c940ce080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009e50 tx=0x7f9c8c02bee0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.090+0000 7f9c9a135640 1 -- 172.21.15.77:0/1357536997 shutdown_connections 2023-11-26T07:18:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.090+0000 7f9c9a135640 1 --2- 172.21.15.77:0/1357536997 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c9406d6c0 0x7f9c9406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.090+0000 7f9c9a135640 1 --2- 172.21.15.77:0/1357536997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c940cdbf0 0x7f9c940ce080 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.090+0000 7f9c9a135640 1 -- 172.21.15.77:0/1357536997 >> 172.21.15.77:0/1357536997 conn(0x7f9c940cb830 msgr2=0x7f9c940cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.090+0000 7f9c9a135640 1 -- 172.21.15.77:0/1357536997 shutdown_connections 2023-11-26T07:18:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.090+0000 7f9c9a135640 1 -- 172.21.15.77:0/1357536997 wait complete. 2023-11-26T07:18:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.092+0000 7f9c9a135640 1 Processor -- start 2023-11-26T07:18:22.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.092+0000 7f9c9a135640 1 -- start start 2023-11-26T07:18:22.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.093+0000 7f9c9a135640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c9406d6c0 0x7f9c940b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.093+0000 7f9c9a135640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c940cdbf0 0x7f9c940ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.093+0000 7f9c9a135640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9413d120 0x7f9c9415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.093+0000 7f9c9a135640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940adaa0 con 0x7f9c9413d120 2023-11-26T07:18:22.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.093+0000 7f9c9a135640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940add80 con 0x7f9c9406d6c0 2023-11-26T07:18:22.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.093+0000 7f9c9a135640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940ae060 con 0x7f9c940cdbf0 2023-11-26T07:18:22.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.093+0000 7f9c99934640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9413d120 0x7f9c9415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.093+0000 7f9c99934640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9413d120 0x7f9c9415c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57302/0 (socket says 172.21.15.77:57302) 2023-11-26T07:18:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.094+0000 7f9c99934640 1 -- 172.21.15.77:0/252889680 learned_addr learned my addr 172.21.15.77:0/252889680 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.094+0000 7f9c99934640 1 -- 172.21.15.77:0/252889680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c940cdbf0 msgr2=0x7f9c940ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.094+0000 7f9c98932640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c940cdbf0 0x7f9c940ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.094+0000 7f9c99133640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c9406d6c0 0x7f9c940b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.094+0000 7f9c99934640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c940cdbf0 0x7f9c940ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.094+0000 7f9c99934640 1 -- 172.21.15.77:0/252889680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c9406d6c0 msgr2=0x7f9c940b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.094+0000 7f9c99934640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c9406d6c0 0x7f9c940b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.094+0000 7f9c99934640 1 -- 172.21.15.77:0/252889680 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c009b30 con 0x7f9c9413d120 2023-11-26T07:18:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.094+0000 7f9c99934640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9413d120 0x7f9c9415c380 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c036040 tx=0x7f9c8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.095+0000 7f9c89ffb640 1 -- 172.21.15.77:0/252889680 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c009510 con 0x7f9c9413d120 2023-11-26T07:18:22.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.095+0000 7f9c89ffb640 1 -- 172.21.15.77:0/252889680 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c03e450 con 0x7f9c9413d120 2023-11-26T07:18:22.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.095+0000 7f9c89ffb640 1 -- 172.21.15.77:0/252889680 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c03e820 con 0x7f9c9413d120 2023-11-26T07:18:22.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.095+0000 7f9c9a135640 1 -- 172.21.15.77:0/252889680 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9415a9d0 con 0x7f9c9413d120 2023-11-26T07:18:22.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.095+0000 7f9c9a135640 1 -- 172.21.15.77:0/252889680 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c940ad790 con 0x7f9c9413d120 2023-11-26T07:18:22.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.096+0000 7f9c9a135640 1 -- 172.21.15.77:0/252889680 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c940afe30 con 0x7f9c9413d120 2023-11-26T07:18:22.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.097+0000 7f9c89ffb640 1 -- 172.21.15.77:0/252889680 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c8c02cd50 con 0x7f9c9413d120 2023-11-26T07:18:22.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.098+0000 7f9c89ffb640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c7806ae40 0x7f9c7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.098+0000 7f9c89ffb640 1 -- 172.21.15.77:0/252889680 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9c8c0ac170 con 0x7f9c9413d120 2023-11-26T07:18:22.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.098+0000 7f9c99133640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c7806ae40 0x7f9c7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.099+0000 7f9c99133640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c7806ae40 0x7f9c7806d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c900015a0 tx=0x7f9c90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:22.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.102+0000 7f9c89ffb640 1 -- 172.21.15.77:0/252889680 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c8c077100 con 0x7f9c9413d120 2023-11-26T07:18:22.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.298+0000 7f9c9a135640 1 -- 172.21.15.77:0/252889680 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c9404e840 con 0x7f9c9413d120 2023-11-26T07:18:22.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.301+0000 7f9c89ffb640 1 -- 172.21.15.77:0/252889680 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16729 (secure 0 0 0) 0x7f9c8c07a720 con 0x7f9c9413d120 2023-11-26T07:18:22.304 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:18:16.826725+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:22.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.304+0000 7f9c9a135640 1 -- 172.21.15.77:0/252889680 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c7806ae40 msgr2=0x7f9c7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.304+0000 7f9c9a135640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c7806ae40 0x7f9c7806d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c900015a0 tx=0x7f9c90009040 comp rx=0 tx=0).stop 2023-11-26T07:18:22.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.304+0000 7f9c9a135640 1 -- 172.21.15.77:0/252889680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9413d120 msgr2=0x7f9c9415c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.304+0000 7f9c9a135640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9413d120 0x7f9c9415c380 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c036040 tx=0x7f9c8c004a40 comp rx=0 tx=0).stop 2023-11-26T07:18:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.305+0000 7f9c9a135640 1 -- 172.21.15.77:0/252889680 shutdown_connections 2023-11-26T07:18:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.305+0000 7f9c9a135640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c7806ae40 0x7f9c7806d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.305+0000 7f9c9a135640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c9413d120 0x7f9c9415c380 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.305+0000 7f9c9a135640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c940cdbf0 0x7f9c940ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.305+0000 7f9c9a135640 1 --2- 172.21.15.77:0/252889680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c9406d6c0 0x7f9c940b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.305+0000 7f9c9a135640 1 -- 172.21.15.77:0/252889680 >> 172.21.15.77:0/252889680 conn(0x7f9c940cb830 msgr2=0x7f9c940cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.305+0000 7f9c9a135640 1 -- 172.21.15.77:0/252889680 shutdown_connections 2023-11-26T07:18:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.305+0000 7f9c9a135640 1 -- 172.21.15.77:0/252889680 wait complete. 2023-11-26T07:18:22.326 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:22.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:22.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.540+0000 7f525759e640 1 Processor -- start 2023-11-26T07:18:22.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.540+0000 7f525759e640 1 -- start start 2023-11-26T07:18:22.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.541+0000 7f525759e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f52580b0b40 0x7f52580b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.541+0000 7f525759e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52580cce40 0x7f52580cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.541+0000 7f525759e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52580b14d0 con 0x7f525815d310 2023-11-26T07:18:22.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.541+0000 7f525759e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525806cd10 con 0x7f52580cce40 2023-11-26T07:18:22.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.541+0000 7f525759e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52580ae5d0 con 0x7f52580b0b40 2023-11-26T07:18:22.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.542+0000 7f5256d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52580cce40 0x7f52580cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.542+0000 7f5256d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52580cce40 0x7f52580cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57306/0 (socket says 172.21.15.77:57306) 2023-11-26T07:18:22.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.542+0000 7f5256d9d640 1 -- 172.21.15.77:0/146980188 learned_addr learned my addr 172.21.15.77:0/146980188 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:22.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.542+0000 7f5256d9d640 1 -- 172.21.15.77:0/146980188 >> v2:172.21.15.159:3300/0 conn(0x7f52580b0b40 msgr2=0x7f52580b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:22.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.542+0000 7f524ffff640 1 --2- 172.21.15.77:0/146980188 >> v2:172.21.15.159:3300/0 conn(0x7f52580b0b40 0x7f52580b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.542+0000 7f5256d9d640 1 --2- 172.21.15.77:0/146980188 >> v2:172.21.15.159:3300/0 conn(0x7f52580b0b40 0x7f52580b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.542+0000 7f5256d9d640 1 -- 172.21.15.77:0/146980188 >> v1:172.21.15.77:6789/0 conn(0x7f525815d310 legacy=0x7f52580ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.542+0000 7f5256d9d640 1 -- 172.21.15.77:0/146980188 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52580ae8b0 con 0x7f52580cce40 2023-11-26T07:18:22.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.543+0000 7f5256d9d640 1 --2- 172.21.15.77:0/146980188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52580cce40 0x7f52580cd2a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f52580b1cb0 tx=0x7f525002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff8b28ac14288b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:22.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.544+0000 7f5255d9b640 1 -- 172.21.15.77:0/146980188 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525002cb20 con 0x7f52580cce40 2023-11-26T07:18:22.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.544+0000 7f5255d9b640 1 -- 172.21.15.77:0/146980188 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525002cc80 con 0x7f52580cce40 2023-11-26T07:18:22.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.544+0000 7f5255d9b640 1 -- 172.21.15.77:0/146980188 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52500343f0 con 0x7f52580cce40 2023-11-26T07:18:22.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.544+0000 7f525759e640 1 -- 172.21.15.77:0/146980188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52580cce40 msgr2=0x7f52580cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.544+0000 7f525759e640 1 --2- 172.21.15.77:0/146980188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52580cce40 0x7f52580cd2a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f52580b1cb0 tx=0x7f525002bf80 comp rx=0 tx=0).stop 2023-11-26T07:18:22.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.545+0000 7f525759e640 1 -- 172.21.15.77:0/146980188 shutdown_connections 2023-11-26T07:18:22.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.545+0000 7f525759e640 1 --2- 172.21.15.77:0/146980188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52580cce40 0x7f52580cd2a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.545+0000 7f525759e640 1 --2- 172.21.15.77:0/146980188 >> v2:172.21.15.159:3300/0 conn(0x7f52580b0b40 0x7f52580b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.545+0000 7f525759e640 1 -- 172.21.15.77:0/146980188 >> 172.21.15.77:0/146980188 conn(0x7f52580cbb40 msgr2=0x7f52580cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:22.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.545+0000 7f525759e640 1 -- 172.21.15.77:0/146980188 shutdown_connections 2023-11-26T07:18:22.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.545+0000 7f525759e640 1 -- 172.21.15.77:0/146980188 wait complete. 2023-11-26T07:18:22.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.546+0000 7f525759e640 1 Processor -- start 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.546+0000 7f525759e640 1 -- start start 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.547+0000 7f525759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52580b0b40 0x7f525809c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.547+0000 7f525759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52580cce40 0x7f52580cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.547+0000 7f525759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525815d310 0x7f52580cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.547+0000 7f525759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525809b530 con 0x7f52580cce40 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.547+0000 7f525759e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5258099d70 con 0x7f525815d310 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.547+0000 7f525759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525809b740 con 0x7f52580b0b40 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.548+0000 7f524ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52580cce40 0x7f52580cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.548+0000 7f524ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52580cce40 0x7f52580cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57312/0 (socket says 172.21.15.77:57312) 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.548+0000 7f524ffff640 1 -- 172.21.15.77:0/3338094187 learned_addr learned my addr 172.21.15.77:0/3338094187 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.548+0000 7f524ffff640 1 -- 172.21.15.77:0/3338094187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52580b0b40 msgr2=0x7f525809c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.548+0000 7f524ffff640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52580b0b40 0x7f525809c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.548+0000 7f524ffff640 1 -- 172.21.15.77:0/3338094187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525815d310 msgr2=0x7f52580cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.548+0000 7f524ffff640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525815d310 0x7f52580cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.548+0000 7f524ffff640 1 -- 172.21.15.77:0/3338094187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5250009b30 con 0x7f52580cce40 2023-11-26T07:18:22.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.548+0000 7f524ffff640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52580cce40 0x7f52580cd220 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f524000c7f0 tx=0x7f524000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:22.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.549+0000 7f524effd640 1 -- 172.21.15.77:0/3338094187 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240004220 con 0x7f52580cce40 2023-11-26T07:18:22.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.549+0000 7f524effd640 1 -- 172.21.15.77:0/3338094187 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52400043a0 con 0x7f52580cce40 2023-11-26T07:18:22.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.549+0000 7f524effd640 1 -- 172.21.15.77:0/3338094187 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240007860 con 0x7f52580cce40 2023-11-26T07:18:22.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.549+0000 7f525759e640 1 -- 172.21.15.77:0/3338094187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525809ba20 con 0x7f52580cce40 2023-11-26T07:18:22.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.549+0000 7f525759e640 1 -- 172.21.15.77:0/3338094187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525809a050 con 0x7f52580cce40 2023-11-26T07:18:22.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.550+0000 7f525759e640 1 -- 172.21.15.77:0/3338094187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525809bf40 con 0x7f52580cce40 2023-11-26T07:18:22.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.551+0000 7f524effd640 1 -- 172.21.15.77:0/3338094187 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5240007bd0 con 0x7f52580cce40 2023-11-26T07:18:22.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.552+0000 7f524effd640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523806ae40 0x7f523806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.552+0000 7f524effd640 1 -- 172.21.15.77:0/3338094187 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5240089630 con 0x7f52580cce40 2023-11-26T07:18:22.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.552+0000 7f525659c640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523806ae40 0x7f523806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.553+0000 7f525659c640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523806ae40 0x7f523806d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5248000f60 tx=0x7f52480079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:22.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.556+0000 7f524effd640 1 -- 172.21.15.77:0/3338094187 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f525809bf40 con 0x7f52580cce40 2023-11-26T07:18:22.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.745+0000 7f525759e640 1 -- 172.21.15.77:0/3338094187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f525809bf40 con 0x7f52580cce40 2023-11-26T07:18:22.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.746+0000 7f524effd640 1 -- 172.21.15.77:0/3338094187 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f525809bf40 con 0x7f52580cce40 2023-11-26T07:18:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:18:22.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.748+0000 7f525759e640 1 -- 172.21.15.77:0/3338094187 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523806ae40 msgr2=0x7f523806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.748+0000 7f525759e640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523806ae40 0x7f523806d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5248000f60 tx=0x7f52480079b0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.748+0000 7f525759e640 1 -- 172.21.15.77:0/3338094187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52580cce40 msgr2=0x7f52580cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.748+0000 7f525759e640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52580cce40 0x7f52580cd220 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f524000c7f0 tx=0x7f524000ccb0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.748+0000 7f525759e640 1 -- 172.21.15.77:0/3338094187 shutdown_connections 2023-11-26T07:18:22.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.748+0000 7f525759e640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523806ae40 0x7f523806d300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.748+0000 7f525759e640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525815d310 0x7f52580cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.748+0000 7f525759e640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52580cce40 0x7f52580cd220 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.748+0000 7f525759e640 1 --2- 172.21.15.77:0/3338094187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52580b0b40 0x7f525809c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.748+0000 7f525759e640 1 -- 172.21.15.77:0/3338094187 >> 172.21.15.77:0/3338094187 conn(0x7f52580cbb40 msgr2=0x7f52580afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:22.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.749+0000 7f525759e640 1 -- 172.21.15.77:0/3338094187 shutdown_connections 2023-11-26T07:18:22.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.749+0000 7f525759e640 1 -- 172.21.15.77:0/3338094187 wait complete. 2023-11-26T07:18:22.768 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:22.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.984+0000 7ff22bb4c640 1 Processor -- start 2023-11-26T07:18:22.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.984+0000 7ff22bb4c640 1 -- start start 2023-11-26T07:18:22.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.986+0000 7ff22bb4c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff22415b440 0x7ff2240cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.986+0000 7ff22bb4c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2240cbf20 0x7ff2240c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.986+0000 7ff22bb4c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22415eea0 con 0x7ff2240c57e0 2023-11-26T07:18:22.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.986+0000 7ff22bb4c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2240cc3d0 con 0x7ff2240cbf20 2023-11-26T07:18:22.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.986+0000 7ff22bb4c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22415b820 con 0x7ff22415b440 2023-11-26T07:18:22.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.986+0000 7ff2290e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2240cbf20 0x7ff2240c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.986+0000 7ff2290e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2240cbf20 0x7ff2240c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57318/0 (socket says 172.21.15.77:57318) 2023-11-26T07:18:22.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.986+0000 7ff2290e7640 1 -- 172.21.15.77:0/4094006831 learned_addr learned my addr 172.21.15.77:0/4094006831 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:22.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.986+0000 7ff2298e8640 1 --2- 172.21.15.77:0/4094006831 >> v2:172.21.15.159:3300/0 conn(0x7ff22415b440 0x7ff2240cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.986+0000 7ff2290e7640 1 -- 172.21.15.77:0/4094006831 >> v2:172.21.15.159:3300/0 conn(0x7ff22415b440 msgr2=0x7ff2240cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:22.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.987+0000 7ff2290e7640 1 --2- 172.21.15.77:0/4094006831 >> v2:172.21.15.159:3300/0 conn(0x7ff22415b440 0x7ff2240cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.987+0000 7ff2290e7640 1 -- 172.21.15.77:0/4094006831 >> v1:172.21.15.159:6789/0 conn(0x7ff2240c57e0 legacy=0x7ff2240c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:22.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.987+0000 7ff2290e7640 1 -- 172.21.15.77:0/4094006831 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22406d600 con 0x7ff2240cbf20 2023-11-26T07:18:22.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.987+0000 7ff2298e8640 1 --2- 172.21.15.77:0/4094006831 >> v2:172.21.15.159:3300/0 conn(0x7ff22415b440 0x7ff2240cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.988+0000 7ff2290e7640 1 --2- 172.21.15.77:0/4094006831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2240cbf20 0x7ff2240c52a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff22406e770 tx=0x7ff21402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790c382bbe488521 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.988+0000 7ff2288e6640 1 -- 172.21.15.77:0/4094006831 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2140317e0 con 0x7ff2240cbf20 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.988+0000 7ff2288e6640 1 -- 172.21.15.77:0/4094006831 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214031940 con 0x7ff2240cbf20 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.988+0000 7ff2288e6640 1 -- 172.21.15.77:0/4094006831 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214031cd0 con 0x7ff2240cbf20 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.989+0000 7ff22bb4c640 1 -- 172.21.15.77:0/4094006831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2240cbf20 msgr2=0x7ff2240c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.989+0000 7ff22bb4c640 1 --2- 172.21.15.77:0/4094006831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2240cbf20 0x7ff2240c52a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff22406e770 tx=0x7ff21402b880 comp rx=0 tx=0).stop 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.989+0000 7ff22bb4c640 1 -- 172.21.15.77:0/4094006831 shutdown_connections 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.989+0000 7ff22bb4c640 1 --2- 172.21.15.77:0/4094006831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2240cbf20 0x7ff2240c52a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.989+0000 7ff22bb4c640 1 --2- 172.21.15.77:0/4094006831 >> v2:172.21.15.159:3300/0 conn(0x7ff22415b440 0x7ff2240cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.989+0000 7ff22bb4c640 1 -- 172.21.15.77:0/4094006831 >> 172.21.15.77:0/4094006831 conn(0x7ff2240b0c50 msgr2=0x7ff2240b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.989+0000 7ff22bb4c640 1 -- 172.21.15.77:0/4094006831 shutdown_connections 2023-11-26T07:18:22.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.989+0000 7ff22bb4c640 1 -- 172.21.15.77:0/4094006831 wait complete. 2023-11-26T07:18:22.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.991+0000 7ff22bb4c640 1 Processor -- start 2023-11-26T07:18:22.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.991+0000 7ff22bb4c640 1 -- start start 2023-11-26T07:18:22.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff22bb4c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2240c57e0 0x7ff2240af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff22bb4c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240cbf20 0x7ff2241e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff22bb4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff22415b440 0x7ff2240c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff22bb4c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240ac520 con 0x7ff22415b440 2023-11-26T07:18:22.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff22bb4c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240ac1f0 con 0x7ff2240cbf20 2023-11-26T07:18:22.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff22bb4c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240b02e0 con 0x7ff2240c57e0 2023-11-26T07:18:22.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff22a0e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff22415b440 0x7ff2240c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff22a0e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff22415b440 0x7ff2240c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57322/0 (socket says 172.21.15.77:57322) 2023-11-26T07:18:22.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff22a0e9640 1 -- 172.21.15.77:0/729298299 learned_addr learned my addr 172.21.15.77:0/729298299 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff2290e7640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240cbf20 0x7ff2241e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff2298e8640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2240c57e0 0x7ff2240af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.992+0000 7ff22a0e9640 1 -- 172.21.15.77:0/729298299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2240c57e0 msgr2=0x7ff2240af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff22a0e9640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2240c57e0 0x7ff2240af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff22a0e9640 1 -- 172.21.15.77:0/729298299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240cbf20 msgr2=0x7ff2241e6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff22a0e9640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240cbf20 0x7ff2241e6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff22a0e9640 1 -- 172.21.15.77:0/729298299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140094d0 con 0x7ff22415b440 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff2290e7640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240cbf20 0x7ff2241e6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff2298e8640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2240c57e0 0x7ff2240af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff22a0e9640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff22415b440 0x7ff2240c3ec0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00c780 tx=0x7ff21c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff21a7fc640 1 -- 172.21.15.77:0/729298299 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c004b60 con 0x7ff22415b440 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff21a7fc640 1 -- 172.21.15.77:0/729298299 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c00ce90 con 0x7ff22415b440 2023-11-26T07:18:22.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff22bb4c640 1 -- 172.21.15.77:0/729298299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2240b05c0 con 0x7ff22415b440 2023-11-26T07:18:22.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff21a7fc640 1 -- 172.21.15.77:0/729298299 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00a850 con 0x7ff22415b440 2023-11-26T07:18:22.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.993+0000 7ff22bb4c640 1 -- 172.21.15.77:0/729298299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2240afed0 con 0x7ff22415b440 2023-11-26T07:18:22.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.995+0000 7ff22bb4c640 1 -- 172.21.15.77:0/729298299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2240ac690 con 0x7ff22415b440 2023-11-26T07:18:22.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.995+0000 7ff21a7fc640 1 -- 172.21.15.77:0/729298299 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff21c00a9b0 con 0x7ff22415b440 2023-11-26T07:18:22.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.996+0000 7ff21a7fc640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff20806ae40 0x7ff20806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:22.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.996+0000 7ff21a7fc640 1 -- 172.21.15.77:0/729298299 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff21c089910 con 0x7ff22415b440 2023-11-26T07:18:22.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.996+0000 7ff2298e8640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff20806ae40 0x7ff20806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:22.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:22.997+0000 7ff2298e8640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff20806ae40 0x7ff20806d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff220006fd0 tx=0x7ff220008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.001+0000 7ff21a7fc640 1 -- 172.21.15.77:0/729298299 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff21c0548a0 con 0x7ff22415b440 2023-11-26T07:18:23.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.189+0000 7ff22bb4c640 1 -- 172.21.15.77:0/729298299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff22404e8b0 con 0x7ff22415b440 2023-11-26T07:18:23.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.190+0000 7ff21a7fc640 1 -- 172.21.15.77:0/729298299 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff21c057ec0 con 0x7ff22415b440 2023-11-26T07:18:23.191 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:18:23.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 -- 172.21.15.77:0/729298299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff20806ae40 msgr2=0x7ff20806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff20806ae40 0x7ff20806d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff220006fd0 tx=0x7ff220008040 comp rx=0 tx=0).stop 2023-11-26T07:18:23.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 -- 172.21.15.77:0/729298299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff22415b440 msgr2=0x7ff2240c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff22415b440 0x7ff2240c3ec0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00c780 tx=0x7ff21c00cc40 comp rx=0 tx=0).stop 2023-11-26T07:18:23.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 -- 172.21.15.77:0/729298299 shutdown_connections 2023-11-26T07:18:23.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff20806ae40 0x7ff20806d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff22415b440 0x7ff2240c3ec0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240cbf20 0x7ff2241e6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 --2- 172.21.15.77:0/729298299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2240c57e0 0x7ff2240af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 -- 172.21.15.77:0/729298299 >> 172.21.15.77:0/729298299 conn(0x7ff2240b0c50 msgr2=0x7ff2240b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:23.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 -- 172.21.15.77:0/729298299 shutdown_connections 2023-11-26T07:18:23.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.192+0000 7ff22bb4c640 1 -- 172.21.15.77:0/729298299 wait complete. 2023-11-26T07:18:23.212 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:23.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.419+0000 7f1317e48640 1 Processor -- start 2023-11-26T07:18:23.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.419+0000 7f1317e48640 1 -- start start 2023-11-26T07:18:23.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.421+0000 7f1317e48640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f13100b1ed0 0x7f13101681d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.421+0000 7f1317e48640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131015db00 con 0x7f13100d3a40 2023-11-26T07:18:23.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.421+0000 7f1317e48640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131006d1a0 con 0x7f131015d720 2023-11-26T07:18:23.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.421+0000 7f1317e48640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13100d0ce0 con 0x7f13100b1ed0 2023-11-26T07:18:23.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.421+0000 7f13153e3640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f13100d3a40 0x7f131006ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49136/0 (socket says 172.21.15.77:49136) 2023-11-26T07:18:23.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.421+0000 7f13153e3640 1 -- 172.21.15.77:0/670806086 learned_addr learned my addr 172.21.15.77:0/670806086 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.421+0000 7f13163e5640 1 --2- 172.21.15.77:0/670806086 >> v2:172.21.15.159:3300/0 conn(0x7f13100b1ed0 0x7f13101681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242763850 0 0) 0x7f131015db00 con 0x7f13100d3a40 2023-11-26T07:18:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12fc003520 con 0x7f13100d3a40 2023-11-26T07:18:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 227169718 0 0) 0x7f12fc003520 con 0x7f13100d3a40 2023-11-26T07:18:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 >> v2:172.21.15.159:3300/0 conn(0x7f13100b1ed0 msgr2=0x7f13101681d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 --2- 172.21.15.77:0/670806086 >> v2:172.21.15.159:3300/0 conn(0x7f13100b1ed0 0x7f13101681d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 >> v1:172.21.15.159:6789/0 conn(0x7f131015d720 legacy=0x7f13100d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131006d400 con 0x7f13100d3a40 2023-11-26T07:18:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f130c0019f0 con 0x7f13100d3a40 2023-11-26T07:18:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 >> v1:172.21.15.77:6789/0 conn(0x7f13100d3a40 legacy=0x7f131006ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 --2- 172.21.15.77:0/670806086 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12fc0039c0 0x7f12fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 --2- 172.21.15.77:0/670806086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12fc0047c0 0x7f12fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 --2- 172.21.15.77:0/670806086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12fc0051d0 0x7f12fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13100d0ce0 con 0x7f12fc0051d0 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc00c120 con 0x7f12fc0047c0 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc00c2e0 con 0x7f12fc0039c0 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.422+0000 7f13163e5640 1 --2- 172.21.15.77:0/670806086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12fc0051d0 0x7f12fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.423+0000 7f13163e5640 1 -- 172.21.15.77:0/670806086 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12fc0039c0 msgr2=0x7f12fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.423+0000 7f13163e5640 1 --2- 172.21.15.77:0/670806086 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12fc0039c0 0x7f12fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.423+0000 7f13163e5640 1 -- 172.21.15.77:0/670806086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12fc0047c0 msgr2=0x7f12fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.423+0000 7f13153e3640 1 --2- 172.21.15.77:0/670806086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12fc0047c0 0x7f12fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.423+0000 7f13163e5640 1 --2- 172.21.15.77:0/670806086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12fc0047c0 0x7f12fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.423+0000 7f13163e5640 1 -- 172.21.15.77:0/670806086 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc003520 con 0x7f12fc0051d0 2023-11-26T07:18:23.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.423+0000 7f13153e3640 1 --2- 172.21.15.77:0/670806086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12fc0047c0 0x7f12fc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.424+0000 7f13163e5640 1 -- 172.21.15.77:0/670806086 reap_dead start 2023-11-26T07:18:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.424+0000 7f13163e5640 1 --2- 172.21.15.77:0/670806086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12fc0051d0 0x7f12fc00b980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f13100b2360 tx=0x7f12fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900a93e10cbd4155 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.424+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130802c680 con 0x7f12fc0051d0 2023-11-26T07:18:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.424+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130802c800 con 0x7f12fc0051d0 2023-11-26T07:18:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.424+0000 7f1314be2640 1 -- 172.21.15.77:0/670806086 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130802cbb0 con 0x7f12fc0051d0 2023-11-26T07:18:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.425+0000 7f1317e48640 1 -- 172.21.15.77:0/670806086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12fc0051d0 msgr2=0x7f12fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.425+0000 7f1317e48640 1 --2- 172.21.15.77:0/670806086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12fc0051d0 0x7f12fc00b980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f13100b2360 tx=0x7f12fc0057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.425+0000 7f1317e48640 1 -- 172.21.15.77:0/670806086 shutdown_connections 2023-11-26T07:18:23.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.425+0000 7f1317e48640 1 --2- 172.21.15.77:0/670806086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12fc0051d0 0x7f12fc00b980 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.425+0000 7f1317e48640 1 -- 172.21.15.77:0/670806086 >> 172.21.15.77:0/670806086 conn(0x7f131008af60 msgr2=0x7f131009c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:23.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.425+0000 7f1317e48640 1 -- 172.21.15.77:0/670806086 shutdown_connections 2023-11-26T07:18:23.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.425+0000 7f1317e48640 1 -- 172.21.15.77:0/670806086 wait complete. 2023-11-26T07:18:23.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.427+0000 7f1317e48640 1 Processor -- start 2023-11-26T07:18:23.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.427+0000 7f1317e48640 1 -- start start 2023-11-26T07:18:23.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.428+0000 7f1317e48640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12fc0051d0 0x7f131014fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.428+0000 7f1317e48640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f131015db00 0x7f131015df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.428+0000 7f1317e48640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f131015fb70 0x7f131015fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.428+0000 7f1317e48640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131015f200 con 0x7f131015db00 2023-11-26T07:18:23.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.428+0000 7f1317e48640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1310150040 con 0x7f12fc0051d0 2023-11-26T07:18:23.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.428+0000 7f1317e48640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1310160530 con 0x7f131015fb70 2023-11-26T07:18:23.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.428+0000 7f13153e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f131015db00 0x7f131015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.428+0000 7f13153e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f131015db00 0x7f131015df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57346/0 (socket says 172.21.15.77:57346) 2023-11-26T07:18:23.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.428+0000 7f13153e3640 1 -- 172.21.15.77:0/3905733064 learned_addr learned my addr 172.21.15.77:0/3905733064 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:23.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f1315be4640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12fc0051d0 0x7f131014fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f13153e3640 1 -- 172.21.15.77:0/3905733064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f131015fb70 msgr2=0x7f131015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f13153e3640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f131015fb70 0x7f131015fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f13153e3640 1 -- 172.21.15.77:0/3905733064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12fc0051d0 msgr2=0x7f131014fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f13153e3640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12fc0051d0 0x7f131014fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f13153e3640 1 -- 172.21.15.77:0/3905733064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131015e580 con 0x7f131015db00 2023-11-26T07:18:23.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f1315be4640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12fc0051d0 0x7f131014fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:23.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f13153e3640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f131015db00 0x7f131015df80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f130c002070 tx=0x7f130c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:23.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f13027fc640 1 -- 172.21.15.77:0/3905733064 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c004d60 con 0x7f131015db00 2023-11-26T07:18:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f13027fc640 1 -- 172.21.15.77:0/3905733064 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c00be80 con 0x7f131015db00 2023-11-26T07:18:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f13027fc640 1 -- 172.21.15.77:0/3905733064 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c0072d0 con 0x7f131015db00 2023-11-26T07:18:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f1317e48640 1 -- 172.21.15.77:0/3905733064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131015e860 con 0x7f131015db00 2023-11-26T07:18:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.429+0000 7f1317e48640 1 -- 172.21.15.77:0/3905733064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131015ee20 con 0x7f131015db00 2023-11-26T07:18:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.431+0000 7f1317e48640 1 -- 172.21.15.77:0/3905733064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131004e8b0 con 0x7f131015db00 2023-11-26T07:18:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.432+0000 7f13027fc640 1 -- 172.21.15.77:0/3905733064 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f130c007430 con 0x7f131015db00 2023-11-26T07:18:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.432+0000 7f13027fc640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12f406ae70 0x7f12f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.433+0000 7f13027fc640 1 -- 172.21.15.77:0/3905733064 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f130c089610 con 0x7f131015db00 2023-11-26T07:18:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.433+0000 7f1315be4640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12f406ae70 0x7f12f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.433+0000 7f1315be4640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12f406ae70 0x7f12f406d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13100b7fb0 tx=0x7f1304009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:23.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.437+0000 7f13027fc640 1 -- 172.21.15.77:0/3905733064 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f130c054630 con 0x7f131015db00 2023-11-26T07:18:23.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.630+0000 7f1317e48640 1 -- 172.21.15.77:0/3905733064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f131006c530 con 0x7f131015db00 2023-11-26T07:18:23.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.631+0000 7f13027fc640 1 -- 172.21.15.77:0/3905733064 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f130c057c50 con 0x7f131015db00 2023-11-26T07:18:23.632 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 -- 172.21.15.77:0/3905733064 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12f406ae70 msgr2=0x7f12f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12f406ae70 0x7f12f406d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13100b7fb0 tx=0x7f1304009040 comp rx=0 tx=0).stop 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 -- 172.21.15.77:0/3905733064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f131015db00 msgr2=0x7f131015df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f131015db00 0x7f131015df80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f130c002070 tx=0x7f130c00b4a0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 -- 172.21.15.77:0/3905733064 shutdown_connections 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f12f406ae70 0x7f12f406d330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f131015fb70 0x7f131015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f131015db00 0x7f131015df80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 --2- 172.21.15.77:0/3905733064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12fc0051d0 0x7f131014fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 -- 172.21.15.77:0/3905733064 >> 172.21.15.77:0/3905733064 conn(0x7f131008af60 msgr2=0x7f13100b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 -- 172.21.15.77:0/3905733064 shutdown_connections 2023-11-26T07:18:23.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.634+0000 7f1317e48640 1 -- 172.21.15.77:0/3905733064 wait complete. 2023-11-26T07:18:23.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:23.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.868+0000 7f1b68007640 1 Processor -- start 2023-11-26T07:18:23.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.868+0000 7f1b68007640 1 -- start start 2023-11-26T07:18:23.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.870+0000 7f1b68007640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b600cc0f0 0x7f1b600c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.870+0000 7f1b68007640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1b600c57e0 0x7f1b6006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.870+0000 7f1b68007640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6015eea0 con 0x7f1b6015b440 2023-11-26T07:18:23.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.870+0000 7f1b68007640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6015b820 con 0x7f1b600c57e0 2023-11-26T07:18:23.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.870+0000 7f1b68007640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600abf30 con 0x7f1b600cc0f0 2023-11-26T07:18:23.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.870+0000 7f1b665a4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1b600c57e0 0x7f1b6006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.871+0000 7f1b665a4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1b600c57e0 0x7f1b6006c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57356/0 (socket says 172.21.15.77:57356) 2023-11-26T07:18:23.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.871+0000 7f1b665a4640 1 -- 172.21.15.77:0/391115766 learned_addr learned my addr 172.21.15.77:0/391115766 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:23.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.871+0000 7f1b655a2640 1 --2- 172.21.15.77:0/391115766 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b600cc0f0 0x7f1b600c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.871+0000 7f1b665a4640 1 -- 172.21.15.77:0/391115766 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b600cc0f0 msgr2=0x7f1b600c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:23.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.871+0000 7f1b665a4640 1 --2- 172.21.15.77:0/391115766 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b600cc0f0 0x7f1b600c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.871+0000 7f1b665a4640 1 -- 172.21.15.77:0/391115766 >> v1:172.21.15.77:6789/0 conn(0x7f1b6015b440 legacy=0x7f1b600cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.871+0000 7f1b665a4640 1 -- 172.21.15.77:0/391115766 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6015f0f0 con 0x7f1b600c57e0 2023-11-26T07:18:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.872+0000 7f1b665a4640 1 --2- 172.21.15.77:0/391115766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b600c57e0 0x7f1b6006c5f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009e50 tx=0x7f1b5802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f1f109c8481ffa server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.872+0000 7f1b64da1640 1 -- 172.21.15.77:0/391115766 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5802ca70 con 0x7f1b600c57e0 2023-11-26T07:18:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.873+0000 7f1b64da1640 1 -- 172.21.15.77:0/391115766 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5802cbd0 con 0x7f1b600c57e0 2023-11-26T07:18:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.873+0000 7f1b64da1640 1 -- 172.21.15.77:0/391115766 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580343f0 con 0x7f1b600c57e0 2023-11-26T07:18:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.873+0000 7f1b68007640 1 -- 172.21.15.77:0/391115766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b600c57e0 msgr2=0x7f1b6006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.873+0000 7f1b68007640 1 --2- 172.21.15.77:0/391115766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b600c57e0 0x7f1b6006c5f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009e50 tx=0x7f1b5802bed0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.873+0000 7f1b68007640 1 -- 172.21.15.77:0/391115766 shutdown_connections 2023-11-26T07:18:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.873+0000 7f1b68007640 1 --2- 172.21.15.77:0/391115766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b600c57e0 0x7f1b6006c5f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.873+0000 7f1b68007640 1 --2- 172.21.15.77:0/391115766 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b600cc0f0 0x7f1b600c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.873+0000 7f1b68007640 1 -- 172.21.15.77:0/391115766 >> 172.21.15.77:0/391115766 conn(0x7f1b600b0c50 msgr2=0x7f1b600b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:23.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.874+0000 7f1b68007640 1 -- 172.21.15.77:0/391115766 shutdown_connections 2023-11-26T07:18:23.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.874+0000 7f1b68007640 1 -- 172.21.15.77:0/391115766 wait complete. 2023-11-26T07:18:23.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.875+0000 7f1b68007640 1 Processor -- start 2023-11-26T07:18:23.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.876+0000 7f1b68007640 1 -- start start 2023-11-26T07:18:23.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.877+0000 7f1b68007640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b600c57e0 0x7f1b600c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.877+0000 7f1b68007640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b600cc0f0 0x7f1b60152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.877+0000 7f1b68007640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b6015b440 0x7f1b60150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.877+0000 7f1b68007640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c7d10 con 0x7f1b600cc0f0 2023-11-26T07:18:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.877+0000 7f1b68007640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60153380 con 0x7f1b6015b440 2023-11-26T07:18:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.877+0000 7f1b68007640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c6e40 con 0x7f1b600c57e0 2023-11-26T07:18:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.877+0000 7f1b655a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b600cc0f0 0x7f1b60152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.877+0000 7f1b655a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b600cc0f0 0x7f1b60152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57362/0 (socket says 172.21.15.77:57362) 2023-11-26T07:18:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.878+0000 7f1b655a2640 1 -- 172.21.15.77:0/2302808302 learned_addr learned my addr 172.21.15.77:0/2302808302 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.878+0000 7f1b655a2640 1 -- 172.21.15.77:0/2302808302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b600c57e0 msgr2=0x7f1b600c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.878+0000 7f1b655a2640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b600c57e0 0x7f1b600c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.878+0000 7f1b655a2640 1 -- 172.21.15.77:0/2302808302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b6015b440 msgr2=0x7f1b60150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.878+0000 7f1b665a4640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b6015b440 0x7f1b60150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.878+0000 7f1b655a2640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b6015b440 0x7f1b60150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.878+0000 7f1b655a2640 1 -- 172.21.15.77:0/2302808302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b58009b30 con 0x7f1b600cc0f0 2023-11-26T07:18:23.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.878+0000 7f1b655a2640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b600cc0f0 0x7f1b60152870 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000d830 tx=0x7f1b5000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:23.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.879+0000 7f1b567fc640 1 -- 172.21.15.77:0/2302808302 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000b6c0 con 0x7f1b600cc0f0 2023-11-26T07:18:23.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.879+0000 7f1b567fc640 1 -- 172.21.15.77:0/2302808302 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5000b820 con 0x7f1b600cc0f0 2023-11-26T07:18:23.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.879+0000 7f1b567fc640 1 -- 172.21.15.77:0/2302808302 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000bbb0 con 0x7f1b600cc0f0 2023-11-26T07:18:23.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.879+0000 7f1b68007640 1 -- 172.21.15.77:0/2302808302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b600c7100 con 0x7f1b600cc0f0 2023-11-26T07:18:23.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.879+0000 7f1b68007640 1 -- 172.21.15.77:0/2302808302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b600c76c0 con 0x7f1b600cc0f0 2023-11-26T07:18:23.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.880+0000 7f1b68007640 1 -- 172.21.15.77:0/2302808302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6004e8b0 con 0x7f1b600cc0f0 2023-11-26T07:18:23.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.881+0000 7f1b567fc640 1 -- 172.21.15.77:0/2302808302 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b5001e460 con 0x7f1b600cc0f0 2023-11-26T07:18:23.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.882+0000 7f1b567fc640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1b4406ae90 0x7f1b4406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.882+0000 7f1b567fc640 1 -- 172.21.15.77:0/2302808302 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1b50089e30 con 0x7f1b600cc0f0 2023-11-26T07:18:23.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.882+0000 7f1b65da3640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1b4406ae90 0x7f1b4406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.883+0000 7f1b65da3640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1b4406ae90 0x7f1b4406d350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000f60 tx=0x7f1b5c0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:23.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:23.887+0000 7f1b567fc640 1 -- 172.21.15.77:0/2302808302 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b50054e40 con 0x7f1b600cc0f0 2023-11-26T07:18:24.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.088+0000 7f1b68007640 1 -- 172.21.15.77:0/2302808302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1b601574f0 con 0x7f1b600cc0f0 2023-11-26T07:18:24.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.089+0000 7f1b567fc640 1 -- 172.21.15.77:0/2302808302 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1b50058460 con 0x7f1b600cc0f0 2023-11-26T07:18:24.091 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:18:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 -- 172.21.15.77:0/2302808302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1b4406ae90 msgr2=0x7f1b4406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1b4406ae90 0x7f1b4406d350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000f60 tx=0x7f1b5c0079b0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 -- 172.21.15.77:0/2302808302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b600cc0f0 msgr2=0x7f1b60152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b600cc0f0 0x7f1b60152870 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000d830 tx=0x7f1b5000dcf0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 -- 172.21.15.77:0/2302808302 shutdown_connections 2023-11-26T07:18:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1b4406ae90 0x7f1b4406d350 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b6015b440 0x7f1b60150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b600cc0f0 0x7f1b60152870 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 --2- 172.21.15.77:0/2302808302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b600c57e0 0x7f1b600c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 -- 172.21.15.77:0/2302808302 >> 172.21.15.77:0/2302808302 conn(0x7f1b600b0c50 msgr2=0x7f1b600cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 -- 172.21.15.77:0/2302808302 shutdown_connections 2023-11-26T07:18:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.092+0000 7f1b68007640 1 -- 172.21.15.77:0/2302808302 wait complete. 2023-11-26T07:18:24.113 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-26T07:18:24.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:24.113 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-26T07:18:24.212 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:18:24.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:24.212 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-26T07:18:24.264 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:18:24.264 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:24.326 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:18:24.327 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:24.381 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:18:24.381 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:24.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:24.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.660+0000 7f846ced1640 1 Processor -- start 2023-11-26T07:18:24.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.660+0000 7f846ced1640 1 -- start start 2023-11-26T07:18:24.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.661+0000 7f846ced1640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f846815c410 0x7f846815f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:24.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.662+0000 7f846ced1640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f84680b1de0 0x7f84680b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:24.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.662+0000 7f846ced1640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846815bf80 con 0x7f8468144b30 2023-11-26T07:18:24.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.662+0000 7f846ced1640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84680b27b0 con 0x7f84680b1de0 2023-11-26T07:18:24.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.662+0000 7f846ced1640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84680b1560 con 0x7f846815c410 2023-11-26T07:18:24.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.662+0000 7f8466ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f846815c410 0x7f846815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:24.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.662+0000 7f84677fe640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f8468144b30 0x7f84680b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:56378/0 (socket says 172.21.15.77:56378) 2023-11-26T07:18:24.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.663+0000 7f84677fe640 1 -- 172.21.15.77:0/1032695755 learned_addr learned my addr 172.21.15.77:0/1032695755 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:24.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.663+0000 7f8467fff640 1 --2- 172.21.15.77:0/1032695755 >> v2:172.21.15.159:3300/0 conn(0x7f84680b1de0 0x7f84680b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:24.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.663+0000 7f84667fc640 1 -- 172.21.15.77:0/1032695755 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479235890 0 0) 0x7f846815bf80 con 0x7f8468144b30 2023-11-26T07:18:24.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.663+0000 7f84667fc640 1 -- 172.21.15.77:0/1032695755 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8450003520 con 0x7f8468144b30 2023-11-26T07:18:24.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.663+0000 7f8466ffd640 1 -- 172.21.15.77:0/1032695755 >> v2:172.21.15.159:3300/0 conn(0x7f84680b1de0 msgr2=0x7f84680b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:24.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.663+0000 7f8466ffd640 1 --2- 172.21.15.77:0/1032695755 >> v2:172.21.15.159:3300/0 conn(0x7f84680b1de0 0x7f84680b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.663+0000 7f8466ffd640 1 -- 172.21.15.77:0/1032695755 >> v1:172.21.15.159:6789/0 conn(0x7f8468144b30 legacy=0x7f84680b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:24.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.663+0000 7f8466ffd640 1 -- 172.21.15.77:0/1032695755 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84680b1280 con 0x7f846815c410 2023-11-26T07:18:24.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.665+0000 7f8466ffd640 1 --2- 172.21.15.77:0/1032695755 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f846815c410 0x7f846815f920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f845c0097a0 tx=0x7f845c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=913ea8558c42c9be server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:24.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.665+0000 7f84667fc640 1 -- 172.21.15.77:0/1032695755 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c031830 con 0x7f846815c410 2023-11-26T07:18:24.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.665+0000 7f84667fc640 1 -- 172.21.15.77:0/1032695755 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c031990 con 0x7f846815c410 2023-11-26T07:18:24.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.665+0000 7f84667fc640 1 -- 172.21.15.77:0/1032695755 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c031d20 con 0x7f846815c410 2023-11-26T07:18:24.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.666+0000 7f846ced1640 1 -- 172.21.15.77:0/1032695755 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f846815c410 msgr2=0x7f846815f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:24.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.666+0000 7f846ced1640 1 --2- 172.21.15.77:0/1032695755 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f846815c410 0x7f846815f920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f845c0097a0 tx=0x7f845c02b8d0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.666+0000 7f846ced1640 1 -- 172.21.15.77:0/1032695755 shutdown_connections 2023-11-26T07:18:24.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.666+0000 7f846ced1640 1 --2- 172.21.15.77:0/1032695755 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f846815c410 0x7f846815f920 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.666+0000 7f846ced1640 1 --2- 172.21.15.77:0/1032695755 >> v2:172.21.15.159:3300/0 conn(0x7f84680b1de0 0x7f84680b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.666+0000 7f846ced1640 1 -- 172.21.15.77:0/1032695755 >> 172.21.15.77:0/1032695755 conn(0x7f84680cb830 msgr2=0x7f84680cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:24.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.666+0000 7f846ced1640 1 -- 172.21.15.77:0/1032695755 shutdown_connections 2023-11-26T07:18:24.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.666+0000 7f846ced1640 1 -- 172.21.15.77:0/1032695755 wait complete. 2023-11-26T07:18:24.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.668+0000 7f846ced1640 1 Processor -- start 2023-11-26T07:18:24.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.668+0000 7f846ced1640 1 -- start start 2023-11-26T07:18:24.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.669+0000 7f846ced1640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84680b1de0 0x7f846815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:24.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.669+0000 7f846ced1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468144b30 0x7f846813b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:24.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.669+0000 7f846ced1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846815c410 0x7f84681f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:24.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.669+0000 7f846ced1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8468152eb0 con 0x7f846815c410 2023-11-26T07:18:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.669+0000 7f846ced1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846813cb60 con 0x7f8468144b30 2023-11-26T07:18:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.669+0000 7f846ced1640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846813bf50 con 0x7f84680b1de0 2023-11-26T07:18:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.669+0000 7f8467fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846815c410 0x7f84681f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.669+0000 7f8467fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846815c410 0x7f84681f5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57374/0 (socket says 172.21.15.77:57374) 2023-11-26T07:18:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.669+0000 7f8467fff640 1 -- 172.21.15.77:0/1721593340 learned_addr learned my addr 172.21.15.77:0/1721593340 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f8466ffd640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468144b30 0x7f846813b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f84677fe640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84680b1de0 0x7f846815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f8467fff640 1 -- 172.21.15.77:0/1721593340 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84680b1de0 msgr2=0x7f846815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f8467fff640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84680b1de0 0x7f846815ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f8467fff640 1 -- 172.21.15.77:0/1721593340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468144b30 msgr2=0x7f846813b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f8467fff640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468144b30 0x7f846813b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f8467fff640 1 -- 172.21.15.77:0/1721593340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c009400 con 0x7f846815c410 2023-11-26T07:18:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f8467fff640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846815c410 0x7f84681f5f20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f846000efc0 tx=0x7f846000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f844ffff640 1 -- 172.21.15.77:0/1721593340 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460014480 con 0x7f846815c410 2023-11-26T07:18:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f844ffff640 1 -- 172.21.15.77:0/1721593340 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000f040 con 0x7f846815c410 2023-11-26T07:18:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f844ffff640 1 -- 172.21.15.77:0/1721593340 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460014820 con 0x7f846815c410 2023-11-26T07:18:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.670+0000 7f846ced1640 1 -- 172.21.15.77:0/1721593340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846813c230 con 0x7f846815c410 2023-11-26T07:18:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.671+0000 7f846ced1640 1 -- 172.21.15.77:0/1721593340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846813c7f0 con 0x7f846815c410 2023-11-26T07:18:24.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.672+0000 7f846ced1640 1 -- 172.21.15.77:0/1721593340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846804e840 con 0x7f846815c410 2023-11-26T07:18:24.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.673+0000 7f844ffff640 1 -- 172.21.15.77:0/1721593340 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8460014980 con 0x7f846815c410 2023-11-26T07:18:24.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.674+0000 7f844ffff640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845406ae40 0x7f845406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:24.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.674+0000 7f844ffff640 1 -- 172.21.15.77:0/1721593340 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f846008a1d0 con 0x7f846815c410 2023-11-26T07:18:24.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.674+0000 7f84677fe640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845406ae40 0x7f845406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:24.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.675+0000 7f84677fe640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845406ae40 0x7f845406d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f84580011e0 tx=0x7f8458009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:24.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.679+0000 7f844ffff640 1 -- 172.21.15.77:0/1721593340 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8460055290 con 0x7f846815c410 2023-11-26T07:18:24.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.867+0000 7f846ced1640 1 -- 172.21.15.77:0/1721593340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84681372c0 con 0x7f846815c410 2023-11-26T07:18:24.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.870+0000 7f844ffff640 1 -- 172.21.15.77:0/1721593340 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16729 (secure 0 0 0) 0x7f84600588b0 con 0x7f846815c410 2023-11-26T07:18:24.872 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:24.873 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:18:16.826725+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:24.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 -- 172.21.15.77:0/1721593340 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845406ae40 msgr2=0x7f845406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:24.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845406ae40 0x7f845406d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f84580011e0 tx=0x7f8458009040 comp rx=0 tx=0).stop 2023-11-26T07:18:24.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 -- 172.21.15.77:0/1721593340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846815c410 msgr2=0x7f84681f5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:24.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846815c410 0x7f84681f5f20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f846000efc0 tx=0x7f846000c490 comp rx=0 tx=0).stop 2023-11-26T07:18:24.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 -- 172.21.15.77:0/1721593340 shutdown_connections 2023-11-26T07:18:24.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845406ae40 0x7f845406d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846815c410 0x7f84681f5f20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468144b30 0x7f846813b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 --2- 172.21.15.77:0/1721593340 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84680b1de0 0x7f846815ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:24.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 -- 172.21.15.77:0/1721593340 >> 172.21.15.77:0/1721593340 conn(0x7f84680cb830 msgr2=0x7f846815d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:24.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 -- 172.21.15.77:0/1721593340 shutdown_connections 2023-11-26T07:18:24.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:24.873+0000 7f846ced1640 1 -- 172.21.15.77:0/1721593340 wait complete. 2023-11-26T07:18:24.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:24.882 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:24.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:24.895 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.135+0000 7f4d27fff640 1 Processor -- start 2023-11-26T07:18:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.135+0000 7f4d27fff640 1 -- start start 2023-11-26T07:18:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.137+0000 7f4d27fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4d2815d310 0x7f4d280ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.137+0000 7f4d27fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4d280cde50 0x7f4d280b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.137+0000 7f4d27fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d280b14d0 con 0x7f4d280b0b40 2023-11-26T07:18:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.137+0000 7f4d27fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2806cd10 con 0x7f4d280cde50 2023-11-26T07:18:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.137+0000 7f4d27fff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d280ae5d0 con 0x7f4d2815d310 2023-11-26T07:18:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.137+0000 7f4d277fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4d280cde50 0x7f4d280b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.137+0000 7f4d277fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4d280cde50 0x7f4d280b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57382/0 (socket says 172.21.15.77:57382) 2023-11-26T07:18:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.137+0000 7f4d277fe640 1 -- 172.21.15.77:0/3024913248 learned_addr learned my addr 172.21.15.77:0/3024913248 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.138+0000 7f4d26ffd640 1 --2- 172.21.15.77:0/3024913248 >> v2:172.21.15.159:3300/0 conn(0x7f4d2815d310 0x7f4d280ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.138+0000 7f4d277fe640 1 -- 172.21.15.77:0/3024913248 >> v2:172.21.15.159:3300/0 conn(0x7f4d2815d310 msgr2=0x7f4d280ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.138+0000 7f4d277fe640 1 --2- 172.21.15.77:0/3024913248 >> v2:172.21.15.159:3300/0 conn(0x7f4d2815d310 0x7f4d280ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.138+0000 7f4d277fe640 1 -- 172.21.15.77:0/3024913248 >> v1:172.21.15.77:6789/0 conn(0x7f4d280b0b40 legacy=0x7f4d28160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.138+0000 7f4d277fe640 1 -- 172.21.15.77:0/3024913248 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d280ae8b0 con 0x7f4d280cde50 2023-11-26T07:18:25.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.139+0000 7f4d277fe640 1 --2- 172.21.15.77:0/3024913248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d280cde50 0x7f4d280b0f90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4d280ccb00 tx=0x7f4d2002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93be54b29a5e3630 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:25.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.139+0000 7f4d267fc640 1 -- 172.21.15.77:0/3024913248 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2002cb10 con 0x7f4d280cde50 2023-11-26T07:18:25.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.139+0000 7f4d267fc640 1 -- 172.21.15.77:0/3024913248 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2002cc70 con 0x7f4d280cde50 2023-11-26T07:18:25.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.140+0000 7f4d267fc640 1 -- 172.21.15.77:0/3024913248 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d200343f0 con 0x7f4d280cde50 2023-11-26T07:18:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.140+0000 7f4d27fff640 1 -- 172.21.15.77:0/3024913248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d280cde50 msgr2=0x7f4d280b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.140+0000 7f4d27fff640 1 --2- 172.21.15.77:0/3024913248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d280cde50 0x7f4d280b0f90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4d280ccb00 tx=0x7f4d2002bf70 comp rx=0 tx=0).stop 2023-11-26T07:18:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.140+0000 7f4d27fff640 1 -- 172.21.15.77:0/3024913248 shutdown_connections 2023-11-26T07:18:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.140+0000 7f4d27fff640 1 --2- 172.21.15.77:0/3024913248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d280cde50 0x7f4d280b0f90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.140+0000 7f4d27fff640 1 --2- 172.21.15.77:0/3024913248 >> v2:172.21.15.159:3300/0 conn(0x7f4d2815d310 0x7f4d280ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.140+0000 7f4d27fff640 1 -- 172.21.15.77:0/3024913248 >> 172.21.15.77:0/3024913248 conn(0x7f4d280cbb40 msgr2=0x7f4d280cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.140+0000 7f4d27fff640 1 -- 172.21.15.77:0/3024913248 shutdown_connections 2023-11-26T07:18:25.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.141+0000 7f4d27fff640 1 -- 172.21.15.77:0/3024913248 wait complete. 2023-11-26T07:18:25.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.143+0000 7f4d27fff640 1 Processor -- start 2023-11-26T07:18:25.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.143+0000 7f4d27fff640 1 -- start start 2023-11-26T07:18:25.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.144+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d280b0b40 0x7f4d281f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.144+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d280cde50 0x7f4d28156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.144+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2815d310 0x7f4d2809bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.144+0000 7f4d27fff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d281f49a0 con 0x7f4d280cde50 2023-11-26T07:18:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.144+0000 7f4d27fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d28156aa0 con 0x7f4d280b0b40 2023-11-26T07:18:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.144+0000 7f4d27fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2815e410 con 0x7f4d2815d310 2023-11-26T07:18:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.145+0000 7f4d1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d280cde50 0x7f4d28156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.145+0000 7f4d1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d280cde50 0x7f4d28156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57388/0 (socket says 172.21.15.77:57388) 2023-11-26T07:18:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.145+0000 7f4d1ffff640 1 -- 172.21.15.77:0/1758920647 learned_addr learned my addr 172.21.15.77:0/1758920647 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.145+0000 7f4d26ffd640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d280b0b40 0x7f4d281f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.145+0000 7f4d277fe640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2815d310 0x7f4d2809bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.145+0000 7f4d1ffff640 1 -- 172.21.15.77:0/1758920647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2815d310 msgr2=0x7f4d2809bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.145+0000 7f4d1ffff640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2815d310 0x7f4d2809bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.145+0000 7f4d1ffff640 1 -- 172.21.15.77:0/1758920647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d280b0b40 msgr2=0x7f4d281f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.145+0000 7f4d1ffff640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d280b0b40 0x7f4d281f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.145+0000 7f4d1ffff640 1 -- 172.21.15.77:0/1758920647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d20009b30 con 0x7f4d280cde50 2023-11-26T07:18:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.145+0000 7f4d1ffff640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d280cde50 0x7f4d28156560 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000c480 tx=0x7f4d1000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.146+0000 7f4d1f7fe640 1 -- 172.21.15.77:0/1758920647 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d100052d0 con 0x7f4d280cde50 2023-11-26T07:18:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.146+0000 7f4d1f7fe640 1 -- 172.21.15.77:0/1758920647 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d10005430 con 0x7f4d280cde50 2023-11-26T07:18:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.146+0000 7f4d1f7fe640 1 -- 172.21.15.77:0/1758920647 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d10012870 con 0x7f4d280cde50 2023-11-26T07:18:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.146+0000 7f4d27fff640 1 -- 172.21.15.77:0/1758920647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d281605a0 con 0x7f4d280cde50 2023-11-26T07:18:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.146+0000 7f4d27fff640 1 -- 172.21.15.77:0/1758920647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d281f7800 con 0x7f4d280cde50 2023-11-26T07:18:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.147+0000 7f4d27fff640 1 -- 172.21.15.77:0/1758920647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2804e840 con 0x7f4d280cde50 2023-11-26T07:18:25.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.148+0000 7f4d1f7fe640 1 -- 172.21.15.77:0/1758920647 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d100129d0 con 0x7f4d280cde50 2023-11-26T07:18:25.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.149+0000 7f4d1f7fe640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d0806ae40 0x7f4d0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.149+0000 7f4d1f7fe640 1 -- 172.21.15.77:0/1758920647 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4d10089000 con 0x7f4d280cde50 2023-11-26T07:18:25.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.149+0000 7f4d26ffd640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d0806ae40 0x7f4d0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.150+0000 7f4d26ffd640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d0806ae40 0x7f4d0806d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d18006fd0 tx=0x7f4d18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:25.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.153+0000 7f4d1f7fe640 1 -- 172.21.15.77:0/1758920647 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4d100540c0 con 0x7f4d280cde50 2023-11-26T07:18:25.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.341+0000 7f4d27fff640 1 -- 172.21.15.77:0/1758920647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d2806e870 con 0x7f4d280cde50 2023-11-26T07:18:25.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.342+0000 7f4d1f7fe640 1 -- 172.21.15.77:0/1758920647 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d100576e0 con 0x7f4d280cde50 2023-11-26T07:18:25.344 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:18:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.344+0000 7f4d27fff640 1 -- 172.21.15.77:0/1758920647 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d0806ae40 msgr2=0x7f4d0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.344+0000 7f4d27fff640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d0806ae40 0x7f4d0806d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d18006fd0 tx=0x7f4d18008040 comp rx=0 tx=0).stop 2023-11-26T07:18:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.345+0000 7f4d27fff640 1 -- 172.21.15.77:0/1758920647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d280cde50 msgr2=0x7f4d28156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.345+0000 7f4d27fff640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d280cde50 0x7f4d28156560 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000c480 tx=0x7f4d1000c940 comp rx=0 tx=0).stop 2023-11-26T07:18:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.345+0000 7f4d27fff640 1 -- 172.21.15.77:0/1758920647 shutdown_connections 2023-11-26T07:18:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.345+0000 7f4d27fff640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d0806ae40 0x7f4d0806d300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.345+0000 7f4d27fff640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2815d310 0x7f4d2809bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.345+0000 7f4d27fff640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d280cde50 0x7f4d28156560 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.345+0000 7f4d27fff640 1 --2- 172.21.15.77:0/1758920647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d280b0b40 0x7f4d281f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.345+0000 7f4d27fff640 1 -- 172.21.15.77:0/1758920647 >> 172.21.15.77:0/1758920647 conn(0x7f4d280cbb40 msgr2=0x7f4d28071970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:25.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.345+0000 7f4d27fff640 1 -- 172.21.15.77:0/1758920647 shutdown_connections 2023-11-26T07:18:25.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.345+0000 7f4d27fff640 1 -- 172.21.15.77:0/1758920647 wait complete. 2023-11-26T07:18:25.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:25.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.579+0000 7f0dd4223640 1 Processor -- start 2023-11-26T07:18:25.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.580+0000 7f0dd4223640 1 -- start start 2023-11-26T07:18:25.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.581+0000 7f0dd4223640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0dcc06de10 0x7f0dcc15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.581+0000 7f0dd4223640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dcc15ec90 con 0x7f0dcc0c49f0 2023-11-26T07:18:25.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.581+0000 7f0dd4223640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dcc0cd530 con 0x7f0dcc072160 2023-11-26T07:18:25.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.581+0000 7f0dd4223640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc0c4ed0 con 0x7f0dcc06de10 2023-11-26T07:18:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.582+0000 7f0dd27c0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0dcc0c49f0 0x7f0dcc0705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49164/0 (socket says 172.21.15.77:49164) 2023-11-26T07:18:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.582+0000 7f0dd27c0640 1 -- 172.21.15.77:0/4089386321 learned_addr learned my addr 172.21.15.77:0/4089386321 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.582+0000 7f0dd17be640 1 --2- 172.21.15.77:0/4089386321 >> v2:172.21.15.159:3300/0 conn(0x7f0dcc06de10 0x7f0dcc15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.582+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494709204 0 0) 0x7f0dc4001490 con 0x7f0dcc0c49f0 2023-11-26T07:18:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.582+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db8003520 con 0x7f0dcc0c49f0 2023-11-26T07:18:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.582+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1108795122 0 0) 0x7f0db8003520 con 0x7f0dcc0c49f0 2023-11-26T07:18:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.582+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 >> v2:172.21.15.159:3300/0 conn(0x7f0dcc06de10 msgr2=0x7f0dcc15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.582+0000 7f0dd0fbd640 1 --2- 172.21.15.77:0/4089386321 >> v2:172.21.15.159:3300/0 conn(0x7f0dcc06de10 0x7f0dcc15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.582+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 >> v1:172.21.15.159:6789/0 conn(0x7f0dcc072160 legacy=0x7f0dcc06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc0c51b0 con 0x7f0dcc0c49f0 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f0dc4001b80 con 0x7f0dcc0c49f0 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 >> v1:172.21.15.77:6789/0 conn(0x7f0dcc0c49f0 legacy=0x7f0dcc0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd0fbd640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0db8003970 0x7f0db8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd0fbd640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db80047c0 0x7f0db8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd0fbd640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db8005180 0x7f0db800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc0c4ed0 con 0x7f0db80047c0 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db800c020 con 0x7f0db8005180 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db800c1e0 con 0x7f0db8003970 2023-11-26T07:18:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd17be640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db80047c0 0x7f0db8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd1fbf640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0db8003970 0x7f0db8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd17be640 1 -- 172.21.15.77:0/4089386321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0db8003970 msgr2=0x7f0db8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:25.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd27c0640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db8005180 0x7f0db800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd17be640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0db8003970 0x7f0db8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd17be640 1 -- 172.21.15.77:0/4089386321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db8005180 msgr2=0x7f0db800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:25.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd17be640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db8005180 0x7f0db800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd17be640 1 -- 172.21.15.77:0/4089386321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8003520 con 0x7f0db80047c0 2023-11-26T07:18:25.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd27c0640 1 -- 172.21.15.77:0/4089386321 reap_dead start 2023-11-26T07:18:25.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.583+0000 7f0dd1fbf640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0db8003970 0x7f0db8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:25.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.585+0000 7f0dd17be640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db80047c0 0x7f0db8004c40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009ac0 tx=0x7f0db80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95119c4e1a157cff server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:25.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.585+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc02c6b0 con 0x7f0db80047c0 2023-11-26T07:18:25.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.585+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc02c810 con 0x7f0db80047c0 2023-11-26T07:18:25.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.585+0000 7f0dd0fbd640 1 -- 172.21.15.77:0/4089386321 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc02cba0 con 0x7f0db80047c0 2023-11-26T07:18:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.585+0000 7f0dd4223640 1 -- 172.21.15.77:0/4089386321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db80047c0 msgr2=0x7f0db8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.585+0000 7f0dd4223640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db80047c0 0x7f0db8004c40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009ac0 tx=0x7f0db80057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.585+0000 7f0dd4223640 1 -- 172.21.15.77:0/4089386321 shutdown_connections 2023-11-26T07:18:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.585+0000 7f0dd4223640 1 --2- 172.21.15.77:0/4089386321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db80047c0 0x7f0db8004c40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.585+0000 7f0dd4223640 1 -- 172.21.15.77:0/4089386321 >> 172.21.15.77:0/4089386321 conn(0x7f0dcc0b0c50 msgr2=0x7f0dcc0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.586+0000 7f0dd4223640 1 -- 172.21.15.77:0/4089386321 shutdown_connections 2023-11-26T07:18:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.586+0000 7f0dd4223640 1 -- 172.21.15.77:0/4089386321 wait complete. 2023-11-26T07:18:25.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.587+0000 7f0dd4223640 1 Processor -- start 2023-11-26T07:18:25.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.587+0000 7f0dd4223640 1 -- start start 2023-11-26T07:18:25.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.588+0000 7f0dd4223640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0db80047c0 0x7f0dcc15c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.588+0000 7f0dd4223640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dcc0c60d0 0x7f0dcc0c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.588+0000 7f0dd4223640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dcc0ca280 0x7f0dcc0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.588+0000 7f0dd4223640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc0c7cd0 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.588+0000 7f0dd4223640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc1f3480 con 0x7f0dcc0ca280 2023-11-26T07:18:25.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.588+0000 7f0dd4223640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc0b3150 con 0x7f0db80047c0 2023-11-26T07:18:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.589+0000 7f0dd17be640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dcc0c60d0 0x7f0dcc0c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.589+0000 7f0dd17be640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dcc0c60d0 0x7f0dcc0c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57414/0 (socket says 172.21.15.77:57414) 2023-11-26T07:18:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.589+0000 7f0dd17be640 1 -- 172.21.15.77:0/1319250738 learned_addr learned my addr 172.21.15.77:0/1319250738 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.589+0000 7f0dd1fbf640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0db80047c0 0x7f0dcc15c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.589+0000 7f0dd27c0640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dcc0ca280 0x7f0dcc0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.590+0000 7f0dd17be640 1 -- 172.21.15.77:0/1319250738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0db80047c0 msgr2=0x7f0dcc15c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.590+0000 7f0dd17be640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0db80047c0 0x7f0dcc15c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.590+0000 7f0dd17be640 1 -- 172.21.15.77:0/1319250738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dcc0ca280 msgr2=0x7f0dcc0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.590+0000 7f0dd17be640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dcc0ca280 0x7f0dcc0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.590+0000 7f0dd17be640 1 -- 172.21.15.77:0/1319250738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc0b3430 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.590+0000 7f0dd17be640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dcc0c60d0 0x7f0dcc0c6510 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc02c250 tx=0x7f0dbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:25.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.590+0000 7f0dc27fc640 1 -- 172.21.15.77:0/1319250738 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc003810 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.590+0000 7f0dc27fc640 1 -- 172.21.15.77:0/1319250738 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc003970 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.590+0000 7f0dd4223640 1 -- 172.21.15.77:0/1319250738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc0b3710 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.590+0000 7f0dc27fc640 1 -- 172.21.15.77:0/1319250738 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc003d00 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.590+0000 7f0dd4223640 1 -- 172.21.15.77:0/1319250738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc0b2d90 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.592+0000 7f0dd4223640 1 -- 172.21.15.77:0/1319250738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc04e8b0 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.593+0000 7f0dc27fc640 1 -- 172.21.15.77:0/1319250738 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0dbc047450 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.594+0000 7f0dc27fc640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0db006ae40 0x7f0db006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.594+0000 7f0dc27fc640 1 -- 172.21.15.77:0/1319250738 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0dbc0aba50 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.594+0000 7f0dd1fbf640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0db006ae40 0x7f0db006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.595+0000 7f0dd1fbf640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0db006ae40 0x7f0db006d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0681f0 tx=0x7f0dc8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.598+0000 7f0dc27fc640 1 -- 172.21.15.77:0/1319250738 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0dbc076a90 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.790+0000 7f0dd4223640 1 -- 172.21.15.77:0/1319250738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0dcc15dab0 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.791+0000 7f0dc27fc640 1 -- 172.21.15.77:0/1319250738 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0dbc003e60 con 0x7f0dcc0c60d0 2023-11-26T07:18:25.792 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:18:25.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 -- 172.21.15.77:0/1319250738 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0db006ae40 msgr2=0x7f0db006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0db006ae40 0x7f0db006d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0681f0 tx=0x7f0dc8009040 comp rx=0 tx=0).stop 2023-11-26T07:18:25.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 -- 172.21.15.77:0/1319250738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dcc0c60d0 msgr2=0x7f0dcc0c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dcc0c60d0 0x7f0dcc0c6510 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc02c250 tx=0x7f0dbc004730 comp rx=0 tx=0).stop 2023-11-26T07:18:25.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 -- 172.21.15.77:0/1319250738 shutdown_connections 2023-11-26T07:18:25.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0db006ae40 0x7f0db006d300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dcc0ca280 0x7f0dcc0ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dcc0c60d0 0x7f0dcc0c6510 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 --2- 172.21.15.77:0/1319250738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0db80047c0 0x7f0dcc15c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 -- 172.21.15.77:0/1319250738 >> 172.21.15.77:0/1319250738 conn(0x7f0dcc0b0c50 msgr2=0x7f0dcc0acd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:25.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 -- 172.21.15.77:0/1319250738 shutdown_connections 2023-11-26T07:18:25.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:25.793+0000 7f0dd4223640 1 -- 172.21.15.77:0/1319250738 wait complete. 2023-11-26T07:18:25.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.030+0000 7ffbf3459640 1 Processor -- start 2023-11-26T07:18:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.030+0000 7ffbf3459640 1 -- start start 2023-11-26T07:18:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.032+0000 7ffbf3459640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffbec1608f0 0x7ffbec0d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.032+0000 7ffbf3459640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffbec0ce260 0x7ffbec0d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.032+0000 7ffbf3459640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbec160cd0 con 0x7ffbec0ce710 2023-11-26T07:18:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.032+0000 7ffbf3459640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbec0b8f60 con 0x7ffbec0ce260 2023-11-26T07:18:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.032+0000 7ffbf3459640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbec0cdcb0 con 0x7ffbec1608f0 2023-11-26T07:18:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.032+0000 7ffbf1c56640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffbec0ce260 0x7ffbec0d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.032+0000 7ffbf1c56640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffbec0ce260 0x7ffbec0d3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52468/0 (socket says 172.21.15.77:52468) 2023-11-26T07:18:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.032+0000 7ffbf1c56640 1 -- 172.21.15.77:0/3655472883 learned_addr learned my addr 172.21.15.77:0/3655472883 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.033+0000 7ffbf1c56640 1 -- 172.21.15.77:0/3655472883 >> v2:172.21.15.159:3300/0 conn(0x7ffbec1608f0 msgr2=0x7ffbec0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.033+0000 7ffbf1c56640 1 --2- 172.21.15.77:0/3655472883 >> v2:172.21.15.159:3300/0 conn(0x7ffbec1608f0 0x7ffbec0d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.033+0000 7ffbf1c56640 1 -- 172.21.15.77:0/3655472883 >> v1:172.21.15.77:6789/0 conn(0x7ffbec0ce710 legacy=0x7ffbec0b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.033+0000 7ffbf1c56640 1 -- 172.21.15.77:0/3655472883 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbec0cdf90 con 0x7ffbec0ce260 2023-11-26T07:18:26.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.034+0000 7ffbf1c56640 1 --2- 172.21.15.77:0/3655472883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbec0ce260 0x7ffbec0d3180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffbec0b90a0 tx=0x7ffbdc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d5fe34faf3f6c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:26.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.034+0000 7ffbf1455640 1 -- 172.21.15.77:0/3655472883 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc030860 con 0x7ffbec0ce260 2023-11-26T07:18:26.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.034+0000 7ffbf1455640 1 -- 172.21.15.77:0/3655472883 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc0309c0 con 0x7ffbec0ce260 2023-11-26T07:18:26.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.034+0000 7ffbf1455640 1 -- 172.21.15.77:0/3655472883 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc030d50 con 0x7ffbec0ce260 2023-11-26T07:18:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.035+0000 7ffbf3459640 1 -- 172.21.15.77:0/3655472883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbec0ce260 msgr2=0x7ffbec0d3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.035+0000 7ffbf3459640 1 --2- 172.21.15.77:0/3655472883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbec0ce260 0x7ffbec0d3180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffbec0b90a0 tx=0x7ffbdc02b9a0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.035+0000 7ffbf3459640 1 -- 172.21.15.77:0/3655472883 shutdown_connections 2023-11-26T07:18:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.035+0000 7ffbf3459640 1 --2- 172.21.15.77:0/3655472883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbec0ce260 0x7ffbec0d3180 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.035+0000 7ffbf3459640 1 --2- 172.21.15.77:0/3655472883 >> v2:172.21.15.159:3300/0 conn(0x7ffbec1608f0 0x7ffbec0d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.035+0000 7ffbf3459640 1 -- 172.21.15.77:0/3655472883 >> 172.21.15.77:0/3655472883 conn(0x7ffbec061340 msgr2=0x7ffbec061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.035+0000 7ffbf3459640 1 -- 172.21.15.77:0/3655472883 shutdown_connections 2023-11-26T07:18:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.035+0000 7ffbf3459640 1 -- 172.21.15.77:0/3655472883 wait complete. 2023-11-26T07:18:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.037+0000 7ffbf3459640 1 Processor -- start 2023-11-26T07:18:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.037+0000 7ffbf3459640 1 -- start start 2023-11-26T07:18:26.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.038+0000 7ffbf3459640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbec0ce260 0x7ffbec15eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.038+0000 7ffbf3459640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbec0ce710 0x7ffbec15f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.038+0000 7ffbf3459640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbec1608f0 0x7ffbec1f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.038+0000 7ffbf3459640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec159430 con 0x7ffbec1608f0 2023-11-26T07:18:26.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.038+0000 7ffbf3459640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec14aab0 con 0x7ffbec0ce710 2023-11-26T07:18:26.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.038+0000 7ffbf3459640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec14ad90 con 0x7ffbec0ce260 2023-11-26T07:18:26.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.038+0000 7ffbf2c58640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbec1608f0 0x7ffbec1f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.039+0000 7ffbf2c58640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbec1608f0 0x7ffbec1f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52474/0 (socket says 172.21.15.77:52474) 2023-11-26T07:18:26.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.039+0000 7ffbf2c58640 1 -- 172.21.15.77:0/430231539 learned_addr learned my addr 172.21.15.77:0/430231539 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:26.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.039+0000 7ffbf2c58640 1 -- 172.21.15.77:0/430231539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbec0ce260 msgr2=0x7ffbec15eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:26.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.039+0000 7ffbf1c56640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbec0ce710 0x7ffbec15f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.039+0000 7ffbf2457640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbec0ce260 0x7ffbec15eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.039+0000 7ffbf2c58640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbec0ce260 0x7ffbec15eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.039+0000 7ffbf2c58640 1 -- 172.21.15.77:0/430231539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbec0ce710 msgr2=0x7ffbec15f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:26.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.039+0000 7ffbf2c58640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbec0ce710 0x7ffbec15f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.039+0000 7ffbf2c58640 1 -- 172.21.15.77:0/430231539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc0094d0 con 0x7ffbec1608f0 2023-11-26T07:18:26.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.039+0000 7ffbf2c58640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbec1608f0 0x7ffbec1f6250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400c7a0 tx=0x7ffbe400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:26.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.039+0000 7ffbe2ffd640 1 -- 172.21.15.77:0/430231539 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4003b70 con 0x7ffbec1608f0 2023-11-26T07:18:26.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.040+0000 7ffbe2ffd640 1 -- 172.21.15.77:0/430231539 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe4003cf0 con 0x7ffbec1608f0 2023-11-26T07:18:26.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.040+0000 7ffbe2ffd640 1 -- 172.21.15.77:0/430231539 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4003ea0 con 0x7ffbec1608f0 2023-11-26T07:18:26.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.040+0000 7ffbf3459640 1 -- 172.21.15.77:0/430231539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbec159690 con 0x7ffbec1608f0 2023-11-26T07:18:26.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.040+0000 7ffbf3459640 1 -- 172.21.15.77:0/430231539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbec0ccb70 con 0x7ffbec1608f0 2023-11-26T07:18:26.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.041+0000 7ffbf3459640 1 -- 172.21.15.77:0/430231539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbec159bb0 con 0x7ffbec1608f0 2023-11-26T07:18:26.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.042+0000 7ffbe2ffd640 1 -- 172.21.15.77:0/430231539 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffbe400aa90 con 0x7ffbec1608f0 2023-11-26T07:18:26.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.043+0000 7ffbe2ffd640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffbd006ae70 0x7ffbd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.043+0000 7ffbe2ffd640 1 -- 172.21.15.77:0/430231539 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ffbe4089550 con 0x7ffbec1608f0 2023-11-26T07:18:26.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.043+0000 7ffbf2457640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffbd006ae70 0x7ffbd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.044+0000 7ffbf2457640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffbd006ae70 0x7ffbd006d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffbec1f61b0 tx=0x7ffbe8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:26.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.048+0000 7ffbe2ffd640 1 -- 172.21.15.77:0/430231539 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffbe40544e0 con 0x7ffbec1608f0 2023-11-26T07:18:26.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.237+0000 7ffbf3459640 1 -- 172.21.15.77:0/430231539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffbec0ccd00 con 0x7ffbec1608f0 2023-11-26T07:18:26.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.238+0000 7ffbe2ffd640 1 -- 172.21.15.77:0/430231539 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffbe4057b00 con 0x7ffbec1608f0 2023-11-26T07:18:26.239 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:18:26.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.240+0000 7ffbf3459640 1 -- 172.21.15.77:0/430231539 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffbd006ae70 msgr2=0x7ffbd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.240+0000 7ffbf3459640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffbd006ae70 0x7ffbd006d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffbec1f61b0 tx=0x7ffbe8008040 comp rx=0 tx=0).stop 2023-11-26T07:18:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.240+0000 7ffbf3459640 1 -- 172.21.15.77:0/430231539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbec1608f0 msgr2=0x7ffbec1f6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.240+0000 7ffbf3459640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbec1608f0 0x7ffbec1f6250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400c7a0 tx=0x7ffbe400cc60 comp rx=0 tx=0).stop 2023-11-26T07:18:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.241+0000 7ffbf3459640 1 -- 172.21.15.77:0/430231539 shutdown_connections 2023-11-26T07:18:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.241+0000 7ffbf3459640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffbd006ae70 0x7ffbd006d330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.241+0000 7ffbf3459640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbec1608f0 0x7ffbec1f6250 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.241+0000 7ffbf3459640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbec0ce710 0x7ffbec15f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.241+0000 7ffbf3459640 1 --2- 172.21.15.77:0/430231539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbec0ce260 0x7ffbec15eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.241+0000 7ffbf3459640 1 -- 172.21.15.77:0/430231539 >> 172.21.15.77:0/430231539 conn(0x7ffbec061340 msgr2=0x7ffbec0b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.241+0000 7ffbf3459640 1 -- 172.21.15.77:0/430231539 shutdown_connections 2023-11-26T07:18:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.241+0000 7ffbf3459640 1 -- 172.21.15.77:0/430231539 wait complete. 2023-11-26T07:18:26.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.476+0000 7f2af6516640 1 Processor -- start 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.476+0000 7f2af6516640 1 -- start start 2023-11-26T07:18:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.478+0000 7f2af6516640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af015b1d0 0x7f2af0071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.478+0000 7f2af6516640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2af0070550 0x7f2af00b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.478+0000 7f2af6516640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2af00b1080 0x7f2af006c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.478+0000 7f2af6516640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af00b1510 con 0x7f2af0070550 2023-11-26T07:18:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.478+0000 7f2af6516640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af00ca0e0 con 0x7f2af00b1080 2023-11-26T07:18:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.478+0000 7f2af6516640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af0072800 con 0x7f2af015b1d0 2023-11-26T07:18:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.478+0000 7f2af4d13640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2af0070550 0x7f2af00b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.478+0000 7f2af4d13640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2af0070550 0x7f2af00b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52486/0 (socket says 172.21.15.77:52486) 2023-11-26T07:18:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.478+0000 7f2af4d13640 1 -- 172.21.15.77:0/4093982314 learned_addr learned my addr 172.21.15.77:0/4093982314 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.479+0000 7f2af5d15640 1 --2- 172.21.15.77:0/4093982314 >> v2:172.21.15.159:3300/0 conn(0x7f2af00b1080 0x7f2af006c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.479+0000 7f2af5514640 1 --2- 172.21.15.77:0/4093982314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af015b1d0 0x7f2af0071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.479+0000 7f2af4d13640 1 -- 172.21.15.77:0/4093982314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af015b1d0 msgr2=0x7f2af0071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.479+0000 7f2af4d13640 1 --2- 172.21.15.77:0/4093982314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af015b1d0 0x7f2af0071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.479+0000 7f2af4d13640 1 -- 172.21.15.77:0/4093982314 >> v2:172.21.15.159:3300/0 conn(0x7f2af00b1080 msgr2=0x7f2af006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:26.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.479+0000 7f2af4d13640 1 --2- 172.21.15.77:0/4093982314 >> v2:172.21.15.159:3300/0 conn(0x7f2af00b1080 0x7f2af006c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.479+0000 7f2af4d13640 1 -- 172.21.15.77:0/4093982314 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af00c97b0 con 0x7f2af0070550 2023-11-26T07:18:26.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.480+0000 7f2af4d13640 1 --2- 172.21.15.77:0/4093982314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af0070550 0x7f2af00b0b40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2af00b51a0 tx=0x7f2ae002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ec6edcab154276 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:26.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2ae7fff640 1 -- 172.21.15.77:0/4093982314 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0031860 con 0x7f2af0070550 2023-11-26T07:18:26.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2ae7fff640 1 -- 172.21.15.77:0/4093982314 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae00319c0 con 0x7f2af0070550 2023-11-26T07:18:26.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2ae7fff640 1 -- 172.21.15.77:0/4093982314 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0031d50 con 0x7f2af0070550 2023-11-26T07:18:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2af6516640 1 -- 172.21.15.77:0/4093982314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af0070550 msgr2=0x7f2af00b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2af6516640 1 --2- 172.21.15.77:0/4093982314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af0070550 0x7f2af00b0b40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2af00b51a0 tx=0x7f2ae002b900 comp rx=0 tx=0).stop 2023-11-26T07:18:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2af6516640 1 -- 172.21.15.77:0/4093982314 shutdown_connections 2023-11-26T07:18:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2af6516640 1 --2- 172.21.15.77:0/4093982314 >> v2:172.21.15.159:3300/0 conn(0x7f2af00b1080 0x7f2af006c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2af6516640 1 --2- 172.21.15.77:0/4093982314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af0070550 0x7f2af00b0b40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2af6516640 1 --2- 172.21.15.77:0/4093982314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af015b1d0 0x7f2af0071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2af6516640 1 -- 172.21.15.77:0/4093982314 >> 172.21.15.77:0/4093982314 conn(0x7f2af00cbb40 msgr2=0x7f2af00cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2af6516640 1 -- 172.21.15.77:0/4093982314 shutdown_connections 2023-11-26T07:18:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.481+0000 7f2af6516640 1 -- 172.21.15.77:0/4093982314 wait complete. 2023-11-26T07:18:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.483+0000 7f2af6516640 1 Processor -- start 2023-11-26T07:18:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.483+0000 7f2af6516640 1 -- start start 2023-11-26T07:18:26.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.484+0000 7f2af6516640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af0070550 0x7f2af015a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.484+0000 7f2af6516640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af00b1080 0x7f2af00c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.484+0000 7f2af6516640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af015b1d0 0x7f2af00b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.484+0000 7f2af6516640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af00b4b20 con 0x7f2af00b1080 2023-11-26T07:18:26.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.484+0000 7f2af6516640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af00c4750 con 0x7f2af0070550 2023-11-26T07:18:26.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.484+0000 7f2af6516640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af00b4560 con 0x7f2af015b1d0 2023-11-26T07:18:26.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.485+0000 7f2af4d13640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af00b1080 0x7f2af00c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.485+0000 7f2af4d13640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af00b1080 0x7f2af00c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52492/0 (socket says 172.21.15.77:52492) 2023-11-26T07:18:26.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.485+0000 7f2af4d13640 1 -- 172.21.15.77:0/3119330287 learned_addr learned my addr 172.21.15.77:0/3119330287 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:26.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.485+0000 7f2af5514640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af0070550 0x7f2af015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.485+0000 7f2af5d15640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af015b1d0 0x7f2af00b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.485+0000 7f2af4d13640 1 -- 172.21.15.77:0/3119330287 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af015b1d0 msgr2=0x7f2af00b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:26.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.485+0000 7f2af4d13640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af015b1d0 0x7f2af00b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.485+0000 7f2af4d13640 1 -- 172.21.15.77:0/3119330287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af0070550 msgr2=0x7f2af015a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:26.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.485+0000 7f2af4d13640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af0070550 0x7f2af015a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.486+0000 7f2af4d13640 1 -- 172.21.15.77:0/3119330287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae00094d0 con 0x7f2af00b1080 2023-11-26T07:18:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.486+0000 7f2af5d15640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af015b1d0 0x7f2af00b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.486+0000 7f2af4d13640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af00b1080 0x7f2af00c3cb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2ae002b940 tx=0x7f2ae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.486+0000 7f2ae5ffb640 1 -- 172.21.15.77:0/3119330287 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0031850 con 0x7f2af00b1080 2023-11-26T07:18:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.486+0000 7f2ae5ffb640 1 -- 172.21.15.77:0/3119330287 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae00443f0 con 0x7f2af00b1080 2023-11-26T07:18:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.486+0000 7f2ae5ffb640 1 -- 172.21.15.77:0/3119330287 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00447a0 con 0x7f2af00b1080 2023-11-26T07:18:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.486+0000 7f2af6516640 1 -- 172.21.15.77:0/3119330287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af00b4840 con 0x7f2af00b1080 2023-11-26T07:18:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.486+0000 7f2af6516640 1 -- 172.21.15.77:0/3119330287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af01e3ae0 con 0x7f2af00b1080 2023-11-26T07:18:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.487+0000 7f2af6516640 1 -- 172.21.15.77:0/3119330287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af004e840 con 0x7f2af00b1080 2023-11-26T07:18:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.489+0000 7f2ae5ffb640 1 -- 172.21.15.77:0/3119330287 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ae004d450 con 0x7f2af00b1080 2023-11-26T07:18:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.490+0000 7f2ae5ffb640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2ad406ae40 0x7f2ad406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.490+0000 7f2ae5ffb640 1 -- 172.21.15.77:0/3119330287 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2ae00abec0 con 0x7f2af00b1080 2023-11-26T07:18:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.490+0000 7f2af5514640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2ad406ae40 0x7f2ad406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:26.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.491+0000 7f2af5514640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2ad406ae40 0x7f2ad406d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2aec006fd0 tx=0x7f2aec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:26.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.494+0000 7f2ae5ffb640 1 -- 172.21.15.77:0/3119330287 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ae0076e50 con 0x7f2af00b1080 2023-11-26T07:18:26.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.698+0000 7f2af6516640 1 -- 172.21.15.77:0/3119330287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2af006db40 con 0x7f2af00b1080 2023-11-26T07:18:26.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.698+0000 7f2ae5ffb640 1 -- 172.21.15.77:0/3119330287 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2ae0035020 con 0x7f2af00b1080 2023-11-26T07:18:26.700 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:18:26.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.701+0000 7f2af6516640 1 -- 172.21.15.77:0/3119330287 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2ad406ae40 msgr2=0x7f2ad406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:26.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.701+0000 7f2af6516640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2ad406ae40 0x7f2ad406d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2aec006fd0 tx=0x7f2aec008040 comp rx=0 tx=0).stop 2023-11-26T07:18:26.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.701+0000 7f2af6516640 1 -- 172.21.15.77:0/3119330287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af00b1080 msgr2=0x7f2af00c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:26.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.701+0000 7f2af6516640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af00b1080 0x7f2af00c3cb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2ae002b940 tx=0x7f2ae00046c0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.701+0000 7f2af6516640 1 -- 172.21.15.77:0/3119330287 shutdown_connections 2023-11-26T07:18:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.701+0000 7f2af6516640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2ad406ae40 0x7f2ad406d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.701+0000 7f2af6516640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af015b1d0 0x7f2af00b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.701+0000 7f2af6516640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af00b1080 0x7f2af00c3cb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.701+0000 7f2af6516640 1 --2- 172.21.15.77:0/3119330287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af0070550 0x7f2af015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.701+0000 7f2af6516640 1 -- 172.21.15.77:0/3119330287 >> 172.21.15.77:0/3119330287 conn(0x7f2af00cbb40 msgr2=0x7f2af00ac6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.701+0000 7f2af6516640 1 -- 172.21.15.77:0/3119330287 shutdown_connections 2023-11-26T07:18:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:26.702+0000 7f2af6516640 1 -- 172.21.15.77:0/3119330287 wait complete. 2023-11-26T07:18:26.722 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-26T07:18:26.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:26.722 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-26T07:18:26.826 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:18:26.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:26.826 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-26T07:18:26.872 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:18:26.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:27.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.090+0000 7fb282294640 1 Processor -- start 2023-11-26T07:18:27.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.090+0000 7fb282294640 1 -- start start 2023-11-26T07:18:27.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.091+0000 7fb282294640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb27c0cc050 0x7fb27c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.091+0000 7fb282294640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c0cda70 con 0x7fb27c15b450 2023-11-26T07:18:27.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.091+0000 7fb282294640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c070180 con 0x7fb27c0d0b10 2023-11-26T07:18:27.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.091+0000 7fb282294640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c070460 con 0x7fb27c0cc050 2023-11-26T07:18:27.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.092+0000 7fb27b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb27c0cc050 0x7fb27c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.092+0000 7fb27b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb27c0cc050 0x7fb27c0cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52508/0 (socket says 172.21.15.77:52508) 2023-11-26T07:18:27.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.092+0000 7fb27b7fe640 1 -- 172.21.15.77:0/3613198818 learned_addr learned my addr 172.21.15.77:0/3613198818 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:27.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.092+0000 7fb27b7fe640 1 -- 172.21.15.77:0/3613198818 >> v1:172.21.15.159:6789/0 conn(0x7fb27c0d0b10 legacy=0x7fb27c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:27.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.092+0000 7fb27b7fe640 1 -- 172.21.15.77:0/3613198818 >> v1:172.21.15.77:6789/0 conn(0x7fb27c15b450 legacy=0x7fb27c0cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.092+0000 7fb27b7fe640 1 -- 172.21.15.77:0/3613198818 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c070740 con 0x7fb27c0cc050 2023-11-26T07:18:27.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.093+0000 7fb27b7fe640 1 --2- 172.21.15.77:0/3613198818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb27c0cc050 0x7fb27c0cefa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb264009870 tx=0x7fb26402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82603610eb7c638b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.093+0000 7fb27affd640 1 -- 172.21.15.77:0/3613198818 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264030850 con 0x7fb27c0cc050 2023-11-26T07:18:27.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.093+0000 7fb27affd640 1 -- 172.21.15.77:0/3613198818 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2640309b0 con 0x7fb27c0cc050 2023-11-26T07:18:27.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.093+0000 7fb27affd640 1 -- 172.21.15.77:0/3613198818 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264030d40 con 0x7fb27c0cc050 2023-11-26T07:18:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.094+0000 7fb282294640 1 -- 172.21.15.77:0/3613198818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb27c0cc050 msgr2=0x7fb27c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.094+0000 7fb282294640 1 --2- 172.21.15.77:0/3613198818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb27c0cc050 0x7fb27c0cefa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb264009870 tx=0x7fb26402b990 comp rx=0 tx=0).stop 2023-11-26T07:18:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.094+0000 7fb282294640 1 -- 172.21.15.77:0/3613198818 shutdown_connections 2023-11-26T07:18:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.094+0000 7fb282294640 1 --2- 172.21.15.77:0/3613198818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb27c0cc050 0x7fb27c0cefa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.094+0000 7fb282294640 1 -- 172.21.15.77:0/3613198818 >> 172.21.15.77:0/3613198818 conn(0x7fb27c06e7f0 msgr2=0x7fb27c06ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.094+0000 7fb282294640 1 -- 172.21.15.77:0/3613198818 shutdown_connections 2023-11-26T07:18:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.094+0000 7fb282294640 1 -- 172.21.15.77:0/3613198818 wait complete. 2023-11-26T07:18:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.096+0000 7fb282294640 1 Processor -- start 2023-11-26T07:18:27.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.096+0000 7fb282294640 1 -- start start 2023-11-26T07:18:27.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.097+0000 7fb282294640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb27c0cc050 0x7fb27c15e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.097+0000 7fb282294640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb27c0d0b10 0x7fb27c1f0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.097+0000 7fb282294640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb27c15b450 0x7fb27c0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.097+0000 7fb282294640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c15d210 con 0x7fb27c15b450 2023-11-26T07:18:27.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.097+0000 7fb282294640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c15d4f0 con 0x7fb27c0d0b10 2023-11-26T07:18:27.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.097+0000 7fb282294640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c15d7d0 con 0x7fb27c0cc050 2023-11-26T07:18:27.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.097+0000 7fb280831640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb27c15b450 0x7fb27c0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.097+0000 7fb280831640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb27c15b450 0x7fb27c0afe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52512/0 (socket says 172.21.15.77:52512) 2023-11-26T07:18:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.097+0000 7fb280831640 1 -- 172.21.15.77:0/623139170 learned_addr learned my addr 172.21.15.77:0/623139170 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.098+0000 7fb280831640 1 -- 172.21.15.77:0/623139170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb27c0cc050 msgr2=0x7fb27c15e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.098+0000 7fb280831640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb27c0cc050 0x7fb27c15e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.098+0000 7fb27b7fe640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb27c0d0b10 0x7fb27c1f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.098+0000 7fb280831640 1 -- 172.21.15.77:0/623139170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb27c0d0b10 msgr2=0x7fb27c1f0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.098+0000 7fb280831640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb27c0d0b10 0x7fb27c1f0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.098+0000 7fb280831640 1 -- 172.21.15.77:0/623139170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2640094d0 con 0x7fb27c15b450 2023-11-26T07:18:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.098+0000 7fb280831640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb27c15b450 0x7fb27c0afe40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb27400c410 tx=0x7fb27400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.098+0000 7fb278ff9640 1 -- 172.21.15.77:0/623139170 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274011790 con 0x7fb27c15b450 2023-11-26T07:18:27.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.098+0000 7fb278ff9640 1 -- 172.21.15.77:0/623139170 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2740118f0 con 0x7fb27c15b450 2023-11-26T07:18:27.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.098+0000 7fb278ff9640 1 -- 172.21.15.77:0/623139170 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274011ce0 con 0x7fb27c15b450 2023-11-26T07:18:27.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.098+0000 7fb282294640 1 -- 172.21.15.77:0/623139170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c15dab0 con 0x7fb27c15b450 2023-11-26T07:18:27.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.099+0000 7fb282294640 1 -- 172.21.15.77:0/623139170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c0c7fd0 con 0x7fb27c15b450 2023-11-26T07:18:27.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.100+0000 7fb282294640 1 -- 172.21.15.77:0/623139170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c15dfd0 con 0x7fb27c15b450 2023-11-26T07:18:27.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.100+0000 7fb278ff9640 1 -- 172.21.15.77:0/623139170 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb27401c460 con 0x7fb27c15b450 2023-11-26T07:18:27.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.101+0000 7fb278ff9640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb25c06ae40 0x7fb25c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.101+0000 7fb278ff9640 1 -- 172.21.15.77:0/623139170 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb274089360 con 0x7fb27c15b450 2023-11-26T07:18:27.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.102+0000 7fb27bfff640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb25c06ae40 0x7fb25c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.102+0000 7fb27bfff640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb25c06ae40 0x7fb25c06d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0012e0 tx=0x7fb26c007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.106+0000 7fb278ff9640 1 -- 172.21.15.77:0/623139170 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb27c15dfd0 con 0x7fb27c15b450 2023-11-26T07:18:27.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.317+0000 7fb282294640 1 -- 172.21.15.77:0/623139170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb27c15dfd0 con 0x7fb27c15b450 2023-11-26T07:18:27.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.318+0000 7fb278ff9640 1 -- 172.21.15.77:0/623139170 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4910 (secure 0 0 0) 0x7fb27c15dfd0 con 0x7fb27c15b450 2023-11-26T07:18:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:27.320 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2517793456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2517793456},{"type":"v1","addr":"172.21.15.77:6835","nonce":2517793456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/169772143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":169772143},{"type":"v1","addr":"172.21.15.77:6837","nonce":169772143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3797973649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3797973649},{"type":"v1","addr":"172.21.15.159:6834","nonce":3797973649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:17:34.699805+0000","modified":"2023-11-26T07:17:37.771915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/2168278307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2168278307},{"type":"v1","addr":"172.21.15.159:6835","nonce":2168278307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:27.320 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-11-26T07:18:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 -- 172.21.15.77:0/623139170 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb25c06ae40 msgr2=0x7fb25c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb25c06ae40 0x7fb25c06d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0012e0 tx=0x7fb26c007d30 comp rx=0 tx=0).stop 2023-11-26T07:18:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 -- 172.21.15.77:0/623139170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb27c15b450 msgr2=0x7fb27c0afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb27c15b450 0x7fb27c0afe40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb27400c410 tx=0x7fb27400c8d0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 -- 172.21.15.77:0/623139170 shutdown_connections 2023-11-26T07:18:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb25c06ae40 0x7fb25c06d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb27c15b450 0x7fb27c0afe40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb27c0d0b10 0x7fb27c1f0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 --2- 172.21.15.77:0/623139170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb27c0cc050 0x7fb27c15e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 -- 172.21.15.77:0/623139170 >> 172.21.15.77:0/623139170 conn(0x7fb27c06e7f0 msgr2=0x7fb27c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:27.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 -- 172.21.15.77:0/623139170 shutdown_connections 2023-11-26T07:18:27.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.321+0000 7fb282294640 1 -- 172.21.15.77:0/623139170 wait complete. 2023-11-26T07:18:27.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:27.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.546+0000 7fb8630df640 1 Processor -- start 2023-11-26T07:18:27.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.547+0000 7fb8630df640 1 -- start start 2023-11-26T07:18:27.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.548+0000 7fb8630df640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb85c13d120 0x7fb85c15af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.548+0000 7fb8630df640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb85c06d6c0 0x7fb85c06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.548+0000 7fb8630df640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c06e060 con 0x7fb85c0b0a70 2023-11-26T07:18:27.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.549+0000 7fb8630df640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c13f9e0 con 0x7fb85c06d6c0 2023-11-26T07:18:27.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.549+0000 7fb8630df640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c13fcc0 con 0x7fb85c13d120 2023-11-26T07:18:27.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.549+0000 7fb8628de640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb85c0b0a70 0x7fb85c0b0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57904/0 (socket says 172.21.15.77:57904) 2023-11-26T07:18:27.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.549+0000 7fb8628de640 1 -- 172.21.15.77:0/738908790 learned_addr learned my addr 172.21.15.77:0/738908790 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:27.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.549+0000 7fb8618dc640 1 --2- 172.21.15.77:0/738908790 >> v2:172.21.15.77:3300/0 conn(0x7fb85c06d6c0 0x7fb85c06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.549+0000 7fb8620dd640 1 --2- 172.21.15.77:0/738908790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb85c13d120 0x7fb85c15af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.549+0000 7fb8618dc640 1 -- 172.21.15.77:0/738908790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb85c13d120 msgr2=0x7fb85c15af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:27.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.549+0000 7fb8618dc640 1 --2- 172.21.15.77:0/738908790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb85c13d120 0x7fb85c15af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.549+0000 7fb8618dc640 1 -- 172.21.15.77:0/738908790 >> v1:172.21.15.77:6789/0 conn(0x7fb85c0b0a70 legacy=0x7fb85c0b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.549+0000 7fb8618dc640 1 -- 172.21.15.77:0/738908790 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0cec00 con 0x7fb85c06d6c0 2023-11-26T07:18:27.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.549+0000 7fb8620dd640 1 --2- 172.21.15.77:0/738908790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb85c13d120 0x7fb85c15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:27.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.550+0000 7fb8618dc640 1 --2- 172.21.15.77:0/738908790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85c06d6c0 0x7fb85c06db20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0097a0 tx=0x7fb84c02da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3041321acf7d019a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.551+0000 7fb8610db640 1 -- 172.21.15.77:0/738908790 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c031850 con 0x7fb85c06d6c0 2023-11-26T07:18:27.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.551+0000 7fb8610db640 1 -- 172.21.15.77:0/738908790 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c0319b0 con 0x7fb85c06d6c0 2023-11-26T07:18:27.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.551+0000 7fb8610db640 1 -- 172.21.15.77:0/738908790 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c031d40 con 0x7fb85c06d6c0 2023-11-26T07:18:27.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.551+0000 7fb8630df640 1 -- 172.21.15.77:0/738908790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85c06d6c0 msgr2=0x7fb85c06db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.551+0000 7fb8630df640 1 --2- 172.21.15.77:0/738908790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85c06d6c0 0x7fb85c06db20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0097a0 tx=0x7fb84c02da30 comp rx=0 tx=0).stop 2023-11-26T07:18:27.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.551+0000 7fb8630df640 1 -- 172.21.15.77:0/738908790 shutdown_connections 2023-11-26T07:18:27.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.551+0000 7fb8630df640 1 --2- 172.21.15.77:0/738908790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85c06d6c0 0x7fb85c06db20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.551+0000 7fb8630df640 1 --2- 172.21.15.77:0/738908790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb85c13d120 0x7fb85c15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.551+0000 7fb8630df640 1 -- 172.21.15.77:0/738908790 >> 172.21.15.77:0/738908790 conn(0x7fb85c0cb830 msgr2=0x7fb85c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:27.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.551+0000 7fb8630df640 1 -- 172.21.15.77:0/738908790 shutdown_connections 2023-11-26T07:18:27.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.551+0000 7fb8630df640 1 -- 172.21.15.77:0/738908790 wait complete. 2023-11-26T07:18:27.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.553+0000 7fb8630df640 1 Processor -- start 2023-11-26T07:18:27.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.553+0000 7fb8630df640 1 -- start start 2023-11-26T07:18:27.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.554+0000 7fb8630df640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb85c06d6c0 0x7fb85c159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.554+0000 7fb8630df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85c0b0a70 0x7fb85c0b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.554+0000 7fb8630df640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c13d120 0x7fb85c0adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.554+0000 7fb8630df640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c15a1b0 con 0x7fb85c0b0a70 2023-11-26T07:18:27.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.554+0000 7fb8630df640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c159500 con 0x7fb85c13d120 2023-11-26T07:18:27.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.554+0000 7fb8630df640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0ad0c0 con 0x7fb85c06d6c0 2023-11-26T07:18:27.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.554+0000 7fb8618dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85c0b0a70 0x7fb85c0b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.554+0000 7fb8618dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85c0b0a70 0x7fb85c0b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52518/0 (socket says 172.21.15.77:52518) 2023-11-26T07:18:27.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.554+0000 7fb8618dc640 1 -- 172.21.15.77:0/1256464400 learned_addr learned my addr 172.21.15.77:0/1256464400 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:27.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.555+0000 7fb8618dc640 1 -- 172.21.15.77:0/1256464400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb85c06d6c0 msgr2=0x7fb85c159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.555+0000 7fb8618dc640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb85c06d6c0 0x7fb85c159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.555+0000 7fb8618dc640 1 -- 172.21.15.77:0/1256464400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c13d120 msgr2=0x7fb85c0adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.555+0000 7fb8618dc640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c13d120 0x7fb85c0adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.555+0000 7fb8618dc640 1 -- 172.21.15.77:0/1256464400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c009400 con 0x7fb85c0b0a70 2023-11-26T07:18:27.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.555+0000 7fb8618dc640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85c0b0a70 0x7fb85c0b4470 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb84c02e040 tx=0x7fb84c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.555+0000 7fb852ffd640 1 -- 172.21.15.77:0/1256464400 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c03ad20 con 0x7fb85c0b0a70 2023-11-26T07:18:27.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.555+0000 7fb852ffd640 1 -- 172.21.15.77:0/1256464400 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c0443f0 con 0x7fb85c0b0a70 2023-11-26T07:18:27.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.555+0000 7fb8630df640 1 -- 172.21.15.77:0/1256464400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c0ad3a0 con 0x7fb85c0b0a70 2023-11-26T07:18:27.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.555+0000 7fb852ffd640 1 -- 172.21.15.77:0/1256464400 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c03aea0 con 0x7fb85c0b0a70 2023-11-26T07:18:27.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.556+0000 7fb8630df640 1 -- 172.21.15.77:0/1256464400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c159750 con 0x7fb85c0b0a70 2023-11-26T07:18:27.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.557+0000 7fb8630df640 1 -- 172.21.15.77:0/1256464400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c159940 con 0x7fb85c0b0a70 2023-11-26T07:18:27.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.557+0000 7fb852ffd640 1 -- 172.21.15.77:0/1256464400 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb84c04d450 con 0x7fb85c0b0a70 2023-11-26T07:18:27.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.558+0000 7fb852ffd640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb84006ae70 0x7fb84006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.558+0000 7fb852ffd640 1 -- 172.21.15.77:0/1256464400 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb84c0abbd0 con 0x7fb85c0b0a70 2023-11-26T07:18:27.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.559+0000 7fb8620dd640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb84006ae70 0x7fb84006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.559+0000 7fb8620dd640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb84006ae70 0x7fb84006d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb858006fd0 tx=0x7fb858008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.563+0000 7fb852ffd640 1 -- 172.21.15.77:0/1256464400 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb84c076c90 con 0x7fb85c0b0a70 2023-11-26T07:18:27.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.740+0000 7fb8630df640 1 -- 172.21.15.77:0/1256464400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb85c04e840 con 0x7fb85c0b0a70 2023-11-26T07:18:27.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.742+0000 7fb852ffd640 1 -- 172.21.15.77:0/1256464400 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16729 (secure 0 0 0) 0x7fb84c07a2b0 con 0x7fb85c0b0a70 2023-11-26T07:18:27.744 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:27.744 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:18:16.826725+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:27.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.744+0000 7fb8630df640 1 -- 172.21.15.77:0/1256464400 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb84006ae70 msgr2=0x7fb84006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.744+0000 7fb8630df640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb84006ae70 0x7fb84006d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb858006fd0 tx=0x7fb858008040 comp rx=0 tx=0).stop 2023-11-26T07:18:27.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.744+0000 7fb8630df640 1 -- 172.21.15.77:0/1256464400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85c0b0a70 msgr2=0x7fb85c0b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.744+0000 7fb8630df640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85c0b0a70 0x7fb85c0b4470 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb84c02e040 tx=0x7fb84c0046c0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.745+0000 7fb8630df640 1 -- 172.21.15.77:0/1256464400 shutdown_connections 2023-11-26T07:18:27.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.745+0000 7fb8630df640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb84006ae70 0x7fb84006d330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.745+0000 7fb8630df640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c13d120 0x7fb85c0adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.745+0000 7fb8630df640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85c0b0a70 0x7fb85c0b4470 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.745+0000 7fb8630df640 1 --2- 172.21.15.77:0/1256464400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb85c06d6c0 0x7fb85c159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.745+0000 7fb8630df640 1 -- 172.21.15.77:0/1256464400 >> 172.21.15.77:0/1256464400 conn(0x7fb85c0cb830 msgr2=0x7fb85c13d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:27.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.745+0000 7fb8630df640 1 -- 172.21.15.77:0/1256464400 shutdown_connections 2023-11-26T07:18:27.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.745+0000 7fb8630df640 1 -- 172.21.15.77:0/1256464400 wait complete. 2023-11-26T07:18:27.765 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:17:32.975228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:17:33.719582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:27.766 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:27.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.981+0000 7f941754c640 1 Processor -- start 2023-11-26T07:18:27.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.981+0000 7f941754c640 1 -- start start 2023-11-26T07:18:27.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.982+0000 7f941754c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f941015d270 0x7f941015d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.982+0000 7f941754c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941015db90 con 0x7f94100cf220 2023-11-26T07:18:27.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.982+0000 7f941754c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9410161ce0 con 0x7f9410161260 2023-11-26T07:18:27.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.982+0000 7f941754c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9410161fc0 con 0x7f941015d270 2023-11-26T07:18:27.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.983+0000 7f9415ae9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f94100cf220 0x7f94100d19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57910/0 (socket says 172.21.15.77:57910) 2023-11-26T07:18:27.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.983+0000 7f9415ae9640 1 -- 172.21.15.77:0/3313047296 learned_addr learned my addr 172.21.15.77:0/3313047296 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:27.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.983+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280704764 0 0) 0x7f941015db90 con 0x7f94100cf220 2023-11-26T07:18:27.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.983+0000 7f94152e8640 1 --2- 172.21.15.77:0/3313047296 >> v2:172.21.15.159:3300/0 conn(0x7f941015d270 0x7f941015d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.983+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc003520 con 0x7f94100cf220 2023-11-26T07:18:27.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.983+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1151191725 0 0) 0x7f93fc003520 con 0x7f94100cf220 2023-11-26T07:18:27.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.983+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 >> v2:172.21.15.159:3300/0 conn(0x7f941015d270 msgr2=0x7f941015d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:27.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.983+0000 7f9407fff640 1 --2- 172.21.15.77:0/3313047296 >> v2:172.21.15.159:3300/0 conn(0x7f941015d270 0x7f941015d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 >> v1:172.21.15.159:6789/0 conn(0x7f9410161260 legacy=0x7f94100ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94100ce310 con 0x7f94100cf220 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f94080019f0 con 0x7f94100cf220 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 >> v1:172.21.15.77:6789/0 conn(0x7f94100cf220 legacy=0x7f94100d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f9407fff640 1 --2- 172.21.15.77:0/3313047296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0039c0 0x7f93fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f9407fff640 1 --2- 172.21.15.77:0/3313047296 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93fc0047c0 0x7f93fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f9407fff640 1 --2- 172.21.15.77:0/3313047296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc005180 0x7f93fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9410161fc0 con 0x7f93fc0039c0 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc00c080 con 0x7f93fc005180 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc00c240 con 0x7f93fc0047c0 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f94152e8640 1 --2- 172.21.15.77:0/3313047296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0039c0 0x7f93fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f94152e8640 1 -- 172.21.15.77:0/3313047296 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93fc0047c0 msgr2=0x7f93fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f94152e8640 1 --2- 172.21.15.77:0/3313047296 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93fc0047c0 0x7f93fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f94152e8640 1 -- 172.21.15.77:0/3313047296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc005180 msgr2=0x7f93fc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:27.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f94152e8640 1 --2- 172.21.15.77:0/3313047296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc005180 0x7f93fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f94152e8640 1 -- 172.21.15.77:0/3313047296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc003520 con 0x7f93fc0039c0 2023-11-26T07:18:27.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.984+0000 7f9415ae9640 1 -- 172.21.15.77:0/3313047296 reap_dead start 2023-11-26T07:18:27.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.985+0000 7f94152e8640 1 --2- 172.21.15.77:0/3313047296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0039c0 0x7f93fc003de0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f940c009ac0 tx=0x7f93fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4347fe6d4bd4d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.986+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c02c6d0 con 0x7f93fc0039c0 2023-11-26T07:18:27.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.986+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c02c830 con 0x7f93fc0039c0 2023-11-26T07:18:27.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.986+0000 7f9407fff640 1 -- 172.21.15.77:0/3313047296 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c02cbc0 con 0x7f93fc0039c0 2023-11-26T07:18:27.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.986+0000 7f941754c640 1 -- 172.21.15.77:0/3313047296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0039c0 msgr2=0x7f93fc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.986+0000 7f941754c640 1 --2- 172.21.15.77:0/3313047296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0039c0 0x7f93fc003de0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f940c009ac0 tx=0x7f93fc0057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.986+0000 7f941754c640 1 -- 172.21.15.77:0/3313047296 shutdown_connections 2023-11-26T07:18:27.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.986+0000 7f941754c640 1 --2- 172.21.15.77:0/3313047296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0039c0 0x7f93fc003de0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.986+0000 7f941754c640 1 -- 172.21.15.77:0/3313047296 >> 172.21.15.77:0/3313047296 conn(0x7f941008af60 msgr2=0x7f941009c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:27.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.986+0000 7f941754c640 1 -- 172.21.15.77:0/3313047296 shutdown_connections 2023-11-26T07:18:27.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.986+0000 7f941754c640 1 -- 172.21.15.77:0/3313047296 wait complete. 2023-11-26T07:18:27.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.988+0000 7f941754c640 1 Processor -- start 2023-11-26T07:18:27.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.988+0000 7f941754c640 1 -- start start 2023-11-26T07:18:27.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.989+0000 7f941754c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93fc0039c0 0x7f94101587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.989+0000 7f941754c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9410158260 0x7f941015f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.989+0000 7f941754c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94100cb9d0 0x7f94100cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.989+0000 7f941754c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94100cc390 con 0x7f94100cb9d0 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.989+0000 7f941754c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94100cb770 con 0x7f9410158260 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.989+0000 7f941754c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941015e810 con 0x7f93fc0039c0 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.990+0000 7f9415ae9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94100cb9d0 0x7f94100cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.990+0000 7f9415ae9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94100cb9d0 0x7f94100cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52528/0 (socket says 172.21.15.77:52528) 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.990+0000 7f9415ae9640 1 -- 172.21.15.77:0/493502639 learned_addr learned my addr 172.21.15.77:0/493502639 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.990+0000 7f9415ae9640 1 -- 172.21.15.77:0/493502639 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93fc0039c0 msgr2=0x7f94101587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.990+0000 7f9415ae9640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93fc0039c0 0x7f94101587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.990+0000 7f9415ae9640 1 -- 172.21.15.77:0/493502639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9410158260 msgr2=0x7f941015f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.990+0000 7f9415ae9640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9410158260 0x7f941015f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.990+0000 7f9415ae9640 1 -- 172.21.15.77:0/493502639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941015eaf0 con 0x7f94100cb9d0 2023-11-26T07:18:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.990+0000 7f9415ae9640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94100cb9d0 0x7f94100cbe50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9408001b20 tx=0x7f940800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.991+0000 7f9405ffb640 1 -- 172.21.15.77:0/493502639 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940800ce70 con 0x7f94100cb9d0 2023-11-26T07:18:27.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.991+0000 7f9405ffb640 1 -- 172.21.15.77:0/493502639 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940800a610 con 0x7f94100cb9d0 2023-11-26T07:18:27.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.991+0000 7f9405ffb640 1 -- 172.21.15.77:0/493502639 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940800a9c0 con 0x7f94100cb9d0 2023-11-26T07:18:27.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.991+0000 7f941754c640 1 -- 172.21.15.77:0/493502639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941015edd0 con 0x7f94100cb9d0 2023-11-26T07:18:27.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.991+0000 7f941754c640 1 -- 172.21.15.77:0/493502639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94101600c0 con 0x7f94100cb9d0 2023-11-26T07:18:27.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.992+0000 7f941754c640 1 -- 172.21.15.77:0/493502639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941015f2f0 con 0x7f94100cb9d0 2023-11-26T07:18:27.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.993+0000 7f9405ffb640 1 -- 172.21.15.77:0/493502639 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f940800ab20 con 0x7f94100cb9d0 2023-11-26T07:18:27.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.994+0000 7f9405ffb640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93f406ae70 0x7f93f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.994+0000 7f9405ffb640 1 -- 172.21.15.77:0/493502639 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9408088f50 con 0x7f94100cb9d0 2023-11-26T07:18:27.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.994+0000 7f94152e8640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93f406ae70 0x7f93f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.995+0000 7f94152e8640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93f406ae70 0x7f93f406d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f940c036000 tx=0x7f940c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:27.998+0000 7f9405ffb640 1 -- 172.21.15.77:0/493502639 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f941015f2f0 con 0x7f94100cb9d0 2023-11-26T07:18:28.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.186+0000 7f941754c640 1 -- 172.21.15.77:0/493502639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f941015f2f0 con 0x7f94100cb9d0 2023-11-26T07:18:28.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.187+0000 7f9405ffb640 1 -- 172.21.15.77:0/493502639 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f941015f2f0 con 0x7f94100cb9d0 2023-11-26T07:18:28.189 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:18:28.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 -- 172.21.15.77:0/493502639 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93f406ae70 msgr2=0x7f93f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93f406ae70 0x7f93f406d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f940c036000 tx=0x7f940c02e000 comp rx=0 tx=0).stop 2023-11-26T07:18:28.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 -- 172.21.15.77:0/493502639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94100cb9d0 msgr2=0x7f94100cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94100cb9d0 0x7f94100cbe50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9408001b20 tx=0x7f940800cc20 comp rx=0 tx=0).stop 2023-11-26T07:18:28.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 -- 172.21.15.77:0/493502639 shutdown_connections 2023-11-26T07:18:28.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93f406ae70 0x7f93f406d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94100cb9d0 0x7f94100cbe50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9410158260 0x7f941015f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 --2- 172.21.15.77:0/493502639 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93fc0039c0 0x7f94101587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 -- 172.21.15.77:0/493502639 >> 172.21.15.77:0/493502639 conn(0x7f941008af60 msgr2=0x7f94100b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:28.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 -- 172.21.15.77:0/493502639 shutdown_connections 2023-11-26T07:18:28.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.190+0000 7f941754c640 1 -- 172.21.15.77:0/493502639 wait complete. 2023-11-26T07:18:28.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:28.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.423+0000 7efca214c640 1 Processor -- start 2023-11-26T07:18:28.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.423+0000 7efca214c640 1 -- start start 2023-11-26T07:18:28.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.424+0000 7efca214c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efc9c0cb850 0x7efc9c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.424+0000 7efca214c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc9c0b40d0 0x7efc9c0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.424+0000 7efca214c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c0cc170 con 0x7efc9c0d0a00 2023-11-26T07:18:28.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.424+0000 7efca214c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c070680 con 0x7efc9c0cb850 2023-11-26T07:18:28.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.424+0000 7efca214c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c070870 con 0x7efc9c0b40d0 2023-11-26T07:18:28.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.425+0000 7efc9bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc9c0b40d0 0x7efc9c0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.425+0000 7efc9b7fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efc9c0cb850 0x7efc9c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.425+0000 7efc9affd640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7efc9c0d0a00 0x7efc9c06ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:51258/0 (socket says 172.21.15.77:51258) 2023-11-26T07:18:28.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.425+0000 7efc9affd640 1 -- 172.21.15.77:0/3567902582 learned_addr learned my addr 172.21.15.77:0/3567902582 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:28.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.426+0000 7efc9bfff640 1 -- 172.21.15.77:0/3567902582 >> v2:172.21.15.159:3300/0 conn(0x7efc9c0cb850 msgr2=0x7efc9c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:28.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.426+0000 7efc9bfff640 1 --2- 172.21.15.77:0/3567902582 >> v2:172.21.15.159:3300/0 conn(0x7efc9c0cb850 0x7efc9c0cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.426+0000 7efc9bfff640 1 -- 172.21.15.77:0/3567902582 >> v1:172.21.15.159:6789/0 conn(0x7efc9c0d0a00 legacy=0x7efc9c06ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.426+0000 7efc9bfff640 1 -- 172.21.15.77:0/3567902582 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c070b50 con 0x7efc9c0b40d0 2023-11-26T07:18:28.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.427+0000 7efc9bfff640 1 --2- 172.21.15.77:0/3567902582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc9c0b40d0 0x7efc9c0cf670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efc940097a0 tx=0x7efc9402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd5aa56b5edd471e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.428+0000 7efc9a7fc640 1 -- 172.21.15.77:0/3567902582 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9402e070 con 0x7efc9c0b40d0 2023-11-26T07:18:28.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.428+0000 7efc9a7fc640 1 -- 172.21.15.77:0/3567902582 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc940315a0 con 0x7efc9c0b40d0 2023-11-26T07:18:28.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.428+0000 7efc9a7fc640 1 -- 172.21.15.77:0/3567902582 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94031930 con 0x7efc9c0b40d0 2023-11-26T07:18:28.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.429+0000 7efca214c640 1 -- 172.21.15.77:0/3567902582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc9c0b40d0 msgr2=0x7efc9c0cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.429+0000 7efca214c640 1 --2- 172.21.15.77:0/3567902582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc9c0b40d0 0x7efc9c0cf670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efc940097a0 tx=0x7efc9402b840 comp rx=0 tx=0).stop 2023-11-26T07:18:28.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.429+0000 7efca214c640 1 -- 172.21.15.77:0/3567902582 shutdown_connections 2023-11-26T07:18:28.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.429+0000 7efca214c640 1 --2- 172.21.15.77:0/3567902582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc9c0b40d0 0x7efc9c0cf670 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.429+0000 7efca214c640 1 --2- 172.21.15.77:0/3567902582 >> v2:172.21.15.159:3300/0 conn(0x7efc9c0cb850 0x7efc9c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.429+0000 7efca214c640 1 -- 172.21.15.77:0/3567902582 >> 172.21.15.77:0/3567902582 conn(0x7efc9c06e7d0 msgr2=0x7efc9c06ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:28.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.429+0000 7efca214c640 1 -- 172.21.15.77:0/3567902582 shutdown_connections 2023-11-26T07:18:28.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.429+0000 7efca214c640 1 -- 172.21.15.77:0/3567902582 wait complete. 2023-11-26T07:18:28.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.431+0000 7efca214c640 1 Processor -- start 2023-11-26T07:18:28.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.431+0000 7efca214c640 1 -- start start 2023-11-26T07:18:28.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efca214c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc9c0b40d0 0x7efc9c1f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efca214c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc9c0cb850 0x7efc9c15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efca214c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc9c0d0a00 0x7efc9c0c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efca214c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0ac980 con 0x7efc9c0cb850 2023-11-26T07:18:28.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efca214c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0c82d0 con 0x7efc9c0d0a00 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efca214c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c1f3fd0 con 0x7efc9c0b40d0 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efc9affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc9c0cb850 0x7efc9c15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efc9affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc9c0cb850 0x7efc9c15a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52536/0 (socket says 172.21.15.77:52536) 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efc9affd640 1 -- 172.21.15.77:0/1500062706 learned_addr learned my addr 172.21.15.77:0/1500062706 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efc9bfff640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc9c0d0a00 0x7efc9c0c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efc9b7fe640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc9c0b40d0 0x7efc9c1f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efc9affd640 1 -- 172.21.15.77:0/1500062706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc9c0b40d0 msgr2=0x7efc9c1f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efc9affd640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc9c0b40d0 0x7efc9c1f4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efc9affd640 1 -- 172.21.15.77:0/1500062706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc9c0d0a00 msgr2=0x7efc9c0c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efc9affd640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc9c0d0a00 0x7efc9c0c4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.432+0000 7efc9affd640 1 -- 172.21.15.77:0/1500062706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94009400 con 0x7efc9c0cb850 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.433+0000 7efc9affd640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc9c0cb850 0x7efc9c15a730 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efc9000c3c0 tx=0x7efc9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.433+0000 7efc83fff640 1 -- 172.21.15.77:0/1500062706 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90005ce0 con 0x7efc9c0cb850 2023-11-26T07:18:28.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.433+0000 7efc83fff640 1 -- 172.21.15.77:0/1500062706 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc90005e40 con 0x7efc9c0cb850 2023-11-26T07:18:28.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.433+0000 7efc83fff640 1 -- 172.21.15.77:0/1500062706 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc900072d0 con 0x7efc9c0cb850 2023-11-26T07:18:28.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.433+0000 7efca214c640 1 -- 172.21.15.77:0/1500062706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c0c8520 con 0x7efc9c0cb850 2023-11-26T07:18:28.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.433+0000 7efca214c640 1 -- 172.21.15.77:0/1500062706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c0c8ae0 con 0x7efc9c0cb850 2023-11-26T07:18:28.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.434+0000 7efca214c640 1 -- 172.21.15.77:0/1500062706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c0c4b70 con 0x7efc9c0cb850 2023-11-26T07:18:28.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.435+0000 7efc83fff640 1 -- 172.21.15.77:0/1500062706 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc900074f0 con 0x7efc9c0cb850 2023-11-26T07:18:28.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.436+0000 7efc83fff640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc8806ae40 0x7efc8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.436+0000 7efc83fff640 1 -- 172.21.15.77:0/1500062706 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7efc90088aa0 con 0x7efc9c0cb850 2023-11-26T07:18:28.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.436+0000 7efc9b7fe640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc8806ae40 0x7efc8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.437+0000 7efc9b7fe640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc8806ae40 0x7efc8806d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009fd0 tx=0x7efc8c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.441+0000 7efc83fff640 1 -- 172.21.15.77:0/1500062706 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc90053b80 con 0x7efc9c0cb850 2023-11-26T07:18:28.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.631+0000 7efca214c640 1 -- 172.21.15.77:0/1500062706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc9c0c8cd0 con 0x7efc9c0cb850 2023-11-26T07:18:28.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.632+0000 7efc83fff640 1 -- 172.21.15.77:0/1500062706 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc900170a0 con 0x7efc9c0cb850 2023-11-26T07:18:28.633 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:18:28.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 -- 172.21.15.77:0/1500062706 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc8806ae40 msgr2=0x7efc8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc8806ae40 0x7efc8806d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009fd0 tx=0x7efc8c00b040 comp rx=0 tx=0).stop 2023-11-26T07:18:28.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 -- 172.21.15.77:0/1500062706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc9c0cb850 msgr2=0x7efc9c15a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc9c0cb850 0x7efc9c15a730 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efc9000c3c0 tx=0x7efc9000c880 comp rx=0 tx=0).stop 2023-11-26T07:18:28.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 -- 172.21.15.77:0/1500062706 shutdown_connections 2023-11-26T07:18:28.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc8806ae40 0x7efc8806d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc9c0d0a00 0x7efc9c0c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc9c0cb850 0x7efc9c15a730 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 --2- 172.21.15.77:0/1500062706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc9c0b40d0 0x7efc9c1f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 -- 172.21.15.77:0/1500062706 >> 172.21.15.77:0/1500062706 conn(0x7efc9c06e7d0 msgr2=0x7efc9c06cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:28.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 -- 172.21.15.77:0/1500062706 shutdown_connections 2023-11-26T07:18:28.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.634+0000 7efca214c640 1 -- 172.21.15.77:0/1500062706 wait complete. 2023-11-26T07:18:28.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:28.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.865+0000 7f2902f1a640 1 Processor -- start 2023-11-26T07:18:28.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.865+0000 7f2902f1a640 1 -- start start 2023-11-26T07:18:28.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.867+0000 7f2902f1a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28fc15b260 0x7f28fc06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.867+0000 7f2902f1a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f28fc06e580 0x7f28fc0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.867+0000 7f2902f1a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28fc06d5c0 con 0x7f28fc0b1080 2023-11-26T07:18:28.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.867+0000 7f2902f1a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc15b640 con 0x7f28fc15b260 2023-11-26T07:18:28.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.867+0000 7f2902f1a640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0b14d0 con 0x7f28fc06e580 2023-11-26T07:18:28.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.867+0000 7f2901f18640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28fc15b260 0x7f28fc06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.867+0000 7f2901f18640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28fc15b260 0x7f28fc06e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52552/0 (socket says 172.21.15.77:52552) 2023-11-26T07:18:28.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.867+0000 7f2901f18640 1 -- 172.21.15.77:0/1960467338 learned_addr learned my addr 172.21.15.77:0/1960467338 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:28.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.867+0000 7f2901717640 1 --2- 172.21.15.77:0/1960467338 >> v2:172.21.15.159:3300/0 conn(0x7f28fc06e580 0x7f28fc0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.868+0000 7f2901f18640 1 -- 172.21.15.77:0/1960467338 >> v2:172.21.15.159:3300/0 conn(0x7f28fc06e580 msgr2=0x7f28fc0b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:28.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.868+0000 7f2901f18640 1 --2- 172.21.15.77:0/1960467338 >> v2:172.21.15.159:3300/0 conn(0x7f28fc06e580 0x7f28fc0b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.868+0000 7f2901f18640 1 -- 172.21.15.77:0/1960467338 >> v1:172.21.15.77:6789/0 conn(0x7f28fc0b1080 legacy=0x7f28fc0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.868+0000 7f2901f18640 1 -- 172.21.15.77:0/1960467338 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc15ed20 con 0x7f28fc15b260 2023-11-26T07:18:28.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.869+0000 7f2901f18640 1 --2- 172.21.15.77:0/1960467338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15b260 0x7f28fc06e040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0ce370 tx=0x7f28f802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d6b9a1090f5f7d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.870+0000 7f2900f16640 1 -- 172.21.15.77:0/1960467338 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80317e0 con 0x7f28fc15b260 2023-11-26T07:18:28.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.870+0000 7f2900f16640 1 -- 172.21.15.77:0/1960467338 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8031940 con 0x7f28fc15b260 2023-11-26T07:18:28.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.870+0000 7f2900f16640 1 -- 172.21.15.77:0/1960467338 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8031cd0 con 0x7f28fc15b260 2023-11-26T07:18:28.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.870+0000 7f2902f1a640 1 -- 172.21.15.77:0/1960467338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15b260 msgr2=0x7f28fc06e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.870+0000 7f2902f1a640 1 --2- 172.21.15.77:0/1960467338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15b260 0x7f28fc06e040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0ce370 tx=0x7f28f802b880 comp rx=0 tx=0).stop 2023-11-26T07:18:28.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.871+0000 7f2902f1a640 1 -- 172.21.15.77:0/1960467338 shutdown_connections 2023-11-26T07:18:28.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.871+0000 7f2902f1a640 1 --2- 172.21.15.77:0/1960467338 >> v2:172.21.15.159:3300/0 conn(0x7f28fc06e580 0x7f28fc0b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.871+0000 7f2902f1a640 1 --2- 172.21.15.77:0/1960467338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15b260 0x7f28fc06e040 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.871+0000 7f2902f1a640 1 -- 172.21.15.77:0/1960467338 >> 172.21.15.77:0/1960467338 conn(0x7f28fc0cbb40 msgr2=0x7f28fc0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:28.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.871+0000 7f2902f1a640 1 -- 172.21.15.77:0/1960467338 shutdown_connections 2023-11-26T07:18:28.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.871+0000 7f2902f1a640 1 -- 172.21.15.77:0/1960467338 wait complete. 2023-11-26T07:18:28.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.872+0000 7f2902f1a640 1 Processor -- start 2023-11-26T07:18:28.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.873+0000 7f2902f1a640 1 -- start start 2023-11-26T07:18:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.873+0000 7f2902f1a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28fc06e580 0x7f28fc15c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.873+0000 7f2902f1a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28fc0b1080 0x7f28fc14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.873+0000 7f2902f1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15b260 0x7f28fc147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.873+0000 7f2902f1a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc148860 con 0x7f28fc15b260 2023-11-26T07:18:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.873+0000 7f2902f1a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc14b710 con 0x7f28fc06e580 2023-11-26T07:18:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.873+0000 7f2902f1a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc15d840 con 0x7f28fc0b1080 2023-11-26T07:18:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.874+0000 7f2902719640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15b260 0x7f28fc147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.874+0000 7f2902719640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15b260 0x7f28fc147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52566/0 (socket says 172.21.15.77:52566) 2023-11-26T07:18:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.874+0000 7f2902719640 1 -- 172.21.15.77:0/2252060044 learned_addr learned my addr 172.21.15.77:0/2252060044 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.874+0000 7f2902719640 1 -- 172.21.15.77:0/2252060044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28fc0b1080 msgr2=0x7f28fc14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.874+0000 7f2902719640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28fc0b1080 0x7f28fc14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.874+0000 7f2902719640 1 -- 172.21.15.77:0/2252060044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28fc06e580 msgr2=0x7f28fc15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.874+0000 7f2901f18640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28fc06e580 0x7f28fc15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.874+0000 7f2902719640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28fc06e580 0x7f28fc15c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.874+0000 7f2902719640 1 -- 172.21.15.77:0/2252060044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80094d0 con 0x7f28fc15b260 2023-11-26T07:18:28.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.875+0000 7f2902719640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15b260 0x7f28fc147c00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f28f400c6b0 tx=0x7f28f400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.875+0000 7f28f27fc640 1 -- 172.21.15.77:0/2252060044 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4003b70 con 0x7f28fc15b260 2023-11-26T07:18:28.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.875+0000 7f28f27fc640 1 -- 172.21.15.77:0/2252060044 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f4003cf0 con 0x7f28fc15b260 2023-11-26T07:18:28.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.875+0000 7f28f27fc640 1 -- 172.21.15.77:0/2252060044 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4003ea0 con 0x7f28fc15b260 2023-11-26T07:18:28.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.875+0000 7f2902f1a640 1 -- 172.21.15.77:0/2252060044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc15cfa0 con 0x7f28fc15b260 2023-11-26T07:18:28.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.875+0000 7f2902f1a640 1 -- 172.21.15.77:0/2252060044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc15d560 con 0x7f28fc15b260 2023-11-26T07:18:28.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.876+0000 7f2902f1a640 1 -- 172.21.15.77:0/2252060044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc1489a0 con 0x7f28fc15b260 2023-11-26T07:18:28.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.877+0000 7f28f27fc640 1 -- 172.21.15.77:0/2252060044 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28f4005310 con 0x7f28fc15b260 2023-11-26T07:18:28.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.878+0000 7f28f27fc640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f28e006ae40 0x7f28e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.878+0000 7f28f27fc640 1 -- 172.21.15.77:0/2252060044 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f28f4089450 con 0x7f28fc15b260 2023-11-26T07:18:28.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.878+0000 7f2901f18640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f28e006ae40 0x7f28e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.879+0000 7f2901f18640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f28e006ae40 0x7f28e006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f28f8036000 tx=0x7f28f803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:28.882+0000 7f28f27fc640 1 -- 172.21.15.77:0/2252060044 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28fc1489a0 con 0x7f28fc15b260 2023-11-26T07:18:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.066+0000 7f2902f1a640 1 -- 172.21.15.77:0/2252060044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28fc1489a0 con 0x7f28fc15b260 2023-11-26T07:18:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.067+0000 7f28f27fc640 1 -- 172.21.15.77:0/2252060044 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28fc1489a0 con 0x7f28fc15b260 2023-11-26T07:18:29.068 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:18:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.069+0000 7f2902f1a640 1 -- 172.21.15.77:0/2252060044 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f28e006ae40 msgr2=0x7f28e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.069+0000 7f2902f1a640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f28e006ae40 0x7f28e006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f28f8036000 tx=0x7f28f803d040 comp rx=0 tx=0).stop 2023-11-26T07:18:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.069+0000 7f2902f1a640 1 -- 172.21.15.77:0/2252060044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15b260 msgr2=0x7f28fc147c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.069+0000 7f2902f1a640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15b260 0x7f28fc147c00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f28f400c6b0 tx=0x7f28f400cb70 comp rx=0 tx=0).stop 2023-11-26T07:18:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.069+0000 7f2902f1a640 1 -- 172.21.15.77:0/2252060044 shutdown_connections 2023-11-26T07:18:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.069+0000 7f2902f1a640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f28e006ae40 0x7f28e006d300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.069+0000 7f2902f1a640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15b260 0x7f28fc147c00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.069+0000 7f2902f1a640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28fc0b1080 0x7f28fc14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.069+0000 7f2902f1a640 1 --2- 172.21.15.77:0/2252060044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28fc06e580 0x7f28fc15c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.069+0000 7f2902f1a640 1 -- 172.21.15.77:0/2252060044 >> 172.21.15.77:0/2252060044 conn(0x7f28fc0cbb40 msgr2=0x7f28fc0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.070+0000 7f2902f1a640 1 -- 172.21.15.77:0/2252060044 shutdown_connections 2023-11-26T07:18:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.070+0000 7f2902f1a640 1 -- 172.21.15.77:0/2252060044 wait complete. 2023-11-26T07:18:29.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:29.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.298+0000 7f9244904640 1 Processor -- start 2023-11-26T07:18:29.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.298+0000 7f9244904640 1 -- start start 2023-11-26T07:18:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.300+0000 7f9244904640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f92400d1e20 0x7f92400cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.300+0000 7f9244904640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92400d0070 0x7f92400b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.300+0000 7f9244904640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92400d04b0 con 0x7f924015d4e0 2023-11-26T07:18:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.300+0000 7f9244904640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92400d4110 con 0x7f92400d1e20 2023-11-26T07:18:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.300+0000 7f9244904640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92400ce990 con 0x7f92400d0070 2023-11-26T07:18:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.300+0000 7f9237fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f92400d1e20 0x7f92400cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.300+0000 7f9237fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f92400d1e20 0x7f92400cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52572/0 (socket says 172.21.15.77:52572) 2023-11-26T07:18:29.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.300+0000 7f9237fff640 1 -- 172.21.15.77:0/1349015098 learned_addr learned my addr 172.21.15.77:0/1349015098 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:29.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.301+0000 7f9237fff640 1 -- 172.21.15.77:0/1349015098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92400d0070 msgr2=0x7f92400b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:29.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.301+0000 7f9237fff640 1 --2- 172.21.15.77:0/1349015098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92400d0070 0x7f92400b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.301+0000 7f9237fff640 1 -- 172.21.15.77:0/1349015098 >> v1:172.21.15.77:6789/0 conn(0x7f924015d4e0 legacy=0x7f92400d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.301+0000 7f9237fff640 1 -- 172.21.15.77:0/1349015098 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92400cec70 con 0x7f92400d1e20 2023-11-26T07:18:29.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.302+0000 7f9237fff640 1 --2- 172.21.15.77:0/1349015098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92400d1e20 0x7f92400cfb30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9228009870 tx=0x7f922802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69dc58ecdb34b057 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.302+0000 7f923e59c640 1 -- 172.21.15.77:0/1349015098 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228030840 con 0x7f92400d1e20 2023-11-26T07:18:29.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.302+0000 7f923e59c640 1 -- 172.21.15.77:0/1349015098 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92280309a0 con 0x7f92400d1e20 2023-11-26T07:18:29.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.302+0000 7f923e59c640 1 -- 172.21.15.77:0/1349015098 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228030d30 con 0x7f92400d1e20 2023-11-26T07:18:29.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.303+0000 7f9244904640 1 -- 172.21.15.77:0/1349015098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92400d1e20 msgr2=0x7f92400cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.303+0000 7f9244904640 1 --2- 172.21.15.77:0/1349015098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92400d1e20 0x7f92400cfb30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9228009870 tx=0x7f922802b980 comp rx=0 tx=0).stop 2023-11-26T07:18:29.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.303+0000 7f9244904640 1 -- 172.21.15.77:0/1349015098 shutdown_connections 2023-11-26T07:18:29.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.303+0000 7f9244904640 1 --2- 172.21.15.77:0/1349015098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92400d0070 0x7f92400b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.303+0000 7f9244904640 1 --2- 172.21.15.77:0/1349015098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92400d1e20 0x7f92400cfb30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.303+0000 7f9244904640 1 -- 172.21.15.77:0/1349015098 >> 172.21.15.77:0/1349015098 conn(0x7f924009c510 msgr2=0x7f92400d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:29.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.303+0000 7f9244904640 1 -- 172.21.15.77:0/1349015098 shutdown_connections 2023-11-26T07:18:29.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.303+0000 7f9244904640 1 -- 172.21.15.77:0/1349015098 wait complete. 2023-11-26T07:18:29.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.305+0000 7f9244904640 1 Processor -- start 2023-11-26T07:18:29.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.305+0000 7f9244904640 1 -- start start 2023-11-26T07:18:29.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f9244904640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92400d0070 0x7f92401f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f9244904640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92400d1e20 0x7f92400c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f9244904640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f924015d4e0 0x7f92400c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f9244904640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400b5df0 con 0x7f924015d4e0 2023-11-26T07:18:29.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f9244904640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400b6040 con 0x7f92400d0070 2023-11-26T07:18:29.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f9244904640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92400b6320 con 0x7f92400d1e20 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f923f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f924015d4e0 0x7f92400c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f923f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f924015d4e0 0x7f92400c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52586/0 (socket says 172.21.15.77:52586) 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f923f59e640 1 -- 172.21.15.77:0/4278276443 learned_addr learned my addr 172.21.15.77:0/4278276443 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f923f59e640 1 -- 172.21.15.77:0/4278276443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92400d1e20 msgr2=0x7f92400c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f923f59e640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92400d1e20 0x7f92400c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f923f59e640 1 -- 172.21.15.77:0/4278276443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92400d0070 msgr2=0x7f92401f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f923ed9d640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92400d0070 0x7f92401f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f923f59e640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92400d0070 0x7f92401f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f923f59e640 1 -- 172.21.15.77:0/4278276443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92280094d0 con 0x7f924015d4e0 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.306+0000 7f923ed9d640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92400d0070 0x7f92401f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.307+0000 7f923f59e640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f924015d4e0 0x7f92400c82c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f923800b970 tx=0x7f923800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.307+0000 7f92377fe640 1 -- 172.21.15.77:0/4278276443 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923800cb40 con 0x7f924015d4e0 2023-11-26T07:18:29.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.307+0000 7f92377fe640 1 -- 172.21.15.77:0/4278276443 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923800ccc0 con 0x7f924015d4e0 2023-11-26T07:18:29.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.307+0000 7f92377fe640 1 -- 172.21.15.77:0/4278276443 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238014680 con 0x7f924015d4e0 2023-11-26T07:18:29.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.307+0000 7f9244904640 1 -- 172.21.15.77:0/4278276443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92400b6600 con 0x7f924015d4e0 2023-11-26T07:18:29.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.307+0000 7f9244904640 1 -- 172.21.15.77:0/4278276443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92400b6bc0 con 0x7f924015d4e0 2023-11-26T07:18:29.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.308+0000 7f9244904640 1 -- 172.21.15.77:0/4278276443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92400b6db0 con 0x7f924015d4e0 2023-11-26T07:18:29.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.309+0000 7f92377fe640 1 -- 172.21.15.77:0/4278276443 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f923801d3b0 con 0x7f924015d4e0 2023-11-26T07:18:29.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.310+0000 7f92377fe640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f922006ae40 0x7f922006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.310+0000 7f92377fe640 1 -- 172.21.15.77:0/4278276443 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9238089700 con 0x7f924015d4e0 2023-11-26T07:18:29.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.310+0000 7f923ed9d640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f922006ae40 0x7f922006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.311+0000 7f923ed9d640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f922006ae40 0x7f922006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9230000f60 tx=0x7f9230009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.314+0000 7f92377fe640 1 -- 172.21.15.77:0/4278276443 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9238058120 con 0x7f924015d4e0 2023-11-26T07:18:29.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.527+0000 7f9244904640 1 -- 172.21.15.77:0/4278276443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f924004e840 con 0x7f924015d4e0 2023-11-26T07:18:29.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.528+0000 7f92377fe640 1 -- 172.21.15.77:0/4278276443 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f9238057cb0 con 0x7f924015d4e0 2023-11-26T07:18:29.530 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2517793456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2517793456},{"type":"v1","addr":"172.21.15.77:6835","nonce":2517793456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/169772143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":169772143},{"type":"v1","addr":"172.21.15.77:6837","nonce":169772143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3797973649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3797973649},{"type":"v1","addr":"172.21.15.159:6834","nonce":3797973649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:17:34.699805+0000","modified":"2023-11-26T07:17:37.771915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/2168278307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2168278307},{"type":"v1","addr":"172.21.15.159:6835","nonce":2168278307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:29.530 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-11-26T07:18:29.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.530+0000 7f9244904640 1 -- 172.21.15.77:0/4278276443 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f922006ae40 msgr2=0x7f922006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.530+0000 7f9244904640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f922006ae40 0x7f922006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9230000f60 tx=0x7f9230009040 comp rx=0 tx=0).stop 2023-11-26T07:18:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.531+0000 7f9244904640 1 -- 172.21.15.77:0/4278276443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f924015d4e0 msgr2=0x7f92400c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.531+0000 7f9244904640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f924015d4e0 0x7f92400c82c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f923800b970 tx=0x7f923800be30 comp rx=0 tx=0).stop 2023-11-26T07:18:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.531+0000 7f9244904640 1 -- 172.21.15.77:0/4278276443 shutdown_connections 2023-11-26T07:18:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.531+0000 7f9244904640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f922006ae40 0x7f922006d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.531+0000 7f9244904640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f924015d4e0 0x7f92400c82c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.531+0000 7f9244904640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92400d1e20 0x7f92400c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.531+0000 7f9244904640 1 --2- 172.21.15.77:0/4278276443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92400d0070 0x7f92401f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.531+0000 7f9244904640 1 -- 172.21.15.77:0/4278276443 >> 172.21.15.77:0/4278276443 conn(0x7f924009c510 msgr2=0x7f92400d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.531+0000 7f9244904640 1 -- 172.21.15.77:0/4278276443 shutdown_connections 2023-11-26T07:18:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.531+0000 7f9244904640 1 -- 172.21.15.77:0/4278276443 wait complete. 2023-11-26T07:18:29.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:29.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.759+0000 7f7edc231640 1 Processor -- start 2023-11-26T07:18:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.759+0000 7f7edc231640 1 -- start start 2023-11-26T07:18:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.760+0000 7f7edc231640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed4157c70 0x7f7ed4161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.760+0000 7f7edc231640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7ed40cf450 0x7f7ed40cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.760+0000 7f7edc231640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed40ce0b0 con 0x7f7ed415dc80 2023-11-26T07:18:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.760+0000 7f7edc231640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed40cfe10 con 0x7f7ed40cf450 2023-11-26T07:18:29.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.760+0000 7f7edc231640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed4161960 con 0x7f7ed4157c70 2023-11-26T07:18:29.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.761+0000 7f7eda7ce640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7ed415dc80 0x7f7ed415e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57942/0 (socket says 172.21.15.77:57942) 2023-11-26T07:18:29.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.761+0000 7f7eda7ce640 1 -- 172.21.15.77:0/4146102609 learned_addr learned my addr 172.21.15.77:0/4146102609 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:29.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.761+0000 7f7ed97cc640 1 --2- 172.21.15.77:0/4146102609 >> v2:172.21.15.159:3300/0 conn(0x7f7ed40cf450 0x7f7ed40cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.761+0000 7f7ed9fcd640 1 --2- 172.21.15.77:0/4146102609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed4157c70 0x7f7ed4161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.761+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018651686 0 0) 0x7f7ed40ce0b0 con 0x7f7ed415dc80 2023-11-26T07:18:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.761+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec0003520 con 0x7f7ed415dc80 2023-11-26T07:18:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1722616077 0 0) 0x7f7ec0003520 con 0x7f7ed415dc80 2023-11-26T07:18:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed4157c70 msgr2=0x7f7ed4161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 --2- 172.21.15.77:0/4146102609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed4157c70 0x7f7ed4161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 >> v2:172.21.15.159:3300/0 conn(0x7f7ed40cf450 msgr2=0x7f7ed40cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 --2- 172.21.15.77:0/4146102609 >> v2:172.21.15.159:3300/0 conn(0x7f7ed40cf450 0x7f7ed40cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed415e8d0 con 0x7f7ed415dc80 2023-11-26T07:18:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f7ecc0019f0 con 0x7f7ed415dc80 2023-11-26T07:18:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 >> v1:172.21.15.77:6789/0 conn(0x7f7ed415dc80 legacy=0x7f7ed415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 --2- 172.21.15.77:0/4146102609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec0003970 0x7f7ec0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 --2- 172.21.15.77:0/4146102609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec00047c0 0x7f7ec0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 --2- 172.21.15.77:0/4146102609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed4157c70 0x7f7ec0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40cfe10 con 0x7f7ec0003970 2023-11-26T07:18:29.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed4161960 con 0x7f7ec00047c0 2023-11-26T07:18:29.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec000b980 con 0x7f7ed4157c70 2023-11-26T07:18:29.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.762+0000 7f7ed9fcd640 1 --2- 172.21.15.77:0/4146102609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec0003970 0x7f7ec0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.763+0000 7f7ed9fcd640 1 -- 172.21.15.77:0/4146102609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed4157c70 msgr2=0x7f7ec0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:29.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.763+0000 7f7ed9fcd640 1 --2- 172.21.15.77:0/4146102609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed4157c70 0x7f7ec0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.763+0000 7f7ed9fcd640 1 -- 172.21.15.77:0/4146102609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec00047c0 msgr2=0x7f7ec0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:29.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.763+0000 7f7ed9fcd640 1 --2- 172.21.15.77:0/4146102609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec00047c0 0x7f7ec0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.763+0000 7f7ed9fcd640 1 -- 172.21.15.77:0/4146102609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0003520 con 0x7f7ec0003970 2023-11-26T07:18:29.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.764+0000 7f7ed9fcd640 1 --2- 172.21.15.77:0/4146102609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec0003970 0x7f7ec0003d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009af0 tx=0x7f7ec00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39773a641f590ccc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.764+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed002c710 con 0x7f7ec0003970 2023-11-26T07:18:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.764+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed002c870 con 0x7f7ec0003970 2023-11-26T07:18:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.764+0000 7f7ed8fcb640 1 -- 172.21.15.77:0/4146102609 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed002cc00 con 0x7f7ec0003970 2023-11-26T07:18:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.764+0000 7f7edc231640 1 -- 172.21.15.77:0/4146102609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec0003970 msgr2=0x7f7ec0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.764+0000 7f7edc231640 1 --2- 172.21.15.77:0/4146102609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec0003970 0x7f7ec0003d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009af0 tx=0x7f7ec00057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.764+0000 7f7eda7ce640 1 -- 172.21.15.77:0/4146102609 reap_dead start 2023-11-26T07:18:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.764+0000 7f7edc231640 1 -- 172.21.15.77:0/4146102609 shutdown_connections 2023-11-26T07:18:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.764+0000 7f7edc231640 1 -- 172.21.15.77:0/4146102609 >> 172.21.15.77:0/4146102609 conn(0x7f7ed406a920 msgr2=0x7f7ed406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.764+0000 7f7edc231640 1 -- 172.21.15.77:0/4146102609 shutdown_connections 2023-11-26T07:18:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.764+0000 7f7edc231640 1 -- 172.21.15.77:0/4146102609 wait complete. 2023-11-26T07:18:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.766+0000 7f7edc231640 1 Processor -- start 2023-11-26T07:18:29.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.766+0000 7f7edc231640 1 -- start start 2023-11-26T07:18:29.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.767+0000 7f7edc231640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec0003970 0x7f7ed41f7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.767+0000 7f7edc231640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed409aad0 0x7f7ed409af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.767+0000 7f7edc231640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed4099140 0x7f7ed40995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.767+0000 7f7edc231640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed409b490 con 0x7f7ed409aad0 2023-11-26T07:18:29.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.767+0000 7f7edc231640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed41f7540 con 0x7f7ec0003970 2023-11-26T07:18:29.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.767+0000 7f7edc231640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40cb930 con 0x7f7ed4099140 2023-11-26T07:18:29.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.767+0000 7f7ed97cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed409aad0 0x7f7ed409af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.767+0000 7f7ed97cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed409aad0 0x7f7ed409af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52608/0 (socket says 172.21.15.77:52608) 2023-11-26T07:18:29.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.767+0000 7f7ed97cc640 1 -- 172.21.15.77:0/988480075 learned_addr learned my addr 172.21.15.77:0/988480075 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:29.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.768+0000 7f7ed97cc640 1 -- 172.21.15.77:0/988480075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed4099140 msgr2=0x7f7ed40995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.768+0000 7f7ed97cc640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed4099140 0x7f7ed40995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.768+0000 7f7ed97cc640 1 -- 172.21.15.77:0/988480075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec0003970 msgr2=0x7f7ed41f7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.768+0000 7f7ed97cc640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec0003970 0x7f7ed41f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.768+0000 7f7ed97cc640 1 -- 172.21.15.77:0/988480075 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed40cbc10 con 0x7f7ed409aad0 2023-11-26T07:18:29.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.768+0000 7f7ed97cc640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed409aad0 0x7f7ed409af50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800e860 tx=0x7f7ec800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.768+0000 7f7ec67fc640 1 -- 172.21.15.77:0/988480075 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8009600 con 0x7f7ed409aad0 2023-11-26T07:18:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.768+0000 7f7ec67fc640 1 -- 172.21.15.77:0/988480075 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec800c940 con 0x7f7ed409aad0 2023-11-26T07:18:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.768+0000 7f7ec67fc640 1 -- 172.21.15.77:0/988480075 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800ccd0 con 0x7f7ed409aad0 2023-11-26T07:18:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.768+0000 7f7edc231640 1 -- 172.21.15.77:0/988480075 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed40cbef0 con 0x7f7ed409aad0 2023-11-26T07:18:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.769+0000 7f7edc231640 1 -- 172.21.15.77:0/988480075 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed414a7a0 con 0x7f7ed409aad0 2023-11-26T07:18:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.770+0000 7f7edc231640 1 -- 172.21.15.77:0/988480075 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed4067470 con 0x7f7ed409aad0 2023-11-26T07:18:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.771+0000 7f7ec67fc640 1 -- 172.21.15.77:0/988480075 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ec8013470 con 0x7f7ed409aad0 2023-11-26T07:18:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.772+0000 7f7ec67fc640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 0x7f7eb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.772+0000 7f7ec67fc640 1 -- 172.21.15.77:0/988480075 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7ec80898a0 con 0x7f7ed409aad0 2023-11-26T07:18:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.772+0000 7f7ed9fcd640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 0x7f7eb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.773+0000 7f7ed9fcd640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 0x7f7eb806d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0036000 tx=0x7f7ed002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.776+0000 7f7ec67fc640 1 -- 172.21.15.77:0/988480075 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ec8054830 con 0x7f7ed409aad0 2023-11-26T07:18:29.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.965+0000 7f7edc231640 1 -- 172.21.15.77:0/988480075 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ed415d6c0 con 0x7f7ed409aad0 2023-11-26T07:18:29.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.967+0000 7f7ec67fc640 1 -- 172.21.15.77:0/988480075 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16729 (secure 0 0 0) 0x7f7ec8057e50 con 0x7f7ed409aad0 2023-11-26T07:18:29.969 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:29.969 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:18:16.826725+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:29.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.969+0000 7f7edc231640 1 -- 172.21.15.77:0/988480075 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 msgr2=0x7f7eb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.969+0000 7f7edc231640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 0x7f7eb806d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0036000 tx=0x7f7ed002e000 comp rx=0 tx=0).stop 2023-11-26T07:18:29.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.969+0000 7f7edc231640 1 -- 172.21.15.77:0/988480075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed409aad0 msgr2=0x7f7ed409af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.969+0000 7f7edc231640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed409aad0 0x7f7ed409af50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800e860 tx=0x7f7ec800ed20 comp rx=0 tx=0).stop 2023-11-26T07:18:29.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.969+0000 7f7edc231640 1 -- 172.21.15.77:0/988480075 shutdown_connections 2023-11-26T07:18:29.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.969+0000 7f7edc231640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 0x7f7eb806d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.969+0000 7f7edc231640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed4099140 0x7f7ed40995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.969+0000 7f7edc231640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed409aad0 0x7f7ed409af50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.969+0000 7f7edc231640 1 --2- 172.21.15.77:0/988480075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec0003970 0x7f7ed41f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.969+0000 7f7edc231640 1 -- 172.21.15.77:0/988480075 >> 172.21.15.77:0/988480075 conn(0x7f7ed406a920 msgr2=0x7f7ed415edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:29.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.970+0000 7f7edc231640 1 -- 172.21.15.77:0/988480075 shutdown_connections 2023-11-26T07:18:29.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:29.970+0000 7f7edc231640 1 -- 172.21.15.77:0/988480075 wait complete. 2023-11-26T07:18:29.989 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:18:29.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.196+0000 7fbca22c9640 1 Processor -- start 2023-11-26T07:18:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.196+0000 7fbca22c9640 1 -- start start 2023-11-26T07:18:30.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.198+0000 7fbca22c9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbc9c0b2250 0x7fbc9c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.198+0000 7fbca22c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc9c0b2630 0x7fbc9c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.198+0000 7fbca22c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbc9c0cd470 0x7fbc9c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.198+0000 7fbca22c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c15a990 con 0x7fbc9c0cd470 2023-11-26T07:18:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.198+0000 7fbca22c9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c15ab80 con 0x7fbc9c0b2250 2023-11-26T07:18:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.198+0000 7fbca22c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c15e680 con 0x7fbc9c0b2630 2023-11-26T07:18:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.198+0000 7fbca0866640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbc9c0cd470 0x7fbc9c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.198+0000 7fbca0866640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbc9c0cd470 0x7fbc9c15b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52614/0 (socket says 172.21.15.77:52614) 2023-11-26T07:18:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.198+0000 7fbca0866640 1 -- 172.21.15.77:0/3978740487 learned_addr learned my addr 172.21.15.77:0/3978740487 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:30.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.199+0000 7fbc9bfff640 1 --2- 172.21.15.77:0/3978740487 >> v2:172.21.15.159:3300/0 conn(0x7fbc9c0b2250 0x7fbc9c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.199+0000 7fbc93fff640 1 --2- 172.21.15.77:0/3978740487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc9c0b2630 0x7fbc9c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.199+0000 7fbca0866640 1 -- 172.21.15.77:0/3978740487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc9c0b2630 msgr2=0x7fbc9c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.199+0000 7fbca0866640 1 --2- 172.21.15.77:0/3978740487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc9c0b2630 0x7fbc9c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.199+0000 7fbca0866640 1 -- 172.21.15.77:0/3978740487 >> v2:172.21.15.159:3300/0 conn(0x7fbc9c0b2250 msgr2=0x7fbc9c15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.199+0000 7fbca0866640 1 --2- 172.21.15.77:0/3978740487 >> v2:172.21.15.159:3300/0 conn(0x7fbc9c0b2250 0x7fbc9c15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.199+0000 7fbca0866640 1 -- 172.21.15.77:0/3978740487 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c15e960 con 0x7fbc9c0cd470 2023-11-26T07:18:30.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.199+0000 7fbc9bfff640 1 --2- 172.21.15.77:0/3978740487 >> v2:172.21.15.159:3300/0 conn(0x7fbc9c0b2250 0x7fbc9c15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:30.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.199+0000 7fbc93fff640 1 --2- 172.21.15.77:0/3978740487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc9c0b2630 0x7fbc9c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:30.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.200+0000 7fbca0866640 1 --2- 172.21.15.77:0/3978740487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc9c0cd470 0x7fbc9c15b080 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c072a70 tx=0x7fbc9402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f888f09deaedc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.200+0000 7fbc9b7fe640 1 -- 172.21.15.77:0/3978740487 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9402ec80 con 0x7fbc9c0cd470 2023-11-26T07:18:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.200+0000 7fbc9b7fe640 1 -- 172.21.15.77:0/3978740487 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9402ede0 con 0x7fbc9c0cd470 2023-11-26T07:18:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.200+0000 7fbc9b7fe640 1 -- 172.21.15.77:0/3978740487 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94036610 con 0x7fbc9c0cd470 2023-11-26T07:18:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.201+0000 7fbca22c9640 1 -- 172.21.15.77:0/3978740487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc9c0cd470 msgr2=0x7fbc9c15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.201+0000 7fbca22c9640 1 --2- 172.21.15.77:0/3978740487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc9c0cd470 0x7fbc9c15b080 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c072a70 tx=0x7fbc9402e0e0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.201+0000 7fbca22c9640 1 -- 172.21.15.77:0/3978740487 shutdown_connections 2023-11-26T07:18:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.201+0000 7fbca22c9640 1 --2- 172.21.15.77:0/3978740487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc9c0cd470 0x7fbc9c15b080 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.201+0000 7fbca22c9640 1 --2- 172.21.15.77:0/3978740487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc9c0b2630 0x7fbc9c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.201+0000 7fbca22c9640 1 --2- 172.21.15.77:0/3978740487 >> v2:172.21.15.159:3300/0 conn(0x7fbc9c0b2250 0x7fbc9c15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.201+0000 7fbca22c9640 1 -- 172.21.15.77:0/3978740487 >> 172.21.15.77:0/3978740487 conn(0x7fbc9c06a920 msgr2=0x7fbc9c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:30.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.201+0000 7fbca22c9640 1 -- 172.21.15.77:0/3978740487 shutdown_connections 2023-11-26T07:18:30.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.201+0000 7fbca22c9640 1 -- 172.21.15.77:0/3978740487 wait complete. 2023-11-26T07:18:30.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.204+0000 7fbca22c9640 1 Processor -- start 2023-11-26T07:18:30.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.204+0000 7fbca22c9640 1 -- start start 2023-11-26T07:18:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.205+0000 7fbca22c9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c0b2250 0x7fbc9c144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.205+0000 7fbca22c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc9c0b2630 0x7fbc9c153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.205+0000 7fbca22c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc9c0cd470 0x7fbc9c071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.205+0000 7fbca22c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c156bc0 con 0x7fbc9c0b2630 2023-11-26T07:18:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.205+0000 7fbca22c9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c1448a0 con 0x7fbc9c0b2250 2023-11-26T07:18:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.205+0000 7fbca22c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c155fb0 con 0x7fbc9c0cd470 2023-11-26T07:18:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.205+0000 7fbc93fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc9c0b2630 0x7fbc9c153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.205+0000 7fbc93fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc9c0b2630 0x7fbc9c153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52630/0 (socket says 172.21.15.77:52630) 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.205+0000 7fbc93fff640 1 -- 172.21.15.77:0/2740143137 learned_addr learned my addr 172.21.15.77:0/2740143137 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbc9bfff640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c0b2250 0x7fbc9c144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbc93fff640 1 -- 172.21.15.77:0/2740143137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc9c0cd470 msgr2=0x7fbc9c071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbc93fff640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc9c0cd470 0x7fbc9c071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbc93fff640 1 -- 172.21.15.77:0/2740143137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c0b2250 msgr2=0x7fbc9c144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbc93fff640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c0b2250 0x7fbc9c144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbc93fff640 1 -- 172.21.15.77:0/2740143137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc94009b30 con 0x7fbc9c0b2630 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbc9bfff640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c0b2250 0x7fbc9c144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbc93fff640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc9c0b2630 0x7fbc9c153470 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400c7f0 tx=0x7fbc8400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbc997fa640 1 -- 172.21.15.77:0/2740143137 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84007a30 con 0x7fbc9c0b2630 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbc997fa640 1 -- 172.21.15.77:0/2740143137 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc84007b90 con 0x7fbc9c0b2630 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbc997fa640 1 -- 172.21.15.77:0/2740143137 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8400ce40 con 0x7fbc9c0b2630 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.206+0000 7fbca22c9640 1 -- 172.21.15.77:0/2740143137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c156290 con 0x7fbc9c0b2630 2023-11-26T07:18:30.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.207+0000 7fbca22c9640 1 -- 172.21.15.77:0/2740143137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c156850 con 0x7fbc9c0b2630 2023-11-26T07:18:30.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.208+0000 7fbca22c9640 1 -- 172.21.15.77:0/2740143137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c156d70 con 0x7fbc9c0b2630 2023-11-26T07:18:30.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.209+0000 7fbc997fa640 1 -- 172.21.15.77:0/2740143137 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc840113f0 con 0x7fbc9c0b2630 2023-11-26T07:18:30.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.209+0000 7fbc997fa640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbc7c06ae40 0x7fbc7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.210+0000 7fbc997fa640 1 -- 172.21.15.77:0/2740143137 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbc84089900 con 0x7fbc9c0b2630 2023-11-26T07:18:30.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.210+0000 7fbc9bfff640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbc7c06ae40 0x7fbc7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.210+0000 7fbc9bfff640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbc7c06ae40 0x7fbc7c06d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0088b0 tx=0x7fbc8c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.214+0000 7fbc997fa640 1 -- 172.21.15.77:0/2740143137 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc9c156d70 con 0x7fbc9c0b2630 2023-11-26T07:18:30.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.444+0000 7fbca22c9640 1 -- 172.21.15.77:0/2740143137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc9c067470 con 0x7fbc9c0b2630 2023-11-26T07:18:30.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.445+0000 7fbc997fa640 1 -- 172.21.15.77:0/2740143137 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4910 (secure 0 0 0) 0x7fbc8401f090 con 0x7fbc9c0b2630 2023-11-26T07:18:30.447 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:30.447 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2517793456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2517793456},{"type":"v1","addr":"172.21.15.77:6835","nonce":2517793456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/169772143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":169772143},{"type":"v1","addr":"172.21.15.77:6837","nonce":169772143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3797973649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3797973649},{"type":"v1","addr":"172.21.15.159:6834","nonce":3797973649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:17:34.699805+0000","modified":"2023-11-26T07:17:37.771915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/2168278307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2168278307},{"type":"v1","addr":"172.21.15.159:6835","nonce":2168278307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:30.448 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-11-26T07:18:30.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.448+0000 7fbca22c9640 1 -- 172.21.15.77:0/2740143137 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbc7c06ae40 msgr2=0x7fbc7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.448+0000 7fbca22c9640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbc7c06ae40 0x7fbc7c06d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0088b0 tx=0x7fbc8c008040 comp rx=0 tx=0).stop 2023-11-26T07:18:30.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.448+0000 7fbca22c9640 1 -- 172.21.15.77:0/2740143137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc9c0b2630 msgr2=0x7fbc9c153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.448+0000 7fbca22c9640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc9c0b2630 0x7fbc9c153470 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400c7f0 tx=0x7fbc8400cbf0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.448+0000 7fbca22c9640 1 -- 172.21.15.77:0/2740143137 shutdown_connections 2023-11-26T07:18:30.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.448+0000 7fbca22c9640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbc7c06ae40 0x7fbc7c06d300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.448+0000 7fbca22c9640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc9c0cd470 0x7fbc9c071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.448+0000 7fbca22c9640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc9c0b2630 0x7fbc9c153470 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.448+0000 7fbca22c9640 1 --2- 172.21.15.77:0/2740143137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c0b2250 0x7fbc9c144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.448+0000 7fbca22c9640 1 -- 172.21.15.77:0/2740143137 >> 172.21.15.77:0/2740143137 conn(0x7fbc9c06a920 msgr2=0x7fbc9c0ac2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:30.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.448+0000 7fbca22c9640 1 -- 172.21.15.77:0/2740143137 shutdown_connections 2023-11-26T07:18:30.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.449+0000 7fbca22c9640 1 -- 172.21.15.77:0/2740143137 wait complete. 2023-11-26T07:18:30.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:30.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.682+0000 7f050b59e640 1 Processor -- start 2023-11-26T07:18:30.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.682+0000 7f050b59e640 1 -- start start 2023-11-26T07:18:30.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.683+0000 7f050b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f050c0b1180 0x7f050c1683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.683+0000 7f050b59e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c161510 con 0x7f050c161080 2023-11-26T07:18:30.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.683+0000 7f050b59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c1617f0 con 0x7f050c143870 2023-11-26T07:18:30.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.683+0000 7f050b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c070460 con 0x7f050c0b1180 2023-11-26T07:18:30.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.683+0000 7f0501d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f050c161080 0x7f050c0b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57950/0 (socket says 172.21.15.77:57950) 2023-11-26T07:18:30.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.683+0000 7f0501d9b640 1 -- 172.21.15.77:0/2274102365 learned_addr learned my addr 172.21.15.77:0/2274102365 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:30.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202073558 0 0) 0x7f050c161510 con 0x7f050c161080 2023-11-26T07:18:30.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f8003520 con 0x7f050c161080 2023-11-26T07:18:30.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f050ad9d640 1 --2- 172.21.15.77:0/2274102365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f050c0b1180 0x7f050c1683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2300216948 0 0) 0x7f04f8003520 con 0x7f050c161080 2023-11-26T07:18:30.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f050c0b1180 msgr2=0x7f050c1683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 --2- 172.21.15.77:0/2274102365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f050c0b1180 0x7f050c1683f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 >> v1:172.21.15.159:6789/0 conn(0x7f050c143870 legacy=0x7f050c146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c161ad0 con 0x7f050c161080 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f04f4001670 con 0x7f050c161080 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 >> v1:172.21.15.77:6789/0 conn(0x7f050c161080 legacy=0x7f050c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 --2- 172.21.15.77:0/2274102365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04f80039a0 0x7f04f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 --2- 172.21.15.77:0/2274102365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f80047c0 0x7f04f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 --2- 172.21.15.77:0/2274102365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f050c0b1180 0x7f04f8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c070460 con 0x7f04f80047c0 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f800bb10 con 0x7f04f80039a0 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.684+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f800bcd0 con 0x7f050c0b1180 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.685+0000 7f0501d9b640 1 --2- 172.21.15.77:0/2274102365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f80047c0 0x7f04f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.685+0000 7f050a59c640 1 --2- 172.21.15.77:0/2274102365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04f80039a0 0x7f04f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.685+0000 7f0501d9b640 1 -- 172.21.15.77:0/2274102365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f050c0b1180 msgr2=0x7f04f8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.685+0000 7f0501d9b640 1 --2- 172.21.15.77:0/2274102365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f050c0b1180 0x7f04f8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.685+0000 7f0501d9b640 1 -- 172.21.15.77:0/2274102365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04f80039a0 msgr2=0x7f04f8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.685+0000 7f0501d9b640 1 --2- 172.21.15.77:0/2274102365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04f80039a0 0x7f04f8003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.685+0000 7f0501d9b640 1 -- 172.21.15.77:0/2274102365 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8003520 con 0x7f04f80047c0 2023-11-26T07:18:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.686+0000 7f0501d9b640 1 --2- 172.21.15.77:0/2274102365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f80047c0 0x7f04f8004c40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c190 tx=0x7f04f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac0da246b622655 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.686+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4005ad0 con 0x7f04f80047c0 2023-11-26T07:18:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.686+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f4005c30 con 0x7f04f80047c0 2023-11-26T07:18:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.686+0000 7f0509d9b640 1 -- 172.21.15.77:0/2274102365 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f402c810 con 0x7f04f80047c0 2023-11-26T07:18:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.687+0000 7f050b59e640 1 -- 172.21.15.77:0/2274102365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f80047c0 msgr2=0x7f04f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.687+0000 7f050b59e640 1 --2- 172.21.15.77:0/2274102365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f80047c0 0x7f04f8004c40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c190 tx=0x7f04f80057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.687+0000 7f050ad9d640 1 -- 172.21.15.77:0/2274102365 reap_dead start 2023-11-26T07:18:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.687+0000 7f050b59e640 1 -- 172.21.15.77:0/2274102365 shutdown_connections 2023-11-26T07:18:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.687+0000 7f050b59e640 1 -- 172.21.15.77:0/2274102365 >> 172.21.15.77:0/2274102365 conn(0x7f050c0cb830 msgr2=0x7f050c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.687+0000 7f050b59e640 1 -- 172.21.15.77:0/2274102365 shutdown_connections 2023-11-26T07:18:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.687+0000 7f050b59e640 1 -- 172.21.15.77:0/2274102365 wait complete. 2023-11-26T07:18:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.689+0000 7f050b59e640 1 Processor -- start 2023-11-26T07:18:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.689+0000 7f050b59e640 1 -- start start 2023-11-26T07:18:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.690+0000 7f050b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04f80047c0 0x7f050c15cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.690+0000 7f050b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c15ebd0 0x7f050c15f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.690+0000 7f050b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f050c1f2fd0 0x7f050c1f3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.690+0000 7f050b59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c1602a0 con 0x7f050c15ebd0 2023-11-26T07:18:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.690+0000 7f050b59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c1f39c0 con 0x7f050c1f2fd0 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.690+0000 7f050b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c15f690 con 0x7f04f80047c0 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.690+0000 7f0501d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c15ebd0 0x7f050c15f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.690+0000 7f0501d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c15ebd0 0x7f050c15f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52638/0 (socket says 172.21.15.77:52638) 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.690+0000 7f0501d9b640 1 -- 172.21.15.77:0/618928425 learned_addr learned my addr 172.21.15.77:0/618928425 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.691+0000 7f0501d9b640 1 -- 172.21.15.77:0/618928425 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04f80047c0 msgr2=0x7f050c15cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.691+0000 7f050a59c640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04f80047c0 0x7f050c15cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.691+0000 7f0501d9b640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04f80047c0 0x7f050c15cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.691+0000 7f0501d9b640 1 -- 172.21.15.77:0/618928425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f050c1f2fd0 msgr2=0x7f050c1f3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.691+0000 7f0501d9b640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f050c1f2fd0 0x7f050c1f3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.691+0000 7f0501d9b640 1 -- 172.21.15.77:0/618928425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c15f970 con 0x7f050c15ebd0 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.691+0000 7f0501d9b640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c15ebd0 0x7f050c15f050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f04f402c3b0 tx=0x7f04f4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.691+0000 7f05037fe640 1 -- 172.21.15.77:0/618928425 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f403c040 con 0x7f050c15ebd0 2023-11-26T07:18:30.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.691+0000 7f05037fe640 1 -- 172.21.15.77:0/618928425 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f4005e70 con 0x7f050c15ebd0 2023-11-26T07:18:30.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.691+0000 7f05037fe640 1 -- 172.21.15.77:0/618928425 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4007270 con 0x7f050c15ebd0 2023-11-26T07:18:30.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.691+0000 7f050b59e640 1 -- 172.21.15.77:0/618928425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c15fc50 con 0x7f050c15ebd0 2023-11-26T07:18:30.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.692+0000 7f050b59e640 1 -- 172.21.15.77:0/618928425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c1f3dc0 con 0x7f050c15ebd0 2023-11-26T07:18:30.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.693+0000 7f050b59e640 1 -- 172.21.15.77:0/618928425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c067990 con 0x7f050c15ebd0 2023-11-26T07:18:30.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.694+0000 7f05037fe640 1 -- 172.21.15.77:0/618928425 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04f4032070 con 0x7f050c15ebd0 2023-11-26T07:18:30.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.694+0000 7f05037fe640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f04ec06ae70 0x7f04ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.695+0000 7f05037fe640 1 -- 172.21.15.77:0/618928425 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f04f40ab180 con 0x7f050c15ebd0 2023-11-26T07:18:30.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.695+0000 7f050a59c640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f04ec06ae70 0x7f04ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.695+0000 7f050a59c640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f04ec06ae70 0x7f04ec06d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f050c142970 tx=0x7f04fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.699+0000 7f05037fe640 1 -- 172.21.15.77:0/618928425 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04f4076110 con 0x7f050c15ebd0 2023-11-26T07:18:30.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.929+0000 7f050b59e640 1 -- 172.21.15.77:0/618928425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f050c04e840 con 0x7f050c15ebd0 2023-11-26T07:18:30.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.930+0000 7f05037fe640 1 -- 172.21.15.77:0/618928425 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f04f4079730 con 0x7f050c15ebd0 2023-11-26T07:18:30.932 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:30.932 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2517793456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2517793456},{"type":"v1","addr":"172.21.15.77:6835","nonce":2517793456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/169772143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":169772143},{"type":"v1","addr":"172.21.15.77:6837","nonce":169772143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3797973649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3797973649},{"type":"v1","addr":"172.21.15.159:6834","nonce":3797973649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:17:34.699805+0000","modified":"2023-11-26T07:17:37.771915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/2168278307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2168278307},{"type":"v1","addr":"172.21.15.159:6835","nonce":2168278307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:30.932 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-11-26T07:18:30.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 -- 172.21.15.77:0/618928425 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f04ec06ae70 msgr2=0x7f04ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f04ec06ae70 0x7f04ec06d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f050c142970 tx=0x7f04fc009040 comp rx=0 tx=0).stop 2023-11-26T07:18:30.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 -- 172.21.15.77:0/618928425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c15ebd0 msgr2=0x7f050c15f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c15ebd0 0x7f050c15f050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f04f402c3b0 tx=0x7f04f4001930 comp rx=0 tx=0).stop 2023-11-26T07:18:30.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 -- 172.21.15.77:0/618928425 shutdown_connections 2023-11-26T07:18:30.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f04ec06ae70 0x7f04ec06d330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f050c1f2fd0 0x7f050c1f3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c15ebd0 0x7f050c15f050 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 --2- 172.21.15.77:0/618928425 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04f80047c0 0x7f050c15cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 -- 172.21.15.77:0/618928425 >> 172.21.15.77:0/618928425 conn(0x7f050c0cb830 msgr2=0x7f050c145de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:30.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 -- 172.21.15.77:0/618928425 shutdown_connections 2023-11-26T07:18:30.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:30.933+0000 7f050b59e640 1 -- 172.21.15.77:0/618928425 wait complete. 2023-11-26T07:18:30.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:31.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.164+0000 7f7ce42d3640 1 Processor -- start 2023-11-26T07:18:31.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.165+0000 7f7ce42d3640 1 -- start start 2023-11-26T07:18:31.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.166+0000 7f7ce42d3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cdc0cf450 0x7f7cdc0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.166+0000 7f7ce42d3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7cdc0cdfb0 0x7f7cdc0ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.166+0000 7f7ce42d3640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc0cece0 con 0x7f7cdc15c7f0 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.166+0000 7f7ce42d3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cdc156010 con 0x7f7cdc0cdfb0 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.166+0000 7f7ce42d3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc06ce30 con 0x7f7cdc0cf450 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.166+0000 7f7ce206f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7cdc15c7f0 0x7f7cdc06db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57954/0 (socket says 172.21.15.77:57954) 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.166+0000 7f7ce206f640 1 -- 172.21.15.77:0/2172998799 learned_addr learned my addr 172.21.15.77:0/2172998799 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.166+0000 7f7ce2870640 1 --2- 172.21.15.77:0/2172998799 >> v2:172.21.15.77:3300/0 conn(0x7f7cdc0cdfb0 0x7f7cdc0ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.167+0000 7f7ce186e640 1 --2- 172.21.15.77:0/2172998799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cdc0cf450 0x7f7cdc0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.167+0000 7f7ce2870640 1 -- 172.21.15.77:0/2172998799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cdc0cf450 msgr2=0x7f7cdc0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.167+0000 7f7ce2870640 1 --2- 172.21.15.77:0/2172998799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cdc0cf450 0x7f7cdc0cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.167+0000 7f7ce2870640 1 -- 172.21.15.77:0/2172998799 >> v1:172.21.15.77:6789/0 conn(0x7f7cdc15c7f0 legacy=0x7f7cdc06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.167+0000 7f7ce2870640 1 -- 172.21.15.77:0/2172998799 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc06d040 con 0x7f7cdc0cdfb0 2023-11-26T07:18:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.168+0000 7f7ce2870640 1 --2- 172.21.15.77:0/2172998799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0cdfb0 0x7f7cdc0ce440 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009d90 tx=0x7f7cd402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111f3a19edc26cbb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.168+0000 7f7ce106d640 1 -- 172.21.15.77:0/2172998799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd402cc60 con 0x7f7cdc0cdfb0 2023-11-26T07:18:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.169+0000 7f7ce106d640 1 -- 172.21.15.77:0/2172998799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd402cdc0 con 0x7f7cdc0cdfb0 2023-11-26T07:18:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.169+0000 7f7ce106d640 1 -- 172.21.15.77:0/2172998799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4034660 con 0x7f7cdc0cdfb0 2023-11-26T07:18:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.169+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2172998799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0cdfb0 msgr2=0x7f7cdc0ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.169+0000 7f7ce42d3640 1 --2- 172.21.15.77:0/2172998799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0cdfb0 0x7f7cdc0ce440 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009d90 tx=0x7f7cd402beb0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.169+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2172998799 shutdown_connections 2023-11-26T07:18:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.169+0000 7f7ce42d3640 1 --2- 172.21.15.77:0/2172998799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0cdfb0 0x7f7cdc0ce440 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.169+0000 7f7ce42d3640 1 --2- 172.21.15.77:0/2172998799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cdc0cf450 0x7f7cdc0cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.169+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2172998799 >> 172.21.15.77:0/2172998799 conn(0x7f7cdc06a920 msgr2=0x7f7cdc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.169+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2172998799 shutdown_connections 2023-11-26T07:18:31.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.169+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2172998799 wait complete. 2023-11-26T07:18:31.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.171+0000 7f7ce42d3640 1 Processor -- start 2023-11-26T07:18:31.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.171+0000 7f7ce42d3640 1 -- start start 2023-11-26T07:18:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.172+0000 7f7ce42d3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cdc0cdfb0 0x7f7cdc154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.172+0000 7f7ce42d3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0cf450 0x7f7cdc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.172+0000 7f7ce42d3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cdc15c7f0 0x7f7cdc1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.172+0000 7f7ce42d3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc0ae9b0 con 0x7f7cdc0cf450 2023-11-26T07:18:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.172+0000 7f7ce42d3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc0add30 con 0x7f7cdc0cdfb0 2023-11-26T07:18:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.172+0000 7f7ce42d3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc0ae010 con 0x7f7cdc15c7f0 2023-11-26T07:18:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.172+0000 7f7ce186e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0cf450 0x7f7cdc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.173+0000 7f7ce186e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0cf450 0x7f7cdc156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52654/0 (socket says 172.21.15.77:52654) 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.173+0000 7f7ce186e640 1 -- 172.21.15.77:0/2344541097 learned_addr learned my addr 172.21.15.77:0/2344541097 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.173+0000 7f7ce186e640 1 -- 172.21.15.77:0/2344541097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cdc15c7f0 msgr2=0x7f7cdc1573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.173+0000 7f7ce186e640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cdc15c7f0 0x7f7cdc1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.173+0000 7f7ce186e640 1 -- 172.21.15.77:0/2344541097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cdc0cdfb0 msgr2=0x7f7cdc154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.173+0000 7f7ce186e640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cdc0cdfb0 0x7f7cdc154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.173+0000 7f7ce186e640 1 -- 172.21.15.77:0/2344541097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd4009a70 con 0x7f7cdc0cf450 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.173+0000 7f7ce186e640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0cf450 0x7f7cdc156e90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00d800 tx=0x7f7ccc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.173+0000 7f7cd2ffd640 1 -- 172.21.15.77:0/2344541097 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00b6c0 con 0x7f7cdc0cf450 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.174+0000 7f7cd2ffd640 1 -- 172.21.15.77:0/2344541097 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc00b820 con 0x7f7cdc0cf450 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.174+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2344541097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc0ae2f0 con 0x7f7cdc0cf450 2023-11-26T07:18:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.174+0000 7f7cd2ffd640 1 -- 172.21.15.77:0/2344541097 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00bbb0 con 0x7f7cdc0cf450 2023-11-26T07:18:31.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.174+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2344541097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc0ad9f0 con 0x7f7cdc0cf450 2023-11-26T07:18:31.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.175+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2344541097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cdc067470 con 0x7f7cdc0cf450 2023-11-26T07:18:31.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.176+0000 7f7cd2ffd640 1 -- 172.21.15.77:0/2344541097 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ccc00bd10 con 0x7f7cdc0cf450 2023-11-26T07:18:31.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.176+0000 7f7cd2ffd640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cc006ae90 0x7f7cc006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.177+0000 7f7cd2ffd640 1 -- 172.21.15.77:0/2344541097 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7ccc089b80 con 0x7f7cdc0cf450 2023-11-26T07:18:31.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.177+0000 7f7ce206f640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cc006ae90 0x7f7cc006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.178+0000 7f7ce206f640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cc006ae90 0x7f7cc006d350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8001550 tx=0x7f7cd8007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.181+0000 7f7cd2ffd640 1 -- 172.21.15.77:0/2344541097 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ccc054c20 con 0x7f7cdc0cf450 2023-11-26T07:18:31.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.377+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2344541097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cdc0cd730 con 0x7f7cdc0cf450 2023-11-26T07:18:31.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.380+0000 7f7cd2ffd640 1 -- 172.21.15.77:0/2344541097 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16729 (secure 0 0 0) 0x7f7ccc089e60 con 0x7f7cdc0cf450 2023-11-26T07:18:31.432 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:31.432 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:18:16.826725+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:17:32.975228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:17:33.719582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:31.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2344541097 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cc006ae90 msgr2=0x7f7cc006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cc006ae90 0x7f7cc006d350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8001550 tx=0x7f7cd8007a40 comp rx=0 tx=0).stop 2023-11-26T07:18:31.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2344541097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0cf450 msgr2=0x7f7cdc156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0cf450 0x7f7cdc156e90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00d800 tx=0x7f7ccc00dcc0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2344541097 shutdown_connections 2023-11-26T07:18:31.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cc006ae90 0x7f7cc006d350 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cdc15c7f0 0x7f7cdc1573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0cf450 0x7f7cdc156e90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 --2- 172.21.15.77:0/2344541097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cdc0cdfb0 0x7f7cdc154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2344541097 >> 172.21.15.77:0/2344541097 conn(0x7f7cdc06a920 msgr2=0x7f7cdc0aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:31.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2344541097 shutdown_connections 2023-11-26T07:18:31.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.383+0000 7f7ce42d3640 1 -- 172.21.15.77:0/2344541097 wait complete. 2023-11-26T07:18:31.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:18:31.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.655+0000 7f322b89b640 1 Processor -- start 2023-11-26T07:18:31.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.656+0000 7f322b89b640 1 -- start start 2023-11-26T07:18:31.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.657+0000 7f322b89b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3224072160 0x7f322415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.657+0000 7f322b89b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f322406de10 0x7f32240705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.657+0000 7f322b89b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322415ec90 con 0x7f32240c49f0 2023-11-26T07:18:31.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.657+0000 7f322b89b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32240cd530 con 0x7f3224072160 2023-11-26T07:18:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.657+0000 7f322b89b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32240c4ed0 con 0x7f322406de10 2023-11-26T07:18:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.657+0000 7f3229637640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3224072160 0x7f322415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.658+0000 7f3229637640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3224072160 0x7f322415e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52662/0 (socket says 172.21.15.77:52662) 2023-11-26T07:18:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.658+0000 7f3229637640 1 -- 172.21.15.77:0/2508802345 learned_addr learned my addr 172.21.15.77:0/2508802345 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.658+0000 7f3229e38640 1 --2- 172.21.15.77:0/2508802345 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f322406de10 0x7f32240705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.658+0000 7f3229637640 1 -- 172.21.15.77:0/2508802345 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f322406de10 msgr2=0x7f32240705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.658+0000 7f3229637640 1 --2- 172.21.15.77:0/2508802345 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f322406de10 0x7f32240705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.658+0000 7f3229637640 1 -- 172.21.15.77:0/2508802345 >> v1:172.21.15.77:6789/0 conn(0x7f32240c49f0 legacy=0x7f322406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.658+0000 7f3229637640 1 -- 172.21.15.77:0/2508802345 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240c51b0 con 0x7f3224072160 2023-11-26T07:18:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.660+0000 7f3229637640 1 --2- 172.21.15.77:0/2508802345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3224072160 0x7f322415e750 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3220009870 tx=0x7f322002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5e1439438ca86a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.660+0000 7f3217fff640 1 -- 172.21.15.77:0/2508802345 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220030840 con 0x7f3224072160 2023-11-26T07:18:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.660+0000 7f3217fff640 1 -- 172.21.15.77:0/2508802345 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32200309a0 con 0x7f3224072160 2023-11-26T07:18:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.660+0000 7f3217fff640 1 -- 172.21.15.77:0/2508802345 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220030d30 con 0x7f3224072160 2023-11-26T07:18:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.661+0000 7f322b89b640 1 -- 172.21.15.77:0/2508802345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3224072160 msgr2=0x7f322415e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.661+0000 7f322b89b640 1 --2- 172.21.15.77:0/2508802345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3224072160 0x7f322415e750 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3220009870 tx=0x7f322002b980 comp rx=0 tx=0).stop 2023-11-26T07:18:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.661+0000 7f322b89b640 1 -- 172.21.15.77:0/2508802345 shutdown_connections 2023-11-26T07:18:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.661+0000 7f322b89b640 1 --2- 172.21.15.77:0/2508802345 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f322406de10 0x7f32240705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.661+0000 7f322b89b640 1 --2- 172.21.15.77:0/2508802345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3224072160 0x7f322415e750 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.661+0000 7f322b89b640 1 -- 172.21.15.77:0/2508802345 >> 172.21.15.77:0/2508802345 conn(0x7f32240b0c50 msgr2=0x7f32240b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.661+0000 7f322b89b640 1 -- 172.21.15.77:0/2508802345 shutdown_connections 2023-11-26T07:18:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.661+0000 7f322b89b640 1 -- 172.21.15.77:0/2508802345 wait complete. 2023-11-26T07:18:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.663+0000 7f322b89b640 1 Processor -- start 2023-11-26T07:18:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.663+0000 7f322b89b640 1 -- start start 2023-11-26T07:18:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.664+0000 7f322b89b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f322406de10 0x7f3224141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.664+0000 7f322b89b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3224072160 0x7f32240999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.664+0000 7f322b89b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f32240c49f0 0x7f3224156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.664+0000 7f322b89b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3224142900 con 0x7f3224072160 2023-11-26T07:18:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.664+0000 7f322b89b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322413f720 con 0x7f322406de10 2023-11-26T07:18:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.664+0000 7f322b89b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32241590f0 con 0x7f32240c49f0 2023-11-26T07:18:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.665+0000 7f3228e36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3224072160 0x7f32240999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.665+0000 7f3228e36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3224072160 0x7f32240999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52678/0 (socket says 172.21.15.77:52678) 2023-11-26T07:18:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.665+0000 7f3228e36640 1 -- 172.21.15.77:0/1468337600 learned_addr learned my addr 172.21.15.77:0/1468337600 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.665+0000 7f3229637640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f322406de10 0x7f3224141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.665+0000 7f3229e38640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f32240c49f0 0x7f3224156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.665+0000 7f3228e36640 1 -- 172.21.15.77:0/1468337600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f32240c49f0 msgr2=0x7f3224156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.665+0000 7f3228e36640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f32240c49f0 0x7f3224156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.665+0000 7f3228e36640 1 -- 172.21.15.77:0/1468337600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f322406de10 msgr2=0x7f3224141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.665+0000 7f3228e36640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f322406de10 0x7f3224141cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.665+0000 7f3228e36640 1 -- 172.21.15.77:0/1468337600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32200094d0 con 0x7f3224072160 2023-11-26T07:18:31.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.666+0000 7f3228e36640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3224072160 0x7f32240999d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f321800c400 tx=0x7f321800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.666+0000 7f3215ffb640 1 -- 172.21.15.77:0/1468337600 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32180052d0 con 0x7f3224072160 2023-11-26T07:18:31.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.666+0000 7f3215ffb640 1 -- 172.21.15.77:0/1468337600 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3218005430 con 0x7f3224072160 2023-11-26T07:18:31.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.666+0000 7f3215ffb640 1 -- 172.21.15.77:0/1468337600 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218003830 con 0x7f3224072160 2023-11-26T07:18:31.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.666+0000 7f322b89b640 1 -- 172.21.15.77:0/1468337600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32241593d0 con 0x7f3224072160 2023-11-26T07:18:31.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.666+0000 7f322b89b640 1 -- 172.21.15.77:0/1468337600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3224159760 con 0x7f3224072160 2023-11-26T07:18:31.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.667+0000 7f322b89b640 1 -- 172.21.15.77:0/1468337600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32240ccb90 con 0x7f3224072160 2023-11-26T07:18:31.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.668+0000 7f3215ffb640 1 -- 172.21.15.77:0/1468337600 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3218003990 con 0x7f3224072160 2023-11-26T07:18:31.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.669+0000 7f3215ffb640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f320806ae70 0x7f320806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.669+0000 7f3215ffb640 1 -- 172.21.15.77:0/1468337600 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3218088b80 con 0x7f3224072160 2023-11-26T07:18:31.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.669+0000 7f3229637640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f320806ae70 0x7f320806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.670+0000 7f3229637640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f320806ae70 0x7f320806d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3220036000 tx=0x7f3220008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.673+0000 7f3215ffb640 1 -- 172.21.15.77:0/1468337600 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3218053a80 con 0x7f3224072160 2023-11-26T07:18:31.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.910+0000 7f322b89b640 1 -- 172.21.15.77:0/1468337600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f322415ec90 con 0x7f3224072160 2023-11-26T07:18:31.913 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-26T07:18:31.911+0000 7f36d32f9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:18:31.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.915+0000 7f3215ffb640 1 -- 172.21.15.77:0/1468337600 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f322415ec90 con 0x7f3224072160 2023-11-26T07:18:31.917 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:18:31.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.918+0000 7f322b89b640 1 -- 172.21.15.77:0/1468337600 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f320806ae70 msgr2=0x7f320806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.918+0000 7f322b89b640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f320806ae70 0x7f320806d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3220036000 tx=0x7f3220008030 comp rx=0 tx=0).stop 2023-11-26T07:18:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.919+0000 7f322b89b640 1 -- 172.21.15.77:0/1468337600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3224072160 msgr2=0x7f32240999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.919+0000 7f322b89b640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3224072160 0x7f32240999d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f321800c400 tx=0x7f321800c8c0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.919+0000 7f322b89b640 1 -- 172.21.15.77:0/1468337600 shutdown_connections 2023-11-26T07:18:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.919+0000 7f322b89b640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f320806ae70 0x7f320806d330 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.919+0000 7f322b89b640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f32240c49f0 0x7f3224156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.919+0000 7f322b89b640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3224072160 0x7f32240999d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.919+0000 7f322b89b640 1 --2- 172.21.15.77:0/1468337600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f322406de10 0x7f3224141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.919+0000 7f322b89b640 1 -- 172.21.15.77:0/1468337600 >> 172.21.15.77:0/1468337600 conn(0x7f32240b0c50 msgr2=0x7f32240b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.919+0000 7f322b89b640 1 -- 172.21.15.77:0/1468337600 shutdown_connections 2023-11-26T07:18:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:31.919+0000 7f322b89b640 1 -- 172.21.15.77:0/1468337600 wait complete. 2023-11-26T07:18:31.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:18:31.957 INFO:tasks.ceph.mds.b.smithi159.stderr: -7521> 2023-11-26T07:17:36.049+0000 7ff03db4f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:18:32.041 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-11-26T07:18:32.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.158+0000 7f0491ce7640 1 Processor -- start 2023-11-26T07:18:32.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.158+0000 7f0491ce7640 1 -- start start 2023-11-26T07:18:32.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.159+0000 7f0491ce7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f048c06de10 0x7f048c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.159+0000 7f0491ce7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f048c0c49f0 0x7f048c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.159+0000 7f0491ce7640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048c15ec90 con 0x7f048c072160 2023-11-26T07:18:32.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.159+0000 7f0491ce7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048c0cd530 con 0x7f048c06de10 2023-11-26T07:18:32.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.159+0000 7f0491ce7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048c0c4ed0 con 0x7f048c0c49f0 2023-11-26T07:18:32.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.160+0000 7f048affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f048c06de10 0x7f048c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.160+0000 7f048affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f048c06de10 0x7f048c15e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52692/0 (socket says 172.21.15.77:52692) 2023-11-26T07:18:32.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.160+0000 7f048affd640 1 -- 172.21.15.77:0/2433996147 learned_addr learned my addr 172.21.15.77:0/2433996147 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:32.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.160+0000 7f048bfff640 1 --2- 172.21.15.77:0/2433996147 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f048c0c49f0 0x7f048c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.160+0000 7f048affd640 1 -- 172.21.15.77:0/2433996147 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f048c0c49f0 msgr2=0x7f048c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:32.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.160+0000 7f048affd640 1 --2- 172.21.15.77:0/2433996147 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f048c0c49f0 0x7f048c0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.160+0000 7f048affd640 1 -- 172.21.15.77:0/2433996147 >> v1:172.21.15.159:6789/0 conn(0x7f048c072160 legacy=0x7f048c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.160+0000 7f048affd640 1 -- 172.21.15.77:0/2433996147 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c0c51b0 con 0x7f048c06de10 2023-11-26T07:18:32.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.162+0000 7f048affd640 1 --2- 172.21.15.77:0/2433996147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f048c06de10 0x7f048c15e750 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0480009870 tx=0x7f048002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d49c46cb6d7f4cc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.162+0000 7f048a7fc640 1 -- 172.21.15.77:0/2433996147 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480030840 con 0x7f048c06de10 2023-11-26T07:18:32.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.162+0000 7f048a7fc640 1 -- 172.21.15.77:0/2433996147 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04800309a0 con 0x7f048c06de10 2023-11-26T07:18:32.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.162+0000 7f048a7fc640 1 -- 172.21.15.77:0/2433996147 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480030d30 con 0x7f048c06de10 2023-11-26T07:18:32.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.163+0000 7f0491ce7640 1 -- 172.21.15.77:0/2433996147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f048c06de10 msgr2=0x7f048c15e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.163+0000 7f0491ce7640 1 --2- 172.21.15.77:0/2433996147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f048c06de10 0x7f048c15e750 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0480009870 tx=0x7f048002b980 comp rx=0 tx=0).stop 2023-11-26T07:18:32.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.163+0000 7f0491ce7640 1 -- 172.21.15.77:0/2433996147 shutdown_connections 2023-11-26T07:18:32.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.163+0000 7f0491ce7640 1 --2- 172.21.15.77:0/2433996147 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f048c0c49f0 0x7f048c0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.163+0000 7f0491ce7640 1 --2- 172.21.15.77:0/2433996147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f048c06de10 0x7f048c15e750 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.163+0000 7f0491ce7640 1 -- 172.21.15.77:0/2433996147 >> 172.21.15.77:0/2433996147 conn(0x7f048c0b0c50 msgr2=0x7f048c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:32.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.163+0000 7f0491ce7640 1 -- 172.21.15.77:0/2433996147 shutdown_connections 2023-11-26T07:18:32.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.163+0000 7f0491ce7640 1 -- 172.21.15.77:0/2433996147 wait complete. 2023-11-26T07:18:32.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.165+0000 7f0491ce7640 1 Processor -- start 2023-11-26T07:18:32.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.165+0000 7f0491ce7640 1 -- start start 2023-11-26T07:18:32.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f0491ce7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f048c06de10 0x7f048c154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f0491ce7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f048c072160 0x7f048c15a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f0491ce7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f048c0c49f0 0x7f048c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f0491ce7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c15b840 con 0x7f048c072160 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f0491ce7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c09bb00 con 0x7f048c06de10 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f0491ce7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048c15afa0 con 0x7f048c0c49f0 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f048affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f048c072160 0x7f048c15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f048affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f048c072160 0x7f048c15a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52698/0 (socket says 172.21.15.77:52698) 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f048affd640 1 -- 172.21.15.77:0/3406268142 learned_addr learned my addr 172.21.15.77:0/3406268142 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f048affd640 1 -- 172.21.15.77:0/3406268142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f048c0c49f0 msgr2=0x7f048c15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f048affd640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f048c0c49f0 0x7f048c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f048affd640 1 -- 172.21.15.77:0/3406268142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f048c06de10 msgr2=0x7f048c154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.166+0000 7f048b7fe640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f048c06de10 0x7f048c154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.167+0000 7f048affd640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f048c06de10 0x7f048c154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.167+0000 7f048affd640 1 -- 172.21.15.77:0/3406268142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04800094d0 con 0x7f048c072160 2023-11-26T07:18:32.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.167+0000 7f048b7fe640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f048c06de10 0x7f048c154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:32.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.167+0000 7f048affd640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f048c072160 0x7f048c15a470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0480000c00 tx=0x7f0480004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.167+0000 7f0473fff640 1 -- 172.21.15.77:0/3406268142 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480039c90 con 0x7f048c072160 2023-11-26T07:18:32.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.167+0000 7f0473fff640 1 -- 172.21.15.77:0/3406268142 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0480039df0 con 0x7f048c072160 2023-11-26T07:18:32.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.167+0000 7f0473fff640 1 -- 172.21.15.77:0/3406268142 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480043640 con 0x7f048c072160 2023-11-26T07:18:32.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.167+0000 7f0491ce7640 1 -- 172.21.15.77:0/3406268142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048c15b280 con 0x7f048c072160 2023-11-26T07:18:32.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.167+0000 7f0491ce7640 1 -- 172.21.15.77:0/3406268142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048c0b2360 con 0x7f048c072160 2023-11-26T07:18:32.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.168+0000 7f0491ce7640 1 -- 172.21.15.77:0/3406268142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048c0b2580 con 0x7f048c072160 2023-11-26T07:18:32.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.169+0000 7f0473fff640 1 -- 172.21.15.77:0/3406268142 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04800437a0 con 0x7f048c072160 2023-11-26T07:18:32.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.170+0000 7f0473fff640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047806ae40 0x7f047806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.170+0000 7f0473fff640 1 -- 172.21.15.77:0/3406268142 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f048003e070 con 0x7f048c072160 2023-11-26T07:18:32.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.171+0000 7f048b7fe640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047806ae40 0x7f047806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.171+0000 7f048b7fe640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047806ae40 0x7f047806d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f047c000f60 tx=0x7f047c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.175+0000 7f0473fff640 1 -- 172.21.15.77:0/3406268142 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0480077780 con 0x7f048c072160 2023-11-26T07:18:32.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.399+0000 7f0491ce7640 1 -- 172.21.15.77:0/3406268142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f048c04e8b0 con 0x7f048c072160 2023-11-26T07:18:32.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.936+0000 7f0473fff640 1 -- 172.21.15.77:0/3406268142 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f048007ada0 con 0x7f048c072160 2023-11-26T07:18:32.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.940+0000 7f0491ce7640 1 -- 172.21.15.77:0/3406268142 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047806ae40 msgr2=0x7f047806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.940+0000 7f0491ce7640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047806ae40 0x7f047806d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f047c000f60 tx=0x7f047c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:32.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.940+0000 7f0491ce7640 1 -- 172.21.15.77:0/3406268142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f048c072160 msgr2=0x7f048c15a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.940+0000 7f0491ce7640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f048c072160 0x7f048c15a470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0480000c00 tx=0x7f0480004730 comp rx=0 tx=0).stop 2023-11-26T07:18:32.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.940+0000 7f0491ce7640 1 -- 172.21.15.77:0/3406268142 shutdown_connections 2023-11-26T07:18:32.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.940+0000 7f0491ce7640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047806ae40 0x7f047806d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.940+0000 7f0491ce7640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f048c0c49f0 0x7f048c15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.940+0000 7f0491ce7640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f048c072160 0x7f048c15a470 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.941+0000 7f0491ce7640 1 --2- 172.21.15.77:0/3406268142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f048c06de10 0x7f048c154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.941+0000 7f0491ce7640 1 -- 172.21.15.77:0/3406268142 >> 172.21.15.77:0/3406268142 conn(0x7f048c0b0c50 msgr2=0x7f048c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:32.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.941+0000 7f0491ce7640 1 -- 172.21.15.77:0/3406268142 shutdown_connections 2023-11-26T07:18:32.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:32.941+0000 7f0491ce7640 1 -- 172.21.15.77:0/3406268142 wait complete. 2023-11-26T07:18:32.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:18:33.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.190+0000 7f6ba9bb0640 1 Processor -- start 2023-11-26T07:18:33.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.190+0000 7f6ba9bb0640 1 -- start start 2023-11-26T07:18:33.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.191+0000 7f6ba9bb0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ba415c7f0 0x7f6ba406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.191+0000 7f6ba9bb0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba40cece0 con 0x7f6ba40ce6c0 2023-11-26T07:18:33.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.191+0000 7f6ba9bb0640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba406d040 con 0x7f6ba40cf450 2023-11-26T07:18:33.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.191+0000 7f6ba9bb0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4156010 con 0x7f6ba415c7f0 2023-11-26T07:18:33.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.192+0000 7f6ba3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6ba40ce6c0 0x7f6ba40714d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57960/0 (socket says 172.21.15.77:57960) 2023-11-26T07:18:33.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.192+0000 7f6ba3fff640 1 -- 172.21.15.77:0/591950583 learned_addr learned my addr 172.21.15.77:0/591950583 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:33.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.192+0000 7f6ba37fe640 1 --2- 172.21.15.77:0/591950583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ba415c7f0 0x7f6ba406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.192+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969614494 0 0) 0x7f6ba40cece0 con 0x7f6ba40ce6c0 2023-11-26T07:18:33.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.192+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b90003520 con 0x7f6ba40ce6c0 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 459050542 0 0) 0x7f6b90003520 con 0x7f6ba40ce6c0 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ba415c7f0 msgr2=0x7f6ba406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 --2- 172.21.15.77:0/591950583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ba415c7f0 0x7f6ba406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 >> v1:172.21.15.159:6789/0 conn(0x7f6ba40cf450 legacy=0x7f6ba40cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba406d320 con 0x7f6ba40ce6c0 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f6b9c0019f0 con 0x7f6ba40ce6c0 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 >> v1:172.21.15.77:6789/0 conn(0x7f6ba40ce6c0 legacy=0x7f6ba40714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 --2- 172.21.15.77:0/591950583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 0x7f6b90003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 --2- 172.21.15.77:0/591950583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b900047c0 0x7f6b90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 --2- 172.21.15.77:0/591950583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ba415c7f0 0x7f6b90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4156010 con 0x7f6b900039a0 2023-11-26T07:18:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9000ba30 con 0x7f6b900047c0 2023-11-26T07:18:33.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9000bbf0 con 0x7f6ba415c7f0 2023-11-26T07:18:33.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba37fe640 1 --2- 172.21.15.77:0/591950583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 0x7f6b90003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba37fe640 1 -- 172.21.15.77:0/591950583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ba415c7f0 msgr2=0x7f6b90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:33.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba37fe640 1 --2- 172.21.15.77:0/591950583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ba415c7f0 0x7f6b90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6ba37fe640 1 -- 172.21.15.77:0/591950583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b900047c0 msgr2=0x7f6b90004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:33.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.193+0000 7f6b9bfff640 1 --2- 172.21.15.77:0/591950583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b900047c0 0x7f6b90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.194+0000 7f6ba37fe640 1 --2- 172.21.15.77:0/591950583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b900047c0 0x7f6b90004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.194+0000 7f6ba37fe640 1 -- 172.21.15.77:0/591950583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b90003520 con 0x7f6b900039a0 2023-11-26T07:18:33.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.195+0000 7f6ba37fe640 1 --2- 172.21.15.77:0/591950583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 0x7f6b90003dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009a90 tx=0x7f6b900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ace7d5de9ef4c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.195+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9402c6b0 con 0x7f6b900039a0 2023-11-26T07:18:33.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.195+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9402c810 con 0x7f6b900039a0 2023-11-26T07:18:33.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.195+0000 7f6ba2ffd640 1 -- 172.21.15.77:0/591950583 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9402cba0 con 0x7f6b900039a0 2023-11-26T07:18:33.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.195+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/591950583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 msgr2=0x7f6b90003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.195+0000 7f6ba9bb0640 1 --2- 172.21.15.77:0/591950583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 0x7f6b90003dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009a90 tx=0x7f6b900057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.195+0000 7f6ba3fff640 1 -- 172.21.15.77:0/591950583 reap_dead start 2023-11-26T07:18:33.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.196+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/591950583 shutdown_connections 2023-11-26T07:18:33.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.196+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/591950583 >> 172.21.15.77:0/591950583 conn(0x7f6ba406a920 msgr2=0x7f6ba406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:33.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.196+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/591950583 shutdown_connections 2023-11-26T07:18:33.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.196+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/591950583 wait complete. 2023-11-26T07:18:33.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.197+0000 7f6ba9bb0640 1 Processor -- start 2023-11-26T07:18:33.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.198+0000 7f6ba9bb0640 1 -- start start 2023-11-26T07:18:33.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.198+0000 7f6ba9bb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 0x7f6ba40ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.198+0000 7f6ba9bb0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ba40b39e0 0x7f6ba40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.198+0000 7f6ba9bb0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ba40b3e60 0x7f6ba40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.198+0000 7f6ba9bb0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40b3630 con 0x7f6b900039a0 2023-11-26T07:18:33.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.198+0000 7f6ba9bb0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40afb40 con 0x7f6ba40b3e60 2023-11-26T07:18:33.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.198+0000 7f6ba9bb0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40aec50 con 0x7f6ba40b39e0 2023-11-26T07:18:33.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.199+0000 7f6ba37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 0x7f6ba40ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.199+0000 7f6ba37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 0x7f6ba40ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52716/0 (socket says 172.21.15.77:52716) 2023-11-26T07:18:33.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.199+0000 7f6ba37fe640 1 -- 172.21.15.77:0/934583897 learned_addr learned my addr 172.21.15.77:0/934583897 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:33.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.199+0000 7f6ba37fe640 1 -- 172.21.15.77:0/934583897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ba40b39e0 msgr2=0x7f6ba40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.199+0000 7f6ba37fe640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ba40b39e0 0x7f6ba40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.199+0000 7f6ba37fe640 1 -- 172.21.15.77:0/934583897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ba40b3e60 msgr2=0x7f6ba40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.199+0000 7f6ba37fe640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ba40b3e60 0x7f6ba40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.199+0000 7f6ba37fe640 1 -- 172.21.15.77:0/934583897 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40aef30 con 0x7f6b900039a0 2023-11-26T07:18:33.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.199+0000 7f6ba37fe640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 0x7f6ba40ad280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6b9402c250 tx=0x7f6b94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.200+0000 7f6ba0ff9640 1 -- 172.21.15.77:0/934583897 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94003810 con 0x7f6b900039a0 2023-11-26T07:18:33.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.200+0000 7f6ba0ff9640 1 -- 172.21.15.77:0/934583897 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b94003970 con 0x7f6b900039a0 2023-11-26T07:18:33.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.200+0000 7f6ba0ff9640 1 -- 172.21.15.77:0/934583897 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94003ce0 con 0x7f6b900039a0 2023-11-26T07:18:33.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.200+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/934583897 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba40af210 con 0x7f6b900039a0 2023-11-26T07:18:33.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.200+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/934583897 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba40af7d0 con 0x7f6b900039a0 2023-11-26T07:18:33.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.201+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/934583897 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba406ef60 con 0x7f6b900039a0 2023-11-26T07:18:33.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.202+0000 7f6ba0ff9640 1 -- 172.21.15.77:0/934583897 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b94040450 con 0x7f6b900039a0 2023-11-26T07:18:33.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.203+0000 7f6ba0ff9640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6b8406ae40 0x7f6b8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.203+0000 7f6ba0ff9640 1 -- 172.21.15.77:0/934583897 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f6b940ab520 con 0x7f6b900039a0 2023-11-26T07:18:33.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.203+0000 7f6b9bfff640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6b8406ae40 0x7f6b8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.204+0000 7f6b9bfff640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6b8406ae40 0x7f6b8406d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40aeb10 tx=0x7f6b8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.208+0000 7f6ba0ff9640 1 -- 172.21.15.77:0/934583897 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b94076460 con 0x7f6b900039a0 2023-11-26T07:18:33.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.396+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/934583897 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ba4067470 con 0x7f6b900039a0 2023-11-26T07:18:33.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.957+0000 7f6ba0ff9640 1 -- 172.21.15.77:0/934583897 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6b940044e0 con 0x7f6b900039a0 2023-11-26T07:18:33.960 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:18:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.962+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/934583897 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6b8406ae40 msgr2=0x7f6b8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.962+0000 7f6ba9bb0640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6b8406ae40 0x7f6b8406d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40aeb10 tx=0x7f6b8c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.962+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/934583897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 msgr2=0x7f6ba40ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.962+0000 7f6ba9bb0640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 0x7f6ba40ad280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6b9402c250 tx=0x7f6b94004730 comp rx=0 tx=0).stop 2023-11-26T07:18:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.962+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/934583897 shutdown_connections 2023-11-26T07:18:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.962+0000 7f6ba9bb0640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6b8406ae40 0x7f6b8406d300 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40aeb10 tx=0x7f6b8c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.962+0000 7f6ba9bb0640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ba40b3e60 0x7f6ba40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.962+0000 7f6ba9bb0640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ba40b39e0 0x7f6ba40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.962+0000 7f6ba9bb0640 1 --2- 172.21.15.77:0/934583897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b900039a0 0x7f6ba40ad280 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.962+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/934583897 >> 172.21.15.77:0/934583897 conn(0x7f6ba406a920 msgr2=0x7f6ba415a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:33.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.963+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/934583897 shutdown_connections 2023-11-26T07:18:33.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:33.963+0000 7f6ba9bb0640 1 -- 172.21.15.77:0/934583897 wait complete. 2023-11-26T07:18:33.988 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:18:34.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.199+0000 7f1db512c640 1 Processor -- start 2023-11-26T07:18:34.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.200+0000 7f1db512c640 1 -- start start 2023-11-26T07:18:34.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.201+0000 7f1db512c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1db0144510 0x7f1db006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.201+0000 7f1db512c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1db00b11f0 0x7f1db00b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.201+0000 7f1db512c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db01448f0 con 0x7f1db015edd0 2023-11-26T07:18:34.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.201+0000 7f1db512c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db0144d80 con 0x7f1db00b11f0 2023-11-26T07:18:34.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.201+0000 7f1db512c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db015f2d0 con 0x7f1db0144510 2023-11-26T07:18:34.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.202+0000 7f1db492b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1db00b11f0 0x7f1db00b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.202+0000 7f1da7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1db015edd0 0x7f1db00b0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57964/0 (socket says 172.21.15.77:57964) 2023-11-26T07:18:34.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.202+0000 7f1da7fff640 1 -- 172.21.15.77:0/2828606600 learned_addr learned my addr 172.21.15.77:0/2828606600 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:34.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.202+0000 7f1daffff640 1 --2- 172.21.15.77:0/2828606600 >> v2:172.21.15.159:3300/0 conn(0x7f1db0144510 0x7f1db006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.202+0000 7f1db492b640 1 -- 172.21.15.77:0/2828606600 >> v2:172.21.15.159:3300/0 conn(0x7f1db0144510 msgr2=0x7f1db006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:34.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.202+0000 7f1db492b640 1 --2- 172.21.15.77:0/2828606600 >> v2:172.21.15.159:3300/0 conn(0x7f1db0144510 0x7f1db006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.202+0000 7f1db492b640 1 -- 172.21.15.77:0/2828606600 >> v1:172.21.15.77:6789/0 conn(0x7f1db015edd0 legacy=0x7f1db00b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.202+0000 7f1db492b640 1 -- 172.21.15.77:0/2828606600 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db015f5b0 con 0x7f1db00b11f0 2023-11-26T07:18:34.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.202+0000 7f1daf7fe640 1 -- 172.21.15.77:0/2828606600 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954409736 0 0) 0x7f1db01448f0 con 0x7f1db015edd0 2023-11-26T07:18:34.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.203+0000 7f1db492b640 1 --2- 172.21.15.77:0/2828606600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1db00b11f0 0x7f1db00b4180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1db00b1730 tx=0x7f1da802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60175db4bbb61e7c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:34.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.204+0000 7f1daf7fe640 1 -- 172.21.15.77:0/2828606600 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da802cbf0 con 0x7f1db00b11f0 2023-11-26T07:18:34.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.204+0000 7f1daf7fe640 1 -- 172.21.15.77:0/2828606600 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da802cd50 con 0x7f1db00b11f0 2023-11-26T07:18:34.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.204+0000 7f1daf7fe640 1 -- 172.21.15.77:0/2828606600 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8034660 con 0x7f1db00b11f0 2023-11-26T07:18:34.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.204+0000 7f1db512c640 1 -- 172.21.15.77:0/2828606600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1db00b11f0 msgr2=0x7f1db00b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.204+0000 7f1db512c640 1 --2- 172.21.15.77:0/2828606600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1db00b11f0 0x7f1db00b4180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1db00b1730 tx=0x7f1da802be40 comp rx=0 tx=0).stop 2023-11-26T07:18:34.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.204+0000 7f1db512c640 1 -- 172.21.15.77:0/2828606600 shutdown_connections 2023-11-26T07:18:34.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.204+0000 7f1db512c640 1 --2- 172.21.15.77:0/2828606600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1db00b11f0 0x7f1db00b4180 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.204+0000 7f1db512c640 1 --2- 172.21.15.77:0/2828606600 >> v2:172.21.15.159:3300/0 conn(0x7f1db0144510 0x7f1db006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.204+0000 7f1db512c640 1 -- 172.21.15.77:0/2828606600 >> 172.21.15.77:0/2828606600 conn(0x7f1db00cb8a0 msgr2=0x7f1db00cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:34.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.204+0000 7f1db512c640 1 -- 172.21.15.77:0/2828606600 shutdown_connections 2023-11-26T07:18:34.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.204+0000 7f1db512c640 1 -- 172.21.15.77:0/2828606600 wait complete. 2023-11-26T07:18:34.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.206+0000 7f1db512c640 1 Processor -- start 2023-11-26T07:18:34.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.206+0000 7f1db512c640 1 -- start start 2023-11-26T07:18:34.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.207+0000 7f1db512c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1db00b11f0 0x7f1db0070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.207+0000 7f1db512c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1db0144510 0x7f1db00709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.207+0000 7f1db512c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1db015edd0 0x7f1db01f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.207+0000 7f1db512c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0071dd0 con 0x7f1db015edd0 2023-11-26T07:18:34.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.207+0000 7f1db512c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db013fad0 con 0x7f1db00b11f0 2023-11-26T07:18:34.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.207+0000 7f1db512c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0070f10 con 0x7f1db0144510 2023-11-26T07:18:34.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1db492b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1db015edd0 0x7f1db01f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1db492b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1db015edd0 0x7f1db01f26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52732/0 (socket says 172.21.15.77:52732) 2023-11-26T07:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1db492b640 1 -- 172.21.15.77:0/1601358978 learned_addr learned my addr 172.21.15.77:0/1601358978 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1daffff640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1db00b11f0 0x7f1db0070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1da7fff640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1db0144510 0x7f1db00709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1db492b640 1 -- 172.21.15.77:0/1601358978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1db0144510 msgr2=0x7f1db00709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1db492b640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1db0144510 0x7f1db00709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1db492b640 1 -- 172.21.15.77:0/1601358978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1db00b11f0 msgr2=0x7f1db0070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1db492b640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1db00b11f0 0x7f1db0070490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1db492b640 1 -- 172.21.15.77:0/1601358978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da8009a70 con 0x7f1db015edd0 2023-11-26T07:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1daffff640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1db00b11f0 0x7f1db0070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.208+0000 7f1db492b640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1db015edd0 0x7f1db01f26f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1da802c450 tx=0x7f1da8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.209+0000 7f1dad7fa640 1 -- 172.21.15.77:0/1601358978 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da803e610 con 0x7f1db015edd0 2023-11-26T07:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.209+0000 7f1dad7fa640 1 -- 172.21.15.77:0/1601358978 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da803e790 con 0x7f1db015edd0 2023-11-26T07:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.209+0000 7f1dad7fa640 1 -- 172.21.15.77:0/1601358978 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da803eb40 con 0x7f1db015edd0 2023-11-26T07:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.209+0000 7f1db512c640 1 -- 172.21.15.77:0/1601358978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db00711c0 con 0x7f1db015edd0 2023-11-26T07:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.209+0000 7f1db512c640 1 -- 172.21.15.77:0/1601358978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db0071780 con 0x7f1db015edd0 2023-11-26T07:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.210+0000 7f1db512c640 1 -- 172.21.15.77:0/1601358978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db00aec50 con 0x7f1db015edd0 2023-11-26T07:18:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.211+0000 7f1dad7fa640 1 -- 172.21.15.77:0/1601358978 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1da803b050 con 0x7f1db015edd0 2023-11-26T07:18:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.212+0000 7f1dad7fa640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1d9006ae40 0x7f1d9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.212+0000 7f1dad7fa640 1 -- 172.21.15.77:0/1601358978 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f1da80ab910 con 0x7f1db015edd0 2023-11-26T07:18:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.212+0000 7f1daffff640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1d9006ae40 0x7f1d9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.212+0000 7f1daffff640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1d9006ae40 0x7f1d9006d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1da0006fd0 tx=0x7f1da0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.216+0000 7f1dad7fa640 1 -- 172.21.15.77:0/1601358978 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1db00aec50 con 0x7f1db015edd0 2023-11-26T07:18:34.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.419+0000 7f1db512c640 1 -- 172.21.15.77:0/1601358978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1db00aec50 con 0x7f1db015edd0 2023-11-26T07:18:34.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.960+0000 7f1dad7fa640 1 -- 172.21.15.77:0/1601358978 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1db00aec50 con 0x7f1db015edd0 2023-11-26T07:18:34.963 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-11-26T07:18:34.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.964+0000 7f1db512c640 1 -- 172.21.15.77:0/1601358978 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1d9006ae40 msgr2=0x7f1d9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.964+0000 7f1db512c640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1d9006ae40 0x7f1d9006d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1da0006fd0 tx=0x7f1da0008040 comp rx=0 tx=0).stop 2023-11-26T07:18:34.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.964+0000 7f1db512c640 1 -- 172.21.15.77:0/1601358978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1db015edd0 msgr2=0x7f1db01f26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.964+0000 7f1db512c640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1db015edd0 0x7f1db01f26f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1da802c450 tx=0x7f1da8004a40 comp rx=0 tx=0).stop 2023-11-26T07:18:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.964+0000 7f1db512c640 1 -- 172.21.15.77:0/1601358978 shutdown_connections 2023-11-26T07:18:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.964+0000 7f1db512c640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1d9006ae40 0x7f1d9006d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.964+0000 7f1db512c640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1db015edd0 0x7f1db01f26f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.964+0000 7f1db512c640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1db0144510 0x7f1db00709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.964+0000 7f1db512c640 1 --2- 172.21.15.77:0/1601358978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1db00b11f0 0x7f1db0070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.964+0000 7f1db512c640 1 -- 172.21.15.77:0/1601358978 >> 172.21.15.77:0/1601358978 conn(0x7f1db00cb8a0 msgr2=0x7f1db00b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.964+0000 7f1db512c640 1 -- 172.21.15.77:0/1601358978 shutdown_connections 2023-11-26T07:18:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:34.965+0000 7f1db512c640 1 -- 172.21.15.77:0/1601358978 wait complete. 2023-11-26T07:18:34.994 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:18:34.994 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:18:34.994 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:18:34.994 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:34.994 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:18:34.995 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:18:34.995 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:18:34.995 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:34.995 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:18:34.995 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:18:34.995 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:18:34.995 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:34.996 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:18:34.996 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:18:34.996 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:18:34.996 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:35.014 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:18:35.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:18:35.015 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:18:35.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:18:35.016 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:18:35.016 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:18:35.019 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:18:35.019 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:18:35.063 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:18:35.064 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:35.066 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:18:35.066 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:35.071 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:18:35.071 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:35.073 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:18:35.073 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:35.074 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:18:35.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-26T07:18:35.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-26T07:18:35.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-26T07:18:35.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-26T07:18:35.223 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-26T07:18:35.224 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-26T07:18:35.228 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-11-26T07:18:35.229 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-11-26T07:18:35.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.258+0000 7f9b417d5640 1 Processor -- start 2023-11-26T07:18:35.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.259+0000 7f9b417d5640 1 -- start start 2023-11-26T07:18:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.260+0000 7f9b417d5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b3c15d720 0x7f9b3c0d3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.260+0000 7f9b417d5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9b3c0d3870 0x7f9b3c0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.260+0000 7f9b417d5640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9b3c0b1400 0x7f9b3c0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.260+0000 7f9b417d5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c15db00 con 0x7f9b3c0d3870 2023-11-26T07:18:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.260+0000 7f9b417d5640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c0d3cf0 con 0x7f9b3c0b1400 2023-11-26T07:18:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.260+0000 7f9b417d5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0d0ce0 con 0x7f9b3c15d720 2023-11-26T07:18:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.260+0000 7f9b33fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9b3c0d3870 0x7f9b3c0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.260+0000 7f9b33fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9b3c0d3870 0x7f9b3c0b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52760/0 (socket says 172.21.15.77:52760) 2023-11-26T07:18:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.260+0000 7f9b33fff640 1 -- 172.21.15.77:0/15214156 learned_addr learned my addr 172.21.15.77:0/15214156 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:35.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.261+0000 7f9b3b7fe640 1 --2- 172.21.15.77:0/15214156 >> v2:172.21.15.159:3300/0 conn(0x7f9b3c0b1400 0x7f9b3c0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.261+0000 7f9b3affd640 1 --2- 172.21.15.77:0/15214156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b3c15d720 0x7f9b3c0d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.261+0000 7f9b33fff640 1 -- 172.21.15.77:0/15214156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b3c15d720 msgr2=0x7f9b3c0d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:35.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.261+0000 7f9b33fff640 1 --2- 172.21.15.77:0/15214156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b3c15d720 0x7f9b3c0d3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.261+0000 7f9b33fff640 1 -- 172.21.15.77:0/15214156 >> v2:172.21.15.159:3300/0 conn(0x7f9b3c0b1400 msgr2=0x7f9b3c0b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.261+0000 7f9b33fff640 1 --2- 172.21.15.77:0/15214156 >> v2:172.21.15.159:3300/0 conn(0x7f9b3c0b1400 0x7f9b3c0b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.261+0000 7f9b33fff640 1 -- 172.21.15.77:0/15214156 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c06d400 con 0x7f9b3c0d3870 2023-11-26T07:18:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.261+0000 7f9b3b7fe640 1 --2- 172.21.15.77:0/15214156 >> v2:172.21.15.159:3300/0 conn(0x7f9b3c0b1400 0x7f9b3c0b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.262+0000 7f9b33fff640 1 --2- 172.21.15.77:0/15214156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b3c0d3870 0x7f9b3c0b0ec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c08c760 tx=0x7f9b2402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26abbf1710b15a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.263+0000 7f9b3a7fc640 1 -- 172.21.15.77:0/15214156 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b240317e0 con 0x7f9b3c0d3870 2023-11-26T07:18:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.263+0000 7f9b3a7fc640 1 -- 172.21.15.77:0/15214156 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b24031940 con 0x7f9b3c0d3870 2023-11-26T07:18:35.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.263+0000 7f9b3a7fc640 1 -- 172.21.15.77:0/15214156 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24031cd0 con 0x7f9b3c0d3870 2023-11-26T07:18:35.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.263+0000 7f9b417d5640 1 -- 172.21.15.77:0/15214156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b3c0d3870 msgr2=0x7f9b3c0b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.263+0000 7f9b417d5640 1 --2- 172.21.15.77:0/15214156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b3c0d3870 0x7f9b3c0b0ec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c08c760 tx=0x7f9b2402b880 comp rx=0 tx=0).stop 2023-11-26T07:18:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.264+0000 7f9b417d5640 1 -- 172.21.15.77:0/15214156 shutdown_connections 2023-11-26T07:18:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.264+0000 7f9b417d5640 1 --2- 172.21.15.77:0/15214156 >> v2:172.21.15.159:3300/0 conn(0x7f9b3c0b1400 0x7f9b3c0b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.264+0000 7f9b417d5640 1 --2- 172.21.15.77:0/15214156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b3c0d3870 0x7f9b3c0b0ec0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.264+0000 7f9b417d5640 1 --2- 172.21.15.77:0/15214156 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b3c15d720 0x7f9b3c0d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.264+0000 7f9b417d5640 1 -- 172.21.15.77:0/15214156 >> 172.21.15.77:0/15214156 conn(0x7f9b3c08af60 msgr2=0x7f9b3c09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.264+0000 7f9b417d5640 1 -- 172.21.15.77:0/15214156 shutdown_connections 2023-11-26T07:18:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.264+0000 7f9b417d5640 1 -- 172.21.15.77:0/15214156 wait complete. 2023-11-26T07:18:35.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.266+0000 7f9b417d5640 1 Processor -- start 2023-11-26T07:18:35.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.266+0000 7f9b417d5640 1 -- start start 2023-11-26T07:18:35.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.267+0000 7f9b417d5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b3c0b1400 0x7f9b3c15bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.268+0000 7f9b417d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b3c0d3870 0x7f9b3c0ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.268+0000 7f9b417d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b3c15d720 0x7f9b3c0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.268+0000 7f9b417d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c7940 con 0x7f9b3c0d3870 2023-11-26T07:18:35.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.268+0000 7f9b417d5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c15c090 con 0x7f9b3c15d720 2023-11-26T07:18:35.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.268+0000 7f9b417d5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c15c4d0 con 0x7f9b3c0b1400 2023-11-26T07:18:35.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.268+0000 7f9b33fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b3c0d3870 0x7f9b3c0ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.268+0000 7f9b3affd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b3c0b1400 0x7f9b3c15bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.268+0000 7f9b33fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b3c0d3870 0x7f9b3c0ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52762/0 (socket says 172.21.15.77:52762) 2023-11-26T07:18:35.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.268+0000 7f9b33fff640 1 -- 172.21.15.77:0/1578604192 learned_addr learned my addr 172.21.15.77:0/1578604192 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:35.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.268+0000 7f9b3b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b3c15d720 0x7f9b3c0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.269+0000 7f9b3b7fe640 1 -- 172.21.15.77:0/1578604192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b3c0b1400 msgr2=0x7f9b3c15bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.269+0000 7f9b3b7fe640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b3c0b1400 0x7f9b3c15bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.269+0000 7f9b3b7fe640 1 -- 172.21.15.77:0/1578604192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b3c0d3870 msgr2=0x7f9b3c0ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.269+0000 7f9b3b7fe640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b3c0d3870 0x7f9b3c0ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.269+0000 7f9b3b7fe640 1 -- 172.21.15.77:0/1578604192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b240094d0 con 0x7f9b3c15d720 2023-11-26T07:18:35.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.270+0000 7f9b3b7fe640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b3c15d720 0x7f9b3c0caa30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9b34007db0 tx=0x7f9b3400d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:35.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.270+0000 7f9b337fe640 1 -- 172.21.15.77:0/1578604192 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34003990 con 0x7f9b3c15d720 2023-11-26T07:18:35.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.270+0000 7f9b337fe640 1 -- 172.21.15.77:0/1578604192 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3400f040 con 0x7f9b3c15d720 2023-11-26T07:18:35.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.270+0000 7f9b337fe640 1 -- 172.21.15.77:0/1578604192 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34003d30 con 0x7f9b3c15d720 2023-11-26T07:18:35.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.270+0000 7f9b417d5640 1 -- 172.21.15.77:0/1578604192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c0c8bc0 con 0x7f9b3c15d720 2023-11-26T07:18:35.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.270+0000 7f9b417d5640 1 -- 172.21.15.77:0/1578604192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c0c7e00 con 0x7f9b3c15d720 2023-11-26T07:18:35.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.272+0000 7f9b417d5640 1 -- 172.21.15.77:0/1578604192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c04e8b0 con 0x7f9b3c15d720 2023-11-26T07:18:35.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.273+0000 7f9b337fe640 1 -- 172.21.15.77:0/1578604192 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b34004030 con 0x7f9b3c15d720 2023-11-26T07:18:35.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.274+0000 7f9b337fe640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9b1c06ae40 0x7f9b1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.274+0000 7f9b337fe640 1 -- 172.21.15.77:0/1578604192 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9b34089470 con 0x7f9b3c15d720 2023-11-26T07:18:35.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.274+0000 7f9b3affd640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9b1c06ae40 0x7f9b1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.275+0000 7f9b3affd640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9b1c06ae40 0x7f9b1c06d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c006fd0 tx=0x7f9b2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:35.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.287+0000 7f9b337fe640 1 -- 172.21.15.77:0/1578604192 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b340548e0 con 0x7f9b3c15d720 2023-11-26T07:18:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:35.492+0000 7f9b417d5640 1 -- 172.21.15.77:0/1578604192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9b3c06caf0 con 0x7f9b3c15d720 2023-11-26T07:18:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.679+0000 7f9b337fe640 1 -- 172.21.15.77:0/1578604192 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9b34003e90 con 0x7f9b3c15d720 2023-11-26T07:18:36.687 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 -- 172.21.15.77:0/1578604192 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9b1c06ae40 msgr2=0x7f9b1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9b1c06ae40 0x7f9b1c06d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c006fd0 tx=0x7f9b2c008040 comp rx=0 tx=0).stop 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 -- 172.21.15.77:0/1578604192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b3c15d720 msgr2=0x7f9b3c0caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b3c15d720 0x7f9b3c0caa30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9b34007db0 tx=0x7f9b3400d4a0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 -- 172.21.15.77:0/1578604192 shutdown_connections 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9b1c06ae40 0x7f9b1c06d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b3c15d720 0x7f9b3c0caa30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b3c0d3870 0x7f9b3c0ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 --2- 172.21.15.77:0/1578604192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b3c0b1400 0x7f9b3c15bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 -- 172.21.15.77:0/1578604192 >> 172.21.15.77:0/1578604192 conn(0x7f9b3c08af60 msgr2=0x7f9b3c06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 -- 172.21.15.77:0/1578604192 shutdown_connections 2023-11-26T07:18:36.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.682+0000 7f9b417d5640 1 -- 172.21.15.77:0/1578604192 wait complete. 2023-11-26T07:18:36.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:18:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.920+0000 7f6e20c4b640 1 Processor -- start 2023-11-26T07:18:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.920+0000 7f6e20c4b640 1 -- start start 2023-11-26T07:18:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.921+0000 7f6e20c4b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6e1c0abf50 0x7f6e1c0b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.921+0000 7f6e20c4b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c0711e0 con 0x7f6e1c15b5e0 2023-11-26T07:18:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.921+0000 7f6e20c4b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c0cdc80 con 0x7f6e1c0cd5b0 2023-11-26T07:18:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.921+0000 7f6e20c4b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1c0705d0 con 0x7f6e1c0abf50 2023-11-26T07:18:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.921+0000 7f6e1a59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6e1c15b5e0 0x7f6e1c0ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40376/0 (socket says 172.21.15.77:40376) 2023-11-26T07:18:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.921+0000 7f6e1a59c640 1 -- 172.21.15.77:0/2255622664 learned_addr learned my addr 172.21.15.77:0/2255622664 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170576076 0 0) 0x7f6e1c0711e0 con 0x7f6e1c15b5e0 2023-11-26T07:18:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e04003520 con 0x7f6e1c15b5e0 2023-11-26T07:18:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1ad9d640 1 --2- 172.21.15.77:0/2255622664 >> v2:172.21.15.159:3300/0 conn(0x7f6e1c0abf50 0x7f6e1c0b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1827579528 0 0) 0x7f6e04003520 con 0x7f6e1c15b5e0 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 >> v2:172.21.15.159:3300/0 conn(0x7f6e1c0abf50 msgr2=0x7f6e1c0b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 --2- 172.21.15.77:0/2255622664 >> v2:172.21.15.159:3300/0 conn(0x7f6e1c0abf50 0x7f6e1c0b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 >> v1:172.21.15.159:6789/0 conn(0x7f6e1c0cd5b0 legacy=0x7f6e1c071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0708b0 con 0x7f6e1c15b5e0 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f6e0c0019f0 con 0x7f6e1c15b5e0 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 >> v1:172.21.15.77:6789/0 conn(0x7f6e1c15b5e0 legacy=0x7f6e1c0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 --2- 172.21.15.77:0/2255622664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e04003970 0x7f6e04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 --2- 172.21.15.77:0/2255622664 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e040047c0 0x7f6e04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.922+0000 7f6e1959a640 1 --2- 172.21.15.77:0/2255622664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e04005180 0x7f6e0400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.923+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0705d0 con 0x7f6e04005180 2023-11-26T07:18:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.923+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0400c0d0 con 0x7f6e04003970 2023-11-26T07:18:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.923+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0400c290 con 0x7f6e040047c0 2023-11-26T07:18:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.923+0000 7f6e1ad9d640 1 --2- 172.21.15.77:0/2255622664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e04005180 0x7f6e0400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.923+0000 7f6e1a59c640 1 --2- 172.21.15.77:0/2255622664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e04003970 0x7f6e04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.923+0000 7f6e19d9b640 1 --2- 172.21.15.77:0/2255622664 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e040047c0 0x7f6e04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.923+0000 7f6e1ad9d640 1 -- 172.21.15.77:0/2255622664 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e040047c0 msgr2=0x7f6e04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.923+0000 7f6e1ad9d640 1 --2- 172.21.15.77:0/2255622664 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e040047c0 0x7f6e04004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.923+0000 7f6e1ad9d640 1 -- 172.21.15.77:0/2255622664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e04003970 msgr2=0x7f6e04003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.923+0000 7f6e1ad9d640 1 --2- 172.21.15.77:0/2255622664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e04003970 0x7f6e04003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.923+0000 7f6e1ad9d640 1 -- 172.21.15.77:0/2255622664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e04003520 con 0x7f6e04005180 2023-11-26T07:18:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.924+0000 7f6e1ad9d640 1 -- 172.21.15.77:0/2255622664 reap_dead start 2023-11-26T07:18:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.924+0000 7f6e1ad9d640 1 --2- 172.21.15.77:0/2255622664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e04005180 0x7f6e0400b980 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400ba30 tx=0x7f6e040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10ae3183f5ef7f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.924+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14004020 con 0x7f6e04005180 2023-11-26T07:18:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.924+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e140041c0 con 0x7f6e04005180 2023-11-26T07:18:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.924+0000 7f6e1959a640 1 -- 172.21.15.77:0/2255622664 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14003610 con 0x7f6e04005180 2023-11-26T07:18:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.925+0000 7f6e20c4b640 1 -- 172.21.15.77:0/2255622664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e04005180 msgr2=0x7f6e0400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.925+0000 7f6e20c4b640 1 --2- 172.21.15.77:0/2255622664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e04005180 0x7f6e0400b980 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400ba30 tx=0x7f6e040057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.925+0000 7f6e20c4b640 1 -- 172.21.15.77:0/2255622664 shutdown_connections 2023-11-26T07:18:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.925+0000 7f6e20c4b640 1 --2- 172.21.15.77:0/2255622664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e04005180 0x7f6e0400b980 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.925+0000 7f6e20c4b640 1 -- 172.21.15.77:0/2255622664 >> 172.21.15.77:0/2255622664 conn(0x7f6e1c0b0c70 msgr2=0x7f6e1c0b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.925+0000 7f6e20c4b640 1 -- 172.21.15.77:0/2255622664 shutdown_connections 2023-11-26T07:18:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.925+0000 7f6e20c4b640 1 -- 172.21.15.77:0/2255622664 wait complete. 2023-11-26T07:18:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.927+0000 7f6e20c4b640 1 Processor -- start 2023-11-26T07:18:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.927+0000 7f6e20c4b640 1 -- start start 2023-11-26T07:18:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.928+0000 7f6e20c4b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e04005180 0x7f6e1c15e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.928+0000 7f6e20c4b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e1c15e960 0x7f6e1c145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.928+0000 7f6e20c4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1c145a50 0x7f6e1c145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.928+0000 7f6e20c4b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c143f90 con 0x7f6e1c145a50 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.928+0000 7f6e20c4b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c146440 con 0x7f6e04005180 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.928+0000 7f6e20c4b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c15ede0 con 0x7f6e1c15e960 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.928+0000 7f6e1ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1c145a50 0x7f6e1c145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.928+0000 7f6e1ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1c145a50 0x7f6e1c145f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54964/0 (socket says 172.21.15.77:54964) 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.928+0000 7f6e1ad9d640 1 -- 172.21.15.77:0/3205982468 learned_addr learned my addr 172.21.15.77:0/3205982468 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e19d9b640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e1c15e960 0x7f6e1c145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e1a59c640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e04005180 0x7f6e1c15e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e1ad9d640 1 -- 172.21.15.77:0/3205982468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e1c15e960 msgr2=0x7f6e1c145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e1ad9d640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e1c15e960 0x7f6e1c145510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e1ad9d640 1 -- 172.21.15.77:0/3205982468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e04005180 msgr2=0x7f6e1c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e1ad9d640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e04005180 0x7f6e1c15e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e1ad9d640 1 -- 172.21.15.77:0/3205982468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c159ce0 con 0x7f6e1c145a50 2023-11-26T07:18:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e1ad9d640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1c145a50 0x7f6e1c145f00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400bb20 tx=0x7f6e14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e0affd640 1 -- 172.21.15.77:0/3205982468 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14032480 con 0x7f6e1c145a50 2023-11-26T07:18:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e0affd640 1 -- 172.21.15.77:0/3205982468 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e140325e0 con 0x7f6e1c145a50 2023-11-26T07:18:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e0affd640 1 -- 172.21.15.77:0/3205982468 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14032790 con 0x7f6e1c145a50 2023-11-26T07:18:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.929+0000 7f6e20c4b640 1 -- 172.21.15.77:0/3205982468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c1435f0 con 0x7f6e1c145a50 2023-11-26T07:18:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.930+0000 7f6e20c4b640 1 -- 172.21.15.77:0/3205982468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c143bb0 con 0x7f6e1c145a50 2023-11-26T07:18:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.931+0000 7f6e20c4b640 1 -- 172.21.15.77:0/3205982468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1c1440d0 con 0x7f6e1c145a50 2023-11-26T07:18:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.932+0000 7f6e0affd640 1 -- 172.21.15.77:0/3205982468 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e140328f0 con 0x7f6e1c145a50 2023-11-26T07:18:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.932+0000 7f6e0affd640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6dfc06ae70 0x7f6dfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.933+0000 7f6e0affd640 1 -- 172.21.15.77:0/3205982468 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e140aaf90 con 0x7f6e1c145a50 2023-11-26T07:18:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.933+0000 7f6e1a59c640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6dfc06ae70 0x7f6dfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.933+0000 7f6e1a59c640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6dfc06ae70 0x7f6dfc06d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0013d0 tx=0x7f6e0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:36.937+0000 7f6e0affd640 1 -- 172.21.15.77:0/3205982468 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e1c1440d0 con 0x7f6e1c145a50 2023-11-26T07:18:37.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.201+0000 7f6e20c4b640 1 -- 172.21.15.77:0/3205982468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6e1c1440d0 con 0x7f6e1c145a50 2023-11-26T07:18:37.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.202+0000 7f6e0affd640 1 -- 172.21.15.77:0/3205982468 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f6e1c1440d0 con 0x7f6e1c145a50 2023-11-26T07:18:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:37.205 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:18:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2023-11-26T07:18:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2023-11-26T07:18:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJls/H7KhAAJS2XRN0c7/K+7oskAg2PWQ==", 2023-11-26T07:18:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:18:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:18:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:18:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2023-11-26T07:18:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJljSp5DRAAOH30kXLDMsVQpQomhskVow==", 2023-11-26T07:18:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:18:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:18:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:18:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2023-11-26T07:18:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJlejOkOBAAdCCERoTPpw8Fk1PciaPtag==", 2023-11-26T07:18:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:18:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:18:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:18:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2023-11-26T07:18:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJl5HpoHhAAaW2/GvlUZsizM1A5Gd3U7A==", 2023-11-26T07:18:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:18:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:18:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:18:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2023-11-26T07:18:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDS8GJlaI6nFxAARyjS0s1azVjAfqdNZIT4BA==", 2023-11-26T07:18:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:18:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:18:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2023-11-26T07:18:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDV8GJl+YY9IhAAPh7GuZ2EhEZBybZJJL16gA==", 2023-11-26T07:18:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:18:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:18:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2023-11-26T07:18:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDY8GJlWjPxOhAApethgteKlUOMhor55mJc9A==", 2023-11-26T07:18:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:18:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:18:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2023-11-26T07:18:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDc8GJl9OCqFxAAJeYH2CcWuQG8iILjc/PmTw==", 2023-11-26T07:18:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:18:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:18:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2023-11-26T07:18:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDj8GJlVXaWGxAAfxXHfo561p+2qKX1+9C7+A==", 2023-11-26T07:18:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:18:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:18:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2023-11-26T07:18:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDm8GJlrAsENhAALSWl4bAiy33+ZxX95xvcIw==", 2023-11-26T07:18:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:18:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:18:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2023-11-26T07:18:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDq8GJlUm5MEhAAVlkzzyqBJP1qdcuCfwhZmw==", 2023-11-26T07:18:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:18:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:18:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2023-11-26T07:18:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDt8GJlhvw+KxAAfn+Rklyv9MbMoGvi64A3eQ==", 2023-11-26T07:18:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:18:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:18:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2023-11-26T07:18:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJlhqOIKxAAiafAbVhNu4B+yTd/1i7+1A==", 2023-11-26T07:18:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:18:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:18:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:18:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:18:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2023-11-26T07:18:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDO8GJlTnRuBhAA00v94pDxY21mhcK5h8b5ag==", 2023-11-26T07:18:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:18:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:18:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:18:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:18:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2023-11-26T07:18:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJlCgKpNhAAX0HSBMyXxclLtvXwdw4gBQ==", 2023-11-26T07:18:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:18:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:18:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:18:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:18:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2023-11-26T07:18:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDO8GJlFP2HERAA02DfbslNoErl7daZAir6yw==", 2023-11-26T07:18:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:18:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:18:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:18:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:18:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDL8GJlGorHHhAAWxHMjiSUuG8u/Jl0dYqSBg==", 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-mds", 2023-11-26T07:18:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQD28GJlvuCRIRAA0FnpQy9/CKEmNowntARTiw==", 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-mds" 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-mgr", 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQD28GJlU+2RIRAAvBrKegEYgu/S4PTB9OZ7Mg==", 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-osd", 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQD28GJlRPaRIRAAJKO/ur2+bqRYVourzeV4tQ==", 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-osd" 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rbd", 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQD28GJl3f6RIRAAa+C+JMUIu5tsCtVF/PWfiw==", 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-26T07:18:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQD28GJlRgmSIRAAoAqkxZenhZ/4rLjOvjgK4w==", 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rgw", 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQD28GJlfxKSIRAA6CDuyyTdxGp9mN5BQL6gEQ==", 2023-11-26T07:18:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJlYYTeIBAATi/P7CpbfWNxuKAyi2DChA==", 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:18:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2023-11-26T07:18:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJl07f3FBAAL3JjjVDVa3eQe+Phdo0agw==", 2023-11-26T07:18:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:18:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:18:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-26T07:18:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:18:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2023-11-26T07:18:37.229 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:18:37.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 -- 172.21.15.77:0/3205982468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6dfc06ae70 msgr2=0x7f6dfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6dfc06ae70 0x7f6dfc06d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0013d0 tx=0x7f6e0c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:37.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 -- 172.21.15.77:0/3205982468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1c145a50 msgr2=0x7f6e1c145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1c145a50 0x7f6e1c145f00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400bb20 tx=0x7f6e14004730 comp rx=0 tx=0).stop 2023-11-26T07:18:37.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 -- 172.21.15.77:0/3205982468 shutdown_connections 2023-11-26T07:18:37.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6dfc06ae70 0x7f6dfc06d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1c145a50 0x7f6e1c145f00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e1c15e960 0x7f6e1c145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 --2- 172.21.15.77:0/3205982468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e04005180 0x7f6e1c15e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 -- 172.21.15.77:0/3205982468 >> 172.21.15.77:0/3205982468 conn(0x7f6e1c0b0c70 msgr2=0x7f6e1c0adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:37.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 -- 172.21.15.77:0/3205982468 shutdown_connections 2023-11-26T07:18:37.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.205+0000 7f6e20c4b640 1 -- 172.21.15.77:0/3205982468 wait complete. 2023-11-26T07:18:37.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-26T07:18:37.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.438+0000 7f3582a52640 1 Processor -- start 2023-11-26T07:18:37.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.438+0000 7f3582a52640 1 -- start start 2023-11-26T07:18:37.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.440+0000 7f3582a52640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f357c06ef60 0x7f357c0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.440+0000 7f3582a52640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c0cebf0 con 0x7f357c0cb670 2023-11-26T07:18:37.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.440+0000 7f3582a52640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c0c6080 con 0x7f357c144b10 2023-11-26T07:18:37.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.440+0000 7f3582a52640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c144ef0 con 0x7f357c06ef60 2023-11-26T07:18:37.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.440+0000 7f3582251640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f357c0cb670 0x7f357c0c6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40392/0 (socket says 172.21.15.77:40392) 2023-11-26T07:18:37.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.440+0000 7f3582251640 1 -- 172.21.15.77:0/3298241679 learned_addr learned my addr 172.21.15.77:0/3298241679 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.440+0000 7f358124f640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f357c06ef60 0x7f357c0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298375248 0 0) 0x7f357c0cebf0 con 0x7f357c0cb670 2023-11-26T07:18:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3564003520 con 0x7f357c0cb670 2023-11-26T07:18:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651883952 0 0) 0x7f3564003520 con 0x7f357c0cb670 2023-11-26T07:18:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f357c06ef60 msgr2=0x7f357c0c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f357c06ef60 0x7f357c0c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 >> v1:172.21.15.159:6789/0 conn(0x7f357c144b10 legacy=0x7f357c06e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0cbb00 con 0x7f357c0cb670 2023-11-26T07:18:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f3574001670 con 0x7f357c0cb670 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 >> v1:172.21.15.77:6789/0 conn(0x7f357c0cb670 legacy=0x7f357c0c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35640039a0 0x7f3564003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f357c06ef60 0x7f35640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3564004d00 0x7f3564005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c144ef0 con 0x7f35640039a0 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356400bb90 con 0x7f3564004d00 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356400bd50 con 0x7f357c06ef60 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.441+0000 7f3581a50640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35640039a0 0x7f3564003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.442+0000 7f3582251640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3564004d00 0x7f3564005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.442+0000 7f3581a50640 1 -- 172.21.15.77:0/3298241679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f357c06ef60 msgr2=0x7f35640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.442+0000 7f3581a50640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f357c06ef60 0x7f35640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.442+0000 7f3581a50640 1 -- 172.21.15.77:0/3298241679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3564004d00 msgr2=0x7f3564005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:37.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.442+0000 7f3581a50640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3564004d00 0x7f3564005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.442+0000 7f3581a50640 1 -- 172.21.15.77:0/3298241679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564003520 con 0x7f35640039a0 2023-11-26T07:18:37.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.442+0000 7f3582251640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3564004d00 0x7f3564005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.443+0000 7f3581a50640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35640039a0 0x7f3564003dc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f356c001e50 tx=0x7f35640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd83b2344c45c3f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.443+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c003b70 con 0x7f35640039a0 2023-11-26T07:18:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.443+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c003cd0 con 0x7f35640039a0 2023-11-26T07:18:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.443+0000 7f3580a4e640 1 -- 172.21.15.77:0/3298241679 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c005310 con 0x7f35640039a0 2023-11-26T07:18:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.444+0000 7f3582a52640 1 -- 172.21.15.77:0/3298241679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35640039a0 msgr2=0x7f3564003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.444+0000 7f3582a52640 1 --2- 172.21.15.77:0/3298241679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35640039a0 0x7f3564003dc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f356c001e50 tx=0x7f35640057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.444+0000 7f3582251640 1 -- 172.21.15.77:0/3298241679 reap_dead start 2023-11-26T07:18:37.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.444+0000 7f3582a52640 1 -- 172.21.15.77:0/3298241679 shutdown_connections 2023-11-26T07:18:37.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.444+0000 7f3582a52640 1 -- 172.21.15.77:0/3298241679 >> 172.21.15.77:0/3298241679 conn(0x7f357c0d1020 msgr2=0x7f357c0d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:37.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.444+0000 7f3582a52640 1 -- 172.21.15.77:0/3298241679 shutdown_connections 2023-11-26T07:18:37.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.444+0000 7f3582a52640 1 -- 172.21.15.77:0/3298241679 wait complete. 2023-11-26T07:18:37.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.446+0000 7f3582a52640 1 Processor -- start 2023-11-26T07:18:37.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.446+0000 7f3582a52640 1 -- start start 2023-11-26T07:18:37.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582a52640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35640039a0 0x7f357c15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582a52640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f357c15d4d0 0x7f357c140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582a52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357c0cd8d0 0x7f357c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582a52640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c13ee80 con 0x7f357c0cd8d0 2023-11-26T07:18:37.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582a52640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0ce290 con 0x7f357c15d4d0 2023-11-26T07:18:37.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582a52640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c15d2f0 con 0x7f35640039a0 2023-11-26T07:18:37.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582251640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357c0cd8d0 0x7f357c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582251640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357c0cd8d0 0x7f357c0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54992/0 (socket says 172.21.15.77:54992) 2023-11-26T07:18:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582251640 1 -- 172.21.15.77:0/1058794873 learned_addr learned my addr 172.21.15.77:0/1058794873 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3581a50640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35640039a0 0x7f357c15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f358124f640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f357c15d4d0 0x7f357c140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582251640 1 -- 172.21.15.77:0/1058794873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35640039a0 msgr2=0x7f357c15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582251640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35640039a0 0x7f357c15cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582251640 1 -- 172.21.15.77:0/1058794873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f357c15d4d0 msgr2=0x7f357c140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.447+0000 7f3582251640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f357c15d4d0 0x7f357c140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.448+0000 7f3582251640 1 -- 172.21.15.77:0/1058794873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c13e240 con 0x7f357c0cd8d0 2023-11-26T07:18:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.448+0000 7f3581a50640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35640039a0 0x7f357c15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.448+0000 7f3582251640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357c0cd8d0 0x7f357c0cdd50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3574000ff0 tx=0x7f357400d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.448+0000 7f357a7fc640 1 -- 172.21.15.77:0/1058794873 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574007440 con 0x7f357c0cd8d0 2023-11-26T07:18:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.448+0000 7f357a7fc640 1 -- 172.21.15.77:0/1058794873 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35740075c0 con 0x7f357c0cd8d0 2023-11-26T07:18:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.448+0000 7f3582a52640 1 -- 172.21.15.77:0/1058794873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c13e4e0 con 0x7f357c0cd8d0 2023-11-26T07:18:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.448+0000 7f357a7fc640 1 -- 172.21.15.77:0/1058794873 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574004a20 con 0x7f357c0cd8d0 2023-11-26T07:18:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.448+0000 7f3582a52640 1 -- 172.21.15.77:0/1058794873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c13eaa0 con 0x7f357c0cd8d0 2023-11-26T07:18:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.449+0000 7f3582a52640 1 -- 172.21.15.77:0/1058794873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c13ec90 con 0x7f357c0cd8d0 2023-11-26T07:18:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.450+0000 7f357a7fc640 1 -- 172.21.15.77:0/1058794873 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3574004b80 con 0x7f357c0cd8d0 2023-11-26T07:18:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.451+0000 7f357a7fc640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f356806ae40 0x7f356806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.451+0000 7f357a7fc640 1 -- 172.21.15.77:0/1058794873 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3574088db0 con 0x7f357c0cd8d0 2023-11-26T07:18:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.451+0000 7f3581a50640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f356806ae40 0x7f356806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.452+0000 7f3581a50640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f356806ae40 0x7f356806d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f356c034000 tx=0x7f356c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.455+0000 7f357a7fc640 1 -- 172.21.15.77:0/1058794873 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f357408d070 con 0x7f357c0cd8d0 2023-11-26T07:18:37.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.718+0000 7f3582a52640 1 -- 172.21.15.77:0/1058794873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f357c04e840 con 0x7f357c0cd8d0 2023-11-26T07:18:37.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.722+0000 7f357a7fc640 1 -- 172.21.15.77:0/1058794873 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3574054110 con 0x7f357c0cd8d0 2023-11-26T07:18:37.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 -- 172.21.15.77:0/1058794873 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f356806ae40 msgr2=0x7f356806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f356806ae40 0x7f356806d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f356c034000 tx=0x7f356c009030 comp rx=0 tx=0).stop 2023-11-26T07:18:37.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 -- 172.21.15.77:0/1058794873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357c0cd8d0 msgr2=0x7f357c0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357c0cd8d0 0x7f357c0cdd50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3574000ff0 tx=0x7f357400d9b0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 -- 172.21.15.77:0/1058794873 shutdown_connections 2023-11-26T07:18:37.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f356806ae40 0x7f356806d300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357c0cd8d0 0x7f357c0cdd50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f357c15d4d0 0x7f357c140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 --2- 172.21.15.77:0/1058794873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35640039a0 0x7f357c15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 -- 172.21.15.77:0/1058794873 >> 172.21.15.77:0/1058794873 conn(0x7f357c0d1020 msgr2=0x7f357c0cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:37.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 -- 172.21.15.77:0/1058794873 shutdown_connections 2023-11-26T07:18:37.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.725+0000 7f3582a52640 1 -- 172.21.15.77:0/1058794873 wait complete. 2023-11-26T07:18:37.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-26T07:18:37.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.957+0000 7f3fb32c9640 1 Processor -- start 2023-11-26T07:18:37.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.958+0000 7f3fb32c9640 1 -- start start 2023-11-26T07:18:37.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.959+0000 7f3fb32c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fac0cfb60 0x7f3fac161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.959+0000 7f3fb32c9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fac0ce0b0 con 0x7f3fac15dc80 2023-11-26T07:18:37.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.959+0000 7f3fb32c9640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fac161960 con 0x7f3fac157c70 2023-11-26T07:18:37.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.959+0000 7f3fb32c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fac15e8d0 con 0x7f3fac0cfb60 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.959+0000 7f3fb0864640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fac0cfb60 0x7f3fac161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.959+0000 7f3fb0864640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fac0cfb60 0x7f3fac161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55004/0 (socket says 172.21.15.77:55004) 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.959+0000 7f3fb0864640 1 -- 172.21.15.77:0/1203755043 learned_addr learned my addr 172.21.15.77:0/1203755043 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.959+0000 7f3fb1866640 1 --1- 172.21.15.77:0/1203755043 >> v1:172.21.15.77:6789/0 conn(0x7f3fac15dc80 0x7f3fac0b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40394/0 (socket says 172.21.15.77:40394) 2023-11-26T07:18:37.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.960+0000 7f3fb0864640 1 -- 172.21.15.77:0/1203755043 >> v1:172.21.15.159:6789/0 conn(0x7f3fac157c70 legacy=0x7f3fac0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:37.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.960+0000 7f3fb0864640 1 -- 172.21.15.77:0/1203755043 >> v1:172.21.15.77:6789/0 conn(0x7f3fac15dc80 legacy=0x7f3fac0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.960+0000 7f3fb0864640 1 -- 172.21.15.77:0/1203755043 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac15ebb0 con 0x7f3fac0cfb60 2023-11-26T07:18:37.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.960+0000 7f3f9ffff640 1 -- 172.21.15.77:0/1203755043 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546292627 0 0) 0x7f3fac0ce0b0 con 0x7f3fac15dc80 2023-11-26T07:18:37.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.961+0000 7f3fb0864640 1 --2- 172.21.15.77:0/1203755043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fac0cfb60 0x7f3fac161df0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009870 tx=0x7f3fa002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3ce6a6d3a48d14 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.961+0000 7f3f9ffff640 1 -- 172.21.15.77:0/1203755043 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0031870 con 0x7f3fac0cfb60 2023-11-26T07:18:37.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.961+0000 7f3f9ffff640 1 -- 172.21.15.77:0/1203755043 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa00319d0 con 0x7f3fac0cfb60 2023-11-26T07:18:37.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.961+0000 7f3f9ffff640 1 -- 172.21.15.77:0/1203755043 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0031d60 con 0x7f3fac0cfb60 2023-11-26T07:18:37.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.962+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1203755043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fac0cfb60 msgr2=0x7f3fac161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.962+0000 7f3fb32c9640 1 --2- 172.21.15.77:0/1203755043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fac0cfb60 0x7f3fac161df0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009870 tx=0x7f3fa002b910 comp rx=0 tx=0).stop 2023-11-26T07:18:37.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.962+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1203755043 shutdown_connections 2023-11-26T07:18:37.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.962+0000 7f3fb32c9640 1 --2- 172.21.15.77:0/1203755043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fac0cfb60 0x7f3fac161df0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.962+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1203755043 >> 172.21.15.77:0/1203755043 conn(0x7f3fac06a920 msgr2=0x7f3fac06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.962+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1203755043 shutdown_connections 2023-11-26T07:18:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.962+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1203755043 wait complete. 2023-11-26T07:18:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.964+0000 7f3fb32c9640 1 Processor -- start 2023-11-26T07:18:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.964+0000 7f3fb32c9640 1 -- start start 2023-11-26T07:18:37.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.965+0000 7f3fb32c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fac0cfb60 0x7f3fac146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.965+0000 7f3fb32c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fac157c70 0x7f3fac0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.965+0000 7f3fb32c9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fac15dc80 0x7f3fac145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.965+0000 7f3fb32c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac1471f0 con 0x7f3fac0cfb60 2023-11-26T07:18:37.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.965+0000 7f3fb32c9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac145c10 con 0x7f3fac15dc80 2023-11-26T07:18:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.965+0000 7f3fb32c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac145ef0 con 0x7f3fac157c70 2023-11-26T07:18:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.965+0000 7f3fb1065640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fac0cfb60 0x7f3fac146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.965+0000 7f3fb1065640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fac0cfb60 0x7f3fac146cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55020/0 (socket says 172.21.15.77:55020) 2023-11-26T07:18:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.965+0000 7f3fb1065640 1 -- 172.21.15.77:0/1141251349 learned_addr learned my addr 172.21.15.77:0/1141251349 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.966+0000 7f3fb1065640 1 -- 172.21.15.77:0/1141251349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fac157c70 msgr2=0x7f3fac0b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.966+0000 7f3fb1065640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fac157c70 0x7f3fac0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.966+0000 7f3fb1065640 1 -- 172.21.15.77:0/1141251349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fac15dc80 msgr2=0x7f3fac145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.966+0000 7f3fb1065640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fac15dc80 0x7f3fac145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.966+0000 7f3fb1065640 1 -- 172.21.15.77:0/1141251349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00094d0 con 0x7f3fac0cfb60 2023-11-26T07:18:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.966+0000 7f3fb1065640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fac0cfb60 0x7f3fac146cb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800c430 tx=0x7f3fa800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.966+0000 7f3f9dffb640 1 -- 172.21.15.77:0/1141251349 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8011790 con 0x7f3fac0cfb60 2023-11-26T07:18:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.966+0000 7f3f9dffb640 1 -- 172.21.15.77:0/1141251349 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa80118f0 con 0x7f3fac0cfb60 2023-11-26T07:18:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.966+0000 7f3f9dffb640 1 -- 172.21.15.77:0/1141251349 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8011ca0 con 0x7f3fac0cfb60 2023-11-26T07:18:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.966+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1141251349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fac1461d0 con 0x7f3fac0cfb60 2023-11-26T07:18:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.966+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1141251349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fac146790 con 0x7f3fac0cfb60 2023-11-26T07:18:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.967+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1141251349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fac067470 con 0x7f3fac0cfb60 2023-11-26T07:18:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.968+0000 7f3f9dffb640 1 -- 172.21.15.77:0/1141251349 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3fa801c460 con 0x7f3fac0cfb60 2023-11-26T07:18:37.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.969+0000 7f3f9dffb640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9006ae40 0x7f3f9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.969+0000 7f3f9dffb640 1 -- 172.21.15.77:0/1141251349 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3fa80892a0 con 0x7f3fac0cfb60 2023-11-26T07:18:37.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.970+0000 7f3fb0864640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9006ae40 0x7f3f9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.970+0000 7f3fb0864640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9006ae40 0x7f3f9006d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0036000 tx=0x7f3fa0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:37.973+0000 7f3f9dffb640 1 -- 172.21.15.77:0/1141251349 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3fa8054600 con 0x7f3fac0cfb60 2023-11-26T07:18:38.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.236+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1141251349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f3fac0b27c0 con 0x7f3fac0cfb60 2023-11-26T07:18:38.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.241+0000 7f3f9dffb640 1 -- 172.21.15.77:0/1141251349 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3fa8057c20 con 0x7f3fac0cfb60 2023-11-26T07:18:38.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1141251349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9006ae40 msgr2=0x7f3f9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9006ae40 0x7f3f9006d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0036000 tx=0x7f3fa0030000 comp rx=0 tx=0).stop 2023-11-26T07:18:38.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1141251349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fac0cfb60 msgr2=0x7f3fac146cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fac0cfb60 0x7f3fac146cb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800c430 tx=0x7f3fa800c8f0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1141251349 shutdown_connections 2023-11-26T07:18:38.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9006ae40 0x7f3f9006d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fac15dc80 0x7f3fac145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fac157c70 0x7f3fac0b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 --2- 172.21.15.77:0/1141251349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fac0cfb60 0x7f3fac146cb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1141251349 >> 172.21.15.77:0/1141251349 conn(0x7f3fac06a920 msgr2=0x7f3fac160260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:38.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1141251349 shutdown_connections 2023-11-26T07:18:38.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.244+0000 7f3fb32c9640 1 -- 172.21.15.77:0/1141251349 wait complete. 2023-11-26T07:18:38.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-26T07:18:38.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.471+0000 7f900703d640 1 Processor -- start 2023-11-26T07:18:38.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.471+0000 7f900703d640 1 -- start start 2023-11-26T07:18:38.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.473+0000 7f900703d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90000d1ed0 0x7f90000d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.473+0000 7f900703d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f90000d22b0 0x7f90000ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.473+0000 7f900703d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000ce710 0x7f90000cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.473+0000 7f900703d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90000ceb80 con 0x7f90000d1ed0 2023-11-26T07:18:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.473+0000 7f900703d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90000b2d90 con 0x7f90000d22b0 2023-11-26T07:18:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.473+0000 7f900703d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90000d1540 con 0x7f90000ce710 2023-11-26T07:18:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.473+0000 7f9004dd9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90000d1ed0 0x7f90000d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.473+0000 7f9004dd9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90000d1ed0 0x7f90000d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55034/0 (socket says 172.21.15.77:55034) 2023-11-26T07:18:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.473+0000 7f9004dd9640 1 -- 172.21.15.77:0/2840308003 learned_addr learned my addr 172.21.15.77:0/2840308003 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.473+0000 7f90055da640 1 --2- 172.21.15.77:0/2840308003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000ce710 0x7f90000cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.473+0000 7f8ffffff640 1 --2- 172.21.15.77:0/2840308003 >> v2:172.21.15.159:3300/0 conn(0x7f90000d22b0 0x7f90000ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.474+0000 7f9004dd9640 1 -- 172.21.15.77:0/2840308003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000ce710 msgr2=0x7f90000cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.474+0000 7f9004dd9640 1 --2- 172.21.15.77:0/2840308003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000ce710 0x7f90000cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.474+0000 7f9004dd9640 1 -- 172.21.15.77:0/2840308003 >> v2:172.21.15.159:3300/0 conn(0x7f90000d22b0 msgr2=0x7f90000ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.474+0000 7f9004dd9640 1 --2- 172.21.15.77:0/2840308003 >> v2:172.21.15.159:3300/0 conn(0x7f90000d22b0 0x7f90000ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.474+0000 7f9004dd9640 1 -- 172.21.15.77:0/2840308003 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90000b45f0 con 0x7f90000d1ed0 2023-11-26T07:18:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.474+0000 7f90055da640 1 --2- 172.21.15.77:0/2840308003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000ce710 0x7f90000cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.475+0000 7f9004dd9640 1 --2- 172.21.15.77:0/2840308003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90000d1ed0 0x7f90000d1000 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f900008bdd0 tx=0x7f8fe802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972f0004c09af711 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:38.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.475+0000 7f8fff7fe640 1 -- 172.21.15.77:0/2840308003 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80317e0 con 0x7f90000d1ed0 2023-11-26T07:18:38.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.475+0000 7f8fff7fe640 1 -- 172.21.15.77:0/2840308003 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe8031940 con 0x7f90000d1ed0 2023-11-26T07:18:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.475+0000 7f8fff7fe640 1 -- 172.21.15.77:0/2840308003 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8031cd0 con 0x7f90000d1ed0 2023-11-26T07:18:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.476+0000 7f900703d640 1 -- 172.21.15.77:0/2840308003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90000d1ed0 msgr2=0x7f90000d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.476+0000 7f900703d640 1 --2- 172.21.15.77:0/2840308003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90000d1ed0 0x7f90000d1000 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f900008bdd0 tx=0x7f8fe802b880 comp rx=0 tx=0).stop 2023-11-26T07:18:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.476+0000 7f900703d640 1 -- 172.21.15.77:0/2840308003 shutdown_connections 2023-11-26T07:18:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.476+0000 7f900703d640 1 --2- 172.21.15.77:0/2840308003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000ce710 0x7f90000cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.476+0000 7f900703d640 1 --2- 172.21.15.77:0/2840308003 >> v2:172.21.15.159:3300/0 conn(0x7f90000d22b0 0x7f90000ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.476+0000 7f900703d640 1 --2- 172.21.15.77:0/2840308003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90000d1ed0 0x7f90000d1000 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.476+0000 7f900703d640 1 -- 172.21.15.77:0/2840308003 >> 172.21.15.77:0/2840308003 conn(0x7f900008af60 msgr2=0x7f90000d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.476+0000 7f900703d640 1 -- 172.21.15.77:0/2840308003 shutdown_connections 2023-11-26T07:18:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.476+0000 7f900703d640 1 -- 172.21.15.77:0/2840308003 wait complete. 2023-11-26T07:18:38.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.478+0000 7f900703d640 1 Processor -- start 2023-11-26T07:18:38.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.478+0000 7f900703d640 1 -- start start 2023-11-26T07:18:38.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f900703d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90000ce710 0x7f90000ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f900703d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90000d1ed0 0x7f90000c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f900703d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000d22b0 0x7f90001e2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f900703d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90000caa40 con 0x7f90000d1ed0 2023-11-26T07:18:38.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f900703d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90001f4cc0 con 0x7f90000ce710 2023-11-26T07:18:38.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f900703d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90001f4fa0 con 0x7f90000d22b0 2023-11-26T07:18:38.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f8ffffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90000d1ed0 0x7f90000c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f8ffffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90000d1ed0 0x7f90000c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55048/0 (socket says 172.21.15.77:55048) 2023-11-26T07:18:38.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f8ffffff640 1 -- 172.21.15.77:0/3163523522 learned_addr learned my addr 172.21.15.77:0/3163523522 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:38.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f90055da640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000d22b0 0x7f90001e2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f9004dd9640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90000ce710 0x7f90000ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f8ffffff640 1 -- 172.21.15.77:0/3163523522 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000d22b0 msgr2=0x7f90001e2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f8ffffff640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000d22b0 0x7f90001e2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f8ffffff640 1 -- 172.21.15.77:0/3163523522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90000ce710 msgr2=0x7f90000ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f8ffffff640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90000ce710 0x7f90000ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.479+0000 7f8ffffff640 1 -- 172.21.15.77:0/3163523522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe80094d0 con 0x7f90000d1ed0 2023-11-26T07:18:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.480+0000 7f8ffffff640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90000d1ed0 0x7f90000c94d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000ccd0 tx=0x7f8ff000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.480+0000 7f8ffd7fa640 1 -- 172.21.15.77:0/3163523522 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0003990 con 0x7f90000d1ed0 2023-11-26T07:18:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.480+0000 7f8ffd7fa640 1 -- 172.21.15.77:0/3163523522 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0003af0 con 0x7f90000d1ed0 2023-11-26T07:18:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.480+0000 7f8ffd7fa640 1 -- 172.21.15.77:0/3163523522 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0004020 con 0x7f90000d1ed0 2023-11-26T07:18:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.480+0000 7f900703d640 1 -- 172.21.15.77:0/3163523522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90001f5280 con 0x7f90000d1ed0 2023-11-26T07:18:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.480+0000 7f900703d640 1 -- 172.21.15.77:0/3163523522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90001f5840 con 0x7f90000d1ed0 2023-11-26T07:18:38.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.481+0000 7f900703d640 1 -- 172.21.15.77:0/3163523522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9000067470 con 0x7f90000d1ed0 2023-11-26T07:18:38.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.482+0000 7f8ffd7fa640 1 -- 172.21.15.77:0/3163523522 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ff0004180 con 0x7f90000d1ed0 2023-11-26T07:18:38.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.483+0000 7f8ffd7fa640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe006ae40 0x7f8fe006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.483+0000 7f8ffd7fa640 1 -- 172.21.15.77:0/3163523522 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8ff00896a0 con 0x7f90000d1ed0 2023-11-26T07:18:38.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.483+0000 7f9004dd9640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe006ae40 0x7f8fe006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.484+0000 7f9004dd9640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe006ae40 0x7f8fe006d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8036000 tx=0x7f8fe803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:38.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.488+0000 7f8ffd7fa640 1 -- 172.21.15.77:0/3163523522 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8ff0054a90 con 0x7f90000d1ed0 2023-11-26T07:18:38.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.749+0000 7f900703d640 1 -- 172.21.15.77:0/3163523522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f90000b2b50 con 0x7f90000d1ed0 2023-11-26T07:18:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.753+0000 7f8ffd7fa640 1 -- 172.21.15.77:0/3163523522 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8ff001d020 con 0x7f90000d1ed0 2023-11-26T07:18:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 -- 172.21.15.77:0/3163523522 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe006ae40 msgr2=0x7f8fe006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe006ae40 0x7f8fe006d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8036000 tx=0x7f8fe803d040 comp rx=0 tx=0).stop 2023-11-26T07:18:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 -- 172.21.15.77:0/3163523522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90000d1ed0 msgr2=0x7f90000c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90000d1ed0 0x7f90000c94d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000ccd0 tx=0x7f8ff000a5c0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 -- 172.21.15.77:0/3163523522 shutdown_connections 2023-11-26T07:18:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe006ae40 0x7f8fe006d300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000d22b0 0x7f90001e2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90000d1ed0 0x7f90000c94d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 --2- 172.21.15.77:0/3163523522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90000ce710 0x7f90000ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 -- 172.21.15.77:0/3163523522 >> 172.21.15.77:0/3163523522 conn(0x7f900008af60 msgr2=0x7f90000b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 -- 172.21.15.77:0/3163523522 shutdown_connections 2023-11-26T07:18:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.756+0000 7f900703d640 1 -- 172.21.15.77:0/3163523522 wait complete. 2023-11-26T07:18:38.778 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-26T07:18:38.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.990+0000 7f940e50f640 1 Processor -- start 2023-11-26T07:18:38.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.991+0000 7f940e50f640 1 -- start start 2023-11-26T07:18:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.992+0000 7f940e50f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f940815c7f0 0x7f940806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.992+0000 7f940e50f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94080cece0 con 0x7f94080cf450 2023-11-26T07:18:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.992+0000 7f940e50f640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940806d040 con 0x7f94080ce6c0 2023-11-26T07:18:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.992+0000 7f940e50f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9408156010 con 0x7f940815c7f0 2023-11-26T07:18:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.993+0000 7f93fffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f94080cf450 0x7f94080cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40406/0 (socket says 172.21.15.77:40406) 2023-11-26T07:18:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.993+0000 7f93fffff640 1 -- 172.21.15.77:0/825327178 learned_addr learned my addr 172.21.15.77:0/825327178 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:38.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.993+0000 7f9407fff640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f940815c7f0 0x7f940806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.993+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865954832 0 0) 0x7f94080cece0 con 0x7f94080cf450 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.993+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f4003520 con 0x7f94080cf450 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3760833613 0 0) 0x7f93f4003520 con 0x7f94080cf450 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f940815c7f0 msgr2=0x7f940806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f940815c7f0 0x7f940806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 >> v1:172.21.15.159:6789/0 conn(0x7f94080ce6c0 legacy=0x7f94080714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940806d320 con 0x7f94080cf450 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f93f0001670 con 0x7f94080cf450 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 >> v1:172.21.15.77:6789/0 conn(0x7f94080cf450 legacy=0x7f94080cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f940815c7f0 0x7f93f40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93f4003f70 0x7f93f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 0x7f93f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9408156010 con 0x7f93f4004d00 2023-11-26T07:18:38.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f400bac0 con 0x7f93f4003f70 2023-11-26T07:18:38.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f400bc80 con 0x7f940815c7f0 2023-11-26T07:18:38.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.994+0000 7f940caac640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 0x7f93f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.995+0000 7f9407fff640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f940815c7f0 0x7f93f40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.995+0000 7f940caac640 1 -- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f940815c7f0 msgr2=0x7f93f40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.995+0000 7f93fffff640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93f4003f70 0x7f93f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.995+0000 7f940caac640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f940815c7f0 0x7f93f40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.995+0000 7f940caac640 1 -- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93f4003f70 msgr2=0x7f93f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.995+0000 7f940caac640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93f4003f70 0x7f93f40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.995+0000 7f940caac640 1 -- 172.21.15.77:0/825327178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f4003520 con 0x7f93f4004d00 2023-11-26T07:18:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.995+0000 7f9407fff640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f940815c7f0 0x7f93f40039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.995+0000 7f93fffff640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93f4003f70 0x7f93f40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.996+0000 7f940caac640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 0x7f93f4005180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9400001e50 tx=0x7f93f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38efab4f1a18aa2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.998+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400003b70 con 0x7f93f4004d00 2023-11-26T07:18:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.998+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9400003cd0 con 0x7f93f4004d00 2023-11-26T07:18:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.998+0000 7f94077fe640 1 -- 172.21.15.77:0/825327178 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400005310 con 0x7f93f4004d00 2023-11-26T07:18:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.998+0000 7f940e50f640 1 -- 172.21.15.77:0/825327178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 msgr2=0x7f93f4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.998+0000 7f940e50f640 1 --2- 172.21.15.77:0/825327178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 0x7f93f4005180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9400001e50 tx=0x7f93f40057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.998+0000 7f940caac640 1 -- 172.21.15.77:0/825327178 reap_dead start 2023-11-26T07:18:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.999+0000 7f940e50f640 1 -- 172.21.15.77:0/825327178 shutdown_connections 2023-11-26T07:18:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.999+0000 7f940e50f640 1 -- 172.21.15.77:0/825327178 >> 172.21.15.77:0/825327178 conn(0x7f940806a920 msgr2=0x7f940806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.999+0000 7f940e50f640 1 -- 172.21.15.77:0/825327178 shutdown_connections 2023-11-26T07:18:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:38.999+0000 7f940e50f640 1 -- 172.21.15.77:0/825327178 wait complete. 2023-11-26T07:18:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.001+0000 7f940e50f640 1 Processor -- start 2023-11-26T07:18:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.001+0000 7f940e50f640 1 -- start start 2023-11-26T07:18:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f940e50f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 0x7f9408156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f940e50f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9408152ae0 0x7f94080b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f940e50f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f940813d130 0x7f940813d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f940e50f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080b1b30 con 0x7f93f4004d00 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f940e50f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94081567f0 con 0x7f940813d130 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f940e50f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9408151d20 con 0x7f9408152ae0 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f9407fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 0x7f9408156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f9407fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 0x7f9408156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55058/0 (socket says 172.21.15.77:55058) 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f9407fff640 1 -- 172.21.15.77:0/963274497 learned_addr learned my addr 172.21.15.77:0/963274497 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f93fffff640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9408152ae0 0x7f94080b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f9407fff640 1 -- 172.21.15.77:0/963274497 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9408152ae0 msgr2=0x7f94080b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f9407fff640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9408152ae0 0x7f94080b15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f9407fff640 1 -- 172.21.15.77:0/963274497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f940813d130 msgr2=0x7f940813d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f9407fff640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f940813d130 0x7f940813d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.002+0000 7f9407fff640 1 -- 172.21.15.77:0/963274497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9408152000 con 0x7f93f4004d00 2023-11-26T07:18:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.003+0000 7f9407fff640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 0x7f9408156150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f93f80108b0 tx=0x7f93f8010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.003+0000 7f94057fa640 1 -- 172.21.15.77:0/963274497 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f800eae0 con 0x7f93f4004d00 2023-11-26T07:18:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.003+0000 7f94057fa640 1 -- 172.21.15.77:0/963274497 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f800ec40 con 0x7f93f4004d00 2023-11-26T07:18:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.003+0000 7f94057fa640 1 -- 172.21.15.77:0/963274497 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f801c400 con 0x7f93f4004d00 2023-11-26T07:18:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.003+0000 7f940e50f640 1 -- 172.21.15.77:0/963274497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94081522e0 con 0x7f93f4004d00 2023-11-26T07:18:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.003+0000 7f940e50f640 1 -- 172.21.15.77:0/963274497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940813daf0 con 0x7f93f4004d00 2023-11-26T07:18:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.004+0000 7f940e50f640 1 -- 172.21.15.77:0/963274497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9408067470 con 0x7f93f4004d00 2023-11-26T07:18:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.005+0000 7f94057fa640 1 -- 172.21.15.77:0/963274497 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f93f801c560 con 0x7f93f4004d00 2023-11-26T07:18:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.006+0000 7f94057fa640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93e806ae70 0x7f93e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.006+0000 7f94057fa640 1 -- 172.21.15.77:0/963274497 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93f8089930 con 0x7f93f4004d00 2023-11-26T07:18:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.006+0000 7f93fffff640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93e806ae70 0x7f93e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.007+0000 7f93fffff640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93e806ae70 0x7f93e806d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f94081f47f0 tx=0x7f93f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.010+0000 7f94057fa640 1 -- 172.21.15.77:0/963274497 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93f8054cb0 con 0x7f93f4004d00 2023-11-26T07:18:39.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.268+0000 7f940e50f640 1 -- 172.21.15.77:0/963274497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f94080cd730 con 0x7f93f4004d00 2023-11-26T07:18:39.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.272+0000 7f94057fa640 1 -- 172.21.15.77:0/963274497 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f93f80582d0 con 0x7f93f4004d00 2023-11-26T07:18:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.275+0000 7f940e50f640 1 -- 172.21.15.77:0/963274497 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93e806ae70 msgr2=0x7f93e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.275+0000 7f940e50f640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93e806ae70 0x7f93e806d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f94081f47f0 tx=0x7f93f0009040 comp rx=0 tx=0).stop 2023-11-26T07:18:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.275+0000 7f940e50f640 1 -- 172.21.15.77:0/963274497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 msgr2=0x7f9408156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.275+0000 7f940e50f640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 0x7f9408156150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f93f80108b0 tx=0x7f93f8010d70 comp rx=0 tx=0).stop 2023-11-26T07:18:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.275+0000 7f940e50f640 1 -- 172.21.15.77:0/963274497 shutdown_connections 2023-11-26T07:18:39.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.275+0000 7f940e50f640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f93e806ae70 0x7f93e806d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.275+0000 7f940e50f640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f940813d130 0x7f940813d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.276+0000 7f940e50f640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9408152ae0 0x7f94080b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.276+0000 7f940e50f640 1 --2- 172.21.15.77:0/963274497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f4004d00 0x7f9408156150 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.276+0000 7f940e50f640 1 -- 172.21.15.77:0/963274497 >> 172.21.15.77:0/963274497 conn(0x7f940806a920 msgr2=0x7f9408153fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:39.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.276+0000 7f940e50f640 1 -- 172.21.15.77:0/963274497 shutdown_connections 2023-11-26T07:18:39.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.276+0000 7f940e50f640 1 -- 172.21.15.77:0/963274497 wait complete. 2023-11-26T07:18:39.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-26T07:18:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.506+0000 7f74288ee640 1 Processor -- start 2023-11-26T07:18:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.506+0000 7f74288ee640 1 -- start start 2023-11-26T07:18:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.507+0000 7f74288ee640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f74240d4010 0x7f74240cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.507+0000 7f74288ee640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74240cf300 con 0x7f742415d580 2023-11-26T07:18:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.507+0000 7f74288ee640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74240d1090 con 0x7f74240cfc80 2023-11-26T07:18:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.507+0000 7f74288ee640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74240d1370 con 0x7f74240d4010 2023-11-26T07:18:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.508+0000 7f742259c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f742415d580 0x7f74240d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40412/0 (socket says 172.21.15.77:40412) 2023-11-26T07:18:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.508+0000 7f742259c640 1 -- 172.21.15.77:0/1044918418 learned_addr learned my addr 172.21.15.77:0/1044918418 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.508+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019993863 0 0) 0x7f74240cf300 con 0x7f742415d580 2023-11-26T07:18:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.508+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7410003520 con 0x7f742415d580 2023-11-26T07:18:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.508+0000 7f7421d9b640 1 --2- 172.21.15.77:0/1044918418 >> v2:172.21.15.159:3300/0 conn(0x7f74240d4010 0x7f74240cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.508+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3487220579 0 0) 0x7f7410003520 con 0x7f742415d580 2023-11-26T07:18:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.508+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 >> v2:172.21.15.159:3300/0 conn(0x7f74240d4010 msgr2=0x7f74240cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.508+0000 7f742159a640 1 --2- 172.21.15.77:0/1044918418 >> v2:172.21.15.159:3300/0 conn(0x7f74240d4010 0x7f74240cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.508+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 >> v1:172.21.15.159:6789/0 conn(0x7f74240cfc80 legacy=0x7f74240d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.508+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74240d1650 con 0x7f742415d580 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.508+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f7414001670 con 0x7f742415d580 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 >> v1:172.21.15.77:6789/0 conn(0x7f742415d580 legacy=0x7f74240d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f742159a640 1 --2- 172.21.15.77:0/1044918418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7410003970 0x7f7410003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f742159a640 1 --2- 172.21.15.77:0/1044918418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 0x7f7410004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f742159a640 1 --2- 172.21.15.77:0/1044918418 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7410005180 0x7f741000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74240d1370 con 0x7f74100047c0 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741000c0d0 con 0x7f7410003970 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741000c290 con 0x7f7410005180 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f7421d9b640 1 --2- 172.21.15.77:0/1044918418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 0x7f7410004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f742259c640 1 --2- 172.21.15.77:0/1044918418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7410003970 0x7f7410003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f7421d9b640 1 -- 172.21.15.77:0/1044918418 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7410005180 msgr2=0x7f741000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:39.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f7421d9b640 1 --2- 172.21.15.77:0/1044918418 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7410005180 0x7f741000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f7421d9b640 1 -- 172.21.15.77:0/1044918418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7410003970 msgr2=0x7f7410003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:39.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f7421d9b640 1 --2- 172.21.15.77:0/1044918418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7410003970 0x7f7410003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f7421d9b640 1 -- 172.21.15.77:0/1044918418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7410003520 con 0x7f74100047c0 2023-11-26T07:18:39.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.509+0000 7f7422d9d640 1 -- 172.21.15.77:0/1044918418 reap_dead start 2023-11-26T07:18:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.511+0000 7f7421d9b640 1 --2- 172.21.15.77:0/1044918418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 0x7f7410004c40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f740c007360 tx=0x7f74100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2458f44806b81d65 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.511+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c02ccd0 con 0x7f74100047c0 2023-11-26T07:18:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.511+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c02ce30 con 0x7f74100047c0 2023-11-26T07:18:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.511+0000 7f742159a640 1 -- 172.21.15.77:0/1044918418 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c034660 con 0x7f74100047c0 2023-11-26T07:18:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.511+0000 7f74288ee640 1 -- 172.21.15.77:0/1044918418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 msgr2=0x7f7410004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.511+0000 7f74288ee640 1 --2- 172.21.15.77:0/1044918418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 0x7f7410004c40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f740c007360 tx=0x7f74100057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.511+0000 7f74288ee640 1 -- 172.21.15.77:0/1044918418 shutdown_connections 2023-11-26T07:18:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.511+0000 7f74288ee640 1 --2- 172.21.15.77:0/1044918418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 0x7f7410004c40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.512+0000 7f74288ee640 1 -- 172.21.15.77:0/1044918418 >> 172.21.15.77:0/1044918418 conn(0x7f742409c770 msgr2=0x7f74240d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.512+0000 7f74288ee640 1 -- 172.21.15.77:0/1044918418 shutdown_connections 2023-11-26T07:18:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.512+0000 7f74288ee640 1 -- 172.21.15.77:0/1044918418 wait complete. 2023-11-26T07:18:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.514+0000 7f74288ee640 1 Processor -- start 2023-11-26T07:18:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.514+0000 7f74288ee640 1 -- start start 2023-11-26T07:18:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.515+0000 7f74288ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 0x7f742414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.515+0000 7f74288ee640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74241f3410 0x7f74241f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.515+0000 7f74288ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74240b7db0 0x7f74240b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.515+0000 7f74288ee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74240b8770 con 0x7f74100047c0 2023-11-26T07:18:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.515+0000 7f74288ee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74241f4ae0 con 0x7f74240b7db0 2023-11-26T07:18:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.515+0000 7f74288ee640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74241f3ed0 con 0x7f74241f3410 2023-11-26T07:18:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.515+0000 7f742259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 0x7f742414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.515+0000 7f742259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 0x7f742414aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55064/0 (socket says 172.21.15.77:55064) 2023-11-26T07:18:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.515+0000 7f742259c640 1 -- 172.21.15.77:0/2838844316 learned_addr learned my addr 172.21.15.77:0/2838844316 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.515+0000 7f7421d9b640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74241f3410 0x7f74241f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.515+0000 7f7422d9d640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74240b7db0 0x7f74240b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f742259c640 1 -- 172.21.15.77:0/2838844316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74241f3410 msgr2=0x7f74241f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f742259c640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74241f3410 0x7f74241f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f742259c640 1 -- 172.21.15.77:0/2838844316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74240b7db0 msgr2=0x7f74240b8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f742259c640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74240b7db0 0x7f74240b8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f742259c640 1 -- 172.21.15.77:0/2838844316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74241f41b0 con 0x7f74100047c0 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f7421d9b640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74241f3410 0x7f74241f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f7422d9d640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74240b7db0 0x7f74240b8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f742259c640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 0x7f742414aa50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f741400e8c0 tx=0x7f741400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f741affd640 1 -- 172.21.15.77:0/2838844316 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400c870 con 0x7f74100047c0 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f741affd640 1 -- 172.21.15.77:0/2838844316 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741400c9d0 con 0x7f74100047c0 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f741affd640 1 -- 172.21.15.77:0/2838844316 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400cd80 con 0x7f74100047c0 2023-11-26T07:18:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f74288ee640 1 -- 172.21.15.77:0/2838844316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74241f4490 con 0x7f74100047c0 2023-11-26T07:18:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.516+0000 7f74288ee640 1 -- 172.21.15.77:0/2838844316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7424157b30 con 0x7f74100047c0 2023-11-26T07:18:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.518+0000 7f74288ee640 1 -- 172.21.15.77:0/2838844316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7424157cc0 con 0x7f74100047c0 2023-11-26T07:18:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.519+0000 7f741affd640 1 -- 172.21.15.77:0/2838844316 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f741401d460 con 0x7f74100047c0 2023-11-26T07:18:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.519+0000 7f741affd640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f740406ae40 0x7f740406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.520+0000 7f741affd640 1 -- 172.21.15.77:0/2838844316 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f74140893f0 con 0x7f74100047c0 2023-11-26T07:18:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.520+0000 7f7421d9b640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f740406ae40 0x7f740406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.521+0000 7f7421d9b640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f740406ae40 0x7f740406d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f740c036000 tx=0x7f740c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.524+0000 7f741affd640 1 -- 172.21.15.77:0/2838844316 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f74140547e0 con 0x7f74100047c0 2023-11-26T07:18:39.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.783+0000 7f74288ee640 1 -- 172.21.15.77:0/2838844316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f742404e8b0 con 0x7f74100047c0 2023-11-26T07:18:39.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.788+0000 7f741affd640 1 -- 172.21.15.77:0/2838844316 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7414057e00 con 0x7f74100047c0 2023-11-26T07:18:39.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.790+0000 7f74288ee640 1 -- 172.21.15.77:0/2838844316 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f740406ae40 msgr2=0x7f740406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.790+0000 7f74288ee640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f740406ae40 0x7f740406d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f740c036000 tx=0x7f740c030000 comp rx=0 tx=0).stop 2023-11-26T07:18:39.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.790+0000 7f74288ee640 1 -- 172.21.15.77:0/2838844316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 msgr2=0x7f742414aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.790+0000 7f74288ee640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 0x7f742414aa50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f741400e8c0 tx=0x7f741400ed80 comp rx=0 tx=0).stop 2023-11-26T07:18:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.791+0000 7f74288ee640 1 -- 172.21.15.77:0/2838844316 shutdown_connections 2023-11-26T07:18:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.791+0000 7f74288ee640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f740406ae40 0x7f740406d300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.791+0000 7f74288ee640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74240b7db0 0x7f74240b8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.791+0000 7f74288ee640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74241f3410 0x7f74241f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.791+0000 7f74288ee640 1 --2- 172.21.15.77:0/2838844316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74100047c0 0x7f742414aa50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.791+0000 7f74288ee640 1 -- 172.21.15.77:0/2838844316 >> 172.21.15.77:0/2838844316 conn(0x7f742409c770 msgr2=0x7f74240d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.791+0000 7f74288ee640 1 -- 172.21.15.77:0/2838844316 shutdown_connections 2023-11-26T07:18:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:39.791+0000 7f74288ee640 1 -- 172.21.15.77:0/2838844316 wait complete. 2023-11-26T07:18:39.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-26T07:18:40.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.023+0000 7fed335b0640 1 Processor -- start 2023-11-26T07:18:40.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.024+0000 7fed335b0640 1 -- start start 2023-11-26T07:18:40.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.025+0000 7fed335b0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed2c15c7f0 0x7fed2c06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.025+0000 7fed335b0640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fed2c0cf450 0x7fed2c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.025+0000 7fed335b0640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c0cece0 con 0x7fed2c0cdfb0 2023-11-26T07:18:40.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.025+0000 7fed335b0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c0cfe40 con 0x7fed2c15c7f0 2023-11-26T07:18:40.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.025+0000 7fed335b0640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c0ceaf0 con 0x7fed2c0cf450 2023-11-26T07:18:40.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.025+0000 7fed3134c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed2c15c7f0 0x7fed2c06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.026+0000 7fed3134c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed2c15c7f0 0x7fed2c06db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55068/0 (socket says 172.21.15.77:55068) 2023-11-26T07:18:40.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.026+0000 7fed3134c640 1 -- 172.21.15.77:0/4112801863 learned_addr learned my addr 172.21.15.77:0/4112801863 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:40.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.026+0000 7fed30b4b640 1 --2- 172.21.15.77:0/4112801863 >> v2:172.21.15.159:3300/0 conn(0x7fed2c0cf450 0x7fed2c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.026+0000 7fed3134c640 1 -- 172.21.15.77:0/4112801863 >> v2:172.21.15.159:3300/0 conn(0x7fed2c0cf450 msgr2=0x7fed2c0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:40.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.026+0000 7fed3134c640 1 --2- 172.21.15.77:0/4112801863 >> v2:172.21.15.159:3300/0 conn(0x7fed2c0cf450 0x7fed2c0cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.026+0000 7fed3134c640 1 -- 172.21.15.77:0/4112801863 >> v1:172.21.15.159:6789/0 conn(0x7fed2c0cdfb0 legacy=0x7fed2c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:40.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.026+0000 7fed3134c640 1 -- 172.21.15.77:0/4112801863 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c06d040 con 0x7fed2c15c7f0 2023-11-26T07:18:40.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.026+0000 7fed30b4b640 1 --2- 172.21.15.77:0/4112801863 >> v2:172.21.15.159:3300/0 conn(0x7fed2c0cf450 0x7fed2c0cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:40.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.027+0000 7fed3134c640 1 --2- 172.21.15.77:0/4112801863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed2c15c7f0 0x7fed2c06db20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fed2c070410 tx=0x7fed2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b410e61d32a662ec server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.028+0000 7fed23fff640 1 -- 172.21.15.77:0/4112801863 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28031870 con 0x7fed2c15c7f0 2023-11-26T07:18:40.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.028+0000 7fed23fff640 1 -- 172.21.15.77:0/4112801863 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed280319d0 con 0x7fed2c15c7f0 2023-11-26T07:18:40.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.028+0000 7fed23fff640 1 -- 172.21.15.77:0/4112801863 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28031d60 con 0x7fed2c15c7f0 2023-11-26T07:18:40.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.029+0000 7fed335b0640 1 -- 172.21.15.77:0/4112801863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed2c15c7f0 msgr2=0x7fed2c06db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.029+0000 7fed335b0640 1 --2- 172.21.15.77:0/4112801863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed2c15c7f0 0x7fed2c06db20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fed2c070410 tx=0x7fed2802b910 comp rx=0 tx=0).stop 2023-11-26T07:18:40.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.029+0000 7fed335b0640 1 -- 172.21.15.77:0/4112801863 shutdown_connections 2023-11-26T07:18:40.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.029+0000 7fed335b0640 1 --2- 172.21.15.77:0/4112801863 >> v2:172.21.15.159:3300/0 conn(0x7fed2c0cf450 0x7fed2c0cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.029+0000 7fed335b0640 1 --2- 172.21.15.77:0/4112801863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed2c15c7f0 0x7fed2c06db20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.029+0000 7fed335b0640 1 -- 172.21.15.77:0/4112801863 >> 172.21.15.77:0/4112801863 conn(0x7fed2c06a920 msgr2=0x7fed2c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:40.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.029+0000 7fed335b0640 1 -- 172.21.15.77:0/4112801863 shutdown_connections 2023-11-26T07:18:40.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.029+0000 7fed335b0640 1 -- 172.21.15.77:0/4112801863 wait complete. 2023-11-26T07:18:40.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.031+0000 7fed335b0640 1 Processor -- start 2023-11-26T07:18:40.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.031+0000 7fed335b0640 1 -- start start 2023-11-26T07:18:40.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed335b0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed2c0cdfb0 0x7fed2c0b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed335b0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed2c0cf450 0x7fed2c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed335b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed2c15c7f0 0x7fed2c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed335b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0b36d0 con 0x7fed2c15c7f0 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed335b0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0b2a50 con 0x7fed2c0cdfb0 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed335b0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0b2d30 con 0x7fed2c0cf450 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed31b4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed2c15c7f0 0x7fed2c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed31b4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed2c15c7f0 0x7fed2c153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55074/0 (socket says 172.21.15.77:55074) 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed31b4d640 1 -- 172.21.15.77:0/3680128262 learned_addr learned my addr 172.21.15.77:0/3680128262 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed3134c640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed2c0cdfb0 0x7fed2c0b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed31b4d640 1 -- 172.21.15.77:0/3680128262 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed2c0cf450 msgr2=0x7fed2c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed31b4d640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed2c0cf450 0x7fed2c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed31b4d640 1 -- 172.21.15.77:0/3680128262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed2c0cdfb0 msgr2=0x7fed2c0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed31b4d640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed2c0cdfb0 0x7fed2c0b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed31b4d640 1 -- 172.21.15.77:0/3680128262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed280094d0 con 0x7fed2c15c7f0 2023-11-26T07:18:40.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.032+0000 7fed3134c640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed2c0cdfb0 0x7fed2c0b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:40.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.033+0000 7fed31b4d640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed2c15c7f0 0x7fed2c153070 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c780 tx=0x7fed2400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.033+0000 7fed21ffb640 1 -- 172.21.15.77:0/3680128262 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24004b10 con 0x7fed2c15c7f0 2023-11-26T07:18:40.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.033+0000 7fed21ffb640 1 -- 172.21.15.77:0/3680128262 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24004c70 con 0x7fed2c15c7f0 2023-11-26T07:18:40.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.033+0000 7fed21ffb640 1 -- 172.21.15.77:0/3680128262 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2400aa90 con 0x7fed2c15c7f0 2023-11-26T07:18:40.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.033+0000 7fed335b0640 1 -- 172.21.15.77:0/3680128262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c0b3010 con 0x7fed2c15c7f0 2023-11-26T07:18:40.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.033+0000 7fed335b0640 1 -- 172.21.15.77:0/3680128262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c0b4030 con 0x7fed2c15c7f0 2023-11-26T07:18:40.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.035+0000 7fed335b0640 1 -- 172.21.15.77:0/3680128262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c0b3810 con 0x7fed2c15c7f0 2023-11-26T07:18:40.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.035+0000 7fed21ffb640 1 -- 172.21.15.77:0/3680128262 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed2400abf0 con 0x7fed2c15c7f0 2023-11-26T07:18:40.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.036+0000 7fed21ffb640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed1006ae40 0x7fed1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.036+0000 7fed21ffb640 1 -- 172.21.15.77:0/3680128262 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fed24089370 con 0x7fed2c15c7f0 2023-11-26T07:18:40.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.037+0000 7fed3134c640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed1006ae40 0x7fed1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.037+0000 7fed3134c640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed1006ae40 0x7fed1006d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fed28036000 tx=0x7fed2803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.040+0000 7fed21ffb640 1 -- 172.21.15.77:0/3680128262 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed2c0b3810 con 0x7fed2c15c7f0 2023-11-26T07:18:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.300+0000 7fed335b0640 1 -- 172.21.15.77:0/3680128262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fed2c0b3810 con 0x7fed2c15c7f0 2023-11-26T07:18:40.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.304+0000 7fed21ffb640 1 -- 172.21.15.77:0/3680128262 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fed2c0b3810 con 0x7fed2c15c7f0 2023-11-26T07:18:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 -- 172.21.15.77:0/3680128262 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed1006ae40 msgr2=0x7fed1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed1006ae40 0x7fed1006d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fed28036000 tx=0x7fed2803c040 comp rx=0 tx=0).stop 2023-11-26T07:18:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 -- 172.21.15.77:0/3680128262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed2c15c7f0 msgr2=0x7fed2c153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed2c15c7f0 0x7fed2c153070 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c780 tx=0x7fed2400cc40 comp rx=0 tx=0).stop 2023-11-26T07:18:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 -- 172.21.15.77:0/3680128262 shutdown_connections 2023-11-26T07:18:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed1006ae40 0x7fed1006d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed2c15c7f0 0x7fed2c153070 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed2c0cf450 0x7fed2c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 --2- 172.21.15.77:0/3680128262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed2c0cdfb0 0x7fed2c0b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 -- 172.21.15.77:0/3680128262 >> 172.21.15.77:0/3680128262 conn(0x7fed2c06a920 msgr2=0x7fed2c0cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 -- 172.21.15.77:0/3680128262 shutdown_connections 2023-11-26T07:18:40.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.307+0000 7fed335b0640 1 -- 172.21.15.77:0/3680128262 wait complete. 2023-11-26T07:18:40.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:40.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.523+0000 7f7f0bd53640 1 Processor -- start 2023-11-26T07:18:40.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.523+0000 7f7f0bd53640 1 -- start start 2023-11-26T07:18:40.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.524+0000 7f7f0bd53640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7f04157c70 0x7f7f04161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.524+0000 7f7f0bd53640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7f040cf450 0x7f7f040cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.524+0000 7f7f0bd53640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f040ce0b0 con 0x7f7f0415dc80 2023-11-26T07:18:40.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.524+0000 7f7f0bd53640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f040cfe40 con 0x7f7f040cf450 2023-11-26T07:18:40.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.524+0000 7f7f0bd53640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f04161960 con 0x7f7f04157c70 2023-11-26T07:18:40.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.525+0000 7f7f092ee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7f040cf450 0x7f7f040cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.525+0000 7f7f092ee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7f040cf450 0x7f7f040cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55076/0 (socket says 172.21.15.77:55076) 2023-11-26T07:18:40.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.525+0000 7f7f092ee640 1 -- 172.21.15.77:0/3079614783 learned_addr learned my addr 172.21.15.77:0/3079614783 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:40.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.525+0000 7f7f09aef640 1 --2- 172.21.15.77:0/3079614783 >> v2:172.21.15.159:3300/0 conn(0x7f7f04157c70 0x7f7f04161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.525+0000 7f7f092ee640 1 -- 172.21.15.77:0/3079614783 >> v2:172.21.15.159:3300/0 conn(0x7f7f04157c70 msgr2=0x7f7f04161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:40.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.525+0000 7f7f092ee640 1 --2- 172.21.15.77:0/3079614783 >> v2:172.21.15.159:3300/0 conn(0x7f7f04157c70 0x7f7f04161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.525+0000 7f7f092ee640 1 -- 172.21.15.77:0/3079614783 >> v1:172.21.15.159:6789/0 conn(0x7f7f0415dc80 legacy=0x7f7f0415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:40.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.526+0000 7f7f092ee640 1 -- 172.21.15.77:0/3079614783 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0415e8d0 con 0x7f7f040cf450 2023-11-26T07:18:40.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.527+0000 7f7f092ee640 1 --2- 172.21.15.77:0/3079614783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f040cf450 0x7f7f040cf900 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7f0406d5e0 tx=0x7f7ef402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fc6f72dc03e0c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.527+0000 7f7f08aed640 1 -- 172.21.15.77:0/3079614783 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4031870 con 0x7f7f040cf450 2023-11-26T07:18:40.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.527+0000 7f7f08aed640 1 -- 172.21.15.77:0/3079614783 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef40319d0 con 0x7f7f040cf450 2023-11-26T07:18:40.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.527+0000 7f7f08aed640 1 -- 172.21.15.77:0/3079614783 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4031d60 con 0x7f7f040cf450 2023-11-26T07:18:40.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.528+0000 7f7f0bd53640 1 -- 172.21.15.77:0/3079614783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f040cf450 msgr2=0x7f7f040cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.528+0000 7f7f0bd53640 1 --2- 172.21.15.77:0/3079614783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f040cf450 0x7f7f040cf900 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7f0406d5e0 tx=0x7f7ef402b910 comp rx=0 tx=0).stop 2023-11-26T07:18:40.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.528+0000 7f7f0bd53640 1 -- 172.21.15.77:0/3079614783 shutdown_connections 2023-11-26T07:18:40.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.528+0000 7f7f0bd53640 1 --2- 172.21.15.77:0/3079614783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f040cf450 0x7f7f040cf900 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.528+0000 7f7f0bd53640 1 --2- 172.21.15.77:0/3079614783 >> v2:172.21.15.159:3300/0 conn(0x7f7f04157c70 0x7f7f04161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.528+0000 7f7f0bd53640 1 -- 172.21.15.77:0/3079614783 >> 172.21.15.77:0/3079614783 conn(0x7f7f0406a920 msgr2=0x7f7f0406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:40.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.528+0000 7f7f0bd53640 1 -- 172.21.15.77:0/3079614783 shutdown_connections 2023-11-26T07:18:40.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.528+0000 7f7f0bd53640 1 -- 172.21.15.77:0/3079614783 wait complete. 2023-11-26T07:18:40.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.530+0000 7f7f0bd53640 1 Processor -- start 2023-11-26T07:18:40.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.530+0000 7f7f0bd53640 1 -- start start 2023-11-26T07:18:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f0bd53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f040cf450 0x7f7f041f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f0bd53640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f04157c70 0x7f7f041f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f0bd53640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f0415dc80 0x7f7f041f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f0bd53640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040c8da0 con 0x7f7f040cf450 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f0bd53640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040c8fb0 con 0x7f7f0415dc80 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f0bd53640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040c9290 con 0x7f7f04157c70 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f09aef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f040cf450 0x7f7f041f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f09aef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f040cf450 0x7f7f041f7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55082/0 (socket says 172.21.15.77:55082) 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f09aef640 1 -- 172.21.15.77:0/2267882496 learned_addr learned my addr 172.21.15.77:0/2267882496 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f092ee640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f04157c70 0x7f7f041f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f09aef640 1 -- 172.21.15.77:0/2267882496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f04157c70 msgr2=0x7f7f041f7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f09aef640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f04157c70 0x7f7f041f7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f09aef640 1 -- 172.21.15.77:0/2267882496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f0415dc80 msgr2=0x7f7f041f8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f09aef640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f0415dc80 0x7f7f041f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.531+0000 7f7f09aef640 1 -- 172.21.15.77:0/2267882496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef40094d0 con 0x7f7f040cf450 2023-11-26T07:18:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.532+0000 7f7f09aef640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f040cf450 0x7f7f041f7600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000d800 tx=0x7f7f0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.532+0000 7f7efa7fc640 1 -- 172.21.15.77:0/2267882496 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000b6c0 con 0x7f7f040cf450 2023-11-26T07:18:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.532+0000 7f7efa7fc640 1 -- 172.21.15.77:0/2267882496 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0000b820 con 0x7f7f040cf450 2023-11-26T07:18:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.532+0000 7f7efa7fc640 1 -- 172.21.15.77:0/2267882496 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000bbb0 con 0x7f7f040cf450 2023-11-26T07:18:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.532+0000 7f7f0bd53640 1 -- 172.21.15.77:0/2267882496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f040c9570 con 0x7f7f040cf450 2023-11-26T07:18:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.532+0000 7f7f0bd53640 1 -- 172.21.15.77:0/2267882496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f040c9b30 con 0x7f7f040cf450 2023-11-26T07:18:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.533+0000 7f7f0bd53640 1 -- 172.21.15.77:0/2267882496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f040c9cc0 con 0x7f7f040cf450 2023-11-26T07:18:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.534+0000 7f7efa7fc640 1 -- 172.21.15.77:0/2267882496 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f0000bd10 con 0x7f7f040cf450 2023-11-26T07:18:40.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.535+0000 7f7efa7fc640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ee806ae40 0x7f7ee806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.536+0000 7f7efa7fc640 1 -- 172.21.15.77:0/2267882496 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7f00089860 con 0x7f7f040cf450 2023-11-26T07:18:40.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.536+0000 7f7f092ee640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ee806ae40 0x7f7ee806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.536+0000 7f7f092ee640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ee806ae40 0x7f7ee806d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4036000 tx=0x7f7ef403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.540+0000 7f7efa7fc640 1 -- 172.21.15.77:0/2267882496 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f00054c60 con 0x7f7f040cf450 2023-11-26T07:18:40.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.732+0000 7f7f0bd53640 1 -- 172.21.15.77:0/2267882496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f04061a50 con 0x7f7f040cf450 2023-11-26T07:18:40.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.734+0000 7f7efa7fc640 1 -- 172.21.15.77:0/2267882496 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12833 (secure 0 0 0) 0x7f7f00058280 con 0x7f7f040cf450 2023-11-26T07:18:40.737 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:40.737 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":30,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:18:36.667408+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:40.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.738+0000 7f7f0bd53640 1 -- 172.21.15.77:0/2267882496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ee806ae40 msgr2=0x7f7ee806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.738+0000 7f7f0bd53640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ee806ae40 0x7f7ee806d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4036000 tx=0x7f7ef403c040 comp rx=0 tx=0).stop 2023-11-26T07:18:40.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.738+0000 7f7f0bd53640 1 -- 172.21.15.77:0/2267882496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f040cf450 msgr2=0x7f7f041f7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.738+0000 7f7f0bd53640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f040cf450 0x7f7f041f7600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000d800 tx=0x7f7f0000dcc0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.738+0000 7f7f0bd53640 1 -- 172.21.15.77:0/2267882496 shutdown_connections 2023-11-26T07:18:40.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.738+0000 7f7f0bd53640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ee806ae40 0x7f7ee806d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.738+0000 7f7f0bd53640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f0415dc80 0x7f7f041f8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.738+0000 7f7f0bd53640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f04157c70 0x7f7f041f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.738+0000 7f7f0bd53640 1 --2- 172.21.15.77:0/2267882496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f040cf450 0x7f7f041f7600 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.739+0000 7f7f0bd53640 1 -- 172.21.15.77:0/2267882496 >> 172.21.15.77:0/2267882496 conn(0x7f7f0406a920 msgr2=0x7f7f040affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:40.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.739+0000 7f7f0bd53640 1 -- 172.21.15.77:0/2267882496 shutdown_connections 2023-11-26T07:18:40.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.739+0000 7f7f0bd53640 1 -- 172.21.15.77:0/2267882496 wait complete. 2023-11-26T07:18:40.760 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:40.760 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:40.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.971+0000 7f3e09383640 1 Processor -- start 2023-11-26T07:18:40.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.971+0000 7f3e09383640 1 -- start start 2023-11-26T07:18:40.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.972+0000 7f3e09383640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040cb580 0x7f3e040c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.972+0000 7f3e09383640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3e040c25d0 0x7f3e040b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.972+0000 7f3e09383640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e040cb960 con 0x7f3e040ca940 2023-11-26T07:18:40.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.972+0000 7f3e09383640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e040c2a40 con 0x7f3e040c25d0 2023-11-26T07:18:40.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.973+0000 7f3e09383640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04161e40 con 0x7f3e040cb580 2023-11-26T07:18:40.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.973+0000 7f3e03fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040cb580 0x7f3e040c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.973+0000 7f3e03fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040cb580 0x7f3e040c2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:39494/0 (socket says 172.21.15.77:39494) 2023-11-26T07:18:40.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.973+0000 7f3e03fff640 1 -- 172.21.15.77:0/2019892036 learned_addr learned my addr 172.21.15.77:0/2019892036 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:40.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.974+0000 7f3e08b82640 1 --2- 172.21.15.77:0/2019892036 >> v2:172.21.15.159:3300/0 conn(0x7f3e040c25d0 0x7f3e040b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.974+0000 7f3e03fff640 1 -- 172.21.15.77:0/2019892036 >> v2:172.21.15.159:3300/0 conn(0x7f3e040c25d0 msgr2=0x7f3e040b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:40.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.974+0000 7f3e03fff640 1 --2- 172.21.15.77:0/2019892036 >> v2:172.21.15.159:3300/0 conn(0x7f3e040c25d0 0x7f3e040b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.974+0000 7f3e03fff640 1 -- 172.21.15.77:0/2019892036 >> v1:172.21.15.159:6789/0 conn(0x7f3e040ca940 legacy=0x7f3e040b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.974+0000 7f3e03fff640 1 -- 172.21.15.77:0/2019892036 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04162120 con 0x7f3e040cb580 2023-11-26T07:18:40.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.974+0000 7f3e037fe640 1 -- 172.21.15.77:0/2019892036 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980953768 0 0) 0x7f3e040cb960 con 0x7f3e040ca940 2023-11-26T07:18:40.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.975+0000 7f3e03fff640 1 --2- 172.21.15.77:0/2019892036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040cb580 0x7f3e040c2090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009870 tx=0x7f3df402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f1de055087063da server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.976+0000 7f3e037fe640 1 -- 172.21.15.77:0/2019892036 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4030840 con 0x7f3e040cb580 2023-11-26T07:18:40.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.976+0000 7f3e037fe640 1 -- 172.21.15.77:0/2019892036 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df40309a0 con 0x7f3e040cb580 2023-11-26T07:18:40.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.976+0000 7f3e037fe640 1 -- 172.21.15.77:0/2019892036 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4030d30 con 0x7f3e040cb580 2023-11-26T07:18:40.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.977+0000 7f3e09383640 1 -- 172.21.15.77:0/2019892036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040cb580 msgr2=0x7f3e040c2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.977+0000 7f3e09383640 1 --2- 172.21.15.77:0/2019892036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040cb580 0x7f3e040c2090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009870 tx=0x7f3df402b980 comp rx=0 tx=0).stop 2023-11-26T07:18:40.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.977+0000 7f3e09383640 1 -- 172.21.15.77:0/2019892036 shutdown_connections 2023-11-26T07:18:40.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.977+0000 7f3e09383640 1 --2- 172.21.15.77:0/2019892036 >> v2:172.21.15.159:3300/0 conn(0x7f3e040c25d0 0x7f3e040b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.977+0000 7f3e09383640 1 --2- 172.21.15.77:0/2019892036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040cb580 0x7f3e040c2090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.977+0000 7f3e09383640 1 -- 172.21.15.77:0/2019892036 >> 172.21.15.77:0/2019892036 conn(0x7f3e040cbb40 msgr2=0x7f3e040cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:40.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.977+0000 7f3e09383640 1 -- 172.21.15.77:0/2019892036 shutdown_connections 2023-11-26T07:18:40.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.977+0000 7f3e09383640 1 -- 172.21.15.77:0/2019892036 wait complete. 2023-11-26T07:18:40.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.979+0000 7f3e09383640 1 Processor -- start 2023-11-26T07:18:40.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.979+0000 7f3e09383640 1 -- start start 2023-11-26T07:18:40.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.980+0000 7f3e09383640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040c25d0 0x7f3e04157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.980+0000 7f3e09383640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e040ca940 0x7f3e0409a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.980+0000 7f3e09383640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e040cb580 0x7f3e0409ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.980+0000 7f3e09383640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0409c750 con 0x7f3e040cb580 2023-11-26T07:18:40.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.980+0000 7f3e09383640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c3ff0 con 0x7f3e040ca940 2023-11-26T07:18:40.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.980+0000 7f3e09383640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c3160 con 0x7f3e040c25d0 2023-11-26T07:18:40.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.980+0000 7f3e08b82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e040cb580 0x7f3e0409ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.980+0000 7f3e08b82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e040cb580 0x7f3e0409ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55084/0 (socket says 172.21.15.77:55084) 2023-11-26T07:18:40.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.980+0000 7f3e08b82640 1 -- 172.21.15.77:0/225289153 learned_addr learned my addr 172.21.15.77:0/225289153 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:40.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.980+0000 7f3e03fff640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040c25d0 0x7f3e04157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.980+0000 7f3dfbfff640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e040ca940 0x7f3e0409a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.981+0000 7f3e08b82640 1 -- 172.21.15.77:0/225289153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040c25d0 msgr2=0x7f3e04157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.981+0000 7f3e08b82640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040c25d0 0x7f3e04157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.981+0000 7f3e08b82640 1 -- 172.21.15.77:0/225289153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e040ca940 msgr2=0x7f3e0409a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.981+0000 7f3e08b82640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e040ca940 0x7f3e0409a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.981+0000 7f3e08b82640 1 -- 172.21.15.77:0/225289153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df40094d0 con 0x7f3e040cb580 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.981+0000 7f3e08b82640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e040cb580 0x7f3e0409ac50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00efc0 tx=0x7f3dfc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.981+0000 7f3e017fa640 1 -- 172.21.15.77:0/225289153 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc014480 con 0x7f3e040cb580 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.981+0000 7f3e017fa640 1 -- 172.21.15.77:0/225289153 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc00f040 con 0x7f3e040cb580 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.981+0000 7f3e017fa640 1 -- 172.21.15.77:0/225289153 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc014820 con 0x7f3e040cb580 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.981+0000 7f3e09383640 1 -- 172.21.15.77:0/225289153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e040c3440 con 0x7f3e040cb580 2023-11-26T07:18:40.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.981+0000 7f3e09383640 1 -- 172.21.15.77:0/225289153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e040c3a00 con 0x7f3e040cb580 2023-11-26T07:18:40.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.983+0000 7f3e09383640 1 -- 172.21.15.77:0/225289153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e040c41a0 con 0x7f3e040cb580 2023-11-26T07:18:40.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.983+0000 7f3e017fa640 1 -- 172.21.15.77:0/225289153 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3dfc014980 con 0x7f3e040cb580 2023-11-26T07:18:40.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.985+0000 7f3e017fa640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3de406ae90 0x7f3de406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.985+0000 7f3e017fa640 1 -- 172.21.15.77:0/225289153 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3dfc08a1f0 con 0x7f3e040cb580 2023-11-26T07:18:40.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.985+0000 7f3e03fff640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3de406ae90 0x7f3de406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.986+0000 7f3e03fff640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3de406ae90 0x7f3de406d350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3df4036000 tx=0x7f3df403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:40.990+0000 7f3e017fa640 1 -- 172.21.15.77:0/225289153 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e040c41a0 con 0x7f3e040cb580 2023-11-26T07:18:41.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.165+0000 7f3e09383640 1 -- 172.21.15.77:0/225289153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e040c4160 con 0x7f3e040cb580 2023-11-26T07:18:41.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.166+0000 7f3e017fa640 1 -- 172.21.15.77:0/225289153 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3dfc0555d0 con 0x7f3e040cb580 2023-11-26T07:18:41.168 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:18:41.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.168+0000 7f3e09383640 1 -- 172.21.15.77:0/225289153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3de406ae90 msgr2=0x7f3de406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.168+0000 7f3e09383640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3de406ae90 0x7f3de406d350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3df4036000 tx=0x7f3df403b040 comp rx=0 tx=0).stop 2023-11-26T07:18:41.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.168+0000 7f3e09383640 1 -- 172.21.15.77:0/225289153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e040cb580 msgr2=0x7f3e0409ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.168+0000 7f3e09383640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e040cb580 0x7f3e0409ac50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00efc0 tx=0x7f3dfc00c490 comp rx=0 tx=0).stop 2023-11-26T07:18:41.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.168+0000 7f3e09383640 1 -- 172.21.15.77:0/225289153 shutdown_connections 2023-11-26T07:18:41.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.168+0000 7f3e09383640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3de406ae90 0x7f3de406d350 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.168+0000 7f3e09383640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e040cb580 0x7f3e0409ac50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.168+0000 7f3e09383640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e040ca940 0x7f3e0409a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.168+0000 7f3e09383640 1 --2- 172.21.15.77:0/225289153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e040c25d0 0x7f3e04157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.168+0000 7f3e09383640 1 -- 172.21.15.77:0/225289153 >> 172.21.15.77:0/225289153 conn(0x7f3e040cbb40 msgr2=0x7f3e0406e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.168+0000 7f3e09383640 1 -- 172.21.15.77:0/225289153 shutdown_connections 2023-11-26T07:18:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.169+0000 7f3e09383640 1 -- 172.21.15.77:0/225289153 wait complete. 2023-11-26T07:18:41.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:18:41.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.397+0000 7f7edd173640 1 Processor -- start 2023-11-26T07:18:41.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.397+0000 7f7edd173640 1 -- start start 2023-11-26T07:18:41.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.399+0000 7f7edd173640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7ed815d4e0 0x7f7ed80d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.399+0000 7f7edd173640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7ed80d0240 0x7f7ed80b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.399+0000 7f7edd173640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed80ce990 con 0x7f7ed80d38e0 2023-11-26T07:18:41.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.399+0000 7f7edd173640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed80d4110 con 0x7f7ed815d4e0 2023-11-26T07:18:41.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.399+0000 7f7edd173640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed80cec70 con 0x7f7ed80d0240 2023-11-26T07:18:41.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.399+0000 7f7ed7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7ed815d4e0 0x7f7ed80d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.399+0000 7f7ed77fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7ed80d38e0 0x7f7ed80cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40428/0 (socket says 172.21.15.77:40428) 2023-11-26T07:18:41.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.399+0000 7f7ed77fe640 1 -- 172.21.15.77:0/352175135 learned_addr learned my addr 172.21.15.77:0/352175135 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:41.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.400+0000 7f7edc972640 1 --2- 172.21.15.77:0/352175135 >> v2:172.21.15.159:3300/0 conn(0x7f7ed80d0240 0x7f7ed80b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.400+0000 7f7ed7fff640 1 -- 172.21.15.77:0/352175135 >> v2:172.21.15.159:3300/0 conn(0x7f7ed80d0240 msgr2=0x7f7ed80b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:41.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.400+0000 7f7ed7fff640 1 --2- 172.21.15.77:0/352175135 >> v2:172.21.15.159:3300/0 conn(0x7f7ed80d0240 0x7f7ed80b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.400+0000 7f7ed7fff640 1 -- 172.21.15.77:0/352175135 >> v1:172.21.15.77:6789/0 conn(0x7f7ed80d38e0 legacy=0x7f7ed80cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.400+0000 7f7ed7fff640 1 -- 172.21.15.77:0/352175135 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80cef50 con 0x7f7ed815d4e0 2023-11-26T07:18:41.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.400+0000 7f7edc972640 1 --2- 172.21.15.77:0/352175135 >> v2:172.21.15.159:3300/0 conn(0x7f7ed80d0240 0x7f7ed80b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:41.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.400+0000 7f7ed6ffd640 1 -- 172.21.15.77:0/352175135 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605654116 0 0) 0x7f7ed80ce990 con 0x7f7ed80d38e0 2023-11-26T07:18:41.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.401+0000 7f7ed7fff640 1 --2- 172.21.15.77:0/352175135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed815d4e0 0x7f7ed80d1e20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7ed806b1d0 tx=0x7f7ec802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa1c0d76a727414 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.401+0000 7f7ed6ffd640 1 -- 172.21.15.77:0/352175135 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec802cc80 con 0x7f7ed815d4e0 2023-11-26T07:18:41.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.401+0000 7f7ed6ffd640 1 -- 172.21.15.77:0/352175135 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec802cde0 con 0x7f7ed815d4e0 2023-11-26T07:18:41.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.401+0000 7f7ed6ffd640 1 -- 172.21.15.77:0/352175135 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8034660 con 0x7f7ed815d4e0 2023-11-26T07:18:41.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.402+0000 7f7edd173640 1 -- 172.21.15.77:0/352175135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed815d4e0 msgr2=0x7f7ed80d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.402+0000 7f7edd173640 1 --2- 172.21.15.77:0/352175135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed815d4e0 0x7f7ed80d1e20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7ed806b1d0 tx=0x7f7ec802bed0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.402+0000 7f7edd173640 1 -- 172.21.15.77:0/352175135 shutdown_connections 2023-11-26T07:18:41.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.402+0000 7f7edd173640 1 --2- 172.21.15.77:0/352175135 >> v2:172.21.15.159:3300/0 conn(0x7f7ed80d0240 0x7f7ed80b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.402+0000 7f7edd173640 1 --2- 172.21.15.77:0/352175135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed815d4e0 0x7f7ed80d1e20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.402+0000 7f7edd173640 1 -- 172.21.15.77:0/352175135 >> 172.21.15.77:0/352175135 conn(0x7f7ed809c510 msgr2=0x7f7ed80d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:41.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.402+0000 7f7edd173640 1 -- 172.21.15.77:0/352175135 shutdown_connections 2023-11-26T07:18:41.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.402+0000 7f7edd173640 1 -- 172.21.15.77:0/352175135 wait complete. 2023-11-26T07:18:41.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.404+0000 7f7edd173640 1 Processor -- start 2023-11-26T07:18:41.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.404+0000 7f7edd173640 1 -- start start 2023-11-26T07:18:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.405+0000 7f7edd173640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ed80d0240 0x7f7ed80b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.405+0000 7f7edd173640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed80d38e0 0x7f7ed81526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.405+0000 7f7edd173640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed815d4e0 0x7f7ed81f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.405+0000 7f7edd173640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80b6cb0 con 0x7f7ed815d4e0 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.405+0000 7f7edd173640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80b79e0 con 0x7f7ed80d0240 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.405+0000 7f7edd173640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80ccc70 con 0x7f7ed80d38e0 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.405+0000 7f7edc972640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed815d4e0 0x7f7ed81f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.405+0000 7f7edc972640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed815d4e0 0x7f7ed81f6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55110/0 (socket says 172.21.15.77:55110) 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.405+0000 7f7edc972640 1 -- 172.21.15.77:0/3902240621 learned_addr learned my addr 172.21.15.77:0/3902240621 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7ed7fff640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ed80d0240 0x7f7ed80b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7edc972640 1 -- 172.21.15.77:0/3902240621 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed80d38e0 msgr2=0x7f7ed81526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7edc972640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed80d38e0 0x7f7ed81526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7edc972640 1 -- 172.21.15.77:0/3902240621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ed80d0240 msgr2=0x7f7ed80b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7edc972640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ed80d0240 0x7f7ed80b74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7edc972640 1 -- 172.21.15.77:0/3902240621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec8009a70 con 0x7f7ed815d4e0 2023-11-26T07:18:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7edc972640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed815d4e0 0x7f7ed81f6570 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000c7f0 tx=0x7f7ed000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7ed4ff9640 1 -- 172.21.15.77:0/3902240621 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0007820 con 0x7f7ed815d4e0 2023-11-26T07:18:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7ed4ff9640 1 -- 172.21.15.77:0/3902240621 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed0007980 con 0x7f7ed815d4e0 2023-11-26T07:18:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7edd173640 1 -- 172.21.15.77:0/3902240621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed80ccf50 con 0x7f7ed815d4e0 2023-11-26T07:18:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7ed4ff9640 1 -- 172.21.15.77:0/3902240621 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0007d70 con 0x7f7ed815d4e0 2023-11-26T07:18:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.406+0000 7f7edd173640 1 -- 172.21.15.77:0/3902240621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed8152c30 con 0x7f7ed815d4e0 2023-11-26T07:18:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.407+0000 7f7edd173640 1 -- 172.21.15.77:0/3902240621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed804e840 con 0x7f7ed815d4e0 2023-11-26T07:18:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.408+0000 7f7ed4ff9640 1 -- 172.21.15.77:0/3902240621 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ed00113f0 con 0x7f7ed815d4e0 2023-11-26T07:18:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.409+0000 7f7ed4ff9640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 0x7f7eb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.409+0000 7f7ed4ff9640 1 -- 172.21.15.77:0/3902240621 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ed00896b0 con 0x7f7ed815d4e0 2023-11-26T07:18:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.409+0000 7f7ed7fff640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 0x7f7eb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.410+0000 7f7ed7fff640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 0x7f7eb806d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8036000 tx=0x7f7ec8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.414+0000 7f7ed4ff9640 1 -- 172.21.15.77:0/3902240621 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ed0054aa0 con 0x7f7ed815d4e0 2023-11-26T07:18:41.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.604+0000 7f7edd173640 1 -- 172.21.15.77:0/3902240621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7ed806bfb0 con 0x7f7ed815d4e0 2023-11-26T07:18:41.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.604+0000 7f7ed4ff9640 1 -- 172.21.15.77:0/3902240621 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7ed00580c0 con 0x7f7ed815d4e0 2023-11-26T07:18:41.607 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:41.607 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-26T07:18:41.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:18:41.607 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-11-26T07:18:41.607 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-11-26T07:18:41.607 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:18:41.607 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-26T07:18:41.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 -- 172.21.15.77:0/3902240621 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 msgr2=0x7f7eb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 0x7f7eb806d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8036000 tx=0x7f7ec8030000 comp rx=0 tx=0).stop 2023-11-26T07:18:41.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 -- 172.21.15.77:0/3902240621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed815d4e0 msgr2=0x7f7ed81f6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed815d4e0 0x7f7ed81f6570 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000c7f0 tx=0x7f7ed000ccb0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 -- 172.21.15.77:0/3902240621 shutdown_connections 2023-11-26T07:18:41.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7eb806ae40 0x7f7eb806d300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed815d4e0 0x7f7ed81f6570 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ed80d38e0 0x7f7ed81526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 --2- 172.21.15.77:0/3902240621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ed80d0240 0x7f7ed80b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 -- 172.21.15.77:0/3902240621 >> 172.21.15.77:0/3902240621 conn(0x7f7ed809c510 msgr2=0x7f7ed806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:41.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 -- 172.21.15.77:0/3902240621 shutdown_connections 2023-11-26T07:18:41.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.607+0000 7f7edd173640 1 -- 172.21.15.77:0/3902240621 wait complete. 2023-11-26T07:18:41.627 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:18:41.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:18:41.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.829+0000 7f125896c640 1 Processor -- start 2023-11-26T07:18:41.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.829+0000 7f125896c640 1 -- start start 2023-11-26T07:18:41.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.830+0000 7f125896c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f125415d730 0x7f12540cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.830+0000 7f125896c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f12540cf6d0 0x7f12540d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.830+0000 7f125896c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12540ce0f0 con 0x7f125415d350 2023-11-26T07:18:41.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.830+0000 7f125896c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540ce3d0 con 0x7f12540cf6d0 2023-11-26T07:18:41.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.830+0000 7f125896c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540ce6b0 con 0x7f125415d730 2023-11-26T07:18:41.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.830+0000 7f1253fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f12540cf6d0 0x7f12540d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.830+0000 7f1253fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f12540cf6d0 0x7f12540d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55122/0 (socket says 172.21.15.77:55122) 2023-11-26T07:18:41.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.830+0000 7f1253fff640 1 -- 172.21.15.77:0/3535482087 learned_addr learned my addr 172.21.15.77:0/3535482087 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:41.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.831+0000 7f1252ffd640 1 --2- 172.21.15.77:0/3535482087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f125415d730 0x7f12540cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.831+0000 7f1253fff640 1 -- 172.21.15.77:0/3535482087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f125415d730 msgr2=0x7f12540cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:41.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.831+0000 7f1253fff640 1 --2- 172.21.15.77:0/3535482087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f125415d730 0x7f12540cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.831+0000 7f1253fff640 1 -- 172.21.15.77:0/3535482087 >> v1:172.21.15.159:6789/0 conn(0x7f125415d350 legacy=0x7f1254161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:41.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.831+0000 7f1253fff640 1 -- 172.21.15.77:0/3535482087 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540ce990 con 0x7f12540cf6d0 2023-11-26T07:18:41.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.831+0000 7f1252ffd640 1 --2- 172.21.15.77:0/3535482087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f125415d730 0x7f12540cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:41.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.832+0000 7f1253fff640 1 --2- 172.21.15.77:0/3535482087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12540cf6d0 0x7f12540d1670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f124c009870 tx=0x7f124c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0109fb3468a7ab6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.832+0000 7f12527fc640 1 -- 172.21.15.77:0/3535482087 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c030840 con 0x7f12540cf6d0 2023-11-26T07:18:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.832+0000 7f12527fc640 1 -- 172.21.15.77:0/3535482087 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c0309a0 con 0x7f12540cf6d0 2023-11-26T07:18:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.832+0000 7f12527fc640 1 -- 172.21.15.77:0/3535482087 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c030d30 con 0x7f12540cf6d0 2023-11-26T07:18:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.833+0000 7f125896c640 1 -- 172.21.15.77:0/3535482087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12540cf6d0 msgr2=0x7f12540d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.833+0000 7f125896c640 1 --2- 172.21.15.77:0/3535482087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12540cf6d0 0x7f12540d1670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f124c009870 tx=0x7f124c02b980 comp rx=0 tx=0).stop 2023-11-26T07:18:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.833+0000 7f125896c640 1 -- 172.21.15.77:0/3535482087 shutdown_connections 2023-11-26T07:18:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.833+0000 7f125896c640 1 --2- 172.21.15.77:0/3535482087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12540cf6d0 0x7f12540d1670 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.833+0000 7f125896c640 1 --2- 172.21.15.77:0/3535482087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f125415d730 0x7f12540cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.833+0000 7f125896c640 1 -- 172.21.15.77:0/3535482087 >> 172.21.15.77:0/3535482087 conn(0x7f125408cc00 msgr2=0x7f125409c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.833+0000 7f125896c640 1 -- 172.21.15.77:0/3535482087 shutdown_connections 2023-11-26T07:18:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.833+0000 7f125896c640 1 -- 172.21.15.77:0/3535482087 wait complete. 2023-11-26T07:18:41.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.835+0000 7f125896c640 1 Processor -- start 2023-11-26T07:18:41.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.835+0000 7f125896c640 1 -- start start 2023-11-26T07:18:41.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.836+0000 7f125896c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125415d350 0x7f12540a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.836+0000 7f125896c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f125415d730 0x7f12540b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.836+0000 7f125896c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12541f2f70 0x7f125415fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.836+0000 7f125896c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12541f4100 con 0x7f125415d730 2023-11-26T07:18:41.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.836+0000 7f125896c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12541f34b0 con 0x7f125415d350 2023-11-26T07:18:41.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.836+0000 7f125896c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12541f3790 con 0x7f12541f2f70 2023-11-26T07:18:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.836+0000 7f1252ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f125415d730 0x7f12540b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.836+0000 7f1252ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f125415d730 0x7f12540b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55130/0 (socket says 172.21.15.77:55130) 2023-11-26T07:18:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.836+0000 7f1252ffd640 1 -- 172.21.15.77:0/371871679 learned_addr learned my addr 172.21.15.77:0/371871679 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.836+0000 7f12537fe640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125415d350 0x7f12540a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f1252ffd640 1 -- 172.21.15.77:0/371871679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12541f2f70 msgr2=0x7f125415fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f1252ffd640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12541f2f70 0x7f125415fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f1252ffd640 1 -- 172.21.15.77:0/371871679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125415d350 msgr2=0x7f12540a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f1252ffd640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125415d350 0x7f12540a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f1252ffd640 1 -- 172.21.15.77:0/371871679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c0094d0 con 0x7f125415d730 2023-11-26T07:18:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f12537fe640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125415d350 0x7f12540a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f1252ffd640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f125415d730 0x7f12540b3c90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f123c00c7c0 tx=0x7f123c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f124bfff640 1 -- 172.21.15.77:0/371871679 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c007820 con 0x7f125415d730 2023-11-26T07:18:41.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f124bfff640 1 -- 172.21.15.77:0/371871679 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c007980 con 0x7f125415d730 2023-11-26T07:18:41.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f124bfff640 1 -- 172.21.15.77:0/371871679 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c007d10 con 0x7f125415d730 2023-11-26T07:18:41.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f125896c640 1 -- 172.21.15.77:0/371871679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12541f3a70 con 0x7f125415d730 2023-11-26T07:18:41.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.837+0000 7f125896c640 1 -- 172.21.15.77:0/371871679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12540b41d0 con 0x7f125415d730 2023-11-26T07:18:41.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.838+0000 7f125896c640 1 -- 172.21.15.77:0/371871679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125404e840 con 0x7f125415d730 2023-11-26T07:18:41.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.839+0000 7f124bfff640 1 -- 172.21.15.77:0/371871679 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f123c0113f0 con 0x7f125415d730 2023-11-26T07:18:41.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.840+0000 7f124bfff640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f123406ae70 0x7f123406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.840+0000 7f124bfff640 1 -- 172.21.15.77:0/371871679 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f123c0892d0 con 0x7f125415d730 2023-11-26T07:18:41.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.840+0000 7f12537fe640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f123406ae70 0x7f123406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.841+0000 7f12537fe640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f123406ae70 0x7f123406d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1244004520 tx=0x7f1244009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:41.844+0000 7f124bfff640 1 -- 172.21.15.77:0/371871679 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f123c0546c0 con 0x7f125415d730 2023-11-26T07:18:41.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-26T07:18:41.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-26T07:18:41.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-26T07:18:41.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-26T07:18:42.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.033+0000 7f125896c640 1 -- 172.21.15.77:0/371871679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1254073e10 con 0x7f125415d730 2023-11-26T07:18:42.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.293+0000 7f124bfff640 1 -- 172.21.15.77:0/371871679 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f123c057ce0 con 0x7f125415d730 2023-11-26T07:18:42.296 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-11-26T07:18:42.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.296+0000 7f125896c640 1 -- 172.21.15.77:0/371871679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f123406ae70 msgr2=0x7f123406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.297+0000 7f125896c640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f123406ae70 0x7f123406d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1244004520 tx=0x7f1244009040 comp rx=0 tx=0).stop 2023-11-26T07:18:42.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.297+0000 7f125896c640 1 -- 172.21.15.77:0/371871679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f125415d730 msgr2=0x7f12540b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.297+0000 7f125896c640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f125415d730 0x7f12540b3c90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f123c00c7c0 tx=0x7f123c00cc80 comp rx=0 tx=0).stop 2023-11-26T07:18:42.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.297+0000 7f125896c640 1 -- 172.21.15.77:0/371871679 shutdown_connections 2023-11-26T07:18:42.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.297+0000 7f125896c640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f123406ae70 0x7f123406d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.297+0000 7f125896c640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12541f2f70 0x7f125415fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.297+0000 7f125896c640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f125415d730 0x7f12540b3c90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.297+0000 7f125896c640 1 --2- 172.21.15.77:0/371871679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125415d350 0x7f12540a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.297+0000 7f125896c640 1 -- 172.21.15.77:0/371871679 >> 172.21.15.77:0/371871679 conn(0x7f125408cc00 msgr2=0x7f125415c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:42.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.297+0000 7f125896c640 1 -- 172.21.15.77:0/371871679 shutdown_connections 2023-11-26T07:18:42.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.297+0000 7f125896c640 1 -- 172.21.15.77:0/371871679 wait complete. 2023-11-26T07:18:42.324 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:18:42.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.530+0000 7fd6de483640 1 Processor -- start 2023-11-26T07:18:42.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.530+0000 7fd6de483640 1 -- start start 2023-11-26T07:18:42.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.532+0000 7fd6de483640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd6d8146eb0 0x7fd6d8161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.532+0000 7fd6de483640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd6d806e160 0x7fd6d80ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.532+0000 7fd6de483640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d8161a10 con 0x7fd6d80cd110 2023-11-26T07:18:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.532+0000 7fd6de483640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d80cd580 con 0x7fd6d806e160 2023-11-26T07:18:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.532+0000 7fd6de483640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d8161cf0 con 0x7fd6d8146eb0 2023-11-26T07:18:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.532+0000 7fd6d77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd6d806e160 0x7fd6d80ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.532+0000 7fd6d77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd6d806e160 0x7fd6d80ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55134/0 (socket says 172.21.15.77:55134) 2023-11-26T07:18:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.532+0000 7fd6d77fe640 1 -- 172.21.15.77:0/3272830972 learned_addr learned my addr 172.21.15.77:0/3272830972 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.533+0000 7fd6d77fe640 1 -- 172.21.15.77:0/3272830972 >> v2:172.21.15.159:3300/0 conn(0x7fd6d8146eb0 msgr2=0x7fd6d8161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.533+0000 7fd6d77fe640 1 --2- 172.21.15.77:0/3272830972 >> v2:172.21.15.159:3300/0 conn(0x7fd6d8146eb0 0x7fd6d8161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.533+0000 7fd6d77fe640 1 -- 172.21.15.77:0/3272830972 >> v1:172.21.15.159:6789/0 conn(0x7fd6d80cd110 legacy=0x7fd6d806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.533+0000 7fd6d77fe640 1 -- 172.21.15.77:0/3272830972 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8161fd0 con 0x7fd6d806e160 2023-11-26T07:18:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.534+0000 7fd6d77fe640 1 --2- 172.21.15.77:0/3272830972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d806e160 0x7fd6d80ccbd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd6d806ea50 tx=0x7fd6c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b61661341a2adc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.534+0000 7fd6d6ffd640 1 -- 172.21.15.77:0/3272830972 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0031870 con 0x7fd6d806e160 2023-11-26T07:18:42.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.534+0000 7fd6d6ffd640 1 -- 172.21.15.77:0/3272830972 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c00319d0 con 0x7fd6d806e160 2023-11-26T07:18:42.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.534+0000 7fd6d6ffd640 1 -- 172.21.15.77:0/3272830972 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0031d60 con 0x7fd6d806e160 2023-11-26T07:18:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.535+0000 7fd6de483640 1 -- 172.21.15.77:0/3272830972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d806e160 msgr2=0x7fd6d80ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.535+0000 7fd6de483640 1 --2- 172.21.15.77:0/3272830972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d806e160 0x7fd6d80ccbd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd6d806ea50 tx=0x7fd6c002b910 comp rx=0 tx=0).stop 2023-11-26T07:18:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.535+0000 7fd6de483640 1 -- 172.21.15.77:0/3272830972 shutdown_connections 2023-11-26T07:18:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.535+0000 7fd6de483640 1 --2- 172.21.15.77:0/3272830972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d806e160 0x7fd6d80ccbd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.535+0000 7fd6de483640 1 --2- 172.21.15.77:0/3272830972 >> v2:172.21.15.159:3300/0 conn(0x7fd6d8146eb0 0x7fd6d8161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.535+0000 7fd6de483640 1 -- 172.21.15.77:0/3272830972 >> 172.21.15.77:0/3272830972 conn(0x7fd6d80b0c50 msgr2=0x7fd6d80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.535+0000 7fd6de483640 1 -- 172.21.15.77:0/3272830972 shutdown_connections 2023-11-26T07:18:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.535+0000 7fd6de483640 1 -- 172.21.15.77:0/3272830972 wait complete. 2023-11-26T07:18:42.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.537+0000 7fd6de483640 1 Processor -- start 2023-11-26T07:18:42.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.537+0000 7fd6de483640 1 -- start start 2023-11-26T07:18:42.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6de483640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6d806e160 0x7fd6d815e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6de483640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80cd110 0x7fd6d815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6de483640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8146eb0 0x7fd6d80b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6de483640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80b26e0 con 0x7fd6d8146eb0 2023-11-26T07:18:42.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6de483640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80b1db0 con 0x7fd6d80cd110 2023-11-26T07:18:42.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6de483640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80b2090 con 0x7fd6d806e160 2023-11-26T07:18:42.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6dca20640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8146eb0 0x7fd6d80b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6dca20640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8146eb0 0x7fd6d80b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55144/0 (socket says 172.21.15.77:55144) 2023-11-26T07:18:42.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6dca20640 1 -- 172.21.15.77:0/2733362578 learned_addr learned my addr 172.21.15.77:0/2733362578 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:42.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6dca20640 1 -- 172.21.15.77:0/2733362578 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6d806e160 msgr2=0x7fd6d815e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6dca20640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6d806e160 0x7fd6d815e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6dca20640 1 -- 172.21.15.77:0/2733362578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80cd110 msgr2=0x7fd6d815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6d77fe640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80cd110 0x7fd6d815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6dca20640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80cd110 0x7fd6d815cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.538+0000 7fd6dca20640 1 -- 172.21.15.77:0/2733362578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c00094d0 con 0x7fd6d8146eb0 2023-11-26T07:18:42.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.539+0000 7fd6dca20640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8146eb0 0x7fd6d80b3fd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000c390 tx=0x7fd6d000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.539+0000 7fd6d4ff9640 1 -- 172.21.15.77:0/2733362578 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00035f0 con 0x7fd6d8146eb0 2023-11-26T07:18:42.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.539+0000 7fd6d4ff9640 1 -- 172.21.15.77:0/2733362578 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d0003750 con 0x7fd6d8146eb0 2023-11-26T07:18:42.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.539+0000 7fd6d4ff9640 1 -- 172.21.15.77:0/2733362578 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0003b00 con 0x7fd6d8146eb0 2023-11-26T07:18:42.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.539+0000 7fd6de483640 1 -- 172.21.15.77:0/2733362578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80b2370 con 0x7fd6d8146eb0 2023-11-26T07:18:42.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.539+0000 7fd6de483640 1 -- 172.21.15.77:0/2733362578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d815e820 con 0x7fd6d8146eb0 2023-11-26T07:18:42.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.540+0000 7fd6de483640 1 -- 172.21.15.77:0/2733362578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d804e8b0 con 0x7fd6d8146eb0 2023-11-26T07:18:42.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.541+0000 7fd6d4ff9640 1 -- 172.21.15.77:0/2733362578 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6d0003c60 con 0x7fd6d8146eb0 2023-11-26T07:18:42.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.542+0000 7fd6d4ff9640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6b806ae40 0x7fd6b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.542+0000 7fd6d4ff9640 1 -- 172.21.15.77:0/2733362578 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd6d0088680 con 0x7fd6d8146eb0 2023-11-26T07:18:42.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.543+0000 7fd6d7fff640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6b806ae40 0x7fd6b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.543+0000 7fd6d7fff640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6b806ae40 0x7fd6b806d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800ab90 tx=0x7fd6c8009250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.547+0000 7fd6d4ff9640 1 -- 172.21.15.77:0/2733362578 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6d0053910 con 0x7fd6d8146eb0 2023-11-26T07:18:42.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:42.741+0000 7fd6de483640 1 -- 172.21.15.77:0/2733362578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd6d80b4f70 con 0x7fd6d8146eb0 2023-11-26T07:18:43.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.308+0000 7fd6d4ff9640 1 -- 172.21.15.77:0/2733362578 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd6d0056f30 con 0x7fd6d8146eb0 2023-11-26T07:18:43.311 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-11-26T07:18:43.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.312+0000 7fd6de483640 1 -- 172.21.15.77:0/2733362578 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6b806ae40 msgr2=0x7fd6b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.312+0000 7fd6de483640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6b806ae40 0x7fd6b806d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800ab90 tx=0x7fd6c8009250 comp rx=0 tx=0).stop 2023-11-26T07:18:43.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.312+0000 7fd6de483640 1 -- 172.21.15.77:0/2733362578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8146eb0 msgr2=0x7fd6d80b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.312+0000 7fd6de483640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8146eb0 0x7fd6d80b3fd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000c390 tx=0x7fd6d000c850 comp rx=0 tx=0).stop 2023-11-26T07:18:43.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.312+0000 7fd6de483640 1 -- 172.21.15.77:0/2733362578 shutdown_connections 2023-11-26T07:18:43.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.312+0000 7fd6de483640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6b806ae40 0x7fd6b806d300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.312+0000 7fd6de483640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8146eb0 0x7fd6d80b3fd0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.312+0000 7fd6de483640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d80cd110 0x7fd6d815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.312+0000 7fd6de483640 1 --2- 172.21.15.77:0/2733362578 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6d806e160 0x7fd6d815e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.312+0000 7fd6de483640 1 -- 172.21.15.77:0/2733362578 >> 172.21.15.77:0/2733362578 conn(0x7fd6d80b0c50 msgr2=0x7fd6d8145f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:43.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.313+0000 7fd6de483640 1 -- 172.21.15.77:0/2733362578 shutdown_connections 2023-11-26T07:18:43.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.313+0000 7fd6de483640 1 -- 172.21.15.77:0/2733362578 wait complete. 2023-11-26T07:18:43.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:18:43.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.538+0000 7f7478ed3640 1 Processor -- start 2023-11-26T07:18:43.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.539+0000 7f7478ed3640 1 -- start start 2023-11-26T07:18:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.540+0000 7f7478ed3640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f747415b440 0x7f74740cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.540+0000 7f7478ed3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74740cbf20 0x7f74740c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.540+0000 7f7478ed3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74740c57e0 0x7f74740c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.540+0000 7f7478ed3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74740cc3d0 con 0x7f74740cbf20 2023-11-26T07:18:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.540+0000 7f7478ed3640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747415b820 con 0x7f747415b440 2023-11-26T07:18:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.540+0000 7f7478ed3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747415eea0 con 0x7f74740c57e0 2023-11-26T07:18:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.540+0000 7f746bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74740cbf20 0x7f74740c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.541+0000 7f746bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74740cbf20 0x7f74740c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55150/0 (socket says 172.21.15.77:55150) 2023-11-26T07:18:43.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.541+0000 7f746bfff640 1 -- 172.21.15.77:0/2051491576 learned_addr learned my addr 172.21.15.77:0/2051491576 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:43.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.541+0000 7f7472d9d640 1 --2- 172.21.15.77:0/2051491576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74740c57e0 0x7f74740c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.541+0000 7f746bfff640 1 -- 172.21.15.77:0/2051491576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74740c57e0 msgr2=0x7f74740c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.541+0000 7f746bfff640 1 --2- 172.21.15.77:0/2051491576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74740c57e0 0x7f74740c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.541+0000 7f746bfff640 1 -- 172.21.15.77:0/2051491576 >> v2:172.21.15.159:3300/0 conn(0x7f747415b440 msgr2=0x7f74740cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.541+0000 7f746bfff640 1 --2- 172.21.15.77:0/2051491576 >> v2:172.21.15.159:3300/0 conn(0x7f747415b440 0x7f74740cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.541+0000 7f746bfff640 1 -- 172.21.15.77:0/2051491576 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74740abf30 con 0x7f74740cbf20 2023-11-26T07:18:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.541+0000 7f7472d9d640 1 --2- 172.21.15.77:0/2051491576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74740c57e0 0x7f74740c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.542+0000 7f746bfff640 1 --2- 172.21.15.77:0/2051491576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74740cbf20 0x7f74740c52a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f747406e770 tx=0x7f745c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39de92d29f7928a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.543+0000 7f7471d9b640 1 -- 172.21.15.77:0/2051491576 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0317e0 con 0x7f74740cbf20 2023-11-26T07:18:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.543+0000 7f7471d9b640 1 -- 172.21.15.77:0/2051491576 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c031940 con 0x7f74740cbf20 2023-11-26T07:18:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.543+0000 7f7471d9b640 1 -- 172.21.15.77:0/2051491576 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c031cd0 con 0x7f74740cbf20 2023-11-26T07:18:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.543+0000 7f7478ed3640 1 -- 172.21.15.77:0/2051491576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74740cbf20 msgr2=0x7f74740c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.543+0000 7f7478ed3640 1 --2- 172.21.15.77:0/2051491576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74740cbf20 0x7f74740c52a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f747406e770 tx=0x7f745c02b880 comp rx=0 tx=0).stop 2023-11-26T07:18:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.543+0000 7f7478ed3640 1 -- 172.21.15.77:0/2051491576 shutdown_connections 2023-11-26T07:18:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.543+0000 7f7478ed3640 1 --2- 172.21.15.77:0/2051491576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74740c57e0 0x7f74740c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.543+0000 7f7478ed3640 1 --2- 172.21.15.77:0/2051491576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74740cbf20 0x7f74740c52a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.543+0000 7f7478ed3640 1 --2- 172.21.15.77:0/2051491576 >> v2:172.21.15.159:3300/0 conn(0x7f747415b440 0x7f74740cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.543+0000 7f7478ed3640 1 -- 172.21.15.77:0/2051491576 >> 172.21.15.77:0/2051491576 conn(0x7f74740b0c50 msgr2=0x7f74740b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.544+0000 7f7478ed3640 1 -- 172.21.15.77:0/2051491576 shutdown_connections 2023-11-26T07:18:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.544+0000 7f7478ed3640 1 -- 172.21.15.77:0/2051491576 wait complete. 2023-11-26T07:18:43.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.546+0000 7f7478ed3640 1 Processor -- start 2023-11-26T07:18:43.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.546+0000 7f7478ed3640 1 -- start start 2023-11-26T07:18:43.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.547+0000 7f7478ed3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740c57e0 0x7f74740ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.547+0000 7f7478ed3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74740cbf20 0x7f7474154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.547+0000 7f7478ed3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f747415b440 0x7f74740ac950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.547+0000 7f7478ed3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740ce920 con 0x7f747415b440 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.547+0000 7f7478ed3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740cdbe0 con 0x7f74740c57e0 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.547+0000 7f7478ed3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74740cd110 con 0x7f74740cbf20 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.547+0000 7f7472d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f747415b440 0x7f74740ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.547+0000 7f7472d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f747415b440 0x7f74740ac950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55152/0 (socket says 172.21.15.77:55152) 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.547+0000 7f7472d9d640 1 -- 172.21.15.77:0/3667522553 learned_addr learned my addr 172.21.15.77:0/3667522553 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.547+0000 7f746bfff640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74740cbf20 0x7f7474154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f747259c640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740c57e0 0x7f74740ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f7472d9d640 1 -- 172.21.15.77:0/3667522553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74740cbf20 msgr2=0x7f7474154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f7472d9d640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74740cbf20 0x7f7474154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f7472d9d640 1 -- 172.21.15.77:0/3667522553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740c57e0 msgr2=0x7f74740ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f7472d9d640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740c57e0 0x7f74740ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f7472d9d640 1 -- 172.21.15.77:0/3667522553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c0094d0 con 0x7f747415b440 2023-11-26T07:18:43.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f747259c640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740c57e0 0x7f74740ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:43.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f7472d9d640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f747415b440 0x7f74740ac950 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f746c00cef0 tx=0x7f746c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f746affd640 1 -- 172.21.15.77:0/3667522553 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c00d840 con 0x7f747415b440 2023-11-26T07:18:43.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f746affd640 1 -- 172.21.15.77:0/3667522553 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c00d9c0 con 0x7f747415b440 2023-11-26T07:18:43.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f746affd640 1 -- 172.21.15.77:0/3667522553 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c00dd70 con 0x7f747415b440 2023-11-26T07:18:43.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.548+0000 7f7478ed3640 1 -- 172.21.15.77:0/3667522553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7474155130 con 0x7f747415b440 2023-11-26T07:18:43.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.549+0000 7f7478ed3640 1 -- 172.21.15.77:0/3667522553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74740cd620 con 0x7f747415b440 2023-11-26T07:18:43.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.550+0000 7f7478ed3640 1 -- 172.21.15.77:0/3667522553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747404e8b0 con 0x7f747415b440 2023-11-26T07:18:43.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.551+0000 7f746affd640 1 -- 172.21.15.77:0/3667522553 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f746c01e3b0 con 0x7f747415b440 2023-11-26T07:18:43.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.552+0000 7f746affd640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f745406ae70 0x7f745406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.552+0000 7f746affd640 1 -- 172.21.15.77:0/3667522553 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f746c08a060 con 0x7f747415b440 2023-11-26T07:18:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.552+0000 7f747259c640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f745406ae70 0x7f745406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.553+0000 7f747259c640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f745406ae70 0x7f745406d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f746400a870 tx=0x7f7464008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.557+0000 7f746affd640 1 -- 172.21.15.77:0/3667522553 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f746c0bce90 con 0x7f747415b440 2023-11-26T07:18:43.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:43.788+0000 7f7478ed3640 1 -- 172.21.15.77:0/3667522553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f747406dc80 con 0x7f747415b440 2023-11-26T07:18:44.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.313+0000 7f746affd640 1 -- 172.21.15.77:0/3667522553 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f746c01a0c0 con 0x7f747415b440 2023-11-26T07:18:44.316 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 4 and data pool 5 2023-11-26T07:18:44.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.316+0000 7f7478ed3640 1 -- 172.21.15.77:0/3667522553 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f745406ae70 msgr2=0x7f745406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.316+0000 7f7478ed3640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f745406ae70 0x7f745406d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f746400a870 tx=0x7f7464008040 comp rx=0 tx=0).stop 2023-11-26T07:18:44.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.316+0000 7f7478ed3640 1 -- 172.21.15.77:0/3667522553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f747415b440 msgr2=0x7f74740ac950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.316+0000 7f7478ed3640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f747415b440 0x7f74740ac950 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f746c00cef0 tx=0x7f746c00a710 comp rx=0 tx=0).stop 2023-11-26T07:18:44.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.316+0000 7f7478ed3640 1 -- 172.21.15.77:0/3667522553 shutdown_connections 2023-11-26T07:18:44.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.316+0000 7f7478ed3640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f745406ae70 0x7f745406d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.316+0000 7f7478ed3640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f747415b440 0x7f74740ac950 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.316+0000 7f7478ed3640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74740cbf20 0x7f7474154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.316+0000 7f7478ed3640 1 --2- 172.21.15.77:0/3667522553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74740c57e0 0x7f74740ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.316+0000 7f7478ed3640 1 -- 172.21.15.77:0/3667522553 >> 172.21.15.77:0/3667522553 conn(0x7f74740b0c50 msgr2=0x7f74740b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:44.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.317+0000 7f7478ed3640 1 -- 172.21.15.77:0/3667522553 shutdown_connections 2023-11-26T07:18:44.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.317+0000 7f7478ed3640 1 -- 172.21.15.77:0/3667522553 wait complete. 2023-11-26T07:18:44.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:44.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.530+0000 7f055bdec640 1 Processor -- start 2023-11-26T07:18:44.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.530+0000 7f055bdec640 1 -- start start 2023-11-26T07:18:44.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.531+0000 7f055bdec640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055415c7f0 0x7f055406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.531+0000 7f055bdec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05540ce6c0 0x7f05540cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.531+0000 7f055bdec640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540cece0 con 0x7f05540cf450 2023-11-26T07:18:44.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.532+0000 7f055bdec640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0554156010 con 0x7f05540ce6c0 2023-11-26T07:18:44.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.532+0000 7f055bdec640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055406ce30 con 0x7f055415c7f0 2023-11-26T07:18:44.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.532+0000 7f055a389640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05540ce6c0 0x7f05540cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.532+0000 7f055a389640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05540ce6c0 0x7f05540cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55156/0 (socket says 172.21.15.77:55156) 2023-11-26T07:18:44.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.532+0000 7f055a389640 1 -- 172.21.15.77:0/2175358433 learned_addr learned my addr 172.21.15.77:0/2175358433 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:44.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.532+0000 7f055a389640 1 -- 172.21.15.77:0/2175358433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055415c7f0 msgr2=0x7f055406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:44.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.532+0000 7f0559b88640 1 --2- 172.21.15.77:0/2175358433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055415c7f0 0x7f055406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.532+0000 7f055a389640 1 --2- 172.21.15.77:0/2175358433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055415c7f0 0x7f055406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.532+0000 7f055a389640 1 -- 172.21.15.77:0/2175358433 >> v1:172.21.15.159:6789/0 conn(0x7f05540cf450 legacy=0x7f05540cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:44.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.532+0000 7f055a389640 1 -- 172.21.15.77:0/2175358433 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055406d040 con 0x7f05540ce6c0 2023-11-26T07:18:44.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.532+0000 7f0559b88640 1 --2- 172.21.15.77:0/2175358433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055415c7f0 0x7f055406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:44.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.533+0000 7f055a389640 1 --2- 172.21.15.77:0/2175358433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05540ce6c0 0x7f05540cf8d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f054c009e50 tx=0x7f054c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350f3c9a226b0c3d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.534+0000 7f0558b86640 1 -- 172.21.15.77:0/2175358433 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c02ca70 con 0x7f05540ce6c0 2023-11-26T07:18:44.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.534+0000 7f0558b86640 1 -- 172.21.15.77:0/2175358433 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c02cbd0 con 0x7f05540ce6c0 2023-11-26T07:18:44.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.534+0000 7f0558b86640 1 -- 172.21.15.77:0/2175358433 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0343f0 con 0x7f05540ce6c0 2023-11-26T07:18:44.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.534+0000 7f055bdec640 1 -- 172.21.15.77:0/2175358433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05540ce6c0 msgr2=0x7f05540cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.534+0000 7f055bdec640 1 --2- 172.21.15.77:0/2175358433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05540ce6c0 0x7f05540cf8d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f054c009e50 tx=0x7f054c02bed0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.534+0000 7f055bdec640 1 -- 172.21.15.77:0/2175358433 shutdown_connections 2023-11-26T07:18:44.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.534+0000 7f055bdec640 1 --2- 172.21.15.77:0/2175358433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05540ce6c0 0x7f05540cf8d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.534+0000 7f055bdec640 1 --2- 172.21.15.77:0/2175358433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055415c7f0 0x7f055406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.534+0000 7f055bdec640 1 -- 172.21.15.77:0/2175358433 >> 172.21.15.77:0/2175358433 conn(0x7f055406a920 msgr2=0x7f055406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:44.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.534+0000 7f055bdec640 1 -- 172.21.15.77:0/2175358433 shutdown_connections 2023-11-26T07:18:44.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.534+0000 7f055bdec640 1 -- 172.21.15.77:0/2175358433 wait complete. 2023-11-26T07:18:44.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.536+0000 7f055bdec640 1 Processor -- start 2023-11-26T07:18:44.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.536+0000 7f055bdec640 1 -- start start 2023-11-26T07:18:44.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.537+0000 7f055bdec640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05540ce6c0 0x7f055415f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.537+0000 7f055bdec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05540cf450 0x7f05540ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.537+0000 7f055bdec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055415c7f0 0x7f0554149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.537+0000 7f055bdec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055415fe40 con 0x7f055415c7f0 2023-11-26T07:18:44.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.537+0000 7f055bdec640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05540b24a0 con 0x7f05540cf450 2023-11-26T07:18:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.537+0000 7f055bdec640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05540b2710 con 0x7f05540ce6c0 2023-11-26T07:18:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.537+0000 7f055a389640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055415c7f0 0x7f0554149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.537+0000 7f055a389640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055415c7f0 0x7f0554149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55162/0 (socket says 172.21.15.77:55162) 2023-11-26T07:18:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.537+0000 7f055a389640 1 -- 172.21.15.77:0/2936491359 learned_addr learned my addr 172.21.15.77:0/2936491359 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.538+0000 7f055a389640 1 -- 172.21.15.77:0/2936491359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05540ce6c0 msgr2=0x7f055415f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.538+0000 7f055a389640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05540ce6c0 0x7f055415f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.538+0000 7f055a389640 1 -- 172.21.15.77:0/2936491359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05540cf450 msgr2=0x7f05540ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.538+0000 7f055a389640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05540cf450 0x7f05540ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.538+0000 7f055a389640 1 -- 172.21.15.77:0/2936491359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c009b30 con 0x7f055415c7f0 2023-11-26T07:18:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.538+0000 7f055a389640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055415c7f0 0x7f0554149dc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f054c036040 tx=0x7f054c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.538+0000 7f054a7fc640 1 -- 172.21.15.77:0/2936491359 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c009510 con 0x7f055415c7f0 2023-11-26T07:18:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.538+0000 7f054a7fc640 1 -- 172.21.15.77:0/2936491359 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c03e450 con 0x7f055415c7f0 2023-11-26T07:18:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.538+0000 7f054a7fc640 1 -- 172.21.15.77:0/2936491359 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c03e800 con 0x7f055415c7f0 2023-11-26T07:18:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.538+0000 7f055bdec640 1 -- 172.21.15.77:0/2936491359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05540b29f0 con 0x7f055415c7f0 2023-11-26T07:18:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.538+0000 7f055bdec640 1 -- 172.21.15.77:0/2936491359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05540b2fb0 con 0x7f055415c7f0 2023-11-26T07:18:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.539+0000 7f055bdec640 1 -- 172.21.15.77:0/2936491359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0554061a50 con 0x7f055415c7f0 2023-11-26T07:18:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.540+0000 7f054a7fc640 1 -- 172.21.15.77:0/2936491359 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f054c03e960 con 0x7f055415c7f0 2023-11-26T07:18:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.541+0000 7f054a7fc640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053806ae70 0x7f053806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.541+0000 7f054a7fc640 1 -- 172.21.15.77:0/2936491359 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f054c0ac3c0 con 0x7f055415c7f0 2023-11-26T07:18:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.541+0000 7f0559b88640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053806ae70 0x7f053806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.542+0000 7f0559b88640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053806ae70 0x7f053806d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0550006fd0 tx=0x7f0550008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.546+0000 7f054a7fc640 1 -- 172.21.15.77:0/2936491359 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f054c077460 con 0x7f055415c7f0 2023-11-26T07:18:44.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.723+0000 7f055bdec640 1 -- 172.21.15.77:0/2936491359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0554067470 con 0x7f055415c7f0 2023-11-26T07:18:44.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.726+0000 7f054a7fc640 1 -- 172.21.15.77:0/2936491359 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16558 (secure 0 0 0) 0x7f054c07aa80 con 0x7f055415c7f0 2023-11-26T07:18:44.729 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:44.729 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:18:43.790185+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:42.084786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:42.792071+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:44.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.728+0000 7f055bdec640 1 -- 172.21.15.77:0/2936491359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053806ae70 msgr2=0x7f053806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.728+0000 7f055bdec640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053806ae70 0x7f053806d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0550006fd0 tx=0x7f0550008040 comp rx=0 tx=0).stop 2023-11-26T07:18:44.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.728+0000 7f055bdec640 1 -- 172.21.15.77:0/2936491359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055415c7f0 msgr2=0x7f0554149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.728+0000 7f055bdec640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055415c7f0 0x7f0554149dc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f054c036040 tx=0x7f054c004a40 comp rx=0 tx=0).stop 2023-11-26T07:18:44.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.729+0000 7f055bdec640 1 -- 172.21.15.77:0/2936491359 shutdown_connections 2023-11-26T07:18:44.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.729+0000 7f055bdec640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053806ae70 0x7f053806d330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.729+0000 7f055bdec640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055415c7f0 0x7f0554149dc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.729+0000 7f055bdec640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05540cf450 0x7f05540ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.729+0000 7f055bdec640 1 --2- 172.21.15.77:0/2936491359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05540ce6c0 0x7f055415f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.729+0000 7f055bdec640 1 -- 172.21.15.77:0/2936491359 >> 172.21.15.77:0/2936491359 conn(0x7f055406a920 msgr2=0x7f05540718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:44.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.729+0000 7f055bdec640 1 -- 172.21.15.77:0/2936491359 shutdown_connections 2023-11-26T07:18:44.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.729+0000 7f055bdec640 1 -- 172.21.15.77:0/2936491359 wait complete. 2023-11-26T07:18:44.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:44.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.958+0000 7f711df16640 1 Processor -- start 2023-11-26T07:18:44.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.958+0000 7f711df16640 1 -- start start 2023-11-26T07:18:44.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.959+0000 7f711df16640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71180ad170 0x7f71180b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.959+0000 7f711df16640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f71180b0b10 0x7f71180b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.959+0000 7f711df16640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71180af180 con 0x7f71180b0730 2023-11-26T07:18:44.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.959+0000 7f711df16640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71180af460 con 0x7f71180b0b10 2023-11-26T07:18:44.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.959+0000 7f711df16640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180af740 con 0x7f71180ad170 2023-11-26T07:18:44.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.960+0000 7f711cf14640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f71180b0730 0x7f71180ae930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40444/0 (socket says 172.21.15.77:40444) 2023-11-26T07:18:44.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.960+0000 7f711cf14640 1 -- 172.21.15.77:0/1080254564 learned_addr learned my addr 172.21.15.77:0/1080254564 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:44.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.960+0000 7f711d715640 1 --2- 172.21.15.77:0/1080254564 >> v2:172.21.15.77:3300/0 conn(0x7f71180b0b10 0x7f71180b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.960+0000 7f710f7fe640 1 -- 172.21.15.77:0/1080254564 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764719969 0 0) 0x7f71180af180 con 0x7f71180b0730 2023-11-26T07:18:44.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.960+0000 7f710f7fe640 1 -- 172.21.15.77:0/1080254564 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7100003520 con 0x7f71180b0730 2023-11-26T07:18:44.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.960+0000 7f710ffff640 1 --2- 172.21.15.77:0/1080254564 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71180ad170 0x7f71180b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.961+0000 7f711d715640 1 -- 172.21.15.77:0/1080254564 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71180ad170 msgr2=0x7f71180b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:44.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.961+0000 7f711d715640 1 --2- 172.21.15.77:0/1080254564 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71180ad170 0x7f71180b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.961+0000 7f711d715640 1 -- 172.21.15.77:0/1080254564 >> v1:172.21.15.77:6789/0 conn(0x7f71180b0730 legacy=0x7f71180ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.961+0000 7f710f7fe640 1 -- 172.21.15.77:0/1080254564 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2491120093 0 0) 0x7f7100003520 con 0x7f71180b0730 2023-11-26T07:18:44.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.961+0000 7f711d715640 1 -- 172.21.15.77:0/1080254564 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180afa20 con 0x7f71180b0b10 2023-11-26T07:18:44.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.962+0000 7f711d715640 1 --2- 172.21.15.77:0/1080254564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71180b0b10 0x7f71180b0fa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7110009d90 tx=0x7f711002bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dccab2158be0997 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.962+0000 7f710f7fe640 1 -- 172.21.15.77:0/1080254564 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114001670 con 0x7f71180b0b10 2023-11-26T07:18:44.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.962+0000 7f710f7fe640 1 -- 172.21.15.77:0/1080254564 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711002c810 con 0x7f71180b0b10 2023-11-26T07:18:44.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.962+0000 7f710f7fe640 1 -- 172.21.15.77:0/1080254564 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711002cb80 con 0x7f71180b0b10 2023-11-26T07:18:44.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.963+0000 7f711df16640 1 -- 172.21.15.77:0/1080254564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71180b0b10 msgr2=0x7f71180b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.963+0000 7f711df16640 1 --2- 172.21.15.77:0/1080254564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71180b0b10 0x7f71180b0fa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7110009d90 tx=0x7f711002bce0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.963+0000 7f711df16640 1 -- 172.21.15.77:0/1080254564 shutdown_connections 2023-11-26T07:18:44.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.963+0000 7f711df16640 1 --2- 172.21.15.77:0/1080254564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71180b0b10 0x7f71180b0fa0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.963+0000 7f711df16640 1 --2- 172.21.15.77:0/1080254564 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71180ad170 0x7f71180b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.963+0000 7f711df16640 1 -- 172.21.15.77:0/1080254564 >> 172.21.15.77:0/1080254564 conn(0x7f71180b45e0 msgr2=0x7f71180b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:44.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.963+0000 7f711df16640 1 -- 172.21.15.77:0/1080254564 shutdown_connections 2023-11-26T07:18:44.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.963+0000 7f711df16640 1 -- 172.21.15.77:0/1080254564 wait complete. 2023-11-26T07:18:44.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.965+0000 7f711df16640 1 Processor -- start 2023-11-26T07:18:44.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.965+0000 7f711df16640 1 -- start start 2023-11-26T07:18:44.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711df16640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71180ad170 0x7f7118148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711df16640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71180b0730 0x7f711815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711df16640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71180b0b10 0x7f711815fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711df16640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7118148f60 con 0x7f71180ad170 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711df16640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71181491b0 con 0x7f71180b0b10 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711df16640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7118149490 con 0x7f71180b0730 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711cf14640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71180ad170 0x7f7118148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711cf14640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71180ad170 0x7f7118148740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55184/0 (socket says 172.21.15.77:55184) 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711cf14640 1 -- 172.21.15.77:0/3366317898 learned_addr learned my addr 172.21.15.77:0/3366317898 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711cf14640 1 -- 172.21.15.77:0/3366317898 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71180b0730 msgr2=0x7f711815f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711cf14640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71180b0730 0x7f711815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711cf14640 1 -- 172.21.15.77:0/3366317898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71180b0b10 msgr2=0x7f711815fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711cf14640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71180b0b10 0x7f711815fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.966+0000 7f711cf14640 1 -- 172.21.15.77:0/3366317898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110009a70 con 0x7f71180ad170 2023-11-26T07:18:44.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.967+0000 7f711cf14640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71180ad170 0x7f7118148740 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f711400c750 tx=0x7f711400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.967+0000 7f710d7fa640 1 -- 172.21.15.77:0/3366317898 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114005ad0 con 0x7f71180ad170 2023-11-26T07:18:44.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.967+0000 7f710d7fa640 1 -- 172.21.15.77:0/3366317898 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7114005c30 con 0x7f71180ad170 2023-11-26T07:18:44.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.967+0000 7f711df16640 1 -- 172.21.15.77:0/3366317898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7118149770 con 0x7f71180ad170 2023-11-26T07:18:44.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.967+0000 7f710d7fa640 1 -- 172.21.15.77:0/3366317898 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114007070 con 0x7f71180ad170 2023-11-26T07:18:44.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.967+0000 7f711df16640 1 -- 172.21.15.77:0/3366317898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7118148c80 con 0x7f71180ad170 2023-11-26T07:18:44.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.968+0000 7f711df16640 1 -- 172.21.15.77:0/3366317898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7118149c90 con 0x7f71180ad170 2023-11-26T07:18:44.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.969+0000 7f710d7fa640 1 -- 172.21.15.77:0/3366317898 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71140071d0 con 0x7f71180ad170 2023-11-26T07:18:44.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.970+0000 7f710d7fa640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f710406ae40 0x7f710406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.970+0000 7f710d7fa640 1 -- 172.21.15.77:0/3366317898 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7114088d90 con 0x7f71180ad170 2023-11-26T07:18:44.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.970+0000 7f710ffff640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f710406ae40 0x7f710406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.971+0000 7f710ffff640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f710406ae40 0x7f710406d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7108006fd0 tx=0x7f7108008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:44.974+0000 7f710d7fa640 1 -- 172.21.15.77:0/3366317898 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7118149c90 con 0x7f71180ad170 2023-11-26T07:18:45.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.167+0000 7f711df16640 1 -- 172.21.15.77:0/3366317898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7118149c90 con 0x7f71180ad170 2023-11-26T07:18:45.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.169+0000 7f710d7fa640 1 -- 172.21.15.77:0/3366317898 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16558 (secure 0 0 0) 0x7f7118149c90 con 0x7f71180ad170 2023-11-26T07:18:45.172 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:45.172 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:18:43.790185+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:42.084786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:42.792071+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 -- 172.21.15.77:0/3366317898 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f710406ae40 msgr2=0x7f710406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f710406ae40 0x7f710406d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7108006fd0 tx=0x7f7108008040 comp rx=0 tx=0).stop 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 -- 172.21.15.77:0/3366317898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71180ad170 msgr2=0x7f7118148740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71180ad170 0x7f7118148740 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f711400c750 tx=0x7f711400cc10 comp rx=0 tx=0).stop 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 -- 172.21.15.77:0/3366317898 shutdown_connections 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f710406ae40 0x7f710406d300 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71180b0b10 0x7f711815fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71180b0730 0x7f711815f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 --2- 172.21.15.77:0/3366317898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71180ad170 0x7f7118148740 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 -- 172.21.15.77:0/3366317898 >> 172.21.15.77:0/3366317898 conn(0x7f71180b45e0 msgr2=0x7f711806c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:45.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 -- 172.21.15.77:0/3366317898 shutdown_connections 2023-11-26T07:18:45.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.172+0000 7f711df16640 1 -- 172.21.15.77:0/3366317898 wait complete. 2023-11-26T07:18:45.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:18:45.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.410+0000 7fb69b6bb640 1 Processor -- start 2023-11-26T07:18:45.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.411+0000 7fb69b6bb640 1 -- start start 2023-11-26T07:18:45.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.412+0000 7fb69b6bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6940cff90 0x7fb69415fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.412+0000 7fb69b6bb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6940d13f0 con 0x7fb694160dd0 2023-11-26T07:18:45.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.412+0000 7fb69b6bb640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6940d16d0 con 0x7fb6940cfb50 2023-11-26T07:18:45.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.412+0000 7fb69b6bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940d11e0 con 0x7fb6940cff90 2023-11-26T07:18:45.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.412+0000 7fb699457640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb694160dd0 0x7fb6940cebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40452/0 (socket says 172.21.15.77:40452) 2023-11-26T07:18:45.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.412+0000 7fb699457640 1 -- 172.21.15.77:0/3564374216 learned_addr learned my addr 172.21.15.77:0/3564374216 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283610211 0 0) 0x7fb6940d13f0 con 0x7fb694160dd0 2023-11-26T07:18:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb684003520 con 0x7fb694160dd0 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb699c58640 1 --2- 172.21.15.77:0/3564374216 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6940cff90 0x7fb69415fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 91270901 0 0) 0x7fb684003520 con 0x7fb694160dd0 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6940cff90 msgr2=0x7fb69415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 --2- 172.21.15.77:0/3564374216 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6940cff90 0x7fb69415fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 >> v1:172.21.15.159:6789/0 conn(0x7fb6940cfb50 legacy=0x7fb69415f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6940d19b0 con 0x7fb694160dd0 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fb6880019f0 con 0x7fb694160dd0 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb699c58640 1 --2- 172.21.15.77:0/3564374216 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6940cff90 0x7fb69415fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 >> v1:172.21.15.77:6789/0 conn(0x7fb694160dd0 legacy=0x7fb6940cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 --2- 172.21.15.77:0/3564374216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6840039a0 0x7fb684003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 --2- 172.21.15.77:0/3564374216 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6940cff90 0x7fb6840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 --2- 172.21.15.77:0/3564374216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb684004d00 0x7fb684005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940d11e0 con 0x7fb684004d00 2023-11-26T07:18:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68400bb20 con 0x7fb6840039a0 2023-11-26T07:18:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.413+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68400bce0 con 0x7fb6940cff90 2023-11-26T07:18:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.414+0000 7fb699c58640 1 --2- 172.21.15.77:0/3564374216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb684004d00 0x7fb684005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.414+0000 7fb699c58640 1 -- 172.21.15.77:0/3564374216 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6940cff90 msgr2=0x7fb6840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.414+0000 7fb699c58640 1 --2- 172.21.15.77:0/3564374216 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6940cff90 0x7fb6840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.414+0000 7fb699c58640 1 -- 172.21.15.77:0/3564374216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6840039a0 msgr2=0x7fb684003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.414+0000 7fb699c58640 1 --2- 172.21.15.77:0/3564374216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6840039a0 0x7fb684003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.414+0000 7fb699c58640 1 -- 172.21.15.77:0/3564374216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb684003520 con 0x7fb684004d00 2023-11-26T07:18:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.415+0000 7fb699c58640 1 --2- 172.21.15.77:0/3564374216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb684004d00 0x7fb684005180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb68c006fd0 tx=0x7fb6840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ab3932e9c5fa80 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.415+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c004230 con 0x7fb684004d00 2023-11-26T07:18:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.415+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c004390 con 0x7fb684004d00 2023-11-26T07:18:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.415+0000 7fb693fff640 1 -- 172.21.15.77:0/3564374216 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c003830 con 0x7fb684004d00 2023-11-26T07:18:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.416+0000 7fb69b6bb640 1 -- 172.21.15.77:0/3564374216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb684004d00 msgr2=0x7fb684005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.416+0000 7fb69b6bb640 1 --2- 172.21.15.77:0/3564374216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb684004d00 0x7fb684005180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb68c006fd0 tx=0x7fb6840057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.416+0000 7fb699c58640 1 -- 172.21.15.77:0/3564374216 reap_dead start 2023-11-26T07:18:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.416+0000 7fb69b6bb640 1 -- 172.21.15.77:0/3564374216 shutdown_connections 2023-11-26T07:18:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.416+0000 7fb69b6bb640 1 -- 172.21.15.77:0/3564374216 >> 172.21.15.77:0/3564374216 conn(0x7fb69408af60 msgr2=0x7fb6940d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.416+0000 7fb69b6bb640 1 -- 172.21.15.77:0/3564374216 shutdown_connections 2023-11-26T07:18:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.416+0000 7fb69b6bb640 1 -- 172.21.15.77:0/3564374216 wait complete. 2023-11-26T07:18:45.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.418+0000 7fb69b6bb640 1 Processor -- start 2023-11-26T07:18:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.418+0000 7fb69b6bb640 1 -- start start 2023-11-26T07:18:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.419+0000 7fb69b6bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb684004d00 0x7fb6940b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.419+0000 7fb69b6bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb694150af0 0x7fb69414f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.419+0000 7fb69b6bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb69414f5a0 0x7fb69409d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.419+0000 7fb69b6bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940b4110 con 0x7fb69414f5a0 2023-11-26T07:18:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.419+0000 7fb69b6bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69414fa50 con 0x7fb684004d00 2023-11-26T07:18:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.419+0000 7fb69b6bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69414fd30 con 0x7fb694150af0 2023-11-26T07:18:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.419+0000 7fb699c58640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb69414f5a0 0x7fb69409d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.419+0000 7fb699c58640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb69414f5a0 0x7fb69409d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55194/0 (socket says 172.21.15.77:55194) 2023-11-26T07:18:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.419+0000 7fb699c58640 1 -- 172.21.15.77:0/1845775903 learned_addr learned my addr 172.21.15.77:0/1845775903 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.419+0000 7fb698c56640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb694150af0 0x7fb69414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb699457640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb684004d00 0x7fb6940b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb699c58640 1 -- 172.21.15.77:0/1845775903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb694150af0 msgr2=0x7fb69414f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb699c58640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb694150af0 0x7fb69414f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb699c58640 1 -- 172.21.15.77:0/1845775903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb684004d00 msgr2=0x7fb6940b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb699c58640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb684004d00 0x7fb6940b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb699c58640 1 -- 172.21.15.77:0/1845775903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb694150010 con 0x7fb69414f5a0 2023-11-26T07:18:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb698c56640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb694150af0 0x7fb69414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb699c58640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb69414f5a0 0x7fb69409d0f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097f0 tx=0x7fb68c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb691ffb640 1 -- 172.21.15.77:0/1845775903 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c030630 con 0x7fb69414f5a0 2023-11-26T07:18:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb691ffb640 1 -- 172.21.15.77:0/1845775903 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c030790 con 0x7fb69414f5a0 2023-11-26T07:18:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb691ffb640 1 -- 172.21.15.77:0/1845775903 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c030b20 con 0x7fb69414f5a0 2023-11-26T07:18:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb69b6bb640 1 -- 172.21.15.77:0/1845775903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6941502f0 con 0x7fb69414f5a0 2023-11-26T07:18:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.420+0000 7fb69b6bb640 1 -- 172.21.15.77:0/1845775903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb694150f50 con 0x7fb69414f5a0 2023-11-26T07:18:45.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.421+0000 7fb69b6bb640 1 -- 172.21.15.77:0/1845775903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb694150810 con 0x7fb69414f5a0 2023-11-26T07:18:45.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.422+0000 7fb691ffb640 1 -- 172.21.15.77:0/1845775903 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb68c030c80 con 0x7fb69414f5a0 2023-11-26T07:18:45.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.423+0000 7fb691ffb640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb67806ae40 0x7fb67806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.423+0000 7fb691ffb640 1 -- 172.21.15.77:0/1845775903 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb68c0aac10 con 0x7fb69414f5a0 2023-11-26T07:18:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.423+0000 7fb699457640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb67806ae40 0x7fb67806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.424+0000 7fb699457640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb67806ae40 0x7fb67806d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb688002040 tx=0x7fb688009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.427+0000 7fb691ffb640 1 -- 172.21.15.77:0/1845775903 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb694150810 con 0x7fb69414f5a0 2023-11-26T07:18:45.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:45.656+0000 7fb69b6bb640 1 -- 172.21.15.77:0/1845775903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb694150810 con 0x7fb69414f5a0 2023-11-26T07:18:45.996 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-11-26T07:18:45.993+0000 7f5890c64640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:18:46.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.641+0000 7fb691ffb640 1 -- 172.21.15.77:0/1845775903 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb694150810 con 0x7fb69414f5a0 2023-11-26T07:18:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.644+0000 7fb69b6bb640 1 -- 172.21.15.77:0/1845775903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb67806ae40 msgr2=0x7fb67806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.644+0000 7fb69b6bb640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb67806ae40 0x7fb67806d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb688002040 tx=0x7fb688009040 comp rx=0 tx=0).stop 2023-11-26T07:18:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.644+0000 7fb69b6bb640 1 -- 172.21.15.77:0/1845775903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb69414f5a0 msgr2=0x7fb69409d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.644+0000 7fb69b6bb640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb69414f5a0 0x7fb69409d0f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097f0 tx=0x7fb68c004730 comp rx=0 tx=0).stop 2023-11-26T07:18:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.645+0000 7fb69b6bb640 1 -- 172.21.15.77:0/1845775903 shutdown_connections 2023-11-26T07:18:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.645+0000 7fb69b6bb640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb67806ae40 0x7fb67806d300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.645+0000 7fb69b6bb640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb69414f5a0 0x7fb69409d0f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.645+0000 7fb69b6bb640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb694150af0 0x7fb69414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.645+0000 7fb69b6bb640 1 --2- 172.21.15.77:0/1845775903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb684004d00 0x7fb6940b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.645+0000 7fb69b6bb640 1 -- 172.21.15.77:0/1845775903 >> 172.21.15.77:0/1845775903 conn(0x7fb69408af60 msgr2=0x7fb69415ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.645+0000 7fb69b6bb640 1 -- 172.21.15.77:0/1845775903 shutdown_connections 2023-11-26T07:18:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.645+0000 7fb69b6bb640 1 -- 172.21.15.77:0/1845775903 wait complete. 2023-11-26T07:18:46.669 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:18:46.669 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:18:46.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.882+0000 7f8fb0431640 1 Processor -- start 2023-11-26T07:18:46.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.882+0000 7f8fb0431640 1 -- start start 2023-11-26T07:18:46.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.884+0000 7f8fb0431640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8fa80cc0f0 0x7f8fa80c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.884+0000 7f8fb0431640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa815eea0 con 0x7f8fa815b440 2023-11-26T07:18:46.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.884+0000 7f8fb0431640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa80abf30 con 0x7f8fa80c57e0 2023-11-26T07:18:46.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.884+0000 7f8fb0431640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa815b820 con 0x7f8fa80cc0f0 2023-11-26T07:18:46.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.884+0000 7f8fae1cd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8fa815b440 0x7f8fa80cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46320/0 (socket says 172.21.15.77:46320) 2023-11-26T07:18:46.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.884+0000 7f8fae1cd640 1 -- 172.21.15.77:0/2153627211 learned_addr learned my addr 172.21.15.77:0/2153627211 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:46.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.884+0000 7f8fad9cc640 1 --2- 172.21.15.77:0/2153627211 >> v2:172.21.15.77:3300/0 conn(0x7f8fa80cc0f0 0x7f8fa80c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.885+0000 7f8fad1cb640 1 -- 172.21.15.77:0/2153627211 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404950662 0 0) 0x7f8fa815eea0 con 0x7f8fa815b440 2023-11-26T07:18:46.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.885+0000 7f8fad1cb640 1 -- 172.21.15.77:0/2153627211 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f94003520 con 0x7f8fa815b440 2023-11-26T07:18:46.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.885+0000 7f8fad9cc640 1 -- 172.21.15.77:0/2153627211 >> v1:172.21.15.159:6789/0 conn(0x7f8fa80c57e0 legacy=0x7f8fa806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.885+0000 7f8fad9cc640 1 -- 172.21.15.77:0/2153627211 >> v1:172.21.15.77:6789/0 conn(0x7f8fa815b440 legacy=0x7f8fa80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.885+0000 7f8fad9cc640 1 -- 172.21.15.77:0/2153627211 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa815f0f0 con 0x7f8fa80cc0f0 2023-11-26T07:18:46.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.886+0000 7f8fad9cc640 1 --2- 172.21.15.77:0/2153627211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa80cc0f0 0x7f8fa80c52a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8f980097a0 tx=0x7f8f9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82063aa745d2ba30 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.886+0000 7f8fad1cb640 1 -- 172.21.15.77:0/2153627211 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98031830 con 0x7f8fa80cc0f0 2023-11-26T07:18:46.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.886+0000 7f8fad1cb640 1 -- 172.21.15.77:0/2153627211 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f98031990 con 0x7f8fa80cc0f0 2023-11-26T07:18:46.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.886+0000 7f8fad1cb640 1 -- 172.21.15.77:0/2153627211 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98031d20 con 0x7f8fa80cc0f0 2023-11-26T07:18:46.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.887+0000 7f8fb0431640 1 -- 172.21.15.77:0/2153627211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa80cc0f0 msgr2=0x7f8fa80c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.887+0000 7f8fb0431640 1 --2- 172.21.15.77:0/2153627211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa80cc0f0 0x7f8fa80c52a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8f980097a0 tx=0x7f8f9802b8d0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.887+0000 7f8fb0431640 1 -- 172.21.15.77:0/2153627211 shutdown_connections 2023-11-26T07:18:46.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.887+0000 7f8fb0431640 1 --2- 172.21.15.77:0/2153627211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa80cc0f0 0x7f8fa80c52a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.887+0000 7f8fb0431640 1 -- 172.21.15.77:0/2153627211 >> 172.21.15.77:0/2153627211 conn(0x7f8fa80b0c50 msgr2=0x7f8fa80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:46.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.887+0000 7f8fb0431640 1 -- 172.21.15.77:0/2153627211 shutdown_connections 2023-11-26T07:18:46.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.887+0000 7f8fb0431640 1 -- 172.21.15.77:0/2153627211 wait complete. 2023-11-26T07:18:46.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.889+0000 7f8fb0431640 1 Processor -- start 2023-11-26T07:18:46.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.889+0000 7f8fb0431640 1 -- start start 2023-11-26T07:18:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.890+0000 7f8fb0431640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fa80c57e0 0x7f8fa81f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.890+0000 7f8fb0431640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fa80cc0f0 0x7f8fa80af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.890+0000 7f8fb0431640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa815b440 0x7f8fa80aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.890+0000 7f8fb0431640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80c8220 con 0x7f8fa815b440 2023-11-26T07:18:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.890+0000 7f8fb0431640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80c7180 con 0x7f8fa80cc0f0 2023-11-26T07:18:46.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.890+0000 7f8fb0431640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80c7460 con 0x7f8fa80c57e0 2023-11-26T07:18:46.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.891+0000 7f8fae9ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa815b440 0x7f8fa80aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.891+0000 7f8fae9ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa815b440 0x7f8fa80aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56234/0 (socket says 172.21.15.77:56234) 2023-11-26T07:18:46.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.891+0000 7f8fae9ce640 1 -- 172.21.15.77:0/690557677 learned_addr learned my addr 172.21.15.77:0/690557677 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:46.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.891+0000 7f8fae1cd640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fa80c57e0 0x7f8fa81f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.891+0000 7f8fae9ce640 1 -- 172.21.15.77:0/690557677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fa80c57e0 msgr2=0x7f8fa81f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.891+0000 7f8fae9ce640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fa80c57e0 0x7f8fa81f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.891+0000 7f8fad9cc640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fa80cc0f0 0x7f8fa80af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.891+0000 7f8fae9ce640 1 -- 172.21.15.77:0/690557677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fa80cc0f0 msgr2=0x7f8fa80af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.891+0000 7f8fae9ce640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fa80cc0f0 0x7f8fa80af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.891+0000 7f8fae9ce640 1 -- 172.21.15.77:0/690557677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f98009400 con 0x7f8fa815b440 2023-11-26T07:18:46.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.891+0000 7f8fae9ce640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa815b440 0x7f8fa80aff00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0001eb0 tx=0x7f8fa000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.892+0000 7f8f9effd640 1 -- 172.21.15.77:0/690557677 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa00052d0 con 0x7f8fa815b440 2023-11-26T07:18:46.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.892+0000 7f8f9effd640 1 -- 172.21.15.77:0/690557677 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0005430 con 0x7f8fa815b440 2023-11-26T07:18:46.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.892+0000 7f8f9effd640 1 -- 172.21.15.77:0/690557677 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0003810 con 0x7f8fa815b440 2023-11-26T07:18:46.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.892+0000 7f8fb0431640 1 -- 172.21.15.77:0/690557677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa80c7740 con 0x7f8fa815b440 2023-11-26T07:18:46.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.892+0000 7f8fb0431640 1 -- 172.21.15.77:0/690557677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa80c7d00 con 0x7f8fa815b440 2023-11-26T07:18:46.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.893+0000 7f8fb0431640 1 -- 172.21.15.77:0/690557677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa804e8b0 con 0x7f8fa815b440 2023-11-26T07:18:46.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.894+0000 7f8f9effd640 1 -- 172.21.15.77:0/690557677 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8fa0003970 con 0x7f8fa815b440 2023-11-26T07:18:46.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.895+0000 7f8f9effd640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8f8c06ae40 0x7f8f8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.895+0000 7f8f9effd640 1 -- 172.21.15.77:0/690557677 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fa0088bf0 con 0x7f8fa815b440 2023-11-26T07:18:46.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.895+0000 7f8fae1cd640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8f8c06ae40 0x7f8f8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.896+0000 7f8fae1cd640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8f8c06ae40 0x7f8f8c06d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4001560 tx=0x7f8fa4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:46.899+0000 7f8f9effd640 1 -- 172.21.15.77:0/690557677 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8fa0053c90 con 0x7f8fa815b440 2023-11-26T07:18:47.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.127+0000 7f8fb0431640 1 -- 172.21.15.77:0/690557677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8fa80b4cb0 con 0x7f8fa815b440 2023-11-26T07:18:47.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.645+0000 7f8f9effd640 1 -- 172.21.15.77:0/690557677 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8fa00170c0 con 0x7f8fa815b440 2023-11-26T07:18:47.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.648+0000 7f8fb0431640 1 -- 172.21.15.77:0/690557677 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8f8c06ae40 msgr2=0x7f8f8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.648+0000 7f8fb0431640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8f8c06ae40 0x7f8f8c06d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4001560 tx=0x7f8fa4009040 comp rx=0 tx=0).stop 2023-11-26T07:18:47.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.648+0000 7f8fb0431640 1 -- 172.21.15.77:0/690557677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa815b440 msgr2=0x7f8fa80aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.648+0000 7f8fb0431640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa815b440 0x7f8fa80aff00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0001eb0 tx=0x7f8fa000c890 comp rx=0 tx=0).stop 2023-11-26T07:18:47.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.649+0000 7f8fb0431640 1 -- 172.21.15.77:0/690557677 shutdown_connections 2023-11-26T07:18:47.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.649+0000 7f8fb0431640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8f8c06ae40 0x7f8f8c06d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.649+0000 7f8fb0431640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa815b440 0x7f8fa80aff00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.649+0000 7f8fb0431640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fa80cc0f0 0x7f8fa80af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.649+0000 7f8fb0431640 1 --2- 172.21.15.77:0/690557677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fa80c57e0 0x7f8fa81f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.649+0000 7f8fb0431640 1 -- 172.21.15.77:0/690557677 >> 172.21.15.77:0/690557677 conn(0x7f8fa80b0c50 msgr2=0x7f8fa80706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:47.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.649+0000 7f8fb0431640 1 -- 172.21.15.77:0/690557677 shutdown_connections 2023-11-26T07:18:47.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.649+0000 7f8fb0431640 1 -- 172.21.15.77:0/690557677 wait complete. 2023-11-26T07:18:47.673 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:18:47.673 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:47.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.879+0000 7f8ee18bb640 1 Processor -- start 2023-11-26T07:18:47.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.880+0000 7f8ee18bb640 1 -- start start 2023-11-26T07:18:47.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.881+0000 7f8ee18bb640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8edc14b100 0x7f8edc162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.881+0000 7f8ee18bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0703f0 0x7f8edc165c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.881+0000 7f8ee18bb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc162eb0 con 0x7f8edc166150 2023-11-26T07:18:47.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.882+0000 7f8ee18bb640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8edc1654a0 con 0x7f8edc14b100 2023-11-26T07:18:47.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.882+0000 7f8ee18bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0ccf00 con 0x7f8edc0703f0 2023-11-26T07:18:47.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.882+0000 7f8ee10ba640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8edc166150 0x7f8edc0cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46328/0 (socket says 172.21.15.77:46328) 2023-11-26T07:18:47.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.882+0000 7f8ee10ba640 1 -- 172.21.15.77:0/680956940 learned_addr learned my addr 172.21.15.77:0/680956940 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:47.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.882+0000 7f8edbfff640 1 --2- 172.21.15.77:0/680956940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0703f0 0x7f8edc165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.882+0000 7f8ee08b9640 1 --2- 172.21.15.77:0/680956940 >> v2:172.21.15.159:3300/0 conn(0x7f8edc14b100 0x7f8edc162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.882+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059355023 0 0) 0x7f8ed4001490 con 0x7f8edc166150 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.882+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ecc003520 con 0x7f8edc166150 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 443425753 0 0) 0x7f8ecc003520 con 0x7f8edc166150 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0703f0 msgr2=0x7f8edc165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 --2- 172.21.15.77:0/680956940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0703f0 0x7f8edc165c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 >> v2:172.21.15.159:3300/0 conn(0x7f8edc14b100 msgr2=0x7f8edc162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 --2- 172.21.15.77:0/680956940 >> v2:172.21.15.159:3300/0 conn(0x7f8edc14b100 0x7f8edc162970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc0708f0 con 0x7f8edc166150 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f8ed4001b80 con 0x7f8edc166150 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 >> v1:172.21.15.77:6789/0 conn(0x7f8edc166150 legacy=0x7f8edc0cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 --2- 172.21.15.77:0/680956940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ecc003970 0x7f8ecc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 --2- 172.21.15.77:0/680956940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 0x7f8ecc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 --2- 172.21.15.77:0/680956940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0703f0 0x7f8ecc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc1654a0 con 0x7f8ecc0047c0 2023-11-26T07:18:47.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0ccf00 con 0x7f8ecc003970 2023-11-26T07:18:47.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc00b9b0 con 0x7f8edc0703f0 2023-11-26T07:18:47.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.883+0000 7f8edbfff640 1 --2- 172.21.15.77:0/680956940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 0x7f8ecc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.884+0000 7f8ee08b9640 1 --2- 172.21.15.77:0/680956940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ecc003970 0x7f8ecc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.884+0000 7f8edbfff640 1 -- 172.21.15.77:0/680956940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0703f0 msgr2=0x7f8ecc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:47.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.884+0000 7f8edbfff640 1 --2- 172.21.15.77:0/680956940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0703f0 0x7f8ecc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.884+0000 7f8edbfff640 1 -- 172.21.15.77:0/680956940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ecc003970 msgr2=0x7f8ecc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:47.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.884+0000 7f8edbfff640 1 --2- 172.21.15.77:0/680956940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ecc003970 0x7f8ecc003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.884+0000 7f8edbfff640 1 -- 172.21.15.77:0/680956940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc003520 con 0x7f8ecc0047c0 2023-11-26T07:18:47.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.885+0000 7f8edbfff640 1 --2- 172.21.15.77:0/680956940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 0x7f8ecc004c40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009ac0 tx=0x7f8ecc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9477ad432843c233 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.885+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec802c6d0 con 0x7f8ecc0047c0 2023-11-26T07:18:47.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.885+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec802c830 con 0x7f8ecc0047c0 2023-11-26T07:18:47.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.885+0000 7f8edb7fe640 1 -- 172.21.15.77:0/680956940 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec802cbc0 con 0x7f8ecc0047c0 2023-11-26T07:18:47.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.886+0000 7f8ee18bb640 1 -- 172.21.15.77:0/680956940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 msgr2=0x7f8ecc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.886+0000 7f8ee18bb640 1 --2- 172.21.15.77:0/680956940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 0x7f8ecc004c40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009ac0 tx=0x7f8ecc0057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.886+0000 7f8ee10ba640 1 -- 172.21.15.77:0/680956940 reap_dead start 2023-11-26T07:18:47.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.886+0000 7f8ee18bb640 1 -- 172.21.15.77:0/680956940 shutdown_connections 2023-11-26T07:18:47.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.886+0000 7f8ee18bb640 1 -- 172.21.15.77:0/680956940 >> 172.21.15.77:0/680956940 conn(0x7f8edc0cb830 msgr2=0x7f8edc0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:47.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.886+0000 7f8ee18bb640 1 -- 172.21.15.77:0/680956940 shutdown_connections 2023-11-26T07:18:47.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.886+0000 7f8ee18bb640 1 -- 172.21.15.77:0/680956940 wait complete. 2023-11-26T07:18:47.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.888+0000 7f8ee18bb640 1 Processor -- start 2023-11-26T07:18:47.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.888+0000 7f8ee18bb640 1 -- start start 2023-11-26T07:18:47.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee18bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 0x7f8edc1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee18bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0b4460 0x7f8edc0aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee18bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8edc149a00 0x7f8edc0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee18bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0b4970 con 0x7f8ecc0047c0 2023-11-26T07:18:47.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee18bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0b4c50 con 0x7f8edc149a00 2023-11-26T07:18:47.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee18bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0b4f30 con 0x7f8edc0b4460 2023-11-26T07:18:47.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee08b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 0x7f8edc1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee08b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 0x7f8edc1491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56242/0 (socket says 172.21.15.77:56242) 2023-11-26T07:18:47.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee08b9640 1 -- 172.21.15.77:0/535144359 learned_addr learned my addr 172.21.15.77:0/535144359 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:47.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8edbfff640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0b4460 0x7f8edc0aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee08b9640 1 -- 172.21.15.77:0/535144359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0b4460 msgr2=0x7f8edc0aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee08b9640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0b4460 0x7f8edc0aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee08b9640 1 -- 172.21.15.77:0/535144359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8edc149a00 msgr2=0x7f8edc0b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee08b9640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8edc149a00 0x7f8edc0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.889+0000 7f8ee08b9640 1 -- 172.21.15.77:0/535144359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc0ac300 con 0x7f8ecc0047c0 2023-11-26T07:18:47.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.890+0000 7f8ee08b9640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 0x7f8edc1491e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00108e0 tx=0x7f8ed0010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.890+0000 7f8ed97fa640 1 -- 172.21.15.77:0/535144359 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000eb60 con 0x7f8ecc0047c0 2023-11-26T07:18:47.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.890+0000 7f8ed97fa640 1 -- 172.21.15.77:0/535144359 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed000ecc0 con 0x7f8ecc0047c0 2023-11-26T07:18:47.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.890+0000 7f8ee18bb640 1 -- 172.21.15.77:0/535144359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc0abff0 con 0x7f8ecc0047c0 2023-11-26T07:18:47.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.890+0000 7f8ed97fa640 1 -- 172.21.15.77:0/535144359 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed001c400 con 0x7f8ecc0047c0 2023-11-26T07:18:47.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.890+0000 7f8ee18bb640 1 -- 172.21.15.77:0/535144359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc14a110 con 0x7f8ecc0047c0 2023-11-26T07:18:47.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.891+0000 7f8ee18bb640 1 -- 172.21.15.77:0/535144359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc0b5140 con 0x7f8ecc0047c0 2023-11-26T07:18:47.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.892+0000 7f8ed97fa640 1 -- 172.21.15.77:0/535144359 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ed001c560 con 0x7f8ecc0047c0 2023-11-26T07:18:47.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.893+0000 7f8ed97fa640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ec006ae40 0x7f8ec006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.893+0000 7f8ed97fa640 1 -- 172.21.15.77:0/535144359 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ed0089d90 con 0x7f8ecc0047c0 2023-11-26T07:18:47.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.894+0000 7f8edbfff640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ec006ae40 0x7f8ec006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.894+0000 7f8edbfff640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ec006ae40 0x7f8ec006d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8036000 tx=0x7f8ec8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:47.898+0000 7f8ed97fa640 1 -- 172.21.15.77:0/535144359 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8edc0b5140 con 0x7f8ecc0047c0 2023-11-26T07:18:48.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.125+0000 7f8ee18bb640 1 -- 172.21.15.77:0/535144359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8edc0b5140 con 0x7f8ecc0047c0 2023-11-26T07:18:48.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.126+0000 7f8ed97fa640 1 -- 172.21.15.77:0/535144359 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f8edc0b5140 con 0x7f8ecc0047c0 2023-11-26T07:18:48.128 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:48.129 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3806365439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3806365439},{"type":"v1","addr":"172.21.15.77:6836","nonce":3806365439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/694008676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":694008676},{"type":"v1","addr":"172.21.15.77:6837","nonce":694008676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4705,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/4096574472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4096574472},{"type":"v1","addr":"172.21.15.159:6834","nonce":4096574472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:43.790536+0000","modified":"2023-11-26T07:18:47.129568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6835/360332813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":360332813},{"type":"v1","addr":"172.21.15.159:6835","nonce":360332813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:18:48.129 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2023-11-26T07:18:48.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.128+0000 7f8ee18bb640 1 -- 172.21.15.77:0/535144359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ec006ae40 msgr2=0x7f8ec006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.128+0000 7f8ee18bb640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ec006ae40 0x7f8ec006d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8036000 tx=0x7f8ec8030000 comp rx=0 tx=0).stop 2023-11-26T07:18:48.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.128+0000 7f8ee18bb640 1 -- 172.21.15.77:0/535144359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 msgr2=0x7f8edc1491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.128+0000 7f8ee18bb640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 0x7f8edc1491e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00108e0 tx=0x7f8ed0010da0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.129+0000 7f8ee18bb640 1 -- 172.21.15.77:0/535144359 shutdown_connections 2023-11-26T07:18:48.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.129+0000 7f8ee18bb640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ec006ae40 0x7f8ec006d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.129+0000 7f8ee18bb640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8edc149a00 0x7f8edc0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.129+0000 7f8ee18bb640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8edc0b4460 0x7f8edc0aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.129+0000 7f8ee18bb640 1 --2- 172.21.15.77:0/535144359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ecc0047c0 0x7f8edc1491e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.129+0000 7f8ee18bb640 1 -- 172.21.15.77:0/535144359 >> 172.21.15.77:0/535144359 conn(0x7f8edc0cb830 msgr2=0x7f8edc0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:48.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.129+0000 7f8ee18bb640 1 -- 172.21.15.77:0/535144359 shutdown_connections 2023-11-26T07:18:48.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.129+0000 7f8ee18bb640 1 -- 172.21.15.77:0/535144359 wait complete. 2023-11-26T07:18:48.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:48.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.356+0000 7f0153fff640 1 Processor -- start 2023-11-26T07:18:48.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.357+0000 7f0153fff640 1 -- start start 2023-11-26T07:18:48.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.358+0000 7f0153fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f015414b100 0x7f0154162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.358+0000 7f0153fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01540703f0 0x7f0154165c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.358+0000 7f0153fff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0154162eb0 con 0x7f0154166150 2023-11-26T07:18:48.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.359+0000 7f0153fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01541654a0 con 0x7f015414b100 2023-11-26T07:18:48.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.359+0000 7f0153fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01540ccf00 con 0x7f01540703f0 2023-11-26T07:18:48.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.359+0000 7f0152ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f015414b100 0x7f0154162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.359+0000 7f0152ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f015414b100 0x7f0154162970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56246/0 (socket says 172.21.15.77:56246) 2023-11-26T07:18:48.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.359+0000 7f0152ffd640 1 -- 172.21.15.77:0/1833273284 learned_addr learned my addr 172.21.15.77:0/1833273284 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:48.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.359+0000 7f0152ffd640 1 -- 172.21.15.77:0/1833273284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01540703f0 msgr2=0x7f0154165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:48.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.359+0000 7f0152ffd640 1 --2- 172.21.15.77:0/1833273284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01540703f0 0x7f0154165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.359+0000 7f0152ffd640 1 -- 172.21.15.77:0/1833273284 >> v1:172.21.15.159:6789/0 conn(0x7f0154166150 legacy=0x7f01540cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:48.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.359+0000 7f0152ffd640 1 -- 172.21.15.77:0/1833273284 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01540708f0 con 0x7f015414b100 2023-11-26T07:18:48.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.360+0000 7f0152ffd640 1 --2- 172.21.15.77:0/1833273284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f015414b100 0x7f0154162970 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0144009870 tx=0x7f014402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230dd5f0367a4ea1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.361+0000 7f0151ffb640 1 -- 172.21.15.77:0/1833273284 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01440317c0 con 0x7f015414b100 2023-11-26T07:18:48.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.361+0000 7f0151ffb640 1 -- 172.21.15.77:0/1833273284 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0144031920 con 0x7f015414b100 2023-11-26T07:18:48.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.361+0000 7f0151ffb640 1 -- 172.21.15.77:0/1833273284 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144031cb0 con 0x7f015414b100 2023-11-26T07:18:48.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.361+0000 7f0153fff640 1 -- 172.21.15.77:0/1833273284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f015414b100 msgr2=0x7f0154162970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.361+0000 7f0153fff640 1 --2- 172.21.15.77:0/1833273284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f015414b100 0x7f0154162970 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0144009870 tx=0x7f014402b860 comp rx=0 tx=0).stop 2023-11-26T07:18:48.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.362+0000 7f0153fff640 1 -- 172.21.15.77:0/1833273284 shutdown_connections 2023-11-26T07:18:48.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.362+0000 7f0153fff640 1 --2- 172.21.15.77:0/1833273284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01540703f0 0x7f0154165c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.362+0000 7f0153fff640 1 --2- 172.21.15.77:0/1833273284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f015414b100 0x7f0154162970 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.362+0000 7f0153fff640 1 -- 172.21.15.77:0/1833273284 >> 172.21.15.77:0/1833273284 conn(0x7f01540cb830 msgr2=0x7f01540cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:48.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.362+0000 7f0153fff640 1 -- 172.21.15.77:0/1833273284 shutdown_connections 2023-11-26T07:18:48.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.362+0000 7f0153fff640 1 -- 172.21.15.77:0/1833273284 wait complete. 2023-11-26T07:18:48.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.364+0000 7f0153fff640 1 Processor -- start 2023-11-26T07:18:48.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.364+0000 7f0153fff640 1 -- start start 2023-11-26T07:18:48.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.365+0000 7f0153fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01540703f0 0x7f0154160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.365+0000 7f0153fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f015414b100 0x7f01541608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.365+0000 7f0153fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0154142d90 0x7f0154144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.365+0000 7f0153fff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01541432e0 con 0x7f01540703f0 2023-11-26T07:18:48.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.365+0000 7f0153fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01541435c0 con 0x7f0154142d90 2023-11-26T07:18:48.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.365+0000 7f0153fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01541438a0 con 0x7f015414b100 2023-11-26T07:18:48.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.366+0000 7f0152ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01540703f0 0x7f0154160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.366+0000 7f0152ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01540703f0 0x7f0154160f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56248/0 (socket says 172.21.15.77:56248) 2023-11-26T07:18:48.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.366+0000 7f0152ffd640 1 -- 172.21.15.77:0/1825129484 learned_addr learned my addr 172.21.15.77:0/1825129484 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:48.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.366+0000 7f0152ffd640 1 -- 172.21.15.77:0/1825129484 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f015414b100 msgr2=0x7f01541608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.366+0000 7f01527fc640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f015414b100 0x7f01541608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.366+0000 7f0152ffd640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f015414b100 0x7f01541608d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.366+0000 7f0152ffd640 1 -- 172.21.15.77:0/1825129484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0154142d90 msgr2=0x7f0154144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.366+0000 7f01537fe640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0154142d90 0x7f0154144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.366+0000 7f0152ffd640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0154142d90 0x7f0154144d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.366+0000 7f0152ffd640 1 -- 172.21.15.77:0/1825129484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01440094d0 con 0x7f01540703f0 2023-11-26T07:18:48.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.366+0000 7f0152ffd640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01540703f0 0x7f0154160f60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0144009870 tx=0x7f01440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.367+0000 7f013bfff640 1 -- 172.21.15.77:0/1825129484 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144032860 con 0x7f01540703f0 2023-11-26T07:18:48.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.367+0000 7f013bfff640 1 -- 172.21.15.77:0/1825129484 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01440329c0 con 0x7f01540703f0 2023-11-26T07:18:48.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.367+0000 7f013bfff640 1 -- 172.21.15.77:0/1825129484 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144032d50 con 0x7f01540703f0 2023-11-26T07:18:48.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.367+0000 7f0153fff640 1 -- 172.21.15.77:0/1825129484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0154143b80 con 0x7f01540703f0 2023-11-26T07:18:48.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.367+0000 7f0153fff640 1 -- 172.21.15.77:0/1825129484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0154144380 con 0x7f01540703f0 2023-11-26T07:18:48.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.368+0000 7f0153fff640 1 -- 172.21.15.77:0/1825129484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01541439e0 con 0x7f01540703f0 2023-11-26T07:18:48.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.369+0000 7f013bfff640 1 -- 172.21.15.77:0/1825129484 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f014404d3f0 con 0x7f01540703f0 2023-11-26T07:18:48.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.370+0000 7f013bfff640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f014006ae40 0x7f014006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.370+0000 7f013bfff640 1 -- 172.21.15.77:0/1825129484 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01440ab360 con 0x7f01540703f0 2023-11-26T07:18:48.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.370+0000 7f01527fc640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f014006ae40 0x7f014006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.371+0000 7f01527fc640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f014006ae40 0x7f014006d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0154161c40 tx=0x7f0148008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.374+0000 7f013bfff640 1 -- 172.21.15.77:0/1825129484 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f01541439e0 con 0x7f01540703f0 2023-11-26T07:18:48.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.567+0000 7f0153fff640 1 -- 172.21.15.77:0/1825129484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0154162eb0 con 0x7f01540703f0 2023-11-26T07:18:48.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.570+0000 7f013bfff640 1 -- 172.21.15.77:0/1825129484 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f0154162eb0 con 0x7f01540703f0 2023-11-26T07:18:48.573 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:48.573 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":34,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:18:45.333229+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:42.084786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:42.792071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 -- 172.21.15.77:0/1825129484 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f014006ae40 msgr2=0x7f014006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f014006ae40 0x7f014006d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0154161c40 tx=0x7f0148008040 comp rx=0 tx=0).stop 2023-11-26T07:18:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 -- 172.21.15.77:0/1825129484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01540703f0 msgr2=0x7f0154160f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01540703f0 0x7f0154160f60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0144009870 tx=0x7f01440046c0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 -- 172.21.15.77:0/1825129484 shutdown_connections 2023-11-26T07:18:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f014006ae40 0x7f014006d300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0154142d90 0x7f0154144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f015414b100 0x7f01541608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 --2- 172.21.15.77:0/1825129484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01540703f0 0x7f0154160f60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 -- 172.21.15.77:0/1825129484 >> 172.21.15.77:0/1825129484 conn(0x7f01540cb830 msgr2=0x7f0154164410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:48.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 -- 172.21.15.77:0/1825129484 shutdown_connections 2023-11-26T07:18:48.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.573+0000 7f0153fff640 1 -- 172.21.15.77:0/1825129484 wait complete. 2023-11-26T07:18:48.594 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:18:48.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:18:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.803+0000 7f1362761640 1 Processor -- start 2023-11-26T07:18:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.804+0000 7f1362761640 1 -- start start 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.805+0000 7f1362761640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f135c15df80 0x7f135c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.805+0000 7f1362761640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c0cd470 0x7f135c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.805+0000 7f1362761640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135c15e3f0 con 0x7f135c0b2250 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.805+0000 7f1362761640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135c15a990 con 0x7f135c15df80 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.805+0000 7f1362761640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c15ab80 con 0x7f135c0cd470 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.805+0000 7f135bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f135c0b2250 0x7f135c0b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46342/0 (socket says 172.21.15.77:46342) 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.805+0000 7f135bfff640 1 -- 172.21.15.77:0/3620522661 learned_addr learned my addr 172.21.15.77:0/3620522661 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:48.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271778648 0 0) 0x7f135c15e3f0 con 0x7f135c0b2250 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f1360cfe640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c0cd470 0x7f135c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1348003520 con 0x7f135c0b2250 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f13537fe640 1 --2- 172.21.15.77:0/3620522661 >> v2:172.21.15.159:3300/0 conn(0x7f135c15df80 0x7f135c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1661781906 0 0) 0x7f1348003520 con 0x7f135c0b2250 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c0cd470 msgr2=0x7f135c15b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c0cd470 0x7f135c15b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 >> v2:172.21.15.159:3300/0 conn(0x7f135c15df80 msgr2=0x7f135c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 --2- 172.21.15.77:0/3620522661 >> v2:172.21.15.159:3300/0 conn(0x7f135c15df80 0x7f135c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c0b2d40 con 0x7f135c0b2250 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f134c0019f0 con 0x7f135c0b2250 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 >> v1:172.21.15.77:6789/0 conn(0x7f135c0b2250 legacy=0x7f135c0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1348003970 0x7f1348003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c0cd470 0x7f13480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1348004d00 0x7f1348005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c15ab80 con 0x7f1348003970 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134800b980 con 0x7f1348004d00 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.806+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134800bb40 con 0x7f135c0cd470 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.807+0000 7f135bfff640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1348003970 0x7f1348003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.807+0000 7f13537fe640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c0cd470 0x7f13480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.807+0000 7f135bfff640 1 -- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c0cd470 msgr2=0x7f13480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.807+0000 7f1360cfe640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1348004d00 0x7f1348005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.807+0000 7f135bfff640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c0cd470 0x7f13480047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.807+0000 7f135bfff640 1 -- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1348004d00 msgr2=0x7f1348005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.807+0000 7f135bfff640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1348004d00 0x7f1348005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.807+0000 7f135bfff640 1 -- 172.21.15.77:0/3620522661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1348003520 con 0x7f1348003970 2023-11-26T07:18:48.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.807+0000 7f1360cfe640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1348004d00 0x7f1348005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:48.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.808+0000 7f135bfff640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1348003970 0x7f1348003d90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f134c00a760 tx=0x7f13480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eeac20e512a4787 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.808+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c034630 con 0x7f1348003970 2023-11-26T07:18:48.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.808+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c02f070 con 0x7f1348003970 2023-11-26T07:18:48.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.808+0000 7f135b7fe640 1 -- 172.21.15.77:0/3620522661 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c0349d0 con 0x7f1348003970 2023-11-26T07:18:48.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.809+0000 7f1362761640 1 -- 172.21.15.77:0/3620522661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1348003970 msgr2=0x7f1348003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.809+0000 7f1362761640 1 --2- 172.21.15.77:0/3620522661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1348003970 0x7f1348003d90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f134c00a760 tx=0x7f13480057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.809+0000 7f1360cfe640 1 -- 172.21.15.77:0/3620522661 reap_dead start 2023-11-26T07:18:48.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.809+0000 7f1362761640 1 -- 172.21.15.77:0/3620522661 shutdown_connections 2023-11-26T07:18:48.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.809+0000 7f1362761640 1 -- 172.21.15.77:0/3620522661 >> 172.21.15.77:0/3620522661 conn(0x7f135c06a920 msgr2=0x7f135c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:48.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.809+0000 7f1362761640 1 -- 172.21.15.77:0/3620522661 shutdown_connections 2023-11-26T07:18:48.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.809+0000 7f1362761640 1 -- 172.21.15.77:0/3620522661 wait complete. 2023-11-26T07:18:48.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.811+0000 7f1362761640 1 Processor -- start 2023-11-26T07:18:48.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.811+0000 7f1362761640 1 -- start start 2023-11-26T07:18:48.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.812+0000 7f1362761640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1348003970 0x7f135c1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.812+0000 7f1362761640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f135c154fb0 0x7f135c071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.812+0000 7f1362761640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c1f3b10 0x7f135c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.812+0000 7f1362761640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c153fc0 con 0x7f135c154fb0 2023-11-26T07:18:48.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.812+0000 7f1362761640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c154b20 con 0x7f1348003970 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.812+0000 7f1362761640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c072830 con 0x7f135c1f3b10 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.812+0000 7f13537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f135c154fb0 0x7f135c071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.812+0000 7f13537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f135c154fb0 0x7f135c071ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56252/0 (socket says 172.21.15.77:56252) 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.812+0000 7f13537fe640 1 -- 172.21.15.77:0/3103638349 learned_addr learned my addr 172.21.15.77:0/3103638349 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.812+0000 7f1360cfe640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c1f3b10 0x7f135c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f135bfff640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1348003970 0x7f135c1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f13537fe640 1 -- 172.21.15.77:0/3103638349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c1f3b10 msgr2=0x7f135c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f13537fe640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c1f3b10 0x7f135c15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f13537fe640 1 -- 172.21.15.77:0/3103638349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1348003970 msgr2=0x7f135c1527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f13537fe640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1348003970 0x7f135c1527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f13537fe640 1 -- 172.21.15.77:0/3103638349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c155410 con 0x7f135c154fb0 2023-11-26T07:18:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f13537fe640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f135c154fb0 0x7f135c071ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f134400e7e0 tx=0x7f134400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f13597fa640 1 -- 172.21.15.77:0/3103638349 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134400c670 con 0x7f135c154fb0 2023-11-26T07:18:48.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f13597fa640 1 -- 172.21.15.77:0/3103638349 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134400c7d0 con 0x7f135c154fb0 2023-11-26T07:18:48.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f13597fa640 1 -- 172.21.15.77:0/3103638349 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134400cb40 con 0x7f135c154fb0 2023-11-26T07:18:48.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f1362761640 1 -- 172.21.15.77:0/3103638349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c1541f0 con 0x7f135c154fb0 2023-11-26T07:18:48.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.813+0000 7f1362761640 1 -- 172.21.15.77:0/3103638349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c1547b0 con 0x7f135c154fb0 2023-11-26T07:18:48.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.814+0000 7f1362761640 1 -- 172.21.15.77:0/3103638349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135c067470 con 0x7f135c154fb0 2023-11-26T07:18:48.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.815+0000 7f13597fa640 1 -- 172.21.15.77:0/3103638349 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f134400cca0 con 0x7f135c154fb0 2023-11-26T07:18:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.816+0000 7f13597fa640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f133c06ae70 0x7f133c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.816+0000 7f13597fa640 1 -- 172.21.15.77:0/3103638349 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1344089460 con 0x7f135c154fb0 2023-11-26T07:18:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.817+0000 7f135bfff640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f133c06ae70 0x7f133c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.818+0000 7f135bfff640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f133c06ae70 0x7f133c06d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f134c034000 tx=0x7f134c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.821+0000 7f13597fa640 1 -- 172.21.15.77:0/3103638349 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13440543e0 con 0x7f135c154fb0 2023-11-26T07:18:48.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:48.993+0000 7f1362761640 1 -- 172.21.15.77:0/3103638349 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f135c15ec40 con 0x7f133c06ae70 2023-11-26T07:18:49.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.020+0000 7f13597fa640 1 -- 172.21.15.77:0/3103638349 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281193 (secure 0 0 0) 0x7f134c001f20 con 0x7f133c06ae70 2023-11-26T07:18:49.024 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:49.029 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:18:49.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 -- 172.21.15.77:0/3103638349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f133c06ae70 msgr2=0x7f133c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f133c06ae70 0x7f133c06d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f134c034000 tx=0x7f134c009030 comp rx=0 tx=0).stop 2023-11-26T07:18:49.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 -- 172.21.15.77:0/3103638349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f135c154fb0 msgr2=0x7f135c071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f135c154fb0 0x7f135c071ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f134400e7e0 tx=0x7f134400eca0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 -- 172.21.15.77:0/3103638349 shutdown_connections 2023-11-26T07:18:49.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f133c06ae70 0x7f133c06d330 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f135c1f3b10 0x7f135c15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f135c154fb0 0x7f135c071ff0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 --2- 172.21.15.77:0/3103638349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1348003970 0x7f135c1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 -- 172.21.15.77:0/3103638349 >> 172.21.15.77:0/3103638349 conn(0x7f135c06a920 msgr2=0x7f135c0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:49.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 -- 172.21.15.77:0/3103638349 shutdown_connections 2023-11-26T07:18:49.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.027+0000 7f1362761640 1 -- 172.21.15.77:0/3103638349 wait complete. 2023-11-26T07:18:49.047 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-11-26T07:18:47.625901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220100,"kb_used_data":3928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754620,"statfs":{"total":773094113280,"available":772868730880,"internally_reserved":0,"allocated":4022272,"data_stored":2266260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.329450"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332779+0000","last_change":"2023-11-26T07:18:43.332779+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332779+0000","last_undegraded":"2023-11-26T07:18:43.332779+0000","last_fullsized":"2023-11-26T07:18:43.332779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.323936+0000","last_change":"2023-11-26T07:18:43.323936+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.323936+0000","last_undegraded":"2023-11-26T07:18:43.323936+0000","last_fullsized":"2023-11-26T07:18:43.323936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318263+0000","last_change":"2023-11-26T07:18:43.318263+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318263+0000","last_undegraded":"2023-11-26T07:18:43.318263+0000","last_fullsized":"2023-11-26T07:18:43.318263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.333849+0000","last_change":"2023-11-26T07:18:43.333849+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.333849+0000","last_undegraded":"2023-11-26T07:18:43.333849+0000","last_fullsized":"2023-11-26T07:18:43.333849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.320534+0000","last_change":"2023-11-26T07:18:43.320534+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.320534+0000","last_undegraded":"2023-11-26T07:18:43.320534+0000","last_fullsized":"2023-11-26T07:18:43.320534+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.317226+0000","last_change":"2023-11-26T07:18:43.317226+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.317226+0000","last_undegraded":"2023-11-26T07:18:43.317226+0000","last_fullsized":"2023-11-26T07:18:43.317226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.328208+0000","last_change":"2023-11-26T07:18:43.328208+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.328208+0000","last_undegraded":"2023-11-26T07:18:43.328208+0000","last_fullsized":"2023-11-26T07:18:43.328208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332342+0000","last_change":"2023-11-26T07:18:43.332342+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332342+0000","last_undegraded":"2023-11-26T07:18:43.332342+0000","last_fullsized":"2023-11-26T07:18:43.332342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.327495+0000","last_change":"2023-11-26T07:18:43.327495+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.327495+0000","last_undegraded":"2023-11-26T07:18:43.327495+0000","last_fullsized":"2023-11-26T07:18:43.327495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331387+0000","last_change":"2023-11-26T07:18:43.331387+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331387+0000","last_undegraded":"2023-11-26T07:18:43.331387+0000","last_fullsized":"2023-11-26T07:18:43.331387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.328021+0000","last_change":"2023-11-26T07:18:43.328021+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.328021+0000","last_undegraded":"2023-11-26T07:18:43.328021+0000","last_fullsized":"2023-11-26T07:18:43.328021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.321932+0000","last_change":"2023-11-26T07:18:43.321932+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.321932+0000","last_undegraded":"2023-11-26T07:18:43.321932+0000","last_fullsized":"2023-11-26T07:18:43.321932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.320019+0000","last_change":"2023-11-26T07:18:43.320019+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.320019+0000","last_undegraded":"2023-11-26T07:18:43.320019+0000","last_fullsized":"2023-11-26T07:18:43.320019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.316741+0000","last_change":"2023-11-26T07:18:43.316741+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.316741+0000","last_undegraded":"2023-11-26T07:18:43.316741+0000","last_fullsized":"2023-11-26T07:18:43.316741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.322026+0000","last_change":"2023-11-26T07:18:43.322026+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.322026+0000","last_undegraded":"2023-11-26T07:18:43.322026+0000","last_fullsized":"2023-11-26T07:18:43.322026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.326620+0000","last_change":"2023-11-26T07:18:43.326620+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.326620+0000","last_undegraded":"2023-11-26T07:18:43.326620+0000","last_fullsized":"2023-11-26T07:18:43.326620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.338296+0000","last_change":"2023-11-26T07:18:43.338296+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.338296+0000","last_undegraded":"2023-11-26T07:18:43.338296+0000","last_fullsized":"2023-11-26T07:18:43.338296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.323473+0000","last_change":"2023-11-26T07:18:43.323473+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.323473+0000","last_undegraded":"2023-11-26T07:18:43.323473+0000","last_fullsized":"2023-11-26T07:18:43.323473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.317003+0000","last_change":"2023-11-26T07:18:43.317003+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.317003+0000","last_undegraded":"2023-11-26T07:18:43.317003+0000","last_fullsized":"2023-11-26T07:18:43.317003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.319546+0000","last_change":"2023-11-26T07:18:43.319546+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.319546+0000","last_undegraded":"2023-11-26T07:18:43.319546+0000","last_fullsized":"2023-11-26T07:18:43.319546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.333509+0000","last_change":"2023-11-26T07:18:43.333509+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.333509+0000","last_undegraded":"2023-11-26T07:18:43.333509+0000","last_fullsized":"2023-11-26T07:18:43.333509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331115+0000","last_change":"2023-11-26T07:18:43.331115+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331115+0000","last_undegraded":"2023-11-26T07:18:43.331115+0000","last_fullsized":"2023-11-26T07:18:43.331115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.325815+0000","last_change":"2023-11-26T07:18:43.325815+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.325815+0000","last_undegraded":"2023-11-26T07:18:43.325815+0000","last_fullsized":"2023-11-26T07:18:43.325815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318453+0000","last_change":"2023-11-26T07:18:43.318453+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318453+0000","last_undegraded":"2023-11-26T07:18:43.318453+0000","last_fullsized":"2023-11-26T07:18:43.318453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331370+0000","last_change":"2023-11-26T07:18:43.331370+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331370+0000","last_undegraded":"2023-11-26T07:18:43.331370+0000","last_fullsized":"2023-11-26T07:18:43.331370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.322638+0000","last_change":"2023-11-26T07:18:43.322638+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.322638+0000","last_undegraded":"2023-11-26T07:18:43.322638+0000","last_fullsized":"2023-11-26T07:18:43.322638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.333190+0000","last_change":"2023-11-26T07:18:43.333190+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.333190+0000","last_undegraded":"2023-11-26T07:18:43.333190+0000","last_fullsized":"2023-11-26T07:18:43.333190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.320768+0000","last_change":"2023-11-26T07:18:43.320768+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.320768+0000","last_undegraded":"2023-11-26T07:18:43.320768+0000","last_fullsized":"2023-11-26T07:18:43.320768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332425+0000","last_change":"2023-11-26T07:18:43.332425+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332425+0000","last_undegraded":"2023-11-26T07:18:43.332425+0000","last_fullsized":"2023-11-26T07:18:43.332425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.337416+0000","last_change":"2023-11-26T07:18:43.337416+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.337416+0000","last_undegraded":"2023-11-26T07:18:43.337416+0000","last_fullsized":"2023-11-26T07:18:43.337416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331463+0000","last_change":"2023-11-26T07:18:43.331463+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331463+0000","last_undegraded":"2023-11-26T07:18:43.331463+0000","last_fullsized":"2023-11-26T07:18:43.331463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331797+0000","last_change":"2023-11-26T07:18:43.331797+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331797+0000","last_undegraded":"2023-11-26T07:18:43.331797+0000","last_fullsized":"2023-11-26T07:18:43.331797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.327740+0000","last_change":"2023-11-26T07:18:43.327740+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.327740+0000","last_undegraded":"2023-11-26T07:18:43.327740+0000","last_fullsized":"2023-11-26T07:18:43.327740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.350873+0000","last_change":"2023-11-26T07:18:43.349331+0000","last_active":"2023-11-26T07:18:43.350873+0000","last_peered":"2023-11-26T07:18:43.350873+0000","last_clean":"2023-11-26T07:18:43.350873+0000","last_became_active":"2023-11-26T07:18:43.349011+0000","last_became_peered":"2023-11-26T07:18:43.349011+0000","last_unstale":"2023-11-26T07:18:43.350873+0000","last_undegraded":"2023-11-26T07:18:43.350873+0000","last_fullsized":"2023-11-26T07:18:43.350873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:59.120873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332226+0000","last_change":"2023-11-26T07:18:43.332226+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332226+0000","last_undegraded":"2023-11-26T07:18:43.332226+0000","last_fullsized":"2023-11-26T07:18:43.332226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.346409+0000","last_change":"2023-11-26T07:18:43.340731+0000","last_active":"2023-11-26T07:18:43.346409+0000","last_peered":"2023-11-26T07:18:43.346409+0000","last_clean":"2023-11-26T07:18:43.346409+0000","last_became_active":"2023-11-26T07:18:43.340447+0000","last_became_peered":"2023-11-26T07:18:43.340447+0000","last_unstale":"2023-11-26T07:18:43.346409+0000","last_undegraded":"2023-11-26T07:18:43.346409+0000","last_fullsized":"2023-11-26T07:18:43.346409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:16.747715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332604+0000","last_change":"2023-11-26T07:18:43.332604+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332604+0000","last_undegraded":"2023-11-26T07:18:43.332604+0000","last_fullsized":"2023-11-26T07:18:43.332604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.343850+0000","last_change":"2023-11-26T07:18:43.341518+0000","last_active":"2023-11-26T07:18:43.343850+0000","last_peered":"2023-11-26T07:18:43.343850+0000","last_clean":"2023-11-26T07:18:43.343850+0000","last_became_active":"2023-11-26T07:18:43.341219+0000","last_became_peered":"2023-11-26T07:18:43.341219+0000","last_unstale":"2023-11-26T07:18:43.343850+0000","last_undegraded":"2023-11-26T07:18:43.343850+0000","last_fullsized":"2023-11-26T07:18:43.343850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:51.107572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332763+0000","last_change":"2023-11-26T07:18:43.332763+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332763+0000","last_undegraded":"2023-11-26T07:18:43.332763+0000","last_fullsized":"2023-11-26T07:18:43.332763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.348421+0000","last_change":"2023-11-26T07:18:43.343141+0000","last_active":"2023-11-26T07:18:43.348421+0000","last_peered":"2023-11-26T07:18:43.348421+0000","last_clean":"2023-11-26T07:18:43.348421+0000","last_became_active":"2023-11-26T07:18:43.342643+0000","last_became_peered":"2023-11-26T07:18:43.342643+0000","last_unstale":"2023-11-26T07:18:43.348421+0000","last_undegraded":"2023-11-26T07:18:43.348421+0000","last_fullsized":"2023-11-26T07:18:43.348421+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:07.238526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.334971+0000","last_change":"2023-11-26T07:18:43.334971+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.334971+0000","last_undegraded":"2023-11-26T07:18:43.334971+0000","last_fullsized":"2023-11-26T07:18:43.334971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.345857+0000","last_change":"2023-11-26T07:18:43.340696+0000","last_active":"2023-11-26T07:18:43.345857+0000","last_peered":"2023-11-26T07:18:43.345857+0000","last_clean":"2023-11-26T07:18:43.345857+0000","last_became_active":"2023-11-26T07:18:43.340412+0000","last_became_peered":"2023-11-26T07:18:43.340412+0000","last_unstale":"2023-11-26T07:18:43.345857+0000","last_undegraded":"2023-11-26T07:18:43.345857+0000","last_fullsized":"2023-11-26T07:18:43.345857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:48:42.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.320991+0000","last_change":"2023-11-26T07:18:43.320991+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.320991+0000","last_undegraded":"2023-11-26T07:18:43.320991+0000","last_fullsized":"2023-11-26T07:18:43.320991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.345233+0000","last_change":"2023-11-26T07:18:43.340168+0000","last_active":"2023-11-26T07:18:43.345233+0000","last_peered":"2023-11-26T07:18:43.345233+0000","last_clean":"2023-11-26T07:18:43.345233+0000","last_became_active":"2023-11-26T07:18:43.339836+0000","last_became_peered":"2023-11-26T07:18:43.339836+0000","last_unstale":"2023-11-26T07:18:43.345233+0000","last_undegraded":"2023-11-26T07:18:43.345233+0000","last_fullsized":"2023-11-26T07:18:43.345233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:54:07.837496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.328521+0000","last_change":"2023-11-26T07:18:43.328521+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.328521+0000","last_undegraded":"2023-11-26T07:18:43.328521+0000","last_fullsized":"2023-11-26T07:18:43.328521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.330796+0000","last_change":"2023-11-26T07:18:43.326829+0000","last_active":"2023-11-26T07:18:43.330796+0000","last_peered":"2023-11-26T07:18:43.330796+0000","last_clean":"2023-11-26T07:18:43.330796+0000","last_became_active":"2023-11-26T07:18:43.326359+0000","last_became_peered":"2023-11-26T07:18:43.326359+0000","last_unstale":"2023-11-26T07:18:43.330796+0000","last_undegraded":"2023-11-26T07:18:43.330796+0000","last_fullsized":"2023-11-26T07:18:43.330796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:02:56.133442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.328096+0000","last_change":"2023-11-26T07:18:43.328096+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.328096+0000","last_undegraded":"2023-11-26T07:18:43.328096+0000","last_fullsized":"2023-11-26T07:18:43.328096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.349751+0000","last_change":"2023-11-26T07:18:43.346277+0000","last_active":"2023-11-26T07:18:43.349751+0000","last_peered":"2023-11-26T07:18:43.349751+0000","last_clean":"2023-11-26T07:18:43.349751+0000","last_became_active":"2023-11-26T07:18:43.345926+0000","last_became_peered":"2023-11-26T07:18:43.345926+0000","last_unstale":"2023-11-26T07:18:43.349751+0000","last_undegraded":"2023-11-26T07:18:43.349751+0000","last_fullsized":"2023-11-26T07:18:43.349751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:38:38.424482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.322470+0000","last_change":"2023-11-26T07:18:43.322470+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.322470+0000","last_undegraded":"2023-11-26T07:18:43.322470+0000","last_fullsized":"2023-11-26T07:18:43.322470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.346480+0000","last_change":"2023-11-26T07:18:43.343579+0000","last_active":"2023-11-26T07:18:43.346480+0000","last_peered":"2023-11-26T07:18:43.346480+0000","last_clean":"2023-11-26T07:18:43.346480+0000","last_became_active":"2023-11-26T07:18:43.342690+0000","last_became_peered":"2023-11-26T07:18:43.342690+0000","last_unstale":"2023-11-26T07:18:43.346480+0000","last_undegraded":"2023-11-26T07:18:43.346480+0000","last_fullsized":"2023-11-26T07:18:43.346480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:08:55.413769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.316446+0000","last_change":"2023-11-26T07:18:43.316446+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.316446+0000","last_undegraded":"2023-11-26T07:18:43.316446+0000","last_fullsized":"2023-11-26T07:18:43.316446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.336790+0000","last_change":"2023-11-26T07:18:43.335203+0000","last_active":"2023-11-26T07:18:43.336790+0000","last_peered":"2023-11-26T07:18:43.336790+0000","last_clean":"2023-11-26T07:18:43.336790+0000","last_became_active":"2023-11-26T07:18:43.334385+0000","last_became_peered":"2023-11-26T07:18:43.334385+0000","last_unstale":"2023-11-26T07:18:43.336790+0000","last_undegraded":"2023-11-26T07:18:43.336790+0000","last_fullsized":"2023-11-26T07:18:43.336790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:37.166777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.317505+0000","last_change":"2023-11-26T07:18:43.317505+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.317505+0000","last_undegraded":"2023-11-26T07:18:43.317505+0000","last_fullsized":"2023-11-26T07:18:43.317505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.349354+0000","last_change":"2023-11-26T07:18:43.345767+0000","last_active":"2023-11-26T07:18:43.349354+0000","last_peered":"2023-11-26T07:18:43.349354+0000","last_clean":"2023-11-26T07:18:43.349354+0000","last_became_active":"2023-11-26T07:18:43.343807+0000","last_became_peered":"2023-11-26T07:18:43.343807+0000","last_unstale":"2023-11-26T07:18:43.349354+0000","last_undegraded":"2023-11-26T07:18:43.349354+0000","last_fullsized":"2023-11-26T07:18:43.349354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.319635+0000","last_change":"2023-11-26T07:18:43.319635+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.319635+0000","last_undegraded":"2023-11-26T07:18:43.319635+0000","last_fullsized":"2023-11-26T07:18:43.319635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.347676+0000","last_change":"2023-11-26T07:18:43.343890+0000","last_active":"2023-11-26T07:18:43.347676+0000","last_peered":"2023-11-26T07:18:43.347676+0000","last_clean":"2023-11-26T07:18:43.347676+0000","last_became_active":"2023-11-26T07:18:43.342335+0000","last_became_peered":"2023-11-26T07:18:43.342335+0000","last_unstale":"2023-11-26T07:18:43.347676+0000","last_undegraded":"2023-11-26T07:18:43.347676+0000","last_fullsized":"2023-11-26T07:18:43.347676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:16.747715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.329278+0000","last_change":"2023-11-26T07:18:43.329278+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.329278+0000","last_undegraded":"2023-11-26T07:18:43.329278+0000","last_fullsized":"2023-11-26T07:18:43.329278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.354517+0000","last_change":"2023-11-26T07:18:43.347490+0000","last_active":"2023-11-26T07:18:43.354517+0000","last_peered":"2023-11-26T07:18:43.354517+0000","last_clean":"2023-11-26T07:18:43.354517+0000","last_became_active":"2023-11-26T07:18:43.346319+0000","last_became_peered":"2023-11-26T07:18:43.346319+0000","last_unstale":"2023-11-26T07:18:43.354517+0000","last_undegraded":"2023-11-26T07:18:43.354517+0000","last_fullsized":"2023-11-26T07:18:43.354517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:07.238526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.317713+0000","last_change":"2023-11-26T07:18:43.317713+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.317713+0000","last_undegraded":"2023-11-26T07:18:43.317713+0000","last_fullsized":"2023-11-26T07:18:43.317713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.353711+0000","last_change":"2023-11-26T07:18:43.348725+0000","last_active":"2023-11-26T07:18:43.353711+0000","last_peered":"2023-11-26T07:18:43.353711+0000","last_clean":"2023-11-26T07:18:43.353711+0000","last_became_active":"2023-11-26T07:18:43.348499+0000","last_became_peered":"2023-11-26T07:18:43.348499+0000","last_unstale":"2023-11-26T07:18:43.353711+0000","last_undegraded":"2023-11-26T07:18:43.353711+0000","last_fullsized":"2023-11-26T07:18:43.353711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:37.166777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331150+0000","last_change":"2023-11-26T07:18:43.331150+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331150+0000","last_undegraded":"2023-11-26T07:18:43.331150+0000","last_fullsized":"2023-11-26T07:18:43.331150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.346468+0000","last_change":"2023-11-26T07:18:43.339904+0000","last_active":"2023-11-26T07:18:43.346468+0000","last_peered":"2023-11-26T07:18:43.346468+0000","last_clean":"2023-11-26T07:18:43.346468+0000","last_became_active":"2023-11-26T07:18:43.339639+0000","last_became_peered":"2023-11-26T07:18:43.339639+0000","last_unstale":"2023-11-26T07:18:43.346468+0000","last_undegraded":"2023-11-26T07:18:43.346468+0000","last_fullsized":"2023-11-26T07:18:43.346468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.330761+0000","last_change":"2023-11-26T07:18:43.330761+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.330761+0000","last_undegraded":"2023-11-26T07:18:43.330761+0000","last_fullsized":"2023-11-26T07:18:43.330761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.342028+0000","last_change":"2023-11-26T07:18:43.338129+0000","last_active":"2023-11-26T07:18:43.342028+0000","last_peered":"2023-11-26T07:18:43.342028+0000","last_clean":"2023-11-26T07:18:43.342028+0000","last_became_active":"2023-11-26T07:18:43.337667+0000","last_became_peered":"2023-11-26T07:18:43.337667+0000","last_unstale":"2023-11-26T07:18:43.342028+0000","last_undegraded":"2023-11-26T07:18:43.342028+0000","last_fullsized":"2023-11-26T07:18:43.342028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.335616+0000","last_change":"2023-11-26T07:18:43.335616+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.335616+0000","last_undegraded":"2023-11-26T07:18:43.335616+0000","last_fullsized":"2023-11-26T07:18:43.335616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.346642+0000","last_change":"2023-11-26T07:18:43.339965+0000","last_active":"2023-11-26T07:18:43.346642+0000","last_peered":"2023-11-26T07:18:43.346642+0000","last_clean":"2023-11-26T07:18:43.346642+0000","last_became_active":"2023-11-26T07:18:43.339445+0000","last_became_peered":"2023-11-26T07:18:43.339445+0000","last_unstale":"2023-11-26T07:18:43.346642+0000","last_undegraded":"2023-11-26T07:18:43.346642+0000","last_fullsized":"2023-11-26T07:18:43.346642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:16.747715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.319839+0000","last_change":"2023-11-26T07:18:43.319839+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.319839+0000","last_undegraded":"2023-11-26T07:18:43.319839+0000","last_fullsized":"2023-11-26T07:18:43.319839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.354514+0000","last_change":"2023-11-26T07:18:43.348471+0000","last_active":"2023-11-26T07:18:43.354514+0000","last_peered":"2023-11-26T07:18:43.354514+0000","last_clean":"2023-11-26T07:18:43.354514+0000","last_became_active":"2023-11-26T07:18:43.348219+0000","last_became_peered":"2023-11-26T07:18:43.348219+0000","last_unstale":"2023-11-26T07:18:43.354514+0000","last_undegraded":"2023-11-26T07:18:43.354514+0000","last_fullsized":"2023-11-26T07:18:43.354514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:31:11.623899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.333394+0000","last_change":"2023-11-26T07:18:43.333394+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.333394+0000","last_undegraded":"2023-11-26T07:18:43.333394+0000","last_fullsized":"2023-11-26T07:18:43.333394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.345893+0000","last_change":"2023-11-26T07:18:43.342714+0000","last_active":"2023-11-26T07:18:43.345893+0000","last_peered":"2023-11-26T07:18:43.345893+0000","last_clean":"2023-11-26T07:18:43.345893+0000","last_became_active":"2023-11-26T07:18:43.342424+0000","last_became_peered":"2023-11-26T07:18:43.342424+0000","last_unstale":"2023-11-26T07:18:43.345893+0000","last_undegraded":"2023-11-26T07:18:43.345893+0000","last_fullsized":"2023-11-26T07:18:43.345893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:04.425599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.322101+0000","last_change":"2023-11-26T07:18:43.322101+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.322101+0000","last_undegraded":"2023-11-26T07:18:43.322101+0000","last_fullsized":"2023-11-26T07:18:43.322101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.343990+0000","last_change":"2023-11-26T07:18:43.339730+0000","last_active":"2023-11-26T07:18:43.343990+0000","last_peered":"2023-11-26T07:18:43.343990+0000","last_clean":"2023-11-26T07:18:43.343990+0000","last_became_active":"2023-11-26T07:18:43.339369+0000","last_became_peered":"2023-11-26T07:18:43.339369+0000","last_unstale":"2023-11-26T07:18:43.343990+0000","last_undegraded":"2023-11-26T07:18:43.343990+0000","last_fullsized":"2023-11-26T07:18:43.343990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:39:44.052772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318622+0000","last_change":"2023-11-26T07:18:43.318622+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318622+0000","last_undegraded":"2023-11-26T07:18:43.318622+0000","last_fullsized":"2023-11-26T07:18:43.318622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.348238+0000","last_change":"2023-11-26T07:18:43.342902+0000","last_active":"2023-11-26T07:18:43.348238+0000","last_peered":"2023-11-26T07:18:43.348238+0000","last_clean":"2023-11-26T07:18:43.348238+0000","last_became_active":"2023-11-26T07:18:43.342638+0000","last_became_peered":"2023-11-26T07:18:43.342638+0000","last_unstale":"2023-11-26T07:18:43.348238+0000","last_undegraded":"2023-11-26T07:18:43.348238+0000","last_fullsized":"2023-11-26T07:18:43.348238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:59.120873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318716+0000","last_change":"2023-11-26T07:18:43.318716+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318716+0000","last_undegraded":"2023-11-26T07:18:43.318716+0000","last_fullsized":"2023-11-26T07:18:43.318716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.355248+0000","last_change":"2023-11-26T07:18:43.354310+0000","last_active":"2023-11-26T07:18:43.355248+0000","last_peered":"2023-11-26T07:18:43.355248+0000","last_clean":"2023-11-26T07:18:43.355248+0000","last_became_active":"2023-11-26T07:18:43.354030+0000","last_became_peered":"2023-11-26T07:18:43.354030+0000","last_unstale":"2023-11-26T07:18:43.355248+0000","last_undegraded":"2023-11-26T07:18:43.355248+0000","last_fullsized":"2023-11-26T07:18:43.355248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:37.166777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.319571+0000","last_change":"2023-11-26T07:18:43.319571+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.319571+0000","last_undegraded":"2023-11-26T07:18:43.319571+0000","last_fullsized":"2023-11-26T07:18:43.319571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.354520+0000","last_change":"2023-11-26T07:18:43.347334+0000","last_active":"2023-11-26T07:18:43.354520+0000","last_peered":"2023-11-26T07:18:43.354520+0000","last_clean":"2023-11-26T07:18:43.354520+0000","last_became_active":"2023-11-26T07:18:43.346545+0000","last_became_peered":"2023-11-26T07:18:43.346545+0000","last_unstale":"2023-11-26T07:18:43.354520+0000","last_undegraded":"2023-11-26T07:18:43.354520+0000","last_fullsized":"2023-11-26T07:18:43.354520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:16:50.285570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.329319+0000","last_change":"2023-11-26T07:18:43.329319+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.329319+0000","last_undegraded":"2023-11-26T07:18:43.329319+0000","last_fullsized":"2023-11-26T07:18:43.329319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.347818+0000","last_change":"2023-11-26T07:18:43.343644+0000","last_active":"2023-11-26T07:18:43.347818+0000","last_peered":"2023-11-26T07:18:43.347818+0000","last_clean":"2023-11-26T07:18:43.347818+0000","last_became_active":"2023-11-26T07:18:43.343308+0000","last_became_peered":"2023-11-26T07:18:43.343308+0000","last_unstale":"2023-11-26T07:18:43.347818+0000","last_undegraded":"2023-11-26T07:18:43.347818+0000","last_fullsized":"2023-11-26T07:18:43.347818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318892+0000","last_change":"2023-11-26T07:18:43.318892+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318892+0000","last_undegraded":"2023-11-26T07:18:43.318892+0000","last_fullsized":"2023-11-26T07:18:43.318892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.353095+0000","last_change":"2023-11-26T07:18:43.346545+0000","last_active":"2023-11-26T07:18:43.353095+0000","last_peered":"2023-11-26T07:18:43.353095+0000","last_clean":"2023-11-26T07:18:43.353095+0000","last_became_active":"2023-11-26T07:18:43.345559+0000","last_became_peered":"2023-11-26T07:18:43.345559+0000","last_unstale":"2023-11-26T07:18:43.353095+0000","last_undegraded":"2023-11-26T07:18:43.353095+0000","last_fullsized":"2023-11-26T07:18:43.353095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:23.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318746+0000","last_change":"2023-11-26T07:18:43.318746+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318746+0000","last_undegraded":"2023-11-26T07:18:43.318746+0000","last_fullsized":"2023-11-26T07:18:43.318746+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.348259+0000","last_change":"2023-11-26T07:18:43.344454+0000","last_active":"2023-11-26T07:18:43.348259+0000","last_peered":"2023-11-26T07:18:43.348259+0000","last_clean":"2023-11-26T07:18:43.348259+0000","last_became_active":"2023-11-26T07:18:43.344110+0000","last_became_peered":"2023-11-26T07:18:43.344110+0000","last_unstale":"2023-11-26T07:18:43.348259+0000","last_undegraded":"2023-11-26T07:18:43.348259+0000","last_fullsized":"2023-11-26T07:18:43.348259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:15:36.304547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.328163+0000","last_change":"2023-11-26T07:18:43.328163+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.328163+0000","last_undegraded":"2023-11-26T07:18:43.328163+0000","last_fullsized":"2023-11-26T07:18:43.328163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.353067+0000","last_change":"2023-11-26T07:18:43.345987+0000","last_active":"2023-11-26T07:18:43.353067+0000","last_peered":"2023-11-26T07:18:43.353067+0000","last_clean":"2023-11-26T07:18:43.353067+0000","last_became_active":"2023-11-26T07:18:43.345128+0000","last_became_peered":"2023-11-26T07:18:43.345128+0000","last_unstale":"2023-11-26T07:18:43.353067+0000","last_undegraded":"2023-11-26T07:18:43.353067+0000","last_fullsized":"2023-11-26T07:18:43.353067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:15:36.304547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.337708+0000","last_change":"2023-11-26T07:18:43.337708+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.337708+0000","last_undegraded":"2023-11-26T07:18:43.337708+0000","last_fullsized":"2023-11-26T07:18:43.337708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.346444+0000","last_change":"2023-11-26T07:18:43.340479+0000","last_active":"2023-11-26T07:18:43.346444+0000","last_peered":"2023-11-26T07:18:43.346444+0000","last_clean":"2023-11-26T07:18:43.346444+0000","last_became_active":"2023-11-26T07:18:43.340189+0000","last_became_peered":"2023-11-26T07:18:43.340189+0000","last_unstale":"2023-11-26T07:18:43.346444+0000","last_undegraded":"2023-11-26T07:18:43.346444+0000","last_fullsized":"2023-11-26T07:18:43.346444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:51:55.849227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.326638+0000","last_change":"2023-11-26T07:18:43.326638+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.326638+0000","last_undegraded":"2023-11-26T07:18:43.326638+0000","last_fullsized":"2023-11-26T07:18:43.326638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.348659+0000","last_change":"2023-11-26T07:18:43.344767+0000","last_active":"2023-11-26T07:18:43.348659+0000","last_peered":"2023-11-26T07:18:43.348659+0000","last_clean":"2023-11-26T07:18:43.348659+0000","last_became_active":"2023-11-26T07:18:43.344485+0000","last_became_peered":"2023-11-26T07:18:43.344485+0000","last_unstale":"2023-11-26T07:18:43.348659+0000","last_undegraded":"2023-11-26T07:18:43.348659+0000","last_fullsized":"2023-11-26T07:18:43.348659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:59.120873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.321495+0000","last_change":"2023-11-26T07:18:43.321495+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.321495+0000","last_undegraded":"2023-11-26T07:18:43.321495+0000","last_fullsized":"2023-11-26T07:18:43.321495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.354500+0000","last_change":"2023-11-26T07:18:43.347277+0000","last_active":"2023-11-26T07:18:43.354500+0000","last_peered":"2023-11-26T07:18:43.354500+0000","last_clean":"2023-11-26T07:18:43.354500+0000","last_became_active":"2023-11-26T07:18:43.346602+0000","last_became_peered":"2023-11-26T07:18:43.346602+0000","last_unstale":"2023-11-26T07:18:43.354500+0000","last_undegraded":"2023-11-26T07:18:43.354500+0000","last_fullsized":"2023-11-26T07:18:43.354500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:56:09.238498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.329524+0000","last_change":"2023-11-26T07:18:43.329524+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.329524+0000","last_undegraded":"2023-11-26T07:18:43.329524+0000","last_fullsized":"2023-11-26T07:18:43.329524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.344173+0000","last_change":"2023-11-26T07:18:43.339946+0000","last_active":"2023-11-26T07:18:43.344173+0000","last_peered":"2023-11-26T07:18:43.344173+0000","last_clean":"2023-11-26T07:18:43.344173+0000","last_became_active":"2023-11-26T07:18:43.339654+0000","last_became_peered":"2023-11-26T07:18:43.339654+0000","last_unstale":"2023-11-26T07:18:43.344173+0000","last_undegraded":"2023-11-26T07:18:43.344173+0000","last_fullsized":"2023-11-26T07:18:43.344173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:23.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.333954+0000","last_change":"2023-11-26T07:18:43.333954+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.333954+0000","last_undegraded":"2023-11-26T07:18:43.333954+0000","last_fullsized":"2023-11-26T07:18:43.333954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.350073+0000","last_change":"2023-11-26T07:18:43.347243+0000","last_active":"2023-11-26T07:18:43.350073+0000","last_peered":"2023-11-26T07:18:43.350073+0000","last_clean":"2023-11-26T07:18:43.350073+0000","last_became_active":"2023-11-26T07:18:43.346909+0000","last_became_peered":"2023-11-26T07:18:43.346909+0000","last_unstale":"2023-11-26T07:18:43.350073+0000","last_undegraded":"2023-11-26T07:18:43.350073+0000","last_fullsized":"2023-11-26T07:18:43.350073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:51:55.849227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-26T07:18:42.311380+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:18:42.311380+0000","last_peered":"2023-11-26T07:18:42.311380+0000","last_clean":"2023-11-26T07:18:42.311380+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:18:42.311380+0000","last_undegraded":"2023-11-26T07:18:42.311380+0000","last_fullsized":"2023-11-26T07:18:42.311380+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":729192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.0589999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.272},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.204}]},{"osd":2,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.353},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.4039999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.454}]},{"osd":4,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.6339999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.829},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":1.873}]},{"osd":6,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":2.0619999999999998},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":2.1349999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":1.448},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.169,"5min":3.169,"15min":3.169},"last":0.71899999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.149},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.2609999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.415},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":3.1110000000000002,"5min":3.1110000000000002,"15min":3.1110000000000002},"last":1.0289999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.2150000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.3759999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.355},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.5109999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.4750000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.27},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0529999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.127},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.458}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.93200000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.339}]},{"osd":4,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.1559999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.103}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.1850000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.046}]},{"osd":1,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.091},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.3320000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.274},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.0009999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.387},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.179}]},{"osd":5,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":1.1240000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"min":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.484}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.726,"5min":1.726,"15min":1.726},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.6879999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.2809999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.165}]},{"osd":2,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.218},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.494}]},{"osd":4,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.399},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":1.468}]},{"osd":5,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.524}]},{"osd":6,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.415},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":3.226,"5min":3.226,"15min":3.226},"last":1.3779999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":1.339}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.77300000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.0740000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":1.121},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.2150000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.1899999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.329},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":1.1599999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.288},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.2430000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.391},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.379}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.054}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.879},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.97399999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.677},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.635}]},{"osd":4,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.73}]},{"osd":5,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.589},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.139}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.204},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.47}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.3500000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.518}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.94399999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.353},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.84099999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.876},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.2150000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.52}]},{"osd":5,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.5840000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.8799999999999999,"5min":2.8799999999999999,"15min":2.8799999999999999},"last":1.454},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.3129999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.2649999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:18:49.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:18:49.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.297+0000 7f4173fff640 1 Processor -- start 2023-11-26T07:18:49.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.298+0000 7f4173fff640 1 -- start start 2023-11-26T07:18:49.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.299+0000 7f4173fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4174161080 0x7f41740b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.299+0000 7f4173fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4174161510 con 0x7f4174143870 2023-11-26T07:18:49.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.300+0000 7f4173fff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41741617f0 con 0x7f41740b0fb0 2023-11-26T07:18:49.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.300+0000 7f4173fff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4174070460 con 0x7f4174161080 2023-11-26T07:18:49.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.300+0000 7f4172ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4174143870 0x7f4174146970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46350/0 (socket says 172.21.15.77:46350) 2023-11-26T07:18:49.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.300+0000 7f4172ffd640 1 -- 172.21.15.77:0/1457817517 learned_addr learned my addr 172.21.15.77:0/1457817517 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:49.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.300+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717839304 0 0) 0x7f4174161510 con 0x7f4174143870 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.300+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4160003520 con 0x7f4174143870 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.300+0000 7f416a7fc640 1 --2- 172.21.15.77:0/1457817517 >> v2:172.21.15.159:3300/0 conn(0x7f4174161080 0x7f41740b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254483304 0 0) 0x7f4160003520 con 0x7f4174143870 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 >> v2:172.21.15.159:3300/0 conn(0x7f4174161080 msgr2=0x7f41740b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 --2- 172.21.15.77:0/1457817517 >> v2:172.21.15.159:3300/0 conn(0x7f4174161080 0x7f41740b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 >> v1:172.21.15.159:6789/0 conn(0x7f41740b0fb0 legacy=0x7f41740cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174161ad0 con 0x7f4174143870 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f4164001670 con 0x7f4174143870 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 >> v1:172.21.15.77:6789/0 conn(0x7f4174143870 legacy=0x7f4174146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41600039c0 0x7f4160003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41600047c0 0x7f4160004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41600051d0 0x7f416000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4174070460 con 0x7f41600039c0 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416000c120 con 0x7f41600047c0 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416000c2e0 con 0x7f41600051d0 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f4172ffd640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41600039c0 0x7f4160003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.301+0000 7f416a7fc640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41600047c0 0x7f4160004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.302+0000 7f4172ffd640 1 -- 172.21.15.77:0/1457817517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41600051d0 msgr2=0x7f416000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.302+0000 7f41737fe640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41600051d0 0x7f416000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.302+0000 7f4172ffd640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41600051d0 0x7f416000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.302+0000 7f4172ffd640 1 -- 172.21.15.77:0/1457817517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41600047c0 msgr2=0x7f4160004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.302+0000 7f4172ffd640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41600047c0 0x7f4160004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.302+0000 7f4172ffd640 1 -- 172.21.15.77:0/1457817517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160003520 con 0x7f41600039c0 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.302+0000 7f41737fe640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41600051d0 0x7f416000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.302+0000 7f41737fe640 1 -- 172.21.15.77:0/1457817517 reap_dead start 2023-11-26T07:18:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.303+0000 7f4172ffd640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41600039c0 0x7f4160003de0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f416400c0e0 tx=0x7f41600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd34ea1805221e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.303+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164005ad0 con 0x7f41600039c0 2023-11-26T07:18:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.303+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4164005c30 con 0x7f41600039c0 2023-11-26T07:18:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.303+0000 7f41727fc640 1 -- 172.21.15.77:0/1457817517 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416402ca30 con 0x7f41600039c0 2023-11-26T07:18:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.303+0000 7f4173fff640 1 -- 172.21.15.77:0/1457817517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41600039c0 msgr2=0x7f4160003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.303+0000 7f4173fff640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41600039c0 0x7f4160003de0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f416400c0e0 tx=0x7f41600057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.304+0000 7f4173fff640 1 -- 172.21.15.77:0/1457817517 shutdown_connections 2023-11-26T07:18:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.304+0000 7f4173fff640 1 --2- 172.21.15.77:0/1457817517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41600039c0 0x7f4160003de0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.304+0000 7f4173fff640 1 -- 172.21.15.77:0/1457817517 >> 172.21.15.77:0/1457817517 conn(0x7f41740cb830 msgr2=0x7f41740cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:49.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.304+0000 7f4173fff640 1 -- 172.21.15.77:0/1457817517 shutdown_connections 2023-11-26T07:18:49.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.304+0000 7f4173fff640 1 -- 172.21.15.77:0/1457817517 wait complete. 2023-11-26T07:18:49.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.305+0000 7f4173fff640 1 Processor -- start 2023-11-26T07:18:49.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.306+0000 7f4173fff640 1 -- start start 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.306+0000 7f4173fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41600039c0 0x7f41741f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.306+0000 7f4173fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41741f2740 0x7f41741f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.306+0000 7f4173fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f417413f300 0x7f41741f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.306+0000 7f4173fff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41741f2bc0 con 0x7f417413f300 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.306+0000 7f4173fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41740b3570 con 0x7f41600039c0 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.306+0000 7f4173fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41740b3850 con 0x7f41741f2740 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f41737fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f417413f300 0x7f41741f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f41737fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f417413f300 0x7f41741f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56278/0 (socket says 172.21.15.77:56278) 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f41737fe640 1 -- 172.21.15.77:0/2840454694 learned_addr learned my addr 172.21.15.77:0/2840454694 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f416a7fc640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41741f2740 0x7f41741f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f4172ffd640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41600039c0 0x7f41741f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f41737fe640 1 -- 172.21.15.77:0/2840454694 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41741f2740 msgr2=0x7f41741f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f41737fe640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41741f2740 0x7f41741f37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f41737fe640 1 -- 172.21.15.77:0/2840454694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41600039c0 msgr2=0x7f41741f6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f41737fe640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41600039c0 0x7f41741f6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f41737fe640 1 -- 172.21.15.77:0/2840454694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41740b3b30 con 0x7f417413f300 2023-11-26T07:18:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f416a7fc640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41741f2740 0x7f41741f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.307+0000 7f41737fe640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f417413f300 0x7f41741f6300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f41740cec50 tx=0x7f416c00d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.308+0000 7f4170ff9640 1 -- 172.21.15.77:0/2840454694 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c003d80 con 0x7f417413f300 2023-11-26T07:18:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.308+0000 7f4170ff9640 1 -- 172.21.15.77:0/2840454694 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c005070 con 0x7f417413f300 2023-11-26T07:18:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.308+0000 7f4170ff9640 1 -- 172.21.15.77:0/2840454694 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c005420 con 0x7f417413f300 2023-11-26T07:18:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.308+0000 7f4173fff640 1 -- 172.21.15.77:0/2840454694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41740b3e10 con 0x7f417413f300 2023-11-26T07:18:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.308+0000 7f4173fff640 1 -- 172.21.15.77:0/2840454694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41740b3220 con 0x7f417413f300 2023-11-26T07:18:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.309+0000 7f4173fff640 1 -- 172.21.15.77:0/2840454694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41740b36b0 con 0x7f417413f300 2023-11-26T07:18:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.310+0000 7f4170ff9640 1 -- 172.21.15.77:0/2840454694 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f416c005580 con 0x7f417413f300 2023-11-26T07:18:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.311+0000 7f4170ff9640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415406ae40 0x7f415406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.311+0000 7f4170ff9640 1 -- 172.21.15.77:0/2840454694 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f416c0888a0 con 0x7f417413f300 2023-11-26T07:18:49.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.311+0000 7f4172ffd640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415406ae40 0x7f415406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.312+0000 7f4172ffd640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415406ae40 0x7f415406d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4164034000 tx=0x7f4164009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.315+0000 7f4170ff9640 1 -- 172.21.15.77:0/2840454694 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41740b36b0 con 0x7f417413f300 2023-11-26T07:18:49.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.499+0000 7f4173fff640 1 -- 172.21.15.77:0/2840454694 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41740b39c0 con 0x7f415406ae40 2023-11-26T07:18:49.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.520+0000 7f4170ff9640 1 -- 172.21.15.77:0/2840454694 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281193 (secure 0 0 0) 0x7f41740b39c0 con 0x7f415406ae40 2023-11-26T07:18:49.526 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:49.528 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:18:49.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 -- 172.21.15.77:0/2840454694 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415406ae40 msgr2=0x7f415406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415406ae40 0x7f415406d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4164034000 tx=0x7f4164009030 comp rx=0 tx=0).stop 2023-11-26T07:18:49.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 -- 172.21.15.77:0/2840454694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f417413f300 msgr2=0x7f41741f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f417413f300 0x7f41741f6300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f41740cec50 tx=0x7f416c00d9d0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 -- 172.21.15.77:0/2840454694 shutdown_connections 2023-11-26T07:18:49.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415406ae40 0x7f415406d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f417413f300 0x7f41741f6300 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41741f2740 0x7f41741f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 --2- 172.21.15.77:0/2840454694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41600039c0 0x7f41741f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 -- 172.21.15.77:0/2840454694 >> 172.21.15.77:0/2840454694 conn(0x7f41740cb830 msgr2=0x7f4174141750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:49.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 -- 172.21.15.77:0/2840454694 shutdown_connections 2023-11-26T07:18:49.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.527+0000 7f4173fff640 1 -- 172.21.15.77:0/2840454694 wait complete. 2023-11-26T07:18:49.549 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-11-26T07:18:47.625901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220100,"kb_used_data":3928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754620,"statfs":{"total":773094113280,"available":772868730880,"internally_reserved":0,"allocated":4022272,"data_stored":2266260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.329450"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332779+0000","last_change":"2023-11-26T07:18:43.332779+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332779+0000","last_undegraded":"2023-11-26T07:18:43.332779+0000","last_fullsized":"2023-11-26T07:18:43.332779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.323936+0000","last_change":"2023-11-26T07:18:43.323936+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.323936+0000","last_undegraded":"2023-11-26T07:18:43.323936+0000","last_fullsized":"2023-11-26T07:18:43.323936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318263+0000","last_change":"2023-11-26T07:18:43.318263+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318263+0000","last_undegraded":"2023-11-26T07:18:43.318263+0000","last_fullsized":"2023-11-26T07:18:43.318263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.333849+0000","last_change":"2023-11-26T07:18:43.333849+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.333849+0000","last_undegraded":"2023-11-26T07:18:43.333849+0000","last_fullsized":"2023-11-26T07:18:43.333849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.320534+0000","last_change":"2023-11-26T07:18:43.320534+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.320534+0000","last_undegraded":"2023-11-26T07:18:43.320534+0000","last_fullsized":"2023-11-26T07:18:43.320534+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.317226+0000","last_change":"2023-11-26T07:18:43.317226+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.317226+0000","last_undegraded":"2023-11-26T07:18:43.317226+0000","last_fullsized":"2023-11-26T07:18:43.317226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.328208+0000","last_change":"2023-11-26T07:18:43.328208+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.328208+0000","last_undegraded":"2023-11-26T07:18:43.328208+0000","last_fullsized":"2023-11-26T07:18:43.328208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332342+0000","last_change":"2023-11-26T07:18:43.332342+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332342+0000","last_undegraded":"2023-11-26T07:18:43.332342+0000","last_fullsized":"2023-11-26T07:18:43.332342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.327495+0000","last_change":"2023-11-26T07:18:43.327495+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.327495+0000","last_undegraded":"2023-11-26T07:18:43.327495+0000","last_fullsized":"2023-11-26T07:18:43.327495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331387+0000","last_change":"2023-11-26T07:18:43.331387+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331387+0000","last_undegraded":"2023-11-26T07:18:43.331387+0000","last_fullsized":"2023-11-26T07:18:43.331387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.328021+0000","last_change":"2023-11-26T07:18:43.328021+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.328021+0000","last_undegraded":"2023-11-26T07:18:43.328021+0000","last_fullsized":"2023-11-26T07:18:43.328021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.321932+0000","last_change":"2023-11-26T07:18:43.321932+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.321932+0000","last_undegraded":"2023-11-26T07:18:43.321932+0000","last_fullsized":"2023-11-26T07:18:43.321932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.320019+0000","last_change":"2023-11-26T07:18:43.320019+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.320019+0000","last_undegraded":"2023-11-26T07:18:43.320019+0000","last_fullsized":"2023-11-26T07:18:43.320019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.316741+0000","last_change":"2023-11-26T07:18:43.316741+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.316741+0000","last_undegraded":"2023-11-26T07:18:43.316741+0000","last_fullsized":"2023-11-26T07:18:43.316741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.322026+0000","last_change":"2023-11-26T07:18:43.322026+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.322026+0000","last_undegraded":"2023-11-26T07:18:43.322026+0000","last_fullsized":"2023-11-26T07:18:43.322026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.326620+0000","last_change":"2023-11-26T07:18:43.326620+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.326620+0000","last_undegraded":"2023-11-26T07:18:43.326620+0000","last_fullsized":"2023-11-26T07:18:43.326620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.338296+0000","last_change":"2023-11-26T07:18:43.338296+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.338296+0000","last_undegraded":"2023-11-26T07:18:43.338296+0000","last_fullsized":"2023-11-26T07:18:43.338296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.323473+0000","last_change":"2023-11-26T07:18:43.323473+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.323473+0000","last_undegraded":"2023-11-26T07:18:43.323473+0000","last_fullsized":"2023-11-26T07:18:43.323473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.317003+0000","last_change":"2023-11-26T07:18:43.317003+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.317003+0000","last_undegraded":"2023-11-26T07:18:43.317003+0000","last_fullsized":"2023-11-26T07:18:43.317003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.319546+0000","last_change":"2023-11-26T07:18:43.319546+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.319546+0000","last_undegraded":"2023-11-26T07:18:43.319546+0000","last_fullsized":"2023-11-26T07:18:43.319546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.333509+0000","last_change":"2023-11-26T07:18:43.333509+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.333509+0000","last_undegraded":"2023-11-26T07:18:43.333509+0000","last_fullsized":"2023-11-26T07:18:43.333509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331115+0000","last_change":"2023-11-26T07:18:43.331115+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331115+0000","last_undegraded":"2023-11-26T07:18:43.331115+0000","last_fullsized":"2023-11-26T07:18:43.331115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.325815+0000","last_change":"2023-11-26T07:18:43.325815+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.325815+0000","last_undegraded":"2023-11-26T07:18:43.325815+0000","last_fullsized":"2023-11-26T07:18:43.325815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318453+0000","last_change":"2023-11-26T07:18:43.318453+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318453+0000","last_undegraded":"2023-11-26T07:18:43.318453+0000","last_fullsized":"2023-11-26T07:18:43.318453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331370+0000","last_change":"2023-11-26T07:18:43.331370+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331370+0000","last_undegraded":"2023-11-26T07:18:43.331370+0000","last_fullsized":"2023-11-26T07:18:43.331370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.322638+0000","last_change":"2023-11-26T07:18:43.322638+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.322638+0000","last_undegraded":"2023-11-26T07:18:43.322638+0000","last_fullsized":"2023-11-26T07:18:43.322638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.333190+0000","last_change":"2023-11-26T07:18:43.333190+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.333190+0000","last_undegraded":"2023-11-26T07:18:43.333190+0000","last_fullsized":"2023-11-26T07:18:43.333190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.320768+0000","last_change":"2023-11-26T07:18:43.320768+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.320768+0000","last_undegraded":"2023-11-26T07:18:43.320768+0000","last_fullsized":"2023-11-26T07:18:43.320768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332425+0000","last_change":"2023-11-26T07:18:43.332425+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332425+0000","last_undegraded":"2023-11-26T07:18:43.332425+0000","last_fullsized":"2023-11-26T07:18:43.332425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.337416+0000","last_change":"2023-11-26T07:18:43.337416+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.337416+0000","last_undegraded":"2023-11-26T07:18:43.337416+0000","last_fullsized":"2023-11-26T07:18:43.337416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331463+0000","last_change":"2023-11-26T07:18:43.331463+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331463+0000","last_undegraded":"2023-11-26T07:18:43.331463+0000","last_fullsized":"2023-11-26T07:18:43.331463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331797+0000","last_change":"2023-11-26T07:18:43.331797+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331797+0000","last_undegraded":"2023-11-26T07:18:43.331797+0000","last_fullsized":"2023-11-26T07:18:43.331797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.327740+0000","last_change":"2023-11-26T07:18:43.327740+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.327740+0000","last_undegraded":"2023-11-26T07:18:43.327740+0000","last_fullsized":"2023-11-26T07:18:43.327740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.350873+0000","last_change":"2023-11-26T07:18:43.349331+0000","last_active":"2023-11-26T07:18:43.350873+0000","last_peered":"2023-11-26T07:18:43.350873+0000","last_clean":"2023-11-26T07:18:43.350873+0000","last_became_active":"2023-11-26T07:18:43.349011+0000","last_became_peered":"2023-11-26T07:18:43.349011+0000","last_unstale":"2023-11-26T07:18:43.350873+0000","last_undegraded":"2023-11-26T07:18:43.350873+0000","last_fullsized":"2023-11-26T07:18:43.350873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:59.120873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332226+0000","last_change":"2023-11-26T07:18:43.332226+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332226+0000","last_undegraded":"2023-11-26T07:18:43.332226+0000","last_fullsized":"2023-11-26T07:18:43.332226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.346409+0000","last_change":"2023-11-26T07:18:43.340731+0000","last_active":"2023-11-26T07:18:43.346409+0000","last_peered":"2023-11-26T07:18:43.346409+0000","last_clean":"2023-11-26T07:18:43.346409+0000","last_became_active":"2023-11-26T07:18:43.340447+0000","last_became_peered":"2023-11-26T07:18:43.340447+0000","last_unstale":"2023-11-26T07:18:43.346409+0000","last_undegraded":"2023-11-26T07:18:43.346409+0000","last_fullsized":"2023-11-26T07:18:43.346409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:16.747715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332604+0000","last_change":"2023-11-26T07:18:43.332604+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332604+0000","last_undegraded":"2023-11-26T07:18:43.332604+0000","last_fullsized":"2023-11-26T07:18:43.332604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.343850+0000","last_change":"2023-11-26T07:18:43.341518+0000","last_active":"2023-11-26T07:18:43.343850+0000","last_peered":"2023-11-26T07:18:43.343850+0000","last_clean":"2023-11-26T07:18:43.343850+0000","last_became_active":"2023-11-26T07:18:43.341219+0000","last_became_peered":"2023-11-26T07:18:43.341219+0000","last_unstale":"2023-11-26T07:18:43.343850+0000","last_undegraded":"2023-11-26T07:18:43.343850+0000","last_fullsized":"2023-11-26T07:18:43.343850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:51.107572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.332763+0000","last_change":"2023-11-26T07:18:43.332763+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.332763+0000","last_undegraded":"2023-11-26T07:18:43.332763+0000","last_fullsized":"2023-11-26T07:18:43.332763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.348421+0000","last_change":"2023-11-26T07:18:43.343141+0000","last_active":"2023-11-26T07:18:43.348421+0000","last_peered":"2023-11-26T07:18:43.348421+0000","last_clean":"2023-11-26T07:18:43.348421+0000","last_became_active":"2023-11-26T07:18:43.342643+0000","last_became_peered":"2023-11-26T07:18:43.342643+0000","last_unstale":"2023-11-26T07:18:43.348421+0000","last_undegraded":"2023-11-26T07:18:43.348421+0000","last_fullsized":"2023-11-26T07:18:43.348421+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:07.238526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.334971+0000","last_change":"2023-11-26T07:18:43.334971+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.334971+0000","last_undegraded":"2023-11-26T07:18:43.334971+0000","last_fullsized":"2023-11-26T07:18:43.334971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.345857+0000","last_change":"2023-11-26T07:18:43.340696+0000","last_active":"2023-11-26T07:18:43.345857+0000","last_peered":"2023-11-26T07:18:43.345857+0000","last_clean":"2023-11-26T07:18:43.345857+0000","last_became_active":"2023-11-26T07:18:43.340412+0000","last_became_peered":"2023-11-26T07:18:43.340412+0000","last_unstale":"2023-11-26T07:18:43.345857+0000","last_undegraded":"2023-11-26T07:18:43.345857+0000","last_fullsized":"2023-11-26T07:18:43.345857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:48:42.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.320991+0000","last_change":"2023-11-26T07:18:43.320991+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.320991+0000","last_undegraded":"2023-11-26T07:18:43.320991+0000","last_fullsized":"2023-11-26T07:18:43.320991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.345233+0000","last_change":"2023-11-26T07:18:43.340168+0000","last_active":"2023-11-26T07:18:43.345233+0000","last_peered":"2023-11-26T07:18:43.345233+0000","last_clean":"2023-11-26T07:18:43.345233+0000","last_became_active":"2023-11-26T07:18:43.339836+0000","last_became_peered":"2023-11-26T07:18:43.339836+0000","last_unstale":"2023-11-26T07:18:43.345233+0000","last_undegraded":"2023-11-26T07:18:43.345233+0000","last_fullsized":"2023-11-26T07:18:43.345233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:54:07.837496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.328521+0000","last_change":"2023-11-26T07:18:43.328521+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.328521+0000","last_undegraded":"2023-11-26T07:18:43.328521+0000","last_fullsized":"2023-11-26T07:18:43.328521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.330796+0000","last_change":"2023-11-26T07:18:43.326829+0000","last_active":"2023-11-26T07:18:43.330796+0000","last_peered":"2023-11-26T07:18:43.330796+0000","last_clean":"2023-11-26T07:18:43.330796+0000","last_became_active":"2023-11-26T07:18:43.326359+0000","last_became_peered":"2023-11-26T07:18:43.326359+0000","last_unstale":"2023-11-26T07:18:43.330796+0000","last_undegraded":"2023-11-26T07:18:43.330796+0000","last_fullsized":"2023-11-26T07:18:43.330796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:02:56.133442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.328096+0000","last_change":"2023-11-26T07:18:43.328096+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.328096+0000","last_undegraded":"2023-11-26T07:18:43.328096+0000","last_fullsized":"2023-11-26T07:18:43.328096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.349751+0000","last_change":"2023-11-26T07:18:43.346277+0000","last_active":"2023-11-26T07:18:43.349751+0000","last_peered":"2023-11-26T07:18:43.349751+0000","last_clean":"2023-11-26T07:18:43.349751+0000","last_became_active":"2023-11-26T07:18:43.345926+0000","last_became_peered":"2023-11-26T07:18:43.345926+0000","last_unstale":"2023-11-26T07:18:43.349751+0000","last_undegraded":"2023-11-26T07:18:43.349751+0000","last_fullsized":"2023-11-26T07:18:43.349751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:38:38.424482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.322470+0000","last_change":"2023-11-26T07:18:43.322470+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.322470+0000","last_undegraded":"2023-11-26T07:18:43.322470+0000","last_fullsized":"2023-11-26T07:18:43.322470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.346480+0000","last_change":"2023-11-26T07:18:43.343579+0000","last_active":"2023-11-26T07:18:43.346480+0000","last_peered":"2023-11-26T07:18:43.346480+0000","last_clean":"2023-11-26T07:18:43.346480+0000","last_became_active":"2023-11-26T07:18:43.342690+0000","last_became_peered":"2023-11-26T07:18:43.342690+0000","last_unstale":"2023-11-26T07:18:43.346480+0000","last_undegraded":"2023-11-26T07:18:43.346480+0000","last_fullsized":"2023-11-26T07:18:43.346480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:08:55.413769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.316446+0000","last_change":"2023-11-26T07:18:43.316446+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.316446+0000","last_undegraded":"2023-11-26T07:18:43.316446+0000","last_fullsized":"2023-11-26T07:18:43.316446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.336790+0000","last_change":"2023-11-26T07:18:43.335203+0000","last_active":"2023-11-26T07:18:43.336790+0000","last_peered":"2023-11-26T07:18:43.336790+0000","last_clean":"2023-11-26T07:18:43.336790+0000","last_became_active":"2023-11-26T07:18:43.334385+0000","last_became_peered":"2023-11-26T07:18:43.334385+0000","last_unstale":"2023-11-26T07:18:43.336790+0000","last_undegraded":"2023-11-26T07:18:43.336790+0000","last_fullsized":"2023-11-26T07:18:43.336790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:37.166777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.317505+0000","last_change":"2023-11-26T07:18:43.317505+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.317505+0000","last_undegraded":"2023-11-26T07:18:43.317505+0000","last_fullsized":"2023-11-26T07:18:43.317505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.349354+0000","last_change":"2023-11-26T07:18:43.345767+0000","last_active":"2023-11-26T07:18:43.349354+0000","last_peered":"2023-11-26T07:18:43.349354+0000","last_clean":"2023-11-26T07:18:43.349354+0000","last_became_active":"2023-11-26T07:18:43.343807+0000","last_became_peered":"2023-11-26T07:18:43.343807+0000","last_unstale":"2023-11-26T07:18:43.349354+0000","last_undegraded":"2023-11-26T07:18:43.349354+0000","last_fullsized":"2023-11-26T07:18:43.349354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.319635+0000","last_change":"2023-11-26T07:18:43.319635+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.319635+0000","last_undegraded":"2023-11-26T07:18:43.319635+0000","last_fullsized":"2023-11-26T07:18:43.319635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.347676+0000","last_change":"2023-11-26T07:18:43.343890+0000","last_active":"2023-11-26T07:18:43.347676+0000","last_peered":"2023-11-26T07:18:43.347676+0000","last_clean":"2023-11-26T07:18:43.347676+0000","last_became_active":"2023-11-26T07:18:43.342335+0000","last_became_peered":"2023-11-26T07:18:43.342335+0000","last_unstale":"2023-11-26T07:18:43.347676+0000","last_undegraded":"2023-11-26T07:18:43.347676+0000","last_fullsized":"2023-11-26T07:18:43.347676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:16.747715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.329278+0000","last_change":"2023-11-26T07:18:43.329278+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.329278+0000","last_undegraded":"2023-11-26T07:18:43.329278+0000","last_fullsized":"2023-11-26T07:18:43.329278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.354517+0000","last_change":"2023-11-26T07:18:43.347490+0000","last_active":"2023-11-26T07:18:43.354517+0000","last_peered":"2023-11-26T07:18:43.354517+0000","last_clean":"2023-11-26T07:18:43.354517+0000","last_became_active":"2023-11-26T07:18:43.346319+0000","last_became_peered":"2023-11-26T07:18:43.346319+0000","last_unstale":"2023-11-26T07:18:43.354517+0000","last_undegraded":"2023-11-26T07:18:43.354517+0000","last_fullsized":"2023-11-26T07:18:43.354517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:07.238526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.317713+0000","last_change":"2023-11-26T07:18:43.317713+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.317713+0000","last_undegraded":"2023-11-26T07:18:43.317713+0000","last_fullsized":"2023-11-26T07:18:43.317713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.353711+0000","last_change":"2023-11-26T07:18:43.348725+0000","last_active":"2023-11-26T07:18:43.353711+0000","last_peered":"2023-11-26T07:18:43.353711+0000","last_clean":"2023-11-26T07:18:43.353711+0000","last_became_active":"2023-11-26T07:18:43.348499+0000","last_became_peered":"2023-11-26T07:18:43.348499+0000","last_unstale":"2023-11-26T07:18:43.353711+0000","last_undegraded":"2023-11-26T07:18:43.353711+0000","last_fullsized":"2023-11-26T07:18:43.353711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:37.166777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.331150+0000","last_change":"2023-11-26T07:18:43.331150+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.331150+0000","last_undegraded":"2023-11-26T07:18:43.331150+0000","last_fullsized":"2023-11-26T07:18:43.331150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.346468+0000","last_change":"2023-11-26T07:18:43.339904+0000","last_active":"2023-11-26T07:18:43.346468+0000","last_peered":"2023-11-26T07:18:43.346468+0000","last_clean":"2023-11-26T07:18:43.346468+0000","last_became_active":"2023-11-26T07:18:43.339639+0000","last_became_peered":"2023-11-26T07:18:43.339639+0000","last_unstale":"2023-11-26T07:18:43.346468+0000","last_undegraded":"2023-11-26T07:18:43.346468+0000","last_fullsized":"2023-11-26T07:18:43.346468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.330761+0000","last_change":"2023-11-26T07:18:43.330761+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.330761+0000","last_undegraded":"2023-11-26T07:18:43.330761+0000","last_fullsized":"2023-11-26T07:18:43.330761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.342028+0000","last_change":"2023-11-26T07:18:43.338129+0000","last_active":"2023-11-26T07:18:43.342028+0000","last_peered":"2023-11-26T07:18:43.342028+0000","last_clean":"2023-11-26T07:18:43.342028+0000","last_became_active":"2023-11-26T07:18:43.337667+0000","last_became_peered":"2023-11-26T07:18:43.337667+0000","last_unstale":"2023-11-26T07:18:43.342028+0000","last_undegraded":"2023-11-26T07:18:43.342028+0000","last_fullsized":"2023-11-26T07:18:43.342028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.335616+0000","last_change":"2023-11-26T07:18:43.335616+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.335616+0000","last_undegraded":"2023-11-26T07:18:43.335616+0000","last_fullsized":"2023-11-26T07:18:43.335616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.346642+0000","last_change":"2023-11-26T07:18:43.339965+0000","last_active":"2023-11-26T07:18:43.346642+0000","last_peered":"2023-11-26T07:18:43.346642+0000","last_clean":"2023-11-26T07:18:43.346642+0000","last_became_active":"2023-11-26T07:18:43.339445+0000","last_became_peered":"2023-11-26T07:18:43.339445+0000","last_unstale":"2023-11-26T07:18:43.346642+0000","last_undegraded":"2023-11-26T07:18:43.346642+0000","last_fullsized":"2023-11-26T07:18:43.346642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:16.747715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.319839+0000","last_change":"2023-11-26T07:18:43.319839+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.319839+0000","last_undegraded":"2023-11-26T07:18:43.319839+0000","last_fullsized":"2023-11-26T07:18:43.319839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.354514+0000","last_change":"2023-11-26T07:18:43.348471+0000","last_active":"2023-11-26T07:18:43.354514+0000","last_peered":"2023-11-26T07:18:43.354514+0000","last_clean":"2023-11-26T07:18:43.354514+0000","last_became_active":"2023-11-26T07:18:43.348219+0000","last_became_peered":"2023-11-26T07:18:43.348219+0000","last_unstale":"2023-11-26T07:18:43.354514+0000","last_undegraded":"2023-11-26T07:18:43.354514+0000","last_fullsized":"2023-11-26T07:18:43.354514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:31:11.623899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.333394+0000","last_change":"2023-11-26T07:18:43.333394+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.333394+0000","last_undegraded":"2023-11-26T07:18:43.333394+0000","last_fullsized":"2023-11-26T07:18:43.333394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.345893+0000","last_change":"2023-11-26T07:18:43.342714+0000","last_active":"2023-11-26T07:18:43.345893+0000","last_peered":"2023-11-26T07:18:43.345893+0000","last_clean":"2023-11-26T07:18:43.345893+0000","last_became_active":"2023-11-26T07:18:43.342424+0000","last_became_peered":"2023-11-26T07:18:43.342424+0000","last_unstale":"2023-11-26T07:18:43.345893+0000","last_undegraded":"2023-11-26T07:18:43.345893+0000","last_fullsized":"2023-11-26T07:18:43.345893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:04.425599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.322101+0000","last_change":"2023-11-26T07:18:43.322101+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.322101+0000","last_undegraded":"2023-11-26T07:18:43.322101+0000","last_fullsized":"2023-11-26T07:18:43.322101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.343990+0000","last_change":"2023-11-26T07:18:43.339730+0000","last_active":"2023-11-26T07:18:43.343990+0000","last_peered":"2023-11-26T07:18:43.343990+0000","last_clean":"2023-11-26T07:18:43.343990+0000","last_became_active":"2023-11-26T07:18:43.339369+0000","last_became_peered":"2023-11-26T07:18:43.339369+0000","last_unstale":"2023-11-26T07:18:43.343990+0000","last_undegraded":"2023-11-26T07:18:43.343990+0000","last_fullsized":"2023-11-26T07:18:43.343990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:39:44.052772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318622+0000","last_change":"2023-11-26T07:18:43.318622+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318622+0000","last_undegraded":"2023-11-26T07:18:43.318622+0000","last_fullsized":"2023-11-26T07:18:43.318622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.348238+0000","last_change":"2023-11-26T07:18:43.342902+0000","last_active":"2023-11-26T07:18:43.348238+0000","last_peered":"2023-11-26T07:18:43.348238+0000","last_clean":"2023-11-26T07:18:43.348238+0000","last_became_active":"2023-11-26T07:18:43.342638+0000","last_became_peered":"2023-11-26T07:18:43.342638+0000","last_unstale":"2023-11-26T07:18:43.348238+0000","last_undegraded":"2023-11-26T07:18:43.348238+0000","last_fullsized":"2023-11-26T07:18:43.348238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:59.120873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318716+0000","last_change":"2023-11-26T07:18:43.318716+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318716+0000","last_undegraded":"2023-11-26T07:18:43.318716+0000","last_fullsized":"2023-11-26T07:18:43.318716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.355248+0000","last_change":"2023-11-26T07:18:43.354310+0000","last_active":"2023-11-26T07:18:43.355248+0000","last_peered":"2023-11-26T07:18:43.355248+0000","last_clean":"2023-11-26T07:18:43.355248+0000","last_became_active":"2023-11-26T07:18:43.354030+0000","last_became_peered":"2023-11-26T07:18:43.354030+0000","last_unstale":"2023-11-26T07:18:43.355248+0000","last_undegraded":"2023-11-26T07:18:43.355248+0000","last_fullsized":"2023-11-26T07:18:43.355248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:37.166777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.319571+0000","last_change":"2023-11-26T07:18:43.319571+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.319571+0000","last_undegraded":"2023-11-26T07:18:43.319571+0000","last_fullsized":"2023-11-26T07:18:43.319571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.354520+0000","last_change":"2023-11-26T07:18:43.347334+0000","last_active":"2023-11-26T07:18:43.354520+0000","last_peered":"2023-11-26T07:18:43.354520+0000","last_clean":"2023-11-26T07:18:43.354520+0000","last_became_active":"2023-11-26T07:18:43.346545+0000","last_became_peered":"2023-11-26T07:18:43.346545+0000","last_unstale":"2023-11-26T07:18:43.354520+0000","last_undegraded":"2023-11-26T07:18:43.354520+0000","last_fullsized":"2023-11-26T07:18:43.354520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:16:50.285570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.329319+0000","last_change":"2023-11-26T07:18:43.329319+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.329319+0000","last_undegraded":"2023-11-26T07:18:43.329319+0000","last_fullsized":"2023-11-26T07:18:43.329319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.347818+0000","last_change":"2023-11-26T07:18:43.343644+0000","last_active":"2023-11-26T07:18:43.347818+0000","last_peered":"2023-11-26T07:18:43.347818+0000","last_clean":"2023-11-26T07:18:43.347818+0000","last_became_active":"2023-11-26T07:18:43.343308+0000","last_became_peered":"2023-11-26T07:18:43.343308+0000","last_unstale":"2023-11-26T07:18:43.347818+0000","last_undegraded":"2023-11-26T07:18:43.347818+0000","last_fullsized":"2023-11-26T07:18:43.347818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318892+0000","last_change":"2023-11-26T07:18:43.318892+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318892+0000","last_undegraded":"2023-11-26T07:18:43.318892+0000","last_fullsized":"2023-11-26T07:18:43.318892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.353095+0000","last_change":"2023-11-26T07:18:43.346545+0000","last_active":"2023-11-26T07:18:43.353095+0000","last_peered":"2023-11-26T07:18:43.353095+0000","last_clean":"2023-11-26T07:18:43.353095+0000","last_became_active":"2023-11-26T07:18:43.345559+0000","last_became_peered":"2023-11-26T07:18:43.345559+0000","last_unstale":"2023-11-26T07:18:43.353095+0000","last_undegraded":"2023-11-26T07:18:43.353095+0000","last_fullsized":"2023-11-26T07:18:43.353095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:23.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.318746+0000","last_change":"2023-11-26T07:18:43.318746+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.318746+0000","last_undegraded":"2023-11-26T07:18:43.318746+0000","last_fullsized":"2023-11-26T07:18:43.318746+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.348259+0000","last_change":"2023-11-26T07:18:43.344454+0000","last_active":"2023-11-26T07:18:43.348259+0000","last_peered":"2023-11-26T07:18:43.348259+0000","last_clean":"2023-11-26T07:18:43.348259+0000","last_became_active":"2023-11-26T07:18:43.344110+0000","last_became_peered":"2023-11-26T07:18:43.344110+0000","last_unstale":"2023-11-26T07:18:43.348259+0000","last_undegraded":"2023-11-26T07:18:43.348259+0000","last_fullsized":"2023-11-26T07:18:43.348259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:15:36.304547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.328163+0000","last_change":"2023-11-26T07:18:43.328163+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.328163+0000","last_undegraded":"2023-11-26T07:18:43.328163+0000","last_fullsized":"2023-11-26T07:18:43.328163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.353067+0000","last_change":"2023-11-26T07:18:43.345987+0000","last_active":"2023-11-26T07:18:43.353067+0000","last_peered":"2023-11-26T07:18:43.353067+0000","last_clean":"2023-11-26T07:18:43.353067+0000","last_became_active":"2023-11-26T07:18:43.345128+0000","last_became_peered":"2023-11-26T07:18:43.345128+0000","last_unstale":"2023-11-26T07:18:43.353067+0000","last_undegraded":"2023-11-26T07:18:43.353067+0000","last_fullsized":"2023-11-26T07:18:43.353067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:15:36.304547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.337708+0000","last_change":"2023-11-26T07:18:43.337708+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.337708+0000","last_undegraded":"2023-11-26T07:18:43.337708+0000","last_fullsized":"2023-11-26T07:18:43.337708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.346444+0000","last_change":"2023-11-26T07:18:43.340479+0000","last_active":"2023-11-26T07:18:43.346444+0000","last_peered":"2023-11-26T07:18:43.346444+0000","last_clean":"2023-11-26T07:18:43.346444+0000","last_became_active":"2023-11-26T07:18:43.340189+0000","last_became_peered":"2023-11-26T07:18:43.340189+0000","last_unstale":"2023-11-26T07:18:43.346444+0000","last_undegraded":"2023-11-26T07:18:43.346444+0000","last_fullsized":"2023-11-26T07:18:43.346444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:51:55.849227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.326638+0000","last_change":"2023-11-26T07:18:43.326638+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.326638+0000","last_undegraded":"2023-11-26T07:18:43.326638+0000","last_fullsized":"2023-11-26T07:18:43.326638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.348659+0000","last_change":"2023-11-26T07:18:43.344767+0000","last_active":"2023-11-26T07:18:43.348659+0000","last_peered":"2023-11-26T07:18:43.348659+0000","last_clean":"2023-11-26T07:18:43.348659+0000","last_became_active":"2023-11-26T07:18:43.344485+0000","last_became_peered":"2023-11-26T07:18:43.344485+0000","last_unstale":"2023-11-26T07:18:43.348659+0000","last_undegraded":"2023-11-26T07:18:43.348659+0000","last_fullsized":"2023-11-26T07:18:43.348659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:59.120873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.321495+0000","last_change":"2023-11-26T07:18:43.321495+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.321495+0000","last_undegraded":"2023-11-26T07:18:43.321495+0000","last_fullsized":"2023-11-26T07:18:43.321495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.354500+0000","last_change":"2023-11-26T07:18:43.347277+0000","last_active":"2023-11-26T07:18:43.354500+0000","last_peered":"2023-11-26T07:18:43.354500+0000","last_clean":"2023-11-26T07:18:43.354500+0000","last_became_active":"2023-11-26T07:18:43.346602+0000","last_became_peered":"2023-11-26T07:18:43.346602+0000","last_unstale":"2023-11-26T07:18:43.354500+0000","last_undegraded":"2023-11-26T07:18:43.354500+0000","last_fullsized":"2023-11-26T07:18:43.354500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:56:09.238498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.329524+0000","last_change":"2023-11-26T07:18:43.329524+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.329524+0000","last_undegraded":"2023-11-26T07:18:43.329524+0000","last_fullsized":"2023-11-26T07:18:43.329524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.344173+0000","last_change":"2023-11-26T07:18:43.339946+0000","last_active":"2023-11-26T07:18:43.344173+0000","last_peered":"2023-11-26T07:18:43.344173+0000","last_clean":"2023-11-26T07:18:43.344173+0000","last_became_active":"2023-11-26T07:18:43.339654+0000","last_became_peered":"2023-11-26T07:18:43.339654+0000","last_unstale":"2023-11-26T07:18:43.344173+0000","last_undegraded":"2023-11-26T07:18:43.344173+0000","last_fullsized":"2023-11-26T07:18:43.344173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:23.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-26T07:18:43.333954+0000","last_change":"2023-11-26T07:18:43.333954+0000","last_active":"2023-11-26T07:18:43.295089+0000","last_peered":"2023-11-26T07:18:43.295089+0000","last_clean":"2023-11-26T07:18:43.295089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:18:43.333954+0000","last_undegraded":"2023-11-26T07:18:43.333954+0000","last_fullsized":"2023-11-26T07:18:43.333954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:18:43.350073+0000","last_change":"2023-11-26T07:18:43.347243+0000","last_active":"2023-11-26T07:18:43.350073+0000","last_peered":"2023-11-26T07:18:43.350073+0000","last_clean":"2023-11-26T07:18:43.350073+0000","last_became_active":"2023-11-26T07:18:43.346909+0000","last_became_peered":"2023-11-26T07:18:43.346909+0000","last_unstale":"2023-11-26T07:18:43.350073+0000","last_undegraded":"2023-11-26T07:18:43.350073+0000","last_fullsized":"2023-11-26T07:18:43.350073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:51:55.849227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-26T07:18:42.311380+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:18:42.311380+0000","last_peered":"2023-11-26T07:18:42.311380+0000","last_clean":"2023-11-26T07:18:42.311380+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:18:42.311380+0000","last_undegraded":"2023-11-26T07:18:42.311380+0000","last_fullsized":"2023-11-26T07:18:42.311380+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":729192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.0589999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.272},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.204}]},{"osd":2,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.353},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.4039999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.454}]},{"osd":4,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.6339999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.829},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":1.873}]},{"osd":6,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":2.0619999999999998},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":2.1349999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":1.448},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.169,"5min":3.169,"15min":3.169},"last":0.71899999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.149},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.2609999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.415},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":3.1110000000000002,"5min":3.1110000000000002,"15min":3.1110000000000002},"last":1.0289999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.2150000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.3759999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.355},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.5109999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.4750000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.27},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0529999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.127},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.458}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.93200000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.339}]},{"osd":4,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.1559999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.103}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.1850000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.046}]},{"osd":1,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.091},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.3320000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.274},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.0009999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.387},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.179}]},{"osd":5,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":1.1240000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"min":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.484}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.726,"5min":1.726,"15min":1.726},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.6879999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.2809999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.165}]},{"osd":2,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.218},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.494}]},{"osd":4,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.399},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":1.468}]},{"osd":5,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.524}]},{"osd":6,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.415},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":3.226,"5min":3.226,"15min":3.226},"last":1.3779999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":1.339}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.77300000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.0740000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":1.121},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.2150000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.1899999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.329},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":1.1599999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.288},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.2430000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.391},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.379}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.054}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.879},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.97399999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.677},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.635}]},{"osd":4,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.73}]},{"osd":5,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.589},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.139}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.204},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.47}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.3500000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.518}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.94399999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.353},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.84099999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.876},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.2150000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.52}]},{"osd":5,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.5840000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.8799999999999999,"5min":2.8799999999999999,"15min":2.8799999999999999},"last":1.454},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.3129999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.2649999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:18:49.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:18:49.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.791+0000 7fcaa5767640 1 Processor -- start 2023-11-26T07:18:49.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.791+0000 7fcaa5767640 1 -- start start 2023-11-26T07:18:49.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.792+0000 7fcaa5767640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaa006d6c0 0x7fcaa006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.792+0000 7fcaa5767640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcaa00cdbf0 0x7fcaa00ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.792+0000 7fcaa5767640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa006e060 con 0x7fcaa013d120 2023-11-26T07:18:49.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.792+0000 7fcaa5767640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa013f9e0 con 0x7fcaa00cdbf0 2023-11-26T07:18:49.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.792+0000 7fcaa5767640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa013fcc0 con 0x7fcaa006d6c0 2023-11-26T07:18:49.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.793+0000 7fca9ffff640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fcaa013d120 0x7fcaa015af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:38526/0 (socket says 172.21.15.77:38526) 2023-11-26T07:18:49.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.793+0000 7fca97fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaa006d6c0 0x7fcaa006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.793+0000 7fca9ffff640 1 -- 172.21.15.77:0/3689976523 learned_addr learned my addr 172.21.15.77:0/3689976523 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:49.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.793+0000 7fcaa4f66640 1 --2- 172.21.15.77:0/3689976523 >> v2:172.21.15.159:3300/0 conn(0x7fcaa00cdbf0 0x7fcaa00ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.794+0000 7fca97fff640 1 -- 172.21.15.77:0/3689976523 >> v2:172.21.15.159:3300/0 conn(0x7fcaa00cdbf0 msgr2=0x7fcaa00ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:49.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.794+0000 7fca97fff640 1 --2- 172.21.15.77:0/3689976523 >> v2:172.21.15.159:3300/0 conn(0x7fcaa00cdbf0 0x7fcaa00ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.794+0000 7fca97fff640 1 -- 172.21.15.77:0/3689976523 >> v1:172.21.15.159:6789/0 conn(0x7fcaa013d120 legacy=0x7fcaa015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.794+0000 7fca97fff640 1 -- 172.21.15.77:0/3689976523 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa013ffa0 con 0x7fcaa006d6c0 2023-11-26T07:18:49.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.795+0000 7fca97fff640 1 --2- 172.21.15.77:0/3689976523 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaa006d6c0 0x7fcaa006db20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca880097a0 tx=0x7fca8802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c1d64050aafd3b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.796+0000 7fca9f7fe640 1 -- 172.21.15.77:0/3689976523 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88031780 con 0x7fcaa006d6c0 2023-11-26T07:18:49.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.796+0000 7fca9f7fe640 1 -- 172.21.15.77:0/3689976523 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca880318e0 con 0x7fcaa006d6c0 2023-11-26T07:18:49.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.796+0000 7fca9f7fe640 1 -- 172.21.15.77:0/3689976523 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88031c70 con 0x7fcaa006d6c0 2023-11-26T07:18:49.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.796+0000 7fcaa5767640 1 -- 172.21.15.77:0/3689976523 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaa006d6c0 msgr2=0x7fcaa006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.796+0000 7fcaa5767640 1 --2- 172.21.15.77:0/3689976523 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaa006d6c0 0x7fcaa006db20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca880097a0 tx=0x7fca8802b820 comp rx=0 tx=0).stop 2023-11-26T07:18:49.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.796+0000 7fcaa5767640 1 -- 172.21.15.77:0/3689976523 shutdown_connections 2023-11-26T07:18:49.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.796+0000 7fcaa5767640 1 --2- 172.21.15.77:0/3689976523 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaa006d6c0 0x7fcaa006db20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.796+0000 7fcaa5767640 1 --2- 172.21.15.77:0/3689976523 >> v2:172.21.15.159:3300/0 conn(0x7fcaa00cdbf0 0x7fcaa00ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.796+0000 7fcaa5767640 1 -- 172.21.15.77:0/3689976523 >> 172.21.15.77:0/3689976523 conn(0x7fcaa00cb830 msgr2=0x7fcaa00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:49.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.796+0000 7fcaa5767640 1 -- 172.21.15.77:0/3689976523 shutdown_connections 2023-11-26T07:18:49.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.796+0000 7fcaa5767640 1 -- 172.21.15.77:0/3689976523 wait complete. 2023-11-26T07:18:49.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.798+0000 7fcaa5767640 1 Processor -- start 2023-11-26T07:18:49.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.798+0000 7fcaa5767640 1 -- start start 2023-11-26T07:18:49.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.799+0000 7fcaa5767640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaa006d6c0 0x7fcaa013c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.799+0000 7fcaa5767640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaa00cdbf0 0x7fcaa00b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.799+0000 7fcaa5767640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaa013d120 0x7fcaa0070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.799+0000 7fcaa5767640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00b40d0 con 0x7fcaa006d6c0 2023-11-26T07:18:49.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.799+0000 7fcaa5767640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00b34c0 con 0x7fcaa00cdbf0 2023-11-26T07:18:49.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.799+0000 7fcaa5767640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00b37a0 con 0x7fcaa013d120 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.799+0000 7fca9ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaa006d6c0 0x7fcaa013c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.799+0000 7fca9ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaa006d6c0 0x7fcaa013c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56282/0 (socket says 172.21.15.77:56282) 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.799+0000 7fca9ffff640 1 -- 172.21.15.77:0/2093901631 learned_addr learned my addr 172.21.15.77:0/2093901631 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.800+0000 7fcaa4f66640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaa013d120 0x7fcaa0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.800+0000 7fca97fff640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaa00cdbf0 0x7fcaa00b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.800+0000 7fca9ffff640 1 -- 172.21.15.77:0/2093901631 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaa013d120 msgr2=0x7fcaa0070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.800+0000 7fca9ffff640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaa013d120 0x7fcaa0070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.800+0000 7fca9ffff640 1 -- 172.21.15.77:0/2093901631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaa00cdbf0 msgr2=0x7fcaa00b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.800+0000 7fca9ffff640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaa00cdbf0 0x7fcaa00b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.800+0000 7fca9ffff640 1 -- 172.21.15.77:0/2093901631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88009400 con 0x7fcaa006d6c0 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.800+0000 7fca9ffff640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaa006d6c0 0x7fcaa013c890 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c480 tx=0x7fca9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.800+0000 7fca9d7fa640 1 -- 172.21.15.77:0/2093901631 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90005ce0 con 0x7fcaa006d6c0 2023-11-26T07:18:49.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.800+0000 7fca9d7fa640 1 -- 172.21.15.77:0/2093901631 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca90005e40 con 0x7fcaa006d6c0 2023-11-26T07:18:49.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.801+0000 7fcaa5767640 1 -- 172.21.15.77:0/2093901631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa015a9d0 con 0x7fcaa006d6c0 2023-11-26T07:18:49.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.801+0000 7fca9d7fa640 1 -- 172.21.15.77:0/2093901631 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca900072f0 con 0x7fcaa006d6c0 2023-11-26T07:18:49.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.801+0000 7fcaa5767640 1 -- 172.21.15.77:0/2093901631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa00b3d60 con 0x7fcaa006d6c0 2023-11-26T07:18:49.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.802+0000 7fcaa5767640 1 -- 172.21.15.77:0/2093901631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa004e840 con 0x7fcaa006d6c0 2023-11-26T07:18:49.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.803+0000 7fca9d7fa640 1 -- 172.21.15.77:0/2093901631 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca90007510 con 0x7fcaa006d6c0 2023-11-26T07:18:49.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.803+0000 7fca9d7fa640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fca8006ae40 0x7fca8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.803+0000 7fca9d7fa640 1 -- 172.21.15.77:0/2093901631 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca90088a40 con 0x7fcaa006d6c0 2023-11-26T07:18:49.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.804+0000 7fca97fff640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fca8006ae40 0x7fca8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.804+0000 7fca97fff640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fca8006ae40 0x7fca8006d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fca88036000 tx=0x7fca8803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.808+0000 7fca9d7fa640 1 -- 172.21.15.77:0/2093901631 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca9008ae60 con 0x7fcaa006d6c0 2023-11-26T07:18:49.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:49.994+0000 7fcaa5767640 1 -- 172.21.15.77:0/2093901631 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcaa015a850 con 0x7fca8006ae40 2023-11-26T07:18:50.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.017+0000 7fca9d7fa640 1 -- 172.21.15.77:0/2093901631 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286538 (secure 0 0 0) 0x7fca88031a50 con 0x7fca8006ae40 2023-11-26T07:18:50.022 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:50.025 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:18:50.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 -- 172.21.15.77:0/2093901631 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fca8006ae40 msgr2=0x7fca8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fca8006ae40 0x7fca8006d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fca88036000 tx=0x7fca8803d040 comp rx=0 tx=0).stop 2023-11-26T07:18:50.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 -- 172.21.15.77:0/2093901631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaa006d6c0 msgr2=0x7fcaa013c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaa006d6c0 0x7fcaa013c890 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c480 tx=0x7fca9000c940 comp rx=0 tx=0).stop 2023-11-26T07:18:50.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 -- 172.21.15.77:0/2093901631 shutdown_connections 2023-11-26T07:18:50.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fca8006ae40 0x7fca8006d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaa013d120 0x7fcaa0070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaa00cdbf0 0x7fcaa00b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 --2- 172.21.15.77:0/2093901631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaa006d6c0 0x7fcaa013c890 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 -- 172.21.15.77:0/2093901631 >> 172.21.15.77:0/2093901631 conn(0x7fcaa00cb830 msgr2=0x7fcaa00ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:50.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 -- 172.21.15.77:0/2093901631 shutdown_connections 2023-11-26T07:18:50.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.023+0000 7fcaa5767640 1 -- 172.21.15.77:0/2093901631 wait complete. 2023-11-26T07:18:50.044 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-11-26T07:18:49.626424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220400,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754320,"statfs":{"total":773094113280,"available":772868423680,"internally_reserved":0,"allocated":4333568,"data_stored":2400748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.314868"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348345+0000","last_change":"2023-11-26T07:18:44.347920+0000","last_active":"2023-11-26T07:18:45.348345+0000","last_peered":"2023-11-26T07:18:45.348345+0000","last_clean":"2023-11-26T07:18:45.348345+0000","last_became_active":"2023-11-26T07:18:44.347657+0000","last_became_peered":"2023-11-26T07:18:44.347657+0000","last_unstale":"2023-11-26T07:18:45.348345+0000","last_undegraded":"2023-11-26T07:18:45.348345+0000","last_fullsized":"2023-11-26T07:18:45.348345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:52:23.863830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373193+0000","last_change":"2023-11-26T07:18:44.345735+0000","last_active":"2023-11-26T07:18:46.373193+0000","last_peered":"2023-11-26T07:18:46.373193+0000","last_clean":"2023-11-26T07:18:46.373193+0000","last_became_active":"2023-11-26T07:18:44.345460+0000","last_became_peered":"2023-11-26T07:18:44.345460+0000","last_unstale":"2023-11-26T07:18:46.373193+0000","last_undegraded":"2023-11-26T07:18:46.373193+0000","last_fullsized":"2023-11-26T07:18:46.373193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:16:33.094928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901198+0000","last_change":"2023-11-26T07:18:44.346096+0000","last_active":"2023-11-26T07:18:45.901198+0000","last_peered":"2023-11-26T07:18:45.901198+0000","last_clean":"2023-11-26T07:18:45.901198+0000","last_became_active":"2023-11-26T07:18:44.345635+0000","last_became_peered":"2023-11-26T07:18:44.345635+0000","last_unstale":"2023-11-26T07:18:45.901198+0000","last_undegraded":"2023-11-26T07:18:45.901198+0000","last_fullsized":"2023-11-26T07:18:45.901198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:01.882223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786081+0000","last_change":"2023-11-26T07:18:44.351258+0000","last_active":"2023-11-26T07:18:45.786081+0000","last_peered":"2023-11-26T07:18:45.786081+0000","last_clean":"2023-11-26T07:18:45.786081+0000","last_became_active":"2023-11-26T07:18:44.350618+0000","last_became_peered":"2023-11-26T07:18:44.350618+0000","last_unstale":"2023-11-26T07:18:45.786081+0000","last_undegraded":"2023-11-26T07:18:45.786081+0000","last_fullsized":"2023-11-26T07:18:45.786081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:12.873661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371991+0000","last_change":"2023-11-26T07:18:44.347889+0000","last_active":"2023-11-26T07:18:46.371991+0000","last_peered":"2023-11-26T07:18:46.371991+0000","last_clean":"2023-11-26T07:18:46.371991+0000","last_became_active":"2023-11-26T07:18:44.347632+0000","last_became_peered":"2023-11-26T07:18:44.347632+0000","last_unstale":"2023-11-26T07:18:46.371991+0000","last_undegraded":"2023-11-26T07:18:46.371991+0000","last_fullsized":"2023-11-26T07:18:46.371991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:45:00.135951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372071+0000","last_change":"2023-11-26T07:18:44.332486+0000","last_active":"2023-11-26T07:18:46.372071+0000","last_peered":"2023-11-26T07:18:46.372071+0000","last_clean":"2023-11-26T07:18:46.372071+0000","last_became_active":"2023-11-26T07:18:44.332179+0000","last_became_peered":"2023-11-26T07:18:44.332179+0000","last_unstale":"2023-11-26T07:18:46.372071+0000","last_undegraded":"2023-11-26T07:18:46.372071+0000","last_fullsized":"2023-11-26T07:18:46.372071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:50:16.254065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351178+0000","last_change":"2023-11-26T07:18:44.352470+0000","last_active":"2023-11-26T07:18:45.351178+0000","last_peered":"2023-11-26T07:18:45.351178+0000","last_clean":"2023-11-26T07:18:45.351178+0000","last_became_active":"2023-11-26T07:18:44.352160+0000","last_became_peered":"2023-11-26T07:18:44.352160+0000","last_unstale":"2023-11-26T07:18:45.351178+0000","last_undegraded":"2023-11-26T07:18:45.351178+0000","last_fullsized":"2023-11-26T07:18:45.351178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:41.246469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350124+0000","last_change":"2023-11-26T07:18:44.351969+0000","last_active":"2023-11-26T07:18:45.350124+0000","last_peered":"2023-11-26T07:18:45.350124+0000","last_clean":"2023-11-26T07:18:45.350124+0000","last_became_active":"2023-11-26T07:18:44.351711+0000","last_became_peered":"2023-11-26T07:18:44.351711+0000","last_unstale":"2023-11-26T07:18:45.350124+0000","last_undegraded":"2023-11-26T07:18:45.350124+0000","last_fullsized":"2023-11-26T07:18:45.350124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:12.873661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372735+0000","last_change":"2023-11-26T07:18:44.345764+0000","last_active":"2023-11-26T07:18:46.372735+0000","last_peered":"2023-11-26T07:18:46.372735+0000","last_clean":"2023-11-26T07:18:46.372735+0000","last_became_active":"2023-11-26T07:18:44.345342+0000","last_became_peered":"2023-11-26T07:18:44.345342+0000","last_unstale":"2023-11-26T07:18:46.372735+0000","last_undegraded":"2023-11-26T07:18:46.372735+0000","last_fullsized":"2023-11-26T07:18:46.372735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:55.986599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786774+0000","last_change":"2023-11-26T07:18:44.356850+0000","last_active":"2023-11-26T07:18:45.786774+0000","last_peered":"2023-11-26T07:18:45.786774+0000","last_clean":"2023-11-26T07:18:45.786774+0000","last_became_active":"2023-11-26T07:18:44.356490+0000","last_became_peered":"2023-11-26T07:18:44.356490+0000","last_unstale":"2023-11-26T07:18:45.786774+0000","last_undegraded":"2023-11-26T07:18:45.786774+0000","last_fullsized":"2023-11-26T07:18:45.786774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:37.831580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351011+0000","last_change":"2023-11-26T07:18:44.350582+0000","last_active":"2023-11-26T07:18:45.351011+0000","last_peered":"2023-11-26T07:18:45.351011+0000","last_clean":"2023-11-26T07:18:45.351011+0000","last_became_active":"2023-11-26T07:18:44.350308+0000","last_became_peered":"2023-11-26T07:18:44.350308+0000","last_unstale":"2023-11-26T07:18:45.351011+0000","last_undegraded":"2023-11-26T07:18:45.351011+0000","last_fullsized":"2023-11-26T07:18:45.351011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:27.677252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900850+0000","last_change":"2023-11-26T07:18:44.349629+0000","last_active":"2023-11-26T07:18:45.900850+0000","last_peered":"2023-11-26T07:18:45.900850+0000","last_clean":"2023-11-26T07:18:45.900850+0000","last_became_active":"2023-11-26T07:18:44.349318+0000","last_became_peered":"2023-11-26T07:18:44.349318+0000","last_unstale":"2023-11-26T07:18:45.900850+0000","last_undegraded":"2023-11-26T07:18:45.900850+0000","last_fullsized":"2023-11-26T07:18:45.900850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:27.677252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372437+0000","last_change":"2023-11-26T07:18:44.342774+0000","last_active":"2023-11-26T07:18:46.372437+0000","last_peered":"2023-11-26T07:18:46.372437+0000","last_clean":"2023-11-26T07:18:46.372437+0000","last_became_active":"2023-11-26T07:18:44.342510+0000","last_became_peered":"2023-11-26T07:18:44.342510+0000","last_unstale":"2023-11-26T07:18:46.372437+0000","last_undegraded":"2023-11-26T07:18:46.372437+0000","last_fullsized":"2023-11-26T07:18:46.372437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:15:37.319625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372160+0000","last_change":"2023-11-26T07:18:44.334557+0000","last_active":"2023-11-26T07:18:46.372160+0000","last_peered":"2023-11-26T07:18:46.372160+0000","last_clean":"2023-11-26T07:18:46.372160+0000","last_became_active":"2023-11-26T07:18:44.333952+0000","last_became_peered":"2023-11-26T07:18:44.333952+0000","last_unstale":"2023-11-26T07:18:46.372160+0000","last_undegraded":"2023-11-26T07:18:46.372160+0000","last_fullsized":"2023-11-26T07:18:46.372160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:01.882223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900906+0000","last_change":"2023-11-26T07:18:44.348669+0000","last_active":"2023-11-26T07:18:45.900906+0000","last_peered":"2023-11-26T07:18:45.900906+0000","last_clean":"2023-11-26T07:18:45.900906+0000","last_became_active":"2023-11-26T07:18:44.347341+0000","last_became_peered":"2023-11-26T07:18:44.347341+0000","last_unstale":"2023-11-26T07:18:45.900906+0000","last_undegraded":"2023-11-26T07:18:45.900906+0000","last_fullsized":"2023-11-26T07:18:45.900906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:50:16.254065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350509+0000","last_change":"2023-11-26T07:18:44.361345+0000","last_active":"2023-11-26T07:18:45.350509+0000","last_peered":"2023-11-26T07:18:45.350509+0000","last_clean":"2023-11-26T07:18:45.350509+0000","last_became_active":"2023-11-26T07:18:44.361125+0000","last_became_peered":"2023-11-26T07:18:44.361125+0000","last_unstale":"2023-11-26T07:18:45.350509+0000","last_undegraded":"2023-11-26T07:18:45.350509+0000","last_fullsized":"2023-11-26T07:18:45.350509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:14.130743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351371+0000","last_change":"2023-11-26T07:18:44.353247+0000","last_active":"2023-11-26T07:18:45.351371+0000","last_peered":"2023-11-26T07:18:45.351371+0000","last_clean":"2023-11-26T07:18:45.351371+0000","last_became_active":"2023-11-26T07:18:44.350764+0000","last_became_peered":"2023-11-26T07:18:44.350764+0000","last_unstale":"2023-11-26T07:18:45.351371+0000","last_undegraded":"2023-11-26T07:18:45.351371+0000","last_fullsized":"2023-11-26T07:18:45.351371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:16:33.094928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373266+0000","last_change":"2023-11-26T07:18:44.344990+0000","last_active":"2023-11-26T07:18:46.373266+0000","last_peered":"2023-11-26T07:18:46.373266+0000","last_clean":"2023-11-26T07:18:46.373266+0000","last_became_active":"2023-11-26T07:18:44.343308+0000","last_became_peered":"2023-11-26T07:18:44.343308+0000","last_unstale":"2023-11-26T07:18:46.373266+0000","last_undegraded":"2023-11-26T07:18:46.373266+0000","last_fullsized":"2023-11-26T07:18:46.373266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:56:56.768970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373388+0000","last_change":"2023-11-26T07:18:44.343005+0000","last_active":"2023-11-26T07:18:46.373388+0000","last_peered":"2023-11-26T07:18:46.373388+0000","last_clean":"2023-11-26T07:18:46.373388+0000","last_became_active":"2023-11-26T07:18:44.342508+0000","last_became_peered":"2023-11-26T07:18:44.342508+0000","last_unstale":"2023-11-26T07:18:46.373388+0000","last_undegraded":"2023-11-26T07:18:46.373388+0000","last_fullsized":"2023-11-26T07:18:46.373388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:50:35.270986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371931+0000","last_change":"2023-11-26T07:18:44.332076+0000","last_active":"2023-11-26T07:18:46.371931+0000","last_peered":"2023-11-26T07:18:46.371931+0000","last_clean":"2023-11-26T07:18:46.371931+0000","last_became_active":"2023-11-26T07:18:44.331785+0000","last_became_peered":"2023-11-26T07:18:44.331785+0000","last_unstale":"2023-11-26T07:18:46.371931+0000","last_undegraded":"2023-11-26T07:18:46.371931+0000","last_fullsized":"2023-11-26T07:18:46.371931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:51:56.864305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371982+0000","last_change":"2023-11-26T07:18:44.345163+0000","last_active":"2023-11-26T07:18:46.371982+0000","last_peered":"2023-11-26T07:18:46.371982+0000","last_clean":"2023-11-26T07:18:46.371982+0000","last_became_active":"2023-11-26T07:18:44.343511+0000","last_became_peered":"2023-11-26T07:18:44.343511+0000","last_unstale":"2023-11-26T07:18:46.371982+0000","last_undegraded":"2023-11-26T07:18:46.371982+0000","last_fullsized":"2023-11-26T07:18:46.371982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:51.427055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372898+0000","last_change":"2023-11-26T07:18:44.356696+0000","last_active":"2023-11-26T07:18:46.372898+0000","last_peered":"2023-11-26T07:18:46.372898+0000","last_clean":"2023-11-26T07:18:46.372898+0000","last_became_active":"2023-11-26T07:18:44.355640+0000","last_became_peered":"2023-11-26T07:18:44.355640+0000","last_unstale":"2023-11-26T07:18:46.372898+0000","last_undegraded":"2023-11-26T07:18:46.372898+0000","last_fullsized":"2023-11-26T07:18:46.372898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:11.688889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.346987+0000","last_change":"2023-11-26T07:18:44.351026+0000","last_active":"2023-11-26T07:18:45.346987+0000","last_peered":"2023-11-26T07:18:45.346987+0000","last_clean":"2023-11-26T07:18:45.346987+0000","last_became_active":"2023-11-26T07:18:44.350754+0000","last_became_peered":"2023-11-26T07:18:44.350754+0000","last_unstale":"2023-11-26T07:18:45.346987+0000","last_undegraded":"2023-11-26T07:18:45.346987+0000","last_fullsized":"2023-11-26T07:18:45.346987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:29.028111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900492+0000","last_change":"2023-11-26T07:18:44.330185+0000","last_active":"2023-11-26T07:18:45.900492+0000","last_peered":"2023-11-26T07:18:45.900492+0000","last_clean":"2023-11-26T07:18:45.900492+0000","last_became_active":"2023-11-26T07:18:44.329868+0000","last_became_peered":"2023-11-26T07:18:44.329868+0000","last_unstale":"2023-11-26T07:18:45.900492+0000","last_undegraded":"2023-11-26T07:18:45.900492+0000","last_fullsized":"2023-11-26T07:18:45.900492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:37.831580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786816+0000","last_change":"2023-11-26T07:18:44.349792+0000","last_active":"2023-11-26T07:18:45.786816+0000","last_peered":"2023-11-26T07:18:45.786816+0000","last_clean":"2023-11-26T07:18:45.786816+0000","last_became_active":"2023-11-26T07:18:44.349517+0000","last_became_peered":"2023-11-26T07:18:44.349517+0000","last_unstale":"2023-11-26T07:18:45.786816+0000","last_undegraded":"2023-11-26T07:18:45.786816+0000","last_fullsized":"2023-11-26T07:18:45.786816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:14.130743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373549+0000","last_change":"2023-11-26T07:18:44.345147+0000","last_active":"2023-11-26T07:18:46.373549+0000","last_peered":"2023-11-26T07:18:46.373549+0000","last_clean":"2023-11-26T07:18:46.373549+0000","last_became_active":"2023-11-26T07:18:44.344700+0000","last_became_peered":"2023-11-26T07:18:44.344700+0000","last_unstale":"2023-11-26T07:18:46.373549+0000","last_undegraded":"2023-11-26T07:18:46.373549+0000","last_fullsized":"2023-11-26T07:18:46.373549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:53:07.562653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786696+0000","last_change":"2023-11-26T07:18:44.355462+0000","last_active":"2023-11-26T07:18:45.786696+0000","last_peered":"2023-11-26T07:18:45.786696+0000","last_clean":"2023-11-26T07:18:45.786696+0000","last_became_active":"2023-11-26T07:18:44.355184+0000","last_became_peered":"2023-11-26T07:18:44.355184+0000","last_unstale":"2023-11-26T07:18:45.786696+0000","last_undegraded":"2023-11-26T07:18:45.786696+0000","last_fullsized":"2023-11-26T07:18:45.786696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:42.805540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900890+0000","last_change":"2023-11-26T07:18:44.340207+0000","last_active":"2023-11-26T07:18:45.900890+0000","last_peered":"2023-11-26T07:18:45.900890+0000","last_clean":"2023-11-26T07:18:45.900890+0000","last_became_active":"2023-11-26T07:18:44.339921+0000","last_became_peered":"2023-11-26T07:18:44.339921+0000","last_unstale":"2023-11-26T07:18:45.900890+0000","last_undegraded":"2023-11-26T07:18:45.900890+0000","last_fullsized":"2023-11-26T07:18:45.900890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:14.130743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372032+0000","last_change":"2023-11-26T07:18:44.354377+0000","last_active":"2023-11-26T07:18:46.372032+0000","last_peered":"2023-11-26T07:18:46.372032+0000","last_clean":"2023-11-26T07:18:46.372032+0000","last_became_active":"2023-11-26T07:18:44.354120+0000","last_became_peered":"2023-11-26T07:18:44.354120+0000","last_unstale":"2023-11-26T07:18:46.372032+0000","last_undegraded":"2023-11-26T07:18:46.372032+0000","last_fullsized":"2023-11-26T07:18:46.372032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:29.028111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350936+0000","last_change":"2023-11-26T07:18:44.352615+0000","last_active":"2023-11-26T07:18:45.350936+0000","last_peered":"2023-11-26T07:18:45.350936+0000","last_clean":"2023-11-26T07:18:45.350936+0000","last_became_active":"2023-11-26T07:18:44.352294+0000","last_became_peered":"2023-11-26T07:18:44.352294+0000","last_unstale":"2023-11-26T07:18:45.350936+0000","last_undegraded":"2023-11-26T07:18:45.350936+0000","last_fullsized":"2023-11-26T07:18:45.350936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:13.735281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348709+0000","last_change":"2023-11-26T07:18:44.344168+0000","last_active":"2023-11-26T07:18:45.348709+0000","last_peered":"2023-11-26T07:18:45.348709+0000","last_clean":"2023-11-26T07:18:45.348709+0000","last_became_active":"2023-11-26T07:18:44.340360+0000","last_became_peered":"2023-11-26T07:18:44.340360+0000","last_unstale":"2023-11-26T07:18:45.348709+0000","last_undegraded":"2023-11-26T07:18:45.348709+0000","last_fullsized":"2023-11-26T07:18:45.348709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:51.427055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350272+0000","last_change":"2023-11-26T07:18:44.358261+0000","last_active":"2023-11-26T07:18:45.350272+0000","last_peered":"2023-11-26T07:18:45.350272+0000","last_clean":"2023-11-26T07:18:45.350272+0000","last_became_active":"2023-11-26T07:18:44.357918+0000","last_became_peered":"2023-11-26T07:18:44.357918+0000","last_unstale":"2023-11-26T07:18:45.350272+0000","last_undegraded":"2023-11-26T07:18:45.350272+0000","last_fullsized":"2023-11-26T07:18:45.350272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:42.805540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.347437+0000","last_change":"2023-11-26T07:18:44.350453+0000","last_active":"2023-11-26T07:18:45.347437+0000","last_peered":"2023-11-26T07:18:45.347437+0000","last_clean":"2023-11-26T07:18:45.347437+0000","last_became_active":"2023-11-26T07:18:44.350194+0000","last_became_peered":"2023-11-26T07:18:44.350194+0000","last_unstale":"2023-11-26T07:18:45.347437+0000","last_undegraded":"2023-11-26T07:18:45.347437+0000","last_fullsized":"2023-11-26T07:18:45.347437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.683350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.355706+0000","last_change":"2023-11-26T07:18:43.349331+0000","last_active":"2023-11-26T07:18:44.355706+0000","last_peered":"2023-11-26T07:18:44.355706+0000","last_clean":"2023-11-26T07:18:44.355706+0000","last_became_active":"2023-11-26T07:18:43.349011+0000","last_became_peered":"2023-11-26T07:18:43.349011+0000","last_unstale":"2023-11-26T07:18:44.355706+0000","last_undegraded":"2023-11-26T07:18:44.355706+0000","last_fullsized":"2023-11-26T07:18:44.355706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348743+0000","last_change":"2023-11-26T07:18:44.351596+0000","last_active":"2023-11-26T07:18:45.348743+0000","last_peered":"2023-11-26T07:18:45.348743+0000","last_clean":"2023-11-26T07:18:45.348743+0000","last_became_active":"2023-11-26T07:18:44.349802+0000","last_became_peered":"2023-11-26T07:18:44.349802+0000","last_unstale":"2023-11-26T07:18:45.348743+0000","last_undegraded":"2023-11-26T07:18:45.348743+0000","last_fullsized":"2023-11-26T07:18:45.348743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:29.028111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.350976+0000","last_change":"2023-11-26T07:18:43.340731+0000","last_active":"2023-11-26T07:18:44.350976+0000","last_peered":"2023-11-26T07:18:44.350976+0000","last_clean":"2023-11-26T07:18:44.350976+0000","last_became_active":"2023-11-26T07:18:43.340447+0000","last_became_peered":"2023-11-26T07:18:43.340447+0000","last_unstale":"2023-11-26T07:18:44.350976+0000","last_undegraded":"2023-11-26T07:18:44.350976+0000","last_fullsized":"2023-11-26T07:18:44.350976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372242+0000","last_change":"2023-11-26T07:18:44.365323+0000","last_active":"2023-11-26T07:18:46.372242+0000","last_peered":"2023-11-26T07:18:46.372242+0000","last_clean":"2023-11-26T07:18:46.372242+0000","last_became_active":"2023-11-26T07:18:44.365044+0000","last_became_peered":"2023-11-26T07:18:44.365044+0000","last_unstale":"2023-11-26T07:18:46.372242+0000","last_undegraded":"2023-11-26T07:18:46.372242+0000","last_fullsized":"2023-11-26T07:18:46.372242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:47.571506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.342889+0000","last_change":"2023-11-26T07:18:43.341518+0000","last_active":"2023-11-26T07:18:44.342889+0000","last_peered":"2023-11-26T07:18:44.342889+0000","last_clean":"2023-11-26T07:18:44.342889+0000","last_became_active":"2023-11-26T07:18:43.341219+0000","last_became_peered":"2023-11-26T07:18:43.341219+0000","last_unstale":"2023-11-26T07:18:44.342889+0000","last_undegraded":"2023-11-26T07:18:44.342889+0000","last_fullsized":"2023-11-26T07:18:44.342889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:11.858583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786915+0000","last_change":"2023-11-26T07:18:44.352705+0000","last_active":"2023-11-26T07:18:45.786915+0000","last_peered":"2023-11-26T07:18:45.786915+0000","last_clean":"2023-11-26T07:18:45.786915+0000","last_became_active":"2023-11-26T07:18:44.352394+0000","last_became_peered":"2023-11-26T07:18:44.352394+0000","last_unstale":"2023-11-26T07:18:45.786915+0000","last_undegraded":"2023-11-26T07:18:45.786915+0000","last_fullsized":"2023-11-26T07:18:45.786915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:13.735281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.360589+0000","last_change":"2023-11-26T07:18:43.343141+0000","last_active":"2023-11-26T07:18:44.360589+0000","last_peered":"2023-11-26T07:18:44.360589+0000","last_clean":"2023-11-26T07:18:44.360589+0000","last_became_active":"2023-11-26T07:18:43.342643+0000","last_became_peered":"2023-11-26T07:18:43.342643+0000","last_unstale":"2023-11-26T07:18:44.360589+0000","last_undegraded":"2023-11-26T07:18:44.360589+0000","last_fullsized":"2023-11-26T07:18:44.360589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:48:42.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351025+0000","last_change":"2023-11-26T07:18:44.355098+0000","last_active":"2023-11-26T07:18:45.351025+0000","last_peered":"2023-11-26T07:18:45.351025+0000","last_clean":"2023-11-26T07:18:45.351025+0000","last_became_active":"2023-11-26T07:18:44.354783+0000","last_became_peered":"2023-11-26T07:18:44.354783+0000","last_unstale":"2023-11-26T07:18:45.351025+0000","last_undegraded":"2023-11-26T07:18:45.351025+0000","last_fullsized":"2023-11-26T07:18:45.351025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:50:16.254065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.356431+0000","last_change":"2023-11-26T07:18:43.340696+0000","last_active":"2023-11-26T07:18:44.356431+0000","last_peered":"2023-11-26T07:18:44.356431+0000","last_clean":"2023-11-26T07:18:44.356431+0000","last_became_active":"2023-11-26T07:18:43.340412+0000","last_became_peered":"2023-11-26T07:18:43.340412+0000","last_unstale":"2023-11-26T07:18:44.356431+0000","last_undegraded":"2023-11-26T07:18:44.356431+0000","last_fullsized":"2023-11-26T07:18:44.356431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:15:36.304547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900779+0000","last_change":"2023-11-26T07:18:44.346028+0000","last_active":"2023-11-26T07:18:45.900779+0000","last_peered":"2023-11-26T07:18:45.900779+0000","last_clean":"2023-11-26T07:18:45.900779+0000","last_became_active":"2023-11-26T07:18:44.343992+0000","last_became_peered":"2023-11-26T07:18:44.343992+0000","last_unstale":"2023-11-26T07:18:45.900779+0000","last_undegraded":"2023-11-26T07:18:45.900779+0000","last_fullsized":"2023-11-26T07:18:45.900779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:42.805540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.356336+0000","last_change":"2023-11-26T07:18:43.340168+0000","last_active":"2023-11-26T07:18:44.356336+0000","last_peered":"2023-11-26T07:18:44.356336+0000","last_clean":"2023-11-26T07:18:44.356336+0000","last_became_active":"2023-11-26T07:18:43.339836+0000","last_became_peered":"2023-11-26T07:18:43.339836+0000","last_unstale":"2023-11-26T07:18:44.356336+0000","last_undegraded":"2023-11-26T07:18:44.356336+0000","last_fullsized":"2023-11-26T07:18:44.356336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:37.166777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371747+0000","last_change":"2023-11-26T07:18:44.342135+0000","last_active":"2023-11-26T07:18:46.371747+0000","last_peered":"2023-11-26T07:18:46.371747+0000","last_clean":"2023-11-26T07:18:46.371747+0000","last_became_active":"2023-11-26T07:18:44.341837+0000","last_became_peered":"2023-11-26T07:18:44.341837+0000","last_unstale":"2023-11-26T07:18:46.371747+0000","last_undegraded":"2023-11-26T07:18:46.371747+0000","last_fullsized":"2023-11-26T07:18:46.371747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:52:23.863830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322279+0000","last_change":"2023-11-26T07:18:43.326829+0000","last_active":"2023-11-26T07:18:44.322279+0000","last_peered":"2023-11-26T07:18:44.322279+0000","last_clean":"2023-11-26T07:18:44.322279+0000","last_became_active":"2023-11-26T07:18:43.326359+0000","last_became_peered":"2023-11-26T07:18:43.326359+0000","last_unstale":"2023-11-26T07:18:44.322279+0000","last_undegraded":"2023-11-26T07:18:44.322279+0000","last_fullsized":"2023-11-26T07:18:44.322279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:54.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.785832+0000","last_change":"2023-11-26T07:18:44.348723+0000","last_active":"2023-11-26T07:18:45.785832+0000","last_peered":"2023-11-26T07:18:45.785832+0000","last_clean":"2023-11-26T07:18:45.785832+0000","last_became_active":"2023-11-26T07:18:44.348439+0000","last_became_peered":"2023-11-26T07:18:44.348439+0000","last_unstale":"2023-11-26T07:18:45.785832+0000","last_undegraded":"2023-11-26T07:18:45.785832+0000","last_fullsized":"2023-11-26T07:18:45.785832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:05:20.945115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.329481+0000","last_change":"2023-11-26T07:18:43.346277+0000","last_active":"2023-11-26T07:18:44.329481+0000","last_peered":"2023-11-26T07:18:44.329481+0000","last_clean":"2023-11-26T07:18:44.329481+0000","last_became_active":"2023-11-26T07:18:43.345926+0000","last_became_peered":"2023-11-26T07:18:43.345926+0000","last_unstale":"2023-11-26T07:18:44.329481+0000","last_undegraded":"2023-11-26T07:18:44.329481+0000","last_fullsized":"2023-11-26T07:18:44.329481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:32.125703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901426+0000","last_change":"2023-11-26T07:18:44.350379+0000","last_active":"2023-11-26T07:18:45.901426+0000","last_peered":"2023-11-26T07:18:45.901426+0000","last_clean":"2023-11-26T07:18:45.901426+0000","last_became_active":"2023-11-26T07:18:44.349766+0000","last_became_peered":"2023-11-26T07:18:44.349766+0000","last_unstale":"2023-11-26T07:18:45.901426+0000","last_undegraded":"2023-11-26T07:18:45.901426+0000","last_fullsized":"2023-11-26T07:18:45.901426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:41.246469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.325568+0000","last_change":"2023-11-26T07:18:43.343579+0000","last_active":"2023-11-26T07:18:44.325568+0000","last_peered":"2023-11-26T07:18:44.325568+0000","last_clean":"2023-11-26T07:18:44.325568+0000","last_became_active":"2023-11-26T07:18:43.342690+0000","last_became_peered":"2023-11-26T07:18:43.342690+0000","last_unstale":"2023-11-26T07:18:44.325568+0000","last_undegraded":"2023-11-26T07:18:44.325568+0000","last_fullsized":"2023-11-26T07:18:44.325568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:36.816501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373538+0000","last_change":"2023-11-26T07:18:44.343618+0000","last_active":"2023-11-26T07:18:46.373538+0000","last_peered":"2023-11-26T07:18:46.373538+0000","last_clean":"2023-11-26T07:18:46.373538+0000","last_became_active":"2023-11-26T07:18:44.343349+0000","last_became_peered":"2023-11-26T07:18:44.343349+0000","last_unstale":"2023-11-26T07:18:46.373538+0000","last_undegraded":"2023-11-26T07:18:46.373538+0000","last_fullsized":"2023-11-26T07:18:46.373538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:59:38.105390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.332109+0000","last_change":"2023-11-26T07:18:43.335203+0000","last_active":"2023-11-26T07:18:44.332109+0000","last_peered":"2023-11-26T07:18:44.332109+0000","last_clean":"2023-11-26T07:18:44.332109+0000","last_became_active":"2023-11-26T07:18:43.334385+0000","last_became_peered":"2023-11-26T07:18:43.334385+0000","last_unstale":"2023-11-26T07:18:44.332109+0000","last_undegraded":"2023-11-26T07:18:44.332109+0000","last_fullsized":"2023-11-26T07:18:44.332109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:49:53.547830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373700+0000","last_change":"2023-11-26T07:18:44.360237+0000","last_active":"2023-11-26T07:18:46.373700+0000","last_peered":"2023-11-26T07:18:46.373700+0000","last_clean":"2023-11-26T07:18:46.373700+0000","last_became_active":"2023-11-26T07:18:44.358745+0000","last_became_peered":"2023-11-26T07:18:44.358745+0000","last_unstale":"2023-11-26T07:18:46.373700+0000","last_undegraded":"2023-11-26T07:18:46.373700+0000","last_fullsized":"2023-11-26T07:18:46.373700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:40:48.404744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.346992+0000","last_change":"2023-11-26T07:18:43.345767+0000","last_active":"2023-11-26T07:18:44.346992+0000","last_peered":"2023-11-26T07:18:44.346992+0000","last_clean":"2023-11-26T07:18:44.346992+0000","last_became_active":"2023-11-26T07:18:43.343807+0000","last_became_peered":"2023-11-26T07:18:43.343807+0000","last_unstale":"2023-11-26T07:18:44.346992+0000","last_undegraded":"2023-11-26T07:18:44.346992+0000","last_fullsized":"2023-11-26T07:18:44.346992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:11.858583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900856+0000","last_change":"2023-11-26T07:18:44.345921+0000","last_active":"2023-11-26T07:18:45.900856+0000","last_peered":"2023-11-26T07:18:45.900856+0000","last_clean":"2023-11-26T07:18:45.900856+0000","last_became_active":"2023-11-26T07:18:44.345290+0000","last_became_peered":"2023-11-26T07:18:44.345290+0000","last_unstale":"2023-11-26T07:18:45.900856+0000","last_undegraded":"2023-11-26T07:18:45.900856+0000","last_fullsized":"2023-11-26T07:18:45.900856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:13.735281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.366767+0000","last_change":"2023-11-26T07:18:43.343890+0000","last_active":"2023-11-26T07:18:44.366767+0000","last_peered":"2023-11-26T07:18:44.366767+0000","last_clean":"2023-11-26T07:18:44.366767+0000","last_became_active":"2023-11-26T07:18:43.342335+0000","last_became_peered":"2023-11-26T07:18:43.342335+0000","last_unstale":"2023-11-26T07:18:44.366767+0000","last_undegraded":"2023-11-26T07:18:44.366767+0000","last_fullsized":"2023-11-26T07:18:44.366767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:12.720202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.785865+0000","last_change":"2023-11-26T07:18:44.346638+0000","last_active":"2023-11-26T07:18:45.785865+0000","last_peered":"2023-11-26T07:18:45.785865+0000","last_clean":"2023-11-26T07:18:45.785865+0000","last_became_active":"2023-11-26T07:18:44.346363+0000","last_became_peered":"2023-11-26T07:18:44.346363+0000","last_unstale":"2023-11-26T07:18:45.785865+0000","last_undegraded":"2023-11-26T07:18:45.785865+0000","last_fullsized":"2023-11-26T07:18:45.785865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:08:13.461671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.349343+0000","last_change":"2023-11-26T07:18:43.347490+0000","last_active":"2023-11-26T07:18:44.349343+0000","last_peered":"2023-11-26T07:18:44.349343+0000","last_clean":"2023-11-26T07:18:44.349343+0000","last_became_active":"2023-11-26T07:18:43.346319+0000","last_became_peered":"2023-11-26T07:18:43.346319+0000","last_unstale":"2023-11-26T07:18:44.349343+0000","last_undegraded":"2023-11-26T07:18:44.349343+0000","last_fullsized":"2023-11-26T07:18:44.349343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:02:56.133442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373022+0000","last_change":"2023-11-26T07:18:44.344230+0000","last_active":"2023-11-26T07:18:46.373022+0000","last_peered":"2023-11-26T07:18:46.373022+0000","last_clean":"2023-11-26T07:18:46.373022+0000","last_became_active":"2023-11-26T07:18:44.343846+0000","last_became_peered":"2023-11-26T07:18:44.343846+0000","last_unstale":"2023-11-26T07:18:46.373022+0000","last_undegraded":"2023-11-26T07:18:46.373022+0000","last_fullsized":"2023-11-26T07:18:46.373022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:41.246469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.338705+0000","last_change":"2023-11-26T07:18:43.348725+0000","last_active":"2023-11-26T07:18:44.338705+0000","last_peered":"2023-11-26T07:18:44.338705+0000","last_clean":"2023-11-26T07:18:44.338705+0000","last_became_active":"2023-11-26T07:18:43.348499+0000","last_became_peered":"2023-11-26T07:18:43.348499+0000","last_unstale":"2023-11-26T07:18:44.338705+0000","last_undegraded":"2023-11-26T07:18:44.338705+0000","last_fullsized":"2023-11-26T07:18:44.338705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:28.013033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350256+0000","last_change":"2023-11-26T07:18:44.358762+0000","last_active":"2023-11-26T07:18:45.350256+0000","last_peered":"2023-11-26T07:18:45.350256+0000","last_clean":"2023-11-26T07:18:45.350256+0000","last_became_active":"2023-11-26T07:18:44.357924+0000","last_became_peered":"2023-11-26T07:18:44.357924+0000","last_unstale":"2023-11-26T07:18:45.350256+0000","last_undegraded":"2023-11-26T07:18:45.350256+0000","last_fullsized":"2023-11-26T07:18:45.350256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:19:43.090724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322116+0000","last_change":"2023-11-26T07:18:43.339904+0000","last_active":"2023-11-26T07:18:44.322116+0000","last_peered":"2023-11-26T07:18:44.322116+0000","last_clean":"2023-11-26T07:18:44.322116+0000","last_became_active":"2023-11-26T07:18:43.339639+0000","last_became_peered":"2023-11-26T07:18:43.339639+0000","last_unstale":"2023-11-26T07:18:44.322116+0000","last_undegraded":"2023-11-26T07:18:44.322116+0000","last_fullsized":"2023-11-26T07:18:44.322116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:02.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348817+0000","last_change":"2023-11-26T07:18:44.350412+0000","last_active":"2023-11-26T07:18:45.348817+0000","last_peered":"2023-11-26T07:18:45.348817+0000","last_clean":"2023-11-26T07:18:45.348817+0000","last_became_active":"2023-11-26T07:18:44.350130+0000","last_became_peered":"2023-11-26T07:18:44.350130+0000","last_unstale":"2023-11-26T07:18:45.348817+0000","last_undegraded":"2023-11-26T07:18:45.348817+0000","last_fullsized":"2023-11-26T07:18:45.348817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.683350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.364952+0000","last_change":"2023-11-26T07:18:43.338129+0000","last_active":"2023-11-26T07:18:44.364952+0000","last_peered":"2023-11-26T07:18:44.364952+0000","last_clean":"2023-11-26T07:18:44.364952+0000","last_became_active":"2023-11-26T07:18:43.337667+0000","last_became_peered":"2023-11-26T07:18:43.337667+0000","last_unstale":"2023-11-26T07:18:44.364952+0000","last_undegraded":"2023-11-26T07:18:44.364952+0000","last_fullsized":"2023-11-26T07:18:44.364952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:10.673811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372168+0000","last_change":"2023-11-26T07:18:44.346692+0000","last_active":"2023-11-26T07:18:46.372168+0000","last_peered":"2023-11-26T07:18:46.372168+0000","last_clean":"2023-11-26T07:18:46.372168+0000","last_became_active":"2023-11-26T07:18:44.346408+0000","last_became_peered":"2023-11-26T07:18:44.346408+0000","last_unstale":"2023-11-26T07:18:46.372168+0000","last_undegraded":"2023-11-26T07:18:46.372168+0000","last_fullsized":"2023-11-26T07:18:46.372168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.683350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.356679+0000","last_change":"2023-11-26T07:18:43.339965+0000","last_active":"2023-11-26T07:18:44.356679+0000","last_peered":"2023-11-26T07:18:44.356679+0000","last_clean":"2023-11-26T07:18:44.356679+0000","last_became_active":"2023-11-26T07:18:43.339445+0000","last_became_peered":"2023-11-26T07:18:43.339445+0000","last_unstale":"2023-11-26T07:18:44.356679+0000","last_undegraded":"2023-11-26T07:18:44.356679+0000","last_fullsized":"2023-11-26T07:18:44.356679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:54.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901790+0000","last_change":"2023-11-26T07:18:44.347941+0000","last_active":"2023-11-26T07:18:45.901790+0000","last_peered":"2023-11-26T07:18:45.901790+0000","last_clean":"2023-11-26T07:18:45.901790+0000","last_became_active":"2023-11-26T07:18:44.347693+0000","last_became_peered":"2023-11-26T07:18:44.347693+0000","last_unstale":"2023-11-26T07:18:45.901790+0000","last_undegraded":"2023-11-26T07:18:45.901790+0000","last_fullsized":"2023-11-26T07:18:45.901790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:56:56.768970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.348086+0000","last_change":"2023-11-26T07:18:43.348471+0000","last_active":"2023-11-26T07:18:44.348086+0000","last_peered":"2023-11-26T07:18:44.348086+0000","last_clean":"2023-11-26T07:18:44.348086+0000","last_became_active":"2023-11-26T07:18:43.348219+0000","last_became_peered":"2023-11-26T07:18:43.348219+0000","last_unstale":"2023-11-26T07:18:44.348086+0000","last_undegraded":"2023-11-26T07:18:44.348086+0000","last_fullsized":"2023-11-26T07:18:44.348086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:08:55.413769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786232+0000","last_change":"2023-11-26T07:18:44.351436+0000","last_active":"2023-11-26T07:18:45.786232+0000","last_peered":"2023-11-26T07:18:45.786232+0000","last_clean":"2023-11-26T07:18:45.786232+0000","last_became_active":"2023-11-26T07:18:44.351008+0000","last_became_peered":"2023-11-26T07:18:44.351008+0000","last_unstale":"2023-11-26T07:18:45.786232+0000","last_undegraded":"2023-11-26T07:18:45.786232+0000","last_fullsized":"2023-11-26T07:18:45.786232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:19:43.090724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.357547+0000","last_change":"2023-11-26T07:18:43.342714+0000","last_active":"2023-11-26T07:18:44.357547+0000","last_peered":"2023-11-26T07:18:44.357547+0000","last_clean":"2023-11-26T07:18:44.357547+0000","last_became_active":"2023-11-26T07:18:43.342424+0000","last_became_peered":"2023-11-26T07:18:43.342424+0000","last_unstale":"2023-11-26T07:18:44.357547+0000","last_undegraded":"2023-11-26T07:18:44.357547+0000","last_fullsized":"2023-11-26T07:18:44.357547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:23.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372404+0000","last_change":"2023-11-26T07:18:44.347815+0000","last_active":"2023-11-26T07:18:46.372404+0000","last_peered":"2023-11-26T07:18:46.372404+0000","last_clean":"2023-11-26T07:18:46.372404+0000","last_became_active":"2023-11-26T07:18:44.347475+0000","last_became_peered":"2023-11-26T07:18:44.347475+0000","last_unstale":"2023-11-26T07:18:46.372404+0000","last_undegraded":"2023-11-26T07:18:46.372404+0000","last_fullsized":"2023-11-26T07:18:46.372404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:38.181856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.331765+0000","last_change":"2023-11-26T07:18:43.339730+0000","last_active":"2023-11-26T07:18:44.331765+0000","last_peered":"2023-11-26T07:18:44.331765+0000","last_clean":"2023-11-26T07:18:44.331765+0000","last_became_active":"2023-11-26T07:18:43.339369+0000","last_became_peered":"2023-11-26T07:18:43.339369+0000","last_unstale":"2023-11-26T07:18:44.331765+0000","last_undegraded":"2023-11-26T07:18:44.331765+0000","last_fullsized":"2023-11-26T07:18:44.331765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372497+0000","last_change":"2023-11-26T07:18:44.346798+0000","last_active":"2023-11-26T07:18:46.372497+0000","last_peered":"2023-11-26T07:18:46.372497+0000","last_clean":"2023-11-26T07:18:46.372497+0000","last_became_active":"2023-11-26T07:18:44.345650+0000","last_became_peered":"2023-11-26T07:18:44.345650+0000","last_unstale":"2023-11-26T07:18:46.372497+0000","last_undegraded":"2023-11-26T07:18:46.372497+0000","last_fullsized":"2023-11-26T07:18:46.372497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:17.762793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.345661+0000","last_change":"2023-11-26T07:18:43.342902+0000","last_active":"2023-11-26T07:18:44.345661+0000","last_peered":"2023-11-26T07:18:44.345661+0000","last_clean":"2023-11-26T07:18:44.345661+0000","last_became_active":"2023-11-26T07:18:43.342638+0000","last_became_peered":"2023-11-26T07:18:43.342638+0000","last_unstale":"2023-11-26T07:18:44.345661+0000","last_undegraded":"2023-11-26T07:18:44.345661+0000","last_fullsized":"2023-11-26T07:18:44.345661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:52:22.848752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372767+0000","last_change":"2023-11-26T07:18:44.344439+0000","last_active":"2023-11-26T07:18:46.372767+0000","last_peered":"2023-11-26T07:18:46.372767+0000","last_clean":"2023-11-26T07:18:46.372767+0000","last_became_active":"2023-11-26T07:18:44.344185+0000","last_became_peered":"2023-11-26T07:18:44.344185+0000","last_unstale":"2023-11-26T07:18:46.372767+0000","last_undegraded":"2023-11-26T07:18:46.372767+0000","last_fullsized":"2023-11-26T07:18:46.372767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:24.631508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.339268+0000","last_change":"2023-11-26T07:18:43.354310+0000","last_active":"2023-11-26T07:18:44.339268+0000","last_peered":"2023-11-26T07:18:44.339268+0000","last_clean":"2023-11-26T07:18:44.339268+0000","last_became_active":"2023-11-26T07:18:43.354030+0000","last_became_peered":"2023-11-26T07:18:43.354030+0000","last_unstale":"2023-11-26T07:18:44.339268+0000","last_undegraded":"2023-11-26T07:18:44.339268+0000","last_fullsized":"2023-11-26T07:18:44.339268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:02:56.133442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371405+0000","last_change":"2023-11-26T07:18:44.337125+0000","last_active":"2023-11-26T07:18:46.371405+0000","last_peered":"2023-11-26T07:18:46.371405+0000","last_clean":"2023-11-26T07:18:46.371405+0000","last_became_active":"2023-11-26T07:18:44.334701+0000","last_became_peered":"2023-11-26T07:18:44.334701+0000","last_unstale":"2023-11-26T07:18:46.371405+0000","last_undegraded":"2023-11-26T07:18:46.371405+0000","last_fullsized":"2023-11-26T07:18:46.371405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:28:31.442031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.331311+0000","last_change":"2023-11-26T07:18:43.347334+0000","last_active":"2023-11-26T07:18:44.331311+0000","last_peered":"2023-11-26T07:18:44.331311+0000","last_clean":"2023-11-26T07:18:44.331311+0000","last_became_active":"2023-11-26T07:18:43.346545+0000","last_became_peered":"2023-11-26T07:18:43.346545+0000","last_unstale":"2023-11-26T07:18:44.331311+0000","last_undegraded":"2023-11-26T07:18:44.331311+0000","last_fullsized":"2023-11-26T07:18:44.331311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:51.107572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350467+0000","last_change":"2023-11-26T07:18:44.348109+0000","last_active":"2023-11-26T07:18:45.350467+0000","last_peered":"2023-11-26T07:18:45.350467+0000","last_clean":"2023-11-26T07:18:45.350467+0000","last_became_active":"2023-11-26T07:18:44.347857+0000","last_became_peered":"2023-11-26T07:18:44.347857+0000","last_unstale":"2023-11-26T07:18:45.350467+0000","last_undegraded":"2023-11-26T07:18:45.350467+0000","last_fullsized":"2023-11-26T07:18:45.350467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:37.831580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322823+0000","last_change":"2023-11-26T07:18:43.343644+0000","last_active":"2023-11-26T07:18:44.322823+0000","last_peered":"2023-11-26T07:18:44.322823+0000","last_clean":"2023-11-26T07:18:44.322823+0000","last_became_active":"2023-11-26T07:18:43.343308+0000","last_became_peered":"2023-11-26T07:18:43.343308+0000","last_unstale":"2023-11-26T07:18:44.322823+0000","last_undegraded":"2023-11-26T07:18:44.322823+0000","last_fullsized":"2023-11-26T07:18:44.322823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:02.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372823+0000","last_change":"2023-11-26T07:18:44.336075+0000","last_active":"2023-11-26T07:18:46.372823+0000","last_peered":"2023-11-26T07:18:46.372823+0000","last_clean":"2023-11-26T07:18:46.372823+0000","last_became_active":"2023-11-26T07:18:44.335793+0000","last_became_peered":"2023-11-26T07:18:44.335793+0000","last_unstale":"2023-11-26T07:18:46.372823+0000","last_undegraded":"2023-11-26T07:18:46.372823+0000","last_fullsized":"2023-11-26T07:18:46.372823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:08:56.428847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.360250+0000","last_change":"2023-11-26T07:18:43.346545+0000","last_active":"2023-11-26T07:18:44.360250+0000","last_peered":"2023-11-26T07:18:44.360250+0000","last_clean":"2023-11-26T07:18:44.360250+0000","last_became_active":"2023-11-26T07:18:43.345559+0000","last_became_peered":"2023-11-26T07:18:43.345559+0000","last_unstale":"2023-11-26T07:18:44.360250+0000","last_undegraded":"2023-11-26T07:18:44.360250+0000","last_fullsized":"2023-11-26T07:18:44.360250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:10.673811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901733+0000","last_change":"2023-11-26T07:18:44.348188+0000","last_active":"2023-11-26T07:18:45.901733+0000","last_peered":"2023-11-26T07:18:45.901733+0000","last_clean":"2023-11-26T07:18:45.901733+0000","last_became_active":"2023-11-26T07:18:44.345395+0000","last_became_peered":"2023-11-26T07:18:44.345395+0000","last_unstale":"2023-11-26T07:18:45.901733+0000","last_undegraded":"2023-11-26T07:18:45.901733+0000","last_fullsized":"2023-11-26T07:18:45.901733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:16:33.094928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.331983+0000","last_change":"2023-11-26T07:18:43.344454+0000","last_active":"2023-11-26T07:18:44.331983+0000","last_peered":"2023-11-26T07:18:44.331983+0000","last_clean":"2023-11-26T07:18:44.331983+0000","last_became_active":"2023-11-26T07:18:43.344110+0000","last_became_peered":"2023-11-26T07:18:43.344110+0000","last_unstale":"2023-11-26T07:18:44.331983+0000","last_undegraded":"2023-11-26T07:18:44.331983+0000","last_fullsized":"2023-11-26T07:18:44.331983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.347484+0000","last_change":"2023-11-26T07:18:44.346321+0000","last_active":"2023-11-26T07:18:45.347484+0000","last_peered":"2023-11-26T07:18:45.347484+0000","last_clean":"2023-11-26T07:18:45.347484+0000","last_became_active":"2023-11-26T07:18:44.342883+0000","last_became_peered":"2023-11-26T07:18:44.342883+0000","last_unstale":"2023-11-26T07:18:45.347484+0000","last_undegraded":"2023-11-26T07:18:45.347484+0000","last_fullsized":"2023-11-26T07:18:45.347484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:47.571506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.341116+0000","last_change":"2023-11-26T07:18:43.345987+0000","last_active":"2023-11-26T07:18:44.341116+0000","last_peered":"2023-11-26T07:18:44.341116+0000","last_clean":"2023-11-26T07:18:44.341116+0000","last_became_active":"2023-11-26T07:18:43.345128+0000","last_became_peered":"2023-11-26T07:18:43.345128+0000","last_unstale":"2023-11-26T07:18:44.341116+0000","last_undegraded":"2023-11-26T07:18:44.341116+0000","last_fullsized":"2023-11-26T07:18:44.341116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:46.556428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348045+0000","last_change":"2023-11-26T07:18:44.350191+0000","last_active":"2023-11-26T07:18:45.348045+0000","last_peered":"2023-11-26T07:18:45.348045+0000","last_clean":"2023-11-26T07:18:45.348045+0000","last_became_active":"2023-11-26T07:18:44.349827+0000","last_became_peered":"2023-11-26T07:18:44.349827+0000","last_unstale":"2023-11-26T07:18:45.348045+0000","last_undegraded":"2023-11-26T07:18:45.348045+0000","last_fullsized":"2023-11-26T07:18:45.348045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:49:54.562908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.332950+0000","last_change":"2023-11-26T07:18:43.340479+0000","last_active":"2023-11-26T07:18:44.332950+0000","last_peered":"2023-11-26T07:18:44.332950+0000","last_clean":"2023-11-26T07:18:44.332950+0000","last_became_active":"2023-11-26T07:18:43.340189+0000","last_became_peered":"2023-11-26T07:18:43.340189+0000","last_unstale":"2023-11-26T07:18:44.332950+0000","last_undegraded":"2023-11-26T07:18:44.332950+0000","last_fullsized":"2023-11-26T07:18:44.332950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:50.411976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.347657+0000","last_change":"2023-11-26T07:18:44.349820+0000","last_active":"2023-11-26T07:18:45.347657+0000","last_peered":"2023-11-26T07:18:45.347657+0000","last_clean":"2023-11-26T07:18:45.347657+0000","last_became_active":"2023-11-26T07:18:44.349137+0000","last_became_peered":"2023-11-26T07:18:44.349137+0000","last_unstale":"2023-11-26T07:18:45.347657+0000","last_undegraded":"2023-11-26T07:18:45.347657+0000","last_fullsized":"2023-11-26T07:18:45.347657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:55.986599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.338837+0000","last_change":"2023-11-26T07:18:43.344767+0000","last_active":"2023-11-26T07:18:44.338837+0000","last_peered":"2023-11-26T07:18:44.338837+0000","last_clean":"2023-11-26T07:18:44.338837+0000","last_became_active":"2023-11-26T07:18:43.344485+0000","last_became_peered":"2023-11-26T07:18:43.344485+0000","last_unstale":"2023-11-26T07:18:44.338837+0000","last_undegraded":"2023-11-26T07:18:44.338837+0000","last_fullsized":"2023-11-26T07:18:44.338837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:02.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371584+0000","last_change":"2023-11-26T07:18:44.356457+0000","last_active":"2023-11-26T07:18:46.371584+0000","last_peered":"2023-11-26T07:18:46.371584+0000","last_clean":"2023-11-26T07:18:46.371584+0000","last_became_active":"2023-11-26T07:18:44.356141+0000","last_became_peered":"2023-11-26T07:18:44.356141+0000","last_unstale":"2023-11-26T07:18:46.371584+0000","last_undegraded":"2023-11-26T07:18:46.371584+0000","last_fullsized":"2023-11-26T07:18:46.371584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:27.677252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.332080+0000","last_change":"2023-11-26T07:18:43.347277+0000","last_active":"2023-11-26T07:18:44.332080+0000","last_peered":"2023-11-26T07:18:44.332080+0000","last_clean":"2023-11-26T07:18:44.332080+0000","last_became_active":"2023-11-26T07:18:43.346602+0000","last_became_peered":"2023-11-26T07:18:43.346602+0000","last_unstale":"2023-11-26T07:18:44.332080+0000","last_undegraded":"2023-11-26T07:18:44.332080+0000","last_fullsized":"2023-11-26T07:18:44.332080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371470+0000","last_change":"2023-11-26T07:18:44.356806+0000","last_active":"2023-11-26T07:18:46.371470+0000","last_peered":"2023-11-26T07:18:46.371470+0000","last_clean":"2023-11-26T07:18:46.371470+0000","last_became_active":"2023-11-26T07:18:44.356526+0000","last_became_peered":"2023-11-26T07:18:44.356526+0000","last_unstale":"2023-11-26T07:18:46.371470+0000","last_undegraded":"2023-11-26T07:18:46.371470+0000","last_fullsized":"2023-11-26T07:18:46.371470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:49:54.562908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322127+0000","last_change":"2023-11-26T07:18:43.339946+0000","last_active":"2023-11-26T07:18:44.322127+0000","last_peered":"2023-11-26T07:18:44.322127+0000","last_clean":"2023-11-26T07:18:44.322127+0000","last_became_active":"2023-11-26T07:18:43.339654+0000","last_became_peered":"2023-11-26T07:18:43.339654+0000","last_unstale":"2023-11-26T07:18:44.322127+0000","last_undegraded":"2023-11-26T07:18:44.322127+0000","last_fullsized":"2023-11-26T07:18:44.322127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:46.556428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351069+0000","last_change":"2023-11-26T07:18:44.350819+0000","last_active":"2023-11-26T07:18:45.351069+0000","last_peered":"2023-11-26T07:18:45.351069+0000","last_clean":"2023-11-26T07:18:45.351069+0000","last_became_active":"2023-11-26T07:18:44.350524+0000","last_became_peered":"2023-11-26T07:18:44.350524+0000","last_unstale":"2023-11-26T07:18:45.351069+0000","last_undegraded":"2023-11-26T07:18:45.351069+0000","last_fullsized":"2023-11-26T07:18:45.351069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:01.882223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.339446+0000","last_change":"2023-11-26T07:18:43.347243+0000","last_active":"2023-11-26T07:18:44.339446+0000","last_peered":"2023-11-26T07:18:44.339446+0000","last_clean":"2023-11-26T07:18:44.339446+0000","last_became_active":"2023-11-26T07:18:43.346909+0000","last_became_peered":"2023-11-26T07:18:43.346909+0000","last_unstale":"2023-11-26T07:18:44.339446+0000","last_undegraded":"2023-11-26T07:18:44.339446+0000","last_fullsized":"2023-11-26T07:18:44.339446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.338498+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:18:44.338498+0000","last_peered":"2023-11-26T07:18:44.338498+0000","last_clean":"2023-11-26T07:18:44.338498+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:18:44.338498+0000","last_undegraded":"2023-11-26T07:18:44.338498+0000","last_fullsized":"2023-11-26T07:18:44.338498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.169}]},{"osd":1,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.23},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.7509999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.087},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.4219999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.381},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.8149999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.8779999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.649},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":1.6699999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.708},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.98}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.169,"5min":3.169,"15min":3.169},"last":0.877}]},{"osd":1,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.996}]},{"osd":2,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.226},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":3.1110000000000002,"5min":3.1110000000000002,"15min":3.1110000000000002},"last":0.93700000000000006}]},{"osd":3,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.349}]},{"osd":4,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1719999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.466},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.0489999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.526}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.458},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.105}]},{"osd":1,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.361},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.86799999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.1950000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.034}]},{"osd":4,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.52},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.274}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.577},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.145}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.3280000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.036},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.4570000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.49},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.26}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.417}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.0820000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":1.5389999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"min":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.649}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.593},{"interface":"front","average":{"1min":1.726,"5min":1.726,"15min":1.726},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.6279999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":153533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.88700000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.038},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.98299999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.745},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":0.69499999999999995}]},{"osd":4,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":1.4590000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.28},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.0900000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":3.226,"5min":3.226,"15min":3.226},"last":1.3380000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.224},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":1.3999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":151969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.751},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.97099999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.85799999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.80000000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.1619999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.89500000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.92400000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.296},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.995}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":153533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.393}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.056},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.3},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.5960000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.7},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3460000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.5349999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.788},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.486}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.643},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.3500000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.9630000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":742267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.087}]},{"osd":2,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.4590000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.4039999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.579},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.78}]},{"osd":5,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.506},{"interface":"front","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.55}]},{"osd":6,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.8799999999999999,"5min":2.8799999999999999,"15min":2.8799999999999999},"last":1.139},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.992}]},{"osd":7,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.8959999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.6639999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:18:50.049 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-26T07:18:50.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.303+0000 7f9477361640 1 Processor -- start 2023-11-26T07:18:50.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.303+0000 7f9477361640 1 -- start start 2023-11-26T07:18:50.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.305+0000 7f9477361640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f947015c7f0 0x7f947006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.305+0000 7f9477361640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f94700ce6c0 0x7f94700cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.305+0000 7f9477361640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94700cece0 con 0x7f94700cf450 2023-11-26T07:18:50.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.305+0000 7f9477361640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94700cfe40 con 0x7f94700ce6c0 2023-11-26T07:18:50.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.305+0000 7f9477361640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94700ceaf0 con 0x7f947015c7f0 2023-11-26T07:18:50.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.305+0000 7f94758fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f94700ce6c0 0x7f94700cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.305+0000 7f94758fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f94700ce6c0 0x7f94700cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56292/0 (socket says 172.21.15.77:56292) 2023-11-26T07:18:50.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.305+0000 7f94758fe640 1 -- 172.21.15.77:0/3482028594 learned_addr learned my addr 172.21.15.77:0/3482028594 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:50.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.305+0000 7f94750fd640 1 --2- 172.21.15.77:0/3482028594 >> v2:172.21.15.159:3300/0 conn(0x7f947015c7f0 0x7f947006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.306+0000 7f94758fe640 1 -- 172.21.15.77:0/3482028594 >> v2:172.21.15.159:3300/0 conn(0x7f947015c7f0 msgr2=0x7f947006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:50.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.306+0000 7f94758fe640 1 --2- 172.21.15.77:0/3482028594 >> v2:172.21.15.159:3300/0 conn(0x7f947015c7f0 0x7f947006db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.306+0000 7f94758fe640 1 -- 172.21.15.77:0/3482028594 >> v1:172.21.15.159:6789/0 conn(0x7f94700cf450 legacy=0x7f94700cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:50.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.306+0000 7f94758fe640 1 -- 172.21.15.77:0/3482028594 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947006d040 con 0x7f94700ce6c0 2023-11-26T07:18:50.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.307+0000 7f94758fe640 1 --2- 172.21.15.77:0/3482028594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94700ce6c0 0x7f94700cf900 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f94700d0130 tx=0x7f946802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa47717ec7bd45eb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.307+0000 7f9467fff640 1 -- 172.21.15.77:0/3482028594 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946802ca80 con 0x7f94700ce6c0 2023-11-26T07:18:50.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.307+0000 7f9467fff640 1 -- 172.21.15.77:0/3482028594 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946802cbe0 con 0x7f94700ce6c0 2023-11-26T07:18:50.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.307+0000 7f9467fff640 1 -- 172.21.15.77:0/3482028594 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94680343f0 con 0x7f94700ce6c0 2023-11-26T07:18:50.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.308+0000 7f9477361640 1 -- 172.21.15.77:0/3482028594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94700ce6c0 msgr2=0x7f94700cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.308+0000 7f9477361640 1 --2- 172.21.15.77:0/3482028594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94700ce6c0 0x7f94700cf900 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f94700d0130 tx=0x7f946802bee0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.308+0000 7f9477361640 1 -- 172.21.15.77:0/3482028594 shutdown_connections 2023-11-26T07:18:50.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.308+0000 7f9477361640 1 --2- 172.21.15.77:0/3482028594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94700ce6c0 0x7f94700cf900 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.308+0000 7f9477361640 1 --2- 172.21.15.77:0/3482028594 >> v2:172.21.15.159:3300/0 conn(0x7f947015c7f0 0x7f947006db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.308+0000 7f9477361640 1 -- 172.21.15.77:0/3482028594 >> 172.21.15.77:0/3482028594 conn(0x7f947006a920 msgr2=0x7f947006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:50.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.308+0000 7f9477361640 1 -- 172.21.15.77:0/3482028594 shutdown_connections 2023-11-26T07:18:50.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.308+0000 7f9477361640 1 -- 172.21.15.77:0/3482028594 wait complete. 2023-11-26T07:18:50.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.310+0000 7f9477361640 1 Processor -- start 2023-11-26T07:18:50.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.310+0000 7f9477361640 1 -- start start 2023-11-26T07:18:50.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.311+0000 7f9477361640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700ce6c0 0x7f94700adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.311+0000 7f9477361640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94700cf450 0x7f94700abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.311+0000 7f9477361640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f947015c7f0 0x7f94700ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.311+0000 7f9477361640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94700ac500 con 0x7f94700cf450 2023-11-26T07:18:50.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.311+0000 7f9477361640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94700ac710 con 0x7f94700ce6c0 2023-11-26T07:18:50.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.311+0000 7f9477361640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94700ac9f0 con 0x7f947015c7f0 2023-11-26T07:18:50.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.311+0000 7f94748fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94700cf450 0x7f94700abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.311+0000 7f94748fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94700cf450 0x7f94700abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56306/0 (socket says 172.21.15.77:56306) 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.311+0000 7f94748fc640 1 -- 172.21.15.77:0/2851018003 learned_addr learned my addr 172.21.15.77:0/2851018003 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f94750fd640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700ce6c0 0x7f94700adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f94758fe640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f947015c7f0 0x7f94700ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f94748fc640 1 -- 172.21.15.77:0/2851018003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f947015c7f0 msgr2=0x7f94700ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f94748fc640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f947015c7f0 0x7f94700ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f94748fc640 1 -- 172.21.15.77:0/2851018003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700ce6c0 msgr2=0x7f94700adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f94748fc640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700ce6c0 0x7f94700adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f94748fc640 1 -- 172.21.15.77:0/2851018003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9468009b30 con 0x7f94700cf450 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f94750fd640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700ce6c0 0x7f94700adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f94748fc640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94700cf450 0x7f94700abfc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f946000c430 tx=0x7f946000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f9465ffb640 1 -- 172.21.15.77:0/2851018003 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460011790 con 0x7f94700cf450 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f9465ffb640 1 -- 172.21.15.77:0/2851018003 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94600118f0 con 0x7f94700cf450 2023-11-26T07:18:50.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f9465ffb640 1 -- 172.21.15.77:0/2851018003 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460011ce0 con 0x7f94700cf450 2023-11-26T07:18:50.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f9477361640 1 -- 172.21.15.77:0/2851018003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94700accd0 con 0x7f94700cf450 2023-11-26T07:18:50.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.312+0000 7f9477361640 1 -- 172.21.15.77:0/2851018003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94700ad290 con 0x7f94700cf450 2023-11-26T07:18:50.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.314+0000 7f9477361640 1 -- 172.21.15.77:0/2851018003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947006e060 con 0x7f94700cf450 2023-11-26T07:18:50.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.314+0000 7f9465ffb640 1 -- 172.21.15.77:0/2851018003 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f946001c460 con 0x7f94700cf450 2023-11-26T07:18:50.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.315+0000 7f9465ffb640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f945406ae40 0x7f945406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.315+0000 7f9465ffb640 1 -- 172.21.15.77:0/2851018003 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9460089560 con 0x7f94700cf450 2023-11-26T07:18:50.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.316+0000 7f94750fd640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f945406ae40 0x7f945406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.316+0000 7f94750fd640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f945406ae40 0x7f945406d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f946c006fd0 tx=0x7f946c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.320+0000 7f9465ffb640 1 -- 172.21.15.77:0/2851018003 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9460054610 con 0x7f94700cf450 2023-11-26T07:18:50.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.580+0000 7f9477361640 1 -- 172.21.15.77:0/2851018003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9470067470 con 0x7f94700cf450 2023-11-26T07:18:50.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.581+0000 7f9465ffb640 1 -- 172.21.15.77:0/2851018003 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1173 (secure 0 0 0) 0x7f9460057c30 con 0x7f94700cf450 2023-11-26T07:18:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:50.583 INFO:teuthology.orchestra.run.smithi077.stdout:{"fsid":"957368bd-e942-499b-9938-86266ae9bafb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":100,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1700983042,"num_in_osds":8,"osd_in_since":1700983033,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":225689600,"bytes_avail":772868423680,"bytes_total":773094113280,"write_bytes_sec":2270,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":4708}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-11-26T07:18:31.622191+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-26T07:18:50.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.583+0000 7f9477361640 1 -- 172.21.15.77:0/2851018003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f945406ae40 msgr2=0x7f945406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.583+0000 7f9477361640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f945406ae40 0x7f945406d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f946c006fd0 tx=0x7f946c008040 comp rx=0 tx=0).stop 2023-11-26T07:18:50.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.583+0000 7f9477361640 1 -- 172.21.15.77:0/2851018003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94700cf450 msgr2=0x7f94700abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.583+0000 7f9477361640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94700cf450 0x7f94700abfc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f946000c430 tx=0x7f946000c8f0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.583+0000 7f9477361640 1 -- 172.21.15.77:0/2851018003 shutdown_connections 2023-11-26T07:18:50.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.583+0000 7f9477361640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f945406ae40 0x7f945406d300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.583+0000 7f9477361640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f947015c7f0 0x7f94700ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.583+0000 7f9477361640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94700cf450 0x7f94700abfc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.583+0000 7f9477361640 1 --2- 172.21.15.77:0/2851018003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94700ce6c0 0x7f94700adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.583+0000 7f9477361640 1 -- 172.21.15.77:0/2851018003 >> 172.21.15.77:0/2851018003 conn(0x7f947006a920 msgr2=0x7f947015eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:50.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.583+0000 7f9477361640 1 -- 172.21.15.77:0/2851018003 shutdown_connections 2023-11-26T07:18:50.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.584+0000 7f9477361640 1 -- 172.21.15.77:0/2851018003 wait complete. 2023-11-26T07:18:50.604 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-26T07:18:50.604 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:18:50.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.817+0000 7f132b90f640 1 Processor -- start 2023-11-26T07:18:50.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.817+0000 7f132b90f640 1 -- start start 2023-11-26T07:18:50.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.819+0000 7f132b90f640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1324157c70 0x7f1324161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.819+0000 7f132b90f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13240cf450 0x7f13240cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.819+0000 7f132b90f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13240ce0b0 con 0x7f132415dc80 2023-11-26T07:18:50.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.819+0000 7f132b90f640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13240cfe10 con 0x7f1324157c70 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.819+0000 7f132b90f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1324161960 con 0x7f13240cf450 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.819+0000 7f1329eac640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f132415dc80 0x7f132415e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46354/0 (socket says 172.21.15.77:46354) 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.819+0000 7f1329eac640 1 -- 172.21.15.77:0/104166991 learned_addr learned my addr 172.21.15.77:0/104166991 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.819+0000 7f13296ab640 1 --2- 172.21.15.77:0/104166991 >> v2:172.21.15.159:3300/0 conn(0x7f1324157c70 0x7f1324161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f1328eaa640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13240cf450 0x7f13240cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421391108 0 0) 0x7f13240ce0b0 con 0x7f132415dc80 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1310003520 con 0x7f132415dc80 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183892857 0 0) 0x7f1310003520 con 0x7f132415dc80 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13240cf450 msgr2=0x7f13240cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13240cf450 0x7f13240cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 >> v2:172.21.15.159:3300/0 conn(0x7f1324157c70 msgr2=0x7f1324161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:50.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 --2- 172.21.15.77:0/104166991 >> v2:172.21.15.159:3300/0 conn(0x7f1324157c70 0x7f1324161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132415e8d0 con 0x7f132415dc80 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f131c0019f0 con 0x7f132415dc80 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 >> v1:172.21.15.77:6789/0 conn(0x7f132415dc80 legacy=0x7f132415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1310003970 0x7f1310003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13240cf450 0x7f13100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1310004d00 0x7f1310005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13240cfe10 con 0x7f1310004d00 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1324161960 con 0x7f1310003970 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.820+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131000b980 con 0x7f13240cf450 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.821+0000 7f1329eac640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1310004d00 0x7f1310005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.821+0000 7f1328eaa640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13240cf450 0x7f13100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.821+0000 7f1329eac640 1 -- 172.21.15.77:0/104166991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13240cf450 msgr2=0x7f13100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:50.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.821+0000 7f13296ab640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1310003970 0x7f1310003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.821+0000 7f1329eac640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13240cf450 0x7f13100047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.821+0000 7f1329eac640 1 -- 172.21.15.77:0/104166991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1310003970 msgr2=0x7f1310003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:50.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.821+0000 7f1329eac640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1310003970 0x7f1310003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.821+0000 7f1329eac640 1 -- 172.21.15.77:0/104166991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1310003520 con 0x7f1310004d00 2023-11-26T07:18:50.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.822+0000 7f1329eac640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1310004d00 0x7f1310005180 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f131c00a860 tx=0x7f13100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1055c3981be1a458 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.822+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c034630 con 0x7f1310004d00 2023-11-26T07:18:50.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.822+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c02f070 con 0x7f1310004d00 2023-11-26T07:18:50.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.822+0000 7f131bfff640 1 -- 172.21.15.77:0/104166991 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0349f0 con 0x7f1310004d00 2023-11-26T07:18:50.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.823+0000 7f132b90f640 1 -- 172.21.15.77:0/104166991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1310004d00 msgr2=0x7f1310005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.823+0000 7f132b90f640 1 --2- 172.21.15.77:0/104166991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1310004d00 0x7f1310005180 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f131c00a860 tx=0x7f13100057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.823+0000 7f1329eac640 1 -- 172.21.15.77:0/104166991 reap_dead start 2023-11-26T07:18:50.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.823+0000 7f132b90f640 1 -- 172.21.15.77:0/104166991 shutdown_connections 2023-11-26T07:18:50.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.823+0000 7f132b90f640 1 -- 172.21.15.77:0/104166991 >> 172.21.15.77:0/104166991 conn(0x7f132406a920 msgr2=0x7f132406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:50.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.823+0000 7f132b90f640 1 -- 172.21.15.77:0/104166991 shutdown_connections 2023-11-26T07:18:50.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.823+0000 7f132b90f640 1 -- 172.21.15.77:0/104166991 wait complete. 2023-11-26T07:18:50.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.825+0000 7f132b90f640 1 Processor -- start 2023-11-26T07:18:50.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.825+0000 7f132b90f640 1 -- start start 2023-11-26T07:18:50.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.826+0000 7f132b90f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1324151660 0x7f1324156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.826+0000 7f132b90f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13241567b0 0x7f13240ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.826+0000 7f132b90f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13240ac730 0x7f13241f6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.826+0000 7f132b90f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1324152770 con 0x7f13240ac730 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.826+0000 7f132b90f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1324156c30 con 0x7f1324151660 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.826+0000 7f132b90f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13240acf20 con 0x7f13241567b0 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.826+0000 7f1329eac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13240ac730 0x7f13241f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.826+0000 7f1329eac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13240ac730 0x7f13241f6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56324/0 (socket says 172.21.15.77:56324) 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.826+0000 7f1329eac640 1 -- 172.21.15.77:0/2235609519 learned_addr learned my addr 172.21.15.77:0/2235609519 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.826+0000 7f13296ab640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1324151660 0x7f1324156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f1328eaa640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13241567b0 0x7f13240ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f1329eac640 1 -- 172.21.15.77:0/2235609519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13241567b0 msgr2=0x7f13240ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f1329eac640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13241567b0 0x7f13240ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f1329eac640 1 -- 172.21.15.77:0/2235609519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1324151660 msgr2=0x7f1324156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f1329eac640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1324151660 0x7f1324156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f1329eac640 1 -- 172.21.15.77:0/2235609519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1324151a40 con 0x7f13240ac730 2023-11-26T07:18:50.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f1328eaa640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13241567b0 0x7f13240ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:50.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f1329eac640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13240ac730 0x7f13241f6890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f131c02cba0 tx=0x7f131c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f1319ffb640 1 -- 172.21.15.77:0/2235609519 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c034840 con 0x7f13240ac730 2023-11-26T07:18:50.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f1319ffb640 1 -- 172.21.15.77:0/2235609519 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c0019e0 con 0x7f13240ac730 2023-11-26T07:18:50.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f1319ffb640 1 -- 172.21.15.77:0/2235609519 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c034ba0 con 0x7f13240ac730 2023-11-26T07:18:50.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f132b90f640 1 -- 172.21.15.77:0/2235609519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1324151dd0 con 0x7f13240ac730 2023-11-26T07:18:50.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.827+0000 7f132b90f640 1 -- 172.21.15.77:0/2235609519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1324152390 con 0x7f13240ac730 2023-11-26T07:18:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.829+0000 7f132b90f640 1 -- 172.21.15.77:0/2235609519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1324152550 con 0x7f13240ac730 2023-11-26T07:18:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.829+0000 7f1319ffb640 1 -- 172.21.15.77:0/2235609519 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f131c031030 con 0x7f13240ac730 2023-11-26T07:18:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.830+0000 7f1319ffb640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f130806ae70 0x7f130806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.831+0000 7f1319ffb640 1 -- 172.21.15.77:0/2235609519 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f131c0ab640 con 0x7f13240ac730 2023-11-26T07:18:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.831+0000 7f13296ab640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f130806ae70 0x7f130806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.831+0000 7f13296ab640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f130806ae70 0x7f130806d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1320009a90 tx=0x7f1320008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:50.835+0000 7f1319ffb640 1 -- 172.21.15.77:0/2235609519 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f131c0766e0 con 0x7f13240ac730 2023-11-26T07:18:51.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.026+0000 7f132b90f640 1 -- 172.21.15.77:0/2235609519 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13241615f0 con 0x7f130806ae70 2023-11-26T07:18:51.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.038+0000 7f1319ffb640 1 -- 172.21.15.77:0/2235609519 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286538 (secure 0 0 0) 0x7f13200129b0 con 0x7f130806ae70 2023-11-26T07:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:51.045 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 -- 172.21.15.77:0/2235609519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f130806ae70 msgr2=0x7f130806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f130806ae70 0x7f130806d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1320009a90 tx=0x7f1320008040 comp rx=0 tx=0).stop 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 -- 172.21.15.77:0/2235609519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13240ac730 msgr2=0x7f13241f6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13240ac730 0x7f13241f6890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f131c02cba0 tx=0x7f131c001d80 comp rx=0 tx=0).stop 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 -- 172.21.15.77:0/2235609519 shutdown_connections 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f130806ae70 0x7f130806d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13240ac730 0x7f13241f6890 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13241567b0 0x7f13240ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 --2- 172.21.15.77:0/2235609519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1324151660 0x7f1324156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 -- 172.21.15.77:0/2235609519 >> 172.21.15.77:0/2235609519 conn(0x7f132406a920 msgr2=0x7f132406c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 -- 172.21.15.77:0/2235609519 shutdown_connections 2023-11-26T07:18:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:51.043+0000 7f132b90f640 1 -- 172.21.15.77:0/2235609519 wait complete. 2023-11-26T07:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-11-26T07:18:49.626424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220400,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754320,"statfs":{"total":773094113280,"available":772868423680,"internally_reserved":0,"allocated":4333568,"data_stored":2400748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.314868"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348345+0000","last_change":"2023-11-26T07:18:44.347920+0000","last_active":"2023-11-26T07:18:45.348345+0000","last_peered":"2023-11-26T07:18:45.348345+0000","last_clean":"2023-11-26T07:18:45.348345+0000","last_became_active":"2023-11-26T07:18:44.347657+0000","last_became_peered":"2023-11-26T07:18:44.347657+0000","last_unstale":"2023-11-26T07:18:45.348345+0000","last_undegraded":"2023-11-26T07:18:45.348345+0000","last_fullsized":"2023-11-26T07:18:45.348345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:52:23.863830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373193+0000","last_change":"2023-11-26T07:18:44.345735+0000","last_active":"2023-11-26T07:18:46.373193+0000","last_peered":"2023-11-26T07:18:46.373193+0000","last_clean":"2023-11-26T07:18:46.373193+0000","last_became_active":"2023-11-26T07:18:44.345460+0000","last_became_peered":"2023-11-26T07:18:44.345460+0000","last_unstale":"2023-11-26T07:18:46.373193+0000","last_undegraded":"2023-11-26T07:18:46.373193+0000","last_fullsized":"2023-11-26T07:18:46.373193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:16:33.094928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901198+0000","last_change":"2023-11-26T07:18:44.346096+0000","last_active":"2023-11-26T07:18:45.901198+0000","last_peered":"2023-11-26T07:18:45.901198+0000","last_clean":"2023-11-26T07:18:45.901198+0000","last_became_active":"2023-11-26T07:18:44.345635+0000","last_became_peered":"2023-11-26T07:18:44.345635+0000","last_unstale":"2023-11-26T07:18:45.901198+0000","last_undegraded":"2023-11-26T07:18:45.901198+0000","last_fullsized":"2023-11-26T07:18:45.901198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:01.882223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786081+0000","last_change":"2023-11-26T07:18:44.351258+0000","last_active":"2023-11-26T07:18:45.786081+0000","last_peered":"2023-11-26T07:18:45.786081+0000","last_clean":"2023-11-26T07:18:45.786081+0000","last_became_active":"2023-11-26T07:18:44.350618+0000","last_became_peered":"2023-11-26T07:18:44.350618+0000","last_unstale":"2023-11-26T07:18:45.786081+0000","last_undegraded":"2023-11-26T07:18:45.786081+0000","last_fullsized":"2023-11-26T07:18:45.786081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:12.873661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371991+0000","last_change":"2023-11-26T07:18:44.347889+0000","last_active":"2023-11-26T07:18:46.371991+0000","last_peered":"2023-11-26T07:18:46.371991+0000","last_clean":"2023-11-26T07:18:46.371991+0000","last_became_active":"2023-11-26T07:18:44.347632+0000","last_became_peered":"2023-11-26T07:18:44.347632+0000","last_unstale":"2023-11-26T07:18:46.371991+0000","last_undegraded":"2023-11-26T07:18:46.371991+0000","last_fullsized":"2023-11-26T07:18:46.371991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:45:00.135951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372071+0000","last_change":"2023-11-26T07:18:44.332486+0000","last_active":"2023-11-26T07:18:46.372071+0000","last_peered":"2023-11-26T07:18:46.372071+0000","last_clean":"2023-11-26T07:18:46.372071+0000","last_became_active":"2023-11-26T07:18:44.332179+0000","last_became_peered":"2023-11-26T07:18:44.332179+0000","last_unstale":"2023-11-26T07:18:46.372071+0000","last_undegraded":"2023-11-26T07:18:46.372071+0000","last_fullsized":"2023-11-26T07:18:46.372071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:50:16.254065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351178+0000","last_change":"2023-11-26T07:18:44.352470+0000","last_active":"2023-11-26T07:18:45.351178+0000","last_peered":"2023-11-26T07:18:45.351178+0000","last_clean":"2023-11-26T07:18:45.351178+0000","last_became_active":"2023-11-26T07:18:44.352160+0000","last_became_peered":"2023-11-26T07:18:44.352160+0000","last_unstale":"2023-11-26T07:18:45.351178+0000","last_undegraded":"2023-11-26T07:18:45.351178+0000","last_fullsized":"2023-11-26T07:18:45.351178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:41.246469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350124+0000","last_change":"2023-11-26T07:18:44.351969+0000","last_active":"2023-11-26T07:18:45.350124+0000","last_peered":"2023-11-26T07:18:45.350124+0000","last_clean":"2023-11-26T07:18:45.350124+0000","last_became_active":"2023-11-26T07:18:44.351711+0000","last_became_peered":"2023-11-26T07:18:44.351711+0000","last_unstale":"2023-11-26T07:18:45.350124+0000","last_undegraded":"2023-11-26T07:18:45.350124+0000","last_fullsized":"2023-11-26T07:18:45.350124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:12.873661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372735+0000","last_change":"2023-11-26T07:18:44.345764+0000","last_active":"2023-11-26T07:18:46.372735+0000","last_peered":"2023-11-26T07:18:46.372735+0000","last_clean":"2023-11-26T07:18:46.372735+0000","last_became_active":"2023-11-26T07:18:44.345342+0000","last_became_peered":"2023-11-26T07:18:44.345342+0000","last_unstale":"2023-11-26T07:18:46.372735+0000","last_undegraded":"2023-11-26T07:18:46.372735+0000","last_fullsized":"2023-11-26T07:18:46.372735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:55.986599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786774+0000","last_change":"2023-11-26T07:18:44.356850+0000","last_active":"2023-11-26T07:18:45.786774+0000","last_peered":"2023-11-26T07:18:45.786774+0000","last_clean":"2023-11-26T07:18:45.786774+0000","last_became_active":"2023-11-26T07:18:44.356490+0000","last_became_peered":"2023-11-26T07:18:44.356490+0000","last_unstale":"2023-11-26T07:18:45.786774+0000","last_undegraded":"2023-11-26T07:18:45.786774+0000","last_fullsized":"2023-11-26T07:18:45.786774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:37.831580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351011+0000","last_change":"2023-11-26T07:18:44.350582+0000","last_active":"2023-11-26T07:18:45.351011+0000","last_peered":"2023-11-26T07:18:45.351011+0000","last_clean":"2023-11-26T07:18:45.351011+0000","last_became_active":"2023-11-26T07:18:44.350308+0000","last_became_peered":"2023-11-26T07:18:44.350308+0000","last_unstale":"2023-11-26T07:18:45.351011+0000","last_undegraded":"2023-11-26T07:18:45.351011+0000","last_fullsized":"2023-11-26T07:18:45.351011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:27.677252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900850+0000","last_change":"2023-11-26T07:18:44.349629+0000","last_active":"2023-11-26T07:18:45.900850+0000","last_peered":"2023-11-26T07:18:45.900850+0000","last_clean":"2023-11-26T07:18:45.900850+0000","last_became_active":"2023-11-26T07:18:44.349318+0000","last_became_peered":"2023-11-26T07:18:44.349318+0000","last_unstale":"2023-11-26T07:18:45.900850+0000","last_undegraded":"2023-11-26T07:18:45.900850+0000","last_fullsized":"2023-11-26T07:18:45.900850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:27.677252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372437+0000","last_change":"2023-11-26T07:18:44.342774+0000","last_active":"2023-11-26T07:18:46.372437+0000","last_peered":"2023-11-26T07:18:46.372437+0000","last_clean":"2023-11-26T07:18:46.372437+0000","last_became_active":"2023-11-26T07:18:44.342510+0000","last_became_peered":"2023-11-26T07:18:44.342510+0000","last_unstale":"2023-11-26T07:18:46.372437+0000","last_undegraded":"2023-11-26T07:18:46.372437+0000","last_fullsized":"2023-11-26T07:18:46.372437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:15:37.319625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372160+0000","last_change":"2023-11-26T07:18:44.334557+0000","last_active":"2023-11-26T07:18:46.372160+0000","last_peered":"2023-11-26T07:18:46.372160+0000","last_clean":"2023-11-26T07:18:46.372160+0000","last_became_active":"2023-11-26T07:18:44.333952+0000","last_became_peered":"2023-11-26T07:18:44.333952+0000","last_unstale":"2023-11-26T07:18:46.372160+0000","last_undegraded":"2023-11-26T07:18:46.372160+0000","last_fullsized":"2023-11-26T07:18:46.372160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:01.882223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900906+0000","last_change":"2023-11-26T07:18:44.348669+0000","last_active":"2023-11-26T07:18:45.900906+0000","last_peered":"2023-11-26T07:18:45.900906+0000","last_clean":"2023-11-26T07:18:45.900906+0000","last_became_active":"2023-11-26T07:18:44.347341+0000","last_became_peered":"2023-11-26T07:18:44.347341+0000","last_unstale":"2023-11-26T07:18:45.900906+0000","last_undegraded":"2023-11-26T07:18:45.900906+0000","last_fullsized":"2023-11-26T07:18:45.900906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:50:16.254065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350509+0000","last_change":"2023-11-26T07:18:44.361345+0000","last_active":"2023-11-26T07:18:45.350509+0000","last_peered":"2023-11-26T07:18:45.350509+0000","last_clean":"2023-11-26T07:18:45.350509+0000","last_became_active":"2023-11-26T07:18:44.361125+0000","last_became_peered":"2023-11-26T07:18:44.361125+0000","last_unstale":"2023-11-26T07:18:45.350509+0000","last_undegraded":"2023-11-26T07:18:45.350509+0000","last_fullsized":"2023-11-26T07:18:45.350509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:14.130743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351371+0000","last_change":"2023-11-26T07:18:44.353247+0000","last_active":"2023-11-26T07:18:45.351371+0000","last_peered":"2023-11-26T07:18:45.351371+0000","last_clean":"2023-11-26T07:18:45.351371+0000","last_became_active":"2023-11-26T07:18:44.350764+0000","last_became_peered":"2023-11-26T07:18:44.350764+0000","last_unstale":"2023-11-26T07:18:45.351371+0000","last_undegraded":"2023-11-26T07:18:45.351371+0000","last_fullsized":"2023-11-26T07:18:45.351371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:16:33.094928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373266+0000","last_change":"2023-11-26T07:18:44.344990+0000","last_active":"2023-11-26T07:18:46.373266+0000","last_peered":"2023-11-26T07:18:46.373266+0000","last_clean":"2023-11-26T07:18:46.373266+0000","last_became_active":"2023-11-26T07:18:44.343308+0000","last_became_peered":"2023-11-26T07:18:44.343308+0000","last_unstale":"2023-11-26T07:18:46.373266+0000","last_undegraded":"2023-11-26T07:18:46.373266+0000","last_fullsized":"2023-11-26T07:18:46.373266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:56:56.768970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373388+0000","last_change":"2023-11-26T07:18:44.343005+0000","last_active":"2023-11-26T07:18:46.373388+0000","last_peered":"2023-11-26T07:18:46.373388+0000","last_clean":"2023-11-26T07:18:46.373388+0000","last_became_active":"2023-11-26T07:18:44.342508+0000","last_became_peered":"2023-11-26T07:18:44.342508+0000","last_unstale":"2023-11-26T07:18:46.373388+0000","last_undegraded":"2023-11-26T07:18:46.373388+0000","last_fullsized":"2023-11-26T07:18:46.373388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:50:35.270986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371931+0000","last_change":"2023-11-26T07:18:44.332076+0000","last_active":"2023-11-26T07:18:46.371931+0000","last_peered":"2023-11-26T07:18:46.371931+0000","last_clean":"2023-11-26T07:18:46.371931+0000","last_became_active":"2023-11-26T07:18:44.331785+0000","last_became_peered":"2023-11-26T07:18:44.331785+0000","last_unstale":"2023-11-26T07:18:46.371931+0000","last_undegraded":"2023-11-26T07:18:46.371931+0000","last_fullsized":"2023-11-26T07:18:46.371931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:51:56.864305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371982+0000","last_change":"2023-11-26T07:18:44.345163+0000","last_active":"2023-11-26T07:18:46.371982+0000","last_peered":"2023-11-26T07:18:46.371982+0000","last_clean":"2023-11-26T07:18:46.371982+0000","last_became_active":"2023-11-26T07:18:44.343511+0000","last_became_peered":"2023-11-26T07:18:44.343511+0000","last_unstale":"2023-11-26T07:18:46.371982+0000","last_undegraded":"2023-11-26T07:18:46.371982+0000","last_fullsized":"2023-11-26T07:18:46.371982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:51.427055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372898+0000","last_change":"2023-11-26T07:18:44.356696+0000","last_active":"2023-11-26T07:18:46.372898+0000","last_peered":"2023-11-26T07:18:46.372898+0000","last_clean":"2023-11-26T07:18:46.372898+0000","last_became_active":"2023-11-26T07:18:44.355640+0000","last_became_peered":"2023-11-26T07:18:44.355640+0000","last_unstale":"2023-11-26T07:18:46.372898+0000","last_undegraded":"2023-11-26T07:18:46.372898+0000","last_fullsized":"2023-11-26T07:18:46.372898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:11.688889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.346987+0000","last_change":"2023-11-26T07:18:44.351026+0000","last_active":"2023-11-26T07:18:45.346987+0000","last_peered":"2023-11-26T07:18:45.346987+0000","last_clean":"2023-11-26T07:18:45.346987+0000","last_became_active":"2023-11-26T07:18:44.350754+0000","last_became_peered":"2023-11-26T07:18:44.350754+0000","last_unstale":"2023-11-26T07:18:45.346987+0000","last_undegraded":"2023-11-26T07:18:45.346987+0000","last_fullsized":"2023-11-26T07:18:45.346987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:29.028111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900492+0000","last_change":"2023-11-26T07:18:44.330185+0000","last_active":"2023-11-26T07:18:45.900492+0000","last_peered":"2023-11-26T07:18:45.900492+0000","last_clean":"2023-11-26T07:18:45.900492+0000","last_became_active":"2023-11-26T07:18:44.329868+0000","last_became_peered":"2023-11-26T07:18:44.329868+0000","last_unstale":"2023-11-26T07:18:45.900492+0000","last_undegraded":"2023-11-26T07:18:45.900492+0000","last_fullsized":"2023-11-26T07:18:45.900492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:37.831580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786816+0000","last_change":"2023-11-26T07:18:44.349792+0000","last_active":"2023-11-26T07:18:45.786816+0000","last_peered":"2023-11-26T07:18:45.786816+0000","last_clean":"2023-11-26T07:18:45.786816+0000","last_became_active":"2023-11-26T07:18:44.349517+0000","last_became_peered":"2023-11-26T07:18:44.349517+0000","last_unstale":"2023-11-26T07:18:45.786816+0000","last_undegraded":"2023-11-26T07:18:45.786816+0000","last_fullsized":"2023-11-26T07:18:45.786816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:14.130743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373549+0000","last_change":"2023-11-26T07:18:44.345147+0000","last_active":"2023-11-26T07:18:46.373549+0000","last_peered":"2023-11-26T07:18:46.373549+0000","last_clean":"2023-11-26T07:18:46.373549+0000","last_became_active":"2023-11-26T07:18:44.344700+0000","last_became_peered":"2023-11-26T07:18:44.344700+0000","last_unstale":"2023-11-26T07:18:46.373549+0000","last_undegraded":"2023-11-26T07:18:46.373549+0000","last_fullsized":"2023-11-26T07:18:46.373549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:53:07.562653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786696+0000","last_change":"2023-11-26T07:18:44.355462+0000","last_active":"2023-11-26T07:18:45.786696+0000","last_peered":"2023-11-26T07:18:45.786696+0000","last_clean":"2023-11-26T07:18:45.786696+0000","last_became_active":"2023-11-26T07:18:44.355184+0000","last_became_peered":"2023-11-26T07:18:44.355184+0000","last_unstale":"2023-11-26T07:18:45.786696+0000","last_undegraded":"2023-11-26T07:18:45.786696+0000","last_fullsized":"2023-11-26T07:18:45.786696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:42.805540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900890+0000","last_change":"2023-11-26T07:18:44.340207+0000","last_active":"2023-11-26T07:18:45.900890+0000","last_peered":"2023-11-26T07:18:45.900890+0000","last_clean":"2023-11-26T07:18:45.900890+0000","last_became_active":"2023-11-26T07:18:44.339921+0000","last_became_peered":"2023-11-26T07:18:44.339921+0000","last_unstale":"2023-11-26T07:18:45.900890+0000","last_undegraded":"2023-11-26T07:18:45.900890+0000","last_fullsized":"2023-11-26T07:18:45.900890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:14.130743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372032+0000","last_change":"2023-11-26T07:18:44.354377+0000","last_active":"2023-11-26T07:18:46.372032+0000","last_peered":"2023-11-26T07:18:46.372032+0000","last_clean":"2023-11-26T07:18:46.372032+0000","last_became_active":"2023-11-26T07:18:44.354120+0000","last_became_peered":"2023-11-26T07:18:44.354120+0000","last_unstale":"2023-11-26T07:18:46.372032+0000","last_undegraded":"2023-11-26T07:18:46.372032+0000","last_fullsized":"2023-11-26T07:18:46.372032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:29.028111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350936+0000","last_change":"2023-11-26T07:18:44.352615+0000","last_active":"2023-11-26T07:18:45.350936+0000","last_peered":"2023-11-26T07:18:45.350936+0000","last_clean":"2023-11-26T07:18:45.350936+0000","last_became_active":"2023-11-26T07:18:44.352294+0000","last_became_peered":"2023-11-26T07:18:44.352294+0000","last_unstale":"2023-11-26T07:18:45.350936+0000","last_undegraded":"2023-11-26T07:18:45.350936+0000","last_fullsized":"2023-11-26T07:18:45.350936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:13.735281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348709+0000","last_change":"2023-11-26T07:18:44.344168+0000","last_active":"2023-11-26T07:18:45.348709+0000","last_peered":"2023-11-26T07:18:45.348709+0000","last_clean":"2023-11-26T07:18:45.348709+0000","last_became_active":"2023-11-26T07:18:44.340360+0000","last_became_peered":"2023-11-26T07:18:44.340360+0000","last_unstale":"2023-11-26T07:18:45.348709+0000","last_undegraded":"2023-11-26T07:18:45.348709+0000","last_fullsized":"2023-11-26T07:18:45.348709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:51.427055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350272+0000","last_change":"2023-11-26T07:18:44.358261+0000","last_active":"2023-11-26T07:18:45.350272+0000","last_peered":"2023-11-26T07:18:45.350272+0000","last_clean":"2023-11-26T07:18:45.350272+0000","last_became_active":"2023-11-26T07:18:44.357918+0000","last_became_peered":"2023-11-26T07:18:44.357918+0000","last_unstale":"2023-11-26T07:18:45.350272+0000","last_undegraded":"2023-11-26T07:18:45.350272+0000","last_fullsized":"2023-11-26T07:18:45.350272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:42.805540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.347437+0000","last_change":"2023-11-26T07:18:44.350453+0000","last_active":"2023-11-26T07:18:45.347437+0000","last_peered":"2023-11-26T07:18:45.347437+0000","last_clean":"2023-11-26T07:18:45.347437+0000","last_became_active":"2023-11-26T07:18:44.350194+0000","last_became_peered":"2023-11-26T07:18:44.350194+0000","last_unstale":"2023-11-26T07:18:45.347437+0000","last_undegraded":"2023-11-26T07:18:45.347437+0000","last_fullsized":"2023-11-26T07:18:45.347437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.683350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.355706+0000","last_change":"2023-11-26T07:18:43.349331+0000","last_active":"2023-11-26T07:18:44.355706+0000","last_peered":"2023-11-26T07:18:44.355706+0000","last_clean":"2023-11-26T07:18:44.355706+0000","last_became_active":"2023-11-26T07:18:43.349011+0000","last_became_peered":"2023-11-26T07:18:43.349011+0000","last_unstale":"2023-11-26T07:18:44.355706+0000","last_undegraded":"2023-11-26T07:18:44.355706+0000","last_fullsized":"2023-11-26T07:18:44.355706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348743+0000","last_change":"2023-11-26T07:18:44.351596+0000","last_active":"2023-11-26T07:18:45.348743+0000","last_peered":"2023-11-26T07:18:45.348743+0000","last_clean":"2023-11-26T07:18:45.348743+0000","last_became_active":"2023-11-26T07:18:44.349802+0000","last_became_peered":"2023-11-26T07:18:44.349802+0000","last_unstale":"2023-11-26T07:18:45.348743+0000","last_undegraded":"2023-11-26T07:18:45.348743+0000","last_fullsized":"2023-11-26T07:18:45.348743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:29.028111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.350976+0000","last_change":"2023-11-26T07:18:43.340731+0000","last_active":"2023-11-26T07:18:44.350976+0000","last_peered":"2023-11-26T07:18:44.350976+0000","last_clean":"2023-11-26T07:18:44.350976+0000","last_became_active":"2023-11-26T07:18:43.340447+0000","last_became_peered":"2023-11-26T07:18:43.340447+0000","last_unstale":"2023-11-26T07:18:44.350976+0000","last_undegraded":"2023-11-26T07:18:44.350976+0000","last_fullsized":"2023-11-26T07:18:44.350976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372242+0000","last_change":"2023-11-26T07:18:44.365323+0000","last_active":"2023-11-26T07:18:46.372242+0000","last_peered":"2023-11-26T07:18:46.372242+0000","last_clean":"2023-11-26T07:18:46.372242+0000","last_became_active":"2023-11-26T07:18:44.365044+0000","last_became_peered":"2023-11-26T07:18:44.365044+0000","last_unstale":"2023-11-26T07:18:46.372242+0000","last_undegraded":"2023-11-26T07:18:46.372242+0000","last_fullsized":"2023-11-26T07:18:46.372242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:47.571506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.342889+0000","last_change":"2023-11-26T07:18:43.341518+0000","last_active":"2023-11-26T07:18:44.342889+0000","last_peered":"2023-11-26T07:18:44.342889+0000","last_clean":"2023-11-26T07:18:44.342889+0000","last_became_active":"2023-11-26T07:18:43.341219+0000","last_became_peered":"2023-11-26T07:18:43.341219+0000","last_unstale":"2023-11-26T07:18:44.342889+0000","last_undegraded":"2023-11-26T07:18:44.342889+0000","last_fullsized":"2023-11-26T07:18:44.342889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:11.858583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786915+0000","last_change":"2023-11-26T07:18:44.352705+0000","last_active":"2023-11-26T07:18:45.786915+0000","last_peered":"2023-11-26T07:18:45.786915+0000","last_clean":"2023-11-26T07:18:45.786915+0000","last_became_active":"2023-11-26T07:18:44.352394+0000","last_became_peered":"2023-11-26T07:18:44.352394+0000","last_unstale":"2023-11-26T07:18:45.786915+0000","last_undegraded":"2023-11-26T07:18:45.786915+0000","last_fullsized":"2023-11-26T07:18:45.786915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:13.735281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.360589+0000","last_change":"2023-11-26T07:18:43.343141+0000","last_active":"2023-11-26T07:18:44.360589+0000","last_peered":"2023-11-26T07:18:44.360589+0000","last_clean":"2023-11-26T07:18:44.360589+0000","last_became_active":"2023-11-26T07:18:43.342643+0000","last_became_peered":"2023-11-26T07:18:43.342643+0000","last_unstale":"2023-11-26T07:18:44.360589+0000","last_undegraded":"2023-11-26T07:18:44.360589+0000","last_fullsized":"2023-11-26T07:18:44.360589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:48:42.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351025+0000","last_change":"2023-11-26T07:18:44.355098+0000","last_active":"2023-11-26T07:18:45.351025+0000","last_peered":"2023-11-26T07:18:45.351025+0000","last_clean":"2023-11-26T07:18:45.351025+0000","last_became_active":"2023-11-26T07:18:44.354783+0000","last_became_peered":"2023-11-26T07:18:44.354783+0000","last_unstale":"2023-11-26T07:18:45.351025+0000","last_undegraded":"2023-11-26T07:18:45.351025+0000","last_fullsized":"2023-11-26T07:18:45.351025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:50:16.254065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.356431+0000","last_change":"2023-11-26T07:18:43.340696+0000","last_active":"2023-11-26T07:18:44.356431+0000","last_peered":"2023-11-26T07:18:44.356431+0000","last_clean":"2023-11-26T07:18:44.356431+0000","last_became_active":"2023-11-26T07:18:43.340412+0000","last_became_peered":"2023-11-26T07:18:43.340412+0000","last_unstale":"2023-11-26T07:18:44.356431+0000","last_undegraded":"2023-11-26T07:18:44.356431+0000","last_fullsized":"2023-11-26T07:18:44.356431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:15:36.304547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900779+0000","last_change":"2023-11-26T07:18:44.346028+0000","last_active":"2023-11-26T07:18:45.900779+0000","last_peered":"2023-11-26T07:18:45.900779+0000","last_clean":"2023-11-26T07:18:45.900779+0000","last_became_active":"2023-11-26T07:18:44.343992+0000","last_became_peered":"2023-11-26T07:18:44.343992+0000","last_unstale":"2023-11-26T07:18:45.900779+0000","last_undegraded":"2023-11-26T07:18:45.900779+0000","last_fullsized":"2023-11-26T07:18:45.900779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:42.805540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.356336+0000","last_change":"2023-11-26T07:18:43.340168+0000","last_active":"2023-11-26T07:18:44.356336+0000","last_peered":"2023-11-26T07:18:44.356336+0000","last_clean":"2023-11-26T07:18:44.356336+0000","last_became_active":"2023-11-26T07:18:43.339836+0000","last_became_peered":"2023-11-26T07:18:43.339836+0000","last_unstale":"2023-11-26T07:18:44.356336+0000","last_undegraded":"2023-11-26T07:18:44.356336+0000","last_fullsized":"2023-11-26T07:18:44.356336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:37.166777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371747+0000","last_change":"2023-11-26T07:18:44.342135+0000","last_active":"2023-11-26T07:18:46.371747+0000","last_peered":"2023-11-26T07:18:46.371747+0000","last_clean":"2023-11-26T07:18:46.371747+0000","last_became_active":"2023-11-26T07:18:44.341837+0000","last_became_peered":"2023-11-26T07:18:44.341837+0000","last_unstale":"2023-11-26T07:18:46.371747+0000","last_undegraded":"2023-11-26T07:18:46.371747+0000","last_fullsized":"2023-11-26T07:18:46.371747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:52:23.863830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322279+0000","last_change":"2023-11-26T07:18:43.326829+0000","last_active":"2023-11-26T07:18:44.322279+0000","last_peered":"2023-11-26T07:18:44.322279+0000","last_clean":"2023-11-26T07:18:44.322279+0000","last_became_active":"2023-11-26T07:18:43.326359+0000","last_became_peered":"2023-11-26T07:18:43.326359+0000","last_unstale":"2023-11-26T07:18:44.322279+0000","last_undegraded":"2023-11-26T07:18:44.322279+0000","last_fullsized":"2023-11-26T07:18:44.322279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:54.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.785832+0000","last_change":"2023-11-26T07:18:44.348723+0000","last_active":"2023-11-26T07:18:45.785832+0000","last_peered":"2023-11-26T07:18:45.785832+0000","last_clean":"2023-11-26T07:18:45.785832+0000","last_became_active":"2023-11-26T07:18:44.348439+0000","last_became_peered":"2023-11-26T07:18:44.348439+0000","last_unstale":"2023-11-26T07:18:45.785832+0000","last_undegraded":"2023-11-26T07:18:45.785832+0000","last_fullsized":"2023-11-26T07:18:45.785832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:05:20.945115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.329481+0000","last_change":"2023-11-26T07:18:43.346277+0000","last_active":"2023-11-26T07:18:44.329481+0000","last_peered":"2023-11-26T07:18:44.329481+0000","last_clean":"2023-11-26T07:18:44.329481+0000","last_became_active":"2023-11-26T07:18:43.345926+0000","last_became_peered":"2023-11-26T07:18:43.345926+0000","last_unstale":"2023-11-26T07:18:44.329481+0000","last_undegraded":"2023-11-26T07:18:44.329481+0000","last_fullsized":"2023-11-26T07:18:44.329481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:32.125703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901426+0000","last_change":"2023-11-26T07:18:44.350379+0000","last_active":"2023-11-26T07:18:45.901426+0000","last_peered":"2023-11-26T07:18:45.901426+0000","last_clean":"2023-11-26T07:18:45.901426+0000","last_became_active":"2023-11-26T07:18:44.349766+0000","last_became_peered":"2023-11-26T07:18:44.349766+0000","last_unstale":"2023-11-26T07:18:45.901426+0000","last_undegraded":"2023-11-26T07:18:45.901426+0000","last_fullsized":"2023-11-26T07:18:45.901426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:41.246469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.325568+0000","last_change":"2023-11-26T07:18:43.343579+0000","last_active":"2023-11-26T07:18:44.325568+0000","last_peered":"2023-11-26T07:18:44.325568+0000","last_clean":"2023-11-26T07:18:44.325568+0000","last_became_active":"2023-11-26T07:18:43.342690+0000","last_became_peered":"2023-11-26T07:18:43.342690+0000","last_unstale":"2023-11-26T07:18:44.325568+0000","last_undegraded":"2023-11-26T07:18:44.325568+0000","last_fullsized":"2023-11-26T07:18:44.325568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:36.816501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373538+0000","last_change":"2023-11-26T07:18:44.343618+0000","last_active":"2023-11-26T07:18:46.373538+0000","last_peered":"2023-11-26T07:18:46.373538+0000","last_clean":"2023-11-26T07:18:46.373538+0000","last_became_active":"2023-11-26T07:18:44.343349+0000","last_became_peered":"2023-11-26T07:18:44.343349+0000","last_unstale":"2023-11-26T07:18:46.373538+0000","last_undegraded":"2023-11-26T07:18:46.373538+0000","last_fullsized":"2023-11-26T07:18:46.373538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:59:38.105390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.332109+0000","last_change":"2023-11-26T07:18:43.335203+0000","last_active":"2023-11-26T07:18:44.332109+0000","last_peered":"2023-11-26T07:18:44.332109+0000","last_clean":"2023-11-26T07:18:44.332109+0000","last_became_active":"2023-11-26T07:18:43.334385+0000","last_became_peered":"2023-11-26T07:18:43.334385+0000","last_unstale":"2023-11-26T07:18:44.332109+0000","last_undegraded":"2023-11-26T07:18:44.332109+0000","last_fullsized":"2023-11-26T07:18:44.332109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:49:53.547830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373700+0000","last_change":"2023-11-26T07:18:44.360237+0000","last_active":"2023-11-26T07:18:46.373700+0000","last_peered":"2023-11-26T07:18:46.373700+0000","last_clean":"2023-11-26T07:18:46.373700+0000","last_became_active":"2023-11-26T07:18:44.358745+0000","last_became_peered":"2023-11-26T07:18:44.358745+0000","last_unstale":"2023-11-26T07:18:46.373700+0000","last_undegraded":"2023-11-26T07:18:46.373700+0000","last_fullsized":"2023-11-26T07:18:46.373700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:40:48.404744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.346992+0000","last_change":"2023-11-26T07:18:43.345767+0000","last_active":"2023-11-26T07:18:44.346992+0000","last_peered":"2023-11-26T07:18:44.346992+0000","last_clean":"2023-11-26T07:18:44.346992+0000","last_became_active":"2023-11-26T07:18:43.343807+0000","last_became_peered":"2023-11-26T07:18:43.343807+0000","last_unstale":"2023-11-26T07:18:44.346992+0000","last_undegraded":"2023-11-26T07:18:44.346992+0000","last_fullsized":"2023-11-26T07:18:44.346992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:11.858583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900856+0000","last_change":"2023-11-26T07:18:44.345921+0000","last_active":"2023-11-26T07:18:45.900856+0000","last_peered":"2023-11-26T07:18:45.900856+0000","last_clean":"2023-11-26T07:18:45.900856+0000","last_became_active":"2023-11-26T07:18:44.345290+0000","last_became_peered":"2023-11-26T07:18:44.345290+0000","last_unstale":"2023-11-26T07:18:45.900856+0000","last_undegraded":"2023-11-26T07:18:45.900856+0000","last_fullsized":"2023-11-26T07:18:45.900856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:13.735281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.366767+0000","last_change":"2023-11-26T07:18:43.343890+0000","last_active":"2023-11-26T07:18:44.366767+0000","last_peered":"2023-11-26T07:18:44.366767+0000","last_clean":"2023-11-26T07:18:44.366767+0000","last_became_active":"2023-11-26T07:18:43.342335+0000","last_became_peered":"2023-11-26T07:18:43.342335+0000","last_unstale":"2023-11-26T07:18:44.366767+0000","last_undegraded":"2023-11-26T07:18:44.366767+0000","last_fullsized":"2023-11-26T07:18:44.366767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:12.720202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.785865+0000","last_change":"2023-11-26T07:18:44.346638+0000","last_active":"2023-11-26T07:18:45.785865+0000","last_peered":"2023-11-26T07:18:45.785865+0000","last_clean":"2023-11-26T07:18:45.785865+0000","last_became_active":"2023-11-26T07:18:44.346363+0000","last_became_peered":"2023-11-26T07:18:44.346363+0000","last_unstale":"2023-11-26T07:18:45.785865+0000","last_undegraded":"2023-11-26T07:18:45.785865+0000","last_fullsized":"2023-11-26T07:18:45.785865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:08:13.461671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.349343+0000","last_change":"2023-11-26T07:18:43.347490+0000","last_active":"2023-11-26T07:18:44.349343+0000","last_peered":"2023-11-26T07:18:44.349343+0000","last_clean":"2023-11-26T07:18:44.349343+0000","last_became_active":"2023-11-26T07:18:43.346319+0000","last_became_peered":"2023-11-26T07:18:43.346319+0000","last_unstale":"2023-11-26T07:18:44.349343+0000","last_undegraded":"2023-11-26T07:18:44.349343+0000","last_fullsized":"2023-11-26T07:18:44.349343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:02:56.133442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373022+0000","last_change":"2023-11-26T07:18:44.344230+0000","last_active":"2023-11-26T07:18:46.373022+0000","last_peered":"2023-11-26T07:18:46.373022+0000","last_clean":"2023-11-26T07:18:46.373022+0000","last_became_active":"2023-11-26T07:18:44.343846+0000","last_became_peered":"2023-11-26T07:18:44.343846+0000","last_unstale":"2023-11-26T07:18:46.373022+0000","last_undegraded":"2023-11-26T07:18:46.373022+0000","last_fullsized":"2023-11-26T07:18:46.373022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:41.246469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.338705+0000","last_change":"2023-11-26T07:18:43.348725+0000","last_active":"2023-11-26T07:18:44.338705+0000","last_peered":"2023-11-26T07:18:44.338705+0000","last_clean":"2023-11-26T07:18:44.338705+0000","last_became_active":"2023-11-26T07:18:43.348499+0000","last_became_peered":"2023-11-26T07:18:43.348499+0000","last_unstale":"2023-11-26T07:18:44.338705+0000","last_undegraded":"2023-11-26T07:18:44.338705+0000","last_fullsized":"2023-11-26T07:18:44.338705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:28.013033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350256+0000","last_change":"2023-11-26T07:18:44.358762+0000","last_active":"2023-11-26T07:18:45.350256+0000","last_peered":"2023-11-26T07:18:45.350256+0000","last_clean":"2023-11-26T07:18:45.350256+0000","last_became_active":"2023-11-26T07:18:44.357924+0000","last_became_peered":"2023-11-26T07:18:44.357924+0000","last_unstale":"2023-11-26T07:18:45.350256+0000","last_undegraded":"2023-11-26T07:18:45.350256+0000","last_fullsized":"2023-11-26T07:18:45.350256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:19:43.090724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322116+0000","last_change":"2023-11-26T07:18:43.339904+0000","last_active":"2023-11-26T07:18:44.322116+0000","last_peered":"2023-11-26T07:18:44.322116+0000","last_clean":"2023-11-26T07:18:44.322116+0000","last_became_active":"2023-11-26T07:18:43.339639+0000","last_became_peered":"2023-11-26T07:18:43.339639+0000","last_unstale":"2023-11-26T07:18:44.322116+0000","last_undegraded":"2023-11-26T07:18:44.322116+0000","last_fullsized":"2023-11-26T07:18:44.322116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:02.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348817+0000","last_change":"2023-11-26T07:18:44.350412+0000","last_active":"2023-11-26T07:18:45.348817+0000","last_peered":"2023-11-26T07:18:45.348817+0000","last_clean":"2023-11-26T07:18:45.348817+0000","last_became_active":"2023-11-26T07:18:44.350130+0000","last_became_peered":"2023-11-26T07:18:44.350130+0000","last_unstale":"2023-11-26T07:18:45.348817+0000","last_undegraded":"2023-11-26T07:18:45.348817+0000","last_fullsized":"2023-11-26T07:18:45.348817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.683350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.364952+0000","last_change":"2023-11-26T07:18:43.338129+0000","last_active":"2023-11-26T07:18:44.364952+0000","last_peered":"2023-11-26T07:18:44.364952+0000","last_clean":"2023-11-26T07:18:44.364952+0000","last_became_active":"2023-11-26T07:18:43.337667+0000","last_became_peered":"2023-11-26T07:18:43.337667+0000","last_unstale":"2023-11-26T07:18:44.364952+0000","last_undegraded":"2023-11-26T07:18:44.364952+0000","last_fullsized":"2023-11-26T07:18:44.364952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:10.673811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372168+0000","last_change":"2023-11-26T07:18:44.346692+0000","last_active":"2023-11-26T07:18:46.372168+0000","last_peered":"2023-11-26T07:18:46.372168+0000","last_clean":"2023-11-26T07:18:46.372168+0000","last_became_active":"2023-11-26T07:18:44.346408+0000","last_became_peered":"2023-11-26T07:18:44.346408+0000","last_unstale":"2023-11-26T07:18:46.372168+0000","last_undegraded":"2023-11-26T07:18:46.372168+0000","last_fullsized":"2023-11-26T07:18:46.372168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.683350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.356679+0000","last_change":"2023-11-26T07:18:43.339965+0000","last_active":"2023-11-26T07:18:44.356679+0000","last_peered":"2023-11-26T07:18:44.356679+0000","last_clean":"2023-11-26T07:18:44.356679+0000","last_became_active":"2023-11-26T07:18:43.339445+0000","last_became_peered":"2023-11-26T07:18:43.339445+0000","last_unstale":"2023-11-26T07:18:44.356679+0000","last_undegraded":"2023-11-26T07:18:44.356679+0000","last_fullsized":"2023-11-26T07:18:44.356679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:54.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901790+0000","last_change":"2023-11-26T07:18:44.347941+0000","last_active":"2023-11-26T07:18:45.901790+0000","last_peered":"2023-11-26T07:18:45.901790+0000","last_clean":"2023-11-26T07:18:45.901790+0000","last_became_active":"2023-11-26T07:18:44.347693+0000","last_became_peered":"2023-11-26T07:18:44.347693+0000","last_unstale":"2023-11-26T07:18:45.901790+0000","last_undegraded":"2023-11-26T07:18:45.901790+0000","last_fullsized":"2023-11-26T07:18:45.901790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:56:56.768970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.348086+0000","last_change":"2023-11-26T07:18:43.348471+0000","last_active":"2023-11-26T07:18:44.348086+0000","last_peered":"2023-11-26T07:18:44.348086+0000","last_clean":"2023-11-26T07:18:44.348086+0000","last_became_active":"2023-11-26T07:18:43.348219+0000","last_became_peered":"2023-11-26T07:18:43.348219+0000","last_unstale":"2023-11-26T07:18:44.348086+0000","last_undegraded":"2023-11-26T07:18:44.348086+0000","last_fullsized":"2023-11-26T07:18:44.348086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:08:55.413769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786232+0000","last_change":"2023-11-26T07:18:44.351436+0000","last_active":"2023-11-26T07:18:45.786232+0000","last_peered":"2023-11-26T07:18:45.786232+0000","last_clean":"2023-11-26T07:18:45.786232+0000","last_became_active":"2023-11-26T07:18:44.351008+0000","last_became_peered":"2023-11-26T07:18:44.351008+0000","last_unstale":"2023-11-26T07:18:45.786232+0000","last_undegraded":"2023-11-26T07:18:45.786232+0000","last_fullsized":"2023-11-26T07:18:45.786232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:19:43.090724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.357547+0000","last_change":"2023-11-26T07:18:43.342714+0000","last_active":"2023-11-26T07:18:44.357547+0000","last_peered":"2023-11-26T07:18:44.357547+0000","last_clean":"2023-11-26T07:18:44.357547+0000","last_became_active":"2023-11-26T07:18:43.342424+0000","last_became_peered":"2023-11-26T07:18:43.342424+0000","last_unstale":"2023-11-26T07:18:44.357547+0000","last_undegraded":"2023-11-26T07:18:44.357547+0000","last_fullsized":"2023-11-26T07:18:44.357547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:23.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372404+0000","last_change":"2023-11-26T07:18:44.347815+0000","last_active":"2023-11-26T07:18:46.372404+0000","last_peered":"2023-11-26T07:18:46.372404+0000","last_clean":"2023-11-26T07:18:46.372404+0000","last_became_active":"2023-11-26T07:18:44.347475+0000","last_became_peered":"2023-11-26T07:18:44.347475+0000","last_unstale":"2023-11-26T07:18:46.372404+0000","last_undegraded":"2023-11-26T07:18:46.372404+0000","last_fullsized":"2023-11-26T07:18:46.372404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:38.181856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.331765+0000","last_change":"2023-11-26T07:18:43.339730+0000","last_active":"2023-11-26T07:18:44.331765+0000","last_peered":"2023-11-26T07:18:44.331765+0000","last_clean":"2023-11-26T07:18:44.331765+0000","last_became_active":"2023-11-26T07:18:43.339369+0000","last_became_peered":"2023-11-26T07:18:43.339369+0000","last_unstale":"2023-11-26T07:18:44.331765+0000","last_undegraded":"2023-11-26T07:18:44.331765+0000","last_fullsized":"2023-11-26T07:18:44.331765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372497+0000","last_change":"2023-11-26T07:18:44.346798+0000","last_active":"2023-11-26T07:18:46.372497+0000","last_peered":"2023-11-26T07:18:46.372497+0000","last_clean":"2023-11-26T07:18:46.372497+0000","last_became_active":"2023-11-26T07:18:44.345650+0000","last_became_peered":"2023-11-26T07:18:44.345650+0000","last_unstale":"2023-11-26T07:18:46.372497+0000","last_undegraded":"2023-11-26T07:18:46.372497+0000","last_fullsized":"2023-11-26T07:18:46.372497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:17.762793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.345661+0000","last_change":"2023-11-26T07:18:43.342902+0000","last_active":"2023-11-26T07:18:44.345661+0000","last_peered":"2023-11-26T07:18:44.345661+0000","last_clean":"2023-11-26T07:18:44.345661+0000","last_became_active":"2023-11-26T07:18:43.342638+0000","last_became_peered":"2023-11-26T07:18:43.342638+0000","last_unstale":"2023-11-26T07:18:44.345661+0000","last_undegraded":"2023-11-26T07:18:44.345661+0000","last_fullsized":"2023-11-26T07:18:44.345661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:52:22.848752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372767+0000","last_change":"2023-11-26T07:18:44.344439+0000","last_active":"2023-11-26T07:18:46.372767+0000","last_peered":"2023-11-26T07:18:46.372767+0000","last_clean":"2023-11-26T07:18:46.372767+0000","last_became_active":"2023-11-26T07:18:44.344185+0000","last_became_peered":"2023-11-26T07:18:44.344185+0000","last_unstale":"2023-11-26T07:18:46.372767+0000","last_undegraded":"2023-11-26T07:18:46.372767+0000","last_fullsized":"2023-11-26T07:18:46.372767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:24.631508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.339268+0000","last_change":"2023-11-26T07:18:43.354310+0000","last_active":"2023-11-26T07:18:44.339268+0000","last_peered":"2023-11-26T07:18:44.339268+0000","last_clean":"2023-11-26T07:18:44.339268+0000","last_became_active":"2023-11-26T07:18:43.354030+0000","last_became_peered":"2023-11-26T07:18:43.354030+0000","last_unstale":"2023-11-26T07:18:44.339268+0000","last_undegraded":"2023-11-26T07:18:44.339268+0000","last_fullsized":"2023-11-26T07:18:44.339268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:02:56.133442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371405+0000","last_change":"2023-11-26T07:18:44.337125+0000","last_active":"2023-11-26T07:18:46.371405+0000","last_peered":"2023-11-26T07:18:46.371405+0000","last_clean":"2023-11-26T07:18:46.371405+0000","last_became_active":"2023-11-26T07:18:44.334701+0000","last_became_peered":"2023-11-26T07:18:44.334701+0000","last_unstale":"2023-11-26T07:18:46.371405+0000","last_undegraded":"2023-11-26T07:18:46.371405+0000","last_fullsized":"2023-11-26T07:18:46.371405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:28:31.442031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.331311+0000","last_change":"2023-11-26T07:18:43.347334+0000","last_active":"2023-11-26T07:18:44.331311+0000","last_peered":"2023-11-26T07:18:44.331311+0000","last_clean":"2023-11-26T07:18:44.331311+0000","last_became_active":"2023-11-26T07:18:43.346545+0000","last_became_peered":"2023-11-26T07:18:43.346545+0000","last_unstale":"2023-11-26T07:18:44.331311+0000","last_undegraded":"2023-11-26T07:18:44.331311+0000","last_fullsized":"2023-11-26T07:18:44.331311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:51.107572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350467+0000","last_change":"2023-11-26T07:18:44.348109+0000","last_active":"2023-11-26T07:18:45.350467+0000","last_peered":"2023-11-26T07:18:45.350467+0000","last_clean":"2023-11-26T07:18:45.350467+0000","last_became_active":"2023-11-26T07:18:44.347857+0000","last_became_peered":"2023-11-26T07:18:44.347857+0000","last_unstale":"2023-11-26T07:18:45.350467+0000","last_undegraded":"2023-11-26T07:18:45.350467+0000","last_fullsized":"2023-11-26T07:18:45.350467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:37.831580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322823+0000","last_change":"2023-11-26T07:18:43.343644+0000","last_active":"2023-11-26T07:18:44.322823+0000","last_peered":"2023-11-26T07:18:44.322823+0000","last_clean":"2023-11-26T07:18:44.322823+0000","last_became_active":"2023-11-26T07:18:43.343308+0000","last_became_peered":"2023-11-26T07:18:43.343308+0000","last_unstale":"2023-11-26T07:18:44.322823+0000","last_undegraded":"2023-11-26T07:18:44.322823+0000","last_fullsized":"2023-11-26T07:18:44.322823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:02.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372823+0000","last_change":"2023-11-26T07:18:44.336075+0000","last_active":"2023-11-26T07:18:46.372823+0000","last_peered":"2023-11-26T07:18:46.372823+0000","last_clean":"2023-11-26T07:18:46.372823+0000","last_became_active":"2023-11-26T07:18:44.335793+0000","last_became_peered":"2023-11-26T07:18:44.335793+0000","last_unstale":"2023-11-26T07:18:46.372823+0000","last_undegraded":"2023-11-26T07:18:46.372823+0000","last_fullsized":"2023-11-26T07:18:46.372823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:08:56.428847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.360250+0000","last_change":"2023-11-26T07:18:43.346545+0000","last_active":"2023-11-26T07:18:44.360250+0000","last_peered":"2023-11-26T07:18:44.360250+0000","last_clean":"2023-11-26T07:18:44.360250+0000","last_became_active":"2023-11-26T07:18:43.345559+0000","last_became_peered":"2023-11-26T07:18:43.345559+0000","last_unstale":"2023-11-26T07:18:44.360250+0000","last_undegraded":"2023-11-26T07:18:44.360250+0000","last_fullsized":"2023-11-26T07:18:44.360250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:10.673811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901733+0000","last_change":"2023-11-26T07:18:44.348188+0000","last_active":"2023-11-26T07:18:45.901733+0000","last_peered":"2023-11-26T07:18:45.901733+0000","last_clean":"2023-11-26T07:18:45.901733+0000","last_became_active":"2023-11-26T07:18:44.345395+0000","last_became_peered":"2023-11-26T07:18:44.345395+0000","last_unstale":"2023-11-26T07:18:45.901733+0000","last_undegraded":"2023-11-26T07:18:45.901733+0000","last_fullsized":"2023-11-26T07:18:45.901733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:16:33.094928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.331983+0000","last_change":"2023-11-26T07:18:43.344454+0000","last_active":"2023-11-26T07:18:44.331983+0000","last_peered":"2023-11-26T07:18:44.331983+0000","last_clean":"2023-11-26T07:18:44.331983+0000","last_became_active":"2023-11-26T07:18:43.344110+0000","last_became_peered":"2023-11-26T07:18:43.344110+0000","last_unstale":"2023-11-26T07:18:44.331983+0000","last_undegraded":"2023-11-26T07:18:44.331983+0000","last_fullsized":"2023-11-26T07:18:44.331983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.347484+0000","last_change":"2023-11-26T07:18:44.346321+0000","last_active":"2023-11-26T07:18:45.347484+0000","last_peered":"2023-11-26T07:18:45.347484+0000","last_clean":"2023-11-26T07:18:45.347484+0000","last_became_active":"2023-11-26T07:18:44.342883+0000","last_became_peered":"2023-11-26T07:18:44.342883+0000","last_unstale":"2023-11-26T07:18:45.347484+0000","last_undegraded":"2023-11-26T07:18:45.347484+0000","last_fullsized":"2023-11-26T07:18:45.347484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:47.571506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.341116+0000","last_change":"2023-11-26T07:18:43.345987+0000","last_active":"2023-11-26T07:18:44.341116+0000","last_peered":"2023-11-26T07:18:44.341116+0000","last_clean":"2023-11-26T07:18:44.341116+0000","last_became_active":"2023-11-26T07:18:43.345128+0000","last_became_peered":"2023-11-26T07:18:43.345128+0000","last_unstale":"2023-11-26T07:18:44.341116+0000","last_undegraded":"2023-11-26T07:18:44.341116+0000","last_fullsized":"2023-11-26T07:18:44.341116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:46.556428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348045+0000","last_change":"2023-11-26T07:18:44.350191+0000","last_active":"2023-11-26T07:18:45.348045+0000","last_peered":"2023-11-26T07:18:45.348045+0000","last_clean":"2023-11-26T07:18:45.348045+0000","last_became_active":"2023-11-26T07:18:44.349827+0000","last_became_peered":"2023-11-26T07:18:44.349827+0000","last_unstale":"2023-11-26T07:18:45.348045+0000","last_undegraded":"2023-11-26T07:18:45.348045+0000","last_fullsized":"2023-11-26T07:18:45.348045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:49:54.562908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.332950+0000","last_change":"2023-11-26T07:18:43.340479+0000","last_active":"2023-11-26T07:18:44.332950+0000","last_peered":"2023-11-26T07:18:44.332950+0000","last_clean":"2023-11-26T07:18:44.332950+0000","last_became_active":"2023-11-26T07:18:43.340189+0000","last_became_peered":"2023-11-26T07:18:43.340189+0000","last_unstale":"2023-11-26T07:18:44.332950+0000","last_undegraded":"2023-11-26T07:18:44.332950+0000","last_fullsized":"2023-11-26T07:18:44.332950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:50.411976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.347657+0000","last_change":"2023-11-26T07:18:44.349820+0000","last_active":"2023-11-26T07:18:45.347657+0000","last_peered":"2023-11-26T07:18:45.347657+0000","last_clean":"2023-11-26T07:18:45.347657+0000","last_became_active":"2023-11-26T07:18:44.349137+0000","last_became_peered":"2023-11-26T07:18:44.349137+0000","last_unstale":"2023-11-26T07:18:45.347657+0000","last_undegraded":"2023-11-26T07:18:45.347657+0000","last_fullsized":"2023-11-26T07:18:45.347657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:55.986599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.338837+0000","last_change":"2023-11-26T07:18:43.344767+0000","last_active":"2023-11-26T07:18:44.338837+0000","last_peered":"2023-11-26T07:18:44.338837+0000","last_clean":"2023-11-26T07:18:44.338837+0000","last_became_active":"2023-11-26T07:18:43.344485+0000","last_became_peered":"2023-11-26T07:18:43.344485+0000","last_unstale":"2023-11-26T07:18:44.338837+0000","last_undegraded":"2023-11-26T07:18:44.338837+0000","last_fullsized":"2023-11-26T07:18:44.338837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:02.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371584+0000","last_change":"2023-11-26T07:18:44.356457+0000","last_active":"2023-11-26T07:18:46.371584+0000","last_peered":"2023-11-26T07:18:46.371584+0000","last_clean":"2023-11-26T07:18:46.371584+0000","last_became_active":"2023-11-26T07:18:44.356141+0000","last_became_peered":"2023-11-26T07:18:44.356141+0000","last_unstale":"2023-11-26T07:18:46.371584+0000","last_undegraded":"2023-11-26T07:18:46.371584+0000","last_fullsized":"2023-11-26T07:18:46.371584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:27.677252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.332080+0000","last_change":"2023-11-26T07:18:43.347277+0000","last_active":"2023-11-26T07:18:44.332080+0000","last_peered":"2023-11-26T07:18:44.332080+0000","last_clean":"2023-11-26T07:18:44.332080+0000","last_became_active":"2023-11-26T07:18:43.346602+0000","last_became_peered":"2023-11-26T07:18:43.346602+0000","last_unstale":"2023-11-26T07:18:44.332080+0000","last_undegraded":"2023-11-26T07:18:44.332080+0000","last_fullsized":"2023-11-26T07:18:44.332080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371470+0000","last_change":"2023-11-26T07:18:44.356806+0000","last_active":"2023-11-26T07:18:46.371470+0000","last_peered":"2023-11-26T07:18:46.371470+0000","last_clean":"2023-11-26T07:18:46.371470+0000","last_became_active":"2023-11-26T07:18:44.356526+0000","last_became_peered":"2023-11-26T07:18:44.356526+0000","last_unstale":"2023-11-26T07:18:46.371470+0000","last_undegraded":"2023-11-26T07:18:46.371470+0000","last_fullsized":"2023-11-26T07:18:46.371470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:49:54.562908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322127+0000","last_change":"2023-11-26T07:18:43.339946+0000","last_active":"2023-11-26T07:18:44.322127+0000","last_peered":"2023-11-26T07:18:44.322127+0000","last_clean":"2023-11-26T07:18:44.322127+0000","last_became_active":"2023-11-26T07:18:43.339654+0000","last_became_peered":"2023-11-26T07:18:43.339654+0000","last_unstale":"2023-11-26T07:18:44.322127+0000","last_undegraded":"2023-11-26T07:18:44.322127+0000","last_fullsized":"2023-11-26T07:18:44.322127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:46.556428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351069+0000","last_change":"2023-11-26T07:18:44.350819+0000","last_active":"2023-11-26T07:18:45.351069+0000","last_peered":"2023-11-26T07:18:45.351069+0000","last_clean":"2023-11-26T07:18:45.351069+0000","last_became_active":"2023-11-26T07:18:44.350524+0000","last_became_peered":"2023-11-26T07:18:44.350524+0000","last_unstale":"2023-11-26T07:18:45.351069+0000","last_undegraded":"2023-11-26T07:18:45.351069+0000","last_fullsized":"2023-11-26T07:18:45.351069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:01.882223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.339446+0000","last_change":"2023-11-26T07:18:43.347243+0000","last_active":"2023-11-26T07:18:44.339446+0000","last_peered":"2023-11-26T07:18:44.339446+0000","last_clean":"2023-11-26T07:18:44.339446+0000","last_became_active":"2023-11-26T07:18:43.346909+0000","last_became_peered":"2023-11-26T07:18:43.346909+0000","last_unstale":"2023-11-26T07:18:44.339446+0000","last_undegraded":"2023-11-26T07:18:44.339446+0000","last_fullsized":"2023-11-26T07:18:44.339446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.338498+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:18:44.338498+0000","last_peered":"2023-11-26T07:18:44.338498+0000","last_clean":"2023-11-26T07:18:44.338498+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:18:44.338498+0000","last_undegraded":"2023-11-26T07:18:44.338498+0000","last_fullsized":"2023-11-26T07:18:44.338498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.169}]},{"osd":1,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.23},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.7509999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.087},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.4219999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.381},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.8149999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.8779999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.649},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":1.6699999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.708},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.98}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.169,"5min":3.169,"15min":3.169},"last":0.877}]},{"osd":1,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.996}]},{"osd":2,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.226},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":3.1110000000000002,"5min":3.1110000000000002,"15min":3.1110000000000002},"last":0.93700000000000006}]},{"osd":3,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.349}]},{"osd":4,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1719999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.466},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.0489999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.526}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.458},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.105}]},{"osd":1,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.361},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.86799999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.1950000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.034}]},{"osd":4,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.52},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.274}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.577},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.145}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.3280000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.036},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.4570000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.49},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.26}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.417}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.0820000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":1.5389999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"min":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.649}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.593},{"interface":"front","average":{"1min":1.726,"5min":1.726,"15min":1.726},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.6279999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":153533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.88700000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.038},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.98299999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.745},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":0.69499999999999995}]},{"osd":4,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":1.4590000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.28},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.0900000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":3.226,"5min":3.226,"15min":3.226},"last":1.3380000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.224},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":1.3999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":151969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.751},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.97099999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.85799999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.80000000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.1619999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.89500000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.92400000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.296},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.995}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":153533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.393}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.056},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.3},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.5960000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.7},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3460000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.5349999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.788},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.486}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.643},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.3500000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.9630000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":742267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.087}]},{"osd":2,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.4590000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.4039999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.579},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.78}]},{"osd":5,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.506},{"interface":"front","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.55}]},{"osd":6,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.8799999999999999,"5min":2.8799999999999999,"15min":2.8799999999999999},"last":1.139},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.992}]},{"osd":7,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.8959999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.6639999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:18:54.071 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:18:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.290+0000 7f51cdee0640 1 Processor -- start 2023-11-26T07:18:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.290+0000 7f51cdee0640 1 -- start start 2023-11-26T07:18:54.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51cdee0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51c80b2250 0x7f51c815df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51cdee0640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f51c80b2630 0x7f51c80ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51cdee0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51c80cd470 0x7f51c815b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51cdee0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c815a990 con 0x7f51c80cd470 2023-11-26T07:18:54.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51cdee0640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c815ab80 con 0x7f51c80b2630 2023-11-26T07:18:54.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51cdee0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c815e680 con 0x7f51c80b2250 2023-11-26T07:18:54.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51c7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51c80cd470 0x7f51c815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51c7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51c80cd470 0x7f51c815b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56332/0 (socket says 172.21.15.77:56332) 2023-11-26T07:18:54.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51c7fff640 1 -- 172.21.15.77:0/620517589 learned_addr learned my addr 172.21.15.77:0/620517589 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51bffff640 1 --2- 172.21.15.77:0/620517589 >> v2:172.21.15.159:3300/0 conn(0x7f51c80b2630 0x7f51c80ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51c7fff640 1 -- 172.21.15.77:0/620517589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51c80b2250 msgr2=0x7f51c815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.292+0000 7f51c77fe640 1 --2- 172.21.15.77:0/620517589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51c80b2250 0x7f51c815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.293+0000 7f51c7fff640 1 --2- 172.21.15.77:0/620517589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51c80b2250 0x7f51c815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.293+0000 7f51c7fff640 1 -- 172.21.15.77:0/620517589 >> v2:172.21.15.159:3300/0 conn(0x7f51c80b2630 msgr2=0x7f51c80ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.293+0000 7f51c7fff640 1 --2- 172.21.15.77:0/620517589 >> v2:172.21.15.159:3300/0 conn(0x7f51c80b2630 0x7f51c80ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.293+0000 7f51c7fff640 1 -- 172.21.15.77:0/620517589 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c815e960 con 0x7f51c80cd470 2023-11-26T07:18:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.293+0000 7f51c77fe640 1 --2- 172.21.15.77:0/620517589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51c80b2250 0x7f51c815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.294+0000 7f51c7fff640 1 --2- 172.21.15.77:0/620517589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80cd470 0x7f51c815b080 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f51c806b550 tx=0x7f51c002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9161af6f83052566 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.294+0000 7f51c6ffd640 1 -- 172.21.15.77:0/620517589 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c002ec80 con 0x7f51c80cd470 2023-11-26T07:18:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.294+0000 7f51c6ffd640 1 -- 172.21.15.77:0/620517589 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c002ede0 con 0x7f51c80cd470 2023-11-26T07:18:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.294+0000 7f51c6ffd640 1 -- 172.21.15.77:0/620517589 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0036610 con 0x7f51c80cd470 2023-11-26T07:18:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.295+0000 7f51cdee0640 1 -- 172.21.15.77:0/620517589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80cd470 msgr2=0x7f51c815b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.295+0000 7f51cdee0640 1 --2- 172.21.15.77:0/620517589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80cd470 0x7f51c815b080 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f51c806b550 tx=0x7f51c002e0e0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.295+0000 7f51cdee0640 1 -- 172.21.15.77:0/620517589 shutdown_connections 2023-11-26T07:18:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.295+0000 7f51cdee0640 1 --2- 172.21.15.77:0/620517589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80cd470 0x7f51c815b080 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.295+0000 7f51cdee0640 1 --2- 172.21.15.77:0/620517589 >> v2:172.21.15.159:3300/0 conn(0x7f51c80b2630 0x7f51c80ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.295+0000 7f51cdee0640 1 --2- 172.21.15.77:0/620517589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51c80b2250 0x7f51c815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.295+0000 7f51cdee0640 1 -- 172.21.15.77:0/620517589 >> 172.21.15.77:0/620517589 conn(0x7f51c806a920 msgr2=0x7f51c806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:54.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.295+0000 7f51cdee0640 1 -- 172.21.15.77:0/620517589 shutdown_connections 2023-11-26T07:18:54.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.295+0000 7f51cdee0640 1 -- 172.21.15.77:0/620517589 wait complete. 2023-11-26T07:18:54.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.296+0000 7f51cdee0640 1 Processor -- start 2023-11-26T07:18:54.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.297+0000 7f51cdee0640 1 -- start start 2023-11-26T07:18:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51cdee0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51c80b2250 0x7f51c8149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51cdee0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80b2630 0x7f51c80c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51cdee0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c80cd470 0x7f51c80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51cdee0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c814ace0 con 0x7f51c80b2630 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51cdee0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c809d190 con 0x7f51c80cd470 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51cdee0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80afc60 con 0x7f51c80b2250 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80b2630 0x7f51c80c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80b2630 0x7f51c80c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56348/0 (socket says 172.21.15.77:56348) 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51bffff640 1 -- 172.21.15.77:0/494776537 learned_addr learned my addr 172.21.15.77:0/494776537 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51bffff640 1 -- 172.21.15.77:0/494776537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51c80b2250 msgr2=0x7f51c8149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51bffff640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51c80b2250 0x7f51c8149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51bffff640 1 -- 172.21.15.77:0/494776537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c80cd470 msgr2=0x7f51c80c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51bffff640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c80cd470 0x7f51c80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.298+0000 7f51bffff640 1 -- 172.21.15.77:0/494776537 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c0009b30 con 0x7f51c80b2630 2023-11-26T07:18:54.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.299+0000 7f51bffff640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80b2630 0x7f51c80c93b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f51b000d800 tx=0x7f51b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:54.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.299+0000 7f51c4ff9640 1 -- 172.21.15.77:0/494776537 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000b6c0 con 0x7f51c80b2630 2023-11-26T07:18:54.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.299+0000 7f51c4ff9640 1 -- 172.21.15.77:0/494776537 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b000b820 con 0x7f51c80b2630 2023-11-26T07:18:54.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.299+0000 7f51cdee0640 1 -- 172.21.15.77:0/494776537 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c814a660 con 0x7f51c80b2630 2023-11-26T07:18:54.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.299+0000 7f51c4ff9640 1 -- 172.21.15.77:0/494776537 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000bbb0 con 0x7f51c80b2630 2023-11-26T07:18:54.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.299+0000 7f51cdee0640 1 -- 172.21.15.77:0/494776537 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c814a900 con 0x7f51c80b2630 2023-11-26T07:18:54.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.300+0000 7f51cdee0640 1 -- 172.21.15.77:0/494776537 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c8067470 con 0x7f51c80b2630 2023-11-26T07:18:54.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.301+0000 7f51c4ff9640 1 -- 172.21.15.77:0/494776537 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51b000bd10 con 0x7f51c80b2630 2023-11-26T07:18:54.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.302+0000 7f51c4ff9640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f51a806ae70 0x7f51a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.302+0000 7f51c4ff9640 1 -- 172.21.15.77:0/494776537 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51b0089b80 con 0x7f51c80b2630 2023-11-26T07:18:54.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.303+0000 7f51c77fe640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f51a806ae70 0x7f51a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.303+0000 7f51c77fe640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f51a806ae70 0x7f51a806d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f51b800a8b0 tx=0x7f51b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:54.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.307+0000 7f51c4ff9640 1 -- 172.21.15.77:0/494776537 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51b0054c20 con 0x7f51c80b2630 2023-11-26T07:18:54.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.495+0000 7f51cdee0640 1 -- 172.21.15.77:0/494776537 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51c80cea00 con 0x7f51a806ae70 2023-11-26T07:18:54.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.516+0000 7f51c4ff9640 1 -- 172.21.15.77:0/494776537 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286538 (secure 0 0 0) 0x7f51c80cea00 con 0x7f51a806ae70 2023-11-26T07:18:54.523 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:54.524 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:18:54.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.521+0000 7f51cdee0640 1 -- 172.21.15.77:0/494776537 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f51a806ae70 msgr2=0x7f51a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.521+0000 7f51cdee0640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f51a806ae70 0x7f51a806d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f51b800a8b0 tx=0x7f51b8008040 comp rx=0 tx=0).stop 2023-11-26T07:18:54.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.521+0000 7f51cdee0640 1 -- 172.21.15.77:0/494776537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80b2630 msgr2=0x7f51c80c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.521+0000 7f51cdee0640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80b2630 0x7f51c80c93b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f51b000d800 tx=0x7f51b000dcc0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.521+0000 7f51cdee0640 1 -- 172.21.15.77:0/494776537 shutdown_connections 2023-11-26T07:18:54.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.521+0000 7f51cdee0640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f51a806ae70 0x7f51a806d330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.521+0000 7f51cdee0640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c80cd470 0x7f51c80c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.522+0000 7f51cdee0640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80b2630 0x7f51c80c93b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.522+0000 7f51cdee0640 1 --2- 172.21.15.77:0/494776537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51c80b2250 0x7f51c8149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.522+0000 7f51cdee0640 1 -- 172.21.15.77:0/494776537 >> 172.21.15.77:0/494776537 conn(0x7f51c806a920 msgr2=0x7f51c8159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:54.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.522+0000 7f51cdee0640 1 -- 172.21.15.77:0/494776537 shutdown_connections 2023-11-26T07:18:54.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.522+0000 7f51cdee0640 1 -- 172.21.15.77:0/494776537 wait complete. 2023-11-26T07:18:54.543 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-11-26T07:18:53.627660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220400,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754320,"statfs":{"total":773094113280,"available":772868423680,"internally_reserved":0,"allocated":4333568,"data_stored":2400748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.310069"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348345+0000","last_change":"2023-11-26T07:18:44.347920+0000","last_active":"2023-11-26T07:18:45.348345+0000","last_peered":"2023-11-26T07:18:45.348345+0000","last_clean":"2023-11-26T07:18:45.348345+0000","last_became_active":"2023-11-26T07:18:44.347657+0000","last_became_peered":"2023-11-26T07:18:44.347657+0000","last_unstale":"2023-11-26T07:18:45.348345+0000","last_undegraded":"2023-11-26T07:18:45.348345+0000","last_fullsized":"2023-11-26T07:18:45.348345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:52:23.863830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373193+0000","last_change":"2023-11-26T07:18:44.345735+0000","last_active":"2023-11-26T07:18:46.373193+0000","last_peered":"2023-11-26T07:18:46.373193+0000","last_clean":"2023-11-26T07:18:46.373193+0000","last_became_active":"2023-11-26T07:18:44.345460+0000","last_became_peered":"2023-11-26T07:18:44.345460+0000","last_unstale":"2023-11-26T07:18:46.373193+0000","last_undegraded":"2023-11-26T07:18:46.373193+0000","last_fullsized":"2023-11-26T07:18:46.373193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:16:33.094928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901198+0000","last_change":"2023-11-26T07:18:44.346096+0000","last_active":"2023-11-26T07:18:45.901198+0000","last_peered":"2023-11-26T07:18:45.901198+0000","last_clean":"2023-11-26T07:18:45.901198+0000","last_became_active":"2023-11-26T07:18:44.345635+0000","last_became_peered":"2023-11-26T07:18:44.345635+0000","last_unstale":"2023-11-26T07:18:45.901198+0000","last_undegraded":"2023-11-26T07:18:45.901198+0000","last_fullsized":"2023-11-26T07:18:45.901198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:01.882223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786081+0000","last_change":"2023-11-26T07:18:44.351258+0000","last_active":"2023-11-26T07:18:45.786081+0000","last_peered":"2023-11-26T07:18:45.786081+0000","last_clean":"2023-11-26T07:18:45.786081+0000","last_became_active":"2023-11-26T07:18:44.350618+0000","last_became_peered":"2023-11-26T07:18:44.350618+0000","last_unstale":"2023-11-26T07:18:45.786081+0000","last_undegraded":"2023-11-26T07:18:45.786081+0000","last_fullsized":"2023-11-26T07:18:45.786081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:12.873661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371991+0000","last_change":"2023-11-26T07:18:44.347889+0000","last_active":"2023-11-26T07:18:46.371991+0000","last_peered":"2023-11-26T07:18:46.371991+0000","last_clean":"2023-11-26T07:18:46.371991+0000","last_became_active":"2023-11-26T07:18:44.347632+0000","last_became_peered":"2023-11-26T07:18:44.347632+0000","last_unstale":"2023-11-26T07:18:46.371991+0000","last_undegraded":"2023-11-26T07:18:46.371991+0000","last_fullsized":"2023-11-26T07:18:46.371991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:45:00.135951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372071+0000","last_change":"2023-11-26T07:18:44.332486+0000","last_active":"2023-11-26T07:18:46.372071+0000","last_peered":"2023-11-26T07:18:46.372071+0000","last_clean":"2023-11-26T07:18:46.372071+0000","last_became_active":"2023-11-26T07:18:44.332179+0000","last_became_peered":"2023-11-26T07:18:44.332179+0000","last_unstale":"2023-11-26T07:18:46.372071+0000","last_undegraded":"2023-11-26T07:18:46.372071+0000","last_fullsized":"2023-11-26T07:18:46.372071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:50:16.254065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351178+0000","last_change":"2023-11-26T07:18:44.352470+0000","last_active":"2023-11-26T07:18:45.351178+0000","last_peered":"2023-11-26T07:18:45.351178+0000","last_clean":"2023-11-26T07:18:45.351178+0000","last_became_active":"2023-11-26T07:18:44.352160+0000","last_became_peered":"2023-11-26T07:18:44.352160+0000","last_unstale":"2023-11-26T07:18:45.351178+0000","last_undegraded":"2023-11-26T07:18:45.351178+0000","last_fullsized":"2023-11-26T07:18:45.351178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:41.246469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350124+0000","last_change":"2023-11-26T07:18:44.351969+0000","last_active":"2023-11-26T07:18:45.350124+0000","last_peered":"2023-11-26T07:18:45.350124+0000","last_clean":"2023-11-26T07:18:45.350124+0000","last_became_active":"2023-11-26T07:18:44.351711+0000","last_became_peered":"2023-11-26T07:18:44.351711+0000","last_unstale":"2023-11-26T07:18:45.350124+0000","last_undegraded":"2023-11-26T07:18:45.350124+0000","last_fullsized":"2023-11-26T07:18:45.350124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:12.873661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372735+0000","last_change":"2023-11-26T07:18:44.345764+0000","last_active":"2023-11-26T07:18:46.372735+0000","last_peered":"2023-11-26T07:18:46.372735+0000","last_clean":"2023-11-26T07:18:46.372735+0000","last_became_active":"2023-11-26T07:18:44.345342+0000","last_became_peered":"2023-11-26T07:18:44.345342+0000","last_unstale":"2023-11-26T07:18:46.372735+0000","last_undegraded":"2023-11-26T07:18:46.372735+0000","last_fullsized":"2023-11-26T07:18:46.372735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:55.986599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786774+0000","last_change":"2023-11-26T07:18:44.356850+0000","last_active":"2023-11-26T07:18:45.786774+0000","last_peered":"2023-11-26T07:18:45.786774+0000","last_clean":"2023-11-26T07:18:45.786774+0000","last_became_active":"2023-11-26T07:18:44.356490+0000","last_became_peered":"2023-11-26T07:18:44.356490+0000","last_unstale":"2023-11-26T07:18:45.786774+0000","last_undegraded":"2023-11-26T07:18:45.786774+0000","last_fullsized":"2023-11-26T07:18:45.786774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:37.831580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351011+0000","last_change":"2023-11-26T07:18:44.350582+0000","last_active":"2023-11-26T07:18:45.351011+0000","last_peered":"2023-11-26T07:18:45.351011+0000","last_clean":"2023-11-26T07:18:45.351011+0000","last_became_active":"2023-11-26T07:18:44.350308+0000","last_became_peered":"2023-11-26T07:18:44.350308+0000","last_unstale":"2023-11-26T07:18:45.351011+0000","last_undegraded":"2023-11-26T07:18:45.351011+0000","last_fullsized":"2023-11-26T07:18:45.351011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:27.677252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900850+0000","last_change":"2023-11-26T07:18:44.349629+0000","last_active":"2023-11-26T07:18:45.900850+0000","last_peered":"2023-11-26T07:18:45.900850+0000","last_clean":"2023-11-26T07:18:45.900850+0000","last_became_active":"2023-11-26T07:18:44.349318+0000","last_became_peered":"2023-11-26T07:18:44.349318+0000","last_unstale":"2023-11-26T07:18:45.900850+0000","last_undegraded":"2023-11-26T07:18:45.900850+0000","last_fullsized":"2023-11-26T07:18:45.900850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:27.677252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372437+0000","last_change":"2023-11-26T07:18:44.342774+0000","last_active":"2023-11-26T07:18:46.372437+0000","last_peered":"2023-11-26T07:18:46.372437+0000","last_clean":"2023-11-26T07:18:46.372437+0000","last_became_active":"2023-11-26T07:18:44.342510+0000","last_became_peered":"2023-11-26T07:18:44.342510+0000","last_unstale":"2023-11-26T07:18:46.372437+0000","last_undegraded":"2023-11-26T07:18:46.372437+0000","last_fullsized":"2023-11-26T07:18:46.372437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:15:37.319625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372160+0000","last_change":"2023-11-26T07:18:44.334557+0000","last_active":"2023-11-26T07:18:46.372160+0000","last_peered":"2023-11-26T07:18:46.372160+0000","last_clean":"2023-11-26T07:18:46.372160+0000","last_became_active":"2023-11-26T07:18:44.333952+0000","last_became_peered":"2023-11-26T07:18:44.333952+0000","last_unstale":"2023-11-26T07:18:46.372160+0000","last_undegraded":"2023-11-26T07:18:46.372160+0000","last_fullsized":"2023-11-26T07:18:46.372160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:01.882223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900906+0000","last_change":"2023-11-26T07:18:44.348669+0000","last_active":"2023-11-26T07:18:45.900906+0000","last_peered":"2023-11-26T07:18:45.900906+0000","last_clean":"2023-11-26T07:18:45.900906+0000","last_became_active":"2023-11-26T07:18:44.347341+0000","last_became_peered":"2023-11-26T07:18:44.347341+0000","last_unstale":"2023-11-26T07:18:45.900906+0000","last_undegraded":"2023-11-26T07:18:45.900906+0000","last_fullsized":"2023-11-26T07:18:45.900906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:50:16.254065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350509+0000","last_change":"2023-11-26T07:18:44.361345+0000","last_active":"2023-11-26T07:18:45.350509+0000","last_peered":"2023-11-26T07:18:45.350509+0000","last_clean":"2023-11-26T07:18:45.350509+0000","last_became_active":"2023-11-26T07:18:44.361125+0000","last_became_peered":"2023-11-26T07:18:44.361125+0000","last_unstale":"2023-11-26T07:18:45.350509+0000","last_undegraded":"2023-11-26T07:18:45.350509+0000","last_fullsized":"2023-11-26T07:18:45.350509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:14.130743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351371+0000","last_change":"2023-11-26T07:18:44.353247+0000","last_active":"2023-11-26T07:18:45.351371+0000","last_peered":"2023-11-26T07:18:45.351371+0000","last_clean":"2023-11-26T07:18:45.351371+0000","last_became_active":"2023-11-26T07:18:44.350764+0000","last_became_peered":"2023-11-26T07:18:44.350764+0000","last_unstale":"2023-11-26T07:18:45.351371+0000","last_undegraded":"2023-11-26T07:18:45.351371+0000","last_fullsized":"2023-11-26T07:18:45.351371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:16:33.094928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373266+0000","last_change":"2023-11-26T07:18:44.344990+0000","last_active":"2023-11-26T07:18:46.373266+0000","last_peered":"2023-11-26T07:18:46.373266+0000","last_clean":"2023-11-26T07:18:46.373266+0000","last_became_active":"2023-11-26T07:18:44.343308+0000","last_became_peered":"2023-11-26T07:18:44.343308+0000","last_unstale":"2023-11-26T07:18:46.373266+0000","last_undegraded":"2023-11-26T07:18:46.373266+0000","last_fullsized":"2023-11-26T07:18:46.373266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:56:56.768970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373388+0000","last_change":"2023-11-26T07:18:44.343005+0000","last_active":"2023-11-26T07:18:46.373388+0000","last_peered":"2023-11-26T07:18:46.373388+0000","last_clean":"2023-11-26T07:18:46.373388+0000","last_became_active":"2023-11-26T07:18:44.342508+0000","last_became_peered":"2023-11-26T07:18:44.342508+0000","last_unstale":"2023-11-26T07:18:46.373388+0000","last_undegraded":"2023-11-26T07:18:46.373388+0000","last_fullsized":"2023-11-26T07:18:46.373388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:50:35.270986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371931+0000","last_change":"2023-11-26T07:18:44.332076+0000","last_active":"2023-11-26T07:18:46.371931+0000","last_peered":"2023-11-26T07:18:46.371931+0000","last_clean":"2023-11-26T07:18:46.371931+0000","last_became_active":"2023-11-26T07:18:44.331785+0000","last_became_peered":"2023-11-26T07:18:44.331785+0000","last_unstale":"2023-11-26T07:18:46.371931+0000","last_undegraded":"2023-11-26T07:18:46.371931+0000","last_fullsized":"2023-11-26T07:18:46.371931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:51:56.864305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371982+0000","last_change":"2023-11-26T07:18:44.345163+0000","last_active":"2023-11-26T07:18:46.371982+0000","last_peered":"2023-11-26T07:18:46.371982+0000","last_clean":"2023-11-26T07:18:46.371982+0000","last_became_active":"2023-11-26T07:18:44.343511+0000","last_became_peered":"2023-11-26T07:18:44.343511+0000","last_unstale":"2023-11-26T07:18:46.371982+0000","last_undegraded":"2023-11-26T07:18:46.371982+0000","last_fullsized":"2023-11-26T07:18:46.371982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:51.427055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372898+0000","last_change":"2023-11-26T07:18:44.356696+0000","last_active":"2023-11-26T07:18:46.372898+0000","last_peered":"2023-11-26T07:18:46.372898+0000","last_clean":"2023-11-26T07:18:46.372898+0000","last_became_active":"2023-11-26T07:18:44.355640+0000","last_became_peered":"2023-11-26T07:18:44.355640+0000","last_unstale":"2023-11-26T07:18:46.372898+0000","last_undegraded":"2023-11-26T07:18:46.372898+0000","last_fullsized":"2023-11-26T07:18:46.372898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:11.688889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.346987+0000","last_change":"2023-11-26T07:18:44.351026+0000","last_active":"2023-11-26T07:18:45.346987+0000","last_peered":"2023-11-26T07:18:45.346987+0000","last_clean":"2023-11-26T07:18:45.346987+0000","last_became_active":"2023-11-26T07:18:44.350754+0000","last_became_peered":"2023-11-26T07:18:44.350754+0000","last_unstale":"2023-11-26T07:18:45.346987+0000","last_undegraded":"2023-11-26T07:18:45.346987+0000","last_fullsized":"2023-11-26T07:18:45.346987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:29.028111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900492+0000","last_change":"2023-11-26T07:18:44.330185+0000","last_active":"2023-11-26T07:18:45.900492+0000","last_peered":"2023-11-26T07:18:45.900492+0000","last_clean":"2023-11-26T07:18:45.900492+0000","last_became_active":"2023-11-26T07:18:44.329868+0000","last_became_peered":"2023-11-26T07:18:44.329868+0000","last_unstale":"2023-11-26T07:18:45.900492+0000","last_undegraded":"2023-11-26T07:18:45.900492+0000","last_fullsized":"2023-11-26T07:18:45.900492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:37.831580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786816+0000","last_change":"2023-11-26T07:18:44.349792+0000","last_active":"2023-11-26T07:18:45.786816+0000","last_peered":"2023-11-26T07:18:45.786816+0000","last_clean":"2023-11-26T07:18:45.786816+0000","last_became_active":"2023-11-26T07:18:44.349517+0000","last_became_peered":"2023-11-26T07:18:44.349517+0000","last_unstale":"2023-11-26T07:18:45.786816+0000","last_undegraded":"2023-11-26T07:18:45.786816+0000","last_fullsized":"2023-11-26T07:18:45.786816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:14.130743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373549+0000","last_change":"2023-11-26T07:18:44.345147+0000","last_active":"2023-11-26T07:18:46.373549+0000","last_peered":"2023-11-26T07:18:46.373549+0000","last_clean":"2023-11-26T07:18:46.373549+0000","last_became_active":"2023-11-26T07:18:44.344700+0000","last_became_peered":"2023-11-26T07:18:44.344700+0000","last_unstale":"2023-11-26T07:18:46.373549+0000","last_undegraded":"2023-11-26T07:18:46.373549+0000","last_fullsized":"2023-11-26T07:18:46.373549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:53:07.562653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786696+0000","last_change":"2023-11-26T07:18:44.355462+0000","last_active":"2023-11-26T07:18:45.786696+0000","last_peered":"2023-11-26T07:18:45.786696+0000","last_clean":"2023-11-26T07:18:45.786696+0000","last_became_active":"2023-11-26T07:18:44.355184+0000","last_became_peered":"2023-11-26T07:18:44.355184+0000","last_unstale":"2023-11-26T07:18:45.786696+0000","last_undegraded":"2023-11-26T07:18:45.786696+0000","last_fullsized":"2023-11-26T07:18:45.786696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:42.805540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900890+0000","last_change":"2023-11-26T07:18:44.340207+0000","last_active":"2023-11-26T07:18:45.900890+0000","last_peered":"2023-11-26T07:18:45.900890+0000","last_clean":"2023-11-26T07:18:45.900890+0000","last_became_active":"2023-11-26T07:18:44.339921+0000","last_became_peered":"2023-11-26T07:18:44.339921+0000","last_unstale":"2023-11-26T07:18:45.900890+0000","last_undegraded":"2023-11-26T07:18:45.900890+0000","last_fullsized":"2023-11-26T07:18:45.900890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:14.130743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372032+0000","last_change":"2023-11-26T07:18:44.354377+0000","last_active":"2023-11-26T07:18:46.372032+0000","last_peered":"2023-11-26T07:18:46.372032+0000","last_clean":"2023-11-26T07:18:46.372032+0000","last_became_active":"2023-11-26T07:18:44.354120+0000","last_became_peered":"2023-11-26T07:18:44.354120+0000","last_unstale":"2023-11-26T07:18:46.372032+0000","last_undegraded":"2023-11-26T07:18:46.372032+0000","last_fullsized":"2023-11-26T07:18:46.372032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:29.028111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350936+0000","last_change":"2023-11-26T07:18:44.352615+0000","last_active":"2023-11-26T07:18:45.350936+0000","last_peered":"2023-11-26T07:18:45.350936+0000","last_clean":"2023-11-26T07:18:45.350936+0000","last_became_active":"2023-11-26T07:18:44.352294+0000","last_became_peered":"2023-11-26T07:18:44.352294+0000","last_unstale":"2023-11-26T07:18:45.350936+0000","last_undegraded":"2023-11-26T07:18:45.350936+0000","last_fullsized":"2023-11-26T07:18:45.350936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:13.735281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348709+0000","last_change":"2023-11-26T07:18:44.344168+0000","last_active":"2023-11-26T07:18:45.348709+0000","last_peered":"2023-11-26T07:18:45.348709+0000","last_clean":"2023-11-26T07:18:45.348709+0000","last_became_active":"2023-11-26T07:18:44.340360+0000","last_became_peered":"2023-11-26T07:18:44.340360+0000","last_unstale":"2023-11-26T07:18:45.348709+0000","last_undegraded":"2023-11-26T07:18:45.348709+0000","last_fullsized":"2023-11-26T07:18:45.348709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:51.427055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350272+0000","last_change":"2023-11-26T07:18:44.358261+0000","last_active":"2023-11-26T07:18:45.350272+0000","last_peered":"2023-11-26T07:18:45.350272+0000","last_clean":"2023-11-26T07:18:45.350272+0000","last_became_active":"2023-11-26T07:18:44.357918+0000","last_became_peered":"2023-11-26T07:18:44.357918+0000","last_unstale":"2023-11-26T07:18:45.350272+0000","last_undegraded":"2023-11-26T07:18:45.350272+0000","last_fullsized":"2023-11-26T07:18:45.350272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:42.805540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.347437+0000","last_change":"2023-11-26T07:18:44.350453+0000","last_active":"2023-11-26T07:18:45.347437+0000","last_peered":"2023-11-26T07:18:45.347437+0000","last_clean":"2023-11-26T07:18:45.347437+0000","last_became_active":"2023-11-26T07:18:44.350194+0000","last_became_peered":"2023-11-26T07:18:44.350194+0000","last_unstale":"2023-11-26T07:18:45.347437+0000","last_undegraded":"2023-11-26T07:18:45.347437+0000","last_fullsized":"2023-11-26T07:18:45.347437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.683350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.355706+0000","last_change":"2023-11-26T07:18:43.349331+0000","last_active":"2023-11-26T07:18:44.355706+0000","last_peered":"2023-11-26T07:18:44.355706+0000","last_clean":"2023-11-26T07:18:44.355706+0000","last_became_active":"2023-11-26T07:18:43.349011+0000","last_became_peered":"2023-11-26T07:18:43.349011+0000","last_unstale":"2023-11-26T07:18:44.355706+0000","last_undegraded":"2023-11-26T07:18:44.355706+0000","last_fullsized":"2023-11-26T07:18:44.355706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348743+0000","last_change":"2023-11-26T07:18:44.351596+0000","last_active":"2023-11-26T07:18:45.348743+0000","last_peered":"2023-11-26T07:18:45.348743+0000","last_clean":"2023-11-26T07:18:45.348743+0000","last_became_active":"2023-11-26T07:18:44.349802+0000","last_became_peered":"2023-11-26T07:18:44.349802+0000","last_unstale":"2023-11-26T07:18:45.348743+0000","last_undegraded":"2023-11-26T07:18:45.348743+0000","last_fullsized":"2023-11-26T07:18:45.348743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:29.028111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.350976+0000","last_change":"2023-11-26T07:18:43.340731+0000","last_active":"2023-11-26T07:18:44.350976+0000","last_peered":"2023-11-26T07:18:44.350976+0000","last_clean":"2023-11-26T07:18:44.350976+0000","last_became_active":"2023-11-26T07:18:43.340447+0000","last_became_peered":"2023-11-26T07:18:43.340447+0000","last_unstale":"2023-11-26T07:18:44.350976+0000","last_undegraded":"2023-11-26T07:18:44.350976+0000","last_fullsized":"2023-11-26T07:18:44.350976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372242+0000","last_change":"2023-11-26T07:18:44.365323+0000","last_active":"2023-11-26T07:18:46.372242+0000","last_peered":"2023-11-26T07:18:46.372242+0000","last_clean":"2023-11-26T07:18:46.372242+0000","last_became_active":"2023-11-26T07:18:44.365044+0000","last_became_peered":"2023-11-26T07:18:44.365044+0000","last_unstale":"2023-11-26T07:18:46.372242+0000","last_undegraded":"2023-11-26T07:18:46.372242+0000","last_fullsized":"2023-11-26T07:18:46.372242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:47.571506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.342889+0000","last_change":"2023-11-26T07:18:43.341518+0000","last_active":"2023-11-26T07:18:44.342889+0000","last_peered":"2023-11-26T07:18:44.342889+0000","last_clean":"2023-11-26T07:18:44.342889+0000","last_became_active":"2023-11-26T07:18:43.341219+0000","last_became_peered":"2023-11-26T07:18:43.341219+0000","last_unstale":"2023-11-26T07:18:44.342889+0000","last_undegraded":"2023-11-26T07:18:44.342889+0000","last_fullsized":"2023-11-26T07:18:44.342889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:11.858583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786915+0000","last_change":"2023-11-26T07:18:44.352705+0000","last_active":"2023-11-26T07:18:45.786915+0000","last_peered":"2023-11-26T07:18:45.786915+0000","last_clean":"2023-11-26T07:18:45.786915+0000","last_became_active":"2023-11-26T07:18:44.352394+0000","last_became_peered":"2023-11-26T07:18:44.352394+0000","last_unstale":"2023-11-26T07:18:45.786915+0000","last_undegraded":"2023-11-26T07:18:45.786915+0000","last_fullsized":"2023-11-26T07:18:45.786915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:13.735281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.360589+0000","last_change":"2023-11-26T07:18:43.343141+0000","last_active":"2023-11-26T07:18:44.360589+0000","last_peered":"2023-11-26T07:18:44.360589+0000","last_clean":"2023-11-26T07:18:44.360589+0000","last_became_active":"2023-11-26T07:18:43.342643+0000","last_became_peered":"2023-11-26T07:18:43.342643+0000","last_unstale":"2023-11-26T07:18:44.360589+0000","last_undegraded":"2023-11-26T07:18:44.360589+0000","last_fullsized":"2023-11-26T07:18:44.360589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:48:42.024700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351025+0000","last_change":"2023-11-26T07:18:44.355098+0000","last_active":"2023-11-26T07:18:45.351025+0000","last_peered":"2023-11-26T07:18:45.351025+0000","last_clean":"2023-11-26T07:18:45.351025+0000","last_became_active":"2023-11-26T07:18:44.354783+0000","last_became_peered":"2023-11-26T07:18:44.354783+0000","last_unstale":"2023-11-26T07:18:45.351025+0000","last_undegraded":"2023-11-26T07:18:45.351025+0000","last_fullsized":"2023-11-26T07:18:45.351025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:50:16.254065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.356431+0000","last_change":"2023-11-26T07:18:43.340696+0000","last_active":"2023-11-26T07:18:44.356431+0000","last_peered":"2023-11-26T07:18:44.356431+0000","last_clean":"2023-11-26T07:18:44.356431+0000","last_became_active":"2023-11-26T07:18:43.340412+0000","last_became_peered":"2023-11-26T07:18:43.340412+0000","last_unstale":"2023-11-26T07:18:44.356431+0000","last_undegraded":"2023-11-26T07:18:44.356431+0000","last_fullsized":"2023-11-26T07:18:44.356431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:15:36.304547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900779+0000","last_change":"2023-11-26T07:18:44.346028+0000","last_active":"2023-11-26T07:18:45.900779+0000","last_peered":"2023-11-26T07:18:45.900779+0000","last_clean":"2023-11-26T07:18:45.900779+0000","last_became_active":"2023-11-26T07:18:44.343992+0000","last_became_peered":"2023-11-26T07:18:44.343992+0000","last_unstale":"2023-11-26T07:18:45.900779+0000","last_undegraded":"2023-11-26T07:18:45.900779+0000","last_fullsized":"2023-11-26T07:18:45.900779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:42.805540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.356336+0000","last_change":"2023-11-26T07:18:43.340168+0000","last_active":"2023-11-26T07:18:44.356336+0000","last_peered":"2023-11-26T07:18:44.356336+0000","last_clean":"2023-11-26T07:18:44.356336+0000","last_became_active":"2023-11-26T07:18:43.339836+0000","last_became_peered":"2023-11-26T07:18:43.339836+0000","last_unstale":"2023-11-26T07:18:44.356336+0000","last_undegraded":"2023-11-26T07:18:44.356336+0000","last_fullsized":"2023-11-26T07:18:44.356336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:37.166777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371747+0000","last_change":"2023-11-26T07:18:44.342135+0000","last_active":"2023-11-26T07:18:46.371747+0000","last_peered":"2023-11-26T07:18:46.371747+0000","last_clean":"2023-11-26T07:18:46.371747+0000","last_became_active":"2023-11-26T07:18:44.341837+0000","last_became_peered":"2023-11-26T07:18:44.341837+0000","last_unstale":"2023-11-26T07:18:46.371747+0000","last_undegraded":"2023-11-26T07:18:46.371747+0000","last_fullsized":"2023-11-26T07:18:46.371747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:52:23.863830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322279+0000","last_change":"2023-11-26T07:18:43.326829+0000","last_active":"2023-11-26T07:18:44.322279+0000","last_peered":"2023-11-26T07:18:44.322279+0000","last_clean":"2023-11-26T07:18:44.322279+0000","last_became_active":"2023-11-26T07:18:43.326359+0000","last_became_peered":"2023-11-26T07:18:43.326359+0000","last_unstale":"2023-11-26T07:18:44.322279+0000","last_undegraded":"2023-11-26T07:18:44.322279+0000","last_fullsized":"2023-11-26T07:18:44.322279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:54.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.785832+0000","last_change":"2023-11-26T07:18:44.348723+0000","last_active":"2023-11-26T07:18:45.785832+0000","last_peered":"2023-11-26T07:18:45.785832+0000","last_clean":"2023-11-26T07:18:45.785832+0000","last_became_active":"2023-11-26T07:18:44.348439+0000","last_became_peered":"2023-11-26T07:18:44.348439+0000","last_unstale":"2023-11-26T07:18:45.785832+0000","last_undegraded":"2023-11-26T07:18:45.785832+0000","last_fullsized":"2023-11-26T07:18:45.785832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:05:20.945115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.329481+0000","last_change":"2023-11-26T07:18:43.346277+0000","last_active":"2023-11-26T07:18:44.329481+0000","last_peered":"2023-11-26T07:18:44.329481+0000","last_clean":"2023-11-26T07:18:44.329481+0000","last_became_active":"2023-11-26T07:18:43.345926+0000","last_became_peered":"2023-11-26T07:18:43.345926+0000","last_unstale":"2023-11-26T07:18:44.329481+0000","last_undegraded":"2023-11-26T07:18:44.329481+0000","last_fullsized":"2023-11-26T07:18:44.329481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:32.125703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901426+0000","last_change":"2023-11-26T07:18:44.350379+0000","last_active":"2023-11-26T07:18:45.901426+0000","last_peered":"2023-11-26T07:18:45.901426+0000","last_clean":"2023-11-26T07:18:45.901426+0000","last_became_active":"2023-11-26T07:18:44.349766+0000","last_became_peered":"2023-11-26T07:18:44.349766+0000","last_unstale":"2023-11-26T07:18:45.901426+0000","last_undegraded":"2023-11-26T07:18:45.901426+0000","last_fullsized":"2023-11-26T07:18:45.901426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:41.246469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.325568+0000","last_change":"2023-11-26T07:18:43.343579+0000","last_active":"2023-11-26T07:18:44.325568+0000","last_peered":"2023-11-26T07:18:44.325568+0000","last_clean":"2023-11-26T07:18:44.325568+0000","last_became_active":"2023-11-26T07:18:43.342690+0000","last_became_peered":"2023-11-26T07:18:43.342690+0000","last_unstale":"2023-11-26T07:18:44.325568+0000","last_undegraded":"2023-11-26T07:18:44.325568+0000","last_fullsized":"2023-11-26T07:18:44.325568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:36.816501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373538+0000","last_change":"2023-11-26T07:18:44.343618+0000","last_active":"2023-11-26T07:18:46.373538+0000","last_peered":"2023-11-26T07:18:46.373538+0000","last_clean":"2023-11-26T07:18:46.373538+0000","last_became_active":"2023-11-26T07:18:44.343349+0000","last_became_peered":"2023-11-26T07:18:44.343349+0000","last_unstale":"2023-11-26T07:18:46.373538+0000","last_undegraded":"2023-11-26T07:18:46.373538+0000","last_fullsized":"2023-11-26T07:18:46.373538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:59:38.105390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.332109+0000","last_change":"2023-11-26T07:18:43.335203+0000","last_active":"2023-11-26T07:18:44.332109+0000","last_peered":"2023-11-26T07:18:44.332109+0000","last_clean":"2023-11-26T07:18:44.332109+0000","last_became_active":"2023-11-26T07:18:43.334385+0000","last_became_peered":"2023-11-26T07:18:43.334385+0000","last_unstale":"2023-11-26T07:18:44.332109+0000","last_undegraded":"2023-11-26T07:18:44.332109+0000","last_fullsized":"2023-11-26T07:18:44.332109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:49:53.547830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373700+0000","last_change":"2023-11-26T07:18:44.360237+0000","last_active":"2023-11-26T07:18:46.373700+0000","last_peered":"2023-11-26T07:18:46.373700+0000","last_clean":"2023-11-26T07:18:46.373700+0000","last_became_active":"2023-11-26T07:18:44.358745+0000","last_became_peered":"2023-11-26T07:18:44.358745+0000","last_unstale":"2023-11-26T07:18:46.373700+0000","last_undegraded":"2023-11-26T07:18:46.373700+0000","last_fullsized":"2023-11-26T07:18:46.373700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:40:48.404744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.346992+0000","last_change":"2023-11-26T07:18:43.345767+0000","last_active":"2023-11-26T07:18:44.346992+0000","last_peered":"2023-11-26T07:18:44.346992+0000","last_clean":"2023-11-26T07:18:44.346992+0000","last_became_active":"2023-11-26T07:18:43.343807+0000","last_became_peered":"2023-11-26T07:18:43.343807+0000","last_unstale":"2023-11-26T07:18:44.346992+0000","last_undegraded":"2023-11-26T07:18:44.346992+0000","last_fullsized":"2023-11-26T07:18:44.346992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:37:11.858583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.900856+0000","last_change":"2023-11-26T07:18:44.345921+0000","last_active":"2023-11-26T07:18:45.900856+0000","last_peered":"2023-11-26T07:18:45.900856+0000","last_clean":"2023-11-26T07:18:45.900856+0000","last_became_active":"2023-11-26T07:18:44.345290+0000","last_became_peered":"2023-11-26T07:18:44.345290+0000","last_unstale":"2023-11-26T07:18:45.900856+0000","last_undegraded":"2023-11-26T07:18:45.900856+0000","last_fullsized":"2023-11-26T07:18:45.900856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:13.735281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.366767+0000","last_change":"2023-11-26T07:18:43.343890+0000","last_active":"2023-11-26T07:18:44.366767+0000","last_peered":"2023-11-26T07:18:44.366767+0000","last_clean":"2023-11-26T07:18:44.366767+0000","last_became_active":"2023-11-26T07:18:43.342335+0000","last_became_peered":"2023-11-26T07:18:43.342335+0000","last_unstale":"2023-11-26T07:18:44.366767+0000","last_undegraded":"2023-11-26T07:18:44.366767+0000","last_fullsized":"2023-11-26T07:18:44.366767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:36:12.720202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.785865+0000","last_change":"2023-11-26T07:18:44.346638+0000","last_active":"2023-11-26T07:18:45.785865+0000","last_peered":"2023-11-26T07:18:45.785865+0000","last_clean":"2023-11-26T07:18:45.785865+0000","last_became_active":"2023-11-26T07:18:44.346363+0000","last_became_peered":"2023-11-26T07:18:44.346363+0000","last_unstale":"2023-11-26T07:18:45.785865+0000","last_undegraded":"2023-11-26T07:18:45.785865+0000","last_fullsized":"2023-11-26T07:18:45.785865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:08:13.461671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.349343+0000","last_change":"2023-11-26T07:18:43.347490+0000","last_active":"2023-11-26T07:18:44.349343+0000","last_peered":"2023-11-26T07:18:44.349343+0000","last_clean":"2023-11-26T07:18:44.349343+0000","last_became_active":"2023-11-26T07:18:43.346319+0000","last_became_peered":"2023-11-26T07:18:43.346319+0000","last_unstale":"2023-11-26T07:18:44.349343+0000","last_undegraded":"2023-11-26T07:18:44.349343+0000","last_fullsized":"2023-11-26T07:18:44.349343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:02:56.133442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.373022+0000","last_change":"2023-11-26T07:18:44.344230+0000","last_active":"2023-11-26T07:18:46.373022+0000","last_peered":"2023-11-26T07:18:46.373022+0000","last_clean":"2023-11-26T07:18:46.373022+0000","last_became_active":"2023-11-26T07:18:44.343846+0000","last_became_peered":"2023-11-26T07:18:44.343846+0000","last_unstale":"2023-11-26T07:18:46.373022+0000","last_undegraded":"2023-11-26T07:18:46.373022+0000","last_fullsized":"2023-11-26T07:18:46.373022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:41.246469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.338705+0000","last_change":"2023-11-26T07:18:43.348725+0000","last_active":"2023-11-26T07:18:44.338705+0000","last_peered":"2023-11-26T07:18:44.338705+0000","last_clean":"2023-11-26T07:18:44.338705+0000","last_became_active":"2023-11-26T07:18:43.348499+0000","last_became_peered":"2023-11-26T07:18:43.348499+0000","last_unstale":"2023-11-26T07:18:44.338705+0000","last_undegraded":"2023-11-26T07:18:44.338705+0000","last_fullsized":"2023-11-26T07:18:44.338705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:28.013033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350256+0000","last_change":"2023-11-26T07:18:44.358762+0000","last_active":"2023-11-26T07:18:45.350256+0000","last_peered":"2023-11-26T07:18:45.350256+0000","last_clean":"2023-11-26T07:18:45.350256+0000","last_became_active":"2023-11-26T07:18:44.357924+0000","last_became_peered":"2023-11-26T07:18:44.357924+0000","last_unstale":"2023-11-26T07:18:45.350256+0000","last_undegraded":"2023-11-26T07:18:45.350256+0000","last_fullsized":"2023-11-26T07:18:45.350256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:19:43.090724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322116+0000","last_change":"2023-11-26T07:18:43.339904+0000","last_active":"2023-11-26T07:18:44.322116+0000","last_peered":"2023-11-26T07:18:44.322116+0000","last_clean":"2023-11-26T07:18:44.322116+0000","last_became_active":"2023-11-26T07:18:43.339639+0000","last_became_peered":"2023-11-26T07:18:43.339639+0000","last_unstale":"2023-11-26T07:18:44.322116+0000","last_undegraded":"2023-11-26T07:18:44.322116+0000","last_fullsized":"2023-11-26T07:18:44.322116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:02.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348817+0000","last_change":"2023-11-26T07:18:44.350412+0000","last_active":"2023-11-26T07:18:45.348817+0000","last_peered":"2023-11-26T07:18:45.348817+0000","last_clean":"2023-11-26T07:18:45.348817+0000","last_became_active":"2023-11-26T07:18:44.350130+0000","last_became_peered":"2023-11-26T07:18:44.350130+0000","last_unstale":"2023-11-26T07:18:45.348817+0000","last_undegraded":"2023-11-26T07:18:45.348817+0000","last_fullsized":"2023-11-26T07:18:45.348817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.683350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.364952+0000","last_change":"2023-11-26T07:18:43.338129+0000","last_active":"2023-11-26T07:18:44.364952+0000","last_peered":"2023-11-26T07:18:44.364952+0000","last_clean":"2023-11-26T07:18:44.364952+0000","last_became_active":"2023-11-26T07:18:43.337667+0000","last_became_peered":"2023-11-26T07:18:43.337667+0000","last_unstale":"2023-11-26T07:18:44.364952+0000","last_undegraded":"2023-11-26T07:18:44.364952+0000","last_fullsized":"2023-11-26T07:18:44.364952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:10.673811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372168+0000","last_change":"2023-11-26T07:18:44.346692+0000","last_active":"2023-11-26T07:18:46.372168+0000","last_peered":"2023-11-26T07:18:46.372168+0000","last_clean":"2023-11-26T07:18:46.372168+0000","last_became_active":"2023-11-26T07:18:44.346408+0000","last_became_peered":"2023-11-26T07:18:44.346408+0000","last_unstale":"2023-11-26T07:18:46.372168+0000","last_undegraded":"2023-11-26T07:18:46.372168+0000","last_fullsized":"2023-11-26T07:18:46.372168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.683350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.356679+0000","last_change":"2023-11-26T07:18:43.339965+0000","last_active":"2023-11-26T07:18:44.356679+0000","last_peered":"2023-11-26T07:18:44.356679+0000","last_clean":"2023-11-26T07:18:44.356679+0000","last_became_active":"2023-11-26T07:18:43.339445+0000","last_became_peered":"2023-11-26T07:18:43.339445+0000","last_unstale":"2023-11-26T07:18:44.356679+0000","last_undegraded":"2023-11-26T07:18:44.356679+0000","last_fullsized":"2023-11-26T07:18:44.356679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:54.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901790+0000","last_change":"2023-11-26T07:18:44.347941+0000","last_active":"2023-11-26T07:18:45.901790+0000","last_peered":"2023-11-26T07:18:45.901790+0000","last_clean":"2023-11-26T07:18:45.901790+0000","last_became_active":"2023-11-26T07:18:44.347693+0000","last_became_peered":"2023-11-26T07:18:44.347693+0000","last_unstale":"2023-11-26T07:18:45.901790+0000","last_undegraded":"2023-11-26T07:18:45.901790+0000","last_fullsized":"2023-11-26T07:18:45.901790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:56:56.768970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.348086+0000","last_change":"2023-11-26T07:18:43.348471+0000","last_active":"2023-11-26T07:18:44.348086+0000","last_peered":"2023-11-26T07:18:44.348086+0000","last_clean":"2023-11-26T07:18:44.348086+0000","last_became_active":"2023-11-26T07:18:43.348219+0000","last_became_peered":"2023-11-26T07:18:43.348219+0000","last_unstale":"2023-11-26T07:18:44.348086+0000","last_undegraded":"2023-11-26T07:18:44.348086+0000","last_fullsized":"2023-11-26T07:18:44.348086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:08:55.413769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.786232+0000","last_change":"2023-11-26T07:18:44.351436+0000","last_active":"2023-11-26T07:18:45.786232+0000","last_peered":"2023-11-26T07:18:45.786232+0000","last_clean":"2023-11-26T07:18:45.786232+0000","last_became_active":"2023-11-26T07:18:44.351008+0000","last_became_peered":"2023-11-26T07:18:44.351008+0000","last_unstale":"2023-11-26T07:18:45.786232+0000","last_undegraded":"2023-11-26T07:18:45.786232+0000","last_fullsized":"2023-11-26T07:18:45.786232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:19:43.090724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.357547+0000","last_change":"2023-11-26T07:18:43.342714+0000","last_active":"2023-11-26T07:18:44.357547+0000","last_peered":"2023-11-26T07:18:44.357547+0000","last_clean":"2023-11-26T07:18:44.357547+0000","last_became_active":"2023-11-26T07:18:43.342424+0000","last_became_peered":"2023-11-26T07:18:43.342424+0000","last_unstale":"2023-11-26T07:18:44.357547+0000","last_undegraded":"2023-11-26T07:18:44.357547+0000","last_fullsized":"2023-11-26T07:18:44.357547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:23.616430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372404+0000","last_change":"2023-11-26T07:18:44.347815+0000","last_active":"2023-11-26T07:18:46.372404+0000","last_peered":"2023-11-26T07:18:46.372404+0000","last_clean":"2023-11-26T07:18:46.372404+0000","last_became_active":"2023-11-26T07:18:44.347475+0000","last_became_peered":"2023-11-26T07:18:44.347475+0000","last_unstale":"2023-11-26T07:18:46.372404+0000","last_undegraded":"2023-11-26T07:18:46.372404+0000","last_fullsized":"2023-11-26T07:18:46.372404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:29:38.181856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.331765+0000","last_change":"2023-11-26T07:18:43.339730+0000","last_active":"2023-11-26T07:18:44.331765+0000","last_peered":"2023-11-26T07:18:44.331765+0000","last_clean":"2023-11-26T07:18:44.331765+0000","last_became_active":"2023-11-26T07:18:43.339369+0000","last_became_peered":"2023-11-26T07:18:43.339369+0000","last_unstale":"2023-11-26T07:18:44.331765+0000","last_undegraded":"2023-11-26T07:18:44.331765+0000","last_fullsized":"2023-11-26T07:18:44.331765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:18:12.399058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372497+0000","last_change":"2023-11-26T07:18:44.346798+0000","last_active":"2023-11-26T07:18:46.372497+0000","last_peered":"2023-11-26T07:18:46.372497+0000","last_clean":"2023-11-26T07:18:46.372497+0000","last_became_active":"2023-11-26T07:18:44.345650+0000","last_became_peered":"2023-11-26T07:18:44.345650+0000","last_unstale":"2023-11-26T07:18:46.372497+0000","last_undegraded":"2023-11-26T07:18:46.372497+0000","last_fullsized":"2023-11-26T07:18:46.372497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:17.762793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.345661+0000","last_change":"2023-11-26T07:18:43.342902+0000","last_active":"2023-11-26T07:18:44.345661+0000","last_peered":"2023-11-26T07:18:44.345661+0000","last_clean":"2023-11-26T07:18:44.345661+0000","last_became_active":"2023-11-26T07:18:43.342638+0000","last_became_peered":"2023-11-26T07:18:43.342638+0000","last_unstale":"2023-11-26T07:18:44.345661+0000","last_undegraded":"2023-11-26T07:18:44.345661+0000","last_fullsized":"2023-11-26T07:18:44.345661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:52:22.848752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372767+0000","last_change":"2023-11-26T07:18:44.344439+0000","last_active":"2023-11-26T07:18:46.372767+0000","last_peered":"2023-11-26T07:18:46.372767+0000","last_clean":"2023-11-26T07:18:46.372767+0000","last_became_active":"2023-11-26T07:18:44.344185+0000","last_became_peered":"2023-11-26T07:18:44.344185+0000","last_unstale":"2023-11-26T07:18:46.372767+0000","last_undegraded":"2023-11-26T07:18:46.372767+0000","last_fullsized":"2023-11-26T07:18:46.372767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:24.631508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.339268+0000","last_change":"2023-11-26T07:18:43.354310+0000","last_active":"2023-11-26T07:18:44.339268+0000","last_peered":"2023-11-26T07:18:44.339268+0000","last_clean":"2023-11-26T07:18:44.339268+0000","last_became_active":"2023-11-26T07:18:43.354030+0000","last_became_peered":"2023-11-26T07:18:43.354030+0000","last_unstale":"2023-11-26T07:18:44.339268+0000","last_undegraded":"2023-11-26T07:18:44.339268+0000","last_fullsized":"2023-11-26T07:18:44.339268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:02:56.133442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371405+0000","last_change":"2023-11-26T07:18:44.337125+0000","last_active":"2023-11-26T07:18:46.371405+0000","last_peered":"2023-11-26T07:18:46.371405+0000","last_clean":"2023-11-26T07:18:46.371405+0000","last_became_active":"2023-11-26T07:18:44.334701+0000","last_became_peered":"2023-11-26T07:18:44.334701+0000","last_unstale":"2023-11-26T07:18:46.371405+0000","last_undegraded":"2023-11-26T07:18:46.371405+0000","last_fullsized":"2023-11-26T07:18:46.371405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:28:31.442031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.331311+0000","last_change":"2023-11-26T07:18:43.347334+0000","last_active":"2023-11-26T07:18:44.331311+0000","last_peered":"2023-11-26T07:18:44.331311+0000","last_clean":"2023-11-26T07:18:44.331311+0000","last_became_active":"2023-11-26T07:18:43.346545+0000","last_became_peered":"2023-11-26T07:18:43.346545+0000","last_unstale":"2023-11-26T07:18:44.331311+0000","last_undegraded":"2023-11-26T07:18:44.331311+0000","last_fullsized":"2023-11-26T07:18:44.331311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:51.107572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.350467+0000","last_change":"2023-11-26T07:18:44.348109+0000","last_active":"2023-11-26T07:18:45.350467+0000","last_peered":"2023-11-26T07:18:45.350467+0000","last_clean":"2023-11-26T07:18:45.350467+0000","last_became_active":"2023-11-26T07:18:44.347857+0000","last_became_peered":"2023-11-26T07:18:44.347857+0000","last_unstale":"2023-11-26T07:18:45.350467+0000","last_undegraded":"2023-11-26T07:18:45.350467+0000","last_fullsized":"2023-11-26T07:18:45.350467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:37.831580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322823+0000","last_change":"2023-11-26T07:18:43.343644+0000","last_active":"2023-11-26T07:18:44.322823+0000","last_peered":"2023-11-26T07:18:44.322823+0000","last_clean":"2023-11-26T07:18:44.322823+0000","last_became_active":"2023-11-26T07:18:43.343308+0000","last_became_peered":"2023-11-26T07:18:43.343308+0000","last_unstale":"2023-11-26T07:18:44.322823+0000","last_undegraded":"2023-11-26T07:18:44.322823+0000","last_fullsized":"2023-11-26T07:18:44.322823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:02.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.372823+0000","last_change":"2023-11-26T07:18:44.336075+0000","last_active":"2023-11-26T07:18:46.372823+0000","last_peered":"2023-11-26T07:18:46.372823+0000","last_clean":"2023-11-26T07:18:46.372823+0000","last_became_active":"2023-11-26T07:18:44.335793+0000","last_became_peered":"2023-11-26T07:18:44.335793+0000","last_unstale":"2023-11-26T07:18:46.372823+0000","last_undegraded":"2023-11-26T07:18:46.372823+0000","last_fullsized":"2023-11-26T07:18:46.372823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:08:56.428847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.360250+0000","last_change":"2023-11-26T07:18:43.346545+0000","last_active":"2023-11-26T07:18:44.360250+0000","last_peered":"2023-11-26T07:18:44.360250+0000","last_clean":"2023-11-26T07:18:44.360250+0000","last_became_active":"2023-11-26T07:18:43.345559+0000","last_became_peered":"2023-11-26T07:18:43.345559+0000","last_unstale":"2023-11-26T07:18:44.360250+0000","last_undegraded":"2023-11-26T07:18:44.360250+0000","last_fullsized":"2023-11-26T07:18:44.360250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:10.673811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.901733+0000","last_change":"2023-11-26T07:18:44.348188+0000","last_active":"2023-11-26T07:18:45.901733+0000","last_peered":"2023-11-26T07:18:45.901733+0000","last_clean":"2023-11-26T07:18:45.901733+0000","last_became_active":"2023-11-26T07:18:44.345395+0000","last_became_peered":"2023-11-26T07:18:44.345395+0000","last_unstale":"2023-11-26T07:18:45.901733+0000","last_undegraded":"2023-11-26T07:18:45.901733+0000","last_fullsized":"2023-11-26T07:18:45.901733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:16:33.094928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.331983+0000","last_change":"2023-11-26T07:18:43.344454+0000","last_active":"2023-11-26T07:18:44.331983+0000","last_peered":"2023-11-26T07:18:44.331983+0000","last_clean":"2023-11-26T07:18:44.331983+0000","last_became_active":"2023-11-26T07:18:43.344110+0000","last_became_peered":"2023-11-26T07:18:43.344110+0000","last_unstale":"2023-11-26T07:18:44.331983+0000","last_undegraded":"2023-11-26T07:18:44.331983+0000","last_fullsized":"2023-11-26T07:18:44.331983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.347484+0000","last_change":"2023-11-26T07:18:44.346321+0000","last_active":"2023-11-26T07:18:45.347484+0000","last_peered":"2023-11-26T07:18:45.347484+0000","last_clean":"2023-11-26T07:18:45.347484+0000","last_became_active":"2023-11-26T07:18:44.342883+0000","last_became_peered":"2023-11-26T07:18:44.342883+0000","last_unstale":"2023-11-26T07:18:45.347484+0000","last_undegraded":"2023-11-26T07:18:45.347484+0000","last_fullsized":"2023-11-26T07:18:45.347484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:47.571506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.341116+0000","last_change":"2023-11-26T07:18:43.345987+0000","last_active":"2023-11-26T07:18:44.341116+0000","last_peered":"2023-11-26T07:18:44.341116+0000","last_clean":"2023-11-26T07:18:44.341116+0000","last_became_active":"2023-11-26T07:18:43.345128+0000","last_became_peered":"2023-11-26T07:18:43.345128+0000","last_unstale":"2023-11-26T07:18:44.341116+0000","last_undegraded":"2023-11-26T07:18:44.341116+0000","last_fullsized":"2023-11-26T07:18:44.341116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:46.556428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.348045+0000","last_change":"2023-11-26T07:18:44.350191+0000","last_active":"2023-11-26T07:18:45.348045+0000","last_peered":"2023-11-26T07:18:45.348045+0000","last_clean":"2023-11-26T07:18:45.348045+0000","last_became_active":"2023-11-26T07:18:44.349827+0000","last_became_peered":"2023-11-26T07:18:44.349827+0000","last_unstale":"2023-11-26T07:18:45.348045+0000","last_undegraded":"2023-11-26T07:18:45.348045+0000","last_fullsized":"2023-11-26T07:18:45.348045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:49:54.562908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.332950+0000","last_change":"2023-11-26T07:18:43.340479+0000","last_active":"2023-11-26T07:18:44.332950+0000","last_peered":"2023-11-26T07:18:44.332950+0000","last_clean":"2023-11-26T07:18:44.332950+0000","last_became_active":"2023-11-26T07:18:43.340189+0000","last_became_peered":"2023-11-26T07:18:43.340189+0000","last_unstale":"2023-11-26T07:18:44.332950+0000","last_undegraded":"2023-11-26T07:18:44.332950+0000","last_fullsized":"2023-11-26T07:18:44.332950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:50.411976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.347657+0000","last_change":"2023-11-26T07:18:44.349820+0000","last_active":"2023-11-26T07:18:45.347657+0000","last_peered":"2023-11-26T07:18:45.347657+0000","last_clean":"2023-11-26T07:18:45.347657+0000","last_became_active":"2023-11-26T07:18:44.349137+0000","last_became_peered":"2023-11-26T07:18:44.349137+0000","last_unstale":"2023-11-26T07:18:45.347657+0000","last_undegraded":"2023-11-26T07:18:45.347657+0000","last_fullsized":"2023-11-26T07:18:45.347657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:08:55.986599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.338837+0000","last_change":"2023-11-26T07:18:43.344767+0000","last_active":"2023-11-26T07:18:44.338837+0000","last_peered":"2023-11-26T07:18:44.338837+0000","last_clean":"2023-11-26T07:18:44.338837+0000","last_became_active":"2023-11-26T07:18:43.344485+0000","last_became_peered":"2023-11-26T07:18:43.344485+0000","last_unstale":"2023-11-26T07:18:44.338837+0000","last_undegraded":"2023-11-26T07:18:44.338837+0000","last_fullsized":"2023-11-26T07:18:44.338837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:02.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371584+0000","last_change":"2023-11-26T07:18:44.356457+0000","last_active":"2023-11-26T07:18:46.371584+0000","last_peered":"2023-11-26T07:18:46.371584+0000","last_clean":"2023-11-26T07:18:46.371584+0000","last_became_active":"2023-11-26T07:18:44.356141+0000","last_became_peered":"2023-11-26T07:18:44.356141+0000","last_unstale":"2023-11-26T07:18:46.371584+0000","last_undegraded":"2023-11-26T07:18:46.371584+0000","last_fullsized":"2023-11-26T07:18:46.371584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:27.677252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.332080+0000","last_change":"2023-11-26T07:18:43.347277+0000","last_active":"2023-11-26T07:18:44.332080+0000","last_peered":"2023-11-26T07:18:44.332080+0000","last_clean":"2023-11-26T07:18:44.332080+0000","last_became_active":"2023-11-26T07:18:43.346602+0000","last_became_peered":"2023-11-26T07:18:43.346602+0000","last_unstale":"2023-11-26T07:18:44.332080+0000","last_undegraded":"2023-11-26T07:18:44.332080+0000","last_fullsized":"2023-11-26T07:18:44.332080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:46.371470+0000","last_change":"2023-11-26T07:18:44.356806+0000","last_active":"2023-11-26T07:18:46.371470+0000","last_peered":"2023-11-26T07:18:46.371470+0000","last_clean":"2023-11-26T07:18:46.371470+0000","last_became_active":"2023-11-26T07:18:44.356526+0000","last_became_peered":"2023-11-26T07:18:44.356526+0000","last_unstale":"2023-11-26T07:18:46.371470+0000","last_undegraded":"2023-11-26T07:18:46.371470+0000","last_fullsized":"2023-11-26T07:18:46.371470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:49:54.562908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.322127+0000","last_change":"2023-11-26T07:18:43.339946+0000","last_active":"2023-11-26T07:18:44.322127+0000","last_peered":"2023-11-26T07:18:44.322127+0000","last_clean":"2023-11-26T07:18:44.322127+0000","last_became_active":"2023-11-26T07:18:43.339654+0000","last_became_peered":"2023-11-26T07:18:43.339654+0000","last_unstale":"2023-11-26T07:18:44.322127+0000","last_undegraded":"2023-11-26T07:18:44.322127+0000","last_fullsized":"2023-11-26T07:18:44.322127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:46.556428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:18:45.351069+0000","last_change":"2023-11-26T07:18:44.350819+0000","last_active":"2023-11-26T07:18:45.351069+0000","last_peered":"2023-11-26T07:18:45.351069+0000","last_clean":"2023-11-26T07:18:45.351069+0000","last_became_active":"2023-11-26T07:18:44.350524+0000","last_became_peered":"2023-11-26T07:18:44.350524+0000","last_unstale":"2023-11-26T07:18:45.351069+0000","last_undegraded":"2023-11-26T07:18:45.351069+0000","last_fullsized":"2023-11-26T07:18:45.351069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:43.295089+0000","last_clean_scrub_stamp":"2023-11-26T07:18:43.295089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:01.882223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.339446+0000","last_change":"2023-11-26T07:18:43.347243+0000","last_active":"2023-11-26T07:18:44.339446+0000","last_peered":"2023-11-26T07:18:44.339446+0000","last_clean":"2023-11-26T07:18:44.339446+0000","last_became_active":"2023-11-26T07:18:43.346909+0000","last_became_peered":"2023-11-26T07:18:43.346909+0000","last_unstale":"2023-11-26T07:18:44.339446+0000","last_undegraded":"2023-11-26T07:18:44.339446+0000","last_fullsized":"2023-11-26T07:18:44.339446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:42.280010+0000","last_clean_scrub_stamp":"2023-11-26T07:18:42.280010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:11.526933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:18:44.338498+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:18:44.338498+0000","last_peered":"2023-11-26T07:18:44.338498+0000","last_clean":"2023-11-26T07:18:44.338498+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:18:44.338498+0000","last_undegraded":"2023-11-26T07:18:44.338498+0000","last_fullsized":"2023-11-26T07:18:44.338498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.169}]},{"osd":1,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.23},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.7509999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.087},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.4219999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.381},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.8149999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.8779999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.649},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":1.6699999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:23 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.708},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.98}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.169,"5min":3.169,"15min":3.169},"last":0.877}]},{"osd":1,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.996}]},{"osd":2,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.226},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":3.1110000000000002,"5min":3.1110000000000002,"15min":3.1110000000000002},"last":0.93700000000000006}]},{"osd":3,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.349}]},{"osd":4,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1719999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.466},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.0489999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.526}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.458},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.105}]},{"osd":1,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.361},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.86799999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.1950000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.034}]},{"osd":4,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.52},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.274}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.577},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.145}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.3280000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.036},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.4570000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.49},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.26}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.417}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.0820000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":1.5389999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"min":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.649}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.593},{"interface":"front","average":{"1min":1.726,"5min":1.726,"15min":1.726},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.6279999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":153533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.88700000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.038},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.98299999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.745},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":0.69499999999999995}]},{"osd":4,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":1.4590000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.28},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.0900000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":3.226,"5min":3.226,"15min":3.226},"last":1.3380000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.224},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":1.3999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":151969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.751},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.97099999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.85799999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.80000000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.1619999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.89500000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.92400000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:18:27 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.296},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.995}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":153533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.393}]},{"osd":2,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.056},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.3},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.5960000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.7},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3460000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.5349999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.788},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.486}]},{"osd":7,"last update":"Sun Nov 26 07:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.643},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.3500000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.9630000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":742267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.087}]},{"osd":2,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.4590000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.4039999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.579},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.78}]},{"osd":5,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.506},{"interface":"front","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.55}]},{"osd":6,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.8799999999999999,"5min":2.8799999999999999,"15min":2.8799999999999999},"last":1.139},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.992}]},{"osd":7,"last update":"Sun Nov 26 07:18:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.8959999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.6639999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:18:54.548 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:18:54.548 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:18:54.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.815+0000 7fb359609640 1 Processor -- start 2023-11-26T07:18:54.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.815+0000 7fb359609640 1 -- start start 2023-11-26T07:18:54.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.817+0000 7fb359609640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb35415b440 0x7fb3540cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.817+0000 7fb359609640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb3540c59b0 0x7fb35406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.817+0000 7fb359609640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3540cc3a0 con 0x7fb3540cbf20 2023-11-26T07:18:54.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.817+0000 7fb359609640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35415b820 con 0x7fb3540c59b0 2023-11-26T07:18:54.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.817+0000 7fb359609640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35415eea0 con 0x7fb35415b440 2023-11-26T07:18:54.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.818+0000 7fb3527fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb3540cbf20 0x7fb3540c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46356/0 (socket says 172.21.15.77:46356) 2023-11-26T07:18:54.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.818+0000 7fb3527fc640 1 -- 172.21.15.77:0/1837198705 learned_addr learned my addr 172.21.15.77:0/1837198705 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:54.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.818+0000 7fb352ffd640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb35415b440 0x7fb3540cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.818+0000 7fb3537fe640 1 --2- 172.21.15.77:0/1837198705 >> v2:172.21.15.159:3300/0 conn(0x7fb3540c59b0 0x7fb35406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.818+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487457852 0 0) 0x7fb348001490 con 0x7fb3540cbf20 2023-11-26T07:18:54.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.818+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb33c003520 con 0x7fb3540cbf20 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2472510449 0 0) 0x7fb33c003520 con 0x7fb3540cbf20 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb35415b440 msgr2=0x7fb3540cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb35415b440 0x7fb3540cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 >> v2:172.21.15.159:3300/0 conn(0x7fb3540c59b0 msgr2=0x7fb35406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 --2- 172.21.15.77:0/1837198705 >> v2:172.21.15.159:3300/0 conn(0x7fb3540c59b0 0x7fb35406c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3540abf30 con 0x7fb3540cbf20 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fb348001b80 con 0x7fb3540cbf20 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 >> v1:172.21.15.77:6789/0 conn(0x7fb3540cbf20 legacy=0x7fb3540c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb33c003970 0x7fb33c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb35415b440 0x7fb33c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb33c004d00 0x7fb33c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35415b820 con 0x7fb33c004d00 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35415eea0 con 0x7fb33c003970 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c00b9b0 con 0x7fb35415b440 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.819+0000 7fb3537fe640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb33c004d00 0x7fb33c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.820+0000 7fb352ffd640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb33c003970 0x7fb33c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.820+0000 7fb3527fc640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb35415b440 0x7fb33c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.820+0000 7fb3537fe640 1 -- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb35415b440 msgr2=0x7fb33c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.820+0000 7fb3537fe640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb35415b440 0x7fb33c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.820+0000 7fb3537fe640 1 -- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb33c003970 msgr2=0x7fb33c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.820+0000 7fb3537fe640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb33c003970 0x7fb33c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.820+0000 7fb3537fe640 1 -- 172.21.15.77:0/1837198705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c003520 con 0x7fb33c004d00 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.820+0000 7fb352ffd640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb33c003970 0x7fb33c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.820+0000 7fb3527fc640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb35415b440 0x7fb33c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:54.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.821+0000 7fb3537fe640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb33c004d00 0x7fb33c005180 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009ac0 tx=0x7fb33c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30536f04aa26c60 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:54.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.821+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c02c710 con 0x7fb33c004d00 2023-11-26T07:18:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.821+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c02c870 con 0x7fb33c004d00 2023-11-26T07:18:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.821+0000 7fb351ffb640 1 -- 172.21.15.77:0/1837198705 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c02cc00 con 0x7fb33c004d00 2023-11-26T07:18:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.822+0000 7fb359609640 1 -- 172.21.15.77:0/1837198705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb33c004d00 msgr2=0x7fb33c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.822+0000 7fb359609640 1 --2- 172.21.15.77:0/1837198705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb33c004d00 0x7fb33c005180 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009ac0 tx=0x7fb33c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.822+0000 7fb3537fe640 1 -- 172.21.15.77:0/1837198705 reap_dead start 2023-11-26T07:18:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.822+0000 7fb359609640 1 -- 172.21.15.77:0/1837198705 shutdown_connections 2023-11-26T07:18:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.822+0000 7fb359609640 1 -- 172.21.15.77:0/1837198705 >> 172.21.15.77:0/1837198705 conn(0x7fb3540b0c50 msgr2=0x7fb3540b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.822+0000 7fb359609640 1 -- 172.21.15.77:0/1837198705 shutdown_connections 2023-11-26T07:18:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.822+0000 7fb359609640 1 -- 172.21.15.77:0/1837198705 wait complete. 2023-11-26T07:18:54.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.824+0000 7fb359609640 1 Processor -- start 2023-11-26T07:18:54.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.824+0000 7fb359609640 1 -- start start 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.825+0000 7fb359609640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb33c004d00 0x7fb3540b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.825+0000 7fb359609640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb35415a000 0x7fb354159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.825+0000 7fb359609640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3540c73f0 0x7fb35415b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.825+0000 7fb359609640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb354159db0 con 0x7fb35415a000 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.825+0000 7fb359609640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35415e910 con 0x7fb3540c73f0 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.825+0000 7fb359609640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35415e630 con 0x7fb33c004d00 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.825+0000 7fb3527fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb35415a000 0x7fb354159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.825+0000 7fb3527fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb35415a000 0x7fb354159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56366/0 (socket says 172.21.15.77:56366) 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.825+0000 7fb3527fc640 1 -- 172.21.15.77:0/201311500 learned_addr learned my addr 172.21.15.77:0/201311500 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.825+0000 7fb352ffd640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb33c004d00 0x7fb3540b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb3537fe640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3540c73f0 0x7fb35415b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb3527fc640 1 -- 172.21.15.77:0/201311500 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb33c004d00 msgr2=0x7fb3540b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb3527fc640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb33c004d00 0x7fb3540b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb3527fc640 1 -- 172.21.15.77:0/201311500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3540c73f0 msgr2=0x7fb35415b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb3527fc640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3540c73f0 0x7fb35415b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb3527fc640 1 -- 172.21.15.77:0/201311500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35415c5c0 con 0x7fb35415a000 2023-11-26T07:18:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb3527fc640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb35415a000 0x7fb354159870 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb348001c40 tx=0x7fb348001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb33b7fe640 1 -- 172.21.15.77:0/201311500 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348004d60 con 0x7fb35415a000 2023-11-26T07:18:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb33b7fe640 1 -- 172.21.15.77:0/201311500 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3480070d0 con 0x7fb35415a000 2023-11-26T07:18:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb359609640 1 -- 172.21.15.77:0/201311500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35415c8a0 con 0x7fb35415a000 2023-11-26T07:18:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb33b7fe640 1 -- 172.21.15.77:0/201311500 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348007480 con 0x7fb35415a000 2023-11-26T07:18:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.826+0000 7fb359609640 1 -- 172.21.15.77:0/201311500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3540c78a0 con 0x7fb35415a000 2023-11-26T07:18:54.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.828+0000 7fb359609640 1 -- 172.21.15.77:0/201311500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3540b26c0 con 0x7fb35415a000 2023-11-26T07:18:54.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.829+0000 7fb33b7fe640 1 -- 172.21.15.77:0/201311500 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3480075e0 con 0x7fb35415a000 2023-11-26T07:18:54.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.829+0000 7fb33b7fe640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb34006ae70 0x7fb34006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.830+0000 7fb33b7fe640 1 -- 172.21.15.77:0/201311500 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb348089980 con 0x7fb35415a000 2023-11-26T07:18:54.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.830+0000 7fb352ffd640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb34006ae70 0x7fb34006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.830+0000 7fb352ffd640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb34006ae70 0x7fb34006d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb344009aa0 tx=0x7fb344008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:54.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:54.834+0000 7fb33b7fe640 1 -- 172.21.15.77:0/201311500 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb348054990 con 0x7fb35415a000 2023-11-26T07:18:55.018 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:55.026 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:55.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.094+0000 7fb359609640 1 -- 172.21.15.77:0/201311500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb3540cc3a0 con 0x7fb35415a000 2023-11-26T07:18:55.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.099+0000 7fb33b7fe640 1 -- 172.21.15.77:0/201311500 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb3540cc3a0 con 0x7fb35415a000 2023-11-26T07:18:55.101 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-11-26T07:18:55.101 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDN8GJlhqOIKxAAiafAbVhNu4B+yTd/1i7+1A== 2023-11-26T07:18:55.102 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2023-11-26T07:18:55.102 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2023-11-26T07:18:55.102 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:18:55.102 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2023-11-26T07:18:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 -- 172.21.15.77:0/201311500 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb34006ae70 msgr2=0x7fb34006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb34006ae70 0x7fb34006d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb344009aa0 tx=0x7fb344008040 comp rx=0 tx=0).stop 2023-11-26T07:18:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 -- 172.21.15.77:0/201311500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb35415a000 msgr2=0x7fb354159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb35415a000 0x7fb354159870 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb348001c40 tx=0x7fb348001c70 comp rx=0 tx=0).stop 2023-11-26T07:18:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 -- 172.21.15.77:0/201311500 shutdown_connections 2023-11-26T07:18:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb34006ae70 0x7fb34006d330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3540c73f0 0x7fb35415b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb35415a000 0x7fb354159870 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 --2- 172.21.15.77:0/201311500 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb33c004d00 0x7fb3540b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 -- 172.21.15.77:0/201311500 >> 172.21.15.77:0/201311500 conn(0x7fb3540b0c50 msgr2=0x7fb3540ad670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 -- 172.21.15.77:0/201311500 shutdown_connections 2023-11-26T07:18:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.101+0000 7fb359609640 1 -- 172.21.15.77:0/201311500 wait complete. 2023-11-26T07:18:55.121 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:55.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.310+0000 7f241ce90640 1 Processor -- start 2023-11-26T07:18:55.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.310+0000 7f241ce90640 1 -- start start 2023-11-26T07:18:55.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.311+0000 7f241ce90640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f241815c7f0 0x7f241806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.311+0000 7f241ce90640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24180cece0 con 0x7f24180cf450 2023-11-26T07:18:55.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.311+0000 7f241ce90640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241806d040 con 0x7f24180ce6c0 2023-11-26T07:18:55.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.311+0000 7f241ce90640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2418156010 con 0x7f241815c7f0 2023-11-26T07:18:55.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.312+0000 7f2415d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f24180cf450 0x7f24180cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46368/0 (socket says 172.21.15.77:46368) 2023-11-26T07:18:55.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.312+0000 7f2415d9b640 1 -- 172.21.15.77:0/1638019244 learned_addr learned my addr 172.21.15.77:0/1638019244 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:55.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.312+0000 7f241659c640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f241815c7f0 0x7f241806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.312+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086802392 0 0) 0x7f24180cece0 con 0x7f24180cf450 2023-11-26T07:18:55.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.312+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2400003520 con 0x7f24180cf450 2023-11-26T07:18:55.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.312+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2083105002 0 0) 0x7f2400003520 con 0x7f24180cf450 2023-11-26T07:18:55.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.312+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f241815c7f0 msgr2=0x7f241806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:55.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.312+0000 7f241559a640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f241815c7f0 0x7f241806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.312+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 >> v1:172.21.15.159:6789/0 conn(0x7f24180ce6c0 legacy=0x7f24180714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241806d320 con 0x7f24180cf450 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f240c001670 con 0x7f24180cf450 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 >> v1:172.21.15.77:6789/0 conn(0x7f24180cf450 legacy=0x7f24180cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f241559a640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24000039a0 0x7f2400003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f241559a640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 0x7f2400004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f241559a640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f241815c7f0 0x7f2400005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2418156010 con 0x7f24000047c0 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240000ba30 con 0x7f24000039a0 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240000bbf0 con 0x7f241815c7f0 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f2415d9b640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 0x7f2400004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f241659c640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24000039a0 0x7f2400003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f2416d9d640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f241815c7f0 0x7f2400005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f2415d9b640 1 -- 172.21.15.77:0/1638019244 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f241815c7f0 msgr2=0x7f2400005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:55.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f2415d9b640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f241815c7f0 0x7f2400005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f2415d9b640 1 -- 172.21.15.77:0/1638019244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24000039a0 msgr2=0x7f2400003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:55.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f2415d9b640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24000039a0 0x7f2400003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.313+0000 7f2415d9b640 1 -- 172.21.15.77:0/1638019244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400003520 con 0x7f24000047c0 2023-11-26T07:18:55.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.315+0000 7f2415d9b640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 0x7f2400004c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f240c00c210 tx=0x7f24000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835f103d9ecc7c93 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:55.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.315+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c005ad0 con 0x7f24000047c0 2023-11-26T07:18:55.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.315+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c005c30 con 0x7f24000047c0 2023-11-26T07:18:55.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.315+0000 7f241559a640 1 -- 172.21.15.77:0/1638019244 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c02cab0 con 0x7f24000047c0 2023-11-26T07:18:55.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.315+0000 7f241ce90640 1 -- 172.21.15.77:0/1638019244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 msgr2=0x7f2400004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.315+0000 7f241ce90640 1 --2- 172.21.15.77:0/1638019244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 0x7f2400004c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f240c00c210 tx=0x7f24000057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.315+0000 7f2416d9d640 1 -- 172.21.15.77:0/1638019244 reap_dead start 2023-11-26T07:18:55.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.316+0000 7f241ce90640 1 -- 172.21.15.77:0/1638019244 shutdown_connections 2023-11-26T07:18:55.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.316+0000 7f241ce90640 1 -- 172.21.15.77:0/1638019244 >> 172.21.15.77:0/1638019244 conn(0x7f241806a920 msgr2=0x7f241806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:55.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.316+0000 7f241ce90640 1 -- 172.21.15.77:0/1638019244 shutdown_connections 2023-11-26T07:18:55.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.316+0000 7f241ce90640 1 -- 172.21.15.77:0/1638019244 wait complete. 2023-11-26T07:18:55.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.317+0000 7f241ce90640 1 Processor -- start 2023-11-26T07:18:55.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.317+0000 7f241ce90640 1 -- start start 2023-11-26T07:18:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.318+0000 7f241ce90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 0x7f2418140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.318+0000 7f241ce90640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2418143410 0x7f241813fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.318+0000 7f241ce90640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24181586a0 0x7f2418142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.318+0000 7f241ce90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24180aca90 con 0x7f24000047c0 2023-11-26T07:18:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.318+0000 7f241ce90640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2418158fd0 con 0x7f2418143410 2023-11-26T07:18:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.318+0000 7f241ce90640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24180ac0f0 con 0x7f24181586a0 2023-11-26T07:18:55.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.319+0000 7f241659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 0x7f2418140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.319+0000 7f241659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 0x7f2418140690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56374/0 (socket says 172.21.15.77:56374) 2023-11-26T07:18:55.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.319+0000 7f241659c640 1 -- 172.21.15.77:0/2390308449 learned_addr learned my addr 172.21.15.77:0/2390308449 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:55.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.319+0000 7f241659c640 1 -- 172.21.15.77:0/2390308449 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24181586a0 msgr2=0x7f2418142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.319+0000 7f241659c640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24181586a0 0x7f2418142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.319+0000 7f241659c640 1 -- 172.21.15.77:0/2390308449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2418143410 msgr2=0x7f241813fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.319+0000 7f241659c640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2418143410 0x7f241813fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.319+0000 7f241659c640 1 -- 172.21.15.77:0/2390308449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24180ac3d0 con 0x7f24000047c0 2023-11-26T07:18:55.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.319+0000 7f241659c640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 0x7f2418140690 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2408011600 tx=0x7f2408011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:55.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.320+0000 7f2406ffd640 1 -- 172.21.15.77:0/2390308449 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240800f920 con 0x7f24000047c0 2023-11-26T07:18:55.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.320+0000 7f2406ffd640 1 -- 172.21.15.77:0/2390308449 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240800fa80 con 0x7f24000047c0 2023-11-26T07:18:55.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.320+0000 7f2406ffd640 1 -- 172.21.15.77:0/2390308449 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240800fdf0 con 0x7f24000047c0 2023-11-26T07:18:55.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.320+0000 7f241ce90640 1 -- 172.21.15.77:0/2390308449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24180ac6b0 con 0x7f24000047c0 2023-11-26T07:18:55.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.320+0000 7f241ce90640 1 -- 172.21.15.77:0/2390308449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2418158b30 con 0x7f24000047c0 2023-11-26T07:18:55.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.321+0000 7f241ce90640 1 -- 172.21.15.77:0/2390308449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24180cc8b0 con 0x7f24000047c0 2023-11-26T07:18:55.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.322+0000 7f2406ffd640 1 -- 172.21.15.77:0/2390308449 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2408015460 con 0x7f24000047c0 2023-11-26T07:18:55.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.323+0000 7f2406ffd640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f23f806ae40 0x7f23f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.323+0000 7f2406ffd640 1 -- 172.21.15.77:0/2390308449 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2408089a60 con 0x7f24000047c0 2023-11-26T07:18:55.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.323+0000 7f2415d9b640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f23f806ae40 0x7f23f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.324+0000 7f2415d9b640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f23f806ae40 0x7f23f806d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f240c034000 tx=0x7f240c007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:55.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.328+0000 7f2406ffd640 1 -- 172.21.15.77:0/2390308449 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2408054ba0 con 0x7f24000047c0 2023-11-26T07:18:55.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.553+0000 7f241ce90640 1 -- 172.21.15.77:0/2390308449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2418067470 con 0x7f24000047c0 2023-11-26T07:18:55.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.554+0000 7f2406ffd640 1 -- 172.21.15.77:0/2390308449 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f2408022090 con 0x7f24000047c0 2023-11-26T07:18:55.557 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:18:55.557 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3806365439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3806365439},{"type":"v1","addr":"172.21.15.77:6836","nonce":3806365439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/694008676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":694008676},{"type":"v1","addr":"172.21.15.77:6837","nonce":694008676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4705,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/4096574472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4096574472},{"type":"v1","addr":"172.21.15.159:6834","nonce":4096574472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:43.790536+0000","modified":"2023-11-26T07:18:47.129568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6835/360332813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":360332813},{"type":"v1","addr":"172.21.15.159:6835","nonce":360332813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:18:55.558 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 -- 172.21.15.77:0/2390308449 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f23f806ae40 msgr2=0x7f23f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f23f806ae40 0x7f23f806d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f240c034000 tx=0x7f240c007000 comp rx=0 tx=0).stop 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 -- 172.21.15.77:0/2390308449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 msgr2=0x7f2418140690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 0x7f2418140690 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2408011600 tx=0x7f2408011ac0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 -- 172.21.15.77:0/2390308449 shutdown_connections 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f23f806ae40 0x7f23f806d300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24181586a0 0x7f2418142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2418143410 0x7f241813fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 --2- 172.21.15.77:0/2390308449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24000047c0 0x7f2418140690 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 -- 172.21.15.77:0/2390308449 >> 172.21.15.77:0/2390308449 conn(0x7f241806a920 msgr2=0x7f241806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 -- 172.21.15.77:0/2390308449 shutdown_connections 2023-11-26T07:18:55.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:55.557+0000 7f241ce90640 1 -- 172.21.15.77:0/2390308449 wait complete. 2023-11-26T07:18:55.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:18:43.790536+0000', 'modified': '2023-11-26T07:18:47.129568+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4708}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4708': {'gid': 4708, 'name': 'd', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.159:6835/360332813', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6833', 'nonce': 360332813}, {'type': 'v1', 'addr': '172.21.15.159:6835', 'nonce': 360332813}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:18:55.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:18:55.979 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-26T07:18:56.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.194+0000 7f70fd189640 1 Processor -- start 2023-11-26T07:18:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.194+0000 7f70fd189640 1 -- start start 2023-11-26T07:18:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.196+0000 7f70fd189640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f70f80cc0f0 0x7f70f80c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.196+0000 7f70fd189640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f815eea0 con 0x7f70f815b440 2023-11-26T07:18:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.196+0000 7f70fd189640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f80abf30 con 0x7f70f80c57e0 2023-11-26T07:18:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.196+0000 7f70fd189640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f815b820 con 0x7f70f80cc0f0 2023-11-26T07:18:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.196+0000 7f70f6d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f70f815b440 0x7f70f80cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34750/0 (socket says 172.21.15.77:34750) 2023-11-26T07:18:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.196+0000 7f70f6d9d640 1 -- 172.21.15.77:0/1198235283 learned_addr learned my addr 172.21.15.77:0/1198235283 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:56.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22138389 0 0) 0x7f70f815eea0 con 0x7f70f815b440 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e0003520 con 0x7f70f815b440 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f659c640 1 --2- 172.21.15.77:0/1198235283 >> v2:172.21.15.159:3300/0 conn(0x7f70f80cc0f0 0x7f70f80c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2687793607 0 0) 0x7f70e0003520 con 0x7f70f815b440 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 >> v2:172.21.15.159:3300/0 conn(0x7f70f80cc0f0 msgr2=0x7f70f80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 --2- 172.21.15.77:0/1198235283 >> v2:172.21.15.159:3300/0 conn(0x7f70f80cc0f0 0x7f70f80c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 >> v1:172.21.15.159:6789/0 conn(0x7f70f80c57e0 legacy=0x7f70f806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f815f0f0 con 0x7f70f815b440 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f70e8001670 con 0x7f70f815b440 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 >> v1:172.21.15.77:6789/0 conn(0x7f70f815b440 legacy=0x7f70f80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 --2- 172.21.15.77:0/1198235283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e0003970 0x7f70e0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 --2- 172.21.15.77:0/1198235283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 0x7f70e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 --2- 172.21.15.77:0/1198235283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e00052a0 0x7f70e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f815b820 con 0x7f70e00047c0 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e000c150 con 0x7f70e00052a0 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e000c310 con 0x7f70e0003970 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.197+0000 7f70f659c640 1 --2- 172.21.15.77:0/1198235283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 0x7f70e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.198+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/1198235283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e0003970 0x7f70e0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.198+0000 7f70f759e640 1 --2- 172.21.15.77:0/1198235283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e00052a0 0x7f70e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.198+0000 7f70f659c640 1 -- 172.21.15.77:0/1198235283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e0003970 msgr2=0x7f70e0003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.198+0000 7f70f659c640 1 --2- 172.21.15.77:0/1198235283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e0003970 0x7f70e0003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.198+0000 7f70f659c640 1 -- 172.21.15.77:0/1198235283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e00052a0 msgr2=0x7f70e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.198+0000 7f70f659c640 1 --2- 172.21.15.77:0/1198235283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e00052a0 0x7f70e000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.198+0000 7f70f659c640 1 -- 172.21.15.77:0/1198235283 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0003520 con 0x7f70e00047c0 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.198+0000 7f70f759e640 1 -- 172.21.15.77:0/1198235283 reap_dead start 2023-11-26T07:18:56.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.199+0000 7f70f659c640 1 --2- 172.21.15.77:0/1198235283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 0x7f70e0004c40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00ba00 tx=0x7f70e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31453f612d73aae0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:56.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.199+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec032620 con 0x7f70e00047c0 2023-11-26T07:18:56.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.199+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec032780 con 0x7f70e00047c0 2023-11-26T07:18:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.199+0000 7f70f5d9b640 1 -- 172.21.15.77:0/1198235283 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec032b10 con 0x7f70e00047c0 2023-11-26T07:18:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.200+0000 7f70fd189640 1 -- 172.21.15.77:0/1198235283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 msgr2=0x7f70e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.200+0000 7f70fd189640 1 --2- 172.21.15.77:0/1198235283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 0x7f70e0004c40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00ba00 tx=0x7f70e00057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.200+0000 7f70fd189640 1 -- 172.21.15.77:0/1198235283 shutdown_connections 2023-11-26T07:18:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.200+0000 7f70fd189640 1 --2- 172.21.15.77:0/1198235283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 0x7f70e0004c40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.200+0000 7f70fd189640 1 -- 172.21.15.77:0/1198235283 >> 172.21.15.77:0/1198235283 conn(0x7f70f80b0c50 msgr2=0x7f70f80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.200+0000 7f70fd189640 1 -- 172.21.15.77:0/1198235283 shutdown_connections 2023-11-26T07:18:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.200+0000 7f70fd189640 1 -- 172.21.15.77:0/1198235283 wait complete. 2023-11-26T07:18:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.202+0000 7f70fd189640 1 Processor -- start 2023-11-26T07:18:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.202+0000 7f70fd189640 1 -- start start 2023-11-26T07:18:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.203+0000 7f70fd189640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 0x7f70f8156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.203+0000 7f70fd189640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70f80c7ca0 0x7f70f80c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.203+0000 7f70fd189640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f815a270 0x7f70f815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.203+0000 7f70fd189640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80c8660 con 0x7f70e00047c0 2023-11-26T07:18:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.203+0000 7f70fd189640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f815ac30 con 0x7f70f815a270 2023-11-26T07:18:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.203+0000 7f70fd189640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8158bd0 con 0x7f70f80c7ca0 2023-11-26T07:18:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.203+0000 7f70f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 0x7f70f8156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.203+0000 7f70f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 0x7f70f8156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49396/0 (socket says 172.21.15.77:49396) 2023-11-26T07:18:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.203+0000 7f70f6d9d640 1 -- 172.21.15.77:0/641335705 learned_addr learned my addr 172.21.15.77:0/641335705 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:56.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.204+0000 7f70f6d9d640 1 -- 172.21.15.77:0/641335705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70f80c7ca0 msgr2=0x7f70f80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.204+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70f80c7ca0 0x7f70f80c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.204+0000 7f70f6d9d640 1 -- 172.21.15.77:0/641335705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f815a270 msgr2=0x7f70f815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.204+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f815a270 0x7f70f815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.204+0000 7f70f6d9d640 1 -- 172.21.15.77:0/641335705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8158eb0 con 0x7f70e00047c0 2023-11-26T07:18:56.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.204+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 0x7f70f8156af0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f70e800d770 tx=0x7f70e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:56.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.204+0000 7f70df7fe640 1 -- 172.21.15.77:0/641335705 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80074e0 con 0x7f70e00047c0 2023-11-26T07:18:56.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.204+0000 7f70df7fe640 1 -- 172.21.15.77:0/641335705 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8007640 con 0x7f70e00047c0 2023-11-26T07:18:56.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.204+0000 7f70fd189640 1 -- 172.21.15.77:0/641335705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f8159190 con 0x7f70e00047c0 2023-11-26T07:18:56.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.204+0000 7f70df7fe640 1 -- 172.21.15.77:0/641335705 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80049e0 con 0x7f70e00047c0 2023-11-26T07:18:56.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.204+0000 7f70fd189640 1 -- 172.21.15.77:0/641335705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f8159750 con 0x7f70e00047c0 2023-11-26T07:18:56.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.207+0000 7f70df7fe640 1 -- 172.21.15.77:0/641335705 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70e8004b40 con 0x7f70e00047c0 2023-11-26T07:18:56.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.207+0000 7f70df7fe640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f70e406ae70 0x7f70e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.208+0000 7f70df7fe640 1 -- 172.21.15.77:0/641335705 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70e8088e90 con 0x7f70e00047c0 2023-11-26T07:18:56.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.208+0000 7f70f659c640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f70e406ae70 0x7f70e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.208+0000 7f70ffdf9740 1 Processor -- start 2023-11-26T07:18:56.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.208+0000 7f70ffdf9740 1 -- start start 2023-11-26T07:18:56.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.208+0000 7f70f659c640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f70e406ae70 0x7f70e406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f70e00057a0 tx=0x7f70ec032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.209+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df96ea0 0x55dd3df97280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.209+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df91ba0 0x55dd3df960a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.209+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfda560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.209+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd3def5880 con 0x55dd3df965e0 2023-11-26T07:18:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.209+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd3df04ae0 con 0x55dd3df96ea0 2023-11-26T07:18:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.209+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd3df021d0 con 0x55dd3df91ba0 2023-11-26T07:18:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.209+0000 7f70f759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfda560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.210+0000 7f70f759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfda560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49402/0 (socket says 172.21.15.77:49402) 2023-11-26T07:18:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.210+0000 7f70f759e640 1 -- 172.21.15.77:0/3131131886 learned_addr learned my addr 172.21.15.77:0/3131131886 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.210+0000 7f70f759e640 1 -- 172.21.15.77:0/3131131886 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df91ba0 msgr2=0x55dd3df960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.210+0000 7f70f759e640 1 --2- 172.21.15.77:0/3131131886 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df91ba0 0x55dd3df960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.210+0000 7f70f759e640 1 -- 172.21.15.77:0/3131131886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df96ea0 msgr2=0x55dd3df97280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.210+0000 7f70f759e640 1 --2- 172.21.15.77:0/3131131886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df96ea0 0x55dd3df97280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.210+0000 7f70f759e640 1 -- 172.21.15.77:0/3131131886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd3dec5860 con 0x55dd3df965e0 2023-11-26T07:18:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.210+0000 7f70f759e640 1 --2- 172.21.15.77:0/3131131886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfda560 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70f0005030 tx=0x7f70f00054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca44a6d8193c2267 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.210+0000 7f70dcff9640 1 -- 172.21.15.77:0/3131131886 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0003be0 con 0x55dd3df965e0 2023-11-26T07:18:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.210+0000 7f70dcff9640 1 -- 172.21.15.77:0/3131131886 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f0003d40 con 0x55dd3df965e0 2023-11-26T07:18:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.210+0000 7f70dcff9640 1 -- 172.21.15.77:0/3131131886 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000e980 con 0x55dd3df965e0 2023-11-26T07:18:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.211+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3131131886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 msgr2=0x55dd3dfda560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.211+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/3131131886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfda560 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70f0005030 tx=0x7f70f00054f0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.211+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3131131886 shutdown_connections 2023-11-26T07:18:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.211+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/3131131886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfda560 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.211+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/3131131886 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df91ba0 0x55dd3df960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.211+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/3131131886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df96ea0 0x55dd3df97280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.211+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3131131886 >> 172.21.15.77:0/3131131886 conn(0x55dd3df58c70 msgr2=0x55dd3dfdc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.211+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3131131886 shutdown_connections 2023-11-26T07:18:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.211+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3131131886 wait complete. 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.212+0000 7f70ffdf9740 1 -- start start 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.212+0000 7f70ffdf9740 1 Processor -- start 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.213+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df91ba0 0x55dd3dfbd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.213+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfd5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.213+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df96ea0 0x55dd3dfe4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.213+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd3defdac0 con 0x55dd3df965e0 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.213+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd3de9a2f0 con 0x55dd3df91ba0 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.213+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd3deb7c70 con 0x55dd3df96ea0 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.213+0000 7f70ffdf9740 10 client.0 _ll_register_callbacks cb 0x55dd3debc3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70f659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfd5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70f659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfd5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49416/0 (socket says 172.21.15.77:49416) 2023-11-26T07:18:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70f659c640 1 -- 172.21.15.77:0/2465320916 learned_addr learned my addr 172.21.15.77:0/2465320916 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df91ba0 0x55dd3dfbd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70f759e640 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df96ea0 0x55dd3dfe4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70f659c640 1 -- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df96ea0 msgr2=0x55dd3dfe4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70f659c640 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df96ea0 0x55dd3dfe4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70f659c640 1 -- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df91ba0 msgr2=0x55dd3dfbd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70f659c640 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df91ba0 0x55dd3dfbd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70f659c640 1 -- 172.21.15.77:0/2465320916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f000f040 con 0x55dd3df965e0 2023-11-26T07:18:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70f659c640 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfd5db0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00bb20 tx=0x7f70ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120c058d5e515791 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.214+0000 7f70d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-26T07:18:56.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70d5ffb640 1 -- 172.21.15.77:0/2465320916 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec03ba70 con 0x55dd3df965e0 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70d5ffb640 1 -- 172.21.15.77:0/2465320916 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70ec03bbd0 con 0x55dd3df965e0 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70ffdf9740 1 -- 172.21.15.77:0/2465320916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd3def6aa0 con 0x55dd3df965e0 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70d5ffb640 1 -- 172.21.15.77:0/2465320916 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70ec03bd90 con 0x55dd3df965e0 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70ffdf9740 10 client.5265 fetch_fsmap learned FSMap version 15 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70ffdf9740 1 -- 172.21.15.77:0/2465320916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55dd3defc140 con 0x55dd3df965e0 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70d5ffb640 1 -- 172.21.15.77:0/2465320916 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dd3def6aa0 con 0x55dd3df965e0 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70d5ffb640 1 -- 172.21.15.77:0/2465320916 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f70ec050430 con 0x55dd3df965e0 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70ffdf9740 10 client.5265 fetch_fsmap finished waiting for FSMap version 15 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70ffdf9740 10 client.5265 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70ffdf9740 20 client.5265 populate_metadata read hostname 'smithi077' 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:6833/360332813,v1:172.21.15.159:6835/360332813] conn(0x55dd3dfe4ab0 0x55dd3dfd3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70ffdf9740 4 client.5265 mds_command: new command op to 4708 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:18:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.215+0000 7f70ffdf9740 1 -- 172.21.15.77:0/2465320916 --> [v2:172.21.15.159:6833/360332813,v1:172.21.15.159:6835/360332813] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd3def67c0 con 0x55dd3dfe4ab0 2023-11-26T07:18:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.216+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:6833/360332813,v1:172.21.15.159:6835/360332813] conn(0x55dd3dfe4ab0 0x55dd3dfd3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.217+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:6833/360332813,v1:172.21.15.159:6835/360332813] conn(0x55dd3dfe4ab0 0x55dd3dfd3a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=641906313d688c15 server_cookie=54614e4b2f32a17a in_seq=0 out_seq=0 2023-11-26T07:18:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.217+0000 7f70d5ffb640 10 client.5265 ms_handle_connect on v2:172.21.15.159:6833/360332813 2023-11-26T07:18:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.219+0000 7f70d5ffb640 1 -- 172.21.15.77:0/2465320916 <== mds.0 v2:172.21.15.159:6833/360332813 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dd3def67c0 con 0x55dd3dfe4ab0 2023-11-26T07:18:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.219+0000 7f70d5ffb640 10 client.5265 handle_command_reply: tid=0 2023-11-26T07:18:56.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.219+0000 7f70ffdf9740 1 client.5265 shutdown 2023-11-26T07:18:56.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.219+0000 7f70ffdf9740 1 -- 172.21.15.77:0/2465320916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 msgr2=0x55dd3dfd5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.219+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfd5db0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00bb20 tx=0x7f70ec004730 comp rx=0 tx=0).stop 2023-11-26T07:18:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.219+0000 7f70ffdf9740 1 -- 172.21.15.77:0/2465320916 shutdown_connections 2023-11-26T07:18:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.219+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:6833/360332813,v1:172.21.15.159:6835/360332813] conn(0x55dd3dfe4ab0 0x55dd3dfd3a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.220+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df96ea0 0x55dd3dfe4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.220+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df965e0 0x55dd3dfd5db0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.220+0000 7f70d5ffb640 0 client.5265 ms_handle_reset on v2:172.21.15.159:6833/360332813 2023-11-26T07:18:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.220+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/2465320916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df91ba0 0x55dd3dfbd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.220+0000 7f70ffdf9740 1 -- 172.21.15.77:0/2465320916 >> 172.21.15.77:0/2465320916 conn(0x55dd3df58c70 msgr2=0x55dd3df90b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.220+0000 7f70ffdf9740 1 -- 172.21.15.77:0/2465320916 shutdown_connections 2023-11-26T07:18:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.220+0000 7f70ffdf9740 1 -- 172.21.15.77:0/2465320916 wait complete. 2023-11-26T07:18:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.220+0000 7f70ffdf9740 20 client.5265 trim_cache size 0 max 16384 2023-11-26T07:18:56.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.237+0000 7f70ffdf9740 1 Processor -- start 2023-11-26T07:18:56.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.237+0000 7f70ffdf9740 1 -- start start 2023-11-26T07:18:56.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.237+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfd5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.237+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df965e0 0x55dd3dfdcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.237+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df96ea0 0x55dd3dfdd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.237+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd3dc60f20 con 0x55dd3df91ba0 2023-11-26T07:18:56.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.237+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd3dfb7d60 con 0x55dd3df965e0 2023-11-26T07:18:56.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.237+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd3deb1e30 con 0x55dd3df96ea0 2023-11-26T07:18:56.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.238+0000 7f70f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfd5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.238+0000 7f70f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfd5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49428/0 (socket says 172.21.15.77:49428) 2023-11-26T07:18:56.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.238+0000 7f70f6d9d640 1 -- 172.21.15.77:0/1192186435 learned_addr learned my addr 172.21.15.77:0/1192186435 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:56.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.238+0000 7f70f6d9d640 1 -- 172.21.15.77:0/1192186435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df96ea0 msgr2=0x55dd3dfdd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.238+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/1192186435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df96ea0 0x55dd3dfdd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.238+0000 7f70f6d9d640 1 -- 172.21.15.77:0/1192186435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df965e0 msgr2=0x55dd3dfdcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.238+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/1192186435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df965e0 0x55dd3dfdcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.238+0000 7f70f6d9d640 1 -- 172.21.15.77:0/1192186435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd3de99b80 con 0x55dd3df91ba0 2023-11-26T07:18:56.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.238+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/1192186435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfd5a50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f70e8087350 tx=0x7f70e801f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff488d9deb77f72 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70dd7fa640 1 -- 172.21.15.77:0/1192186435 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e805fef0 con 0x55dd3df91ba0 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70dd7fa640 1 -- 172.21.15.77:0/1192186435 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8055de0 con 0x55dd3df91ba0 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70dd7fa640 1 -- 172.21.15.77:0/1192186435 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8056040 con 0x55dd3df91ba0 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70ffdf9740 1 -- 172.21.15.77:0/1192186435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 msgr2=0x55dd3dfd5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/1192186435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfd5a50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f70e8087350 tx=0x7f70e801f040 comp rx=0 tx=0).stop 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70ffdf9740 1 -- 172.21.15.77:0/1192186435 shutdown_connections 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/1192186435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df96ea0 0x55dd3dfdd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/1192186435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df965e0 0x55dd3dfdcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/1192186435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfd5a50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70ffdf9740 1 -- 172.21.15.77:0/1192186435 >> 172.21.15.77:0/1192186435 conn(0x55dd3df58c70 msgr2=0x55dd3dfe1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70ffdf9740 1 -- 172.21.15.77:0/1192186435 shutdown_connections 2023-11-26T07:18:56.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.239+0000 7f70ffdf9740 1 -- 172.21.15.77:0/1192186435 wait complete. 2023-11-26T07:18:56.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.240+0000 7f70ffdf9740 1 -- start start 2023-11-26T07:18:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.240+0000 7f70ffdf9740 1 Processor -- start 2023-11-26T07:18:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.241+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfdc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.241+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df965e0 0x55dd3dfdced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.241+0000 7f70ffdf9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df96ea0 0x55dd3dfdfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.241+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd3dfff550 con 0x55dd3df91ba0 2023-11-26T07:18:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.241+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd3dfe0be0 con 0x55dd3df96ea0 2023-11-26T07:18:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.241+0000 7f70ffdf9740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd3e044770 con 0x55dd3df965e0 2023-11-26T07:18:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.241+0000 7f70ffdf9740 10 client.0 _ll_register_callbacks cb 0x55dd3df96530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:18:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.241+0000 7f70f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfdc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfdc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49444/0 (socket says 172.21.15.77:49444) 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70f6d9d640 1 -- 172.21.15.77:0/3342980122 learned_addr learned my addr 172.21.15.77:0/3342980122 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70f6d9d640 1 -- 172.21.15.77:0/3342980122 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df965e0 msgr2=0x55dd3dfdced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/3342980122 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df965e0 0x55dd3dfdced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70f6d9d640 1 -- 172.21.15.77:0/3342980122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df96ea0 msgr2=0x55dd3dfdfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/3342980122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df96ea0 0x55dd3dfdfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70f6d9d640 1 -- 172.21.15.77:0/3342980122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f8159750 con 0x55dd3df91ba0 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70f6d9d640 1 --2- 172.21.15.77:0/3342980122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfdc990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f70e8057c30 tx=0x7f70e8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b32fb5f7374b1d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70d5ffb640 1 -- 172.21.15.77:0/3342980122 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80874f0 con 0x55dd3df91ba0 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70d5ffb640 1 -- 172.21.15.77:0/3342980122 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70e805fa60 con 0x55dd3df91ba0 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3342980122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd3dfe3730 con 0x55dd3df91ba0 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.242+0000 7f70d5ffb640 1 -- 172.21.15.77:0/3342980122 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70e805fc20 con 0x55dd3df91ba0 2023-11-26T07:18:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.243+0000 7f70ffdf9740 10 client.5271 fetch_fsmap learned FSMap version 15 2023-11-26T07:18:56.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.243+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3342980122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55dd3debf170 con 0x55dd3df91ba0 2023-11-26T07:18:56.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.243+0000 7f70d5ffb640 1 -- 172.21.15.77:0/3342980122 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dd3dfe3730 con 0x55dd3df91ba0 2023-11-26T07:18:56.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.243+0000 7f70d5ffb640 1 -- 172.21.15.77:0/3342980122 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f70e80762b0 con 0x55dd3df91ba0 2023-11-26T07:18:56.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.243+0000 7f70ffdf9740 10 client.5271 fetch_fsmap finished waiting for FSMap version 15 2023-11-26T07:18:56.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.243+0000 7f70ffdf9740 10 client.5271 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-26T07:18:56.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.243+0000 7f70ffdf9740 20 client.5271 populate_metadata read hostname 'smithi077' 2023-11-26T07:18:56.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.243+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/3342980122 >> [v2:172.21.15.159:6833/360332813,v1:172.21.15.159:6835/360332813] conn(0x55dd3dfe0010 0x55dd3dff5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.243+0000 7f70ffdf9740 4 client.5271 mds_command: new command op to 4708 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:18:56.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.243+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3342980122 --> [v2:172.21.15.159:6833/360332813,v1:172.21.15.159:6835/360332813] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f70f0003d40 con 0x55dd3dfe0010 2023-11-26T07:18:56.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.244+0000 7f70f659c640 1 --2- 172.21.15.77:0/3342980122 >> [v2:172.21.15.159:6833/360332813,v1:172.21.15.159:6835/360332813] conn(0x55dd3dfe0010 0x55dd3dff5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.244+0000 7f70f659c640 1 --2- 172.21.15.77:0/3342980122 >> [v2:172.21.15.159:6833/360332813,v1:172.21.15.159:6835/360332813] conn(0x55dd3dfe0010 0x55dd3dff5130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3deb9823752d10a server_cookie=70400178b342d1b7 in_seq=0 out_seq=0 2023-11-26T07:18:56.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.244+0000 7f70d5ffb640 10 client.5271 ms_handle_connect on v2:172.21.15.159:6833/360332813 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70d5ffb640 1 -- 172.21.15.77:0/3342980122 <== mds.0 v2:172.21.15.159:6833/360332813 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x7f70f0003d40 con 0x55dd3dfe0010 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70d5ffb640 10 client.5271 handle_command_reply: tid=0 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70ffdf9740 1 client.5271 shutdown 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3342980122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 msgr2=0x55dd3dfdc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/3342980122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfdc990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f70e8057c30 tx=0x7f70e8001a00 comp rx=0 tx=0).stop 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3342980122 shutdown_connections 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/3342980122 >> [v2:172.21.15.159:6833/360332813,v1:172.21.15.159:6835/360332813] conn(0x55dd3dfe0010 0x55dd3dff5130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/3342980122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dd3df96ea0 0x55dd3dfdfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/3342980122 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55dd3df965e0 0x55dd3dfdced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70ffdf9740 1 --2- 172.21.15.77:0/3342980122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dd3df91ba0 0x55dd3dfdc990 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70d5ffb640 0 client.5271 ms_handle_reset on v2:172.21.15.159:6833/360332813 2023-11-26T07:18:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.245+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3342980122 >> 172.21.15.77:0/3342980122 conn(0x55dd3df58c70 msgr2=0x55dd3dfd5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:56.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.246+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3342980122 shutdown_connections 2023-11-26T07:18:56.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.246+0000 7f70ffdf9740 1 -- 172.21.15.77:0/3342980122 wait complete. 2023-11-26T07:18:56.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.246+0000 7f70ffdf9740 20 client.5271 trim_cache size 0 max 16384 2023-11-26T07:18:56.251 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:18:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "957368bd-e942-499b-9938-86266ae9bafb", 2023-11-26T07:18:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-26T07:18:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4708, 2023-11-26T07:18:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-26T07:18:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-26T07:18:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-26T07:18:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 11.928624914, 2023-11-26T07:18:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 15, 2023-11-26T07:18:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 34, 2023-11-26T07:18:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 34, 2023-11-26T07:18:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 21.012978643 2023-11-26T07:18:56.252 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.246+0000 7f70fd189640 1 -- 172.21.15.77:0/641335705 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f70e406ae70 msgr2=0x7f70e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.246+0000 7f70fd189640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f70e406ae70 0x7f70e406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f70e00057a0 tx=0x7f70ec032000 comp rx=0 tx=0).stop 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.246+0000 7f70fd189640 1 -- 172.21.15.77:0/641335705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 msgr2=0x7f70f8156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.246+0000 7f70fd189640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 0x7f70f8156af0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f70e800d770 tx=0x7f70e800dc30 comp rx=0 tx=0).stop 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.247+0000 7f70fd189640 1 -- 172.21.15.77:0/641335705 shutdown_connections 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.247+0000 7f70fd189640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f70e406ae70 0x7f70e406d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.247+0000 7f70fd189640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70f815a270 0x7f70f815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.247+0000 7f70fd189640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70f80c7ca0 0x7f70f80c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.247+0000 7f70fd189640 1 --2- 172.21.15.77:0/641335705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e00047c0 0x7f70f8156af0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.247+0000 7f70fd189640 1 -- 172.21.15.77:0/641335705 >> 172.21.15.77:0/641335705 conn(0x7f70f80b0c50 msgr2=0x7f70f8071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.247+0000 7f70fd189640 1 -- 172.21.15.77:0/641335705 shutdown_connections 2023-11-26T07:18:56.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.247+0000 7f70fd189640 1 -- 172.21.15.77:0/641335705 wait complete. 2023-11-26T07:18:56.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:18:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.464+0000 7f935d864640 1 Processor -- start 2023-11-26T07:18:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.464+0000 7f935d864640 1 -- start start 2023-11-26T07:18:56.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.465+0000 7f935d864640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f935815c410 0x7f935815f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.465+0000 7f935d864640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935815bf80 con 0x7f9358144b30 2023-11-26T07:18:56.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.465+0000 7f935d864640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93580b1560 con 0x7f93580b1de0 2023-11-26T07:18:56.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.465+0000 7f935d864640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93580b1280 con 0x7f935815c410 2023-11-26T07:18:56.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f935c862640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9358144b30 0x7f93580b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34752/0 (socket says 172.21.15.77:34752) 2023-11-26T07:18:56.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f935c862640 1 -- 172.21.15.77:0/2122019289 learned_addr learned my addr 172.21.15.77:0/2122019289 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012183229 0 0) 0x7f935815bf80 con 0x7f9358144b30 2023-11-26T07:18:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9348003520 con 0x7f9358144b30 2023-11-26T07:18:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f9357fff640 1 --2- 172.21.15.77:0/2122019289 >> v2:172.21.15.159:3300/0 conn(0x7f935815c410 0x7f935815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3644364929 0 0) 0x7f9348003520 con 0x7f9358144b30 2023-11-26T07:18:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 >> v2:172.21.15.159:3300/0 conn(0x7f935815c410 msgr2=0x7f935815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f93577fe640 1 --2- 172.21.15.77:0/2122019289 >> v2:172.21.15.159:3300/0 conn(0x7f935815c410 0x7f935815f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 >> v1:172.21.15.159:6789/0 conn(0x7f93580b1de0 legacy=0x7f93580b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935815b930 con 0x7f9358144b30 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f934c001670 con 0x7f9358144b30 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.466+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 >> v1:172.21.15.77:6789/0 conn(0x7f9358144b30 legacy=0x7f93580b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f93577fe640 1 --2- 172.21.15.77:0/2122019289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9348003970 0x7f9348003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f93577fe640 1 --2- 172.21.15.77:0/2122019289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480047c0 0x7f9348004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f93577fe640 1 --2- 172.21.15.77:0/2122019289 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9348005180 0x7f934800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93580b1280 con 0x7f9348003970 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934800c0b0 con 0x7f93480047c0 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934800c270 con 0x7f9348005180 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f935c862640 1 --2- 172.21.15.77:0/2122019289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9348003970 0x7f9348003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f935c862640 1 -- 172.21.15.77:0/2122019289 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9348005180 msgr2=0x7f934800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f935c862640 1 --2- 172.21.15.77:0/2122019289 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9348005180 0x7f934800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f935c862640 1 -- 172.21.15.77:0/2122019289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480047c0 msgr2=0x7f9348004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:56.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f935c862640 1 --2- 172.21.15.77:0/2122019289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93480047c0 0x7f9348004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f935c862640 1 -- 172.21.15.77:0/2122019289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9348003520 con 0x7f9348003970 2023-11-26T07:18:56.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.467+0000 7f935d063640 1 -- 172.21.15.77:0/2122019289 reap_dead start 2023-11-26T07:18:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.468+0000 7f935c862640 1 --2- 172.21.15.77:0/2122019289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9348003970 0x7f9348003d70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f934c001eb0 tx=0x7f93480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f63c50b20bfb70 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.468+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c005ad0 con 0x7f9348003970 2023-11-26T07:18:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.469+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c005c50 con 0x7f9348003970 2023-11-26T07:18:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.469+0000 7f93577fe640 1 -- 172.21.15.77:0/2122019289 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c02c890 con 0x7f9348003970 2023-11-26T07:18:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.469+0000 7f935d864640 1 -- 172.21.15.77:0/2122019289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9348003970 msgr2=0x7f9348003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.469+0000 7f935d864640 1 --2- 172.21.15.77:0/2122019289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9348003970 0x7f9348003d70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f934c001eb0 tx=0x7f93480057f0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.469+0000 7f935d864640 1 -- 172.21.15.77:0/2122019289 shutdown_connections 2023-11-26T07:18:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.469+0000 7f935d864640 1 --2- 172.21.15.77:0/2122019289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9348003970 0x7f9348003d70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.469+0000 7f935d864640 1 -- 172.21.15.77:0/2122019289 >> 172.21.15.77:0/2122019289 conn(0x7f93580cb830 msgr2=0x7f93580cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.469+0000 7f935d864640 1 -- 172.21.15.77:0/2122019289 shutdown_connections 2023-11-26T07:18:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.469+0000 7f935d864640 1 -- 172.21.15.77:0/2122019289 wait complete. 2023-11-26T07:18:56.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.471+0000 7f935d864640 1 Processor -- start 2023-11-26T07:18:56.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.471+0000 7f935d864640 1 -- start start 2023-11-26T07:18:56.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.472+0000 7f935d864640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9348003970 0x7f93580b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.472+0000 7f935d864640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f935813e8a0 0x7f93581327c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.472+0000 7f935d864640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f935806c5b0 0x7f935806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.472+0000 7f935d864640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935806cf70 con 0x7f935813e8a0 2023-11-26T07:18:56.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.472+0000 7f935d864640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9358133110 con 0x7f9348003970 2023-11-26T07:18:56.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.472+0000 7f935d864640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93581333f0 con 0x7f935806c5b0 2023-11-26T07:18:56.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f9357fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f935813e8a0 0x7f93581327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f9357fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f935813e8a0 0x7f93581327c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49460/0 (socket says 172.21.15.77:49460) 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f9357fff640 1 -- 172.21.15.77:0/600614840 learned_addr learned my addr 172.21.15.77:0/600614840 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f935c862640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9348003970 0x7f93580b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f935d063640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f935806c5b0 0x7f935806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f9357fff640 1 -- 172.21.15.77:0/600614840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f935806c5b0 msgr2=0x7f935806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f9357fff640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f935806c5b0 0x7f935806ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f9357fff640 1 -- 172.21.15.77:0/600614840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9348003970 msgr2=0x7f93580b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f9357fff640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9348003970 0x7f93580b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f9357fff640 1 -- 172.21.15.77:0/600614840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93581336d0 con 0x7f935813e8a0 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f935c862640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9348003970 0x7f93580b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f9357fff640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f935813e8a0 0x7f93581327c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f934400d800 tx=0x7f934400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.473+0000 7f93557fa640 1 -- 172.21.15.77:0/600614840 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934400b6c0 con 0x7f935813e8a0 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.474+0000 7f93557fa640 1 -- 172.21.15.77:0/600614840 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934400b820 con 0x7f935813e8a0 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.474+0000 7f93557fa640 1 -- 172.21.15.77:0/600614840 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934400bbd0 con 0x7f935813e8a0 2023-11-26T07:18:56.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.474+0000 7f935d864640 1 -- 172.21.15.77:0/600614840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9358130820 con 0x7f935813e8a0 2023-11-26T07:18:56.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.474+0000 7f935d864640 1 -- 172.21.15.77:0/600614840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9358132d00 con 0x7f935813e8a0 2023-11-26T07:18:56.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.475+0000 7f935d864640 1 -- 172.21.15.77:0/600614840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9358132e90 con 0x7f935813e8a0 2023-11-26T07:18:56.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.476+0000 7f93557fa640 1 -- 172.21.15.77:0/600614840 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f934400bd30 con 0x7f935813e8a0 2023-11-26T07:18:56.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.476+0000 7f93557fa640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f933c06ae70 0x7f933c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:56.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.477+0000 7f93557fa640 1 -- 172.21.15.77:0/600614840 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9344089b10 con 0x7f935813e8a0 2023-11-26T07:18:56.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.477+0000 7f935c862640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f933c06ae70 0x7f933c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:56.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.477+0000 7f935c862640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f933c06ae70 0x7f933c06d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f934c034000 tx=0x7f934c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:56.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.481+0000 7f93557fa640 1 -- 172.21.15.77:0/600614840 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9344054b20 con 0x7f935813e8a0 2023-11-26T07:18:56.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.709+0000 7f935d864640 1 -- 172.21.15.77:0/600614840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f935804e840 con 0x7f935813e8a0 2023-11-26T07:18:56.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.710+0000 7f93557fa640 1 -- 172.21.15.77:0/600614840 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9344058140 con 0x7f935813e8a0 2023-11-26T07:18:56.713 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:18:56.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 -- 172.21.15.77:0/600614840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f933c06ae70 msgr2=0x7f933c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f933c06ae70 0x7f933c06d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f934c034000 tx=0x7f934c009030 comp rx=0 tx=0).stop 2023-11-26T07:18:56.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 -- 172.21.15.77:0/600614840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f935813e8a0 msgr2=0x7f93581327c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f935813e8a0 0x7f93581327c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f934400d800 tx=0x7f934400dcc0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 -- 172.21.15.77:0/600614840 shutdown_connections 2023-11-26T07:18:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f933c06ae70 0x7f933c06d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f935806c5b0 0x7f935806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f935813e8a0 0x7f93581327c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 --2- 172.21.15.77:0/600614840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9348003970 0x7f93580b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 -- 172.21.15.77:0/600614840 >> 172.21.15.77:0/600614840 conn(0x7f93580cb830 msgr2=0x7f93580cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 -- 172.21.15.77:0/600614840 shutdown_connections 2023-11-26T07:18:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:56.713+0000 7f935d864640 1 -- 172.21.15.77:0/600614840 wait complete. 2023-11-26T07:18:56.733 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:18:56.733 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:18:56.733 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-26T07:18:56.733 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:18:56.733 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:56.733 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:18:56.733 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:18:56.734 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:18:56.734 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:18:56.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:56.734 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-26T07:18:56.787 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:56.787 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42312sec preferred_lft 42312sec 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-26T07:18:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 36:2c:fb:c0:b0:85 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::609f:3dff:fe4d:944c/64 scope link 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether ba:55:90:99:11:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::b855:90ff:fe99:11fe/64 scope link 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 36:2c:fb:c0:b0:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:18:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::342c:fbff:fec0:b085/64 scope link 2023-11-26T07:18:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:56.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:56.791 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:18:56.880 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-26T07:18:56.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:56.884 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-26T07:18:56.938 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-26T07:18:56.938 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:18:56.938 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:18:56.938 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:18:56.938 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:18:56.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:56.939 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:18:56.939 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:18:56.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:18:56.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:18:56.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:18:56.939 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:18:57.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:57.118 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-26T07:18:57.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:18:57.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:18:57.169 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:18:57.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:57.169 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-26T07:18:57.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:57.259 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:57.316 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:18:57.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:57.317 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:57.368 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:18:57.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:57.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:18:57.510 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:18:57.510 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:18:57.511 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:18:57.532 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:18:57.532 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:18:57.532 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:18:57.532 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:18:57.533 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:18:57.559 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:18:57.559 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:18:57.559 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:18:57.559 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:18:57.559 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:18:57.559 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:18:57.559 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:18:57.560 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:18:57.561 INFO:teuthology.orchestra.run.smithi077.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-26T07:18:57.561 INFO:teuthology.orchestra.run.smithi077.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:18:57.561 INFO:teuthology.orchestra.run.smithi077.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:18:57.561 INFO:teuthology.orchestra.run.smithi077.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:18:57.562 INFO:teuthology.orchestra.run.smithi077.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:18:57.565 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:18:57.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:57.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:57.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:57.647 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:18:57.716 INFO:teuthology.orchestra.run.smithi077.stdout:client5280 2023-11-26T07:18:57.716 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:18:57.716 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:57.769 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:18:57.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.976+0000 7f0dc8bd4640 1 Processor -- start 2023-11-26T07:18:57.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.977+0000 7f0dc8bd4640 1 -- start start 2023-11-26T07:18:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.978+0000 7f0dc8bd4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dc406d6c0 0x7f0dc406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.978+0000 7f0dc8bd4640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0dc40cdbf0 0x7f0dc40ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.978+0000 7f0dc8bd4640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc406e060 con 0x7f0dc413d120 2023-11-26T07:18:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.978+0000 7f0dc8bd4640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc413f9e0 con 0x7f0dc40cdbf0 2023-11-26T07:18:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.978+0000 7f0dc8bd4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc413fcc0 con 0x7f0dc406d6c0 2023-11-26T07:18:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.979+0000 7f0dbbfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dc406d6c0 0x7f0dc406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.979+0000 7f0dc3fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0dc40cdbf0 0x7f0dc40ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:57.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.979+0000 7f0dc37fe640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f0dc413d120 0x7f0dc415af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:37952/0 (socket says 172.21.15.77:37952) 2023-11-26T07:18:57.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.979+0000 7f0dc37fe640 1 -- 172.21.15.77:0/855545292 learned_addr learned my addr 172.21.15.77:0/855545292 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:57.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.979+0000 7f0dc2ffd640 1 -- 172.21.15.77:0/855545292 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442497867 0 0) 0x7f0dc406e060 con 0x7f0dc413d120 2023-11-26T07:18:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.979+0000 7f0dc2ffd640 1 -- 172.21.15.77:0/855545292 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db0005730 con 0x7f0dc413d120 2023-11-26T07:18:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.980+0000 7f0dbbfff640 1 -- 172.21.15.77:0/855545292 >> v2:172.21.15.159:3300/0 conn(0x7f0dc40cdbf0 msgr2=0x7f0dc40ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.980+0000 7f0dbbfff640 1 --2- 172.21.15.77:0/855545292 >> v2:172.21.15.159:3300/0 conn(0x7f0dc40cdbf0 0x7f0dc40ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.980+0000 7f0dbbfff640 1 -- 172.21.15.77:0/855545292 >> v1:172.21.15.159:6789/0 conn(0x7f0dc413d120 legacy=0x7f0dc415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.980+0000 7f0dbbfff640 1 -- 172.21.15.77:0/855545292 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc413ffa0 con 0x7f0dc406d6c0 2023-11-26T07:18:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.980+0000 7f0dc3fff640 1 --2- 172.21.15.77:0/855545292 >> v2:172.21.15.159:3300/0 conn(0x7f0dc40cdbf0 0x7f0dc40ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:57.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.982+0000 7f0dbbfff640 1 --2- 172.21.15.77:0/855545292 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dc406d6c0 0x7f0dc406db20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0097a0 tx=0x7f0dac02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=612e0ebca8dc63ea server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.982+0000 7f0dc2ffd640 1 -- 172.21.15.77:0/855545292 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac02e070 con 0x7f0dc406d6c0 2023-11-26T07:18:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.982+0000 7f0dc2ffd640 1 -- 172.21.15.77:0/855545292 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac0315a0 con 0x7f0dc406d6c0 2023-11-26T07:18:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.982+0000 7f0dc2ffd640 1 -- 172.21.15.77:0/855545292 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac031910 con 0x7f0dc406d6c0 2023-11-26T07:18:57.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.983+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/855545292 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dc406d6c0 msgr2=0x7f0dc406db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:57.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.983+0000 7f0dc8bd4640 1 --2- 172.21.15.77:0/855545292 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dc406d6c0 0x7f0dc406db20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0097a0 tx=0x7f0dac02b840 comp rx=0 tx=0).stop 2023-11-26T07:18:57.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.983+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/855545292 shutdown_connections 2023-11-26T07:18:57.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.983+0000 7f0dc8bd4640 1 --2- 172.21.15.77:0/855545292 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dc406d6c0 0x7f0dc406db20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:57.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.983+0000 7f0dc8bd4640 1 --2- 172.21.15.77:0/855545292 >> v2:172.21.15.159:3300/0 conn(0x7f0dc40cdbf0 0x7f0dc40ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:57.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.983+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/855545292 >> 172.21.15.77:0/855545292 conn(0x7f0dc40cb830 msgr2=0x7f0dc40cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:57.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.983+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/855545292 shutdown_connections 2023-11-26T07:18:57.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.983+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/855545292 wait complete. 2023-11-26T07:18:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.985+0000 7f0dc8bd4640 1 Processor -- start 2023-11-26T07:18:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.985+0000 7f0dc8bd4640 1 -- start start 2023-11-26T07:18:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.986+0000 7f0dc8bd4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dc406d6c0 0x7f0dc4158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.986+0000 7f0dc8bd4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dc40cdbf0 0x7f0dc413ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.986+0000 7f0dc8bd4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dc413d120 0x7f0dc4139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.986+0000 7f0dc8bd4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc413b0b0 con 0x7f0dc406d6c0 2023-11-26T07:18:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.986+0000 7f0dc8bd4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4159e70 con 0x7f0dc413d120 2023-11-26T07:18:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.986+0000 7f0dc8bd4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4159260 con 0x7f0dc40cdbf0 2023-11-26T07:18:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.986+0000 7f0dc37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dc406d6c0 0x7f0dc4158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.986+0000 7f0dc37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dc406d6c0 0x7f0dc4158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49470/0 (socket says 172.21.15.77:49470) 2023-11-26T07:18:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.986+0000 7f0dc37fe640 1 -- 172.21.15.77:0/3104841116 learned_addr learned my addr 172.21.15.77:0/3104841116 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.987+0000 7f0dbbfff640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dc40cdbf0 0x7f0dc413ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.987+0000 7f0dc3fff640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dc413d120 0x7f0dc4139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:57.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.987+0000 7f0dc37fe640 1 -- 172.21.15.77:0/3104841116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dc40cdbf0 msgr2=0x7f0dc413ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:57.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.987+0000 7f0dc37fe640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dc40cdbf0 0x7f0dc413ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:57.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.987+0000 7f0dc37fe640 1 -- 172.21.15.77:0/3104841116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dc413d120 msgr2=0x7f0dc4139310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:57.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.987+0000 7f0dc37fe640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dc413d120 0x7f0dc4139310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:57.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.987+0000 7f0dc37fe640 1 -- 172.21.15.77:0/3104841116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc009a70 con 0x7f0dc406d6c0 2023-11-26T07:18:57.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.987+0000 7f0dc37fe640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dc406d6c0 0x7f0dc4158bd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c390 tx=0x7f0db400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:57.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.987+0000 7f0dc0ff9640 1 -- 172.21.15.77:0/3104841116 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4005ce0 con 0x7f0dc406d6c0 2023-11-26T07:18:57.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.988+0000 7f0dc0ff9640 1 -- 172.21.15.77:0/3104841116 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4005e40 con 0x7f0dc406d6c0 2023-11-26T07:18:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.988+0000 7f0dc0ff9640 1 -- 172.21.15.77:0/3104841116 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40072f0 con 0x7f0dc406d6c0 2023-11-26T07:18:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.988+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/3104841116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac009400 con 0x7f0dc406d6c0 2023-11-26T07:18:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.988+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/3104841116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc415a9d0 con 0x7f0dc406d6c0 2023-11-26T07:18:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.989+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/3104841116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc404e840 con 0x7f0dc406d6c0 2023-11-26T07:18:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.990+0000 7f0dc0ff9640 1 -- 172.21.15.77:0/3104841116 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0db4007450 con 0x7f0dc406d6c0 2023-11-26T07:18:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.991+0000 7f0dc0ff9640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0da406ae40 0x7f0da406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.991+0000 7f0dc0ff9640 1 -- 172.21.15.77:0/3104841116 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0db4088ba0 con 0x7f0dc406d6c0 2023-11-26T07:18:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.991+0000 7f0dbbfff640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0da406ae40 0x7f0da406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.992+0000 7f0dbbfff640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0da406ae40 0x7f0da406d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0dac036000 tx=0x7f0dac008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:57.995+0000 7f0dc0ff9640 1 -- 172.21.15.77:0/3104841116 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0db4053ce0 con 0x7f0dc406d6c0 2023-11-26T07:18:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.223+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/3104841116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0dc40cd7d0 con 0x7f0dc406d6c0 2023-11-26T07:18:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.224+0000 7f0dc0ff9640 1 -- 172.21.15.77:0/3104841116 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0db4017020 con 0x7f0dc406d6c0 2023-11-26T07:18:58.227 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:18:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/3104841116 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0da406ae40 msgr2=0x7f0da406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0da406ae40 0x7f0da406d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0dac036000 tx=0x7f0dac008030 comp rx=0 tx=0).stop 2023-11-26T07:18:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/3104841116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dc406d6c0 msgr2=0x7f0dc4158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dc406d6c0 0x7f0dc4158bd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c390 tx=0x7f0db400c850 comp rx=0 tx=0).stop 2023-11-26T07:18:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/3104841116 shutdown_connections 2023-11-26T07:18:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0da406ae40 0x7f0da406d300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0dc413d120 0x7f0dc4139310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dc40cdbf0 0x7f0dc413ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 --2- 172.21.15.77:0/3104841116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dc406d6c0 0x7f0dc4158bd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/3104841116 >> 172.21.15.77:0/3104841116 conn(0x7f0dc40cb830 msgr2=0x7f0dc415e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/3104841116 shutdown_connections 2023-11-26T07:18:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:58.227+0000 7f0dc8bd4640 1 -- 172.21.15.77:0/3104841116 wait complete. 2023-11-26T07:18:58.249 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:18:58.249 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:18:58.250 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-11-26T07:18:58.250 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:18:58.250 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:58.250 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:18:58.250 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:18:58.250 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:18:58.250 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:18:58.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:58.250 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-11-26T07:18:58.311 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:58.311 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:58.311 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:58.311 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:58.312 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42269sec preferred_lft 42269sec 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 5a:27:d9:14:0a:5b brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::5429:19ff:fe3d:266e/64 scope link 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether be:e0:26:a8:90:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::bce0:26ff:fea8:90e7/64 scope link 2023-11-26T07:18:58.313 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:58.314 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:18:58.314 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 5a:27:d9:14:0a:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:18:58.314 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::5827:d9ff:fe14:a5b/64 scope link 2023-11-26T07:18:58.314 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:58.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:58.315 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:18:58.408 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-11-26T07:18:58.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:58.412 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-11-26T07:18:58.466 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-11-26T07:18:58.466 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:18:58.466 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:18:58.466 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:18:58.466 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:18:58.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:58.467 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:18:58.467 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:18:58.467 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:18:58.467 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:18:58.467 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:18:58.467 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:18:58.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:58.651 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-11-26T07:18:58.700 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:18:58.701 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:18:58.701 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:18:58.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:58.702 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-11-26T07:18:58.788 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:58.788 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:58.838 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:18:58.838 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:58.838 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:58.889 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:18:58.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:58.890 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:18:59.025 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:18:59.025 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:18:59.025 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:18:59.046 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:18:59.046 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:18:59.046 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:18:59.046 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:18:59.046 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:18:59.074 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:18:59.074 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:18:59.074 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:18:59.074 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:18:59.074 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:18:59.075 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:18:59.075 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:18:59.075 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:18:59.076 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-26T07:18:59.076 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:18:59.077 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:18:59.077 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:18:59.077 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:18:59.080 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:18:59.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:59.081 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:59.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:59.169 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:18:59.227 INFO:teuthology.orchestra.run.smithi159.stdout:client5286 2023-11-26T07:18:59.227 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:18:59.227 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:59.278 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:18:59.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.489+0000 7f73f829b640 1 Processor -- start 2023-11-26T07:18:59.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.489+0000 7f73f829b640 1 -- start start 2023-11-26T07:18:59.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.491+0000 7f73f829b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f73f00ac840 0x7f73f00ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:59.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.491+0000 7f73f829b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73f00ae650 0x7f73f00aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:59.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.491+0000 7f73f829b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f00aefe0 con 0x7f73f015d4f0 2023-11-26T07:18:59.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.491+0000 7f73f829b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f00b4ef0 con 0x7f73f00ae650 2023-11-26T07:18:59.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.491+0000 7f73f829b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f00b4040 con 0x7f73f00ac840 2023-11-26T07:18:59.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.491+0000 7f73f6838640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73f00ae650 0x7f73f00aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:59.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.491+0000 7f73f6037640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f73f015d4f0 0x7f73f00b5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34762/0 (socket says 172.21.15.77:34762) 2023-11-26T07:18:59.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.492+0000 7f73f6037640 1 -- 172.21.15.77:0/1655190357 learned_addr learned my addr 172.21.15.77:0/1655190357 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:18:59.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.492+0000 7f73f5836640 1 --2- 172.21.15.77:0/1655190357 >> v2:172.21.15.159:3300/0 conn(0x7f73f00ac840 0x7f73f00ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:59.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.492+0000 7f73f6838640 1 -- 172.21.15.77:0/1655190357 >> v2:172.21.15.159:3300/0 conn(0x7f73f00ac840 msgr2=0x7f73f00ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:59.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.492+0000 7f73f6838640 1 --2- 172.21.15.77:0/1655190357 >> v2:172.21.15.159:3300/0 conn(0x7f73f00ac840 0x7f73f00ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:59.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.492+0000 7f73f6838640 1 -- 172.21.15.77:0/1655190357 >> v1:172.21.15.77:6789/0 conn(0x7f73f015d4f0 legacy=0x7f73f00b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:59.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.492+0000 7f73f6838640 1 -- 172.21.15.77:0/1655190357 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f015d8d0 con 0x7f73f00ae650 2023-11-26T07:18:59.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.492+0000 7f73f5035640 1 -- 172.21.15.77:0/1655190357 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792881824 0 0) 0x7f73e0001490 con 0x7f73f015d4f0 2023-11-26T07:18:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.493+0000 7f73f6838640 1 --2- 172.21.15.77:0/1655190357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f00ae650 0x7f73f00aeaa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f73f0074290 tx=0x7f73e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eea5d189d647ea8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.493+0000 7f73f5035640 1 -- 172.21.15.77:0/1655190357 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8031830 con 0x7f73f00ae650 2023-11-26T07:18:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.493+0000 7f73f5035640 1 -- 172.21.15.77:0/1655190357 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8031990 con 0x7f73f00ae650 2023-11-26T07:18:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.493+0000 7f73f5035640 1 -- 172.21.15.77:0/1655190357 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8031d20 con 0x7f73f00ae650 2023-11-26T07:18:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.494+0000 7f73f829b640 1 -- 172.21.15.77:0/1655190357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f00ae650 msgr2=0x7f73f00aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.494+0000 7f73f829b640 1 --2- 172.21.15.77:0/1655190357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f00ae650 0x7f73f00aeaa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f73f0074290 tx=0x7f73e802b8d0 comp rx=0 tx=0).stop 2023-11-26T07:18:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.494+0000 7f73f829b640 1 -- 172.21.15.77:0/1655190357 shutdown_connections 2023-11-26T07:18:59.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.494+0000 7f73f829b640 1 --2- 172.21.15.77:0/1655190357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f00ae650 0x7f73f00aeaa0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:59.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.494+0000 7f73f829b640 1 --2- 172.21.15.77:0/1655190357 >> v2:172.21.15.159:3300/0 conn(0x7f73f00ac840 0x7f73f00ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:59.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.494+0000 7f73f829b640 1 -- 172.21.15.77:0/1655190357 >> 172.21.15.77:0/1655190357 conn(0x7f73f0071d40 msgr2=0x7f73f006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:59.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.494+0000 7f73f829b640 1 -- 172.21.15.77:0/1655190357 shutdown_connections 2023-11-26T07:18:59.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.494+0000 7f73f829b640 1 -- 172.21.15.77:0/1655190357 wait complete. 2023-11-26T07:18:59.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.496+0000 7f73f829b640 1 Processor -- start 2023-11-26T07:18:59.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.496+0000 7f73f829b640 1 -- start start 2023-11-26T07:18:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.497+0000 7f73f829b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73f00ac840 0x7f73f01507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.497+0000 7f73f829b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73f00ae650 0x7f73f0150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.497+0000 7f73f829b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f015d4f0 0x7f73f0140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.497+0000 7f73f829b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0151fc0 con 0x7f73f015d4f0 2023-11-26T07:18:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.497+0000 7f73f829b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f013db60 con 0x7f73f00ac840 2023-11-26T07:18:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.497+0000 7f73f829b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f01513b0 con 0x7f73f00ae650 2023-11-26T07:18:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.497+0000 7f73f6838640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f015d4f0 0x7f73f0140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.497+0000 7f73f6838640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f015d4f0 0x7f73f0140130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49482/0 (socket says 172.21.15.77:49482) 2023-11-26T07:18:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.497+0000 7f73f6838640 1 -- 172.21.15.77:0/1039138189 learned_addr learned my addr 172.21.15.77:0/1039138189 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:18:59.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73f6037640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73f00ac840 0x7f73f01507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:59.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73f6838640 1 -- 172.21.15.77:0/1039138189 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73f00ae650 msgr2=0x7f73f0150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73f6838640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73f00ae650 0x7f73f0150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73f6838640 1 -- 172.21.15.77:0/1039138189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73f00ac840 msgr2=0x7f73f01507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73f6838640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73f00ac840 0x7f73f01507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73f6838640 1 -- 172.21.15.77:0/1039138189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e8009400 con 0x7f73f015d4f0 2023-11-26T07:18:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73f6037640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73f00ac840 0x7f73f01507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73f6838640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f015d4f0 0x7f73f0140130 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f73e802bee0 tx=0x7f73e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73eeffd640 1 -- 172.21.15.77:0/1039138189 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8004230 con 0x7f73f015d4f0 2023-11-26T07:18:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73eeffd640 1 -- 172.21.15.77:0/1039138189 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8004390 con 0x7f73f015d4f0 2023-11-26T07:18:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73eeffd640 1 -- 172.21.15.77:0/1039138189 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e803a920 con 0x7f73f015d4f0 2023-11-26T07:18:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73f829b640 1 -- 172.21.15.77:0/1039138189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f0151690 con 0x7f73f015d4f0 2023-11-26T07:18:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.498+0000 7f73f829b640 1 -- 172.21.15.77:0/1039138189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f0151c50 con 0x7f73f015d4f0 2023-11-26T07:18:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.499+0000 7f73f829b640 1 -- 172.21.15.77:0/1039138189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f0151de0 con 0x7f73f015d4f0 2023-11-26T07:18:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.500+0000 7f73eeffd640 1 -- 172.21.15.77:0/1039138189 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73e803aa80 con 0x7f73f015d4f0 2023-11-26T07:18:59.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.501+0000 7f73eeffd640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73dc06ae40 0x7f73dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:59.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.501+0000 7f73eeffd640 1 -- 172.21.15.77:0/1039138189 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73e80abdc0 con 0x7f73f015d4f0 2023-11-26T07:18:59.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.502+0000 7f73f6037640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73dc06ae40 0x7f73dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:59.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.502+0000 7f73f6037640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73dc06ae40 0x7f73dc06d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f73e00012e0 tx=0x7f73e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:59.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.506+0000 7f73eeffd640 1 -- 172.21.15.77:0/1039138189 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73e8076dd0 con 0x7f73f015d4f0 2023-11-26T07:18:59.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:18:59.737+0000 7f73f829b640 1 -- 172.21.15.77:0/1039138189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f73f0067470 con 0x7f73f015d4f0 2023-11-26T07:19:00.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.702+0000 7f73eeffd640 1 -- 172.21.15.77:0/1039138189 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 136+0+0 (secure 0 0 0) 0x7f73e803ad30 con 0x7f73f015d4f0 2023-11-26T07:19:00.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.706+0000 7f73f829b640 1 -- 172.21.15.77:0/1039138189 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73dc06ae40 msgr2=0x7f73dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:00.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.706+0000 7f73f829b640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73dc06ae40 0x7f73dc06d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f73e00012e0 tx=0x7f73e0009040 comp rx=0 tx=0).stop 2023-11-26T07:19:00.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.706+0000 7f73f829b640 1 -- 172.21.15.77:0/1039138189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f015d4f0 msgr2=0x7f73f0140130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:00.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.706+0000 7f73f829b640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f015d4f0 0x7f73f0140130 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f73e802bee0 tx=0x7f73e80046c0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.706+0000 7f73f829b640 1 -- 172.21.15.77:0/1039138189 shutdown_connections 2023-11-26T07:19:00.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.706+0000 7f73f829b640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73dc06ae40 0x7f73dc06d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.706+0000 7f73f829b640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f015d4f0 0x7f73f0140130 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.706+0000 7f73f829b640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73f00ae650 0x7f73f0150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.706+0000 7f73f829b640 1 --2- 172.21.15.77:0/1039138189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73f00ac840 0x7f73f01507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.707+0000 7f73f829b640 1 -- 172.21.15.77:0/1039138189 >> 172.21.15.77:0/1039138189 conn(0x7f73f0071d40 msgr2=0x7f73f00adf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:00.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.707+0000 7f73f829b640 1 -- 172.21.15.77:0/1039138189 shutdown_connections 2023-11-26T07:19:00.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.707+0000 7f73f829b640 1 -- 172.21.15.77:0/1039138189 wait complete. 2023-11-26T07:19:00.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:19:00.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.948+0000 7fb9be4cf640 1 Processor -- start 2023-11-26T07:19:00.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.948+0000 7fb9be4cf640 1 -- start start 2023-11-26T07:19:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.949+0000 7fb9be4cf640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b815b440 0x7fb9b80cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.949+0000 7fb9be4cf640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb9b80cbf20 0x7fb9b80c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.949+0000 7fb9be4cf640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b80cc3a0 con 0x7fb9b80c57e0 2023-11-26T07:19:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.949+0000 7fb9be4cf640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b815b820 con 0x7fb9b80cbf20 2023-11-26T07:19:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.949+0000 7fb9be4cf640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b815eea0 con 0x7fb9b815b440 2023-11-26T07:19:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.949+0000 7fb9bca6c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb9b80c57e0 0x7fb9b80c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34776/0 (socket says 172.21.15.77:34776) 2023-11-26T07:19:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.949+0000 7fb9bca6c640 1 -- 172.21.15.77:0/2114787958 learned_addr learned my addr 172.21.15.77:0/2114787958 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b7fff640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b815b440 0x7fb9b80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9affff640 1 --2- 172.21.15.77:0/2114787958 >> v2:172.21.15.159:3300/0 conn(0x7fb9b80cbf20 0x7fb9b80c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979943823 0 0) 0x7fb9b0001490 con 0x7fb9b80c57e0 2023-11-26T07:19:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a4003520 con 0x7fb9b80c57e0 2023-11-26T07:19:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2574829284 0 0) 0x7fb9a4003520 con 0x7fb9b80c57e0 2023-11-26T07:19:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b815b440 msgr2=0x7fb9b80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b815b440 0x7fb9b80cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 >> v2:172.21.15.159:3300/0 conn(0x7fb9b80cbf20 msgr2=0x7fb9b80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 --2- 172.21.15.77:0/2114787958 >> v2:172.21.15.159:3300/0 conn(0x7fb9b80cbf20 0x7fb9b80c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b806d600 con 0x7fb9b80c57e0 2023-11-26T07:19:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fb9b0001b80 con 0x7fb9b80c57e0 2023-11-26T07:19:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 >> v1:172.21.15.77:6789/0 conn(0x7fb9b80c57e0 legacy=0x7fb9b80c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 0x7fb9a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b815b440 0x7fb9a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a4004d00 0x7fb9a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.950+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b815b820 con 0x7fb9a4003970 2023-11-26T07:19:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.951+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b815eea0 con 0x7fb9a4004d00 2023-11-26T07:19:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.951+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a400b980 con 0x7fb9b815b440 2023-11-26T07:19:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.951+0000 7fb9b7fff640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 0x7fb9a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.951+0000 7fb9affff640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b815b440 0x7fb9a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.951+0000 7fb9b7fff640 1 -- 172.21.15.77:0/2114787958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b815b440 msgr2=0x7fb9a40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.951+0000 7fb9b7fff640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b815b440 0x7fb9a40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.951+0000 7fb9b7fff640 1 -- 172.21.15.77:0/2114787958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a4004d00 msgr2=0x7fb9a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.951+0000 7fb9b7fff640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a4004d00 0x7fb9a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.951+0000 7fb9b7fff640 1 -- 172.21.15.77:0/2114787958 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a4003520 con 0x7fb9a4003970 2023-11-26T07:19:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.951+0000 7fb9affff640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b815b440 0x7fb9a40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.952+0000 7fb9b7fff640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 0x7fb9a4003d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009ac0 tx=0x7fb9a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8d04a408255022 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.952+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a802c6b0 con 0x7fb9a4003970 2023-11-26T07:19:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.953+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a802c810 con 0x7fb9a4003970 2023-11-26T07:19:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.953+0000 7fb9b77fe640 1 -- 172.21.15.77:0/2114787958 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a802cba0 con 0x7fb9a4003970 2023-11-26T07:19:00.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.953+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2114787958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 msgr2=0x7fb9a4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:00.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.953+0000 7fb9be4cf640 1 --2- 172.21.15.77:0/2114787958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 0x7fb9a4003d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009ac0 tx=0x7fb9a40057f0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.953+0000 7fb9bca6c640 1 -- 172.21.15.77:0/2114787958 reap_dead start 2023-11-26T07:19:00.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.953+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2114787958 shutdown_connections 2023-11-26T07:19:00.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.953+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2114787958 >> 172.21.15.77:0/2114787958 conn(0x7fb9b80b0c50 msgr2=0x7fb9b80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:00.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.953+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2114787958 shutdown_connections 2023-11-26T07:19:00.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.953+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2114787958 wait complete. 2023-11-26T07:19:00.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.955+0000 7fb9be4cf640 1 Processor -- start 2023-11-26T07:19:00.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.955+0000 7fb9be4cf640 1 -- start start 2023-11-26T07:19:00.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.956+0000 7fb9be4cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 0x7fb9b8157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:00.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.956+0000 7fb9be4cf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b814a210 0x7fb9b8149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:00.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.956+0000 7fb9be4cf640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b80b3040 0x7fb9b80b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:00.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.956+0000 7fb9be4cf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8149f80 con 0x7fb9a4003970 2023-11-26T07:19:00.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.956+0000 7fb9be4cf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b80b4030 con 0x7fb9b814a210 2023-11-26T07:19:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.956+0000 7fb9be4cf640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b80b4310 con 0x7fb9b80b3040 2023-11-26T07:19:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.957+0000 7fb9b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 0x7fb9b8157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.957+0000 7fb9b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 0x7fb9b8157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49498/0 (socket says 172.21.15.77:49498) 2023-11-26T07:19:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.957+0000 7fb9b7fff640 1 -- 172.21.15.77:0/2387895374 learned_addr learned my addr 172.21.15.77:0/2387895374 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.957+0000 7fb9affff640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b814a210 0x7fb9b8149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.957+0000 7fb9bca6c640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b80b3040 0x7fb9b80b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:00.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.957+0000 7fb9b7fff640 1 -- 172.21.15.77:0/2387895374 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b80b3040 msgr2=0x7fb9b80b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:00.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.957+0000 7fb9b7fff640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b80b3040 0x7fb9b80b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.957+0000 7fb9b7fff640 1 -- 172.21.15.77:0/2387895374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b814a210 msgr2=0x7fb9b8149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:00.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.957+0000 7fb9b7fff640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b814a210 0x7fb9b8149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:00.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.957+0000 7fb9b7fff640 1 -- 172.21.15.77:0/2387895374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b80b45f0 con 0x7fb9a4003970 2023-11-26T07:19:00.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.957+0000 7fb9bca6c640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b80b3040 0x7fb9b80b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:00.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.958+0000 7fb9b7fff640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 0x7fb9b8157190 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb9a802c250 tx=0x7fb9a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:00.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.958+0000 7fb9b57fa640 1 -- 172.21.15.77:0/2387895374 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8003810 con 0x7fb9a4003970 2023-11-26T07:19:00.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.958+0000 7fb9b57fa640 1 -- 172.21.15.77:0/2387895374 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a8003970 con 0x7fb9a4003970 2023-11-26T07:19:00.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.958+0000 7fb9b57fa640 1 -- 172.21.15.77:0/2387895374 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8003ce0 con 0x7fb9a4003970 2023-11-26T07:19:00.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.958+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2387895374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b80b48d0 con 0x7fb9a4003970 2023-11-26T07:19:00.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.958+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2387895374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b80b3a30 con 0x7fb9a4003970 2023-11-26T07:19:00.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.959+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2387895374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b804e8b0 con 0x7fb9a4003970 2023-11-26T07:19:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.960+0000 7fb9b57fa640 1 -- 172.21.15.77:0/2387895374 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9a8034440 con 0x7fb9a4003970 2023-11-26T07:19:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.961+0000 7fb9b57fa640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb99806ae40 0x7fb99806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.961+0000 7fb9b57fa640 1 -- 172.21.15.77:0/2387895374 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9a80ab920 con 0x7fb9a4003970 2023-11-26T07:19:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.961+0000 7fb9affff640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb99806ae40 0x7fb99806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.962+0000 7fb9affff640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb99806ae40 0x7fb99806d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80c7c80 tx=0x7fb9a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:00.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:00.966+0000 7fb9b57fa640 1 -- 172.21.15.77:0/2387895374 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb9a8076a70 con 0x7fb9a4003970 2023-11-26T07:19:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.163+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2387895374 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b8149f80 con 0x7fb99806ae40 2023-11-26T07:19:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.166+0000 7fb9b57fa640 1 -- 172.21.15.77:0/2387895374 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb9b8149f80 con 0x7fb99806ae40 2023-11-26T07:19:01.169 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-26T07:19:01.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:19:01.169 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cephfs" 2023-11-26T07:19:01.169 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:01.169 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-26T07:19:01.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.169+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2387895374 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb99806ae40 msgr2=0x7fb99806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.169+0000 7fb9be4cf640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb99806ae40 0x7fb99806d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80c7c80 tx=0x7fb9a0008040 comp rx=0 tx=0).stop 2023-11-26T07:19:01.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.170+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2387895374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 msgr2=0x7fb9b8157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.170+0000 7fb9be4cf640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 0x7fb9b8157190 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb9a802c250 tx=0x7fb9a8004730 comp rx=0 tx=0).stop 2023-11-26T07:19:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.170+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2387895374 shutdown_connections 2023-11-26T07:19:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.170+0000 7fb9be4cf640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb99806ae40 0x7fb99806d300 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.170+0000 7fb9be4cf640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9b80b3040 0x7fb9b80b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.170+0000 7fb9be4cf640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9b814a210 0x7fb9b8149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.170+0000 7fb9be4cf640 1 --2- 172.21.15.77:0/2387895374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9a4003970 0x7fb9b8157190 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.170+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2387895374 >> 172.21.15.77:0/2387895374 conn(0x7fb9b80b0c50 msgr2=0x7fb9b80cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.170+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2387895374 shutdown_connections 2023-11-26T07:19:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.170+0000 7fb9be4cf640 1 -- 172.21.15.77:0/2387895374 wait complete. 2023-11-26T07:19:01.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:19:01.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.399+0000 7f1fa0694640 1 Processor -- start 2023-11-26T07:19:01.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.401+0000 7f1fa0694640 1 -- start start 2023-11-26T07:19:01.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1fa0694640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f98072160 0x7f1f9815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1fa0694640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1f980c49f0 0x7f1f9806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1fa0694640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9815ec90 con 0x7f1f9806dc40 2023-11-26T07:19:01.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1fa0694640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9806e0f0 con 0x7f1f980c49f0 2023-11-26T07:19:01.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1fa0694640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980cd530 con 0x7f1f98072160 2023-11-26T07:19:01.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9ec31640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1f9806dc40 0x7f1f980cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34786/0 (socket says 172.21.15.77:34786) 2023-11-26T07:19:01.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9ec31640 1 -- 172.21.15.77:0/2580481840 learned_addr learned my addr 172.21.15.77:0/2580481840 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:01.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9e430640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f98072160 0x7f1f9815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:01.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9dc2f640 1 --2- 172.21.15.77:0/2580481840 >> v2:172.21.15.159:3300/0 conn(0x7f1f980c49f0 0x7f1f9806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:01.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387352653 0 0) 0x7f1f90001110 con 0x7f1f9806dc40 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f80003520 con 0x7f1f9806dc40 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 597752585 0 0) 0x7f1f80003520 con 0x7f1f9806dc40 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f98072160 msgr2=0x7f1f9815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f98072160 0x7f1f9815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 >> v2:172.21.15.159:3300/0 conn(0x7f1f980c49f0 msgr2=0x7f1f9806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 --2- 172.21.15.77:0/2580481840 >> v2:172.21.15.159:3300/0 conn(0x7f1f980c49f0 0x7f1f9806d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f980c4ed0 con 0x7f1f9806dc40 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f1f90001800 con 0x7f1f9806dc40 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9dc2f640 1 --2- 172.21.15.77:0/2580481840 >> v2:172.21.15.159:3300/0 conn(0x7f1f980c49f0 0x7f1f9806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 >> v1:172.21.15.77:6789/0 conn(0x7f1f9806dc40 legacy=0x7f1f980cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f80003970 0x7f1f80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f800047c0 0x7f1f80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f98072160 0x7f1f80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9806e0f0 con 0x7f1f80003970 2023-11-26T07:19:01.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980cd530 con 0x7f1f800047c0 2023-11-26T07:19:01.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.402+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8000db90 con 0x7f1f98072160 2023-11-26T07:19:01.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.403+0000 7f1f9e430640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f80003970 0x7f1f80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:01.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.403+0000 7f1f9ec31640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f98072160 0x7f1f80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:01.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.403+0000 7f1f9e430640 1 -- 172.21.15.77:0/2580481840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f98072160 msgr2=0x7f1f80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:01.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.403+0000 7f1f9e430640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f98072160 0x7f1f80005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.403+0000 7f1f9e430640 1 -- 172.21.15.77:0/2580481840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f800047c0 msgr2=0x7f1f80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:01.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.403+0000 7f1f9e430640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f800047c0 0x7f1f80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.403+0000 7f1f9e430640 1 -- 172.21.15.77:0/2580481840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80003520 con 0x7f1f80003970 2023-11-26T07:19:01.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.403+0000 7f1f9ec31640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f98072160 0x7f1f80005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:01.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.404+0000 7f1f9e430640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f80003970 0x7f1f80003d90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009fc0 tx=0x7f1f800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687edc029f4293a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.405+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8802cc20 con 0x7f1f80003970 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.405+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8800f040 con 0x7f1f80003970 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.405+0000 7f1f9d42e640 1 -- 172.21.15.77:0/2580481840 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88034440 con 0x7f1f80003970 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.405+0000 7f1fa0694640 1 -- 172.21.15.77:0/2580481840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f80003970 msgr2=0x7f1f80003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.405+0000 7f1fa0694640 1 --2- 172.21.15.77:0/2580481840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f80003970 0x7f1f80003d90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009fc0 tx=0x7f1f800057f0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.405+0000 7f1f9ec31640 1 -- 172.21.15.77:0/2580481840 reap_dead start 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.405+0000 7f1fa0694640 1 -- 172.21.15.77:0/2580481840 shutdown_connections 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.405+0000 7f1fa0694640 1 -- 172.21.15.77:0/2580481840 >> 172.21.15.77:0/2580481840 conn(0x7f1f980b0c50 msgr2=0x7f1f980b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.405+0000 7f1fa0694640 1 -- 172.21.15.77:0/2580481840 shutdown_connections 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.405+0000 7f1fa0694640 1 -- 172.21.15.77:0/2580481840 wait complete. 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.407+0000 7f1fa0694640 1 Processor -- start 2023-11-26T07:19:01.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.407+0000 7f1fa0694640 1 -- start start 2023-11-26T07:19:01.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1fa0694640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f80003970 0x7f1f9814ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1fa0694640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9806cae0 0x7f1f9806cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1fa0694640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f980ac720 0x7f1f980acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1fa0694640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9815d3f0 con 0x7f1f9806cae0 2023-11-26T07:19:01.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1fa0694640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980ad110 con 0x7f1f980ac720 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1fa0694640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9815c870 con 0x7f1f80003970 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f9dc2f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9806cae0 0x7f1f9806cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f9dc2f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9806cae0 0x7f1f9806cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49510/0 (socket says 172.21.15.77:49510) 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f9dc2f640 1 -- 172.21.15.77:0/2356997972 learned_addr learned my addr 172.21.15.77:0/2356997972 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f9dc2f640 1 -- 172.21.15.77:0/2356997972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f80003970 msgr2=0x7f1f9814ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f9dc2f640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f80003970 0x7f1f9814ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f9dc2f640 1 -- 172.21.15.77:0/2356997972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f980ac720 msgr2=0x7f1f980acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f9dc2f640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f980ac720 0x7f1f980acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f9dc2f640 1 -- 172.21.15.77:0/2356997972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9815cb50 con 0x7f1f9806cae0 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f9dc2f640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9806cae0 0x7f1f9806cf40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00e7e0 tx=0x7f1f8c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f96ffd640 1 -- 172.21.15.77:0/2356997972 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c004230 con 0x7f1f9806cae0 2023-11-26T07:19:01.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f96ffd640 1 -- 172.21.15.77:0/2356997972 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c00ee90 con 0x7f1f9806cae0 2023-11-26T07:19:01.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1f96ffd640 1 -- 172.21.15.77:0/2356997972 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00c6d0 con 0x7f1f9806cae0 2023-11-26T07:19:01.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.409+0000 7f1fa0694640 1 -- 172.21.15.77:0/2356997972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9815ce30 con 0x7f1f9806cae0 2023-11-26T07:19:01.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.410+0000 7f1fa0694640 1 -- 172.21.15.77:0/2356997972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9814d390 con 0x7f1f9806cae0 2023-11-26T07:19:01.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.411+0000 7f1fa0694640 1 -- 172.21.15.77:0/2356997972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9804e8b0 con 0x7f1f9806cae0 2023-11-26T07:19:01.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.412+0000 7f1f96ffd640 1 -- 172.21.15.77:0/2356997972 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f8c00c830 con 0x7f1f9806cae0 2023-11-26T07:19:01.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.413+0000 7f1f96ffd640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f8406ae40 0x7f1f8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.413+0000 7f1f96ffd640 1 -- 172.21.15.77:0/2356997972 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f8c089230 con 0x7f1f9806cae0 2023-11-26T07:19:01.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.413+0000 7f1f9e430640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f8406ae40 0x7f1f8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:01.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.414+0000 7f1f9e430640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f8406ae40 0x7f1f8406d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1f88036000 tx=0x7f1f8802e070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:01.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.417+0000 7f1f96ffd640 1 -- 172.21.15.77:0/2356997972 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f8c054240 con 0x7f1f9806cae0 2023-11-26T07:19:01.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.607+0000 7f1fa0694640 1 -- 172.21.15.77:0/2356997972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1f9815dab0 con 0x7f1f9806cae0 2023-11-26T07:19:01.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.608+0000 7f1f96ffd640 1 -- 172.21.15.77:0/2356997972 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1f8c057860 con 0x7f1f9806cae0 2023-11-26T07:19:01.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.610+0000 7f1fa0694640 1 -- 172.21.15.77:0/2356997972 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f8406ae40 msgr2=0x7f1f8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.610+0000 7f1fa0694640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f8406ae40 0x7f1f8406d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1f88036000 tx=0x7f1f8802e070 comp rx=0 tx=0).stop 2023-11-26T07:19:01.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.610+0000 7f1fa0694640 1 -- 172.21.15.77:0/2356997972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9806cae0 msgr2=0x7f1f9806cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.610+0000 7f1fa0694640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9806cae0 0x7f1f9806cf40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00e7e0 tx=0x7f1f8c00eca0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.611+0000 7f1fa0694640 1 -- 172.21.15.77:0/2356997972 shutdown_connections 2023-11-26T07:19:01.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.611+0000 7f1fa0694640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f8406ae40 0x7f1f8406d300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.611+0000 7f1fa0694640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f980ac720 0x7f1f980acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.611+0000 7f1fa0694640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9806cae0 0x7f1f9806cf40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.611+0000 7f1fa0694640 1 --2- 172.21.15.77:0/2356997972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f80003970 0x7f1f9814ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.611+0000 7f1fa0694640 1 -- 172.21.15.77:0/2356997972 >> 172.21.15.77:0/2356997972 conn(0x7f1f980b0c50 msgr2=0x7f1f980b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:01.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.611+0000 7f1fa0694640 1 -- 172.21.15.77:0/2356997972 shutdown_connections 2023-11-26T07:19:01.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.611+0000 7f1fa0694640 1 -- 172.21.15.77:0/2356997972 wait complete. 2023-11-26T07:19:01.631 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol1410 --mode=777 2023-11-26T07:19:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.849+0000 7f245c9b7640 1 Processor -- start 2023-11-26T07:19:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.849+0000 7f245c9b7640 1 -- start start 2023-11-26T07:19:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.850+0000 7f245c9b7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f245815c7f0 0x7f245806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.850+0000 7f245c9b7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24580cece0 con 0x7f24580ce6c0 2023-11-26T07:19:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.850+0000 7f245c9b7640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245806d040 con 0x7f24580cf450 2023-11-26T07:19:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.850+0000 7f245c9b7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580ceaf0 con 0x7f245815c7f0 2023-11-26T07:19:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.851+0000 7f245659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f245815c7f0 0x7f245806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.851+0000 7f2456d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f24580ce6c0 0x7f24580714d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34800/0 (socket says 172.21.15.77:34800) 2023-11-26T07:19:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.851+0000 7f245659c640 1 --2- 172.21.15.77:0/1868268378 >> v2:172.21.15.77:3300/0 conn(0x7f245815c7f0 0x7f245806db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49512/0 (socket says 172.21.15.77:49512) 2023-11-26T07:19:01.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.851+0000 7f2456d9d640 1 -- 172.21.15.77:0/1868268378 learned_addr learned my addr 172.21.15.77:0/1868268378 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:01.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.851+0000 7f245659c640 1 -- 172.21.15.77:0/1868268378 >> v1:172.21.15.159:6789/0 conn(0x7f24580cf450 legacy=0x7f24580cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:01.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.851+0000 7f245659c640 1 -- 172.21.15.77:0/1868268378 >> v1:172.21.15.77:6789/0 conn(0x7f24580ce6c0 legacy=0x7f24580714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.851+0000 7f245659c640 1 -- 172.21.15.77:0/1868268378 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245806d320 con 0x7f245815c7f0 2023-11-26T07:19:01.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.852+0000 7f245659c640 1 --2- 172.21.15.77:0/1868268378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245815c7f0 0x7f245806db20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f24480097a0 tx=0x7f244802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b265821c02eeb446 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:01.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.853+0000 7f2455d9b640 1 -- 172.21.15.77:0/1868268378 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448031830 con 0x7f245815c7f0 2023-11-26T07:19:01.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.853+0000 7f2455d9b640 1 -- 172.21.15.77:0/1868268378 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2448031990 con 0x7f245815c7f0 2023-11-26T07:19:01.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.853+0000 7f2455d9b640 1 -- 172.21.15.77:0/1868268378 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448031d20 con 0x7f245815c7f0 2023-11-26T07:19:01.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.853+0000 7f245c9b7640 1 -- 172.21.15.77:0/1868268378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245815c7f0 msgr2=0x7f245806db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.853+0000 7f245c9b7640 1 --2- 172.21.15.77:0/1868268378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245815c7f0 0x7f245806db20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f24480097a0 tx=0x7f244802b8d0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.854+0000 7f245c9b7640 1 -- 172.21.15.77:0/1868268378 shutdown_connections 2023-11-26T07:19:01.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.854+0000 7f245c9b7640 1 --2- 172.21.15.77:0/1868268378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245815c7f0 0x7f245806db20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.854+0000 7f245c9b7640 1 -- 172.21.15.77:0/1868268378 >> 172.21.15.77:0/1868268378 conn(0x7f245806a920 msgr2=0x7f245806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:01.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.854+0000 7f245c9b7640 1 -- 172.21.15.77:0/1868268378 shutdown_connections 2023-11-26T07:19:01.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.854+0000 7f245c9b7640 1 -- 172.21.15.77:0/1868268378 wait complete. 2023-11-26T07:19:01.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.855+0000 7f245c9b7640 1 Processor -- start 2023-11-26T07:19:01.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.856+0000 7f245c9b7640 1 -- start start 2023-11-26T07:19:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.856+0000 7f245c9b7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24580ce6c0 0x7f24581f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.856+0000 7f245c9b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24580cf450 0x7f24581541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.856+0000 7f245c9b7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245815c7f0 0x7f2458154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.856+0000 7f245c9b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458157790 con 0x7f24580cf450 2023-11-26T07:19:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.856+0000 7f245c9b7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24581f46f0 con 0x7f245815c7f0 2023-11-26T07:19:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.856+0000 7f245c9b7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2458156b10 con 0x7f24580ce6c0 2023-11-26T07:19:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.857+0000 7f244ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24580cf450 0x7f24581541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.857+0000 7f244ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24580cf450 0x7f24581541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49514/0 (socket says 172.21.15.77:49514) 2023-11-26T07:19:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.857+0000 7f244ffff640 1 -- 172.21.15.77:0/2420230441 learned_addr learned my addr 172.21.15.77:0/2420230441 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.857+0000 7f2456d9d640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245815c7f0 0x7f2458154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.857+0000 7f245659c640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24580ce6c0 0x7f24581f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:01.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.857+0000 7f244ffff640 1 -- 172.21.15.77:0/2420230441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24580ce6c0 msgr2=0x7f24581f41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.857+0000 7f244ffff640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24580ce6c0 0x7f24581f41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.857+0000 7f244ffff640 1 -- 172.21.15.77:0/2420230441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245815c7f0 msgr2=0x7f2458154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:01.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.857+0000 7f244ffff640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245815c7f0 0x7f2458154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:01.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.857+0000 7f244ffff640 1 -- 172.21.15.77:0/2420230441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448009400 con 0x7f24580cf450 2023-11-26T07:19:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.858+0000 7f244ffff640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24580cf450 0x7f24581541c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f244000c430 tx=0x7f244000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.858+0000 7f244effd640 1 -- 172.21.15.77:0/2420230441 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440011790 con 0x7f24580cf450 2023-11-26T07:19:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.858+0000 7f244effd640 1 -- 172.21.15.77:0/2420230441 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24400118f0 con 0x7f24580cf450 2023-11-26T07:19:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.858+0000 7f244effd640 1 -- 172.21.15.77:0/2420230441 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440011ca0 con 0x7f24580cf450 2023-11-26T07:19:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.858+0000 7f245c9b7640 1 -- 172.21.15.77:0/2420230441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2458156df0 con 0x7f24580cf450 2023-11-26T07:19:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.858+0000 7f245c9b7640 1 -- 172.21.15.77:0/2420230441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24581573b0 con 0x7f24580cf450 2023-11-26T07:19:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.859+0000 7f245c9b7640 1 -- 172.21.15.77:0/2420230441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2458067470 con 0x7f24580cf450 2023-11-26T07:19:01.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.860+0000 7f244effd640 1 -- 172.21.15.77:0/2420230441 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f244001c460 con 0x7f24580cf450 2023-11-26T07:19:01.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.861+0000 7f244effd640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f243806ae40 0x7f243806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:01.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.861+0000 7f244effd640 1 -- 172.21.15.77:0/2420230441 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2440089530 con 0x7f24580cf450 2023-11-26T07:19:01.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.861+0000 7f245659c640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f243806ae40 0x7f243806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:01.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.862+0000 7f245659c640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f243806ae40 0x7f243806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2448036000 tx=0x7f244803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:01.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:01.866+0000 7f244effd640 1 -- 172.21.15.77:0/2420230441 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2440054670 con 0x7f24580cf450 2023-11-26T07:19:02.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.083+0000 7f245c9b7640 1 -- 172.21.15.77:0/2420230441 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol1410", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f245806e060 con 0x7f243806ae40 2023-11-26T07:19:02.091 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:02.090+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:02.091 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:02.090+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:02.091 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:02.090+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:02.092 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:02.090+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:02.092 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:02.090+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:02.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.156+0000 7f244effd640 1 -- 172.21.15.77:0/2420230441 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f244803a420 con 0x7f243806ae40 2023-11-26T07:19:02.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.159+0000 7f245c9b7640 1 -- 172.21.15.77:0/2420230441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f243806ae40 msgr2=0x7f243806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:02.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.159+0000 7f245c9b7640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f243806ae40 0x7f243806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2448036000 tx=0x7f244803c040 comp rx=0 tx=0).stop 2023-11-26T07:19:02.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.159+0000 7f245c9b7640 1 -- 172.21.15.77:0/2420230441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24580cf450 msgr2=0x7f24581541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:02.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.159+0000 7f245c9b7640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24580cf450 0x7f24581541c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f244000c430 tx=0x7f244000c8f0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.160+0000 7f245c9b7640 1 -- 172.21.15.77:0/2420230441 shutdown_connections 2023-11-26T07:19:02.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.160+0000 7f245c9b7640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f243806ae40 0x7f243806d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.160+0000 7f245c9b7640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f245815c7f0 0x7f2458154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.160+0000 7f245c9b7640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24580cf450 0x7f24581541c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.160+0000 7f245c9b7640 1 --2- 172.21.15.77:0/2420230441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24580ce6c0 0x7f24581f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.160+0000 7f245c9b7640 1 -- 172.21.15.77:0/2420230441 >> 172.21.15.77:0/2420230441 conn(0x7f245806a920 msgr2=0x7f24580afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:02.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.160+0000 7f245c9b7640 1 -- 172.21.15.77:0/2420230441 shutdown_connections 2023-11-26T07:19:02.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.160+0000 7f245c9b7640 1 -- 172.21.15.77:0/2420230441 wait complete. 2023-11-26T07:19:02.180 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol1410 2023-11-26T07:19:02.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.386+0000 7f52f03e3640 1 Processor -- start 2023-11-26T07:19:02.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.386+0000 7f52f03e3640 1 -- start start 2023-11-26T07:19:02.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.388+0000 7f52f03e3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52e8146eb0 0x7f52e8161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.388+0000 7f52f03e3640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f52e806e160 0x7f52e80ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.388+0000 7f52f03e3640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e8161a10 con 0x7f52e80cd110 2023-11-26T07:19:02.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.388+0000 7f52f03e3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e80cd580 con 0x7f52e8146eb0 2023-11-26T07:19:02.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.388+0000 7f52f03e3640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e8161cf0 con 0x7f52e806e160 2023-11-26T07:19:02.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.388+0000 7f52ee17f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52e8146eb0 0x7f52e8161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:02.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.389+0000 7f52ee17f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52e8146eb0 0x7f52e8161150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49532/0 (socket says 172.21.15.77:49532) 2023-11-26T07:19:02.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.389+0000 7f52ee17f640 1 -- 172.21.15.77:0/3834595704 learned_addr learned my addr 172.21.15.77:0/3834595704 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:02.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.389+0000 7f52ee17f640 1 -- 172.21.15.77:0/3834595704 >> v2:172.21.15.159:3300/0 conn(0x7f52e806e160 msgr2=0x7f52e80ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:02.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.389+0000 7f52ee17f640 1 --2- 172.21.15.77:0/3834595704 >> v2:172.21.15.159:3300/0 conn(0x7f52e806e160 0x7f52e80ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.389+0000 7f52ee17f640 1 -- 172.21.15.77:0/3834595704 >> v1:172.21.15.159:6789/0 conn(0x7f52e80cd110 legacy=0x7f52e806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.389+0000 7f52ee17f640 1 -- 172.21.15.77:0/3834595704 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8161fd0 con 0x7f52e8146eb0 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.390+0000 7f52ee17f640 1 --2- 172.21.15.77:0/3834595704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8146eb0 0x7f52e8161150 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f52e806eab0 tx=0x7f52e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1ca9ff494aa9c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.390+0000 7f52ed17d640 1 -- 172.21.15.77:0/3834595704 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4031870 con 0x7f52e8146eb0 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.391+0000 7f52ed17d640 1 -- 172.21.15.77:0/3834595704 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e40319d0 con 0x7f52e8146eb0 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.391+0000 7f52ed17d640 1 -- 172.21.15.77:0/3834595704 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4031d60 con 0x7f52e8146eb0 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.391+0000 7f52f03e3640 1 -- 172.21.15.77:0/3834595704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8146eb0 msgr2=0x7f52e8161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.391+0000 7f52f03e3640 1 --2- 172.21.15.77:0/3834595704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8146eb0 0x7f52e8161150 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f52e806eab0 tx=0x7f52e402b910 comp rx=0 tx=0).stop 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.391+0000 7f52f03e3640 1 -- 172.21.15.77:0/3834595704 shutdown_connections 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.391+0000 7f52f03e3640 1 --2- 172.21.15.77:0/3834595704 >> v2:172.21.15.159:3300/0 conn(0x7f52e806e160 0x7f52e80ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.391+0000 7f52f03e3640 1 --2- 172.21.15.77:0/3834595704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8146eb0 0x7f52e8161150 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.391+0000 7f52f03e3640 1 -- 172.21.15.77:0/3834595704 >> 172.21.15.77:0/3834595704 conn(0x7f52e80b0c50 msgr2=0x7f52e80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:02.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.391+0000 7f52f03e3640 1 -- 172.21.15.77:0/3834595704 shutdown_connections 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.391+0000 7f52f03e3640 1 -- 172.21.15.77:0/3834595704 wait complete. 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.393+0000 7f52f03e3640 1 Processor -- start 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.393+0000 7f52f03e3640 1 -- start start 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.394+0000 7f52f03e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e806e160 0x7f52e80b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.394+0000 7f52f03e3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e80cd110 0x7f52e815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.394+0000 7f52f03e3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52e8146eb0 0x7f52e809a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.394+0000 7f52f03e3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e80b4610 con 0x7f52e806e160 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.394+0000 7f52f03e3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e815d2f0 con 0x7f52e80cd110 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.394+0000 7f52f03e3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e80b3570 con 0x7f52e8146eb0 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ee17f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e806e160 0x7f52e80b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ee17f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e806e160 0x7f52e80b2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49540/0 (socket says 172.21.15.77:49540) 2023-11-26T07:19:02.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ee17f640 1 -- 172.21.15.77:0/2907501410 learned_addr learned my addr 172.21.15.77:0/2907501410 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ed97e640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e80cd110 0x7f52e815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ee17f640 1 -- 172.21.15.77:0/2907501410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52e8146eb0 msgr2=0x7f52e809a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ee980640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52e8146eb0 0x7f52e809a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ee17f640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52e8146eb0 0x7f52e809a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ee17f640 1 -- 172.21.15.77:0/2907501410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e80cd110 msgr2=0x7f52e815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ee17f640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e80cd110 0x7f52e815cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ee17f640 1 -- 172.21.15.77:0/2907501410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40094d0 con 0x7f52e806e160 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ed97e640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e80cd110 0x7f52e815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ee980640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52e8146eb0 0x7f52e809a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.395+0000 7f52ee17f640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e806e160 0x7f52e80b2f00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f52e4000c00 tx=0x7f52e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.396+0000 7f52daffd640 1 -- 172.21.15.77:0/2907501410 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e403ad10 con 0x7f52e806e160 2023-11-26T07:19:02.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.396+0000 7f52daffd640 1 -- 172.21.15.77:0/2907501410 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e403ae70 con 0x7f52e806e160 2023-11-26T07:19:02.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.396+0000 7f52daffd640 1 -- 172.21.15.77:0/2907501410 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4044610 con 0x7f52e806e160 2023-11-26T07:19:02.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.396+0000 7f52f03e3640 1 -- 172.21.15.77:0/2907501410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e80b3850 con 0x7f52e806e160 2023-11-26T07:19:02.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.396+0000 7f52f03e3640 1 -- 172.21.15.77:0/2907501410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e80b3e10 con 0x7f52e806e160 2023-11-26T07:19:02.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.397+0000 7f52f03e3640 1 -- 172.21.15.77:0/2907501410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e804e8b0 con 0x7f52e806e160 2023-11-26T07:19:02.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.398+0000 7f52daffd640 1 -- 172.21.15.77:0/2907501410 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52e4044770 con 0x7f52e806e160 2023-11-26T07:19:02.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.399+0000 7f52daffd640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f52cc06ae70 0x7f52cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.399+0000 7f52daffd640 1 -- 172.21.15.77:0/2907501410 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52e402d040 con 0x7f52e806e160 2023-11-26T07:19:02.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.399+0000 7f52ed97e640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f52cc06ae70 0x7f52cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:02.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.400+0000 7f52ed97e640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f52cc06ae70 0x7f52cc06d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f52dc006fd0 tx=0x7f52dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:02.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.403+0000 7f52daffd640 1 -- 172.21.15.77:0/2907501410 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52e4077000 con 0x7f52e806e160 2023-11-26T07:19:02.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.621+0000 7f52f03e3640 1 -- 172.21.15.77:0/2907501410 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol1410", "target": ["mon-mgr", ""]}) v1 -- 0x7f52e8161690 con 0x7f52cc06ae70 2023-11-26T07:19:02.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.632+0000 7f52daffd640 1 -- 172.21.15.77:0/2907501410 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f52dc00ae20 con 0x7f52cc06ae70 2023-11-26T07:19:02.634 INFO:teuthology.orchestra.run.smithi077.stdout:/volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf 2023-11-26T07:19:02.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.634+0000 7f52f03e3640 1 -- 172.21.15.77:0/2907501410 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f52cc06ae70 msgr2=0x7f52cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:02.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.634+0000 7f52f03e3640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f52cc06ae70 0x7f52cc06d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f52dc006fd0 tx=0x7f52dc008040 comp rx=0 tx=0).stop 2023-11-26T07:19:02.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.635+0000 7f52f03e3640 1 -- 172.21.15.77:0/2907501410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e806e160 msgr2=0x7f52e80b2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:02.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.635+0000 7f52f03e3640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e806e160 0x7f52e80b2f00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f52e4000c00 tx=0x7f52e40046c0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.635+0000 7f52f03e3640 1 -- 172.21.15.77:0/2907501410 shutdown_connections 2023-11-26T07:19:02.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.635+0000 7f52f03e3640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f52cc06ae70 0x7f52cc06d330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.635+0000 7f52f03e3640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52e8146eb0 0x7f52e809a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.635+0000 7f52f03e3640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e80cd110 0x7f52e815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.635+0000 7f52f03e3640 1 --2- 172.21.15.77:0/2907501410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e806e160 0x7f52e80b2f00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.635+0000 7f52f03e3640 1 -- 172.21.15.77:0/2907501410 >> 172.21.15.77:0/2907501410 conn(0x7f52e80b0c50 msgr2=0x7f52e80aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:02.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.635+0000 7f52f03e3640 1 -- 172.21.15.77:0/2907501410 shutdown_connections 2023-11-26T07:19:02.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:02.635+0000 7f52f03e3640 1 -- 172.21.15.77:0/2907501410 wait complete. 2023-11-26T07:19:02.655 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol1410 with 200 files each 1MB size under directory volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf 2023-11-26T07:19:02.655 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:02.655 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:02.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:02.707 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:02.875 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:02.875 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:02.875 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0482292 s, 21.7 MB/s 2023-11-26T07:19:02.877 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:02.877 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:02.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:02.935 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:03.029 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:03.029 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:03.029 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0402335 s, 26.1 MB/s 2023-11-26T07:19:03.031 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:03.031 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:03.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:03.084 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:03.161 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:03.161 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:03.161 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243218 s, 43.1 MB/s 2023-11-26T07:19:03.162 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:03.163 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:03.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:03.216 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:03.304 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:03.304 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:03.304 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032992 s, 31.8 MB/s 2023-11-26T07:19:03.305 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:03.305 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:03.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:03.355 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:03.492 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:03.492 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:03.492 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0360522 s, 29.1 MB/s 2023-11-26T07:19:03.494 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:03.494 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:03.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:03.554 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:03.635 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:03.636 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:03.636 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025482 s, 41.1 MB/s 2023-11-26T07:19:03.638 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:03.638 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:03.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:03.696 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:03.774 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:03.774 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:03.774 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212995 s, 49.2 MB/s 2023-11-26T07:19:03.775 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:03.775 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:03.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:03.827 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:03.954 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:03.955 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:03.955 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287148 s, 36.5 MB/s 2023-11-26T07:19:03.956 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:03.956 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:04.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:04.015 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:04.093 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:04.093 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:04.094 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237076 s, 44.2 MB/s 2023-11-26T07:19:04.095 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:04.095 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:04.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:04.153 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:04.262 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:04.262 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:04.262 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0534339 s, 19.6 MB/s 2023-11-26T07:19:04.264 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:04.264 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:04.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:04.318 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:04.395 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:04.395 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:04.395 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231516 s, 45.3 MB/s 2023-11-26T07:19:04.396 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:04.396 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:04.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:04.455 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:04.530 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:04.530 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:04.530 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180178 s, 58.2 MB/s 2023-11-26T07:19:04.530 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:04.531 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:04.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:04.585 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:04.665 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:04.665 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:04.665 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240513 s, 43.6 MB/s 2023-11-26T07:19:04.666 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:04.666 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:04.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:04.722 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:04.806 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:04.806 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:04.806 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021571 s, 48.6 MB/s 2023-11-26T07:19:04.807 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:04.808 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:04.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:04.864 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:04.947 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:04.947 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278172 s, 37.7 MB/s 2023-11-26T07:19:04.948 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:04.948 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:05.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:05.007 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:05.089 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:05.089 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:05.089 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241814 s, 43.4 MB/s 2023-11-26T07:19:05.090 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:05.090 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:05.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:05.149 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:05.227 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:05.227 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:05.227 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218273 s, 48.0 MB/s 2023-11-26T07:19:05.229 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:05.229 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:05.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:05.286 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:05.364 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:05.365 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:05.365 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235942 s, 44.4 MB/s 2023-11-26T07:19:05.366 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:05.366 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:05.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:05.423 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:05.507 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:05.508 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:05.508 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293662 s, 35.7 MB/s 2023-11-26T07:19:05.509 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:05.509 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:05.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:05.563 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:05.648 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:05.648 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:05.648 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321218 s, 32.6 MB/s 2023-11-26T07:19:05.650 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:05.650 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:05.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:05.701 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:05.847 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:05.847 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:05.847 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0448861 s, 23.4 MB/s 2023-11-26T07:19:05.849 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:05.849 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:05.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:05.907 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:05.982 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:05.982 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:05.982 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203642 s, 51.5 MB/s 2023-11-26T07:19:05.983 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:05.984 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:06.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:06.038 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:06.123 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:06.123 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:06.123 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311793 s, 33.6 MB/s 2023-11-26T07:19:06.125 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:06.125 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:06.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:06.179 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:06.254 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:06.254 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:06.255 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240673 s, 43.6 MB/s 2023-11-26T07:19:06.256 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:06.256 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:06.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:06.313 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:06.386 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:06.386 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:06.386 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198834 s, 52.7 MB/s 2023-11-26T07:19:06.388 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:06.388 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:06.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:06.445 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028093 s, 37.3 MB/s 2023-11-26T07:19:06.530 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:06.530 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:06.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:06.586 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:06.665 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:06.665 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:06.665 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026106 s, 40.2 MB/s 2023-11-26T07:19:06.666 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:06.666 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:06.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:06.725 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:06.814 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:06.814 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:06.814 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340446 s, 30.8 MB/s 2023-11-26T07:19:06.816 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:06.816 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:06.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:06.876 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:06.958 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:06.959 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:06.959 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272251 s, 38.5 MB/s 2023-11-26T07:19:06.960 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:06.960 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:07.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:07.017 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:07.108 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:07.108 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:07.108 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358111 s, 29.3 MB/s 2023-11-26T07:19:07.110 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:07.110 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:07.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:07.164 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227254 s, 46.1 MB/s 2023-11-26T07:19:07.241 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:07.241 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:07.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:07.293 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:07.373 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:07.373 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:07.374 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247995 s, 42.3 MB/s 2023-11-26T07:19:07.375 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:07.375 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:07.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:07.433 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:07.527 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:07.527 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:07.527 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239435 s, 43.8 MB/s 2023-11-26T07:19:07.528 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:07.528 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:07.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:07.601 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:07.692 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:07.692 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:07.692 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272717 s, 38.4 MB/s 2023-11-26T07:19:07.694 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:07.694 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:07.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:07.761 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:07.852 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:07.852 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:07.852 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264749 s, 39.6 MB/s 2023-11-26T07:19:07.854 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:07.854 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:07.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:07.914 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:08.004 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:08.004 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:08.004 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262756 s, 39.9 MB/s 2023-11-26T07:19:08.005 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:08.005 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:08.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:08.067 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299878 s, 35.0 MB/s 2023-11-26T07:19:08.155 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:08.155 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:08.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:08.212 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261515 s, 40.1 MB/s 2023-11-26T07:19:08.295 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:08.295 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:08.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:08.354 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:08.430 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:08.430 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:08.430 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241858 s, 43.4 MB/s 2023-11-26T07:19:08.432 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:08.432 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:08.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:08.489 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033103 s, 31.7 MB/s 2023-11-26T07:19:08.582 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:08.582 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:08.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:08.639 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:08.721 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:08.721 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:08.722 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267383 s, 39.2 MB/s 2023-11-26T07:19:08.723 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:08.723 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:08.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:08.776 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:08.855 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:08.855 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:08.855 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249853 s, 42.0 MB/s 2023-11-26T07:19:08.856 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:08.857 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:08.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:08.903 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:09.022 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:09.022 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:09.022 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189235 s, 55.4 MB/s 2023-11-26T07:19:09.024 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:09.024 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:09.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:09.082 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:09.162 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:09.162 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:09.162 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023541 s, 44.5 MB/s 2023-11-26T07:19:09.164 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:09.164 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:09.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:09.221 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:09.300 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:09.300 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:09.301 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248198 s, 42.2 MB/s 2023-11-26T07:19:09.302 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:09.303 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:09.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:09.360 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:09.440 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:09.440 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:09.440 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255268 s, 41.1 MB/s 2023-11-26T07:19:09.442 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:09.442 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:09.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:09.492 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:09.614 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:09.614 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266937 s, 39.3 MB/s 2023-11-26T07:19:09.615 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:09.616 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:09.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:09.673 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:09.755 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:09.755 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:09.755 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268521 s, 39.1 MB/s 2023-11-26T07:19:09.757 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:09.757 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:09.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:09.815 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:09.895 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:09.895 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:09.896 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257686 s, 40.7 MB/s 2023-11-26T07:19:09.897 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:09.897 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:09.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:09.954 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:10.032 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:10.032 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:10.032 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237069 s, 44.2 MB/s 2023-11-26T07:19:10.034 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:10.034 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:10.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:10.091 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:10.169 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:10.170 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:10.170 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248572 s, 42.2 MB/s 2023-11-26T07:19:10.171 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:10.171 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:10.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:10.228 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:10.305 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202437 s, 51.8 MB/s 2023-11-26T07:19:10.306 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:10.306 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:10.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:10.359 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:10.434 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:10.434 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:10.434 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225317 s, 46.5 MB/s 2023-11-26T07:19:10.436 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:10.436 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:10.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:10.489 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:10.555 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:10.555 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:10.555 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156364 s, 67.1 MB/s 2023-11-26T07:19:10.556 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:10.556 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:10.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:10.604 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:10.733 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:10.733 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:10.733 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259602 s, 40.4 MB/s 2023-11-26T07:19:10.735 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:10.735 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:10.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:10.792 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:10.874 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:10.874 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:10.874 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269851 s, 38.9 MB/s 2023-11-26T07:19:10.876 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:10.876 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:10.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:10.932 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:11.011 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:11.011 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:11.011 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223002 s, 47.0 MB/s 2023-11-26T07:19:11.013 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:11.013 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:11.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:11.072 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257661 s, 40.7 MB/s 2023-11-26T07:19:11.154 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:11.154 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:11.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:11.209 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:11.290 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229081 s, 45.8 MB/s 2023-11-26T07:19:11.291 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:11.291 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:11.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:11.348 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:11.427 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:11.427 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:11.427 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257657 s, 40.7 MB/s 2023-11-26T07:19:11.429 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:11.429 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:11.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:11.485 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:11.562 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:11.562 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:11.562 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219477 s, 47.8 MB/s 2023-11-26T07:19:11.564 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:11.564 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:11.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:11.621 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:11.698 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:11.698 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:11.698 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240707 s, 43.6 MB/s 2023-11-26T07:19:11.700 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:11.700 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:11.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:11.757 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:11.835 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:11.835 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:11.835 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239019 s, 43.9 MB/s 2023-11-26T07:19:11.836 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:11.836 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:11.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:11.890 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:11.966 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:11.966 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:11.966 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245975 s, 42.6 MB/s 2023-11-26T07:19:11.968 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:11.968 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:12.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:12.022 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291204 s, 36.0 MB/s 2023-11-26T07:19:12.105 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:12.106 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:12.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:12.163 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:12.239 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:12.239 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:12.239 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226753 s, 46.2 MB/s 2023-11-26T07:19:12.240 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:12.241 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:12.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:12.295 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:12.368 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:12.369 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:12.369 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022882 s, 45.8 MB/s 2023-11-26T07:19:12.370 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:12.370 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:12.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:12.420 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:12.494 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:12.494 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:12.494 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218319 s, 48.0 MB/s 2023-11-26T07:19:12.496 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:12.496 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:12.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:12.550 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:12.623 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023387 s, 44.8 MB/s 2023-11-26T07:19:12.625 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:12.625 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:12.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:12.678 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:12.750 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:12.750 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:12.750 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240448 s, 43.6 MB/s 2023-11-26T07:19:12.752 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:12.752 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:12.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:12.804 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:12.887 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:12.888 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:12.888 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293973 s, 35.7 MB/s 2023-11-26T07:19:12.889 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:12.889 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:12.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:12.946 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:13.026 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:13.026 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:13.027 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279063 s, 37.6 MB/s 2023-11-26T07:19:13.028 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:13.028 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:13.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:13.085 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:13.160 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:13.160 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:13.160 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227074 s, 46.2 MB/s 2023-11-26T07:19:13.161 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:13.162 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:13.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:13.218 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:13.305 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:13.306 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:13.306 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327476 s, 32.0 MB/s 2023-11-26T07:19:13.307 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:13.307 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:13.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:13.364 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:13.453 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:13.453 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:13.453 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325031 s, 32.3 MB/s 2023-11-26T07:19:13.454 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:13.454 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:13.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:13.511 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:13.587 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:13.588 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:13.588 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210486 s, 49.8 MB/s 2023-11-26T07:19:13.589 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:13.589 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:13.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:13.643 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:13.729 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:13.729 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:13.729 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302553 s, 34.7 MB/s 2023-11-26T07:19:13.730 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:13.731 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:13.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:13.789 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:13.871 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:13.871 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264605 s, 39.6 MB/s 2023-11-26T07:19:13.872 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:13.872 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:13.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:13.927 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231625 s, 45.3 MB/s 2023-11-26T07:19:14.006 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:14.006 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:14.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:14.064 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:14.145 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:14.145 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:14.145 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025751 s, 40.7 MB/s 2023-11-26T07:19:14.147 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:14.147 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:14.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:14.205 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225464 s, 46.5 MB/s 2023-11-26T07:19:14.284 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:14.284 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:14.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:14.342 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:14.418 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:14.418 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:14.418 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208206 s, 50.4 MB/s 2023-11-26T07:19:14.419 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:14.419 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:14.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:14.476 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:14.557 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:14.557 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:14.557 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226932 s, 46.2 MB/s 2023-11-26T07:19:14.559 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:14.559 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:14.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:14.618 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260455 s, 40.3 MB/s 2023-11-26T07:19:14.701 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:14.701 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:14.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:14.758 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:14.837 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:14.837 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:14.837 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240845 s, 43.5 MB/s 2023-11-26T07:19:14.839 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:14.839 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:14.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:14.894 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246739 s, 42.5 MB/s 2023-11-26T07:19:14.975 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:14.975 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:15.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:15.032 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305523 s, 34.3 MB/s 2023-11-26T07:19:15.121 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:15.121 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:15.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:15.180 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:15.260 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246882 s, 42.5 MB/s 2023-11-26T07:19:15.262 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:15.262 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:15.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:15.315 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:15.439 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:15.439 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:15.439 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246361 s, 42.6 MB/s 2023-11-26T07:19:15.441 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:15.441 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:15.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:15.499 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345491 s, 30.4 MB/s 2023-11-26T07:19:15.591 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:15.591 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:15.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:15.649 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:15.727 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:15.727 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:15.727 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246266 s, 42.6 MB/s 2023-11-26T07:19:15.729 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:15.729 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:15.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:15.786 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:15.865 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:15.866 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:15.866 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213138 s, 49.2 MB/s 2023-11-26T07:19:15.867 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:15.867 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:15.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:15.927 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227245 s, 46.1 MB/s 2023-11-26T07:19:16.007 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:16.007 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:16.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.063 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:16.146 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297508 s, 35.2 MB/s 2023-11-26T07:19:16.148 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:16.148 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:16.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.204 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:16.282 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:16.283 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:16.283 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247247 s, 42.4 MB/s 2023-11-26T07:19:16.284 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:16.284 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:16.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.341 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:16.419 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:16.419 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:16.419 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022953 s, 45.7 MB/s 2023-11-26T07:19:16.420 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:16.420 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:16.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.472 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:16.543 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:16.544 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:16.544 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199425 s, 52.6 MB/s 2023-11-26T07:19:16.545 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:16.545 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:16.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.595 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:16.671 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:16.671 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:16.672 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242419 s, 43.3 MB/s 2023-11-26T07:19:16.673 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:16.673 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:16.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.729 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:16.807 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:16.807 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:16.807 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025747 s, 40.7 MB/s 2023-11-26T07:19:16.809 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:16.809 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:16.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.864 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:16.943 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:16.943 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:16.943 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252439 s, 41.5 MB/s 2023-11-26T07:19:16.945 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:16.945 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:17.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.003 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:17.084 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:17.084 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238119 s, 44.0 MB/s 2023-11-26T07:19:17.085 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:17.085 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:17.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.141 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:17.218 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:17.218 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:17.218 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242952 s, 43.2 MB/s 2023-11-26T07:19:17.220 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:17.220 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:17.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.277 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:17.354 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:17.354 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:17.354 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224393 s, 46.7 MB/s 2023-11-26T07:19:17.355 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:17.355 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:17.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.411 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:17.498 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:17.498 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315956 s, 33.2 MB/s 2023-11-26T07:19:17.500 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:17.500 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:17.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.554 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:17.629 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:17.630 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:17.630 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212207 s, 49.4 MB/s 2023-11-26T07:19:17.631 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:17.631 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:17.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.690 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:17.768 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221284 s, 47.4 MB/s 2023-11-26T07:19:17.769 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:17.769 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:17.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.820 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:17.890 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:17.890 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:17.890 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203177 s, 51.6 MB/s 2023-11-26T07:19:17.892 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:17.892 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:17.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.943 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:18.021 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:18.021 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:18.022 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251583 s, 41.7 MB/s 2023-11-26T07:19:18.023 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:18.023 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:18.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.080 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:18.165 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031173 s, 33.6 MB/s 2023-11-26T07:19:18.167 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:18.167 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:18.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.220 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:18.343 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:18.344 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:18.344 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235365 s, 44.6 MB/s 2023-11-26T07:19:18.345 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:18.346 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:18.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.404 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:18.489 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:18.489 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:18.489 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254391 s, 41.2 MB/s 2023-11-26T07:19:18.491 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:18.491 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:18.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.548 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:18.626 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:18.626 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:18.626 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224836 s, 46.6 MB/s 2023-11-26T07:19:18.628 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:18.628 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:18.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.684 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:18.760 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:18.760 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:18.760 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242794 s, 43.2 MB/s 2023-11-26T07:19:18.762 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:18.762 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:18.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.814 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:18.892 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:18.892 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:18.892 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258773 s, 40.5 MB/s 2023-11-26T07:19:18.894 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:18.894 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:18.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.952 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031377 s, 33.4 MB/s 2023-11-26T07:19:19.041 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:19.041 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:19.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:19.097 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:19.174 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:19.174 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:19.175 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241996 s, 43.3 MB/s 2023-11-26T07:19:19.176 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:19.176 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:19.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:19.233 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:19.308 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:19.309 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:19.309 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201256 s, 52.1 MB/s 2023-11-26T07:19:19.310 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:19.311 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:19.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:19.368 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:19.447 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:19.447 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:19.447 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228343 s, 45.9 MB/s 2023-11-26T07:19:19.449 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:19.449 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:19.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:19.504 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:19.581 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:19.581 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:19.581 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023412 s, 44.8 MB/s 2023-11-26T07:19:19.583 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:19.583 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:19.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:19.639 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:19.724 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:19.724 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:19.724 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295578 s, 35.5 MB/s 2023-11-26T07:19:19.726 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:19.726 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:19.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:19.783 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:19.862 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:19.862 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:19.863 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236146 s, 44.4 MB/s 2023-11-26T07:19:19.864 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:19.864 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:19.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:19.921 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:19.998 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:19.998 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:19.998 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245331 s, 42.7 MB/s 2023-11-26T07:19:20.000 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:20.000 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:20.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:20.058 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237951 s, 44.1 MB/s 2023-11-26T07:19:20.137 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:20.137 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:20.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:20.192 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266269 s, 39.4 MB/s 2023-11-26T07:19:20.278 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:20.278 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:20.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:20.336 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:20.414 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:20.414 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:20.414 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029557 s, 35.5 MB/s 2023-11-26T07:19:20.416 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:20.416 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:20.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:20.474 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:20.555 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:20.555 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:20.555 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269865 s, 38.9 MB/s 2023-11-26T07:19:20.557 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:20.557 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:20.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:20.615 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:20.695 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:20.695 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:20.695 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279084 s, 37.6 MB/s 2023-11-26T07:19:20.697 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:20.697 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:20.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:20.754 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:20.832 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:20.832 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:20.833 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232408 s, 45.1 MB/s 2023-11-26T07:19:20.834 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:20.834 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:20.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:20.891 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:20.970 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024074 s, 43.6 MB/s 2023-11-26T07:19:20.972 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:20.972 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:21.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:21.031 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:21.120 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:21.120 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:21.120 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308915 s, 33.9 MB/s 2023-11-26T07:19:21.122 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:21.122 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:21.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:21.176 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:21.254 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:21.254 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:21.254 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298518 s, 35.1 MB/s 2023-11-26T07:19:21.256 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:21.256 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:21.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:21.313 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235562 s, 44.5 MB/s 2023-11-26T07:19:21.394 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:21.394 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:21.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:21.449 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:21.526 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:21.526 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:21.526 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218279 s, 48.0 MB/s 2023-11-26T07:19:21.528 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:21.528 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:21.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:21.583 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:21.662 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:21.662 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:21.662 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250107 s, 41.9 MB/s 2023-11-26T07:19:21.663 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:21.663 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:21.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:21.720 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:21.801 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:21.801 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:21.801 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255708 s, 41.0 MB/s 2023-11-26T07:19:21.802 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:21.802 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:21.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:21.861 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:21.949 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:21.949 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:21.949 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309992 s, 33.8 MB/s 2023-11-26T07:19:21.951 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:21.951 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.007 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.091 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:22.091 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:22.091 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284274 s, 36.9 MB/s 2023-11-26T07:19:22.093 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:22.093 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.146 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.272 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:22.273 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:22.273 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228435 s, 45.9 MB/s 2023-11-26T07:19:22.274 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:22.274 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.331 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.411 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:22.412 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:22.412 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234176 s, 44.8 MB/s 2023-11-26T07:19:22.413 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:22.413 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.469 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.545 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:22.545 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:22.545 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250245 s, 41.9 MB/s 2023-11-26T07:19:22.547 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:22.547 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.600 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.674 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:22.674 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:22.674 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213983 s, 49.0 MB/s 2023-11-26T07:19:22.676 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:22.676 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.734 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.817 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:22.817 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:22.817 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027886 s, 37.6 MB/s 2023-11-26T07:19:22.819 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:22.819 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.875 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.953 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:22.953 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:22.953 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209328 s, 50.1 MB/s 2023-11-26T07:19:22.955 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:22.955 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.009 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.077 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:23.078 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:23.078 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189073 s, 55.5 MB/s 2023-11-26T07:19:23.078 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:23.078 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.131 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233901 s, 44.8 MB/s 2023-11-26T07:19:23.213 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:23.213 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.269 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.348 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:23.349 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:23.349 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255559 s, 41.0 MB/s 2023-11-26T07:19:23.350 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:23.350 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.402 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.524 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:23.524 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:23.524 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209727 s, 50.0 MB/s 2023-11-26T07:19:23.526 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:23.526 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.581 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.671 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:23.671 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:23.671 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347549 s, 30.2 MB/s 2023-11-26T07:19:23.673 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:23.673 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.725 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.801 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:23.801 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:23.801 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256334 s, 40.9 MB/s 2023-11-26T07:19:23.803 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:23.803 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.860 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.936 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:23.936 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:23.936 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193986 s, 54.1 MB/s 2023-11-26T07:19:23.938 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:23.938 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.994 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.075 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:24.076 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:24.076 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266313 s, 39.4 MB/s 2023-11-26T07:19:24.077 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:24.077 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.134 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.215 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:24.215 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:24.215 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249736 s, 42.0 MB/s 2023-11-26T07:19:24.217 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:24.217 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.272 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.351 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:24.351 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:24.351 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230607 s, 45.5 MB/s 2023-11-26T07:19:24.352 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:24.352 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.404 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.477 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:24.478 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:24.478 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229441 s, 45.7 MB/s 2023-11-26T07:19:24.479 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:24.479 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.535 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.613 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:24.614 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:24.614 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243803 s, 43.0 MB/s 2023-11-26T07:19:24.615 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:24.615 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.673 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.750 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:24.750 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:24.750 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022537 s, 46.5 MB/s 2023-11-26T07:19:24.751 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:24.751 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.799 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023463 s, 44.7 MB/s 2023-11-26T07:19:24.927 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:24.927 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.986 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203245 s, 51.6 MB/s 2023-11-26T07:19:25.063 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:25.063 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.119 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.166 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:19:25.172 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:19:25.197 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:25.197 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:25.197 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021204 s, 49.5 MB/s 2023-11-26T07:19:25.198 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:25.198 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.285 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.448 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:25.448 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:25.448 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348464 s, 30.1 MB/s 2023-11-26T07:19:25.450 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:25.450 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.508 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021908 s, 47.9 MB/s 2023-11-26T07:19:25.587 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:25.587 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.641 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.726 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:25.726 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:25.726 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268243 s, 39.1 MB/s 2023-11-26T07:19:25.728 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:25.728 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.786 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.868 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:25.868 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:25.868 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025068 s, 41.8 MB/s 2023-11-26T07:19:25.869 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:25.870 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.929 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248618 s, 42.2 MB/s 2023-11-26T07:19:26.011 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:26.011 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.069 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.160 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:26.161 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:26.161 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331201 s, 31.7 MB/s 2023-11-26T07:19:26.162 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:26.162 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.220 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.298 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:26.298 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:26.298 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246501 s, 42.5 MB/s 2023-11-26T07:19:26.299 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:26.300 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.359 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.439 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:26.439 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:26.439 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242419 s, 43.3 MB/s 2023-11-26T07:19:26.441 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:26.441 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.496 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.581 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:26.581 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:26.581 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338233 s, 31.0 MB/s 2023-11-26T07:19:26.583 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:26.583 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.637 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.714 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:26.714 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:26.714 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235366 s, 44.6 MB/s 2023-11-26T07:19:26.715 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:26.716 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.772 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.853 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:26.853 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:26.853 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269122 s, 39.0 MB/s 2023-11-26T07:19:26.854 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:26.854 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.914 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.992 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:26.993 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:26.993 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213952 s, 49.0 MB/s 2023-11-26T07:19:26.994 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:26.994 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.045 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.130 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:27.130 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:27.130 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308152 s, 34.0 MB/s 2023-11-26T07:19:27.132 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:27.132 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.189 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.267 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:27.267 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:27.267 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223812 s, 46.9 MB/s 2023-11-26T07:19:27.269 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:27.269 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.325 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.405 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:27.405 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:27.405 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237452 s, 44.2 MB/s 2023-11-26T07:19:27.407 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:27.407 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.463 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.538 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:27.538 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:27.538 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211752 s, 49.5 MB/s 2023-11-26T07:19:27.540 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:27.540 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.598 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.684 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:27.684 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:27.684 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248681 s, 42.2 MB/s 2023-11-26T07:19:27.686 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:27.686 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.739 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.864 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:27.864 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:27.864 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219263 s, 47.8 MB/s 2023-11-26T07:19:27.866 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:27.866 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.926 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.999 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:27.999 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:28.000 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231722 s, 45.3 MB/s 2023-11-26T07:19:28.001 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:28.001 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.058 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.136 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:28.136 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:28.136 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241032 s, 43.5 MB/s 2023-11-26T07:19:28.137 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:28.137 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.195 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.275 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:28.275 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:28.275 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244749 s, 42.8 MB/s 2023-11-26T07:19:28.277 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:28.277 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.331 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.413 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:28.413 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:28.413 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243517 s, 43.1 MB/s 2023-11-26T07:19:28.414 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:28.415 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.473 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.553 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:28.553 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:28.553 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024677 s, 42.5 MB/s 2023-11-26T07:19:28.555 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:28.555 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.614 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.694 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:28.694 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:28.694 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221952 s, 47.2 MB/s 2023-11-26T07:19:28.696 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:28.696 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.750 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.825 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:28.825 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:28.825 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203183 s, 51.6 MB/s 2023-11-26T07:19:28.826 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:28.826 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.877 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.000 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:29.000 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:29.000 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241069 s, 43.5 MB/s 2023-11-26T07:19:29.001 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:29.001 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.057 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.141 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:29.141 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:29.141 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02865 s, 36.6 MB/s 2023-11-26T07:19:29.143 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:29.143 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.200 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210404 s, 49.8 MB/s 2023-11-26T07:19:29.275 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:29.275 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.330 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.410 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:29.410 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:29.410 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259541 s, 40.4 MB/s 2023-11-26T07:19:29.412 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:29.412 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.466 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.542 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:29.542 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:29.542 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262533 s, 39.9 MB/s 2023-11-26T07:19:29.544 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:29.544 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.604 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.684 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:29.684 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237459 s, 44.2 MB/s 2023-11-26T07:19:29.686 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:29.686 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.744 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247031 s, 42.4 MB/s 2023-11-26T07:19:29.828 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:29.828 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.887 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.965 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:29.965 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:29.966 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244675 s, 42.9 MB/s 2023-11-26T07:19:29.967 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:29.967 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.022 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:30.109 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304752 s, 34.4 MB/s 2023-11-26T07:19:30.111 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:30.111 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.165 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245824 s, 42.7 MB/s 2023-11-26T07:19:30.243 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:30.243 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.292 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.416 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:30.416 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:30.416 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279578 s, 37.5 MB/s 2023-11-26T07:19:30.417 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:30.418 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.473 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.549 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:30.549 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:30.549 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223231 s, 47.0 MB/s 2023-11-26T07:19:30.551 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:30.551 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.609 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224287 s, 46.8 MB/s 2023-11-26T07:19:30.693 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:30.694 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.749 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.832 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:30.833 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:30.833 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302024 s, 34.7 MB/s 2023-11-26T07:19:30.834 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:30.834 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.890 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.962 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:30.962 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:30.962 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190592 s, 55.0 MB/s 2023-11-26T07:19:30.963 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:30.964 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:31.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:31.020 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol1410/a2ad39bf-67ec-4d16-80b3-6575b0b9dfdf/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:31.094 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:19:31.094 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:19:31.094 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248281 s, 42.2 MB/s 2023-11-26T07:19:31.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol1410 subvol_snap51340 2023-11-26T07:19:31.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.315+0000 7f85b2c1e640 1 Processor -- start 2023-11-26T07:19:31.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.315+0000 7f85b2c1e640 1 -- start start 2023-11-26T07:19:31.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.317+0000 7f85b2c1e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f85ac15c7f0 0x7f85ac06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.317+0000 7f85b2c1e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f85ac0cf450 0x7f85ac0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.317+0000 7f85b2c1e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac0cece0 con 0x7f85ac0cdfb0 2023-11-26T07:19:31.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.317+0000 7f85b2c1e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac0cfe40 con 0x7f85ac0cf450 2023-11-26T07:19:31.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.317+0000 7f85b2c1e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac0ceaf0 con 0x7f85ac15c7f0 2023-11-26T07:19:31.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.317+0000 7f85abfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f85ac0cf450 0x7f85ac0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:31.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.317+0000 7f85abfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f85ac0cf450 0x7f85ac0cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47132/0 (socket says 172.21.15.77:47132) 2023-11-26T07:19:31.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.317+0000 7f85abfff640 1 -- 172.21.15.77:0/1725675502 learned_addr learned my addr 172.21.15.77:0/1725675502 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:31.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.318+0000 7f85abfff640 1 -- 172.21.15.77:0/1725675502 >> v2:172.21.15.159:3300/0 conn(0x7f85ac15c7f0 msgr2=0x7f85ac06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:31.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.318+0000 7f85abfff640 1 --2- 172.21.15.77:0/1725675502 >> v2:172.21.15.159:3300/0 conn(0x7f85ac15c7f0 0x7f85ac06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.318+0000 7f85abfff640 1 -- 172.21.15.77:0/1725675502 >> v1:172.21.15.159:6789/0 conn(0x7f85ac0cdfb0 legacy=0x7f85ac0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:31.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.318+0000 7f85abfff640 1 -- 172.21.15.77:0/1725675502 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac06d040 con 0x7f85ac0cf450 2023-11-26T07:19:31.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.319+0000 7f85abfff640 1 --2- 172.21.15.77:0/1725675502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ac0cf450 0x7f85ac0cf900 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0d0130 tx=0x7f859802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f30091bd8a4d53 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:31.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.319+0000 7f85ab7fe640 1 -- 172.21.15.77:0/1725675502 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598031870 con 0x7f85ac0cf450 2023-11-26T07:19:31.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.319+0000 7f85ab7fe640 1 -- 172.21.15.77:0/1725675502 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85980319d0 con 0x7f85ac0cf450 2023-11-26T07:19:31.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.319+0000 7f85ab7fe640 1 -- 172.21.15.77:0/1725675502 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598031d60 con 0x7f85ac0cf450 2023-11-26T07:19:31.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.320+0000 7f85b2c1e640 1 -- 172.21.15.77:0/1725675502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ac0cf450 msgr2=0x7f85ac0cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.320+0000 7f85b2c1e640 1 --2- 172.21.15.77:0/1725675502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ac0cf450 0x7f85ac0cf900 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0d0130 tx=0x7f859802b910 comp rx=0 tx=0).stop 2023-11-26T07:19:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.320+0000 7f85b2c1e640 1 -- 172.21.15.77:0/1725675502 shutdown_connections 2023-11-26T07:19:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.320+0000 7f85b2c1e640 1 --2- 172.21.15.77:0/1725675502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ac0cf450 0x7f85ac0cf900 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.320+0000 7f85b2c1e640 1 --2- 172.21.15.77:0/1725675502 >> v2:172.21.15.159:3300/0 conn(0x7f85ac15c7f0 0x7f85ac06db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.320+0000 7f85b2c1e640 1 -- 172.21.15.77:0/1725675502 >> 172.21.15.77:0/1725675502 conn(0x7f85ac06a920 msgr2=0x7f85ac06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.320+0000 7f85b2c1e640 1 -- 172.21.15.77:0/1725675502 shutdown_connections 2023-11-26T07:19:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.320+0000 7f85b2c1e640 1 -- 172.21.15.77:0/1725675502 wait complete. 2023-11-26T07:19:31.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.322+0000 7f85b2c1e640 1 Processor -- start 2023-11-26T07:19:31.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.322+0000 7f85b2c1e640 1 -- start start 2023-11-26T07:19:31.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.323+0000 7f85b2c1e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ac0cdfb0 0x7f85ac1412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.323+0000 7f85b2c1e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85ac0cf450 0x7f85ac14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.323+0000 7f85b2c1e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ac15c7f0 0x7f85ac14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.323+0000 7f85b2c1e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac14f560 con 0x7f85ac15c7f0 2023-11-26T07:19:31.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.323+0000 7f85b2c1e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac14f170 con 0x7f85ac0cf450 2023-11-26T07:19:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.323+0000 7f85b2c1e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac14e8d0 con 0x7f85ac0cdfb0 2023-11-26T07:19:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.323+0000 7f85b11bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ac15c7f0 0x7f85ac14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.323+0000 7f85b11bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ac15c7f0 0x7f85ac14e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47140/0 (socket says 172.21.15.77:47140) 2023-11-26T07:19:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.323+0000 7f85b11bb640 1 -- 172.21.15.77:0/770315010 learned_addr learned my addr 172.21.15.77:0/770315010 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.323+0000 7f85abfff640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85ac0cf450 0x7f85ac14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.323+0000 7f85b09ba640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ac0cdfb0 0x7f85ac1412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.324+0000 7f85b11bb640 1 -- 172.21.15.77:0/770315010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ac0cdfb0 msgr2=0x7f85ac1412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.324+0000 7f85b11bb640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ac0cdfb0 0x7f85ac1412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.324+0000 7f85b11bb640 1 -- 172.21.15.77:0/770315010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85ac0cf450 msgr2=0x7f85ac14dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.324+0000 7f85b11bb640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85ac0cf450 0x7f85ac14dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.324+0000 7f85b11bb640 1 -- 172.21.15.77:0/770315010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85980094d0 con 0x7f85ac15c7f0 2023-11-26T07:19:31.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.324+0000 7f85b11bb640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ac15c7f0 0x7f85ac14e250 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f85a400c780 tx=0x7f85a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:31.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.324+0000 7f85a97fa640 1 -- 172.21.15.77:0/770315010 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4003d80 con 0x7f85ac15c7f0 2023-11-26T07:19:31.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.324+0000 7f85a97fa640 1 -- 172.21.15.77:0/770315010 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a400ce30 con 0x7f85ac15c7f0 2023-11-26T07:19:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.324+0000 7f85a97fa640 1 -- 172.21.15.77:0/770315010 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4005290 con 0x7f85ac15c7f0 2023-11-26T07:19:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.324+0000 7f85b2c1e640 1 -- 172.21.15.77:0/770315010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac14ebb0 con 0x7f85ac15c7f0 2023-11-26T07:19:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.325+0000 7f85b2c1e640 1 -- 172.21.15.77:0/770315010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac0add00 con 0x7f85ac15c7f0 2023-11-26T07:19:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.326+0000 7f85b2c1e640 1 -- 172.21.15.77:0/770315010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac14f6a0 con 0x7f85ac15c7f0 2023-11-26T07:19:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.327+0000 7f85a97fa640 1 -- 172.21.15.77:0/770315010 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f85a40053f0 con 0x7f85ac15c7f0 2023-11-26T07:19:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.328+0000 7f85a97fa640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f859006af00 0x7f859006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.328+0000 7f85a97fa640 1 -- 172.21.15.77:0/770315010 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85a4088a80 con 0x7f85ac15c7f0 2023-11-26T07:19:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.328+0000 7f85b09ba640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f859006af00 0x7f859006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:31.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.329+0000 7f85b09ba640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f859006af00 0x7f859006d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f85a000b810 tx=0x7f85a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.332+0000 7f85a97fa640 1 -- 172.21.15.77:0/770315010 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85ac14f6a0 con 0x7f85ac15c7f0 2023-11-26T07:19:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.553+0000 7f85b2c1e640 1 -- 172.21.15.77:0/770315010 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol1410", "snap_name": "subvol_snap51340", "target": ["mon-mgr", ""]}) v1 -- 0x7f85ac15b310 con 0x7f859006af00 2023-11-26T07:19:31.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.596+0000 7f85a97fa640 1 -- 172.21.15.77:0/770315010 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f85ac15b310 con 0x7f859006af00 2023-11-26T07:19:31.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.599+0000 7f85b2c1e640 1 -- 172.21.15.77:0/770315010 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f859006af00 msgr2=0x7f859006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.599+0000 7f85b2c1e640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f859006af00 0x7f859006d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f85a000b810 tx=0x7f85a0008040 comp rx=0 tx=0).stop 2023-11-26T07:19:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.599+0000 7f85b2c1e640 1 -- 172.21.15.77:0/770315010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ac15c7f0 msgr2=0x7f85ac14e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.599+0000 7f85b2c1e640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ac15c7f0 0x7f85ac14e250 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f85a400c780 tx=0x7f85a400cc40 comp rx=0 tx=0).stop 2023-11-26T07:19:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.599+0000 7f85b2c1e640 1 -- 172.21.15.77:0/770315010 shutdown_connections 2023-11-26T07:19:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.599+0000 7f85b2c1e640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f859006af00 0x7f859006d3c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.599+0000 7f85b2c1e640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85ac15c7f0 0x7f85ac14e250 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.599+0000 7f85b2c1e640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85ac0cf450 0x7f85ac14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.599+0000 7f85b2c1e640 1 --2- 172.21.15.77:0/770315010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ac0cdfb0 0x7f85ac1412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.599+0000 7f85b2c1e640 1 -- 172.21.15.77:0/770315010 >> 172.21.15.77:0/770315010 conn(0x7f85ac06a920 msgr2=0x7f85ac0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.599+0000 7f85b2c1e640 1 -- 172.21.15.77:0/770315010 shutdown_connections 2023-11-26T07:19:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.600+0000 7f85b2c1e640 1 -- 172.21.15.77:0/770315010 wait complete. 2023-11-26T07:19:31.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:19:31.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.831+0000 7f9abcfb3640 1 Processor -- start 2023-11-26T07:19:31.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.831+0000 7f9abcfb3640 1 -- start start 2023-11-26T07:19:31.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.832+0000 7f9abcfb3640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9ab815a1c0 0x7f9ab806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.833+0000 7f9abcfb3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ab80b0b40 0x7f9ab80b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.833+0000 7f9abcfb3640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab806d430 con 0x7f9ab815ded0 2023-11-26T07:19:31.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.833+0000 7f9abcfb3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab815ea70 con 0x7f9ab80b0b40 2023-11-26T07:19:31.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.833+0000 7f9abcfb3640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab815ec50 con 0x7f9ab815a1c0 2023-11-26T07:19:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.833+0000 7f9ab6ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ab80b0b40 0x7f9ab80b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.833+0000 7f9ab6ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ab80b0b40 0x7f9ab80b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47142/0 (socket says 172.21.15.77:47142) 2023-11-26T07:19:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.833+0000 7f9ab6ffd640 1 -- 172.21.15.77:0/3698462143 learned_addr learned my addr 172.21.15.77:0/3698462143 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:31.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.833+0000 7f9ab77fe640 1 --2- 172.21.15.77:0/3698462143 >> v2:172.21.15.159:3300/0 conn(0x7f9ab815a1c0 0x7f9ab806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:31.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.833+0000 7f9ab6ffd640 1 -- 172.21.15.77:0/3698462143 >> v2:172.21.15.159:3300/0 conn(0x7f9ab815a1c0 msgr2=0x7f9ab806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:31.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.834+0000 7f9ab6ffd640 1 --2- 172.21.15.77:0/3698462143 >> v2:172.21.15.159:3300/0 conn(0x7f9ab815a1c0 0x7f9ab806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.834+0000 7f9ab6ffd640 1 -- 172.21.15.77:0/3698462143 >> v1:172.21.15.159:6789/0 conn(0x7f9ab815ded0 legacy=0x7f9ab815e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:31.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.834+0000 7f9ab6ffd640 1 -- 172.21.15.77:0/3698462143 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab80b14e0 con 0x7f9ab80b0b40 2023-11-26T07:19:31.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.835+0000 7f9ab6ffd640 1 --2- 172.21.15.77:0/3698462143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab80b0b40 0x7f9ab80b0fa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80cca80 tx=0x7f9aac02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5315b1ec1e84d13 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.835+0000 7f9ab67fc640 1 -- 172.21.15.77:0/3698462143 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac02ee90 con 0x7f9ab80b0b40 2023-11-26T07:19:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.835+0000 7f9ab67fc640 1 -- 172.21.15.77:0/3698462143 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac036440 con 0x7f9ab80b0b40 2023-11-26T07:19:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.835+0000 7f9ab67fc640 1 -- 172.21.15.77:0/3698462143 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0367d0 con 0x7f9ab80b0b40 2023-11-26T07:19:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.836+0000 7f9abcfb3640 1 -- 172.21.15.77:0/3698462143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab80b0b40 msgr2=0x7f9ab80b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.836+0000 7f9abcfb3640 1 --2- 172.21.15.77:0/3698462143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab80b0b40 0x7f9ab80b0fa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80cca80 tx=0x7f9aac02e0e0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.836+0000 7f9abcfb3640 1 -- 172.21.15.77:0/3698462143 shutdown_connections 2023-11-26T07:19:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.836+0000 7f9abcfb3640 1 --2- 172.21.15.77:0/3698462143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab80b0b40 0x7f9ab80b0fa0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.836+0000 7f9abcfb3640 1 --2- 172.21.15.77:0/3698462143 >> v2:172.21.15.159:3300/0 conn(0x7f9ab815a1c0 0x7f9ab806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.836+0000 7f9abcfb3640 1 -- 172.21.15.77:0/3698462143 >> 172.21.15.77:0/3698462143 conn(0x7f9ab80cbb40 msgr2=0x7f9ab80cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.836+0000 7f9abcfb3640 1 -- 172.21.15.77:0/3698462143 shutdown_connections 2023-11-26T07:19:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.836+0000 7f9abcfb3640 1 -- 172.21.15.77:0/3698462143 wait complete. 2023-11-26T07:19:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.838+0000 7f9abcfb3640 1 Processor -- start 2023-11-26T07:19:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.838+0000 7f9abcfb3640 1 -- start start 2023-11-26T07:19:31.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9abcfb3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80b0b40 0x7f9ab8155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9abcfb3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ab815a1c0 0x7f9ab809ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9abcfb3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab815ded0 0x7f9ab809bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9abcfb3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab815c340 con 0x7f9ab815ded0 2023-11-26T07:19:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9abcfb3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab815a5a0 con 0x7f9ab80b0b40 2023-11-26T07:19:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9abcfb3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab815ae40 con 0x7f9ab815a1c0 2023-11-26T07:19:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9ab7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab815ded0 0x7f9ab809bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9ab7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab815ded0 0x7f9ab809bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47156/0 (socket says 172.21.15.77:47156) 2023-11-26T07:19:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9ab7fff640 1 -- 172.21.15.77:0/306672437 learned_addr learned my addr 172.21.15.77:0/306672437 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:31.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9ab77fe640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80b0b40 0x7f9ab8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:31.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9ab6ffd640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ab815a1c0 0x7f9ab809ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9ab7fff640 1 -- 172.21.15.77:0/306672437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ab815a1c0 msgr2=0x7f9ab809ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9ab7fff640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ab815a1c0 0x7f9ab809ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9ab7fff640 1 -- 172.21.15.77:0/306672437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80b0b40 msgr2=0x7f9ab8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9ab7fff640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80b0b40 0x7f9ab8155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9ab7fff640 1 -- 172.21.15.77:0/306672437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac00b770 con 0x7f9ab815ded0 2023-11-26T07:19:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.839+0000 7f9ab6ffd640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ab815a1c0 0x7f9ab809ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.840+0000 7f9ab7fff640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab815ded0 0x7f9ab809bfc0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000b9a0 tx=0x7f9ab000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.840+0000 7f9a9ffff640 1 -- 172.21.15.77:0/306672437 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000cba0 con 0x7f9ab815ded0 2023-11-26T07:19:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.840+0000 7f9a9ffff640 1 -- 172.21.15.77:0/306672437 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab000cd00 con 0x7f9ab815ded0 2023-11-26T07:19:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.840+0000 7f9a9ffff640 1 -- 172.21.15.77:0/306672437 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0014680 con 0x7f9ab815ded0 2023-11-26T07:19:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.840+0000 7f9abcfb3640 1 -- 172.21.15.77:0/306672437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab815d250 con 0x7f9ab815ded0 2023-11-26T07:19:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.840+0000 7f9abcfb3640 1 -- 172.21.15.77:0/306672437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab815aad0 con 0x7f9ab815ded0 2023-11-26T07:19:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.842+0000 7f9abcfb3640 1 -- 172.21.15.77:0/306672437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab804e840 con 0x7f9ab815ded0 2023-11-26T07:19:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.842+0000 7f9a9ffff640 1 -- 172.21.15.77:0/306672437 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f9ab001d3b0 con 0x7f9ab815ded0 2023-11-26T07:19:31.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.843+0000 7f9a9ffff640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9aa406af00 0x7f9aa406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:31.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.844+0000 7f9a9ffff640 1 -- 172.21.15.77:0/306672437 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ab0089370 con 0x7f9ab815ded0 2023-11-26T07:19:31.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.844+0000 7f9ab77fe640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9aa406af00 0x7f9aa406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:31.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.844+0000 7f9ab77fe640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9aa406af00 0x7f9aa406d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8006fd0 tx=0x7f9aa8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:31.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:31.848+0000 7f9a9ffff640 1 -- 172.21.15.77:0/306672437 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ab00544c0 con 0x7f9ab815ded0 2023-11-26T07:19:32.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.038+0000 7f9abcfb3640 1 -- 172.21.15.77:0/306672437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f9ab815af80 con 0x7f9ab815ded0 2023-11-26T07:19:32.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.046+0000 7f9a9ffff640 1 -- 172.21.15.77:0/306672437 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v11)=0 v11) v1 ==== 130+0+0 (secure 0 0 0) 0x7f9ab0057ae0 con 0x7f9ab815ded0 2023-11-26T07:19:32.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.049+0000 7f9abcfb3640 1 -- 172.21.15.77:0/306672437 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9aa406af00 msgr2=0x7f9aa406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.049+0000 7f9abcfb3640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9aa406af00 0x7f9aa406d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8006fd0 tx=0x7f9aa8008040 comp rx=0 tx=0).stop 2023-11-26T07:19:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.050+0000 7f9abcfb3640 1 -- 172.21.15.77:0/306672437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab815ded0 msgr2=0x7f9ab809bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.050+0000 7f9abcfb3640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab815ded0 0x7f9ab809bfc0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000b9a0 tx=0x7f9ab000be60 comp rx=0 tx=0).stop 2023-11-26T07:19:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.050+0000 7f9abcfb3640 1 -- 172.21.15.77:0/306672437 shutdown_connections 2023-11-26T07:19:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.050+0000 7f9abcfb3640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9aa406af00 0x7f9aa406d3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.050+0000 7f9abcfb3640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab815ded0 0x7f9ab809bfc0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.050+0000 7f9abcfb3640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ab815a1c0 0x7f9ab809ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.050+0000 7f9abcfb3640 1 --2- 172.21.15.77:0/306672437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab80b0b40 0x7f9ab8155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.050+0000 7f9abcfb3640 1 -- 172.21.15.77:0/306672437 >> 172.21.15.77:0/306672437 conn(0x7f9ab80cbb40 msgr2=0x7f9ab80caad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.050+0000 7f9abcfb3640 1 -- 172.21.15.77:0/306672437 shutdown_connections 2023-11-26T07:19:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.050+0000 7f9abcfb3640 1 -- 172.21.15.77:0/306672437 wait complete. 2023-11-26T07:19:32.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol1410 subvol_snap51340 subvol_clone15150 2023-11-26T07:19:32.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.280+0000 7f0f38f2e640 1 Processor -- start 2023-11-26T07:19:32.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.281+0000 7f0f38f2e640 1 -- start start 2023-11-26T07:19:32.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.282+0000 7f0f38f2e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f3415bd80 0x7f0f3415c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:32.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.282+0000 7f0f38f2e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0f340cf1d0 0x7f0f340cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:32.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.282+0000 7f0f38f2e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3415b990 con 0x7f0f3406c510 2023-11-26T07:19:32.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.282+0000 7f0f38f2e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3406d590 con 0x7f0f340cf1d0 2023-11-26T07:19:32.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.282+0000 7f0f38f2e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340cfb80 con 0x7f0f3415bd80 2023-11-26T07:19:32.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.282+0000 7f0f33fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0f340cf1d0 0x7f0f340cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:32.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.283+0000 7f0f33fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0f340cf1d0 0x7f0f340cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47172/0 (socket says 172.21.15.77:47172) 2023-11-26T07:19:32.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.283+0000 7f0f33fff640 1 -- 172.21.15.77:0/3211270511 learned_addr learned my addr 172.21.15.77:0/3211270511 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:32.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.283+0000 7f0f337fe640 1 --2- 172.21.15.77:0/3211270511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f3415bd80 0x7f0f3415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:32.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.283+0000 7f0f33fff640 1 -- 172.21.15.77:0/3211270511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f3415bd80 msgr2=0x7f0f3415c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:32.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.283+0000 7f0f33fff640 1 --2- 172.21.15.77:0/3211270511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f3415bd80 0x7f0f3415c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.283+0000 7f0f33fff640 1 -- 172.21.15.77:0/3211270511 >> v1:172.21.15.159:6789/0 conn(0x7f0f3406c510 legacy=0x7f0f3415f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:32.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.283+0000 7f0f33fff640 1 -- 172.21.15.77:0/3211270511 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340cd630 con 0x7f0f340cf1d0 2023-11-26T07:19:32.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.284+0000 7f0f33fff640 1 --2- 172.21.15.77:0/3211270511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340cf1d0 0x7f0f340cf640 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0f340cd400 tx=0x7f0f2c02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2a1735a20e79ed server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:32.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.285+0000 7f0f32ffd640 1 -- 172.21.15.77:0/3211270511 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c02ca30 con 0x7f0f340cf1d0 2023-11-26T07:19:32.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.285+0000 7f0f32ffd640 1 -- 172.21.15.77:0/3211270511 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c02cb90 con 0x7f0f340cf1d0 2023-11-26T07:19:32.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.285+0000 7f0f32ffd640 1 -- 172.21.15.77:0/3211270511 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0343f0 con 0x7f0f340cf1d0 2023-11-26T07:19:32.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.285+0000 7f0f38f2e640 1 -- 172.21.15.77:0/3211270511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340cf1d0 msgr2=0x7f0f340cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:32.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.285+0000 7f0f38f2e640 1 --2- 172.21.15.77:0/3211270511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340cf1d0 0x7f0f340cf640 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0f340cd400 tx=0x7f0f2c02be90 comp rx=0 tx=0).stop 2023-11-26T07:19:32.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.286+0000 7f0f38f2e640 1 -- 172.21.15.77:0/3211270511 shutdown_connections 2023-11-26T07:19:32.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.286+0000 7f0f38f2e640 1 --2- 172.21.15.77:0/3211270511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340cf1d0 0x7f0f340cf640 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.286+0000 7f0f38f2e640 1 --2- 172.21.15.77:0/3211270511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f3415bd80 0x7f0f3415c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.286+0000 7f0f38f2e640 1 -- 172.21.15.77:0/3211270511 >> 172.21.15.77:0/3211270511 conn(0x7f0f3406a950 msgr2=0x7f0f3406ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.286+0000 7f0f38f2e640 1 -- 172.21.15.77:0/3211270511 shutdown_connections 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.286+0000 7f0f38f2e640 1 -- 172.21.15.77:0/3211270511 wait complete. 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.287+0000 7f0f38f2e640 1 Processor -- start 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.288+0000 7f0f38f2e640 1 -- start start 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f38f2e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3406c510 0x7f0f3413d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f38f2e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f340cf1d0 0x7f0f34071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f38f2e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f3415bd80 0x7f0f340ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f38f2e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34071c80 con 0x7f0f3406c510 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f38f2e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34156330 con 0x7f0f340cf1d0 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f38f2e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f341565d0 con 0x7f0f3415bd80 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f337fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3406c510 0x7f0f3413d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f337fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3406c510 0x7f0f3413d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47178/0 (socket says 172.21.15.77:47178) 2023-11-26T07:19:32.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f337fe640 1 -- 172.21.15.77:0/1831262448 learned_addr learned my addr 172.21.15.77:0/1831262448 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:32.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f33fff640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f3415bd80 0x7f0f340ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:32.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f2bfff640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f340cf1d0 0x7f0f34071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:32.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f337fe640 1 -- 172.21.15.77:0/1831262448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f3415bd80 msgr2=0x7f0f340ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:32.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f337fe640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f3415bd80 0x7f0f340ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f337fe640 1 -- 172.21.15.77:0/1831262448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f340cf1d0 msgr2=0x7f0f34071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:32.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f337fe640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f340cf1d0 0x7f0f34071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f337fe640 1 -- 172.21.15.77:0/1831262448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c009b30 con 0x7f0f3406c510 2023-11-26T07:19:32.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.289+0000 7f0f2bfff640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f340cf1d0 0x7f0f34071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:32.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.290+0000 7f0f337fe640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3406c510 0x7f0f3413d350 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400d800 tx=0x7f0f2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:32.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.290+0000 7f0f30ff9640 1 -- 172.21.15.77:0/1831262448 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400b6c0 con 0x7f0f3406c510 2023-11-26T07:19:32.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.290+0000 7f0f30ff9640 1 -- 172.21.15.77:0/1831262448 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2400b820 con 0x7f0f3406c510 2023-11-26T07:19:32.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.290+0000 7f0f30ff9640 1 -- 172.21.15.77:0/1831262448 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400bbb0 con 0x7f0f3406c510 2023-11-26T07:19:32.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.290+0000 7f0f38f2e640 1 -- 172.21.15.77:0/1831262448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f341568b0 con 0x7f0f3406c510 2023-11-26T07:19:32.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.290+0000 7f0f38f2e640 1 -- 172.21.15.77:0/1831262448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3413d890 con 0x7f0f3406c510 2023-11-26T07:19:32.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.292+0000 7f0f38f2e640 1 -- 172.21.15.77:0/1831262448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3404e840 con 0x7f0f3406c510 2023-11-26T07:19:32.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.292+0000 7f0f30ff9640 1 -- 172.21.15.77:0/1831262448 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f0f2400bd10 con 0x7f0f3406c510 2023-11-26T07:19:32.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.293+0000 7f0f30ff9640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f1406aed0 0x7f0f1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:32.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.293+0000 7f0f30ff9640 1 -- 172.21.15.77:0/1831262448 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f24089b50 con 0x7f0f3406c510 2023-11-26T07:19:32.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.293+0000 7f0f2bfff640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f1406aed0 0x7f0f1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:32.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.294+0000 7f0f2bfff640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f1406aed0 0x7f0f1406d390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0f3413df00 tx=0x7f0f1c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:32.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.297+0000 7f0f30ff9640 1 -- 172.21.15.77:0/1831262448 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f24054ca0 con 0x7f0f3406c510 2023-11-26T07:19:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.527+0000 7f0f38f2e640 1 -- 172.21.15.77:0/1831262448 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol1410", "snap_name": "subvol_snap51340", "target_sub_name": "subvol_clone15150", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f3406ccf0 con 0x7f0f1406aed0 2023-11-26T07:19:32.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.781+0000 7f0f30ff9640 1 -- 172.21.15.77:0/1831262448 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0f1c00ad80 con 0x7f0f1406aed0 2023-11-26T07:19:32.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.784+0000 7f0f38f2e640 1 -- 172.21.15.77:0/1831262448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f1406aed0 msgr2=0x7f0f1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:32.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.784+0000 7f0f38f2e640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f1406aed0 0x7f0f1406d390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0f3413df00 tx=0x7f0f1c008040 comp rx=0 tx=0).stop 2023-11-26T07:19:32.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.784+0000 7f0f38f2e640 1 -- 172.21.15.77:0/1831262448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3406c510 msgr2=0x7f0f3413d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.784+0000 7f0f38f2e640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3406c510 0x7f0f3413d350 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400d800 tx=0x7f0f2400dcc0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.784+0000 7f0f38f2e640 1 -- 172.21.15.77:0/1831262448 shutdown_connections 2023-11-26T07:19:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.784+0000 7f0f38f2e640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f1406aed0 0x7f0f1406d390 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.784+0000 7f0f38f2e640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f3415bd80 0x7f0f340ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.785+0000 7f0f38f2e640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f340cf1d0 0x7f0f34071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.785+0000 7f0f38f2e640 1 --2- 172.21.15.77:0/1831262448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3406c510 0x7f0f3413d350 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.785+0000 7f0f38f2e640 1 -- 172.21.15.77:0/1831262448 >> 172.21.15.77:0/1831262448 conn(0x7f0f3406a950 msgr2=0x7f0f3415d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:32.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.785+0000 7f0f38f2e640 1 -- 172.21.15.77:0/1831262448 shutdown_connections 2023-11-26T07:19:32.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:32.785+0000 7f0f38f2e640 1 -- 172.21.15.77:0/1831262448 wait complete. 2023-11-26T07:19:32.792 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:32.789+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:32.792 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:32.789+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:32.792 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:32.789+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:32.792 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:32.789+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:32.792 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:32.789+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:32.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:32.809 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rmdir ./volumes/_nogroup/subvol1410/.snap/subvol_snap51340) 2023-11-26T07:19:32.821 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:32.818+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:32.821 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:32.818+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:32.821 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:32.818+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:32.821 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:32.818+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:32.821 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:32.818+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:32.904 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone15150 2023-11-26T07:19:33.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.164+0000 7fe315a3d640 1 Processor -- start 2023-11-26T07:19:33.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.164+0000 7fe315a3d640 1 -- start start 2023-11-26T07:19:33.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.166+0000 7fe315a3d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe3100c9650 0x7fe3100c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:33.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.166+0000 7fe315a3d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe310166510 con 0x7fe3100ccbd0 2023-11-26T07:19:33.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.166+0000 7fe315a3d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3101655f0 con 0x7fe3101660b0 2023-11-26T07:19:33.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.166+0000 7fe315a3d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3100cc380 con 0x7fe3100c9650 2023-11-26T07:19:33.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.167+0000 7fe30effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe3100ccbd0 0x7fe3100ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54122/0 (socket says 172.21.15.77:54122) 2023-11-26T07:19:33.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.167+0000 7fe30effd640 1 -- 172.21.15.77:0/4226402992 learned_addr learned my addr 172.21.15.77:0/4226402992 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:33.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.167+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412320431 0 0) 0x7fe300001110 con 0x7fe3100ccbd0 2023-11-26T07:19:33.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.167+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2fc003520 con 0x7fe3100ccbd0 2023-11-26T07:19:33.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.167+0000 7fe30f7fe640 1 --2- 172.21.15.77:0/4226402992 >> v2:172.21.15.159:3300/0 conn(0x7fe3100c9650 0x7fe3100c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:33.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.167+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 462008056 0 0) 0x7fe2fc003520 con 0x7fe3100ccbd0 2023-11-26T07:19:33.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 >> v2:172.21.15.159:3300/0 conn(0x7fe3100c9650 msgr2=0x7fe3100c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:33.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 --2- 172.21.15.77:0/4226402992 >> v2:172.21.15.159:3300/0 conn(0x7fe3100c9650 0x7fe3100c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:33.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 >> v1:172.21.15.159:6789/0 conn(0x7fe3101660b0 legacy=0x7fe310162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:33.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310162b30 con 0x7fe3100ccbd0 2023-11-26T07:19:33.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fe300001800 con 0x7fe3100ccbd0 2023-11-26T07:19:33.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 >> v1:172.21.15.77:6789/0 conn(0x7fe3100ccbd0 legacy=0x7fe3100ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:33.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2fc0039c0 0x7fe2fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:33.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0047c0 0x7fe2fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:33.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 0x7fe2fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:33.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100cc380 con 0x7fe2fc005180 2023-11-26T07:19:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc00c080 con 0x7fe2fc0047c0 2023-11-26T07:19:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc00c240 con 0x7fe2fc0039c0 2023-11-26T07:19:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30f7fe640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 0x7fe2fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30effd640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2fc0039c0 0x7fe2fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30f7fe640 1 -- 172.21.15.77:0/4226402992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2fc0039c0 msgr2=0x7fe2fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.168+0000 7fe30f7fe640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2fc0039c0 0x7fe2fc003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.169+0000 7fe30f7fe640 1 -- 172.21.15.77:0/4226402992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0047c0 msgr2=0x7fe2fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.169+0000 7fe30e7fc640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0047c0 0x7fe2fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.169+0000 7fe30f7fe640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0047c0 0x7fe2fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.169+0000 7fe30f7fe640 1 -- 172.21.15.77:0/4226402992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc003520 con 0x7fe2fc005180 2023-11-26T07:19:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.169+0000 7fe30e7fc640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2fc0047c0 0x7fe2fc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.170+0000 7fe30f7fe640 1 -- 172.21.15.77:0/4226402992 reap_dead start 2023-11-26T07:19:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.170+0000 7fe30f7fe640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 0x7fe2fc00b980 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe308009fc0 tx=0x7fe2fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4815387d320b9bab server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.170+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30802cc60 con 0x7fe2fc005180 2023-11-26T07:19:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.170+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30800f040 con 0x7fe2fc005180 2023-11-26T07:19:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.170+0000 7fe30dffb640 1 -- 172.21.15.77:0/4226402992 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308003990 con 0x7fe2fc005180 2023-11-26T07:19:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.170+0000 7fe315a3d640 1 -- 172.21.15.77:0/4226402992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 msgr2=0x7fe2fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.171+0000 7fe315a3d640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 0x7fe2fc00b980 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe308009fc0 tx=0x7fe2fc0057f0 comp rx=0 tx=0).stop 2023-11-26T07:19:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.171+0000 7fe315a3d640 1 -- 172.21.15.77:0/4226402992 shutdown_connections 2023-11-26T07:19:33.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.171+0000 7fe315a3d640 1 --2- 172.21.15.77:0/4226402992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 0x7fe2fc00b980 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:33.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.171+0000 7fe315a3d640 1 -- 172.21.15.77:0/4226402992 >> 172.21.15.77:0/4226402992 conn(0x7fe3100b0c50 msgr2=0x7fe3100b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:33.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.171+0000 7fe315a3d640 1 -- 172.21.15.77:0/4226402992 shutdown_connections 2023-11-26T07:19:33.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.171+0000 7fe315a3d640 1 -- 172.21.15.77:0/4226402992 wait complete. 2023-11-26T07:19:33.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.172+0000 7fe315a3d640 1 Processor -- start 2023-11-26T07:19:33.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.173+0000 7fe315a3d640 1 -- start start 2023-11-26T07:19:33.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.173+0000 7fe315a3d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 0x7fe310158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:33.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe315a3d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe310163130 0x7fe3101602f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:33.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe315a3d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3100c6f30 0x7fe3100af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:33.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe315a3d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3101586d0 con 0x7fe2fc005180 2023-11-26T07:19:33.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe315a3d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3101f75d0 con 0x7fe3100c6f30 2023-11-26T07:19:33.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe315a3d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3101635c0 con 0x7fe310163130 2023-11-26T07:19:33.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe30effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 0x7fe310158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:33.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe30effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 0x7fe310158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47250/0 (socket says 172.21.15.77:47250) 2023-11-26T07:19:33.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe30effd640 1 -- 172.21.15.77:0/3164942401 learned_addr learned my addr 172.21.15.77:0/3164942401 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:33.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe30e7fc640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe310163130 0x7fe3101602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:33.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe30effd640 1 -- 172.21.15.77:0/3164942401 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe310163130 msgr2=0x7fe3101602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:33.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe30effd640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe310163130 0x7fe3101602f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:33.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe30effd640 1 -- 172.21.15.77:0/3164942401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3100c6f30 msgr2=0x7fe3100af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:33.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe30effd640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3100c6f30 0x7fe3100af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:33.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.174+0000 7fe30effd640 1 -- 172.21.15.77:0/3164942401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3101638a0 con 0x7fe2fc005180 2023-11-26T07:19:33.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.175+0000 7fe30effd640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 0x7fe310158190 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe30000d770 tx=0x7fe30000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:33.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.175+0000 7fe307fff640 1 -- 172.21.15.77:0/3164942401 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000072d0 con 0x7fe2fc005180 2023-11-26T07:19:33.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.175+0000 7fe307fff640 1 -- 172.21.15.77:0/3164942401 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe300007430 con 0x7fe2fc005180 2023-11-26T07:19:33.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.175+0000 7fe307fff640 1 -- 172.21.15.77:0/3164942401 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000047e0 con 0x7fe2fc005180 2023-11-26T07:19:33.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.175+0000 7fe315a3d640 1 -- 172.21.15.77:0/3164942401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe310163b80 con 0x7fe2fc005180 2023-11-26T07:19:33.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.175+0000 7fe315a3d640 1 -- 172.21.15.77:0/3164942401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe310160830 con 0x7fe2fc005180 2023-11-26T07:19:33.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.176+0000 7fe315a3d640 1 -- 172.21.15.77:0/3164942401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe310160a50 con 0x7fe2fc005180 2023-11-26T07:19:33.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.177+0000 7fe307fff640 1 -- 172.21.15.77:0/3164942401 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fe300004940 con 0x7fe2fc005180 2023-11-26T07:19:33.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.178+0000 7fe307fff640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006aed0 0x7fe2f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:33.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.178+0000 7fe307fff640 1 -- 172.21.15.77:0/3164942401 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe300088e90 con 0x7fe2fc005180 2023-11-26T07:19:33.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.178+0000 7fe30e7fc640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006aed0 0x7fe2f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:33.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.179+0000 7fe30e7fc640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006aed0 0x7fe2f006d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8000c00 tx=0x7fe2f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:33.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.182+0000 7fe307fff640 1 -- 172.21.15.77:0/3164942401 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3000577d0 con 0x7fe2fc005180 2023-11-26T07:19:33.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.409+0000 7fe315a3d640 1 -- 172.21.15.77:0/3164942401 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone15150", "target": ["mon-mgr", ""]}) v1 -- 0x7fe310165b90 con 0x7fe2f006aed0 2023-11-26T07:19:33.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.419+0000 7fe307fff640 1 -- 172.21.15.77:0/3164942401 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+164 (secure 0 0 0) 0x7fe2f800d040 con 0x7fe2f006aed0 2023-11-26T07:19:33.426 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:19:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:19:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "pending", 2023-11-26T07:19:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:19:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:19:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol1410", 2023-11-26T07:19:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap51340" 2023-11-26T07:19:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:33.427 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:19:33.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 -- 172.21.15.77:0/3164942401 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006aed0 msgr2=0x7fe2f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:33.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006aed0 0x7fe2f006d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8000c00 tx=0x7fe2f8009040 comp rx=0 tx=0).stop 2023-11-26T07:19:33.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 -- 172.21.15.77:0/3164942401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 msgr2=0x7fe310158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:33.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 0x7fe310158190 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe30000d770 tx=0x7fe30000dc30 comp rx=0 tx=0).stop 2023-11-26T07:19:33.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 -- 172.21.15.77:0/3164942401 shutdown_connections 2023-11-26T07:19:33.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006aed0 0x7fe2f006d390 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:33.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3100c6f30 0x7fe3100af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:33.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe310163130 0x7fe3101602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:33.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 --2- 172.21.15.77:0/3164942401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2fc005180 0x7fe310158190 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:33.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 -- 172.21.15.77:0/3164942401 >> 172.21.15.77:0/3164942401 conn(0x7fe3100b0c50 msgr2=0x7fe3100b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:33.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 -- 172.21.15.77:0/3164942401 shutdown_connections 2023-11-26T07:19:33.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:33.422+0000 7fe315a3d640 1 -- 172.21.15.77:0/3164942401 wait complete. 2023-11-26T07:19:34.444 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone15150 2023-11-26T07:19:34.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.671+0000 7f988359e640 1 Processor -- start 2023-11-26T07:19:34.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.671+0000 7f988359e640 1 -- start start 2023-11-26T07:19:34.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.673+0000 7f988359e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f988415a1c0 0x7f988406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:34.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.673+0000 7f988359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f988415e5e0 0x7f98840b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:34.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.673+0000 7f988359e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988406d430 con 0x7f98840b0b40 2023-11-26T07:19:34.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.673+0000 7f988359e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988415ea70 con 0x7f988415a1c0 2023-11-26T07:19:34.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.673+0000 7f988359e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988415ec50 con 0x7f988415e5e0 2023-11-26T07:19:34.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.673+0000 7f988259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f988415a1c0 0x7f988406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:34.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.673+0000 7f988259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f988415a1c0 0x7f988406d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47252/0 (socket says 172.21.15.77:47252) 2023-11-26T07:19:34.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.673+0000 7f988259c640 1 -- 172.21.15.77:0/1672819661 learned_addr learned my addr 172.21.15.77:0/1672819661 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:34.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.673+0000 7f988259c640 1 -- 172.21.15.77:0/1672819661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f988415e5e0 msgr2=0x7f98840b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:34.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.673+0000 7f988259c640 1 --2- 172.21.15.77:0/1672819661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f988415e5e0 0x7f98840b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:34.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.674+0000 7f988259c640 1 -- 172.21.15.77:0/1672819661 >> v1:172.21.15.77:6789/0 conn(0x7f98840b0b40 legacy=0x7f988415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:34.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.674+0000 7f988259c640 1 -- 172.21.15.77:0/1672819661 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98840b14e0 con 0x7f988415a1c0 2023-11-26T07:19:34.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.675+0000 7f988259c640 1 --2- 172.21.15.77:0/1672819661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f988415a1c0 0x7f988406d8c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9874009870 tx=0x7f987402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246a30875d87c4ac server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.675+0000 7f9881d9b640 1 -- 172.21.15.77:0/1672819661 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874030840 con 0x7f988415a1c0 2023-11-26T07:19:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.675+0000 7f9881d9b640 1 -- 172.21.15.77:0/1672819661 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98740309a0 con 0x7f988415a1c0 2023-11-26T07:19:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.675+0000 7f9881d9b640 1 -- 172.21.15.77:0/1672819661 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874030d30 con 0x7f988415a1c0 2023-11-26T07:19:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.675+0000 7f988359e640 1 -- 172.21.15.77:0/1672819661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f988415a1c0 msgr2=0x7f988406d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.675+0000 7f988359e640 1 --2- 172.21.15.77:0/1672819661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f988415a1c0 0x7f988406d8c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9874009870 tx=0x7f987402b980 comp rx=0 tx=0).stop 2023-11-26T07:19:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.676+0000 7f988359e640 1 -- 172.21.15.77:0/1672819661 shutdown_connections 2023-11-26T07:19:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.676+0000 7f988359e640 1 --2- 172.21.15.77:0/1672819661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f988415e5e0 0x7f98840b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.676+0000 7f988359e640 1 --2- 172.21.15.77:0/1672819661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f988415a1c0 0x7f988406d8c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.676+0000 7f988359e640 1 -- 172.21.15.77:0/1672819661 >> 172.21.15.77:0/1672819661 conn(0x7f98840cbb40 msgr2=0x7f98840cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.676+0000 7f988359e640 1 -- 172.21.15.77:0/1672819661 shutdown_connections 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.676+0000 7f988359e640 1 -- 172.21.15.77:0/1672819661 wait complete. 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.677+0000 7f988359e640 1 Processor -- start 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.678+0000 7f988359e640 1 -- start start 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98840b0b40 0x7f98841591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f988415a1c0 0x7f98840caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f988415e5e0 0x7f98840caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988359e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98841f2c30 con 0x7f98840b0b40 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988359e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98841f3750 con 0x7f988415a1c0 2023-11-26T07:19:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988359e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98840c9070 con 0x7f988415e5e0 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98840b0b40 0x7f98841591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98840b0b40 0x7f98841591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47260/0 (socket says 172.21.15.77:47260) 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988259c640 1 -- 172.21.15.77:0/742206325 learned_addr learned my addr 172.21.15.77:0/742206325 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f9882d9d640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f988415e5e0 0x7f98840caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988259c640 1 -- 172.21.15.77:0/742206325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f988415e5e0 msgr2=0x7f98840caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988259c640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f988415e5e0 0x7f98840caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988259c640 1 -- 172.21.15.77:0/742206325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f988415a1c0 msgr2=0x7f98840caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f987bfff640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f988415a1c0 0x7f98840caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988259c640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f988415a1c0 0x7f98840caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f988259c640 1 -- 172.21.15.77:0/742206325 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98740094d0 con 0x7f98840b0b40 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.679+0000 7f987bfff640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f988415a1c0 0x7f98840caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.680+0000 7f988259c640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98840b0b40 0x7f98841591b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9874000c00 tx=0x7f9874004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.680+0000 7f987affd640 1 -- 172.21.15.77:0/742206325 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740307f0 con 0x7f98840b0b40 2023-11-26T07:19:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.680+0000 7f987affd640 1 -- 172.21.15.77:0/742206325 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9874043400 con 0x7f98840b0b40 2023-11-26T07:19:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.680+0000 7f988359e640 1 -- 172.21.15.77:0/742206325 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98841f3be0 con 0x7f98840b0b40 2023-11-26T07:19:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.680+0000 7f987affd640 1 -- 172.21.15.77:0/742206325 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740437b0 con 0x7f98840b0b40 2023-11-26T07:19:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.680+0000 7f988359e640 1 -- 172.21.15.77:0/742206325 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98841f2e20 con 0x7f98840b0b40 2023-11-26T07:19:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.681+0000 7f988359e640 1 -- 172.21.15.77:0/742206325 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988404e840 con 0x7f98840b0b40 2023-11-26T07:19:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.683+0000 7f987affd640 1 -- 172.21.15.77:0/742206325 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9874043910 con 0x7f98840b0b40 2023-11-26T07:19:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.684+0000 7f987affd640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f986406aff0 0x7f986406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.684+0000 7f987affd640 1 -- 172.21.15.77:0/742206325 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f987403e070 con 0x7f98840b0b40 2023-11-26T07:19:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.684+0000 7f987bfff640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f986406aff0 0x7f986406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.685+0000 7f987bfff640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f986406aff0 0x7f986406d4b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98841596f0 tx=0x7f986c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:34.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.690+0000 7f987affd640 1 -- 172.21.15.77:0/742206325 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9874077af0 con 0x7f98840b0b40 2023-11-26T07:19:34.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.917+0000 7f988359e640 1 -- 172.21.15.77:0/742206325 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone15150", "target": ["mon-mgr", ""]}) v1 -- 0x7f988406d0c0 con 0x7f986406aff0 2023-11-26T07:19:34.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.930+0000 7f987affd640 1 -- 172.21.15.77:0/742206325 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+164 (secure 0 0 0) 0x7f986c001340 con 0x7f986406aff0 2023-11-26T07:19:34.933 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:19:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:19:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "pending", 2023-11-26T07:19:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:19:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:19:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol1410", 2023-11-26T07:19:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap51340" 2023-11-26T07:19:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:34.933 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 -- 172.21.15.77:0/742206325 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f986406aff0 msgr2=0x7f986406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f986406aff0 0x7f986406d4b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98841596f0 tx=0x7f986c009040 comp rx=0 tx=0).stop 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 -- 172.21.15.77:0/742206325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98840b0b40 msgr2=0x7f98841591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98840b0b40 0x7f98841591b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9874000c00 tx=0x7f9874004730 comp rx=0 tx=0).stop 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 -- 172.21.15.77:0/742206325 shutdown_connections 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f986406aff0 0x7f986406d4b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f988415e5e0 0x7f98840caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f988415a1c0 0x7f98840caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 --2- 172.21.15.77:0/742206325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98840b0b40 0x7f98841591b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 -- 172.21.15.77:0/742206325 >> 172.21.15.77:0/742206325 conn(0x7f98840cbb40 msgr2=0x7f98840ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 -- 172.21.15.77:0/742206325 shutdown_connections 2023-11-26T07:19:34.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:34.933+0000 7f988359e640 1 -- 172.21.15.77:0/742206325 wait complete. 2023-11-26T07:19:35.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone15150 2023-11-26T07:19:36.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.181+0000 7f3068aff640 1 Processor -- start 2023-11-26T07:19:36.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.182+0000 7f3068aff640 1 -- start start 2023-11-26T07:19:36.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.183+0000 7f3068aff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f306415d3f0 0x7f30640d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:36.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.183+0000 7f3068aff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f30640d0e40 0x7f30640d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:36.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.183+0000 7f3068aff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30640d15e0 con 0x7f306415d7d0 2023-11-26T07:19:36.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.183+0000 7f3068aff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30640d0280 con 0x7f306415d3f0 2023-11-26T07:19:36.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.183+0000 7f3068aff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30640d1300 con 0x7f30640d0e40 2023-11-26T07:19:36.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.183+0000 7f30637fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f306415d3f0 0x7f30640d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:36.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.183+0000 7f30637fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f306415d3f0 0x7f30640d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36756/0 (socket says 172.21.15.77:36756) 2023-11-26T07:19:36.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.183+0000 7f30637fe640 1 -- 172.21.15.77:0/3207507971 learned_addr learned my addr 172.21.15.77:0/3207507971 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:36.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.184+0000 7f30637fe640 1 -- 172.21.15.77:0/3207507971 >> v2:172.21.15.159:3300/0 conn(0x7f30640d0e40 msgr2=0x7f30640d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:36.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.184+0000 7f30637fe640 1 --2- 172.21.15.77:0/3207507971 >> v2:172.21.15.159:3300/0 conn(0x7f30640d0e40 0x7f30640d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:36.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.184+0000 7f30637fe640 1 -- 172.21.15.77:0/3207507971 >> v1:172.21.15.159:6789/0 conn(0x7f306415d7d0 legacy=0x7f30640afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:36.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.184+0000 7f30637fe640 1 -- 172.21.15.77:0/3207507971 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640cfc30 con 0x7f306415d3f0 2023-11-26T07:19:36.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.185+0000 7f30637fe640 1 --2- 172.21.15.77:0/3207507971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f306415d3f0 0x7f30640d1830 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f306408c6e0 tx=0x7f305402bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d24deee2ac8d91 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:36.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.186+0000 7f30627fc640 1 -- 172.21.15.77:0/3207507971 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305402caa0 con 0x7f306415d3f0 2023-11-26T07:19:36.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.186+0000 7f30627fc640 1 -- 172.21.15.77:0/3207507971 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305402cc00 con 0x7f306415d3f0 2023-11-26T07:19:36.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.186+0000 7f30627fc640 1 -- 172.21.15.77:0/3207507971 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540343f0 con 0x7f306415d3f0 2023-11-26T07:19:36.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.186+0000 7f3068aff640 1 -- 172.21.15.77:0/3207507971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f306415d3f0 msgr2=0x7f30640d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:36.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.186+0000 7f3068aff640 1 --2- 172.21.15.77:0/3207507971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f306415d3f0 0x7f30640d1830 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f306408c6e0 tx=0x7f305402bf00 comp rx=0 tx=0).stop 2023-11-26T07:19:36.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.186+0000 7f3068aff640 1 -- 172.21.15.77:0/3207507971 shutdown_connections 2023-11-26T07:19:36.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.186+0000 7f3068aff640 1 --2- 172.21.15.77:0/3207507971 >> v2:172.21.15.159:3300/0 conn(0x7f30640d0e40 0x7f30640d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:36.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.186+0000 7f3068aff640 1 --2- 172.21.15.77:0/3207507971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f306415d3f0 0x7f30640d1830 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:36.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.186+0000 7f3068aff640 1 -- 172.21.15.77:0/3207507971 >> 172.21.15.77:0/3207507971 conn(0x7f306409c5b0 msgr2=0x7f30640d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:36.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.186+0000 7f3068aff640 1 -- 172.21.15.77:0/3207507971 shutdown_connections 2023-11-26T07:19:36.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.186+0000 7f3068aff640 1 -- 172.21.15.77:0/3207507971 wait complete. 2023-11-26T07:19:36.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.188+0000 7f3068aff640 1 Processor -- start 2023-11-26T07:19:36.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.188+0000 7f3068aff640 1 -- start start 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.189+0000 7f3068aff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30640d0e40 0x7f3064152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.189+0000 7f3068aff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f306415d3f0 0x7f30640c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.189+0000 7f3068aff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f306415d7d0 0x7f30640c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.189+0000 7f3068aff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640cba40 con 0x7f306415d7d0 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.189+0000 7f3068aff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640b5e90 con 0x7f30640d0e40 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.189+0000 7f3068aff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30640cbce0 con 0x7f306415d3f0 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f3063fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f306415d7d0 0x7f30640c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f3063fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f306415d7d0 0x7f30640c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36758/0 (socket says 172.21.15.77:36758) 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f3063fff640 1 -- 172.21.15.77:0/2056884595 learned_addr learned my addr 172.21.15.77:0/2056884595 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f3062ffd640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f306415d3f0 0x7f30640c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f30637fe640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30640d0e40 0x7f3064152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:36.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f3063fff640 1 -- 172.21.15.77:0/2056884595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f306415d3f0 msgr2=0x7f30640c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:36.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f3063fff640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f306415d3f0 0x7f30640c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:36.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f3063fff640 1 -- 172.21.15.77:0/2056884595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30640d0e40 msgr2=0x7f3064152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:36.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f3063fff640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30640d0e40 0x7f3064152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:36.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f3063fff640 1 -- 172.21.15.77:0/2056884595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3054009b30 con 0x7f306415d7d0 2023-11-26T07:19:36.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f30637fe640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30640d0e40 0x7f3064152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:36.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.190+0000 7f3063fff640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f306415d7d0 0x7f30640c9680 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f305c00b3f0 tx=0x7f305c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:36.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.191+0000 7f305bfff640 1 -- 172.21.15.77:0/2056884595 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c011830 con 0x7f306415d7d0 2023-11-26T07:19:36.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.191+0000 7f305bfff640 1 -- 172.21.15.77:0/2056884595 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c011990 con 0x7f306415d7d0 2023-11-26T07:19:36.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.191+0000 7f305bfff640 1 -- 172.21.15.77:0/2056884595 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c011d40 con 0x7f306415d7d0 2023-11-26T07:19:36.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.191+0000 7f3068aff640 1 -- 172.21.15.77:0/2056884595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30640c69d0 con 0x7f306415d7d0 2023-11-26T07:19:36.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.191+0000 7f3068aff640 1 -- 172.21.15.77:0/2056884595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30640c8330 con 0x7f306415d7d0 2023-11-26T07:19:36.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.192+0000 7f3068aff640 1 -- 172.21.15.77:0/2056884595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30640d06f0 con 0x7f306415d7d0 2023-11-26T07:19:36.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.193+0000 7f305bfff640 1 -- 172.21.15.77:0/2056884595 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f305c01a400 con 0x7f306415d7d0 2023-11-26T07:19:36.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.194+0000 7f305bfff640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f304406aff0 0x7f304406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:36.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.194+0000 7f305bfff640 1 -- 172.21.15.77:0/2056884595 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f305c089b30 con 0x7f306415d7d0 2023-11-26T07:19:36.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.194+0000 7f30637fe640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f304406aff0 0x7f304406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:36.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.195+0000 7f30637fe640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f304406aff0 0x7f304406d4b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3054035000 tx=0x7f3054030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:36.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.199+0000 7f305bfff640 1 -- 172.21.15.77:0/2056884595 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f30640d06f0 con 0x7f306415d7d0 2023-11-26T07:19:36.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.424+0000 7f3068aff640 1 -- 172.21.15.77:0/2056884595 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone15150", "target": ["mon-mgr", ""]}) v1 -- 0x7f30640ced50 con 0x7f304406aff0 2023-11-26T07:19:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.437+0000 7f305bfff640 1 -- 172.21.15.77:0/2056884595 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+164 (secure 0 0 0) 0x7f3054040450 con 0x7f304406aff0 2023-11-26T07:19:36.440 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:19:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:19:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "pending", 2023-11-26T07:19:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:19:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:19:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol1410", 2023-11-26T07:19:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap51340" 2023-11-26T07:19:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:36.441 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:19:36.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.440+0000 7f3068aff640 1 -- 172.21.15.77:0/2056884595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f304406aff0 msgr2=0x7f304406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:36.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.440+0000 7f3068aff640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f304406aff0 0x7f304406d4b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3054035000 tx=0x7f3054030000 comp rx=0 tx=0).stop 2023-11-26T07:19:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.440+0000 7f3068aff640 1 -- 172.21.15.77:0/2056884595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f306415d7d0 msgr2=0x7f30640c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.440+0000 7f3068aff640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f306415d7d0 0x7f30640c9680 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f305c00b3f0 tx=0x7f305c00b8b0 comp rx=0 tx=0).stop 2023-11-26T07:19:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.441+0000 7f3068aff640 1 -- 172.21.15.77:0/2056884595 shutdown_connections 2023-11-26T07:19:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.441+0000 7f3068aff640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f304406aff0 0x7f304406d4b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.441+0000 7f3068aff640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f306415d7d0 0x7f30640c9680 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.441+0000 7f3068aff640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f306415d3f0 0x7f30640c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.441+0000 7f3068aff640 1 --2- 172.21.15.77:0/2056884595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30640d0e40 0x7f3064152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.441+0000 7f3068aff640 1 -- 172.21.15.77:0/2056884595 >> 172.21.15.77:0/2056884595 conn(0x7f306409c5b0 msgr2=0x7f30640d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.441+0000 7f3068aff640 1 -- 172.21.15.77:0/2056884595 shutdown_connections 2023-11-26T07:19:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:36.441+0000 7f3068aff640 1 -- 172.21.15.77:0/2056884595 wait complete. 2023-11-26T07:19:37.462 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone15150 2023-11-26T07:19:37.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.687+0000 7ff16047c640 1 Processor -- start 2023-11-26T07:19:37.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.687+0000 7ff16047c640 1 -- start start 2023-11-26T07:19:37.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.688+0000 7ff16047c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1580cc0f0 0x7ff1580c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:37.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff16047c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1580c57e0 0x7ff15806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:37.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff16047c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15815eea0 con 0x7ff15815b440 2023-11-26T07:19:37.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff16047c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15815b820 con 0x7ff1580c57e0 2023-11-26T07:19:37.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff16047c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580abf30 con 0x7ff1580cc0f0 2023-11-26T07:19:37.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff15ea19640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1580c57e0 0x7ff15806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:37.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff15ea19640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1580c57e0 0x7ff15806c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36772/0 (socket says 172.21.15.77:36772) 2023-11-26T07:19:37.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff15ea19640 1 -- 172.21.15.77:0/3300323007 learned_addr learned my addr 172.21.15.77:0/3300323007 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:37.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff15da17640 1 --2- 172.21.15.77:0/3300323007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1580cc0f0 0x7ff1580c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:37.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff15ea19640 1 -- 172.21.15.77:0/3300323007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1580cc0f0 msgr2=0x7ff1580c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:37.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff15ea19640 1 --2- 172.21.15.77:0/3300323007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1580cc0f0 0x7ff1580c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:37.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff15ea19640 1 -- 172.21.15.77:0/3300323007 >> v1:172.21.15.159:6789/0 conn(0x7ff15815b440 legacy=0x7ff1580cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:37.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff15ea19640 1 -- 172.21.15.77:0/3300323007 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15815f0f0 con 0x7ff1580c57e0 2023-11-26T07:19:37.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.689+0000 7ff15da17640 1 --2- 172.21.15.77:0/3300323007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1580cc0f0 0x7ff1580c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:37.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.691+0000 7ff15ea19640 1 --2- 172.21.15.77:0/3300323007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1580c57e0 0x7ff15806c5f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff150009e50 tx=0x7ff15002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1399b5915292be3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:37.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.692+0000 7ff15d216640 1 -- 172.21.15.77:0/3300323007 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15002c9e0 con 0x7ff1580c57e0 2023-11-26T07:19:37.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.692+0000 7ff15d216640 1 -- 172.21.15.77:0/3300323007 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15002cb40 con 0x7ff1580c57e0 2023-11-26T07:19:37.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.692+0000 7ff15d216640 1 -- 172.21.15.77:0/3300323007 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500343f0 con 0x7ff1580c57e0 2023-11-26T07:19:37.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.692+0000 7ff16047c640 1 -- 172.21.15.77:0/3300323007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1580c57e0 msgr2=0x7ff15806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:37.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.692+0000 7ff16047c640 1 --2- 172.21.15.77:0/3300323007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1580c57e0 0x7ff15806c5f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff150009e50 tx=0x7ff15002be40 comp rx=0 tx=0).stop 2023-11-26T07:19:37.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.693+0000 7ff16047c640 1 -- 172.21.15.77:0/3300323007 shutdown_connections 2023-11-26T07:19:37.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.693+0000 7ff16047c640 1 --2- 172.21.15.77:0/3300323007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1580c57e0 0x7ff15806c5f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:37.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.693+0000 7ff16047c640 1 --2- 172.21.15.77:0/3300323007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1580cc0f0 0x7ff1580c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:37.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.693+0000 7ff16047c640 1 -- 172.21.15.77:0/3300323007 >> 172.21.15.77:0/3300323007 conn(0x7ff1580b0c50 msgr2=0x7ff1580b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:37.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.693+0000 7ff16047c640 1 -- 172.21.15.77:0/3300323007 shutdown_connections 2023-11-26T07:19:37.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.693+0000 7ff16047c640 1 -- 172.21.15.77:0/3300323007 wait complete. 2023-11-26T07:19:37.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.694+0000 7ff16047c640 1 Processor -- start 2023-11-26T07:19:37.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.695+0000 7ff16047c640 1 -- start start 2023-11-26T07:19:37.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff16047c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1580c57e0 0x7ff1580ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:37.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff16047c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1580cc0f0 0x7ff1580ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:37.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff16047c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff15815b440 0x7ff158154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:37.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff16047c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580b3580 con 0x7ff15815b440 2023-11-26T07:19:37.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff16047c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff158155350 con 0x7ff1580c57e0 2023-11-26T07:19:37.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff16047c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580cdb70 con 0x7ff1580cc0f0 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff15ea19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff15815b440 0x7ff158154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff15ea19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff15815b440 0x7ff158154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36786/0 (socket says 172.21.15.77:36786) 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff15ea19640 1 -- 172.21.15.77:0/3833472925 learned_addr learned my addr 172.21.15.77:0/3833472925 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff15e218640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1580c57e0 0x7ff1580ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff15ea19640 1 -- 172.21.15.77:0/3833472925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1580cc0f0 msgr2=0x7ff1580ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.696+0000 7ff15da17640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1580cc0f0 0x7ff1580ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.697+0000 7ff15ea19640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1580cc0f0 0x7ff1580ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.697+0000 7ff15ea19640 1 -- 172.21.15.77:0/3833472925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1580c57e0 msgr2=0x7ff1580ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.697+0000 7ff15ea19640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1580c57e0 0x7ff1580ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.697+0000 7ff15ea19640 1 -- 172.21.15.77:0/3833472925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff150009b30 con 0x7ff15815b440 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.697+0000 7ff15e218640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1580c57e0 0x7ff1580ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:37.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.697+0000 7ff15ea19640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff15815b440 0x7ff158154e10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff150036040 tx=0x7ff150004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:37.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.698+0000 7ff14effd640 1 -- 172.21.15.77:0/3833472925 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15003e450 con 0x7ff15815b440 2023-11-26T07:19:37.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.698+0000 7ff14effd640 1 -- 172.21.15.77:0/3833472925 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15003e5d0 con 0x7ff15815b440 2023-11-26T07:19:37.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.698+0000 7ff16047c640 1 -- 172.21.15.77:0/3833472925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1581f42b0 con 0x7ff15815b440 2023-11-26T07:19:37.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.698+0000 7ff14effd640 1 -- 172.21.15.77:0/3833472925 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15003e980 con 0x7ff15815b440 2023-11-26T07:19:37.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.698+0000 7ff16047c640 1 -- 172.21.15.77:0/3833472925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1580cd5b0 con 0x7ff15815b440 2023-11-26T07:19:37.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.699+0000 7ff16047c640 1 -- 172.21.15.77:0/3833472925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1580b32c0 con 0x7ff15815b440 2023-11-26T07:19:37.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.700+0000 7ff14effd640 1 -- 172.21.15.77:0/3833472925 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff15003eae0 con 0x7ff15815b440 2023-11-26T07:19:37.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.701+0000 7ff14effd640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff13c06aff0 0x7ff13c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:37.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.701+0000 7ff14effd640 1 -- 172.21.15.77:0/3833472925 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1500ac730 con 0x7ff15815b440 2023-11-26T07:19:37.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.701+0000 7ff15e218640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff13c06aff0 0x7ff13c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:37.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.702+0000 7ff15e218640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff13c06aff0 0x7ff13c06d4b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff15400a830 tx=0x7ff154008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:37.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.705+0000 7ff14effd640 1 -- 172.21.15.77:0/3833472925 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff150077710 con 0x7ff15815b440 2023-11-26T07:19:37.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:37.939+0000 7ff16047c640 1 -- 172.21.15.77:0/3833472925 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone15150", "target": ["mon-mgr", ""]}) v1 -- 0x7ff15815f990 con 0x7ff13c06aff0 2023-11-26T07:19:40.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.275+0000 7ff14effd640 1 -- 172.21.15.77:0/3833472925 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+168 (secure 0 0 0) 0x7ff15400adb0 con 0x7ff13c06aff0 2023-11-26T07:19:40.278 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:19:40.278 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:19:40.278 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "in-progress", 2023-11-26T07:19:40.278 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:19:40.278 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:19:40.278 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol1410", 2023-11-26T07:19:40.278 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap51340" 2023-11-26T07:19:40.278 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:40.279 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:40.279 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:19:40.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.278+0000 7ff16047c640 1 -- 172.21.15.77:0/3833472925 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff13c06aff0 msgr2=0x7ff13c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:40.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.278+0000 7ff16047c640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff13c06aff0 0x7ff13c06d4b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff15400a830 tx=0x7ff154008040 comp rx=0 tx=0).stop 2023-11-26T07:19:40.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.278+0000 7ff16047c640 1 -- 172.21.15.77:0/3833472925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff15815b440 msgr2=0x7ff158154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:40.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.278+0000 7ff16047c640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff15815b440 0x7ff158154e10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff150036040 tx=0x7ff150004a40 comp rx=0 tx=0).stop 2023-11-26T07:19:40.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.278+0000 7ff16047c640 1 -- 172.21.15.77:0/3833472925 shutdown_connections 2023-11-26T07:19:40.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.278+0000 7ff16047c640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff13c06aff0 0x7ff13c06d4b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:40.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.278+0000 7ff16047c640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff15815b440 0x7ff158154e10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:40.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.278+0000 7ff16047c640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1580cc0f0 0x7ff1580ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:40.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.278+0000 7ff16047c640 1 --2- 172.21.15.77:0/3833472925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1580c57e0 0x7ff1580ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:40.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.278+0000 7ff16047c640 1 -- 172.21.15.77:0/3833472925 >> 172.21.15.77:0/3833472925 conn(0x7ff1580b0c50 msgr2=0x7ff158071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:40.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.279+0000 7ff16047c640 1 -- 172.21.15.77:0/3833472925 shutdown_connections 2023-11-26T07:19:40.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:40.279+0000 7ff16047c640 1 -- 172.21.15.77:0/3833472925 wait complete. 2023-11-26T07:19:41.301 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone15150 2023-11-26T07:19:41.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.522+0000 7fbddd809640 1 Processor -- start 2023-11-26T07:19:41.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.522+0000 7fbddd809640 1 -- start start 2023-11-26T07:19:41.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.524+0000 7fbddd809640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbdd81660b0 0x7fbdd8162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:41.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.524+0000 7fbddd809640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd8162540 0x7fbdd80c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:41.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.524+0000 7fbddd809640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd8166510 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.524+0000 7fbddd809640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd81655f0 con 0x7fbdd81660b0 2023-11-26T07:19:41.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.524+0000 7fbddd809640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80cc380 con 0x7fbdd8162540 2023-11-26T07:19:41.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.525+0000 7fbdd77fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd8162540 0x7fbdd80c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:41.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.525+0000 7fbdd77fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd8162540 0x7fbdd80c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:60676/0 (socket says 172.21.15.77:60676) 2023-11-26T07:19:41.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.525+0000 7fbdd77fe640 1 -- 172.21.15.77:0/4037979378 learned_addr learned my addr 172.21.15.77:0/4037979378 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:41.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.525+0000 7fbdce7fc640 1 --2- 172.21.15.77:0/4037979378 >> v2:172.21.15.159:3300/0 conn(0x7fbdd81660b0 0x7fbdd8162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:41.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.526+0000 7fbdd77fe640 1 -- 172.21.15.77:0/4037979378 >> v2:172.21.15.159:3300/0 conn(0x7fbdd81660b0 msgr2=0x7fbdd8162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:41.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.526+0000 7fbdd77fe640 1 --2- 172.21.15.77:0/4037979378 >> v2:172.21.15.159:3300/0 conn(0x7fbdd81660b0 0x7fbdd8162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:41.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.526+0000 7fbdd77fe640 1 -- 172.21.15.77:0/4037979378 >> v1:172.21.15.159:6789/0 conn(0x7fbdd80ccbd0 legacy=0x7fbdd80ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:41.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.526+0000 7fbdd77fe640 1 -- 172.21.15.77:0/4037979378 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd8162b30 con 0x7fbdd8162540 2023-11-26T07:19:41.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.527+0000 7fbdd77fe640 1 --2- 172.21.15.77:0/4037979378 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd8162540 0x7fbdd80c9650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009e50 tx=0x7fbdd002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20b4077913ddb8d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:41.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.528+0000 7fbdd67fc640 1 -- 172.21.15.77:0/4037979378 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd002cb00 con 0x7fbdd8162540 2023-11-26T07:19:41.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.528+0000 7fbdd67fc640 1 -- 172.21.15.77:0/4037979378 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd002cc60 con 0x7fbdd8162540 2023-11-26T07:19:41.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.528+0000 7fbdd67fc640 1 -- 172.21.15.77:0/4037979378 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00343f0 con 0x7fbdd8162540 2023-11-26T07:19:41.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.529+0000 7fbddd809640 1 -- 172.21.15.77:0/4037979378 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd8162540 msgr2=0x7fbdd80c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:41.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.529+0000 7fbddd809640 1 --2- 172.21.15.77:0/4037979378 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd8162540 0x7fbdd80c9650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009e50 tx=0x7fbdd002bf60 comp rx=0 tx=0).stop 2023-11-26T07:19:41.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.529+0000 7fbddd809640 1 -- 172.21.15.77:0/4037979378 shutdown_connections 2023-11-26T07:19:41.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.529+0000 7fbddd809640 1 --2- 172.21.15.77:0/4037979378 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd8162540 0x7fbdd80c9650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:41.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.529+0000 7fbddd809640 1 --2- 172.21.15.77:0/4037979378 >> v2:172.21.15.159:3300/0 conn(0x7fbdd81660b0 0x7fbdd8162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:41.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.529+0000 7fbddd809640 1 -- 172.21.15.77:0/4037979378 >> 172.21.15.77:0/4037979378 conn(0x7fbdd80b0c50 msgr2=0x7fbdd80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:41.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.529+0000 7fbddd809640 1 -- 172.21.15.77:0/4037979378 shutdown_connections 2023-11-26T07:19:41.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.529+0000 7fbddd809640 1 -- 172.21.15.77:0/4037979378 wait complete. 2023-11-26T07:19:41.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.531+0000 7fbddd809640 1 Processor -- start 2023-11-26T07:19:41.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.531+0000 7fbddd809640 1 -- start start 2023-11-26T07:19:41.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.532+0000 7fbddd809640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdd80ccbd0 0x7fbdd80704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.532+0000 7fbddd809640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdd8162540 0x7fbdd8071970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.532+0000 7fbddd809640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd81660b0 0x7fbdd81f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.532+0000 7fbddd809640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd809abb0 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.532+0000 7fbddd809640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8071eb0 con 0x7fbdd8162540 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.532+0000 7fbddd809640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd81f78f0 con 0x7fbdd81660b0 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.533+0000 7fbdd6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdd80ccbd0 0x7fbdd80704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.533+0000 7fbdd6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdd80ccbd0 0x7fbdd80704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36800/0 (socket says 172.21.15.77:36800) 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.533+0000 7fbdd6ffd640 1 -- 172.21.15.77:0/3572927254 learned_addr learned my addr 172.21.15.77:0/3572927254 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.533+0000 7fbdd77fe640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd81660b0 0x7fbdd81f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.533+0000 7fbdce7fc640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdd8162540 0x7fbdd8071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.533+0000 7fbdd6ffd640 1 -- 172.21.15.77:0/3572927254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd81660b0 msgr2=0x7fbdd81f7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:41.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.533+0000 7fbdd6ffd640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd81660b0 0x7fbdd81f7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:41.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.533+0000 7fbdd6ffd640 1 -- 172.21.15.77:0/3572927254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdd8162540 msgr2=0x7fbdd8071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:41.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.533+0000 7fbdd6ffd640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdd8162540 0x7fbdd8071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:41.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.533+0000 7fbdd6ffd640 1 -- 172.21.15.77:0/3572927254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd0009b30 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.534+0000 7fbdd6ffd640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdd80ccbd0 0x7fbdd80704c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c480 tx=0x7fbdc800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:41.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.534+0000 7fbdd4ff9640 1 -- 172.21.15.77:0/3572927254 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc80052d0 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.534+0000 7fbdd4ff9640 1 -- 172.21.15.77:0/3572927254 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8005430 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.534+0000 7fbddd809640 1 -- 172.21.15.77:0/3572927254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd81f75c0 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.534+0000 7fbdd4ff9640 1 -- 172.21.15.77:0/3572927254 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8012870 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.534+0000 7fbddd809640 1 -- 172.21.15.77:0/3572927254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd8070e30 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.535+0000 7fbddd809640 1 -- 172.21.15.77:0/3572927254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd804e8b0 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.536+0000 7fbdd4ff9640 1 -- 172.21.15.77:0/3572927254 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbdc80129d0 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.537+0000 7fbdd4ff9640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbdb806aff0 0x7fbdb806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:41.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.537+0000 7fbdd4ff9640 1 -- 172.21.15.77:0/3572927254 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fbdc8089300 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.537+0000 7fbdce7fc640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbdb806aff0 0x7fbdb806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:41.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.538+0000 7fbdce7fc640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbdb806aff0 0x7fbdb806d4b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8164b90 tx=0x7fbdc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:41.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.543+0000 7fbdd4ff9640 1 -- 172.21.15.77:0/3572927254 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbdc8054160 con 0x7fbdd80ccbd0 2023-11-26T07:19:41.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:41.778+0000 7fbddd809640 1 -- 172.21.15.77:0/3572927254 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone15150", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdd8165b90 con 0x7fbdb806aff0 2023-11-26T07:19:45.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.263+0000 7fbdd4ff9640 1 -- 172.21.15.77:0/3572927254 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+271 (secure 0 0 0) 0x7fbdc0009680 con 0x7fbdb806aff0 2023-11-26T07:19:45.266 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:19:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:19:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "failed", 2023-11-26T07:19:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:19:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:19:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol1410", 2023-11-26T07:19:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap51340" 2023-11-26T07:19:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:19:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: "failure": { 2023-11-26T07:19:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: "errno": "2", 2023-11-26T07:19:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: "error_msg": "snapshot 'subvol_snap51340' does not exist" 2023-11-26T07:19:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:45.267 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:19:45.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.266+0000 7fbddd809640 1 -- 172.21.15.77:0/3572927254 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbdb806aff0 msgr2=0x7fbdb806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:45.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.266+0000 7fbddd809640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbdb806aff0 0x7fbdb806d4b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8164b90 tx=0x7fbdc0008040 comp rx=0 tx=0).stop 2023-11-26T07:19:45.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.266+0000 7fbddd809640 1 -- 172.21.15.77:0/3572927254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdd80ccbd0 msgr2=0x7fbdd80704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:45.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.266+0000 7fbddd809640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdd80ccbd0 0x7fbdd80704c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c480 tx=0x7fbdc800c940 comp rx=0 tx=0).stop 2023-11-26T07:19:45.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.267+0000 7fbddd809640 1 -- 172.21.15.77:0/3572927254 shutdown_connections 2023-11-26T07:19:45.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.267+0000 7fbddd809640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbdb806aff0 0x7fbdb806d4b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.267+0000 7fbddd809640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdd81660b0 0x7fbdd81f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.267+0000 7fbddd809640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdd8162540 0x7fbdd8071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.267+0000 7fbddd809640 1 --2- 172.21.15.77:0/3572927254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdd80ccbd0 0x7fbdd80704c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.267+0000 7fbddd809640 1 -- 172.21.15.77:0/3572927254 >> 172.21.15.77:0/3572927254 conn(0x7fbdd80b0c50 msgr2=0x7fbdd80c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:45.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.267+0000 7fbddd809640 1 -- 172.21.15.77:0/3572927254 shutdown_connections 2023-11-26T07:19:45.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.267+0000 7fbddd809640 1 -- 172.21.15.77:0/3572927254 wait complete. 2023-11-26T07:19:45.291 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone15150 2023-11-26T07:19:45.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.507+0000 7f8ad99fa640 1 Processor -- start 2023-11-26T07:19:45.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.507+0000 7f8ad99fa640 1 -- start start 2023-11-26T07:19:45.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.508+0000 7f8ad99fa640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8ad40b0b40 0x7f8ad40b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:45.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.508+0000 7f8ad99fa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ad406c5b0 0x7f8ad406ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:45.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.508+0000 7f8ad99fa640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad415ed20 con 0x7f8ad415b260 2023-11-26T07:19:45.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.508+0000 7f8ad99fa640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad415b640 con 0x7f8ad406c5b0 2023-11-26T07:19:45.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.508+0000 7f8ad99fa640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad40b14f0 con 0x7f8ad40b0b40 2023-11-26T07:19:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.508+0000 7f8ad89f8640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8ad415b260 0x7f8ad406e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42816/0 (socket says 172.21.15.77:42816) 2023-11-26T07:19:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.508+0000 7f8ad89f8640 1 -- 172.21.15.77:0/96932931 learned_addr learned my addr 172.21.15.77:0/96932931 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.508+0000 7f8ad91f9640 1 --2- 172.21.15.77:0/96932931 >> v2:172.21.15.77:3300/0 conn(0x7f8ad406c5b0 0x7f8ad406ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.509+0000 7f8ad3fff640 1 --2- 172.21.15.77:0/96932931 >> v2:172.21.15.159:3300/0 conn(0x7f8ad40b0b40 0x7f8ad40b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:45.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.509+0000 7f8ad91f9640 1 -- 172.21.15.77:0/96932931 >> v2:172.21.15.159:3300/0 conn(0x7f8ad40b0b40 msgr2=0x7f8ad40b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:45.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.509+0000 7f8ad91f9640 1 --2- 172.21.15.77:0/96932931 >> v2:172.21.15.159:3300/0 conn(0x7f8ad40b0b40 0x7f8ad40b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.509+0000 7f8ad91f9640 1 -- 172.21.15.77:0/96932931 >> v1:172.21.15.77:6789/0 conn(0x7f8ad415b260 legacy=0x7f8ad406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:45.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.509+0000 7f8ad91f9640 1 -- 172.21.15.77:0/96932931 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad415f8a0 con 0x7f8ad406c5b0 2023-11-26T07:19:45.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.510+0000 7f8ad91f9640 1 --2- 172.21.15.77:0/96932931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ad406c5b0 0x7f8ad406ca20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40ce370 tx=0x7f8acc02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb850ba5c971730 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:45.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.510+0000 7f8ad37fe640 1 -- 172.21.15.77:0/96932931 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc02cb50 con 0x7f8ad406c5b0 2023-11-26T07:19:45.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.510+0000 7f8ad37fe640 1 -- 172.21.15.77:0/96932931 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc02ccb0 con 0x7f8ad406c5b0 2023-11-26T07:19:45.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.510+0000 7f8ad37fe640 1 -- 172.21.15.77:0/96932931 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc034660 con 0x7f8ad406c5b0 2023-11-26T07:19:45.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.511+0000 7f8ad99fa640 1 -- 172.21.15.77:0/96932931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ad406c5b0 msgr2=0x7f8ad406ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:45.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.511+0000 7f8ad99fa640 1 --2- 172.21.15.77:0/96932931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ad406c5b0 0x7f8ad406ca20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40ce370 tx=0x7f8acc02bda0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.511+0000 7f8ad99fa640 1 -- 172.21.15.77:0/96932931 shutdown_connections 2023-11-26T07:19:45.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.511+0000 7f8ad99fa640 1 --2- 172.21.15.77:0/96932931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ad406c5b0 0x7f8ad406ca20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.511+0000 7f8ad99fa640 1 --2- 172.21.15.77:0/96932931 >> v2:172.21.15.159:3300/0 conn(0x7f8ad40b0b40 0x7f8ad40b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.511+0000 7f8ad99fa640 1 -- 172.21.15.77:0/96932931 >> 172.21.15.77:0/96932931 conn(0x7f8ad40cbb40 msgr2=0x7f8ad40cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:45.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.511+0000 7f8ad99fa640 1 -- 172.21.15.77:0/96932931 shutdown_connections 2023-11-26T07:19:45.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.511+0000 7f8ad99fa640 1 -- 172.21.15.77:0/96932931 wait complete. 2023-11-26T07:19:45.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.513+0000 7f8ad99fa640 1 Processor -- start 2023-11-26T07:19:45.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.513+0000 7f8ad99fa640 1 -- start start 2023-11-26T07:19:45.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.514+0000 7f8ad99fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ad406c5b0 0x7f8ad415a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:45.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.514+0000 7f8ad99fa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ad40b0b40 0x7f8ad40b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:45.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.514+0000 7f8ad99fa640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ad415b260 0x7f8ad40b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:45.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.514+0000 7f8ad99fa640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad40b46e0 con 0x7f8ad40b0b40 2023-11-26T07:19:45.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.514+0000 7f8ad99fa640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad40b1be0 con 0x7f8ad406c5b0 2023-11-26T07:19:45.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.514+0000 7f8ad99fa640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad40b1ec0 con 0x7f8ad415b260 2023-11-26T07:19:45.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.514+0000 7f8ad3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ad40b0b40 0x7f8ad40b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:45.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.514+0000 7f8ad3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ad40b0b40 0x7f8ad40b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36826/0 (socket says 172.21.15.77:36826) 2023-11-26T07:19:45.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.514+0000 7f8ad3fff640 1 -- 172.21.15.77:0/4160020149 learned_addr learned my addr 172.21.15.77:0/4160020149 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:45.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad3fff640 1 -- 172.21.15.77:0/4160020149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ad415b260 msgr2=0x7f8ad40b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad91f9640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ad415b260 0x7f8ad40b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad3fff640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ad415b260 0x7f8ad40b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad3fff640 1 -- 172.21.15.77:0/4160020149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ad406c5b0 msgr2=0x7f8ad415a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad89f8640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ad406c5b0 0x7f8ad415a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad3fff640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ad406c5b0 0x7f8ad415a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad3fff640 1 -- 172.21.15.77:0/4160020149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc009a70 con 0x7f8ad40b0b40 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad3fff640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ad40b0b40 0x7f8ad40b3c60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000d5f0 tx=0x7f8ac000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad17fa640 1 -- 172.21.15.77:0/4160020149 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00125f0 con 0x7f8ad40b0b40 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad17fa640 1 -- 172.21.15.77:0/4160020149 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac0012750 con 0x7f8ad40b0b40 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad17fa640 1 -- 172.21.15.77:0/4160020149 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0012b00 con 0x7f8ad40b0b40 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.515+0000 7f8ad99fa640 1 -- 172.21.15.77:0/4160020149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad40b21a0 con 0x7f8ad40b0b40 2023-11-26T07:19:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.516+0000 7f8ad99fa640 1 -- 172.21.15.77:0/4160020149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad415a770 con 0x7f8ad40b0b40 2023-11-26T07:19:45.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.517+0000 7f8ad99fa640 1 -- 172.21.15.77:0/4160020149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad404e840 con 0x7f8ad40b0b40 2023-11-26T07:19:45.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.517+0000 7f8ad17fa640 1 -- 172.21.15.77:0/4160020149 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8ac0012c60 con 0x7f8ad40b0b40 2023-11-26T07:19:45.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.518+0000 7f8ad17fa640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ab806aff0 0x7f8ab806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:45.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.519+0000 7f8ad17fa640 1 -- 172.21.15.77:0/4160020149 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f8ac0089e70 con 0x7f8ad40b0b40 2023-11-26T07:19:45.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.519+0000 7f8ad89f8640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ab806aff0 0x7f8ab806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:45.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.519+0000 7f8ad89f8640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ab806aff0 0x7f8ab806d4b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8005880 tx=0x7f8ac8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:45.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.523+0000 7f8ad17fa640 1 -- 172.21.15.77:0/4160020149 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8ac0054c50 con 0x7f8ad40b0b40 2023-11-26T07:19:45.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.750+0000 7f8ad99fa640 1 -- 172.21.15.77:0/4160020149 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone15150", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ad40acbf0 con 0x7f8ab806aff0 2023-11-26T07:19:45.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.761+0000 7f8ad17fa640 1 -- 172.21.15.77:0/4160020149 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+271 (secure 0 0 0) 0x7f8ad40acbf0 con 0x7f8ab806aff0 2023-11-26T07:19:45.764 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:19:45.764 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:19:45.764 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "failed", 2023-11-26T07:19:45.764 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:19:45.764 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:19:45.764 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol1410", 2023-11-26T07:19:45.764 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap51340" 2023-11-26T07:19:45.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:19:45.765 INFO:teuthology.orchestra.run.smithi077.stdout: "failure": { 2023-11-26T07:19:45.765 INFO:teuthology.orchestra.run.smithi077.stdout: "errno": "2", 2023-11-26T07:19:45.765 INFO:teuthology.orchestra.run.smithi077.stdout: "error_msg": "snapshot 'subvol_snap51340' does not exist" 2023-11-26T07:19:45.765 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:45.765 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:19:45.765 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:19:45.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 -- 172.21.15.77:0/4160020149 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ab806aff0 msgr2=0x7f8ab806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:45.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ab806aff0 0x7f8ab806d4b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8005880 tx=0x7f8ac8009040 comp rx=0 tx=0).stop 2023-11-26T07:19:45.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 -- 172.21.15.77:0/4160020149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ad40b0b40 msgr2=0x7f8ad40b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:45.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ad40b0b40 0x7f8ad40b3c60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000d5f0 tx=0x7f8ac000dab0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 -- 172.21.15.77:0/4160020149 shutdown_connections 2023-11-26T07:19:45.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8ab806aff0 0x7f8ab806d4b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ad415b260 0x7f8ad40b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ad40b0b40 0x7f8ad40b3c60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 --2- 172.21.15.77:0/4160020149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ad406c5b0 0x7f8ad415a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:45.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 -- 172.21.15.77:0/4160020149 >> 172.21.15.77:0/4160020149 conn(0x7f8ad40cbb40 msgr2=0x7f8ad40cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:45.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 -- 172.21.15.77:0/4160020149 shutdown_connections 2023-11-26T07:19:45.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.765+0000 7f8ad99fa640 1 -- 172.21.15.77:0/4160020149 wait complete. 2023-11-26T07:19:45.785 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone15150 --force 2023-11-26T07:19:46.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.999+0000 7f509b50d640 1 Processor -- start 2023-11-26T07:19:46.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:45.999+0000 7f509b50d640 1 -- start start 2023-11-26T07:19:46.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.001+0000 7f509b50d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f509406cb90 0x7f509406d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:46.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.001+0000 7f509b50d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50940b3db0 con 0x7f509406b510 2023-11-26T07:19:46.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.001+0000 7f509b50d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50940b31a0 con 0x7f509415d4d0 2023-11-26T07:19:46.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.001+0000 7f509b50d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509406d550 con 0x7f509406cb90 2023-11-26T07:19:46.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.002+0000 7f509ad0c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f509406b510 0x7f50940ad2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36326/0 (socket says 172.21.15.77:36326) 2023-11-26T07:19:46.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.002+0000 7f509ad0c640 1 -- 172.21.15.77:0/3849669811 learned_addr learned my addr 172.21.15.77:0/3849669811 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:46.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.002+0000 7f5099d0a640 1 --2- 172.21.15.77:0/3849669811 >> v2:172.21.15.77:3300/0 conn(0x7f509406cb90 0x7f509406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:46.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.002+0000 7f5099d0a640 1 -- 172.21.15.77:0/3849669811 >> v1:172.21.15.159:6789/0 conn(0x7f509415d4d0 legacy=0x7f50940b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:46.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.002+0000 7f5099d0a640 1 -- 172.21.15.77:0/3849669811 >> v1:172.21.15.77:6789/0 conn(0x7f509406b510 legacy=0x7f50940ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:46.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.002+0000 7f5099d0a640 1 -- 172.21.15.77:0/3849669811 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50940b3480 con 0x7f509406cb90 2023-11-26T07:19:46.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.002+0000 7f5099509640 1 -- 172.21.15.77:0/3849669811 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289247628 0 0) 0x7f50940b3db0 con 0x7f509406b510 2023-11-26T07:19:46.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.003+0000 7f5099d0a640 1 --2- 172.21.15.77:0/3849669811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f509406cb90 0x7f509406d010 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f50840097a0 tx=0x7f508402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac180c340d3a01c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:46.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.003+0000 7f5099509640 1 -- 172.21.15.77:0/3849669811 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084030610 con 0x7f509406cb90 2023-11-26T07:19:46.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.003+0000 7f5099509640 1 -- 172.21.15.77:0/3849669811 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5084030770 con 0x7f509406cb90 2023-11-26T07:19:46.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.003+0000 7f5099509640 1 -- 172.21.15.77:0/3849669811 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084030b00 con 0x7f509406cb90 2023-11-26T07:19:46.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.004+0000 7f509b50d640 1 -- 172.21.15.77:0/3849669811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f509406cb90 msgr2=0x7f509406d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:46.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.004+0000 7f509b50d640 1 --2- 172.21.15.77:0/3849669811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f509406cb90 0x7f509406d010 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f50840097a0 tx=0x7f508402b960 comp rx=0 tx=0).stop 2023-11-26T07:19:46.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.004+0000 7f509b50d640 1 -- 172.21.15.77:0/3849669811 shutdown_connections 2023-11-26T07:19:46.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.004+0000 7f509b50d640 1 --2- 172.21.15.77:0/3849669811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f509406cb90 0x7f509406d010 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.004+0000 7f509b50d640 1 -- 172.21.15.77:0/3849669811 >> 172.21.15.77:0/3849669811 conn(0x7f5094070c80 msgr2=0x7f5094071060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:46.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.004+0000 7f509b50d640 1 -- 172.21.15.77:0/3849669811 shutdown_connections 2023-11-26T07:19:46.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.004+0000 7f509b50d640 1 -- 172.21.15.77:0/3849669811 wait complete. 2023-11-26T07:19:46.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.006+0000 7f509b50d640 1 Processor -- start 2023-11-26T07:19:46.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.006+0000 7f509b50d640 1 -- start start 2023-11-26T07:19:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.007+0000 7f509b50d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f509406b510 0x7f5094154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.007+0000 7f509b50d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f509406cb90 0x7f509415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.007+0000 7f509b50d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f509415d4d0 0x7f509415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.007+0000 7f509b50d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509415ba40 con 0x7f509406b510 2023-11-26T07:19:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.007+0000 7f509b50d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5094154400 con 0x7f509415d4d0 2023-11-26T07:19:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.007+0000 7f509b50d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509415adc0 con 0x7f509406cb90 2023-11-26T07:19:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.007+0000 7f509a50b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f509406b510 0x7f5094154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.007+0000 7f509a50b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f509406b510 0x7f5094154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50320/0 (socket says 172.21.15.77:50320) 2023-11-26T07:19:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.007+0000 7f509a50b640 1 -- 172.21.15.77:0/633632242 learned_addr learned my addr 172.21.15.77:0/633632242 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.008+0000 7f509a50b640 1 -- 172.21.15.77:0/633632242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f509406cb90 msgr2=0x7f509415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.008+0000 7f509a50b640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f509406cb90 0x7f509415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.008+0000 7f509a50b640 1 -- 172.21.15.77:0/633632242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f509415d4d0 msgr2=0x7f509415a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.008+0000 7f509a50b640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f509415d4d0 0x7f509415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.008+0000 7f509a50b640 1 -- 172.21.15.77:0/633632242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084009400 con 0x7f509406b510 2023-11-26T07:19:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.008+0000 7f509a50b640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f509406b510 0x7f5094154c90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f509000c400 tx=0x7f509000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.008+0000 7f508affd640 1 -- 172.21.15.77:0/633632242 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900052d0 con 0x7f509406b510 2023-11-26T07:19:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.008+0000 7f508affd640 1 -- 172.21.15.77:0/633632242 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090005430 con 0x7f509406b510 2023-11-26T07:19:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.008+0000 7f509b50d640 1 -- 172.21.15.77:0/633632242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509415b0a0 con 0x7f509406b510 2023-11-26T07:19:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.008+0000 7f508affd640 1 -- 172.21.15.77:0/633632242 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090003830 con 0x7f509406b510 2023-11-26T07:19:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.008+0000 7f509b50d640 1 -- 172.21.15.77:0/633632242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509415b660 con 0x7f509406b510 2023-11-26T07:19:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.009+0000 7f509b50d640 1 -- 172.21.15.77:0/633632242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509404e840 con 0x7f509406b510 2023-11-26T07:19:46.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.011+0000 7f508affd640 1 -- 172.21.15.77:0/633632242 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5090003990 con 0x7f509406b510 2023-11-26T07:19:46.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.011+0000 7f508affd640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f507806aff0 0x7f507806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:46.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.012+0000 7f508affd640 1 -- 172.21.15.77:0/633632242 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f5090088f00 con 0x7f509406b510 2023-11-26T07:19:46.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.012+0000 7f5099d0a640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f507806aff0 0x7f507806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.012+0000 7f5099d0a640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f507806aff0 0x7f507806d4b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5084036000 tx=0x7f508403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:46.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.016+0000 7f508affd640 1 -- 172.21.15.77:0/633632242 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5090053ce0 con 0x7f509406b510 2023-11-26T07:19:46.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.229+0000 7f509b50d640 1 -- 172.21.15.77:0/633632242 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone15150", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f50940b3a40 con 0x7f507806aff0 2023-11-26T07:19:46.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.265+0000 7f508affd640 1 -- 172.21.15.77:0/633632242 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5084030960 con 0x7f507806aff0 2023-11-26T07:19:46.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 -- 172.21.15.77:0/633632242 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f507806aff0 msgr2=0x7f507806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:46.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f507806aff0 0x7f507806d4b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5084036000 tx=0x7f508403b040 comp rx=0 tx=0).stop 2023-11-26T07:19:46.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 -- 172.21.15.77:0/633632242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f509406b510 msgr2=0x7f5094154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:46.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f509406b510 0x7f5094154c90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f509000c400 tx=0x7f509000c8c0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 -- 172.21.15.77:0/633632242 shutdown_connections 2023-11-26T07:19:46.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f507806aff0 0x7f507806d4b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f509415d4d0 0x7f509415a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f509406cb90 0x7f509415a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 --2- 172.21.15.77:0/633632242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f509406b510 0x7f5094154c90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 -- 172.21.15.77:0/633632242 >> 172.21.15.77:0/633632242 conn(0x7f5094070c80 msgr2=0x7f509415c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:46.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 -- 172.21.15.77:0/633632242 shutdown_connections 2023-11-26T07:19:46.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.268+0000 7f509b50d640 1 -- 172.21.15.77:0/633632242 wait complete. 2023-11-26T07:19:46.272 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:46.271+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:46.272 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:46.271+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:46.272 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:46.271+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:46.272 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:46.271+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:46.272 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:46.271+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:46.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol1410 2023-11-26T07:19:46.297 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:46.296+0000 7f59b45fb640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:46.298 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:46.296+0000 7f59b45fb640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:46.298 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:46.296+0000 7f59b45fb640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:46.298 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:46.296+0000 7f59b45fb640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:46.298 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:19:46.296+0000 7f59b45fb640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:46.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.473+0000 7f9bf1aad640 1 Processor -- start 2023-11-26T07:19:46.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.473+0000 7f9bf1aad640 1 -- start start 2023-11-26T07:19:46.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.475+0000 7f9bf1aad640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9bec15d3f0 0x7f9bec0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:46.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.475+0000 7f9bf1aad640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9bec0d0e40 0x7f9bec0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:46.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.475+0000 7f9bf1aad640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec0d15e0 con 0x7f9bec15d7d0 2023-11-26T07:19:46.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.475+0000 7f9bf1aad640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec0d0280 con 0x7f9bec15d3f0 2023-11-26T07:19:46.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.475+0000 7f9bf1aad640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec0d1300 con 0x7f9bec0d0e40 2023-11-26T07:19:46.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.475+0000 7f9bf0aab640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9bec15d3f0 0x7f9bec0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:46.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.475+0000 7f9bf0aab640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9bec15d3f0 0x7f9bec0d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50370/0 (socket says 172.21.15.77:50370) 2023-11-26T07:19:46.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.475+0000 7f9bf0aab640 1 -- 172.21.15.77:0/1699154180 learned_addr learned my addr 172.21.15.77:0/1699154180 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:46.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.476+0000 7f9bf0aab640 1 -- 172.21.15.77:0/1699154180 >> v2:172.21.15.159:3300/0 conn(0x7f9bec0d0e40 msgr2=0x7f9bec0d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:46.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.476+0000 7f9bf0aab640 1 --2- 172.21.15.77:0/1699154180 >> v2:172.21.15.159:3300/0 conn(0x7f9bec0d0e40 0x7f9bec0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.476+0000 7f9bf0aab640 1 -- 172.21.15.77:0/1699154180 >> v1:172.21.15.159:6789/0 conn(0x7f9bec15d7d0 legacy=0x7f9bec0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:46.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.476+0000 7f9bf0aab640 1 -- 172.21.15.77:0/1699154180 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec0cfc30 con 0x7f9bec15d3f0 2023-11-26T07:19:46.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.477+0000 7f9bf0aab640 1 --2- 172.21.15.77:0/1699154180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bec15d3f0 0x7f9bec0d1830 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9bec08c6e0 tx=0x7f9bdc02b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a1769ec061b9ee server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:46.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.478+0000 7f9beb7fe640 1 -- 172.21.15.77:0/1699154180 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc031890 con 0x7f9bec15d3f0 2023-11-26T07:19:46.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.478+0000 7f9beb7fe640 1 -- 172.21.15.77:0/1699154180 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc0319f0 con 0x7f9bec15d3f0 2023-11-26T07:19:46.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.478+0000 7f9beb7fe640 1 -- 172.21.15.77:0/1699154180 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc031d80 con 0x7f9bec15d3f0 2023-11-26T07:19:46.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.478+0000 7f9bf1aad640 1 -- 172.21.15.77:0/1699154180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bec15d3f0 msgr2=0x7f9bec0d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:46.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.478+0000 7f9bf1aad640 1 --2- 172.21.15.77:0/1699154180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bec15d3f0 0x7f9bec0d1830 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9bec08c6e0 tx=0x7f9bdc02b930 comp rx=0 tx=0).stop 2023-11-26T07:19:46.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.478+0000 7f9bf1aad640 1 -- 172.21.15.77:0/1699154180 shutdown_connections 2023-11-26T07:19:46.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.478+0000 7f9bf1aad640 1 --2- 172.21.15.77:0/1699154180 >> v2:172.21.15.159:3300/0 conn(0x7f9bec0d0e40 0x7f9bec0d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.478+0000 7f9bf1aad640 1 --2- 172.21.15.77:0/1699154180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bec15d3f0 0x7f9bec0d1830 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.478+0000 7f9bf1aad640 1 -- 172.21.15.77:0/1699154180 >> 172.21.15.77:0/1699154180 conn(0x7f9bec09c5b0 msgr2=0x7f9bec0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:46.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.478+0000 7f9bf1aad640 1 -- 172.21.15.77:0/1699154180 shutdown_connections 2023-11-26T07:19:46.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.478+0000 7f9bf1aad640 1 -- 172.21.15.77:0/1699154180 wait complete. 2023-11-26T07:19:46.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.480+0000 7f9bf1aad640 1 Processor -- start 2023-11-26T07:19:46.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.480+0000 7f9bf1aad640 1 -- start start 2023-11-26T07:19:46.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.481+0000 7f9bf1aad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bec0d0e40 0x7f9bec15ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:46.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.481+0000 7f9bf1aad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9bec15d3f0 0x7f9bec0b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:46.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.481+0000 7f9bf1aad640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9bec15d7d0 0x7f9bec0b8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.481+0000 7f9bf1aad640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec15b7e0 con 0x7f9bec0d0e40 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.481+0000 7f9bf1aad640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0c7a20 con 0x7f9bec15d3f0 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.481+0000 7f9bf1aad640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0c7d00 con 0x7f9bec15d7d0 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.481+0000 7f9bf0aab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bec0d0e40 0x7f9bec15ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.481+0000 7f9bf0aab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bec0d0e40 0x7f9bec15ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50384/0 (socket says 172.21.15.77:50384) 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.481+0000 7f9bf0aab640 1 -- 172.21.15.77:0/796977402 learned_addr learned my addr 172.21.15.77:0/796977402 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.482+0000 7f9bebfff640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9bec15d3f0 0x7f9bec0b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.482+0000 7f9bf12ac640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9bec15d7d0 0x7f9bec0b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.482+0000 7f9bf0aab640 1 -- 172.21.15.77:0/796977402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9bec15d7d0 msgr2=0x7f9bec0b8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.482+0000 7f9bf0aab640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9bec15d7d0 0x7f9bec0b8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.482+0000 7f9bf0aab640 1 -- 172.21.15.77:0/796977402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9bec15d3f0 msgr2=0x7f9bec0b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.482+0000 7f9bf0aab640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9bec15d3f0 0x7f9bec0b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.482+0000 7f9bf0aab640 1 -- 172.21.15.77:0/796977402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc0094d0 con 0x7f9bec0d0e40 2023-11-26T07:19:46.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.482+0000 7f9bf0aab640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bec0d0e40 0x7f9bec15ac40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc000c00 tx=0x7f9bdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.483+0000 7f9be97fa640 1 -- 172.21.15.77:0/796977402 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc03acb0 con 0x7f9bec0d0e40 2023-11-26T07:19:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.483+0000 7f9be97fa640 1 -- 172.21.15.77:0/796977402 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc03ae10 con 0x7f9bec0d0e40 2023-11-26T07:19:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.483+0000 7f9bf1aad640 1 -- 172.21.15.77:0/796977402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec0c7fe0 con 0x7f9bec0d0e40 2023-11-26T07:19:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.483+0000 7f9be97fa640 1 -- 172.21.15.77:0/796977402 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc044610 con 0x7f9bec0d0e40 2023-11-26T07:19:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.483+0000 7f9bf1aad640 1 -- 172.21.15.77:0/796977402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec0c85a0 con 0x7f9bec0d0e40 2023-11-26T07:19:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.484+0000 7f9bf1aad640 1 -- 172.21.15.77:0/796977402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec067990 con 0x7f9bec0d0e40 2023-11-26T07:19:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.485+0000 7f9be97fa640 1 -- 172.21.15.77:0/796977402 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9bdc04d450 con 0x7f9bec0d0e40 2023-11-26T07:19:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.486+0000 7f9be97fa640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bd806aff0 0x7f9bd806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:46.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.486+0000 7f9be97fa640 1 -- 172.21.15.77:0/796977402 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f9bdc0ac1f0 con 0x7f9bec0d0e40 2023-11-26T07:19:46.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.487+0000 7f9bebfff640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bd806aff0 0x7f9bd806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:46.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.487+0000 7f9bebfff640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bd806aff0 0x7f9bd806d4b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9be0006fd0 tx=0x7f9be0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.491+0000 7f9be97fa640 1 -- 172.21.15.77:0/796977402 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9bdc076f60 con 0x7f9bec0d0e40 2023-11-26T07:19:46.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.700+0000 7f9bf1aad640 1 -- 172.21.15.77:0/796977402 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol1410", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bec0d0710 con 0x7f9bd806aff0 2023-11-26T07:19:46.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.759+0000 7f9be97fa640 1 -- 172.21.15.77:0/796977402 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9be000be50 con 0x7f9bd806aff0 2023-11-26T07:19:46.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.761+0000 7f9bf1aad640 1 -- 172.21.15.77:0/796977402 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bd806aff0 msgr2=0x7f9bd806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:46.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.761+0000 7f9bf1aad640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bd806aff0 0x7f9bd806d4b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9be0006fd0 tx=0x7f9be0008040 comp rx=0 tx=0).stop 2023-11-26T07:19:46.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.761+0000 7f9bf1aad640 1 -- 172.21.15.77:0/796977402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bec0d0e40 msgr2=0x7f9bec15ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:46.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.761+0000 7f9bf1aad640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bec0d0e40 0x7f9bec15ac40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc000c00 tx=0x7f9bdc0046c0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.761+0000 7f9bf1aad640 1 -- 172.21.15.77:0/796977402 shutdown_connections 2023-11-26T07:19:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.761+0000 7f9bf1aad640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bd806aff0 0x7f9bd806d4b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.762+0000 7f9bf1aad640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9bec15d7d0 0x7f9bec0b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.762+0000 7f9bf1aad640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9bec15d3f0 0x7f9bec0b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.762+0000 7f9bf1aad640 1 --2- 172.21.15.77:0/796977402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bec0d0e40 0x7f9bec15ac40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.762+0000 7f9bf1aad640 1 -- 172.21.15.77:0/796977402 >> 172.21.15.77:0/796977402 conn(0x7f9bec09c5b0 msgr2=0x7f9bec06b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.762+0000 7f9bf1aad640 1 -- 172.21.15.77:0/796977402 shutdown_connections 2023-11-26T07:19:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:46.762+0000 7f9bf1aad640 1 -- 172.21.15.77:0/796977402 wait complete. 2023-11-26T07:19:46.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:46.781 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:19:46.877 INFO:teuthology.orchestra.run.smithi077.stdout:3 2023-11-26T07:19:51.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:51.879 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:19:51.944 INFO:teuthology.orchestra.run.smithi077.stdout:2 2023-11-26T07:19:51.945 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:19:51.945 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:19:52.063 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:19:52.185 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:19:52.185 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:52.185 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:52.246 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:52.246 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:52.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:19:52.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.514+0000 7fb6ab9a9640 1 Processor -- start 2023-11-26T07:19:52.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.515+0000 7fb6ab9a9640 1 -- start start 2023-11-26T07:19:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.516+0000 7fb6ab9a9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb6a40cf450 0x7fb6a40cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.516+0000 7fb6ab9a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb6a40cdfb0 0x7fb6a40ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.516+0000 7fb6ab9a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a40cece0 con 0x7fb6a415c7f0 2023-11-26T07:19:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.516+0000 7fb6ab9a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a40cfe40 con 0x7fb6a40cdfb0 2023-11-26T07:19:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.516+0000 7fb6ab9a9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a4156010 con 0x7fb6a40cf450 2023-11-26T07:19:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.516+0000 7fb6a9745640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb6a415c7f0 0x7fb6a406db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36336/0 (socket says 172.21.15.77:36336) 2023-11-26T07:19:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.516+0000 7fb6a9745640 1 -- 172.21.15.77:0/1930028383 learned_addr learned my addr 172.21.15.77:0/1930028383 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.516+0000 7fb6a9f46640 1 --2- 172.21.15.77:0/1930028383 >> v2:172.21.15.77:3300/0 conn(0x7fb6a40cdfb0 0x7fb6a40ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.517+0000 7fb6a8f44640 1 --2- 172.21.15.77:0/1930028383 >> v2:172.21.15.159:3300/0 conn(0x7fb6a40cf450 0x7fb6a40cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.517+0000 7fb6a3fff640 1 -- 172.21.15.77:0/1930028383 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500326623 0 0) 0x7fb6a40cece0 con 0x7fb6a415c7f0 2023-11-26T07:19:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.517+0000 7fb6a9f46640 1 -- 172.21.15.77:0/1930028383 >> v2:172.21.15.159:3300/0 conn(0x7fb6a40cf450 msgr2=0x7fb6a40cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.517+0000 7fb6a9f46640 1 --2- 172.21.15.77:0/1930028383 >> v2:172.21.15.159:3300/0 conn(0x7fb6a40cf450 0x7fb6a40cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.517+0000 7fb6a9f46640 1 -- 172.21.15.77:0/1930028383 >> v1:172.21.15.77:6789/0 conn(0x7fb6a415c7f0 legacy=0x7fb6a406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.517+0000 7fb6a9f46640 1 -- 172.21.15.77:0/1930028383 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a406d040 con 0x7fb6a40cdfb0 2023-11-26T07:19:52.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.518+0000 7fb6a9f46640 1 --2- 172.21.15.77:0/1930028383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6a40cdfb0 0x7fb6a40ce3e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4070410 tx=0x7fb69c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2501e1faa92f2b2b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:52.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.518+0000 7fb6a3fff640 1 -- 172.21.15.77:0/1930028383 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c031830 con 0x7fb6a40cdfb0 2023-11-26T07:19:52.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.518+0000 7fb6a3fff640 1 -- 172.21.15.77:0/1930028383 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c031990 con 0x7fb6a40cdfb0 2023-11-26T07:19:52.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.518+0000 7fb6a3fff640 1 -- 172.21.15.77:0/1930028383 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c031d20 con 0x7fb6a40cdfb0 2023-11-26T07:19:52.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.519+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/1930028383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6a40cdfb0 msgr2=0x7fb6a40ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.519+0000 7fb6ab9a9640 1 --2- 172.21.15.77:0/1930028383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6a40cdfb0 0x7fb6a40ce3e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4070410 tx=0x7fb69c02b8d0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.519+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/1930028383 shutdown_connections 2023-11-26T07:19:52.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.519+0000 7fb6ab9a9640 1 --2- 172.21.15.77:0/1930028383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6a40cdfb0 0x7fb6a40ce3e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.519+0000 7fb6ab9a9640 1 --2- 172.21.15.77:0/1930028383 >> v2:172.21.15.159:3300/0 conn(0x7fb6a40cf450 0x7fb6a40cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.519+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/1930028383 >> 172.21.15.77:0/1930028383 conn(0x7fb6a406a920 msgr2=0x7fb6a406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:52.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.519+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/1930028383 shutdown_connections 2023-11-26T07:19:52.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.519+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/1930028383 wait complete. 2023-11-26T07:19:52.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.521+0000 7fb6ab9a9640 1 Processor -- start 2023-11-26T07:19:52.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.521+0000 7fb6ab9a9640 1 -- start start 2023-11-26T07:19:52.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.522+0000 7fb6ab9a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6a40cdfb0 0x7fb6a40af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.522+0000 7fb6ab9a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6a40cf450 0x7fb6a4149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.522+0000 7fb6ab9a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6a415c7f0 0x7fb6a4152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.522+0000 7fb6ab9a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a4159070 con 0x7fb6a415c7f0 2023-11-26T07:19:52.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.522+0000 7fb6ab9a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a41f0d80 con 0x7fb6a40cf450 2023-11-26T07:19:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.522+0000 7fb6ab9a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a4158460 con 0x7fb6a40cdfb0 2023-11-26T07:19:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.522+0000 7fb6a9f46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6a415c7f0 0x7fb6a4152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.522+0000 7fb6a9f46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6a415c7f0 0x7fb6a4152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50396/0 (socket says 172.21.15.77:50396) 2023-11-26T07:19:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.522+0000 7fb6a9f46640 1 -- 172.21.15.77:0/3540431871 learned_addr learned my addr 172.21.15.77:0/3540431871 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.523+0000 7fb6a9f46640 1 -- 172.21.15.77:0/3540431871 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6a40cdfb0 msgr2=0x7fb6a40af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.523+0000 7fb6a9f46640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6a40cdfb0 0x7fb6a40af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.523+0000 7fb6a9f46640 1 -- 172.21.15.77:0/3540431871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6a40cf450 msgr2=0x7fb6a4149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.523+0000 7fb6a9f46640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6a40cf450 0x7fb6a4149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.523+0000 7fb6a9f46640 1 -- 172.21.15.77:0/3540431871 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c009400 con 0x7fb6a415c7f0 2023-11-26T07:19:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.523+0000 7fb6a9f46640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6a415c7f0 0x7fb6a4152970 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb69c02bee0 tx=0x7fb69c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.523+0000 7fb6a1ffb640 1 -- 172.21.15.77:0/3540431871 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0317b0 con 0x7fb6a415c7f0 2023-11-26T07:19:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.523+0000 7fb6a1ffb640 1 -- 172.21.15.77:0/3540431871 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c03b9f0 con 0x7fb6a415c7f0 2023-11-26T07:19:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.523+0000 7fb6a1ffb640 1 -- 172.21.15.77:0/3540431871 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c03bda0 con 0x7fb6a415c7f0 2023-11-26T07:19:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.524+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/3540431871 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a4158740 con 0x7fb6a415c7f0 2023-11-26T07:19:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.524+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/3540431871 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a4158d00 con 0x7fb6a415c7f0 2023-11-26T07:19:52.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.525+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/3540431871 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a4067470 con 0x7fb6a415c7f0 2023-11-26T07:19:52.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.526+0000 7fb6a1ffb640 1 -- 172.21.15.77:0/3540431871 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fb69c0453f0 con 0x7fb6a415c7f0 2023-11-26T07:19:52.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.527+0000 7fb6a1ffb640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb68806b110 0x7fb68806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.527+0000 7fb6a1ffb640 1 -- 172.21.15.77:0/3540431871 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fb69c0abf30 con 0x7fb6a415c7f0 2023-11-26T07:19:52.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.527+0000 7fb6a9745640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb68806b110 0x7fb68806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.528+0000 7fb6a9745640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb68806b110 0x7fb68806d5d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb698007fd0 tx=0x7fb698007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:52.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.532+0000 7fb6a1ffb640 1 -- 172.21.15.77:0/3540431871 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb69c076c40 con 0x7fb6a415c7f0 2023-11-26T07:19:52.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.721+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/3540431871 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6a40cd730 con 0x7fb6a415c7f0 2023-11-26T07:19:52.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.723+0000 7fb6a1ffb640 1 -- 172.21.15.77:0/3540431871 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16610 (secure 0 0 0) 0x7fb69c035090 con 0x7fb6a415c7f0 2023-11-26T07:19:52.725 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:19:52.725 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":36,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:19:50.657201+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:42.084786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:42.792071+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:19:52.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.726+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/3540431871 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb68806b110 msgr2=0x7fb68806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.726+0000 7fb6ab9a9640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb68806b110 0x7fb68806d5d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb698007fd0 tx=0x7fb698007ce0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.727+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/3540431871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6a415c7f0 msgr2=0x7fb6a4152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.727+0000 7fb6ab9a9640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6a415c7f0 0x7fb6a4152970 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb69c02bee0 tx=0x7fb69c0046c0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.727+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/3540431871 shutdown_connections 2023-11-26T07:19:52.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.727+0000 7fb6ab9a9640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb68806b110 0x7fb68806d5d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.727+0000 7fb6ab9a9640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6a415c7f0 0x7fb6a4152970 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.727+0000 7fb6ab9a9640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6a40cf450 0x7fb6a4149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.727+0000 7fb6ab9a9640 1 --2- 172.21.15.77:0/3540431871 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6a40cdfb0 0x7fb6a40af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.727+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/3540431871 >> 172.21.15.77:0/3540431871 conn(0x7fb6a406a920 msgr2=0x7fb6a406c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:52.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.727+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/3540431871 shutdown_connections 2023-11-26T07:19:52.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.727+0000 7fb6ab9a9640 1 -- 172.21.15.77:0/3540431871 wait complete. 2023-11-26T07:19:52.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:42.084786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:42.792071+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:19:52.748 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:19:52.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.964+0000 7fef92831640 1 Processor -- start 2023-11-26T07:19:52.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.964+0000 7fef92831640 1 -- start start 2023-11-26T07:19:52.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.965+0000 7fef92831640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fef8c072160 0x7fef8c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.965+0000 7fef92831640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fef8c06de10 0x7fef8c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.965+0000 7fef92831640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c15ec90 con 0x7fef8c0c49f0 2023-11-26T07:19:52.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.965+0000 7fef92831640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c0cd530 con 0x7fef8c072160 2023-11-26T07:19:52.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.965+0000 7fef92831640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c0c4ed0 con 0x7fef8c06de10 2023-11-26T07:19:52.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.966+0000 7fef8bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fef8c072160 0x7fef8c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.966+0000 7fef8bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fef8c072160 0x7fef8c15e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50410/0 (socket says 172.21.15.77:50410) 2023-11-26T07:19:52.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.966+0000 7fef8bfff640 1 -- 172.21.15.77:0/636587140 learned_addr learned my addr 172.21.15.77:0/636587140 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:52.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.966+0000 7fef8bfff640 1 -- 172.21.15.77:0/636587140 >> v2:172.21.15.159:3300/0 conn(0x7fef8c06de10 msgr2=0x7fef8c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:52.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.966+0000 7fef8bfff640 1 --2- 172.21.15.77:0/636587140 >> v2:172.21.15.159:3300/0 conn(0x7fef8c06de10 0x7fef8c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.966+0000 7fef8bfff640 1 -- 172.21.15.77:0/636587140 >> v1:172.21.15.77:6789/0 conn(0x7fef8c0c49f0 legacy=0x7fef8c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:52.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.966+0000 7fef8bfff640 1 -- 172.21.15.77:0/636587140 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c0c51b0 con 0x7fef8c072160 2023-11-26T07:19:52.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.967+0000 7fef8bfff640 1 --2- 172.21.15.77:0/636587140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8c072160 0x7fef8c15e750 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fef8c06eab0 tx=0x7fef7c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2f60ea844dc7b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:52.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.968+0000 7fef8affd640 1 -- 172.21.15.77:0/636587140 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c02cb10 con 0x7fef8c072160 2023-11-26T07:19:52.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.968+0000 7fef8affd640 1 -- 172.21.15.77:0/636587140 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c02cc70 con 0x7fef8c072160 2023-11-26T07:19:52.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.968+0000 7fef8affd640 1 -- 172.21.15.77:0/636587140 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0343f0 con 0x7fef8c072160 2023-11-26T07:19:52.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.968+0000 7fef92831640 1 -- 172.21.15.77:0/636587140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8c072160 msgr2=0x7fef8c15e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.968+0000 7fef92831640 1 --2- 172.21.15.77:0/636587140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8c072160 0x7fef8c15e750 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fef8c06eab0 tx=0x7fef7c02bf70 comp rx=0 tx=0).stop 2023-11-26T07:19:52.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.968+0000 7fef92831640 1 -- 172.21.15.77:0/636587140 shutdown_connections 2023-11-26T07:19:52.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.968+0000 7fef92831640 1 --2- 172.21.15.77:0/636587140 >> v2:172.21.15.159:3300/0 conn(0x7fef8c06de10 0x7fef8c0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.968+0000 7fef92831640 1 --2- 172.21.15.77:0/636587140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8c072160 0x7fef8c15e750 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.968+0000 7fef92831640 1 -- 172.21.15.77:0/636587140 >> 172.21.15.77:0/636587140 conn(0x7fef8c0b0c50 msgr2=0x7fef8c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:52.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.969+0000 7fef92831640 1 -- 172.21.15.77:0/636587140 shutdown_connections 2023-11-26T07:19:52.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.969+0000 7fef92831640 1 -- 172.21.15.77:0/636587140 wait complete. 2023-11-26T07:19:52.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.970+0000 7fef92831640 1 Processor -- start 2023-11-26T07:19:52.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.970+0000 7fef92831640 1 -- start start 2023-11-26T07:19:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.971+0000 7fef92831640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef8c06de10 0x7fef8c15c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.971+0000 7fef92831640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8c072160 0x7fef8c0c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.971+0000 7fef92831640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef8c0c49f0 0x7fef8c0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.971+0000 7fef92831640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0c8140 con 0x7fef8c072160 2023-11-26T07:19:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.971+0000 7fef92831640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c099e70 con 0x7fef8c06de10 2023-11-26T07:19:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.971+0000 7fef92831640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0c75c0 con 0x7fef8c0c49f0 2023-11-26T07:19:52.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.972+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8c072160 0x7fef8c0c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.972+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8c072160 0x7fef8c0c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50412/0 (socket says 172.21.15.77:50412) 2023-11-26T07:19:52.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.972+0000 7fef8b7fe640 1 -- 172.21.15.77:0/1628004699 learned_addr learned my addr 172.21.15.77:0/1628004699 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.972+0000 7fef8b7fe640 1 -- 172.21.15.77:0/1628004699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef8c0c49f0 msgr2=0x7fef8c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.972+0000 7fef8b7fe640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef8c0c49f0 0x7fef8c0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.972+0000 7fef8b7fe640 1 -- 172.21.15.77:0/1628004699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef8c06de10 msgr2=0x7fef8c15c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.972+0000 7fef8b7fe640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef8c06de10 0x7fef8c15c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.972+0000 7fef8b7fe640 1 -- 172.21.15.77:0/1628004699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c009b30 con 0x7fef8c072160 2023-11-26T07:19:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.972+0000 7fef8b7fe640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8c072160 0x7fef8c0c6ae0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c400 tx=0x7fef7400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.973+0000 7fef88ff9640 1 -- 172.21.15.77:0/1628004699 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef740052d0 con 0x7fef8c072160 2023-11-26T07:19:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.973+0000 7fef88ff9640 1 -- 172.21.15.77:0/1628004699 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef74005430 con 0x7fef8c072160 2023-11-26T07:19:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.973+0000 7fef88ff9640 1 -- 172.21.15.77:0/1628004699 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74003830 con 0x7fef8c072160 2023-11-26T07:19:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.973+0000 7fef92831640 1 -- 172.21.15.77:0/1628004699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8c0c7900 con 0x7fef8c072160 2023-11-26T07:19:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.973+0000 7fef92831640 1 -- 172.21.15.77:0/1628004699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8c0cb500 con 0x7fef8c072160 2023-11-26T07:19:52.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.974+0000 7fef92831640 1 -- 172.21.15.77:0/1628004699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8c04e8b0 con 0x7fef8c072160 2023-11-26T07:19:52.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.975+0000 7fef88ff9640 1 -- 172.21.15.77:0/1628004699 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fef74003990 con 0x7fef8c072160 2023-11-26T07:19:52.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.976+0000 7fef88ff9640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6c06b110 0x7fef6c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.976+0000 7fef88ff9640 1 -- 172.21.15.77:0/1628004699 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fef74088f80 con 0x7fef8c072160 2023-11-26T07:19:52.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.976+0000 7fef8bfff640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6c06b110 0x7fef6c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.977+0000 7fef8bfff640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6c06b110 0x7fef6c06d5d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef7c035000 tx=0x7fef7c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:52.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:52.980+0000 7fef88ff9640 1 -- 172.21.15.77:0/1628004699 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef74053ba0 con 0x7fef8c072160 2023-11-26T07:19:53.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.169+0000 7fef92831640 1 -- 172.21.15.77:0/1628004699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef8c15ec90 con 0x7fef8c072160 2023-11-26T07:19:53.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.170+0000 7fef88ff9640 1 -- 172.21.15.77:0/1628004699 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef8c15ec90 con 0x7fef8c072160 2023-11-26T07:19:53.172 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:19:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 -- 172.21.15.77:0/1628004699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6c06b110 msgr2=0x7fef6c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6c06b110 0x7fef6c06d5d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef7c035000 tx=0x7fef7c02e000 comp rx=0 tx=0).stop 2023-11-26T07:19:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 -- 172.21.15.77:0/1628004699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8c072160 msgr2=0x7fef8c0c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8c072160 0x7fef8c0c6ae0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c400 tx=0x7fef7400c8c0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 -- 172.21.15.77:0/1628004699 shutdown_connections 2023-11-26T07:19:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6c06b110 0x7fef6c06d5d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef8c0c49f0 0x7fef8c0ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8c072160 0x7fef8c0c6ae0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 --2- 172.21.15.77:0/1628004699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef8c06de10 0x7fef8c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 -- 172.21.15.77:0/1628004699 >> 172.21.15.77:0/1628004699 conn(0x7fef8c0b0c50 msgr2=0x7fef8c06c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:53.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 -- 172.21.15.77:0/1628004699 shutdown_connections 2023-11-26T07:19:53.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.173+0000 7fef92831640 1 -- 172.21.15.77:0/1628004699 wait complete. 2023-11-26T07:19:53.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:19:53.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.410+0000 7f48a0e25640 1 Processor -- start 2023-11-26T07:19:53.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.411+0000 7f48a0e25640 1 -- start start 2023-11-26T07:19:53.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.412+0000 7f48a0e25640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f489c15d3f0 0x7f489c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.412+0000 7f48a0e25640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f489c15d7d0 0x7f489c0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.412+0000 7f48a0e25640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c0d15e0 con 0x7f489c0d0e40 2023-11-26T07:19:53.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.412+0000 7f48a0e25640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c0d0280 con 0x7f489c15d7d0 2023-11-26T07:19:53.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.412+0000 7f48a0e25640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c0d1300 con 0x7f489c15d3f0 2023-11-26T07:19:53.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.412+0000 7f489affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f489c15d7d0 0x7f489c0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.412+0000 7f489affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f489c15d7d0 0x7f489c0d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50422/0 (socket says 172.21.15.77:50422) 2023-11-26T07:19:53.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.412+0000 7f489affd640 1 -- 172.21.15.77:0/1738125697 learned_addr learned my addr 172.21.15.77:0/1738125697 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:53.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.412+0000 7f489bfff640 1 --1- 172.21.15.77:0/1738125697 >> v1:172.21.15.77:6789/0 conn(0x7f489c0d0e40 0x7f489c0afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36350/0 (socket says 172.21.15.77:36350) 2023-11-26T07:19:53.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.413+0000 7f489b7fe640 1 --2- 172.21.15.77:0/1738125697 >> v2:172.21.15.159:3300/0 conn(0x7f489c15d3f0 0x7f489c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.413+0000 7f489affd640 1 -- 172.21.15.77:0/1738125697 >> v2:172.21.15.159:3300/0 conn(0x7f489c15d3f0 msgr2=0x7f489c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:53.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.413+0000 7f489affd640 1 --2- 172.21.15.77:0/1738125697 >> v2:172.21.15.159:3300/0 conn(0x7f489c15d3f0 0x7f489c0d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.413+0000 7f489affd640 1 -- 172.21.15.77:0/1738125697 >> v1:172.21.15.77:6789/0 conn(0x7f489c0d0e40 legacy=0x7f489c0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.413+0000 7f489affd640 1 -- 172.21.15.77:0/1738125697 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c0cfc30 con 0x7f489c15d7d0 2023-11-26T07:19:53.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.414+0000 7f489affd640 1 --2- 172.21.15.77:0/1738125697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c15d7d0 0x7f489c0d1d70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f489c067c60 tx=0x7f488402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bfc4acf7150f92 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:53.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.414+0000 7f489a7fc640 1 -- 172.21.15.77:0/1738125697 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884030860 con 0x7f489c15d7d0 2023-11-26T07:19:53.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.415+0000 7f489a7fc640 1 -- 172.21.15.77:0/1738125697 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48840309c0 con 0x7f489c15d7d0 2023-11-26T07:19:53.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.415+0000 7f489a7fc640 1 -- 172.21.15.77:0/1738125697 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884030d50 con 0x7f489c15d7d0 2023-11-26T07:19:53.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.415+0000 7f48a0e25640 1 -- 172.21.15.77:0/1738125697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c15d7d0 msgr2=0x7f489c0d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.415+0000 7f48a0e25640 1 --2- 172.21.15.77:0/1738125697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c15d7d0 0x7f489c0d1d70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f489c067c60 tx=0x7f488402b9a0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.415+0000 7f48a0e25640 1 -- 172.21.15.77:0/1738125697 shutdown_connections 2023-11-26T07:19:53.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.415+0000 7f48a0e25640 1 --2- 172.21.15.77:0/1738125697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c15d7d0 0x7f489c0d1d70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.415+0000 7f48a0e25640 1 --2- 172.21.15.77:0/1738125697 >> v2:172.21.15.159:3300/0 conn(0x7f489c15d3f0 0x7f489c0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.415+0000 7f48a0e25640 1 -- 172.21.15.77:0/1738125697 >> 172.21.15.77:0/1738125697 conn(0x7f489c09c5b0 msgr2=0x7f489c0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:53.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.415+0000 7f48a0e25640 1 -- 172.21.15.77:0/1738125697 shutdown_connections 2023-11-26T07:19:53.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.415+0000 7f48a0e25640 1 -- 172.21.15.77:0/1738125697 wait complete. 2023-11-26T07:19:53.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.417+0000 7f48a0e25640 1 Processor -- start 2023-11-26T07:19:53.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.417+0000 7f48a0e25640 1 -- start start 2023-11-26T07:19:53.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.418+0000 7f48a0e25640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f489c0d0e40 0x7f489c0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.418+0000 7f48a0e25640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f489c15d3f0 0x7f489c0b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.418+0000 7f48a0e25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c15d7d0 0x7f489c0b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.418+0000 7f48a0e25640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0ca3e0 con 0x7f489c15d7d0 2023-11-26T07:19:53.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.418+0000 7f48a0e25640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0ca6c0 con 0x7f489c0d0e40 2023-11-26T07:19:53.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.418+0000 7f48a0e25640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0ca9a0 con 0x7f489c15d3f0 2023-11-26T07:19:53.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.418+0000 7f489bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c15d7d0 0x7f489c0b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.419+0000 7f489bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c15d7d0 0x7f489c0b8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50434/0 (socket says 172.21.15.77:50434) 2023-11-26T07:19:53.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.419+0000 7f489bfff640 1 -- 172.21.15.77:0/65145501 learned_addr learned my addr 172.21.15.77:0/65145501 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:53.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.419+0000 7f489b7fe640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f489c0d0e40 0x7f489c0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.419+0000 7f489bfff640 1 -- 172.21.15.77:0/65145501 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f489c15d3f0 msgr2=0x7f489c0b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.419+0000 7f489bfff640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f489c15d3f0 0x7f489c0b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.419+0000 7f489bfff640 1 -- 172.21.15.77:0/65145501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f489c0d0e40 msgr2=0x7f489c0b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.419+0000 7f489bfff640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f489c0d0e40 0x7f489c0b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.419+0000 7f489bfff640 1 -- 172.21.15.77:0/65145501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48840094d0 con 0x7f489c15d7d0 2023-11-26T07:19:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.419+0000 7f489bfff640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c15d7d0 0x7f489c0b8350 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f489400c400 tx=0x7f489400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.420+0000 7f4893fff640 1 -- 172.21.15.77:0/65145501 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48940074e0 con 0x7f489c15d7d0 2023-11-26T07:19:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.420+0000 7f4893fff640 1 -- 172.21.15.77:0/65145501 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894007640 con 0x7f489c15d7d0 2023-11-26T07:19:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.420+0000 7f4893fff640 1 -- 172.21.15.77:0/65145501 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48940049e0 con 0x7f489c15d7d0 2023-11-26T07:19:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.420+0000 7f48a0e25640 1 -- 172.21.15.77:0/65145501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c0cac80 con 0x7f489c15d7d0 2023-11-26T07:19:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.420+0000 7f48a0e25640 1 -- 172.21.15.77:0/65145501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c0b6640 con 0x7f489c15d7d0 2023-11-26T07:19:53.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.421+0000 7f48a0e25640 1 -- 172.21.15.77:0/65145501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c0cb1a0 con 0x7f489c15d7d0 2023-11-26T07:19:53.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.422+0000 7f4893fff640 1 -- 172.21.15.77:0/65145501 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f4894004b40 con 0x7f489c15d7d0 2023-11-26T07:19:53.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.423+0000 7f4893fff640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f487c06b140 0x7f487c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.423+0000 7f4893fff640 1 -- 172.21.15.77:0/65145501 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f4894089560 con 0x7f489c15d7d0 2023-11-26T07:19:53.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.423+0000 7f489b7fe640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f487c06b140 0x7f487c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.424+0000 7f489b7fe640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f487c06b140 0x7f487c06d600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f488c009f30 tx=0x7f488c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:53.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.427+0000 7f4893fff640 1 -- 172.21.15.77:0/65145501 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f489c0cb1a0 con 0x7f489c15d7d0 2023-11-26T07:19:53.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.615+0000 7f48a0e25640 1 -- 172.21.15.77:0/65145501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f489c0cb1a0 con 0x7f489c15d7d0 2023-11-26T07:19:53.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.616+0000 7f4893fff640 1 -- 172.21.15.77:0/65145501 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f489c0cb1a0 con 0x7f489c15d7d0 2023-11-26T07:19:53.617 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:19:53.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.618+0000 7f48a0e25640 1 -- 172.21.15.77:0/65145501 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f487c06b140 msgr2=0x7f487c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.618+0000 7f48a0e25640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f487c06b140 0x7f487c06d600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f488c009f30 tx=0x7f488c00b040 comp rx=0 tx=0).stop 2023-11-26T07:19:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.619+0000 7f48a0e25640 1 -- 172.21.15.77:0/65145501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c15d7d0 msgr2=0x7f489c0b8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.619+0000 7f48a0e25640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c15d7d0 0x7f489c0b8350 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f489400c400 tx=0x7f489400c8c0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.619+0000 7f48a0e25640 1 -- 172.21.15.77:0/65145501 shutdown_connections 2023-11-26T07:19:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.619+0000 7f48a0e25640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f487c06b140 0x7f487c06d600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.619+0000 7f48a0e25640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c15d7d0 0x7f489c0b8350 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.619+0000 7f48a0e25640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f489c15d3f0 0x7f489c0b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.619+0000 7f48a0e25640 1 --2- 172.21.15.77:0/65145501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f489c0d0e40 0x7f489c0b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.619+0000 7f48a0e25640 1 -- 172.21.15.77:0/65145501 >> 172.21.15.77:0/65145501 conn(0x7f489c09c5b0 msgr2=0x7f489c0afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.619+0000 7f48a0e25640 1 -- 172.21.15.77:0/65145501 shutdown_connections 2023-11-26T07:19:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.619+0000 7f48a0e25640 1 -- 172.21.15.77:0/65145501 wait complete. 2023-11-26T07:19:53.639 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:19:53.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.854+0000 7fd0c7789640 1 Processor -- start 2023-11-26T07:19:53.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.854+0000 7fd0c7789640 1 -- start start 2023-11-26T07:19:53.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.856+0000 7fd0c7789640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0c015b440 0x7fd0c00cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.856+0000 7fd0c7789640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c00c5dc0 con 0x7fd0c00cbf20 2023-11-26T07:19:53.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.856+0000 7fd0c7789640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c015eea0 con 0x7fd0c00c59b0 2023-11-26T07:19:53.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.856+0000 7fd0c7789640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c00cc3d0 con 0x7fd0c015b440 2023-11-26T07:19:53.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.856+0000 7fd0c5525640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0c015b440 0x7fd0c00cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.856+0000 7fd0c4d24640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd0c00cbf20 0x7fd0c00c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36352/0 (socket says 172.21.15.77:36352) 2023-11-26T07:19:53.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.856+0000 7fd0c5525640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0c015b440 0x7fd0c00cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50442/0 (socket says 172.21.15.77:50442) 2023-11-26T07:19:53.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.856+0000 7fd0c4d24640 1 -- 172.21.15.77:0/2613910281 learned_addr learned my addr 172.21.15.77:0/2613910281 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:53.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.857+0000 7fd0c5525640 1 -- 172.21.15.77:0/2613910281 >> v1:172.21.15.159:6789/0 conn(0x7fd0c00c59b0 legacy=0x7fd0c006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:53.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.857+0000 7fd0c5525640 1 -- 172.21.15.77:0/2613910281 >> v1:172.21.15.77:6789/0 conn(0x7fd0c00cbf20 legacy=0x7fd0c00c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.857+0000 7fd0c5525640 1 -- 172.21.15.77:0/2613910281 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c00abf30 con 0x7fd0c015b440 2023-11-26T07:19:53.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.858+0000 7fd0c5525640 1 --2- 172.21.15.77:0/2613910281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0c015b440 0x7fd0c00cb9e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009d90 tx=0x7fd0b402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b65066f9d819751 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:53.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.858+0000 7fd0bffff640 1 -- 172.21.15.77:0/2613910281 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b402cbd0 con 0x7fd0c015b440 2023-11-26T07:19:53.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.858+0000 7fd0bffff640 1 -- 172.21.15.77:0/2613910281 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b402cd30 con 0x7fd0c015b440 2023-11-26T07:19:53.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.858+0000 7fd0bffff640 1 -- 172.21.15.77:0/2613910281 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b402cea0 con 0x7fd0c015b440 2023-11-26T07:19:53.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.859+0000 7fd0c7789640 1 -- 172.21.15.77:0/2613910281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0c015b440 msgr2=0x7fd0c00cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.859+0000 7fd0c7789640 1 --2- 172.21.15.77:0/2613910281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0c015b440 0x7fd0c00cb9e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009d90 tx=0x7fd0b402be20 comp rx=0 tx=0).stop 2023-11-26T07:19:53.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.859+0000 7fd0c7789640 1 -- 172.21.15.77:0/2613910281 shutdown_connections 2023-11-26T07:19:53.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.859+0000 7fd0c7789640 1 --2- 172.21.15.77:0/2613910281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0c015b440 0x7fd0c00cb9e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.859+0000 7fd0c7789640 1 -- 172.21.15.77:0/2613910281 >> 172.21.15.77:0/2613910281 conn(0x7fd0c00b0c50 msgr2=0x7fd0c00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:53.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.859+0000 7fd0c7789640 1 -- 172.21.15.77:0/2613910281 shutdown_connections 2023-11-26T07:19:53.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.859+0000 7fd0c7789640 1 -- 172.21.15.77:0/2613910281 wait complete. 2023-11-26T07:19:53.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.861+0000 7fd0c7789640 1 Processor -- start 2023-11-26T07:19:53.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.861+0000 7fd0c7789640 1 -- start start 2023-11-26T07:19:53.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.862+0000 7fd0c7789640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0c00c59b0 0x7fd0c0156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.862+0000 7fd0c7789640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0c00cbf20 0x7fd0c01e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.862+0000 7fd0c7789640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c015b440 0x7fd0c00b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.862+0000 7fd0c7789640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c01e6420 con 0x7fd0c00cbf20 2023-11-26T07:19:53.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.862+0000 7fd0c7789640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c01e6700 con 0x7fd0c00c59b0 2023-11-26T07:19:53.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.862+0000 7fd0c7789640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c01e69e0 con 0x7fd0c015b440 2023-11-26T07:19:53.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.862+0000 7fd0c4d24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0c00cbf20 0x7fd0c01e5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.862+0000 7fd0c4d24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0c00cbf20 0x7fd0c01e5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50448/0 (socket says 172.21.15.77:50448) 2023-11-26T07:19:53.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.862+0000 7fd0c4d24640 1 -- 172.21.15.77:0/3238108177 learned_addr learned my addr 172.21.15.77:0/3238108177 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:53.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.863+0000 7fd0c4d24640 1 -- 172.21.15.77:0/3238108177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c015b440 msgr2=0x7fd0c00b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.863+0000 7fd0c4d24640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c015b440 0x7fd0c00b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.863+0000 7fd0c4d24640 1 -- 172.21.15.77:0/3238108177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0c00c59b0 msgr2=0x7fd0c0156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.863+0000 7fd0c4d24640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0c00c59b0 0x7fd0c0156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.863+0000 7fd0c4d24640 1 -- 172.21.15.77:0/3238108177 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b4009a70 con 0x7fd0c00cbf20 2023-11-26T07:19:53.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.863+0000 7fd0c4d24640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0c00cbf20 0x7fd0c01e5a20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c4a0 tx=0x7fd0ac00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:53.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.863+0000 7fd0bdffb640 1 -- 172.21.15.77:0/3238108177 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac005ce0 con 0x7fd0c00cbf20 2023-11-26T07:19:53.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.863+0000 7fd0bdffb640 1 -- 172.21.15.77:0/3238108177 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac005e40 con 0x7fd0c00cbf20 2023-11-26T07:19:53.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.863+0000 7fd0bdffb640 1 -- 172.21.15.77:0/3238108177 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac007270 con 0x7fd0c00cbf20 2023-11-26T07:19:53.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.863+0000 7fd0c7789640 1 -- 172.21.15.77:0/3238108177 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c01e6cc0 con 0x7fd0c00cbf20 2023-11-26T07:19:53.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.864+0000 7fd0c7789640 1 -- 172.21.15.77:0/3238108177 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c01e5f60 con 0x7fd0c00cbf20 2023-11-26T07:19:53.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.865+0000 7fd0c7789640 1 -- 172.21.15.77:0/3238108177 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c00c60b0 con 0x7fd0c00cbf20 2023-11-26T07:19:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.866+0000 7fd0bdffb640 1 -- 172.21.15.77:0/3238108177 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fd0ac007490 con 0x7fd0c00cbf20 2023-11-26T07:19:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.866+0000 7fd0bdffb640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0a406b110 0x7fd0a406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.867+0000 7fd0bdffb640 1 -- 172.21.15.77:0/3238108177 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fd0ac088fe0 con 0x7fd0c00cbf20 2023-11-26T07:19:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.867+0000 7fd0c5525640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0a406b110 0x7fd0a406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.867+0000 7fd0c5525640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0a406b110 0x7fd0a406d5d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4036000 tx=0x7fd0b402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:53.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:53.871+0000 7fd0bdffb640 1 -- 172.21.15.77:0/3238108177 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0ac053cb0 con 0x7fd0c00cbf20 2023-11-26T07:19:54.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.062+0000 7fd0c7789640 1 -- 172.21.15.77:0/3238108177 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0c004e8b0 con 0x7fd0c00cbf20 2023-11-26T07:19:54.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.063+0000 7fd0bdffb640 1 -- 172.21.15.77:0/3238108177 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0ac017020 con 0x7fd0c00cbf20 2023-11-26T07:19:54.065 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:19:54.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 -- 172.21.15.77:0/3238108177 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0a406b110 msgr2=0x7fd0a406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:54.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0a406b110 0x7fd0a406d5d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4036000 tx=0x7fd0b402e000 comp rx=0 tx=0).stop 2023-11-26T07:19:54.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 -- 172.21.15.77:0/3238108177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0c00cbf20 msgr2=0x7fd0c01e5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:54.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0c00cbf20 0x7fd0c01e5a20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c4a0 tx=0x7fd0ac00c960 comp rx=0 tx=0).stop 2023-11-26T07:19:54.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 -- 172.21.15.77:0/3238108177 shutdown_connections 2023-11-26T07:19:54.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0a406b110 0x7fd0a406d5d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c015b440 0x7fd0c00b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0c00cbf20 0x7fd0c01e5a20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 --2- 172.21.15.77:0/3238108177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0c00c59b0 0x7fd0c0156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 -- 172.21.15.77:0/3238108177 >> 172.21.15.77:0/3238108177 conn(0x7fd0c00b0c50 msgr2=0x7fd0c00cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:54.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 -- 172.21.15.77:0/3238108177 shutdown_connections 2023-11-26T07:19:54.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.066+0000 7fd0c7789640 1 -- 172.21.15.77:0/3238108177 wait complete. 2023-11-26T07:19:54.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:19:54.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.306+0000 7fb5cdaf1640 1 Processor -- start 2023-11-26T07:19:54.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.306+0000 7fb5cdaf1640 1 -- start start 2023-11-26T07:19:54.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.308+0000 7fb5cdaf1640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5c80cb690 0x7fb5c80b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:54.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.308+0000 7fb5cdaf1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c806c530 con 0x7fb5c8160890 2023-11-26T07:19:54.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.308+0000 7fb5cdaf1640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c806c7d0 con 0x7fb5c80b1080 2023-11-26T07:19:54.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.308+0000 7fb5cdaf1640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c806d170 con 0x7fb5c80cb690 2023-11-26T07:19:54.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.308+0000 7fb5ccaef640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb5c8160890 0x7fb5c80c9710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36360/0 (socket says 172.21.15.77:36360) 2023-11-26T07:19:54.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.308+0000 7fb5ccaef640 1 -- 172.21.15.77:0/281470458 learned_addr learned my addr 172.21.15.77:0/281470458 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:54.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.308+0000 7fb5c7fff640 1 --2- 172.21.15.77:0/281470458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5c80cb690 0x7fb5c80b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:54.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.308+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877344262 0 0) 0x7fb5c806c530 con 0x7fb5c8160890 2023-11-26T07:19:54.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b8003520 con 0x7fb5c8160890 2023-11-26T07:19:54.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1318761966 0 0) 0x7fb5b8003520 con 0x7fb5c8160890 2023-11-26T07:19:54.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5c80cb690 msgr2=0x7fb5c80b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:54.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 --2- 172.21.15.77:0/281470458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5c80cb690 0x7fb5c80b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 >> v1:172.21.15.159:6789/0 conn(0x7fb5c80b1080 legacy=0x7fb5c80ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c806cab0 con 0x7fb5c8160890 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fb5bc001670 con 0x7fb5c8160890 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 >> v1:172.21.15.77:6789/0 conn(0x7fb5c8160890 legacy=0x7fb5c80c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 --2- 172.21.15.77:0/281470458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b80039a0 0x7fb5b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 --2- 172.21.15.77:0/281470458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5c80cb690 0x7fb5b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 --2- 172.21.15.77:0/281470458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5b8004d00 0x7fb5b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c806d170 con 0x7fb5b80039a0 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b800bb10 con 0x7fb5b8004d00 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b800bcd0 con 0x7fb5c80cb690 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.309+0000 7fb5ccaef640 1 --2- 172.21.15.77:0/281470458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b80039a0 0x7fb5b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.310+0000 7fb5ccaef640 1 -- 172.21.15.77:0/281470458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5c80cb690 msgr2=0x7fb5b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.310+0000 7fb5ccaef640 1 --2- 172.21.15.77:0/281470458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5c80cb690 0x7fb5b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.310+0000 7fb5ccaef640 1 -- 172.21.15.77:0/281470458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5b8004d00 msgr2=0x7fb5b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.310+0000 7fb5ccaef640 1 --2- 172.21.15.77:0/281470458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5b8004d00 0x7fb5b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.310+0000 7fb5ccaef640 1 -- 172.21.15.77:0/281470458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b8003520 con 0x7fb5b80039a0 2023-11-26T07:19:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.311+0000 7fb5ccaef640 1 --2- 172.21.15.77:0/281470458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b80039a0 0x7fb5b8003dc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00c0e0 tx=0x7fb5b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4061d432ac1079 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.311+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc005ad0 con 0x7fb5b80039a0 2023-11-26T07:19:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.311+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc005c30 con 0x7fb5b80039a0 2023-11-26T07:19:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.311+0000 7fb5c77fe640 1 -- 172.21.15.77:0/281470458 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc02c810 con 0x7fb5b80039a0 2023-11-26T07:19:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.311+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/281470458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b80039a0 msgr2=0x7fb5b8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.311+0000 7fb5cdaf1640 1 --2- 172.21.15.77:0/281470458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b80039a0 0x7fb5b8003dc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00c0e0 tx=0x7fb5b80057f0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.311+0000 7fb5cd2f0640 1 -- 172.21.15.77:0/281470458 reap_dead start 2023-11-26T07:19:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.311+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/281470458 shutdown_connections 2023-11-26T07:19:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.311+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/281470458 >> 172.21.15.77:0/281470458 conn(0x7fb5c80cbb40 msgr2=0x7fb5c80cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.312+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/281470458 shutdown_connections 2023-11-26T07:19:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.312+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/281470458 wait complete. 2023-11-26T07:19:54.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.313+0000 7fb5cdaf1640 1 Processor -- start 2023-11-26T07:19:54.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.313+0000 7fb5cdaf1640 1 -- start start 2023-11-26T07:19:54.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.314+0000 7fb5cdaf1640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b80039a0 0x7fb5c81556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:54.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.314+0000 7fb5cdaf1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5c80c3fc0 0x7fb5c80b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.314+0000 7fb5cdaf1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c80c4a60 0x7fb5c80c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.314+0000 7fb5cdaf1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c8155c00 con 0x7fb5c80c4a60 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.314+0000 7fb5cdaf1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80c5420 con 0x7fb5c80c3fc0 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.314+0000 7fb5cdaf1640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80b4ed0 con 0x7fb5b80039a0 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.315+0000 7fb5cd2f0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c80c4a60 0x7fb5c80c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.315+0000 7fb5cd2f0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c80c4a60 0x7fb5c80c4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50466/0 (socket says 172.21.15.77:50466) 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.315+0000 7fb5cd2f0640 1 -- 172.21.15.77:0/1801003486 learned_addr learned my addr 172.21.15.77:0/1801003486 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.315+0000 7fb5ccaef640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b80039a0 0x7fb5c81556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.315+0000 7fb5cd2f0640 1 -- 172.21.15.77:0/1801003486 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b80039a0 msgr2=0x7fb5c81556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.315+0000 7fb5cd2f0640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b80039a0 0x7fb5c81556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.315+0000 7fb5cd2f0640 1 -- 172.21.15.77:0/1801003486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5c80c3fc0 msgr2=0x7fb5c80b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.315+0000 7fb5cd2f0640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5c80c3fc0 0x7fb5c80b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.315+0000 7fb5cd2f0640 1 -- 172.21.15.77:0/1801003486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c80b3650 con 0x7fb5c80c4a60 2023-11-26T07:19:54.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.315+0000 7fb5cd2f0640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c80c4a60 0x7fb5c80c4ee0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80ccbc0 tx=0x7fb5c000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:54.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.316+0000 7fb5c57fa640 1 -- 172.21.15.77:0/1801003486 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0005d40 con 0x7fb5c80c4a60 2023-11-26T07:19:54.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.316+0000 7fb5c57fa640 1 -- 172.21.15.77:0/1801003486 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c000ced0 con 0x7fb5c80c4a60 2023-11-26T07:19:54.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.316+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/1801003486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c80b2890 con 0x7fb5c80c4a60 2023-11-26T07:19:54.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.316+0000 7fb5c57fa640 1 -- 172.21.15.77:0/1801003486 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c000a7f0 con 0x7fb5c80c4a60 2023-11-26T07:19:54.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.316+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/1801003486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c80b2e50 con 0x7fb5c80c4a60 2023-11-26T07:19:54.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.317+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/1801003486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c81f4330 con 0x7fb5c80c4a60 2023-11-26T07:19:54.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.318+0000 7fb5c57fa640 1 -- 172.21.15.77:0/1801003486 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fb5c000a950 con 0x7fb5c80c4a60 2023-11-26T07:19:54.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.319+0000 7fb5c57fa640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb5ac06b110 0x7fb5ac06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:54.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.319+0000 7fb5c57fa640 1 -- 172.21.15.77:0/1801003486 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fb5c0088f50 con 0x7fb5c80c4a60 2023-11-26T07:19:54.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.319+0000 7fb5ccaef640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb5ac06b110 0x7fb5ac06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:54.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.320+0000 7fb5ccaef640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb5ac06b110 0x7fb5ac06d5d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc034000 tx=0x7fb5bc009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:54.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.323+0000 7fb5c57fa640 1 -- 172.21.15.77:0/1801003486 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb5c0053c40 con 0x7fb5c80c4a60 2023-11-26T07:19:54.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.529+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/1801003486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb5c804e840 con 0x7fb5c80c4a60 2023-11-26T07:19:54.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.529+0000 7fb5c57fa640 1 -- 172.21.15.77:0/1801003486 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb5c0017020 con 0x7fb5c80c4a60 2023-11-26T07:19:54.531 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:19:54.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/1801003486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb5ac06b110 msgr2=0x7fb5ac06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:54.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb5ac06b110 0x7fb5ac06d5d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc034000 tx=0x7fb5bc009030 comp rx=0 tx=0).stop 2023-11-26T07:19:54.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/1801003486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c80c4a60 msgr2=0x7fb5c80c4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:54.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c80c4a60 0x7fb5c80c4ee0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80ccbc0 tx=0x7fb5c000cb90 comp rx=0 tx=0).stop 2023-11-26T07:19:54.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/1801003486 shutdown_connections 2023-11-26T07:19:54.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb5ac06b110 0x7fb5ac06d5d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c80c4a60 0x7fb5c80c4ee0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5c80c3fc0 0x7fb5c80b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 --2- 172.21.15.77:0/1801003486 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b80039a0 0x7fb5c81556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:54.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/1801003486 >> 172.21.15.77:0/1801003486 conn(0x7fb5c80cbb40 msgr2=0x7fb5c80712e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:54.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/1801003486 shutdown_connections 2023-11-26T07:19:54.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:54.532+0000 7fb5cdaf1640 1 -- 172.21.15.77:0/1801003486 wait complete. 2023-11-26T07:19:54.553 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-26T07:19:54.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:54.553 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-26T07:19:54.702 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:19:54.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:54.702 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:19:54.758 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:19:54.758 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:54.801 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:19:54.801 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:54.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:19:55.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.099+0000 7f64be7d5640 1 Processor -- start 2023-11-26T07:19:55.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.099+0000 7f64be7d5640 1 -- start start 2023-11-26T07:19:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.101+0000 7f64be7d5640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f64b80b2250 0x7f64b815df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.101+0000 7f64be7d5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f64b80b2aa0 0x7f64b815b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.101+0000 7f64be7d5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b815ab80 con 0x7f64b80b2630 2023-11-26T07:19:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.101+0000 7f64be7d5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b815a990 con 0x7f64b80b2aa0 2023-11-26T07:19:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.101+0000 7f64be7d5640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b815e680 con 0x7f64b80b2250 2023-11-26T07:19:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.101+0000 7f64bcd72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f64b80b2aa0 0x7f64b815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.101+0000 7f64affff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f64b80b2630 0x7f64b80ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36374/0 (socket says 172.21.15.77:36374) 2023-11-26T07:19:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.101+0000 7f64affff640 1 -- 172.21.15.77:0/3052476788 learned_addr learned my addr 172.21.15.77:0/3052476788 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:55.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.101+0000 7f64b7fff640 1 --2- 172.21.15.77:0/3052476788 >> v2:172.21.15.159:3300/0 conn(0x7f64b80b2250 0x7f64b815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.102+0000 7f64bcd72640 1 -- 172.21.15.77:0/3052476788 >> v2:172.21.15.159:3300/0 conn(0x7f64b80b2250 msgr2=0x7f64b815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.102+0000 7f64bcd72640 1 --2- 172.21.15.77:0/3052476788 >> v2:172.21.15.159:3300/0 conn(0x7f64b80b2250 0x7f64b815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.102+0000 7f64bcd72640 1 -- 172.21.15.77:0/3052476788 >> v1:172.21.15.77:6789/0 conn(0x7f64b80b2630 legacy=0x7f64b80ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.102+0000 7f64bcd72640 1 -- 172.21.15.77:0/3052476788 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b815e960 con 0x7f64b80b2aa0 2023-11-26T07:19:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.102+0000 7f64b77fe640 1 -- 172.21.15.77:0/3052476788 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831023917 0 0) 0x7f64b815ab80 con 0x7f64b80b2630 2023-11-26T07:19:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.103+0000 7f64bcd72640 1 --2- 172.21.15.77:0/3052476788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b80b2aa0 0x7f64b815b080 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f64b8072a70 tx=0x7f64b002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64f35b7db65c972 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.103+0000 7f64b77fe640 1 -- 172.21.15.77:0/3052476788 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b002cc80 con 0x7f64b80b2aa0 2023-11-26T07:19:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.103+0000 7f64b77fe640 1 -- 172.21.15.77:0/3052476788 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b002cde0 con 0x7f64b80b2aa0 2023-11-26T07:19:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.103+0000 7f64b77fe640 1 -- 172.21.15.77:0/3052476788 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0034660 con 0x7f64b80b2aa0 2023-11-26T07:19:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.104+0000 7f64be7d5640 1 -- 172.21.15.77:0/3052476788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b80b2aa0 msgr2=0x7f64b815b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.104+0000 7f64be7d5640 1 --2- 172.21.15.77:0/3052476788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b80b2aa0 0x7f64b815b080 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f64b8072a70 tx=0x7f64b002bed0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.104+0000 7f64be7d5640 1 -- 172.21.15.77:0/3052476788 shutdown_connections 2023-11-26T07:19:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.104+0000 7f64be7d5640 1 --2- 172.21.15.77:0/3052476788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b80b2aa0 0x7f64b815b080 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.104+0000 7f64be7d5640 1 --2- 172.21.15.77:0/3052476788 >> v2:172.21.15.159:3300/0 conn(0x7f64b80b2250 0x7f64b815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.104+0000 7f64be7d5640 1 -- 172.21.15.77:0/3052476788 >> 172.21.15.77:0/3052476788 conn(0x7f64b806a920 msgr2=0x7f64b806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.104+0000 7f64be7d5640 1 -- 172.21.15.77:0/3052476788 shutdown_connections 2023-11-26T07:19:55.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.104+0000 7f64be7d5640 1 -- 172.21.15.77:0/3052476788 wait complete. 2023-11-26T07:19:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.106+0000 7f64be7d5640 1 Processor -- start 2023-11-26T07:19:55.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.106+0000 7f64be7d5640 1 -- start start 2023-11-26T07:19:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.107+0000 7f64be7d5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b80b2250 0x7f64b80c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.107+0000 7f64be7d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b80b2630 0x7f64b80ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.107+0000 7f64be7d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80b2aa0 0x7f64b81f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.107+0000 7f64be7d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80c9300 con 0x7f64b80b2630 2023-11-26T07:19:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.107+0000 7f64be7d5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80b1590 con 0x7f64b80b2aa0 2023-11-26T07:19:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.107+0000 7f64be7d5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80caf30 con 0x7f64b80b2250 2023-11-26T07:19:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.107+0000 7f64affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b80b2630 0x7f64b80ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.107+0000 7f64affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b80b2630 0x7f64b80ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50484/0 (socket says 172.21.15.77:50484) 2023-11-26T07:19:55.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.107+0000 7f64affff640 1 -- 172.21.15.77:0/1289269467 learned_addr learned my addr 172.21.15.77:0/1289269467 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.107+0000 7f64bcd72640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80b2aa0 0x7f64b81f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64affff640 1 -- 172.21.15.77:0/1289269467 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b80b2250 msgr2=0x7f64b80c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64b7fff640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b80b2250 0x7f64b80c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64affff640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b80b2250 0x7f64b80c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64affff640 1 -- 172.21.15.77:0/1289269467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80b2aa0 msgr2=0x7f64b81f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64affff640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80b2aa0 0x7f64b81f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64affff640 1 -- 172.21.15.77:0/1289269467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b0009a70 con 0x7f64b80b2630 2023-11-26T07:19:55.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64bcd72640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80b2aa0 0x7f64b81f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64affff640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b80b2630 0x7f64b80ca720 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c4d0 tx=0x7f64a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64b57fa640 1 -- 172.21.15.77:0/1289269467 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a00074e0 con 0x7f64b80b2630 2023-11-26T07:19:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64b57fa640 1 -- 172.21.15.77:0/1289269467 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a0007660 con 0x7f64b80b2630 2023-11-26T07:19:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64b57fa640 1 -- 172.21.15.77:0/1289269467 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a0004a20 con 0x7f64b80b2630 2023-11-26T07:19:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64be7d5640 1 -- 172.21.15.77:0/1289269467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b80cd7c0 con 0x7f64b80b2630 2023-11-26T07:19:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.108+0000 7f64be7d5640 1 -- 172.21.15.77:0/1289269467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b80b0c60 con 0x7f64b80b2630 2023-11-26T07:19:55.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.109+0000 7f64be7d5640 1 -- 172.21.15.77:0/1289269467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b80b1720 con 0x7f64b80b2630 2023-11-26T07:19:55.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.110+0000 7f64b57fa640 1 -- 172.21.15.77:0/1289269467 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f64a0004b80 con 0x7f64b80b2630 2023-11-26T07:19:55.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.111+0000 7f64b57fa640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f649806b110 0x7f649806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.111+0000 7f64b57fa640 1 -- 172.21.15.77:0/1289269467 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f64a0088cb0 con 0x7f64b80b2630 2023-11-26T07:19:55.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.112+0000 7f64b7fff640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f649806b110 0x7f649806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:55.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.112+0000 7f64b7fff640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f649806b110 0x7f649806d5d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006fd0 tx=0x7f64a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:55.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.116+0000 7f64b57fa640 1 -- 172.21.15.77:0/1289269467 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f64a0053960 con 0x7f64b80b2630 2023-11-26T07:19:55.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.309+0000 7f64be7d5640 1 -- 172.21.15.77:0/1289269467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64b8067470 con 0x7f64b80b2630 2023-11-26T07:19:55.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:19:55.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.312+0000 7f64b57fa640 1 -- 172.21.15.77:0/1289269467 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16610 (secure 0 0 0) 0x7f64a0018020 con 0x7f64b80b2630 2023-11-26T07:19:55.315 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:19:55.315 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":36,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:19:50.657201+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:42.084786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:42.792071+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:19:55.320 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:19:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 -- 172.21.15.77:0/1289269467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f649806b110 msgr2=0x7f649806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f649806b110 0x7f649806d5d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006fd0 tx=0x7f64a8008040 comp rx=0 tx=0).stop 2023-11-26T07:19:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 -- 172.21.15.77:0/1289269467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b80b2630 msgr2=0x7f64b80ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b80b2630 0x7f64b80ca720 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c4d0 tx=0x7f64a000c990 comp rx=0 tx=0).stop 2023-11-26T07:19:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 -- 172.21.15.77:0/1289269467 shutdown_connections 2023-11-26T07:19:55.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f649806b110 0x7f649806d5d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b80b2aa0 0x7f64b81f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b80b2630 0x7f64b80ca720 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 --2- 172.21.15.77:0/1289269467 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b80b2250 0x7f64b80c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 -- 172.21.15.77:0/1289269467 >> 172.21.15.77:0/1289269467 conn(0x7f64b806a920 msgr2=0x7f64b8159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:55.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 -- 172.21.15.77:0/1289269467 shutdown_connections 2023-11-26T07:19:55.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.315+0000 7f64be7d5640 1 -- 172.21.15.77:0/1289269467 wait complete. 2023-11-26T07:19:55.335 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:42.084786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:42.792071+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:19:55.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:19:55.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.562+0000 7f5f9850c640 1 Processor -- start 2023-11-26T07:19:55.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.562+0000 7f5f9850c640 1 -- start start 2023-11-26T07:19:55.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.564+0000 7f5f9850c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5f901660b0 0x7f5f90162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.564+0000 7f5f9850c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5f90162540 0x7f5f900c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.564+0000 7f5f9850c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f90166510 con 0x7f5f900ccbd0 2023-11-26T07:19:55.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.564+0000 7f5f9850c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f901655f0 con 0x7f5f90162540 2023-11-26T07:19:55.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.564+0000 7f5f9850c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f900cc380 con 0x7f5f901660b0 2023-11-26T07:19:55.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.564+0000 7f5f96aa9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5f90162540 0x7f5f900c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:55.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.564+0000 7f5f96aa9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5f90162540 0x7f5f900c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50498/0 (socket says 172.21.15.77:50498) 2023-11-26T07:19:55.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.564+0000 7f5f96aa9640 1 -- 172.21.15.77:0/327622593 learned_addr learned my addr 172.21.15.77:0/327622593 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:55.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.565+0000 7f5f96aa9640 1 -- 172.21.15.77:0/327622593 >> v2:172.21.15.159:3300/0 conn(0x7f5f901660b0 msgr2=0x7f5f90162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:55.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.565+0000 7f5f96aa9640 1 --2- 172.21.15.77:0/327622593 >> v2:172.21.15.159:3300/0 conn(0x7f5f901660b0 0x7f5f90162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.565+0000 7f5f96aa9640 1 -- 172.21.15.77:0/327622593 >> v1:172.21.15.159:6789/0 conn(0x7f5f900ccbd0 legacy=0x7f5f900ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:55.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.565+0000 7f5f96aa9640 1 -- 172.21.15.77:0/327622593 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f90162b30 con 0x7f5f90162540 2023-11-26T07:19:55.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.566+0000 7f5f96aa9640 1 --2- 172.21.15.77:0/327622593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f90162540 0x7f5f900c9650 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5f9006e700 tx=0x7f5f8802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3add5e0dcb1f19ba server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:55.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.566+0000 7f5f952a6640 1 -- 172.21.15.77:0/327622593 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8802ca80 con 0x7f5f90162540 2023-11-26T07:19:55.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.566+0000 7f5f952a6640 1 -- 172.21.15.77:0/327622593 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8802cbe0 con 0x7f5f90162540 2023-11-26T07:19:55.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.566+0000 7f5f952a6640 1 -- 172.21.15.77:0/327622593 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880343f0 con 0x7f5f90162540 2023-11-26T07:19:55.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.567+0000 7f5f9850c640 1 -- 172.21.15.77:0/327622593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f90162540 msgr2=0x7f5f900c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:55.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.567+0000 7f5f9850c640 1 --2- 172.21.15.77:0/327622593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f90162540 0x7f5f900c9650 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5f9006e700 tx=0x7f5f8802bee0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.567+0000 7f5f9850c640 1 -- 172.21.15.77:0/327622593 shutdown_connections 2023-11-26T07:19:55.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.567+0000 7f5f9850c640 1 --2- 172.21.15.77:0/327622593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f90162540 0x7f5f900c9650 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.567+0000 7f5f9850c640 1 --2- 172.21.15.77:0/327622593 >> v2:172.21.15.159:3300/0 conn(0x7f5f901660b0 0x7f5f90162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.567+0000 7f5f9850c640 1 -- 172.21.15.77:0/327622593 >> 172.21.15.77:0/327622593 conn(0x7f5f900b0c50 msgr2=0x7f5f900b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:55.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.567+0000 7f5f9850c640 1 -- 172.21.15.77:0/327622593 shutdown_connections 2023-11-26T07:19:55.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.567+0000 7f5f9850c640 1 -- 172.21.15.77:0/327622593 wait complete. 2023-11-26T07:19:55.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.569+0000 7f5f9850c640 1 Processor -- start 2023-11-26T07:19:55.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.569+0000 7f5f9850c640 1 -- start start 2023-11-26T07:19:55.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f9850c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f900ccbd0 0x7f5f90158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f9850c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f90162540 0x7f5f900acf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f9850c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f901660b0 0x7f5f900ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f9850c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900b3390 con 0x7f5f900ccbd0 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f9850c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f901640d0 con 0x7f5f901660b0 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f9850c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f90163550 con 0x7f5f90162540 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f962a8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f900ccbd0 0x7f5f90158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f962a8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f900ccbd0 0x7f5f90158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50514/0 (socket says 172.21.15.77:50514) 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f962a8640 1 -- 172.21.15.77:0/2499908549 learned_addr learned my addr 172.21.15.77:0/2499908549 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f962a8640 1 -- 172.21.15.77:0/2499908549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f90162540 msgr2=0x7f5f900acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f962a8640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f90162540 0x7f5f900acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f962a8640 1 -- 172.21.15.77:0/2499908549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f901660b0 msgr2=0x7f5f900ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:55.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f962a8640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f901660b0 0x7f5f900ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.570+0000 7f5f962a8640 1 -- 172.21.15.77:0/2499908549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88009b30 con 0x7f5f900ccbd0 2023-11-26T07:19:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.571+0000 7f5f962a8640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f900ccbd0 0x7f5f90158200 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000c410 tx=0x7f5f8000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.571+0000 7f5f86ffd640 1 -- 172.21.15.77:0/2499908549 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f800035f0 con 0x7f5f900ccbd0 2023-11-26T07:19:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.571+0000 7f5f86ffd640 1 -- 172.21.15.77:0/2499908549 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f80003750 con 0x7f5f900ccbd0 2023-11-26T07:19:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.571+0000 7f5f86ffd640 1 -- 172.21.15.77:0/2499908549 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80003b40 con 0x7f5f900ccbd0 2023-11-26T07:19:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.571+0000 7f5f9850c640 1 -- 172.21.15.77:0/2499908549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f90163830 con 0x7f5f900ccbd0 2023-11-26T07:19:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.571+0000 7f5f9850c640 1 -- 172.21.15.77:0/2499908549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f90163df0 con 0x7f5f900ccbd0 2023-11-26T07:19:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.572+0000 7f5f9850c640 1 -- 172.21.15.77:0/2499908549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f900b3500 con 0x7f5f900ccbd0 2023-11-26T07:19:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.573+0000 7f5f86ffd640 1 -- 172.21.15.77:0/2499908549 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f5f80003ca0 con 0x7f5f900ccbd0 2023-11-26T07:19:55.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.574+0000 7f5f86ffd640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f7c06b110 0x7f5f7c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:55.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.574+0000 7f5f86ffd640 1 -- 172.21.15.77:0/2499908549 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f5f80088d70 con 0x7f5f900ccbd0 2023-11-26T07:19:55.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.574+0000 7f5f95aa7640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f7c06b110 0x7f5f7c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:55.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.575+0000 7f5f95aa7640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f7c06b110 0x7f5f7c06d5d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f900c91d0 tx=0x7f5f8c006bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.578+0000 7f5f86ffd640 1 -- 172.21.15.77:0/2499908549 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f800539d0 con 0x7f5f900ccbd0 2023-11-26T07:19:55.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.771+0000 7f5f9850c640 1 -- 172.21.15.77:0/2499908549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f90165880 con 0x7f5f900ccbd0 2023-11-26T07:19:55.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.772+0000 7f5f86ffd640 1 -- 172.21.15.77:0/2499908549 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f80056ff0 con 0x7f5f900ccbd0 2023-11-26T07:19:55.773 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:19:55.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.774+0000 7f5f9850c640 1 -- 172.21.15.77:0/2499908549 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f7c06b110 msgr2=0x7f5f7c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:55.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.774+0000 7f5f9850c640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f7c06b110 0x7f5f7c06d5d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f900c91d0 tx=0x7f5f8c006bf0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.774+0000 7f5f9850c640 1 -- 172.21.15.77:0/2499908549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f900ccbd0 msgr2=0x7f5f90158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:55.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.774+0000 7f5f9850c640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f900ccbd0 0x7f5f90158200 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000c410 tx=0x7f5f8000c8d0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.775+0000 7f5f9850c640 1 -- 172.21.15.77:0/2499908549 shutdown_connections 2023-11-26T07:19:55.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.775+0000 7f5f9850c640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f7c06b110 0x7f5f7c06d5d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.775+0000 7f5f9850c640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f901660b0 0x7f5f900ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.775+0000 7f5f9850c640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f90162540 0x7f5f900acf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.775+0000 7f5f9850c640 1 --2- 172.21.15.77:0/2499908549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f900ccbd0 0x7f5f90158200 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:55.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.775+0000 7f5f9850c640 1 -- 172.21.15.77:0/2499908549 >> 172.21.15.77:0/2499908549 conn(0x7f5f900b0c50 msgr2=0x7f5f900ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:55.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.775+0000 7f5f9850c640 1 -- 172.21.15.77:0/2499908549 shutdown_connections 2023-11-26T07:19:55.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:55.775+0000 7f5f9850c640 1 -- 172.21.15.77:0/2499908549 wait complete. 2023-11-26T07:19:55.795 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:19:56.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.009+0000 7f738fbb0640 1 Processor -- start 2023-11-26T07:19:56.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.009+0000 7f738fbb0640 1 -- start start 2023-11-26T07:19:56.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.011+0000 7f738fbb0640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f73880cc0f0 0x7f73880c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.011+0000 7f738fbb0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73880c57e0 0x7f738806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.011+0000 7f738fbb0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738815eea0 con 0x7f738815b440 2023-11-26T07:19:56.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.011+0000 7f738fbb0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738815b820 con 0x7f73880c57e0 2023-11-26T07:19:56.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.011+0000 7f738fbb0640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73880abf30 con 0x7f73880cc0f0 2023-11-26T07:19:56.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.011+0000 7f738e14d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73880c57e0 0x7f738806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.011+0000 7f738e14d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73880c57e0 0x7f738806c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50000/0 (socket says 172.21.15.77:50000) 2023-11-26T07:19:56.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.011+0000 7f738e14d640 1 -- 172.21.15.77:0/4054821793 learned_addr learned my addr 172.21.15.77:0/4054821793 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:56.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.011+0000 7f738d14b640 1 --2- 172.21.15.77:0/4054821793 >> v2:172.21.15.159:3300/0 conn(0x7f73880cc0f0 0x7f73880c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.012+0000 7f738e14d640 1 -- 172.21.15.77:0/4054821793 >> v2:172.21.15.159:3300/0 conn(0x7f73880cc0f0 msgr2=0x7f73880c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:56.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.012+0000 7f738e14d640 1 --2- 172.21.15.77:0/4054821793 >> v2:172.21.15.159:3300/0 conn(0x7f73880cc0f0 0x7f73880c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.012+0000 7f738e14d640 1 -- 172.21.15.77:0/4054821793 >> v1:172.21.15.77:6789/0 conn(0x7f738815b440 legacy=0x7f73880cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.012+0000 7f738e14d640 1 -- 172.21.15.77:0/4054821793 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738815f0f0 con 0x7f73880c57e0 2023-11-26T07:19:56.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.013+0000 7f738e14d640 1 --2- 172.21.15.77:0/4054821793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880c57e0 0x7f738806c5f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f738806e720 tx=0x7f738002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b50ba7594d1c3e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:56.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.013+0000 7f738c94a640 1 -- 172.21.15.77:0/4054821793 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738002ca80 con 0x7f73880c57e0 2023-11-26T07:19:56.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.013+0000 7f738c94a640 1 -- 172.21.15.77:0/4054821793 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738002cbe0 con 0x7f73880c57e0 2023-11-26T07:19:56.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.013+0000 7f738c94a640 1 -- 172.21.15.77:0/4054821793 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800343f0 con 0x7f73880c57e0 2023-11-26T07:19:56.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.013+0000 7f738fbb0640 1 -- 172.21.15.77:0/4054821793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880c57e0 msgr2=0x7f738806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.013+0000 7f738fbb0640 1 --2- 172.21.15.77:0/4054821793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880c57e0 0x7f738806c5f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f738806e720 tx=0x7f738002bee0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.014+0000 7f738fbb0640 1 -- 172.21.15.77:0/4054821793 shutdown_connections 2023-11-26T07:19:56.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.014+0000 7f738fbb0640 1 --2- 172.21.15.77:0/4054821793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880c57e0 0x7f738806c5f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.014+0000 7f738fbb0640 1 --2- 172.21.15.77:0/4054821793 >> v2:172.21.15.159:3300/0 conn(0x7f73880cc0f0 0x7f73880c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.014+0000 7f738fbb0640 1 -- 172.21.15.77:0/4054821793 >> 172.21.15.77:0/4054821793 conn(0x7f73880b0c50 msgr2=0x7f73880b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:56.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.014+0000 7f738fbb0640 1 -- 172.21.15.77:0/4054821793 shutdown_connections 2023-11-26T07:19:56.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.014+0000 7f738fbb0640 1 -- 172.21.15.77:0/4054821793 wait complete. 2023-11-26T07:19:56.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.015+0000 7f738fbb0640 1 Processor -- start 2023-11-26T07:19:56.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.016+0000 7f738fbb0640 1 -- start start 2023-11-26T07:19:56.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.016+0000 7f738fbb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880c57e0 0x7f7388152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.016+0000 7f738fbb0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73880cc0f0 0x7f7388159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.016+0000 7f738fbb0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f738815b440 0x7f7388159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.016+0000 7f738fbb0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73880ae200 con 0x7f73880c57e0 2023-11-26T07:19:56.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.016+0000 7f738fbb0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73880ac130 con 0x7f73880cc0f0 2023-11-26T07:19:56.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.016+0000 7f738fbb0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73880ac380 con 0x7f738815b440 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.017+0000 7f738d94c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880c57e0 0x7f7388152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.017+0000 7f738d94c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880c57e0 0x7f7388152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50016/0 (socket says 172.21.15.77:50016) 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.017+0000 7f738d94c640 1 -- 172.21.15.77:0/2740067721 learned_addr learned my addr 172.21.15.77:0/2740067721 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.017+0000 7f738d94c640 1 -- 172.21.15.77:0/2740067721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f738815b440 msgr2=0x7f7388159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.017+0000 7f738d94c640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f738815b440 0x7f7388159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.017+0000 7f738d94c640 1 -- 172.21.15.77:0/2740067721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73880cc0f0 msgr2=0x7f7388159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.017+0000 7f738d94c640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73880cc0f0 0x7f7388159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.017+0000 7f738d94c640 1 -- 172.21.15.77:0/2740067721 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7380009b30 con 0x7f73880c57e0 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.017+0000 7f738d94c640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880c57e0 0x7f7388152b60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f738400c400 tx=0x7f738400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.018+0000 7f737e7fc640 1 -- 172.21.15.77:0/2740067721 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840052d0 con 0x7f73880c57e0 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.018+0000 7f737e7fc640 1 -- 172.21.15.77:0/2740067721 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7384005430 con 0x7f73880c57e0 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.018+0000 7f737e7fc640 1 -- 172.21.15.77:0/2740067721 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384003830 con 0x7f73880c57e0 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.018+0000 7f738fbb0640 1 -- 172.21.15.77:0/2740067721 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73880ac660 con 0x7f73880c57e0 2023-11-26T07:19:56.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.018+0000 7f738fbb0640 1 -- 172.21.15.77:0/2740067721 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73880acc20 con 0x7f73880c57e0 2023-11-26T07:19:56.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.019+0000 7f738fbb0640 1 -- 172.21.15.77:0/2740067721 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738804e8b0 con 0x7f73880c57e0 2023-11-26T07:19:56.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.020+0000 7f737e7fc640 1 -- 172.21.15.77:0/2740067721 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f7384003990 con 0x7f73880c57e0 2023-11-26T07:19:56.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.021+0000 7f737e7fc640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f736c06b110 0x7f736c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.021+0000 7f737e7fc640 1 -- 172.21.15.77:0/2740067721 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f7384089100 con 0x7f73880c57e0 2023-11-26T07:19:56.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.022+0000 7f738d14b640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f736c06b110 0x7f736c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.022+0000 7f738d14b640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f736c06b110 0x7f736c06d5d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f73881533d0 tx=0x7f7378008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:56.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.026+0000 7f737e7fc640 1 -- 172.21.15.77:0/2740067721 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7384053d20 con 0x7f73880c57e0 2023-11-26T07:19:56.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.218+0000 7f738fbb0640 1 -- 172.21.15.77:0/2740067721 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73880cebc0 con 0x7f73880c57e0 2023-11-26T07:19:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.219+0000 7f737e7fc640 1 -- 172.21.15.77:0/2740067721 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7384057340 con 0x7f73880c57e0 2023-11-26T07:19:56.220 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:19:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.221+0000 7f738fbb0640 1 -- 172.21.15.77:0/2740067721 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f736c06b110 msgr2=0x7f736c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.221+0000 7f738fbb0640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f736c06b110 0x7f736c06d5d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f73881533d0 tx=0x7f7378008040 comp rx=0 tx=0).stop 2023-11-26T07:19:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.221+0000 7f738fbb0640 1 -- 172.21.15.77:0/2740067721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880c57e0 msgr2=0x7f7388152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.221+0000 7f738fbb0640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880c57e0 0x7f7388152b60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f738400c400 tx=0x7f738400c8c0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.222+0000 7f738fbb0640 1 -- 172.21.15.77:0/2740067721 shutdown_connections 2023-11-26T07:19:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.222+0000 7f738fbb0640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f736c06b110 0x7f736c06d5d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.222+0000 7f738fbb0640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f738815b440 0x7f7388159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.222+0000 7f738fbb0640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73880cc0f0 0x7f7388159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.222+0000 7f738fbb0640 1 --2- 172.21.15.77:0/2740067721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880c57e0 0x7f7388152b60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.222+0000 7f738fbb0640 1 -- 172.21.15.77:0/2740067721 >> 172.21.15.77:0/2740067721 conn(0x7f73880b0c50 msgr2=0x7f7388154160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.222+0000 7f738fbb0640 1 -- 172.21.15.77:0/2740067721 shutdown_connections 2023-11-26T07:19:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.222+0000 7f738fbb0640 1 -- 172.21.15.77:0/2740067721 wait complete. 2023-11-26T07:19:56.242 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:19:56.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.460+0000 7f618f097640 1 Processor -- start 2023-11-26T07:19:56.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.460+0000 7f618f097640 1 -- start start 2023-11-26T07:19:56.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.462+0000 7f618f097640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f618806e640 0x7f61880ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.462+0000 7f618f097640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61880ad3c0 0x7f61880708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.462+0000 7f618f097640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618815b670 con 0x7f618815b290 2023-11-26T07:19:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.462+0000 7f618f097640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61880adbd0 con 0x7f61880ad3c0 2023-11-26T07:19:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.462+0000 7f618f097640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61880adeb0 con 0x7f618806e640 2023-11-26T07:19:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.462+0000 7f618d634640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61880ad3c0 0x7f61880708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.462+0000 7f618ce33640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f618815b290 0x7f618806df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50468/0 (socket says 172.21.15.77:50468) 2023-11-26T07:19:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.462+0000 7f618ce33640 1 -- 172.21.15.77:0/564685906 learned_addr learned my addr 172.21.15.77:0/564685906 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.462+0000 7f617ffff640 1 --2- 172.21.15.77:0/564685906 >> v2:172.21.15.159:3300/0 conn(0x7f618806e640 0x7f61880ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.463+0000 7f618d634640 1 -- 172.21.15.77:0/564685906 >> v2:172.21.15.159:3300/0 conn(0x7f618806e640 msgr2=0x7f61880ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.463+0000 7f618d634640 1 --2- 172.21.15.77:0/564685906 >> v2:172.21.15.159:3300/0 conn(0x7f618806e640 0x7f61880ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.463+0000 7f618d634640 1 -- 172.21.15.77:0/564685906 >> v1:172.21.15.77:6789/0 conn(0x7f618815b290 legacy=0x7f618806df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.463+0000 7f618d634640 1 -- 172.21.15.77:0/564685906 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61880ae190 con 0x7f61880ad3c0 2023-11-26T07:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.463+0000 7f617f7fe640 1 -- 172.21.15.77:0/564685906 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708441171 0 0) 0x7f618815b670 con 0x7f618815b290 2023-11-26T07:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.464+0000 7f618d634640 1 --2- 172.21.15.77:0/564685906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61880ad3c0 0x7f61880708f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f61880cb170 tx=0x7f618002e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd3121c0d4b0211 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.464+0000 7f617f7fe640 1 -- 172.21.15.77:0/564685906 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618002ea60 con 0x7f61880ad3c0 2023-11-26T07:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.464+0000 7f617f7fe640 1 -- 172.21.15.77:0/564685906 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618002ebc0 con 0x7f61880ad3c0 2023-11-26T07:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.464+0000 7f617f7fe640 1 -- 172.21.15.77:0/564685906 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180009540 con 0x7f61880ad3c0 2023-11-26T07:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.465+0000 7f618f097640 1 -- 172.21.15.77:0/564685906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61880ad3c0 msgr2=0x7f61880708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.465+0000 7f618f097640 1 --2- 172.21.15.77:0/564685906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61880ad3c0 0x7f61880708f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f61880cb170 tx=0x7f618002e0c0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.465+0000 7f618f097640 1 -- 172.21.15.77:0/564685906 shutdown_connections 2023-11-26T07:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.465+0000 7f618f097640 1 --2- 172.21.15.77:0/564685906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61880ad3c0 0x7f61880708f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.465+0000 7f618f097640 1 --2- 172.21.15.77:0/564685906 >> v2:172.21.15.159:3300/0 conn(0x7f618806e640 0x7f61880ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.465+0000 7f618f097640 1 -- 172.21.15.77:0/564685906 >> 172.21.15.77:0/564685906 conn(0x7f61880b0b70 msgr2=0x7f61880b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.465+0000 7f618f097640 1 -- 172.21.15.77:0/564685906 shutdown_connections 2023-11-26T07:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.465+0000 7f618f097640 1 -- 172.21.15.77:0/564685906 wait complete. 2023-11-26T07:19:56.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.466+0000 7f618f097640 1 Processor -- start 2023-11-26T07:19:56.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.467+0000 7f618f097640 1 -- start start 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618f097640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618806e640 0x7f618814cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618f097640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61880ad3c0 0x7f618814c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618f097640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f618815b290 0x7f61880cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618f097640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618814d340 con 0x7f618806e640 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618f097640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618814d630 con 0x7f61880ad3c0 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618f097640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618814d910 con 0x7f618815b290 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618ce33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618806e640 0x7f618814cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618ce33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618806e640 0x7f618814cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50028/0 (socket says 172.21.15.77:50028) 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618ce33640 1 -- 172.21.15.77:0/3072863565 learned_addr learned my addr 172.21.15.77:0/3072863565 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618ce33640 1 -- 172.21.15.77:0/3072863565 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f618815b290 msgr2=0x7f61880cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618ce33640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f618815b290 0x7f61880cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618ce33640 1 -- 172.21.15.77:0/3072863565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61880ad3c0 msgr2=0x7f618814c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618ce33640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61880ad3c0 0x7f618814c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618ce33640 1 -- 172.21.15.77:0/3072863565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618000bc80 con 0x7f618806e640 2023-11-26T07:19:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.468+0000 7f618ce33640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618806e640 0x7f618814cd60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f618400c4d0 tx=0x7f618400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.469+0000 7f617d7fa640 1 -- 172.21.15.77:0/3072863565 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61840074e0 con 0x7f618806e640 2023-11-26T07:19:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.469+0000 7f617d7fa640 1 -- 172.21.15.77:0/3072863565 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6184007640 con 0x7f618806e640 2023-11-26T07:19:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.469+0000 7f617d7fa640 1 -- 172.21.15.77:0/3072863565 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6184004a20 con 0x7f618806e640 2023-11-26T07:19:56.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.469+0000 7f618f097640 1 -- 172.21.15.77:0/3072863565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618814dbf0 con 0x7f618806e640 2023-11-26T07:19:56.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.469+0000 7f618f097640 1 -- 172.21.15.77:0/3072863565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61880ca6f0 con 0x7f618806e640 2023-11-26T07:19:56.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.470+0000 7f618f097640 1 -- 172.21.15.77:0/3072863565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618814e110 con 0x7f618806e640 2023-11-26T07:19:56.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.471+0000 7f617d7fa640 1 -- 172.21.15.77:0/3072863565 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f6184004b80 con 0x7f618806e640 2023-11-26T07:19:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.472+0000 7f617d7fa640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f617406b110 0x7f617406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.472+0000 7f617d7fa640 1 -- 172.21.15.77:0/3072863565 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f6184088cc0 con 0x7f618806e640 2023-11-26T07:19:56.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.472+0000 7f617ffff640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f617406b110 0x7f617406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.473+0000 7f617ffff640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f617406b110 0x7f617406d5d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6178006fd0 tx=0x7f6178008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:56.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.477+0000 7f617d7fa640 1 -- 172.21.15.77:0/3072863565 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f618814e110 con 0x7f618806e640 2023-11-26T07:19:56.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.666+0000 7f618f097640 1 -- 172.21.15.77:0/3072863565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f618814e110 con 0x7f618806e640 2023-11-26T07:19:56.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.667+0000 7f617d7fa640 1 -- 172.21.15.77:0/3072863565 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6184018020 con 0x7f618806e640 2023-11-26T07:19:56.669 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:19:56.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 -- 172.21.15.77:0/3072863565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f617406b110 msgr2=0x7f617406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f617406b110 0x7f617406d5d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6178006fd0 tx=0x7f6178008040 comp rx=0 tx=0).stop 2023-11-26T07:19:56.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 -- 172.21.15.77:0/3072863565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618806e640 msgr2=0x7f618814cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618806e640 0x7f618814cd60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f618400c4d0 tx=0x7f618400c990 comp rx=0 tx=0).stop 2023-11-26T07:19:56.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 -- 172.21.15.77:0/3072863565 shutdown_connections 2023-11-26T07:19:56.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f617406b110 0x7f617406d5d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f618815b290 0x7f61880cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61880ad3c0 0x7f618814c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 --2- 172.21.15.77:0/3072863565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618806e640 0x7f618814cd60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 -- 172.21.15.77:0/3072863565 >> 172.21.15.77:0/3072863565 conn(0x7f61880b0b70 msgr2=0x7f618806d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:56.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 -- 172.21.15.77:0/3072863565 shutdown_connections 2023-11-26T07:19:56.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.670+0000 7f618f097640 1 -- 172.21.15.77:0/3072863565 wait complete. 2023-11-26T07:19:56.690 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:19:56.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.899+0000 7f92f39a9640 1 Processor -- start 2023-11-26T07:19:56.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.900+0000 7f92f39a9640 1 -- start start 2023-11-26T07:19:56.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.901+0000 7f92f39a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92ec0c59b0 0x7f92ec166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.901+0000 7f92f39a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec15eea0 con 0x7f92ec15b440 2023-11-26T07:19:56.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.901+0000 7f92f39a9640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec06d600 con 0x7f92ec0cc0f0 2023-11-26T07:19:56.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.901+0000 7f92f39a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0c5e00 con 0x7f92ec0c59b0 2023-11-26T07:19:56.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.902+0000 7f92f1745640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f92ec15b440 0x7f92ec0cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50482/0 (socket says 172.21.15.77:50482) 2023-11-26T07:19:56.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.902+0000 7f92f1745640 1 -- 172.21.15.77:0/3894652160 learned_addr learned my addr 172.21.15.77:0/3894652160 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:56.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.902+0000 7f92f1f46640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92ec0c59b0 0x7f92ec166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.902+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438081958 0 0) 0x7f92ec15eea0 con 0x7f92ec15b440 2023-11-26T07:19:56.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.902+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92dc003520 con 0x7f92ec15b440 2023-11-26T07:19:56.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3727498556 0 0) 0x7f92dc003520 con 0x7f92ec15b440 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92ec0c59b0 msgr2=0x7f92ec166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92ec0c59b0 0x7f92ec166230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 >> v1:172.21.15.159:6789/0 conn(0x7f92ec0cc0f0 legacy=0x7f92ec0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0abf30 con 0x7f92ec15b440 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f92e00019f0 con 0x7f92ec15b440 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 >> v1:172.21.15.77:6789/0 conn(0x7f92ec15b440 legacy=0x7f92ec0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92dc0039a0 0x7f92dc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92ec0c59b0 0x7f92dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92dc004d00 0x7f92dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc00ba80 con 0x7f92dc0039a0 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc00bbf0 con 0x7f92dc004d00 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc00bdb0 con 0x7f92ec0c59b0 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.903+0000 7f92f1745640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92dc0039a0 0x7f92dc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.904+0000 7f92f1f46640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92dc004d00 0x7f92dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.904+0000 7f92f0f44640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92ec0c59b0 0x7f92dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.904+0000 7f92f1745640 1 -- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92ec0c59b0 msgr2=0x7f92dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:56.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.904+0000 7f92f1745640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92ec0c59b0 0x7f92dc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.904+0000 7f92f1745640 1 -- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92dc004d00 msgr2=0x7f92dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:56.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.904+0000 7f92f1745640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92dc004d00 0x7f92dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.904+0000 7f92f1745640 1 -- 172.21.15.77:0/3894652160 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc003520 con 0x7f92dc0039a0 2023-11-26T07:19:56.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.904+0000 7f92f1f46640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92dc004d00 0x7f92dc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:56.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.904+0000 7f92f0f44640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92ec0c59b0 0x7f92dc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:56.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.905+0000 7f92f1745640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92dc0039a0 0x7f92dc003dc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f92e000a830 tx=0x7f92dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5537b5b0a4153487 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:56.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.905+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00072d0 con 0x7f92dc0039a0 2023-11-26T07:19:56.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.905+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e002f070 con 0x7f92dc0039a0 2023-11-26T07:19:56.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.905+0000 7f92ebfff640 1 -- 172.21.15.77:0/3894652160 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00076b0 con 0x7f92dc0039a0 2023-11-26T07:19:56.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.906+0000 7f92f39a9640 1 -- 172.21.15.77:0/3894652160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92dc0039a0 msgr2=0x7f92dc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.906+0000 7f92f39a9640 1 --2- 172.21.15.77:0/3894652160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92dc0039a0 0x7f92dc003dc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f92e000a830 tx=0x7f92dc0057f0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.906+0000 7f92f1f46640 1 -- 172.21.15.77:0/3894652160 reap_dead start 2023-11-26T07:19:56.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.906+0000 7f92f39a9640 1 -- 172.21.15.77:0/3894652160 shutdown_connections 2023-11-26T07:19:56.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.906+0000 7f92f39a9640 1 -- 172.21.15.77:0/3894652160 >> 172.21.15.77:0/3894652160 conn(0x7f92ec0b0c50 msgr2=0x7f92ec0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:56.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.906+0000 7f92f39a9640 1 -- 172.21.15.77:0/3894652160 shutdown_connections 2023-11-26T07:19:56.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.906+0000 7f92f39a9640 1 -- 172.21.15.77:0/3894652160 wait complete. 2023-11-26T07:19:56.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.908+0000 7f92f39a9640 1 Processor -- start 2023-11-26T07:19:56.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.908+0000 7f92f39a9640 1 -- start start 2023-11-26T07:19:56.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.909+0000 7f92f39a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92dc0039a0 0x7f92ec0c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.909+0000 7f92f39a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92ec15b9a0 0x7f92ec1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.909+0000 7f92f39a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec0b3e80 0x7f92ec0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.909+0000 7f92f39a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0b4840 con 0x7f92ec0b3e80 2023-11-26T07:19:56.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.909+0000 7f92f39a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0c9040 con 0x7f92ec15b9a0 2023-11-26T07:19:56.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.909+0000 7f92f39a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec1f20d0 con 0x7f92dc0039a0 2023-11-26T07:19:56.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.909+0000 7f92f1f46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec0b3e80 0x7f92ec0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.909+0000 7f92f1f46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec0b3e80 0x7f92ec0b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50050/0 (socket says 172.21.15.77:50050) 2023-11-26T07:19:56.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.909+0000 7f92f1f46640 1 -- 172.21.15.77:0/3518284489 learned_addr learned my addr 172.21.15.77:0/3518284489 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:56.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.909+0000 7f92f1745640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92dc0039a0 0x7f92ec0c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.909+0000 7f92f1f46640 1 -- 172.21.15.77:0/3518284489 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92dc0039a0 msgr2=0x7f92ec0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.910+0000 7f92f1f46640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92dc0039a0 0x7f92ec0c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.910+0000 7f92f1f46640 1 -- 172.21.15.77:0/3518284489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92ec15b9a0 msgr2=0x7f92ec1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.910+0000 7f92f1f46640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92ec15b9a0 0x7f92ec1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.910+0000 7f92f1f46640 1 -- 172.21.15.77:0/3518284489 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec1f1550 con 0x7f92ec0b3e80 2023-11-26T07:19:56.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.910+0000 7f92f1745640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92dc0039a0 0x7f92ec0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:56.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.910+0000 7f92f1f46640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec0b3e80 0x7f92ec0b4300 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f92ec09d280 tx=0x7f92e4010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:56.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.910+0000 7f92e9ffb640 1 -- 172.21.15.77:0/3518284489 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e400e8a0 con 0x7f92ec0b3e80 2023-11-26T07:19:56.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.910+0000 7f92e9ffb640 1 -- 172.21.15.77:0/3518284489 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e400ea20 con 0x7f92ec0b3e80 2023-11-26T07:19:56.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.910+0000 7f92e9ffb640 1 -- 172.21.15.77:0/3518284489 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e400edd0 con 0x7f92ec0b3e80 2023-11-26T07:19:56.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.910+0000 7f92f39a9640 1 -- 172.21.15.77:0/3518284489 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec1f1830 con 0x7f92ec0b3e80 2023-11-26T07:19:56.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.910+0000 7f92f39a9640 1 -- 172.21.15.77:0/3518284489 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec1f1df0 con 0x7f92ec0b3e80 2023-11-26T07:19:56.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.911+0000 7f92f39a9640 1 -- 172.21.15.77:0/3518284489 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec0cfdc0 con 0x7f92ec0b3e80 2023-11-26T07:19:56.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.912+0000 7f92e9ffb640 1 -- 172.21.15.77:0/3518284489 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f92e4021460 con 0x7f92ec0b3e80 2023-11-26T07:19:56.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.913+0000 7f92e9ffb640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d006b140 0x7f92d006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:56.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.913+0000 7f92e9ffb640 1 -- 172.21.15.77:0/3518284489 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f92e4089600 con 0x7f92ec0b3e80 2023-11-26T07:19:56.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.913+0000 7f92f1745640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d006b140 0x7f92d006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:56.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.914+0000 7f92f1745640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d006b140 0x7f92d006d600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f92e0034000 tx=0x7f92e0007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:56.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:56.917+0000 7f92e9ffb640 1 -- 172.21.15.77:0/3518284489 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92e4054300 con 0x7f92ec0b3e80 2023-11-26T07:19:57.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.122+0000 7f92f39a9640 1 -- 172.21.15.77:0/3518284489 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f92ec04e8b0 con 0x7f92ec0b3e80 2023-11-26T07:19:57.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.123+0000 7f92e9ffb640 1 -- 172.21.15.77:0/3518284489 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f92e4057920 con 0x7f92ec0b3e80 2023-11-26T07:19:57.124 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:19:57.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.125+0000 7f92f39a9640 1 -- 172.21.15.77:0/3518284489 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d006b140 msgr2=0x7f92d006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.125+0000 7f92f39a9640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d006b140 0x7f92d006d600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f92e0034000 tx=0x7f92e0007000 comp rx=0 tx=0).stop 2023-11-26T07:19:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.126+0000 7f92f39a9640 1 -- 172.21.15.77:0/3518284489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec0b3e80 msgr2=0x7f92ec0b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.126+0000 7f92f39a9640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec0b3e80 0x7f92ec0b4300 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f92ec09d280 tx=0x7f92e4010c20 comp rx=0 tx=0).stop 2023-11-26T07:19:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.126+0000 7f92f39a9640 1 -- 172.21.15.77:0/3518284489 shutdown_connections 2023-11-26T07:19:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.126+0000 7f92f39a9640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d006b140 0x7f92d006d600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.126+0000 7f92f39a9640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92ec0b3e80 0x7f92ec0b4300 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.126+0000 7f92f39a9640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92ec15b9a0 0x7f92ec1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.126+0000 7f92f39a9640 1 --2- 172.21.15.77:0/3518284489 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92dc0039a0 0x7f92ec0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.126+0000 7f92f39a9640 1 -- 172.21.15.77:0/3518284489 >> 172.21.15.77:0/3518284489 conn(0x7f92ec0b0c50 msgr2=0x7f92ec06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.126+0000 7f92f39a9640 1 -- 172.21.15.77:0/3518284489 shutdown_connections 2023-11-26T07:19:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.126+0000 7f92f39a9640 1 -- 172.21.15.77:0/3518284489 wait complete. 2023-11-26T07:19:57.147 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-26T07:19:57.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:57.147 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-26T07:19:57.264 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:19:57.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:57.264 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:19:57.314 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:19:57.314 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:57.374 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:19:57.375 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:19:57.375 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:57.433 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:19:57.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:19:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.658+0000 7f4eac87b640 1 Processor -- start 2023-11-26T07:19:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.658+0000 7f4eac87b640 1 -- start start 2023-11-26T07:19:57.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.660+0000 7f4eac87b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ea8144b30 0x7f4ea815f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.660+0000 7f4eac87b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4ea815c410 0x7f4ea80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.660+0000 7f4eac87b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea815bf80 con 0x7f4ea80b1de0 2023-11-26T07:19:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.660+0000 7f4eac87b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea80b1560 con 0x7f4ea815c410 2023-11-26T07:19:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.660+0000 7f4eac87b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80b0fb0 con 0x7f4ea8144b30 2023-11-26T07:19:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.660+0000 7f4e9ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4ea815c410 0x7f4ea80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.660+0000 7f4ea759e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4ea80b1de0 0x7f4ea806c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50490/0 (socket says 172.21.15.77:50490) 2023-11-26T07:19:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.660+0000 7f4ea759e640 1 -- 172.21.15.77:0/657069642 learned_addr learned my addr 172.21.15.77:0/657069642 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.660+0000 7f4ea6d9d640 1 --2- 172.21.15.77:0/657069642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ea8144b30 0x7f4ea815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:57.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.660+0000 7f4ea659c640 1 -- 172.21.15.77:0/657069642 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104963609 0 0) 0x7f4ea815bf80 con 0x7f4ea80b1de0 2023-11-26T07:19:57.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.660+0000 7f4ea659c640 1 -- 172.21.15.77:0/657069642 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e88003520 con 0x7f4ea80b1de0 2023-11-26T07:19:57.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.661+0000 7f4e9ffff640 1 -- 172.21.15.77:0/657069642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ea8144b30 msgr2=0x7f4ea815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:57.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.661+0000 7f4e9ffff640 1 --2- 172.21.15.77:0/657069642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ea8144b30 0x7f4ea815f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.661+0000 7f4e9ffff640 1 -- 172.21.15.77:0/657069642 >> v1:172.21.15.77:6789/0 conn(0x7f4ea80b1de0 legacy=0x7f4ea806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:57.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.661+0000 7f4e9ffff640 1 -- 172.21.15.77:0/657069642 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80b1280 con 0x7f4ea815c410 2023-11-26T07:19:57.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.662+0000 7f4e9ffff640 1 --2- 172.21.15.77:0/657069642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ea815c410 0x7f4ea80b0a70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4e900097a0 tx=0x7f4e9002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434039244dcf3bfc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:57.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.662+0000 7f4ea659c640 1 -- 172.21.15.77:0/657069642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90031830 con 0x7f4ea815c410 2023-11-26T07:19:57.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.662+0000 7f4ea659c640 1 -- 172.21.15.77:0/657069642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e90031990 con 0x7f4ea815c410 2023-11-26T07:19:57.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.662+0000 7f4ea659c640 1 -- 172.21.15.77:0/657069642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90031d20 con 0x7f4ea815c410 2023-11-26T07:19:57.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.662+0000 7f4eac87b640 1 -- 172.21.15.77:0/657069642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ea815c410 msgr2=0x7f4ea80b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:57.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.662+0000 7f4eac87b640 1 --2- 172.21.15.77:0/657069642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ea815c410 0x7f4ea80b0a70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4e900097a0 tx=0x7f4e9002b8d0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.662+0000 7f4eac87b640 1 -- 172.21.15.77:0/657069642 shutdown_connections 2023-11-26T07:19:57.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.662+0000 7f4eac87b640 1 --2- 172.21.15.77:0/657069642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ea815c410 0x7f4ea80b0a70 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.662+0000 7f4eac87b640 1 --2- 172.21.15.77:0/657069642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ea8144b30 0x7f4ea815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.663+0000 7f4eac87b640 1 -- 172.21.15.77:0/657069642 >> 172.21.15.77:0/657069642 conn(0x7f4ea80cb830 msgr2=0x7f4ea80cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:57.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.663+0000 7f4eac87b640 1 -- 172.21.15.77:0/657069642 shutdown_connections 2023-11-26T07:19:57.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.663+0000 7f4eac87b640 1 -- 172.21.15.77:0/657069642 wait complete. 2023-11-26T07:19:57.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.664+0000 7f4eac87b640 1 Processor -- start 2023-11-26T07:19:57.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.664+0000 7f4eac87b640 1 -- start start 2023-11-26T07:19:57.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.665+0000 7f4eac87b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ea80b1de0 0x7f4ea80c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.665+0000 7f4eac87b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ea8144b30 0x7f4ea81f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.665+0000 7f4eac87b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ea815c410 0x7f4ea81f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.665+0000 7f4eac87b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8136fa0 con 0x7f4ea80b1de0 2023-11-26T07:19:57.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.665+0000 7f4eac87b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea81f0980 con 0x7f4ea8144b30 2023-11-26T07:19:57.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.665+0000 7f4eac87b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea81f3e40 con 0x7f4ea815c410 2023-11-26T07:19:57.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.666+0000 7f4ea6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ea80b1de0 0x7f4ea80c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:57.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.666+0000 7f4ea6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ea80b1de0 0x7f4ea80c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50058/0 (socket says 172.21.15.77:50058) 2023-11-26T07:19:57.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.666+0000 7f4ea6d9d640 1 -- 172.21.15.77:0/486130987 learned_addr learned my addr 172.21.15.77:0/486130987 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:57.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.666+0000 7f4ea6d9d640 1 -- 172.21.15.77:0/486130987 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ea815c410 msgr2=0x7f4ea81f3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:57.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.666+0000 7f4ea6d9d640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ea815c410 0x7f4ea81f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.666+0000 7f4ea6d9d640 1 -- 172.21.15.77:0/486130987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ea8144b30 msgr2=0x7f4ea81f0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:57.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.666+0000 7f4ea6d9d640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ea8144b30 0x7f4ea81f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.666+0000 7f4ea6d9d640 1 -- 172.21.15.77:0/486130987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e90009400 con 0x7f4ea80b1de0 2023-11-26T07:19:57.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.666+0000 7f4ea6d9d640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ea80b1de0 0x7f4ea80c90e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800d860 tx=0x7f4e9800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:57.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.667+0000 7f4e9f7fe640 1 -- 172.21.15.77:0/486130987 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9800de50 con 0x7f4ea80b1de0 2023-11-26T07:19:57.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.667+0000 7f4e9f7fe640 1 -- 172.21.15.77:0/486130987 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9800b8d0 con 0x7f4ea80b1de0 2023-11-26T07:19:57.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.667+0000 7f4eac87b640 1 -- 172.21.15.77:0/486130987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea81367c0 con 0x7f4ea80b1de0 2023-11-26T07:19:57.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.667+0000 7f4e9f7fe640 1 -- 172.21.15.77:0/486130987 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9800bc60 con 0x7f4ea80b1de0 2023-11-26T07:19:57.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.667+0000 7f4eac87b640 1 -- 172.21.15.77:0/486130987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea813d4e0 con 0x7f4ea80b1de0 2023-11-26T07:19:57.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.668+0000 7f4eac87b640 1 -- 172.21.15.77:0/486130987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea80b3610 con 0x7f4ea80b1de0 2023-11-26T07:19:57.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.669+0000 7f4e9f7fe640 1 -- 172.21.15.77:0/486130987 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f4e9801e460 con 0x7f4ea80b1de0 2023-11-26T07:19:57.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.670+0000 7f4e9f7fe640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4e8c06b110 0x7f4e8c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.670+0000 7f4e9f7fe640 1 -- 172.21.15.77:0/486130987 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f4e98089fb0 con 0x7f4ea80b1de0 2023-11-26T07:19:57.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.670+0000 7f4e9ffff640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4e8c06b110 0x7f4e8c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:57.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.671+0000 7f4e9ffff640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4e8c06b110 0x7f4e8c06d5d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4e90036000 tx=0x7f4e90030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:57.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.674+0000 7f4e9f7fe640 1 -- 172.21.15.77:0/486130987 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ea80b3610 con 0x7f4ea80b1de0 2023-11-26T07:19:57.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.905+0000 7f4eac87b640 1 -- 172.21.15.77:0/486130987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ea80b3610 con 0x7f4ea80b1de0 2023-11-26T07:19:57.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.907+0000 7f4e9f7fe640 1 -- 172.21.15.77:0/486130987 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f4ea80b3610 con 0x7f4ea80b1de0 2023-11-26T07:19:57.908 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:19:57.908 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3806365439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3806365439},{"type":"v1","addr":"172.21.15.77:6836","nonce":3806365439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/694008676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":694008676},{"type":"v1","addr":"172.21.15.77:6837","nonce":694008676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4705,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/4096574472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4096574472},{"type":"v1","addr":"172.21.15.159:6834","nonce":4096574472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:43.790536+0000","modified":"2023-11-26T07:18:47.129568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6835/360332813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":360332813},{"type":"v1","addr":"172.21.15.159:6835","nonce":360332813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:19:57.909 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 -- 172.21.15.77:0/486130987 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4e8c06b110 msgr2=0x7f4e8c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4e8c06b110 0x7f4e8c06d5d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4e90036000 tx=0x7f4e90030000 comp rx=0 tx=0).stop 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 -- 172.21.15.77:0/486130987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ea80b1de0 msgr2=0x7f4ea80c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ea80b1de0 0x7f4ea80c90e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800d860 tx=0x7f4e9800dd20 comp rx=0 tx=0).stop 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 -- 172.21.15.77:0/486130987 shutdown_connections 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4e8c06b110 0x7f4e8c06d5d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ea815c410 0x7f4ea81f3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ea8144b30 0x7f4ea81f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 --2- 172.21.15.77:0/486130987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ea80b1de0 0x7f4ea80c90e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 -- 172.21.15.77:0/486130987 >> 172.21.15.77:0/486130987 conn(0x7f4ea80cb830 msgr2=0x7f4ea815ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 -- 172.21.15.77:0/486130987 shutdown_connections 2023-11-26T07:19:57.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:57.909+0000 7f4eac87b640 1 -- 172.21.15.77:0/486130987 wait complete. 2023-11-26T07:19:57.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:19:58.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.131+0000 7f35bcf4c640 1 Processor -- start 2023-11-26T07:19:58.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.131+0000 7f35bcf4c640 1 -- start start 2023-11-26T07:19:58.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.132+0000 7f35bcf4c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b80b2250 0x7f35b815df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.132+0000 7f35bcf4c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f35b80b2a70 0x7f35b815b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.132+0000 7f35bcf4c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b815ab80 con 0x7f35b80b2630 2023-11-26T07:19:58.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.132+0000 7f35bcf4c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b815a990 con 0x7f35b80b2a70 2023-11-26T07:19:58.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.133+0000 7f35bcf4c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b815e680 con 0x7f35b80b2250 2023-11-26T07:19:58.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.133+0000 7f35affff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f35b80b2630 0x7f35b80ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50506/0 (socket says 172.21.15.77:50506) 2023-11-26T07:19:58.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.133+0000 7f35affff640 1 -- 172.21.15.77:0/755458177 learned_addr learned my addr 172.21.15.77:0/755458177 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:58.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.133+0000 7f35b659c640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b80b2250 0x7f35b815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.133+0000 7f35b6d9d640 1 --2- 172.21.15.77:0/755458177 >> v2:172.21.15.159:3300/0 conn(0x7f35b80b2a70 0x7f35b815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.133+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898487699 0 0) 0x7f35b815ab80 con 0x7f35b80b2630 2023-11-26T07:19:58.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.133+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a4003520 con 0x7f35b80b2630 2023-11-26T07:19:58.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1824307278 0 0) 0x7f35a4003520 con 0x7f35b80b2630 2023-11-26T07:19:58.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b80b2250 msgr2=0x7f35b815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:58.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b80b2250 0x7f35b815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 >> v2:172.21.15.159:3300/0 conn(0x7f35b80b2a70 msgr2=0x7f35b815b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:58.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 --2- 172.21.15.77:0/755458177 >> v2:172.21.15.159:3300/0 conn(0x7f35b80b2a70 0x7f35b815b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b815e960 con 0x7f35b80b2630 2023-11-26T07:19:58.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f35a0001670 con 0x7f35b80b2630 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 >> v1:172.21.15.77:6789/0 conn(0x7f35b80b2630 legacy=0x7f35b80ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b80b2250 0x7f35a4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35a4003f40 0x7f35a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a4004d00 0x7f35a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b815e680 con 0x7f35a4004d00 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a400b980 con 0x7f35a4003f40 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a400bac0 con 0x7f35b80b2250 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b6d9d640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a4004d00 0x7f35a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.134+0000 7f35b659c640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b80b2250 0x7f35a4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.135+0000 7f35b6d9d640 1 -- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b80b2250 msgr2=0x7f35a4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.135+0000 7f35b6d9d640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35b80b2250 0x7f35a4003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.135+0000 7f35b6d9d640 1 -- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35a4003f40 msgr2=0x7f35a40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:58.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.135+0000 7f35affff640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35a4003f40 0x7f35a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.135+0000 7f35b6d9d640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35a4003f40 0x7f35a40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.135+0000 7f35b6d9d640 1 -- 172.21.15.77:0/755458177 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a4003520 con 0x7f35a4004d00 2023-11-26T07:19:58.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.135+0000 7f35affff640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35a4003f40 0x7f35a40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:58.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.136+0000 7f35b6d9d640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a4004d00 0x7f35a4005180 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e170 tx=0x7f35a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b36c654a553939c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:58.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.136+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b002cc20 con 0x7f35a4004d00 2023-11-26T07:19:58.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.136+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b000f040 con 0x7f35a4004d00 2023-11-26T07:19:58.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.136+0000 7f35b5d9b640 1 -- 172.21.15.77:0/755458177 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0034440 con 0x7f35a4004d00 2023-11-26T07:19:58.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.137+0000 7f35bcf4c640 1 -- 172.21.15.77:0/755458177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a4004d00 msgr2=0x7f35a4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.137+0000 7f35bcf4c640 1 --2- 172.21.15.77:0/755458177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a4004d00 0x7f35a4005180 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e170 tx=0x7f35a40057f0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.137+0000 7f35b6d9d640 1 -- 172.21.15.77:0/755458177 reap_dead start 2023-11-26T07:19:58.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.137+0000 7f35bcf4c640 1 -- 172.21.15.77:0/755458177 shutdown_connections 2023-11-26T07:19:58.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.137+0000 7f35bcf4c640 1 -- 172.21.15.77:0/755458177 >> 172.21.15.77:0/755458177 conn(0x7f35b806a920 msgr2=0x7f35b806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:58.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.137+0000 7f35bcf4c640 1 -- 172.21.15.77:0/755458177 shutdown_connections 2023-11-26T07:19:58.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.137+0000 7f35bcf4c640 1 -- 172.21.15.77:0/755458177 wait complete. 2023-11-26T07:19:58.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.139+0000 7f35bcf4c640 1 Processor -- start 2023-11-26T07:19:58.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.139+0000 7f35bcf4c640 1 -- start start 2023-11-26T07:19:58.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35bcf4c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35a4004d00 0x7f35b8167b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35bcf4c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35b8154900 0x7f35b8155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35bcf4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b8153cb0 0x7f35b8154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35bcf4c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b8154670 con 0x7f35b8153cb0 2023-11-26T07:19:58.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35bcf4c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b8157330 con 0x7f35b8154900 2023-11-26T07:19:58.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35bcf4c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b8156720 con 0x7f35a4004d00 2023-11-26T07:19:58.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35b6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b8153cb0 0x7f35b8154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35b6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b8153cb0 0x7f35b8154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50084/0 (socket says 172.21.15.77:50084) 2023-11-26T07:19:58.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35b6d9d640 1 -- 172.21.15.77:0/4182697250 learned_addr learned my addr 172.21.15.77:0/4182697250 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:58.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35b659c640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35a4004d00 0x7f35b8167b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35b6d9d640 1 -- 172.21.15.77:0/4182697250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35a4004d00 msgr2=0x7f35b8167b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35b6d9d640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35a4004d00 0x7f35b8167b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35b6d9d640 1 -- 172.21.15.77:0/4182697250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35b8154900 msgr2=0x7f35b8155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35affff640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35b8154900 0x7f35b8155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35b6d9d640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35b8154900 0x7f35b8155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.140+0000 7f35b6d9d640 1 -- 172.21.15.77:0/4182697250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b80cd7c0 con 0x7f35b8153cb0 2023-11-26T07:19:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.141+0000 7f35b6d9d640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b8153cb0 0x7f35b8154130 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e170 tx=0x7f35b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.141+0000 7f35aeffd640 1 -- 172.21.15.77:0/4182697250 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b002de90 con 0x7f35b8153cb0 2023-11-26T07:19:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.141+0000 7f35aeffd640 1 -- 172.21.15.77:0/4182697250 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0034b50 con 0x7f35b8153cb0 2023-11-26T07:19:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.141+0000 7f35aeffd640 1 -- 172.21.15.77:0/4182697250 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0003990 con 0x7f35b8153cb0 2023-11-26T07:19:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.141+0000 7f35bcf4c640 1 -- 172.21.15.77:0/4182697250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b8156a00 con 0x7f35b8153cb0 2023-11-26T07:19:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.141+0000 7f35bcf4c640 1 -- 172.21.15.77:0/4182697250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b8156fc0 con 0x7f35b8153cb0 2023-11-26T07:19:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.143+0000 7f35bcf4c640 1 -- 172.21.15.77:0/4182697250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b8157150 con 0x7f35b8153cb0 2023-11-26T07:19:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.143+0000 7f35aeffd640 1 -- 172.21.15.77:0/4182697250 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f35b003e440 con 0x7f35b8153cb0 2023-11-26T07:19:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.144+0000 7f35aeffd640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f359806b110 0x7f359806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.144+0000 7f35aeffd640 1 -- 172.21.15.77:0/4182697250 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f35b00ab7f0 con 0x7f35b8153cb0 2023-11-26T07:19:58.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.144+0000 7f35b659c640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f359806b110 0x7f359806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.145+0000 7f35b659c640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f359806b110 0x7f359806d5d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009a10 tx=0x7f35a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:58.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.149+0000 7f35aeffd640 1 -- 172.21.15.77:0/4182697250 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35b00765e0 con 0x7f35b8153cb0 2023-11-26T07:19:58.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.341+0000 7f35bcf4c640 1 -- 172.21.15.77:0/4182697250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35b8061a50 con 0x7f35b8153cb0 2023-11-26T07:19:58.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.343+0000 7f35aeffd640 1 -- 172.21.15.77:0/4182697250 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16610 (secure 0 0 0) 0x7f35b0079c00 con 0x7f35b8153cb0 2023-11-26T07:19:58.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:19:58.345 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":36,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:19:50.657201+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:42.084786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:42.792071+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:19:58.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.346+0000 7f35bcf4c640 1 -- 172.21.15.77:0/4182697250 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f359806b110 msgr2=0x7f359806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.346+0000 7f35bcf4c640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f359806b110 0x7f359806d5d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009a10 tx=0x7f35a8008040 comp rx=0 tx=0).stop 2023-11-26T07:19:58.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.346+0000 7f35bcf4c640 1 -- 172.21.15.77:0/4182697250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b8153cb0 msgr2=0x7f35b8154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.346+0000 7f35bcf4c640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b8153cb0 0x7f35b8154130 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e170 tx=0x7f35b0009750 comp rx=0 tx=0).stop 2023-11-26T07:19:58.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.347+0000 7f35bcf4c640 1 -- 172.21.15.77:0/4182697250 shutdown_connections 2023-11-26T07:19:58.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.347+0000 7f35bcf4c640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f359806b110 0x7f359806d5d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.347+0000 7f35bcf4c640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b8153cb0 0x7f35b8154130 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.347+0000 7f35bcf4c640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35b8154900 0x7f35b8155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.347+0000 7f35bcf4c640 1 --2- 172.21.15.77:0/4182697250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35a4004d00 0x7f35b8167b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.347+0000 7f35bcf4c640 1 -- 172.21.15.77:0/4182697250 >> 172.21.15.77:0/4182697250 conn(0x7f35b806a920 msgr2=0x7f35b80cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:58.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.347+0000 7f35bcf4c640 1 -- 172.21.15.77:0/4182697250 shutdown_connections 2023-11-26T07:19:58.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.347+0000 7f35bcf4c640 1 -- 172.21.15.77:0/4182697250 wait complete. 2023-11-26T07:19:58.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:42.084786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:42.792071+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:19:58.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:19:58.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.572+0000 7f7ccffc9640 1 Processor -- start 2023-11-26T07:19:58.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.572+0000 7f7ccffc9640 1 -- start start 2023-11-26T07:19:58.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.574+0000 7f7ccffc9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7cc80c59b0 0x7f7cc8166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.574+0000 7f7ccffc9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc80c5dc0 con 0x7f7cc80cc0f0 2023-11-26T07:19:58.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.574+0000 7f7ccffc9640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc815eea0 con 0x7f7cc815b440 2023-11-26T07:19:58.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.574+0000 7f7ccffc9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc815b820 con 0x7f7cc80c59b0 2023-11-26T07:19:58.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.574+0000 7f7ccd564640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7cc80cc0f0 0x7f7cc80c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50512/0 (socket says 172.21.15.77:50512) 2023-11-26T07:19:58.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.574+0000 7f7ccd564640 1 -- 172.21.15.77:0/3621628835 learned_addr learned my addr 172.21.15.77:0/3621628835 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:58.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.574+0000 7f7cce566640 1 --2- 172.21.15.77:0/3621628835 >> v2:172.21.15.77:3300/0 conn(0x7f7cc80c59b0 0x7f7cc8166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.574+0000 7f7cccd63640 1 -- 172.21.15.77:0/3621628835 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521044453 0 0) 0x7f7cc80c5dc0 con 0x7f7cc80cc0f0 2023-11-26T07:19:58.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.575+0000 7f7cccd63640 1 -- 172.21.15.77:0/3621628835 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb4003520 con 0x7f7cc80cc0f0 2023-11-26T07:19:58.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.575+0000 7f7cce566640 1 -- 172.21.15.77:0/3621628835 >> v1:172.21.15.159:6789/0 conn(0x7f7cc815b440 legacy=0x7f7cc80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:58.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.575+0000 7f7cce566640 1 -- 172.21.15.77:0/3621628835 >> v1:172.21.15.77:6789/0 conn(0x7f7cc80cc0f0 legacy=0x7f7cc80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.575+0000 7f7cce566640 1 -- 172.21.15.77:0/3621628835 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc806d600 con 0x7f7cc80c59b0 2023-11-26T07:19:58.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.576+0000 7f7cce566640 1 --2- 172.21.15.77:0/3621628835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cc80c59b0 0x7f7cc8166230 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009d90 tx=0x7f7cc002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9ca089e970cdcf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:58.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.576+0000 7f7cccd63640 1 -- 172.21.15.77:0/3621628835 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc002cbd0 con 0x7f7cc80c59b0 2023-11-26T07:19:58.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.576+0000 7f7cccd63640 1 -- 172.21.15.77:0/3621628835 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc002cd30 con 0x7f7cc80c59b0 2023-11-26T07:19:58.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.576+0000 7f7cccd63640 1 -- 172.21.15.77:0/3621628835 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc002cea0 con 0x7f7cc80c59b0 2023-11-26T07:19:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.576+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3621628835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cc80c59b0 msgr2=0x7f7cc8166230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.576+0000 7f7ccffc9640 1 --2- 172.21.15.77:0/3621628835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cc80c59b0 0x7f7cc8166230 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009d90 tx=0x7f7cc002be20 comp rx=0 tx=0).stop 2023-11-26T07:19:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.577+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3621628835 shutdown_connections 2023-11-26T07:19:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.577+0000 7f7ccffc9640 1 --2- 172.21.15.77:0/3621628835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cc80c59b0 0x7f7cc8166230 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.577+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3621628835 >> 172.21.15.77:0/3621628835 conn(0x7f7cc80b0c50 msgr2=0x7f7cc80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.577+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3621628835 shutdown_connections 2023-11-26T07:19:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.577+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3621628835 wait complete. 2023-11-26T07:19:58.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.578+0000 7f7ccffc9640 1 Processor -- start 2023-11-26T07:19:58.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.579+0000 7f7ccffc9640 1 -- start start 2023-11-26T07:19:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.579+0000 7f7ccffc9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cc80c59b0 0x7f7cc80cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.579+0000 7f7ccffc9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc80cc0f0 0x7f7cc80cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.579+0000 7f7ccffc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cc815b440 0x7f7cc8154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.579+0000 7f7ccffc9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc80ccbd0 con 0x7f7cc815b440 2023-11-26T07:19:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.579+0000 7f7ccffc9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc80ce780 con 0x7f7cc80cc0f0 2023-11-26T07:19:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.579+0000 7f7ccffc9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc80cea60 con 0x7f7cc80c59b0 2023-11-26T07:19:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.580+0000 7f7cce566640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cc815b440 0x7f7cc8154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.580+0000 7f7cce566640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cc815b440 0x7f7cc8154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50104/0 (socket says 172.21.15.77:50104) 2023-11-26T07:19:58.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.580+0000 7f7cce566640 1 -- 172.21.15.77:0/3491448007 learned_addr learned my addr 172.21.15.77:0/3491448007 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.580+0000 7f7cce566640 1 -- 172.21.15.77:0/3491448007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cc80c59b0 msgr2=0x7f7cc80cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.580+0000 7f7cce566640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cc80c59b0 0x7f7cc80cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.580+0000 7f7cce566640 1 -- 172.21.15.77:0/3491448007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc80cc0f0 msgr2=0x7f7cc80cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.580+0000 7f7cce566640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc80cc0f0 0x7f7cc80cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.580+0000 7f7cce566640 1 -- 172.21.15.77:0/3491448007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0009a70 con 0x7f7cc815b440 2023-11-26T07:19:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.580+0000 7f7cce566640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cc815b440 0x7f7cc8154510 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009d90 tx=0x7f7cc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.581+0000 7f7cbe7fc640 1 -- 172.21.15.77:0/3491448007 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc002cea0 con 0x7f7cc815b440 2023-11-26T07:19:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.581+0000 7f7cbe7fc640 1 -- 172.21.15.77:0/3491448007 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc0040650 con 0x7f7cc815b440 2023-11-26T07:19:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.581+0000 7f7cbe7fc640 1 -- 172.21.15.77:0/3491448007 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0040a00 con 0x7f7cc815b440 2023-11-26T07:19:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.581+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3491448007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc80cce20 con 0x7f7cc815b440 2023-11-26T07:19:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.581+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3491448007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc80ce3c0 con 0x7f7cc815b440 2023-11-26T07:19:58.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.582+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3491448007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc80ce550 con 0x7f7cc815b440 2023-11-26T07:19:58.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.583+0000 7f7cbe7fc640 1 -- 172.21.15.77:0/3491448007 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f7cc0040b60 con 0x7f7cc815b440 2023-11-26T07:19:58.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.584+0000 7f7cbe7fc640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cac06b110 0x7f7cac06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:58.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.584+0000 7f7cbe7fc640 1 -- 172.21.15.77:0/3491448007 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f7cc00ac7a0 con 0x7f7cc815b440 2023-11-26T07:19:58.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.584+0000 7f7ccdd65640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cac06b110 0x7f7cac06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:58.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.585+0000 7f7ccdd65640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cac06b110 0x7f7cac06d5d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4006fd0 tx=0x7f7cc4006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:58.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.588+0000 7f7cbe7fc640 1 -- 172.21.15.77:0/3491448007 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7cc0077510 con 0x7f7cc815b440 2023-11-26T07:19:58.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.780+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3491448007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7cc80cd2e0 con 0x7f7cc815b440 2023-11-26T07:19:58.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.781+0000 7f7cbe7fc640 1 -- 172.21.15.77:0/3491448007 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7cc0009450 con 0x7f7cc815b440 2023-11-26T07:19:58.783 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:19:58.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3491448007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cac06b110 msgr2=0x7f7cac06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cac06b110 0x7f7cac06d5d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4006fd0 tx=0x7f7cc4006bc0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3491448007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cc815b440 msgr2=0x7f7cc8154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cc815b440 0x7f7cc8154510 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009d90 tx=0x7f7cc0004a40 comp rx=0 tx=0).stop 2023-11-26T07:19:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3491448007 shutdown_connections 2023-11-26T07:19:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7cac06b110 0x7f7cac06d5d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cc815b440 0x7f7cc8154510 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cc80cc0f0 0x7f7cc80cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 --2- 172.21.15.77:0/3491448007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cc80c59b0 0x7f7cc80cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3491448007 >> 172.21.15.77:0/3491448007 conn(0x7f7cc80b0c50 msgr2=0x7f7cc80cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3491448007 shutdown_connections 2023-11-26T07:19:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:58.784+0000 7f7ccffc9640 1 -- 172.21.15.77:0/3491448007 wait complete. 2023-11-26T07:19:58.805 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:19:59.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.023+0000 7ff7a962b640 1 Processor -- start 2023-11-26T07:19:59.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.023+0000 7ff7a962b640 1 -- start start 2023-11-26T07:19:59.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.025+0000 7ff7a962b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7a415b440 0x7ff7a40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.025+0000 7ff7a962b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff7a40cbf20 0x7ff7a40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.025+0000 7ff7a962b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a415eea0 con 0x7ff7a40c57e0 2023-11-26T07:19:59.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.025+0000 7ff7a962b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a40cc3d0 con 0x7ff7a415b440 2023-11-26T07:19:59.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.025+0000 7ff7a962b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a415b820 con 0x7ff7a40cbf20 2023-11-26T07:19:59.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.025+0000 7ff7a2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7a415b440 0x7ff7a40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.025+0000 7ff7a37fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff7a40c57e0 0x7ff7a40c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50516/0 (socket says 172.21.15.77:50516) 2023-11-26T07:19:59.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.025+0000 7ff7a37fe640 1 -- 172.21.15.77:0/8389230 learned_addr learned my addr 172.21.15.77:0/8389230 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:59.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.026+0000 7ff79bfff640 1 --2- 172.21.15.77:0/8389230 >> v2:172.21.15.159:3300/0 conn(0x7ff7a40cbf20 0x7ff7a40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.026+0000 7ff7a27fc640 1 -- 172.21.15.77:0/8389230 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833513357 0 0) 0x7ff7a415eea0 con 0x7ff7a40c57e0 2023-11-26T07:19:59.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.026+0000 7ff7a2ffd640 1 -- 172.21.15.77:0/8389230 >> v2:172.21.15.159:3300/0 conn(0x7ff7a40cbf20 msgr2=0x7ff7a40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:59.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.026+0000 7ff7a2ffd640 1 --2- 172.21.15.77:0/8389230 >> v2:172.21.15.159:3300/0 conn(0x7ff7a40cbf20 0x7ff7a40c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.026+0000 7ff7a2ffd640 1 -- 172.21.15.77:0/8389230 >> v1:172.21.15.77:6789/0 conn(0x7ff7a40c57e0 legacy=0x7ff7a40c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.026+0000 7ff7a2ffd640 1 -- 172.21.15.77:0/8389230 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a406d600 con 0x7ff7a415b440 2023-11-26T07:19:59.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.027+0000 7ff7a2ffd640 1 --2- 172.21.15.77:0/8389230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a415b440 0x7ff7a40cb9e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff7a406e890 tx=0x7ff79402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cc8a0457c34c89 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:59.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.027+0000 7ff7a27fc640 1 -- 172.21.15.77:0/8389230 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79402e070 con 0x7ff7a415b440 2023-11-26T07:19:59.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.027+0000 7ff7a27fc640 1 -- 172.21.15.77:0/8389230 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7940315a0 con 0x7ff7a415b440 2023-11-26T07:19:59.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.027+0000 7ff7a27fc640 1 -- 172.21.15.77:0/8389230 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794031930 con 0x7ff7a415b440 2023-11-26T07:19:59.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.028+0000 7ff7a962b640 1 -- 172.21.15.77:0/8389230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a415b440 msgr2=0x7ff7a40cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.028+0000 7ff7a962b640 1 --2- 172.21.15.77:0/8389230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a415b440 0x7ff7a40cb9e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff7a406e890 tx=0x7ff79402b840 comp rx=0 tx=0).stop 2023-11-26T07:19:59.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.028+0000 7ff7a962b640 1 -- 172.21.15.77:0/8389230 shutdown_connections 2023-11-26T07:19:59.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.028+0000 7ff7a962b640 1 --2- 172.21.15.77:0/8389230 >> v2:172.21.15.159:3300/0 conn(0x7ff7a40cbf20 0x7ff7a40c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.028+0000 7ff7a962b640 1 --2- 172.21.15.77:0/8389230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a415b440 0x7ff7a40cb9e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.028+0000 7ff7a962b640 1 -- 172.21.15.77:0/8389230 >> 172.21.15.77:0/8389230 conn(0x7ff7a40b0c50 msgr2=0x7ff7a40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:59.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.028+0000 7ff7a962b640 1 -- 172.21.15.77:0/8389230 shutdown_connections 2023-11-26T07:19:59.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.028+0000 7ff7a962b640 1 -- 172.21.15.77:0/8389230 wait complete. 2023-11-26T07:19:59.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.030+0000 7ff7a962b640 1 Processor -- start 2023-11-26T07:19:59.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.030+0000 7ff7a962b640 1 -- start start 2023-11-26T07:19:59.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.031+0000 7ff7a962b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7a40c57e0 0x7ff7a4154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.031+0000 7ff7a962b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7a40cbf20 0x7ff7a40c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.031+0000 7ff7a962b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a415b440 0x7ff7a40c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.031+0000 7ff7a962b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40cd900 con 0x7ff7a415b440 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.031+0000 7ff7a962b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40cdbe0 con 0x7ff7a40cbf20 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.031+0000 7ff7a962b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40cdec0 con 0x7ff7a40c57e0 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.031+0000 7ff7a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a415b440 0x7ff7a40c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.031+0000 7ff7a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a415b440 0x7ff7a40c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50124/0 (socket says 172.21.15.77:50124) 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.032+0000 7ff7a37fe640 1 -- 172.21.15.77:0/2847364884 learned_addr learned my addr 172.21.15.77:0/2847364884 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.032+0000 7ff7a2ffd640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7a40c57e0 0x7ff7a4154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.032+0000 7ff79bfff640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7a40cbf20 0x7ff7a40c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.032+0000 7ff7a37fe640 1 -- 172.21.15.77:0/2847364884 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7a40c57e0 msgr2=0x7ff7a4154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.032+0000 7ff7a37fe640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7a40c57e0 0x7ff7a4154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.032+0000 7ff7a37fe640 1 -- 172.21.15.77:0/2847364884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7a40cbf20 msgr2=0x7ff7a40c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.032+0000 7ff7a37fe640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7a40cbf20 0x7ff7a40c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.032+0000 7ff7a37fe640 1 -- 172.21.15.77:0/2847364884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794009400 con 0x7ff7a415b440 2023-11-26T07:19:59.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.032+0000 7ff79bfff640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7a40cbf20 0x7ff7a40c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:59.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.032+0000 7ff7a37fe640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a415b440 0x7ff7a40c6e90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c7e0 tx=0x7ff79c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:59.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.033+0000 7ff79b7fe640 1 -- 172.21.15.77:0/2847364884 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c00a640 con 0x7ff7a415b440 2023-11-26T07:19:59.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.033+0000 7ff79b7fe640 1 -- 172.21.15.77:0/2847364884 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c00a7c0 con 0x7ff7a415b440 2023-11-26T07:19:59.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.033+0000 7ff7a962b640 1 -- 172.21.15.77:0/2847364884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a40ce1a0 con 0x7ff7a415b440 2023-11-26T07:19:59.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.033+0000 7ff79b7fe640 1 -- 172.21.15.77:0/2847364884 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c00ab70 con 0x7ff7a415b440 2023-11-26T07:19:59.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.033+0000 7ff7a962b640 1 -- 172.21.15.77:0/2847364884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a4155030 con 0x7ff7a415b440 2023-11-26T07:19:59.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.034+0000 7ff7a962b640 1 -- 172.21.15.77:0/2847364884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a40ce6c0 con 0x7ff7a415b440 2023-11-26T07:19:59.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.035+0000 7ff79b7fe640 1 -- 172.21.15.77:0/2847364884 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7ff79c00acd0 con 0x7ff7a415b440 2023-11-26T07:19:59.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.036+0000 7ff79b7fe640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff78406b110 0x7ff78406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.037+0000 7ff79b7fe640 1 -- 172.21.15.77:0/2847364884 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7ff79c0893b0 con 0x7ff7a415b440 2023-11-26T07:19:59.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.037+0000 7ff7a2ffd640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff78406b110 0x7ff78406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.037+0000 7ff7a2ffd640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff78406b110 0x7ff78406d5d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff794036000 tx=0x7ff79403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:59.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.041+0000 7ff79b7fe640 1 -- 172.21.15.77:0/2847364884 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff7a40ce6c0 con 0x7ff7a415b440 2023-11-26T07:19:59.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.231+0000 7ff7a962b640 1 -- 172.21.15.77:0/2847364884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7a40ce6c0 con 0x7ff7a415b440 2023-11-26T07:19:59.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.231+0000 7ff79b7fe640 1 -- 172.21.15.77:0/2847364884 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff79c018020 con 0x7ff7a415b440 2023-11-26T07:19:59.233 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:19:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 -- 172.21.15.77:0/2847364884 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff78406b110 msgr2=0x7ff78406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff78406b110 0x7ff78406d5d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff794036000 tx=0x7ff79403d040 comp rx=0 tx=0).stop 2023-11-26T07:19:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 -- 172.21.15.77:0/2847364884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a415b440 msgr2=0x7ff7a40c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a415b440 0x7ff7a40c6e90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c7e0 tx=0x7ff79c00cca0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 -- 172.21.15.77:0/2847364884 shutdown_connections 2023-11-26T07:19:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff78406b110 0x7ff78406d5d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a415b440 0x7ff7a40c6e90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7a40cbf20 0x7ff7a40c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 --2- 172.21.15.77:0/2847364884 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7a40c57e0 0x7ff7a4154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 -- 172.21.15.77:0/2847364884 >> 172.21.15.77:0/2847364884 conn(0x7ff7a40b0c50 msgr2=0x7ff7a4155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 -- 172.21.15.77:0/2847364884 shutdown_connections 2023-11-26T07:19:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.234+0000 7ff7a962b640 1 -- 172.21.15.77:0/2847364884 wait complete. 2023-11-26T07:19:59.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:19:59.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.468+0000 7f683cf1d640 1 Processor -- start 2023-11-26T07:19:59.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.468+0000 7f683cf1d640 1 -- start start 2023-11-26T07:19:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.470+0000 7f683cf1d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6838072160 0x7f683815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.470+0000 7f683cf1d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f68380c49f0 0x7f683806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.470+0000 7f683cf1d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f683806dc40 0x7f68380cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.470+0000 7f683cf1d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683806e0f0 con 0x7f68380c49f0 2023-11-26T07:19:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.470+0000 7f683cf1d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683815ec90 con 0x7f683806dc40 2023-11-26T07:19:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.470+0000 7f683cf1d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68380cd530 con 0x7f6838072160 2023-11-26T07:19:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.470+0000 7f6835d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f68380c49f0 0x7f683806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.470+0000 7f6835d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f68380c49f0 0x7f683806d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50128/0 (socket says 172.21.15.77:50128) 2023-11-26T07:19:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.470+0000 7f6835d9b640 1 -- 172.21.15.77:0/278506633 learned_addr learned my addr 172.21.15.77:0/278506633 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.471+0000 7f683659c640 1 --2- 172.21.15.77:0/278506633 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6838072160 0x7f683815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.471+0000 7f6836d9d640 1 --2- 172.21.15.77:0/278506633 >> v2:172.21.15.159:3300/0 conn(0x7f683806dc40 0x7f68380cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.471+0000 7f6835d9b640 1 -- 172.21.15.77:0/278506633 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6838072160 msgr2=0x7f683815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.471+0000 7f6835d9b640 1 --2- 172.21.15.77:0/278506633 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6838072160 0x7f683815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.471+0000 7f6835d9b640 1 -- 172.21.15.77:0/278506633 >> v2:172.21.15.159:3300/0 conn(0x7f683806dc40 msgr2=0x7f68380cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.471+0000 7f6835d9b640 1 --2- 172.21.15.77:0/278506633 >> v2:172.21.15.159:3300/0 conn(0x7f683806dc40 0x7f68380cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.471+0000 7f6835d9b640 1 -- 172.21.15.77:0/278506633 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68380c4ed0 con 0x7f68380c49f0 2023-11-26T07:19:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.472+0000 7f6835d9b640 1 --2- 172.21.15.77:0/278506633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68380c49f0 0x7f683806d700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6838072a30 tx=0x7f682002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc7ab26a84d8302 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.472+0000 7f683559a640 1 -- 172.21.15.77:0/278506633 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820031870 con 0x7f68380c49f0 2023-11-26T07:19:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.472+0000 7f683559a640 1 -- 172.21.15.77:0/278506633 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68200319d0 con 0x7f68380c49f0 2023-11-26T07:19:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.472+0000 7f683559a640 1 -- 172.21.15.77:0/278506633 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820031d60 con 0x7f68380c49f0 2023-11-26T07:19:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.473+0000 7f683cf1d640 1 -- 172.21.15.77:0/278506633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68380c49f0 msgr2=0x7f683806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.473+0000 7f683cf1d640 1 --2- 172.21.15.77:0/278506633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68380c49f0 0x7f683806d700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6838072a30 tx=0x7f682002b910 comp rx=0 tx=0).stop 2023-11-26T07:19:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.473+0000 7f683cf1d640 1 -- 172.21.15.77:0/278506633 shutdown_connections 2023-11-26T07:19:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.473+0000 7f683cf1d640 1 --2- 172.21.15.77:0/278506633 >> v2:172.21.15.159:3300/0 conn(0x7f683806dc40 0x7f68380cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.473+0000 7f683cf1d640 1 --2- 172.21.15.77:0/278506633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68380c49f0 0x7f683806d700 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.473+0000 7f683cf1d640 1 --2- 172.21.15.77:0/278506633 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6838072160 0x7f683815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.473+0000 7f683cf1d640 1 -- 172.21.15.77:0/278506633 >> 172.21.15.77:0/278506633 conn(0x7f68380b0c50 msgr2=0x7f68380b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.473+0000 7f683cf1d640 1 -- 172.21.15.77:0/278506633 shutdown_connections 2023-11-26T07:19:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.473+0000 7f683cf1d640 1 -- 172.21.15.77:0/278506633 wait complete. 2023-11-26T07:19:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.475+0000 7f683cf1d640 1 Processor -- start 2023-11-26T07:19:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.475+0000 7f683cf1d640 1 -- start start 2023-11-26T07:19:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.476+0000 7f683cf1d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f683806dc40 0x7f6838148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.476+0000 7f683cf1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6838072160 0x7f6838156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.476+0000 7f683cf1d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68380c49f0 0x7f6838071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.476+0000 7f683cf1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683815b5a0 con 0x7f6838072160 2023-11-26T07:19:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.476+0000 7f683cf1d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68381490f0 con 0x7f683806dc40 2023-11-26T07:19:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.476+0000 7f683cf1d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68381575c0 con 0x7f68380c49f0 2023-11-26T07:19:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.476+0000 7f6835d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6838072160 0x7f6838156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f6835d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6838072160 0x7f6838156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50136/0 (socket says 172.21.15.77:50136) 2023-11-26T07:19:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f6835d9b640 1 -- 172.21.15.77:0/3303690568 learned_addr learned my addr 172.21.15.77:0/3303690568 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f6835d9b640 1 -- 172.21.15.77:0/3303690568 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68380c49f0 msgr2=0x7f6838071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f6835d9b640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68380c49f0 0x7f6838071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f6835d9b640 1 -- 172.21.15.77:0/3303690568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f683806dc40 msgr2=0x7f6838148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f6835d9b640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f683806dc40 0x7f6838148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f6835d9b640 1 -- 172.21.15.77:0/3303690568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68200094d0 con 0x7f6838072160 2023-11-26T07:19:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f6835d9b640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6838072160 0x7f6838156cc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f682002b950 tx=0x7f68200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f682effd640 1 -- 172.21.15.77:0/3303690568 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682003ad30 con 0x7f6838072160 2023-11-26T07:19:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f682effd640 1 -- 172.21.15.77:0/3303690568 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68200443f0 con 0x7f6838072160 2023-11-26T07:19:59.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f683cf1d640 1 -- 172.21.15.77:0/3303690568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68381578a0 con 0x7f6838072160 2023-11-26T07:19:59.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.477+0000 7f682effd640 1 -- 172.21.15.77:0/3303690568 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68200447a0 con 0x7f6838072160 2023-11-26T07:19:59.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.478+0000 7f683cf1d640 1 -- 172.21.15.77:0/3303690568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6838157e60 con 0x7f6838072160 2023-11-26T07:19:59.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.479+0000 7f683cf1d640 1 -- 172.21.15.77:0/3303690568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683804e8b0 con 0x7f6838072160 2023-11-26T07:19:59.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.480+0000 7f682effd640 1 -- 172.21.15.77:0/3303690568 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f682004d450 con 0x7f6838072160 2023-11-26T07:19:59.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.480+0000 7f682effd640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f681806b110 0x7f681806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.481+0000 7f682effd640 1 -- 172.21.15.77:0/3303690568 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f682002d040 con 0x7f6838072160 2023-11-26T07:19:59.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.481+0000 7f683659c640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f681806b110 0x7f681806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.482+0000 7f683659c640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f681806b110 0x7f681806d5d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f68280070b0 tx=0x7f6828007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:59.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.485+0000 7f682effd640 1 -- 172.21.15.77:0/3303690568 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6820076d50 con 0x7f6838072160 2023-11-26T07:19:59.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.673+0000 7f683cf1d640 1 -- 172.21.15.77:0/3303690568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f683815b6e0 con 0x7f6838072160 2023-11-26T07:19:59.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.674+0000 7f682effd640 1 -- 172.21.15.77:0/3303690568 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6820035020 con 0x7f6838072160 2023-11-26T07:19:59.675 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:19:59.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 -- 172.21.15.77:0/3303690568 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f681806b110 msgr2=0x7f681806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f681806b110 0x7f681806d5d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f68280070b0 tx=0x7f6828007040 comp rx=0 tx=0).stop 2023-11-26T07:19:59.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 -- 172.21.15.77:0/3303690568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6838072160 msgr2=0x7f6838156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6838072160 0x7f6838156cc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f682002b950 tx=0x7f68200046c0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 -- 172.21.15.77:0/3303690568 shutdown_connections 2023-11-26T07:19:59.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f681806b110 0x7f681806d5d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68380c49f0 0x7f6838071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6838072160 0x7f6838156cc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 --2- 172.21.15.77:0/3303690568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f683806dc40 0x7f6838148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 -- 172.21.15.77:0/3303690568 >> 172.21.15.77:0/3303690568 conn(0x7f68380b0c50 msgr2=0x7f68380afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:59.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 -- 172.21.15.77:0/3303690568 shutdown_connections 2023-11-26T07:19:59.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.676+0000 7f683cf1d640 1 -- 172.21.15.77:0/3303690568 wait complete. 2023-11-26T07:19:59.697 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:19:59.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.913+0000 7f9a1ef27640 1 Processor -- start 2023-11-26T07:19:59.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.914+0000 7f9a1ef27640 1 -- start start 2023-11-26T07:19:59.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.915+0000 7f9a1ef27640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9a1815c410 0x7f9a1815f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.915+0000 7f9a1ef27640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1815bf80 con 0x7f9a18144b30 2023-11-26T07:19:59.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.915+0000 7f9a1ef27640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a180b1560 con 0x7f9a180b1de0 2023-11-26T07:19:59.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.915+0000 7f9a1ef27640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a180b1280 con 0x7f9a1815c410 2023-11-26T07:19:59.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.915+0000 7f9a1d724640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9a1815c410 0x7f9a1815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.916+0000 7f9a1df25640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9a18144b30 0x7f9a180b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50532/0 (socket says 172.21.15.77:50532) 2023-11-26T07:19:59.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.916+0000 7f9a1df25640 1 -- 172.21.15.77:0/2787775441 learned_addr learned my addr 172.21.15.77:0/2787775441 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:19:59.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.916+0000 7f9a1d724640 1 -- 172.21.15.77:0/2787775441 >> v1:172.21.15.159:6789/0 conn(0x7f9a180b1de0 legacy=0x7f9a180b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:59.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.916+0000 7f9a1d724640 1 -- 172.21.15.77:0/2787775441 >> v1:172.21.15.77:6789/0 conn(0x7f9a18144b30 legacy=0x7f9a180b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.916+0000 7f9a1d724640 1 -- 172.21.15.77:0/2787775441 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1815b930 con 0x7f9a1815c410 2023-11-26T07:19:59.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.917+0000 7f9a1d724640 1 --2- 172.21.15.77:0/2787775441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a1815c410 0x7f9a1815f920 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9a080097a0 tx=0x7f9a0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a04d6589f15ed7b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:59.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.917+0000 7f9a1cf23640 1 -- 172.21.15.77:0/2787775441 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08031830 con 0x7f9a1815c410 2023-11-26T07:19:59.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.917+0000 7f9a1cf23640 1 -- 172.21.15.77:0/2787775441 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08031990 con 0x7f9a1815c410 2023-11-26T07:19:59.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.917+0000 7f9a1cf23640 1 -- 172.21.15.77:0/2787775441 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08031d20 con 0x7f9a1815c410 2023-11-26T07:19:59.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.918+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2787775441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a1815c410 msgr2=0x7f9a1815f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.918+0000 7f9a1ef27640 1 --2- 172.21.15.77:0/2787775441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a1815c410 0x7f9a1815f920 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9a080097a0 tx=0x7f9a0802b8d0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.918+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2787775441 shutdown_connections 2023-11-26T07:19:59.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.918+0000 7f9a1ef27640 1 --2- 172.21.15.77:0/2787775441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a1815c410 0x7f9a1815f920 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.918+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2787775441 >> 172.21.15.77:0/2787775441 conn(0x7f9a180cb830 msgr2=0x7f9a180cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:59.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.918+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2787775441 shutdown_connections 2023-11-26T07:19:59.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.918+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2787775441 wait complete. 2023-11-26T07:19:59.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.920+0000 7f9a1ef27640 1 Processor -- start 2023-11-26T07:19:59.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.920+0000 7f9a1ef27640 1 -- start start 2023-11-26T07:19:59.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.921+0000 7f9a1ef27640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a180b1de0 0x7f9a180c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.921+0000 7f9a1ef27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a18144b30 0x7f9a180c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.921+0000 7f9a1ef27640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1815c410 0x7f9a18141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.921+0000 7f9a1ef27640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180c45f0 con 0x7f9a18144b30 2023-11-26T07:19:59.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.921+0000 7f9a1ef27640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180c96d0 con 0x7f9a1815c410 2023-11-26T07:19:59.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.921+0000 7f9a1ef27640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180caa00 con 0x7f9a180b1de0 2023-11-26T07:19:59.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.921+0000 7f9a1d724640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a18144b30 0x7f9a180c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.921+0000 7f9a1d724640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a18144b30 0x7f9a180c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50158/0 (socket says 172.21.15.77:50158) 2023-11-26T07:19:59.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.921+0000 7f9a1d724640 1 -- 172.21.15.77:0/2227777809 learned_addr learned my addr 172.21.15.77:0/2227777809 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:19:59.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.922+0000 7f9a1df25640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a180b1de0 0x7f9a180c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.922+0000 7f9a1d724640 1 -- 172.21.15.77:0/2227777809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a180b1de0 msgr2=0x7f9a180c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.922+0000 7f9a1d724640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a180b1de0 0x7f9a180c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.922+0000 7f9a1d724640 1 -- 172.21.15.77:0/2227777809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1815c410 msgr2=0x7f9a18141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:59.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.922+0000 7f9a1d724640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1815c410 0x7f9a18141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:59.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.922+0000 7f9a1d724640 1 -- 172.21.15.77:0/2227777809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08009400 con 0x7f9a18144b30 2023-11-26T07:19:59.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.922+0000 7f9a1d724640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a18144b30 0x7f9a180c9190 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098c0 tx=0x7f9a080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:59.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.922+0000 7f9a0e7fc640 1 -- 172.21.15.77:0/2227777809 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0803ba70 con 0x7f9a18144b30 2023-11-26T07:19:59.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.922+0000 7f9a0e7fc640 1 -- 172.21.15.77:0/2227777809 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0803bbf0 con 0x7f9a18144b30 2023-11-26T07:19:59.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.922+0000 7f9a0e7fc640 1 -- 172.21.15.77:0/2227777809 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a080453f0 con 0x7f9a18144b30 2023-11-26T07:19:59.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.922+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2227777809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a180c9960 con 0x7f9a18144b30 2023-11-26T07:19:59.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.923+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2227777809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a180c9f20 con 0x7f9a18144b30 2023-11-26T07:19:59.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.924+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2227777809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1804e840 con 0x7f9a18144b30 2023-11-26T07:19:59.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.925+0000 7f9a0e7fc640 1 -- 172.21.15.77:0/2227777809 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f9a0804e450 con 0x7f9a18144b30 2023-11-26T07:19:59.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.925+0000 7f9a0e7fc640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f99fc06b140 0x7f99fc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:59.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.926+0000 7f9a0e7fc640 1 -- 172.21.15.77:0/2227777809 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f9a080abdf0 con 0x7f9a18144b30 2023-11-26T07:19:59.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.926+0000 7f9a1df25640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f99fc06b140 0x7f99fc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:59.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.926+0000 7f9a1df25640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f99fc06b140 0x7f99fc06d600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9a14005880 tx=0x7f9a14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:19:59.930+0000 7f9a0e7fc640 1 -- 172.21.15.77:0/2227777809 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a08076b40 con 0x7f9a18144b30 2023-11-26T07:20:00.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.155+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2227777809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a1806d860 con 0x7f9a18144b30 2023-11-26T07:20:00.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.156+0000 7f9a0e7fc640 1 -- 172.21.15.77:0/2227777809 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f9a08035020 con 0x7f9a18144b30 2023-11-26T07:20:00.158 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:00.158 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3806365439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3806365439},{"type":"v1","addr":"172.21.15.77:6836","nonce":3806365439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/694008676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":694008676},{"type":"v1","addr":"172.21.15.77:6837","nonce":694008676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4705,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/4096574472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4096574472},{"type":"v1","addr":"172.21.15.159:6834","nonce":4096574472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:43.790536+0000","modified":"2023-11-26T07:18:47.129568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6835/360332813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":360332813},{"type":"v1","addr":"172.21.15.159:6835","nonce":360332813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:20:00.158 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-11-26T07:20:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.158+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2227777809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f99fc06b140 msgr2=0x7f99fc06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.158+0000 7f9a1ef27640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f99fc06b140 0x7f99fc06d600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9a14005880 tx=0x7f9a14009040 comp rx=0 tx=0).stop 2023-11-26T07:20:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.158+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2227777809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a18144b30 msgr2=0x7f9a180c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.158+0000 7f9a1ef27640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a18144b30 0x7f9a180c9190 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098c0 tx=0x7f9a080046c0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.159+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2227777809 shutdown_connections 2023-11-26T07:20:00.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.159+0000 7f9a1ef27640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f99fc06b140 0x7f99fc06d600 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.159+0000 7f9a1ef27640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a1815c410 0x7f9a18141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.159+0000 7f9a1ef27640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a18144b30 0x7f9a180c9190 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.159+0000 7f9a1ef27640 1 --2- 172.21.15.77:0/2227777809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a180b1de0 0x7f9a180c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.159+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2227777809 >> 172.21.15.77:0/2227777809 conn(0x7f9a180cb830 msgr2=0x7f9a180cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:00.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.159+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2227777809 shutdown_connections 2023-11-26T07:20:00.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.159+0000 7f9a1ef27640 1 -- 172.21.15.77:0/2227777809 wait complete. 2023-11-26T07:20:00.180 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:00.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.391+0000 7fe7460e7640 1 Processor -- start 2023-11-26T07:20:00.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.391+0000 7fe7460e7640 1 -- start start 2023-11-26T07:20:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.392+0000 7fe7460e7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400cf450 0x7fe7400cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.392+0000 7fe7460e7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7400cece0 con 0x7fe7400cdfb0 2023-11-26T07:20:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.393+0000 7fe7460e7640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74006d040 con 0x7fe74015c7f0 2023-11-26T07:20:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.393+0000 7fe7460e7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe740156010 con 0x7fe7400cf450 2023-11-26T07:20:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.393+0000 7fe73ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe7400cdfb0 0x7fe7400ce440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50534/0 (socket says 172.21.15.77:50534) 2023-11-26T07:20:00.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.393+0000 7fe73ffff640 1 -- 172.21.15.77:0/3671196494 learned_addr learned my addr 172.21.15.77:0/3671196494 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:00.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.393+0000 7fe73effd640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400cf450 0x7fe7400cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:00.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.393+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145003918 0 0) 0x7fe7400cece0 con 0x7fe7400cdfb0 2023-11-26T07:20:00.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.393+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe728003520 con 0x7fe7400cdfb0 2023-11-26T07:20:00.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4099421316 0 0) 0x7fe728003520 con 0x7fe7400cdfb0 2023-11-26T07:20:00.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400cf450 msgr2=0x7fe7400cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:00.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400cf450 0x7fe7400cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 >> v1:172.21.15.159:6789/0 conn(0x7fe74015c7f0 legacy=0x7fe74006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74006d320 con 0x7fe7400cdfb0 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fe738001670 con 0x7fe7400cdfb0 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 >> v1:172.21.15.77:6789/0 conn(0x7fe7400cdfb0 legacy=0x7fe7400ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7280039a0 0x7fe728003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400cf450 0x7fe7280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 0x7fe728005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe740156010 con 0x7fe728004d00 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72800ba90 con 0x7fe7280039a0 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72800bc50 con 0x7fe7400cf450 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73ffff640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 0x7fe728005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73effd640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400cf450 0x7fe7280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:00.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.394+0000 7fe73f7fe640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7280039a0 0x7fe728003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.395+0000 7fe73ffff640 1 -- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400cf450 msgr2=0x7fe7280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.395+0000 7fe73ffff640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400cf450 0x7fe7280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.395+0000 7fe73ffff640 1 -- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7280039a0 msgr2=0x7fe728003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.395+0000 7fe73ffff640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7280039a0 0x7fe728003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.395+0000 7fe73ffff640 1 -- 172.21.15.77:0/3671196494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728003520 con 0x7fe728004d00 2023-11-26T07:20:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.395+0000 7fe73effd640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400cf450 0x7fe7280047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.395+0000 7fe73f7fe640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7280039a0 0x7fe728003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.396+0000 7fe73ffff640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 0x7fe728005180 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe738001eb0 tx=0x7fe7280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a5a4b9992dea9f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.396+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738005ad0 con 0x7fe728004d00 2023-11-26T07:20:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.396+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe738005c50 con 0x7fe728004d00 2023-11-26T07:20:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.396+0000 7fe73e7fc640 1 -- 172.21.15.77:0/3671196494 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73802c7c0 con 0x7fe728004d00 2023-11-26T07:20:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.396+0000 7fe7460e7640 1 -- 172.21.15.77:0/3671196494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 msgr2=0x7fe728005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.396+0000 7fe7460e7640 1 --2- 172.21.15.77:0/3671196494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 0x7fe728005180 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe738001eb0 tx=0x7fe7280057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.396+0000 7fe73ffff640 1 -- 172.21.15.77:0/3671196494 reap_dead start 2023-11-26T07:20:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.397+0000 7fe7460e7640 1 -- 172.21.15.77:0/3671196494 shutdown_connections 2023-11-26T07:20:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.397+0000 7fe7460e7640 1 -- 172.21.15.77:0/3671196494 >> 172.21.15.77:0/3671196494 conn(0x7fe74006a920 msgr2=0x7fe74006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.397+0000 7fe7460e7640 1 -- 172.21.15.77:0/3671196494 shutdown_connections 2023-11-26T07:20:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.397+0000 7fe7460e7640 1 -- 172.21.15.77:0/3671196494 wait complete. 2023-11-26T07:20:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.398+0000 7fe7460e7640 1 Processor -- start 2023-11-26T07:20:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.399+0000 7fe7460e7640 1 -- start start 2023-11-26T07:20:00.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.399+0000 7fe7460e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 0x7fe74014eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe7460e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7401538c0 0x7fe740153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe7460e7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400af3b0 0x7fe7400af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe7460e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe740154280 con 0x7fe728004d00 2023-11-26T07:20:00.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe7460e7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7400afda0 con 0x7fe7401538c0 2023-11-26T07:20:00.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe7460e7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7400b1a60 con 0x7fe7400af3b0 2023-11-26T07:20:00.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe73f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 0x7fe74014eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe73f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 0x7fe74014eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50180/0 (socket says 172.21.15.77:50180) 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe73f7fe640 1 -- 172.21.15.77:0/764647074 learned_addr learned my addr 172.21.15.77:0/764647074 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe73f7fe640 1 -- 172.21.15.77:0/764647074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400af3b0 msgr2=0x7fe7400af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe73f7fe640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400af3b0 0x7fe7400af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe73f7fe640 1 -- 172.21.15.77:0/764647074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7401538c0 msgr2=0x7fe740153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe73f7fe640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7401538c0 0x7fe740153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe73f7fe640 1 -- 172.21.15.77:0/764647074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74014fce0 con 0x7fe728004d00 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.400+0000 7fe73f7fe640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 0x7fe74014eba0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe73000db40 tx=0x7fe7300020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.401+0000 7fe727fff640 1 -- 172.21.15.77:0/764647074 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730003da0 con 0x7fe728004d00 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.401+0000 7fe727fff640 1 -- 172.21.15.77:0/764647074 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe730006b50 con 0x7fe728004d00 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.401+0000 7fe7460e7640 1 -- 172.21.15.77:0/764647074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74014f700 con 0x7fe728004d00 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.401+0000 7fe727fff640 1 -- 172.21.15.77:0/764647074 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73000b770 con 0x7fe728004d00 2023-11-26T07:20:00.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.401+0000 7fe7460e7640 1 -- 172.21.15.77:0/764647074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74014f970 con 0x7fe728004d00 2023-11-26T07:20:00.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.402+0000 7fe7460e7640 1 -- 172.21.15.77:0/764647074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe740067470 con 0x7fe728004d00 2023-11-26T07:20:00.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.403+0000 7fe727fff640 1 -- 172.21.15.77:0/764647074 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fe73000b8d0 con 0x7fe728004d00 2023-11-26T07:20:00.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.404+0000 7fe727fff640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe72c06b140 0x7fe72c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.404+0000 7fe727fff640 1 -- 172.21.15.77:0/764647074 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fe730089560 con 0x7fe728004d00 2023-11-26T07:20:00.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.404+0000 7fe73effd640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe72c06b140 0x7fe72c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:00.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.405+0000 7fe73effd640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe72c06b140 0x7fe72c06d600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe740071540 tx=0x7fe734008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:00.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.408+0000 7fe727fff640 1 -- 172.21.15.77:0/764647074 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe730054150 con 0x7fe728004d00 2023-11-26T07:20:00.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.600+0000 7fe7460e7640 1 -- 172.21.15.77:0/764647074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7400cd730 con 0x7fe728004d00 2023-11-26T07:20:00.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.602+0000 7fe727fff640 1 -- 172.21.15.77:0/764647074 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16610 (secure 0 0 0) 0x7fe730057770 con 0x7fe728004d00 2023-11-26T07:20:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:00.604 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":36,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:19:50.657201+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:42.084786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:42.792071+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 -- 172.21.15.77:0/764647074 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe72c06b140 msgr2=0x7fe72c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe72c06b140 0x7fe72c06d600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe740071540 tx=0x7fe734008040 comp rx=0 tx=0).stop 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 -- 172.21.15.77:0/764647074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 msgr2=0x7fe74014eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 0x7fe74014eba0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe73000db40 tx=0x7fe7300020c0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 -- 172.21.15.77:0/764647074 shutdown_connections 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe72c06b140 0x7fe72c06d600 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7400af3b0 0x7fe7400af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7401538c0 0x7fe740153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 --2- 172.21.15.77:0/764647074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe728004d00 0x7fe74014eba0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 -- 172.21.15.77:0/764647074 >> 172.21.15.77:0/764647074 conn(0x7fe74006a920 msgr2=0x7fe7400b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 -- 172.21.15.77:0/764647074 shutdown_connections 2023-11-26T07:20:00.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.605+0000 7fe7460e7640 1 -- 172.21.15.77:0/764647074 wait complete. 2023-11-26T07:20:00.626 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:20:00.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:00.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.824+0000 7f8bf569b640 1 Processor -- start 2023-11-26T07:20:00.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.824+0000 7f8bf569b640 1 -- start start 2023-11-26T07:20:00.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.826+0000 7f8bf569b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8bf00d04f0 0x7f8bf00b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.826+0000 7f8bf569b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bf00b2740 0x7f8bf00ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.826+0000 7f8bf569b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf00cdf90 con 0x7f8bf0160d40 2023-11-26T07:20:00.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.826+0000 7f8bf569b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf00ce230 con 0x7f8bf00b2740 2023-11-26T07:20:00.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.826+0000 7f8bf569b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf00d2430 con 0x7f8bf00d04f0 2023-11-26T07:20:00.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.826+0000 7f8bef7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bf00b2740 0x7f8bf00ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:00.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.826+0000 7f8bef7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bf00b2740 0x7f8bf00ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50194/0 (socket says 172.21.15.77:50194) 2023-11-26T07:20:00.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.826+0000 7f8bef7fe640 1 -- 172.21.15.77:0/782557859 learned_addr learned my addr 172.21.15.77:0/782557859 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:00.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.827+0000 7f8bef7fe640 1 -- 172.21.15.77:0/782557859 >> v2:172.21.15.159:3300/0 conn(0x7f8bf00d04f0 msgr2=0x7f8bf00b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:00.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.827+0000 7f8bef7fe640 1 --2- 172.21.15.77:0/782557859 >> v2:172.21.15.159:3300/0 conn(0x7f8bf00d04f0 0x7f8bf00b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.827+0000 7f8bef7fe640 1 -- 172.21.15.77:0/782557859 >> v1:172.21.15.159:6789/0 conn(0x7f8bf0160d40 legacy=0x7f8bf00cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:00.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.827+0000 7f8bef7fe640 1 -- 172.21.15.77:0/782557859 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf00d1b90 con 0x7f8bf00b2740 2023-11-26T07:20:00.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.828+0000 7f8bef7fe640 1 --2- 172.21.15.77:0/782557859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00b2740 0x7f8bf00ce710 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8bf008d450 tx=0x7f8be802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7106b38f1d7ea4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:00.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.829+0000 7f8bee7fc640 1 -- 172.21.15.77:0/782557859 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be802ca80 con 0x7f8bf00b2740 2023-11-26T07:20:00.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.829+0000 7f8bee7fc640 1 -- 172.21.15.77:0/782557859 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be802cbe0 con 0x7f8bf00b2740 2023-11-26T07:20:00.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.829+0000 7f8bee7fc640 1 -- 172.21.15.77:0/782557859 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80343f0 con 0x7f8bf00b2740 2023-11-26T07:20:00.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.830+0000 7f8bf569b640 1 -- 172.21.15.77:0/782557859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00b2740 msgr2=0x7f8bf00ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.830+0000 7f8bf569b640 1 --2- 172.21.15.77:0/782557859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00b2740 0x7f8bf00ce710 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8bf008d450 tx=0x7f8be802bee0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.830+0000 7f8bf569b640 1 -- 172.21.15.77:0/782557859 shutdown_connections 2023-11-26T07:20:00.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.830+0000 7f8bf569b640 1 --2- 172.21.15.77:0/782557859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00b2740 0x7f8bf00ce710 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.830+0000 7f8bf569b640 1 --2- 172.21.15.77:0/782557859 >> v2:172.21.15.159:3300/0 conn(0x7f8bf00d04f0 0x7f8bf00b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.830+0000 7f8bf569b640 1 -- 172.21.15.77:0/782557859 >> 172.21.15.77:0/782557859 conn(0x7f8bf008af60 msgr2=0x7f8bf00d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:00.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.830+0000 7f8bf569b640 1 -- 172.21.15.77:0/782557859 shutdown_connections 2023-11-26T07:20:00.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.830+0000 7f8bf569b640 1 -- 172.21.15.77:0/782557859 wait complete. 2023-11-26T07:20:00.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.832+0000 7f8bf569b640 1 Processor -- start 2023-11-26T07:20:00.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.832+0000 7f8bf569b640 1 -- start start 2023-11-26T07:20:00.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.833+0000 7f8bf569b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00b2740 0x7f8bf015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.833+0000 7f8bf569b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bf00d04f0 0x7f8bf00cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.833+0000 7f8bf569b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bf0160d40 0x7f8bf00b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.833+0000 7f8bf569b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf015b0e0 con 0x7f8bf00b2740 2023-11-26T07:20:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.833+0000 7f8bf569b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf00ccc40 con 0x7f8bf00d04f0 2023-11-26T07:20:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.833+0000 7f8bf569b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf00ccf20 con 0x7f8bf0160d40 2023-11-26T07:20:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.833+0000 7f8beeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00b2740 0x7f8bf015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.833+0000 7f8beeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00b2740 0x7f8bf015aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50210/0 (socket says 172.21.15.77:50210) 2023-11-26T07:20:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.833+0000 7f8beeffd640 1 -- 172.21.15.77:0/3596476208 learned_addr learned my addr 172.21.15.77:0/3596476208 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.833+0000 7f8be67fc640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bf00d04f0 0x7f8bf00cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.833+0000 7f8bef7fe640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bf0160d40 0x7f8bf00b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.834+0000 7f8beeffd640 1 -- 172.21.15.77:0/3596476208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bf0160d40 msgr2=0x7f8bf00b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.834+0000 7f8beeffd640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bf0160d40 0x7f8bf00b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.834+0000 7f8beeffd640 1 -- 172.21.15.77:0/3596476208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bf00d04f0 msgr2=0x7f8bf00cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:00.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.834+0000 7f8beeffd640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bf00d04f0 0x7f8bf00cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:00.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.834+0000 7f8beeffd640 1 -- 172.21.15.77:0/3596476208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8009b30 con 0x7f8bf00b2740 2023-11-26T07:20:00.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.834+0000 7f8beeffd640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00b2740 0x7f8bf015aba0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c410 tx=0x7f8be000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:00.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.834+0000 7f8be7fff640 1 -- 172.21.15.77:0/3596476208 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be00035f0 con 0x7f8bf00b2740 2023-11-26T07:20:00.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.834+0000 7f8be7fff640 1 -- 172.21.15.77:0/3596476208 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0003750 con 0x7f8bf00b2740 2023-11-26T07:20:00.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.834+0000 7f8be7fff640 1 -- 172.21.15.77:0/3596476208 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0003b40 con 0x7f8bf00b2740 2023-11-26T07:20:00.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.834+0000 7f8bf569b640 1 -- 172.21.15.77:0/3596476208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf00cd200 con 0x7f8bf00b2740 2023-11-26T07:20:00.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.834+0000 7f8bf569b640 1 -- 172.21.15.77:0/3596476208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf00c7240 con 0x7f8bf00b2740 2023-11-26T07:20:00.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.835+0000 7f8bf569b640 1 -- 172.21.15.77:0/3596476208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf0067470 con 0x7f8bf00b2740 2023-11-26T07:20:00.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.836+0000 7f8be7fff640 1 -- 172.21.15.77:0/3596476208 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f8be0003ca0 con 0x7f8bf00b2740 2023-11-26T07:20:00.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.837+0000 7f8be7fff640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8bd406b110 0x7f8bd406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:00.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.837+0000 7f8be7fff640 1 -- 172.21.15.77:0/3596476208 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f8be0088c40 con 0x7f8bf00b2740 2023-11-26T07:20:00.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.837+0000 7f8be67fc640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8bd406b110 0x7f8bd406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:00.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.838+0000 7f8be67fc640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8bd406b110 0x7f8bd406d5d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8bf006c5c0 tx=0x7f8bd8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:00.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:00.842+0000 7f8be7fff640 1 -- 172.21.15.77:0/3596476208 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8be00539d0 con 0x7f8bf00b2740 2023-11-26T07:20:01.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.069+0000 7f8bf569b640 1 -- 172.21.15.77:0/3596476208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bf006ceb0 con 0x7f8bf00b2740 2023-11-26T07:20:01.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.070+0000 7f8be7fff640 1 -- 172.21.15.77:0/3596476208 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f8be0056ff0 con 0x7f8bf00b2740 2023-11-26T07:20:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:01.072 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3806365439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3806365439},{"type":"v1","addr":"172.21.15.77:6836","nonce":3806365439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/694008676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":694008676},{"type":"v1","addr":"172.21.15.77:6837","nonce":694008676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4705,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/4096574472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4096574472},{"type":"v1","addr":"172.21.15.159:6834","nonce":4096574472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:43.790536+0000","modified":"2023-11-26T07:18:47.129568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6835/360332813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":360332813},{"type":"v1","addr":"172.21.15.159:6835","nonce":360332813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:20:01.073 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-11-26T07:20:01.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 -- 172.21.15.77:0/3596476208 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8bd406b110 msgr2=0x7f8bd406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8bd406b110 0x7f8bd406d5d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8bf006c5c0 tx=0x7f8bd8008040 comp rx=0 tx=0).stop 2023-11-26T07:20:01.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 -- 172.21.15.77:0/3596476208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00b2740 msgr2=0x7f8bf015aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00b2740 0x7f8bf015aba0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c410 tx=0x7f8be000c8d0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 -- 172.21.15.77:0/3596476208 shutdown_connections 2023-11-26T07:20:01.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8bd406b110 0x7f8bd406d5d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bf0160d40 0x7f8bf00b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bf00d04f0 0x7f8bf00cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 --2- 172.21.15.77:0/3596476208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00b2740 0x7f8bf015aba0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 -- 172.21.15.77:0/3596476208 >> 172.21.15.77:0/3596476208 conn(0x7f8bf008af60 msgr2=0x7f8bf006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:01.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 -- 172.21.15.77:0/3596476208 shutdown_connections 2023-11-26T07:20:01.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.073+0000 7f8bf569b640 1 -- 172.21.15.77:0/3596476208 wait complete. 2023-11-26T07:20:01.095 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:01.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.309+0000 7f6adbf48640 1 Processor -- start 2023-11-26T07:20:01.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.309+0000 7f6adbf48640 1 -- start start 2023-11-26T07:20:01.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.310+0000 7f6adbf48640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6ad40b2250 0x7f6ad415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.310+0000 7f6adbf48640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6ad40b2630 0x7f6ad40ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.310+0000 7f6adbf48640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad415ab80 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.310+0000 7f6adbf48640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad415a990 con 0x7f6ad40b2250 2023-11-26T07:20:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.310+0000 7f6adbf48640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad415e680 con 0x7f6ad40b2630 2023-11-26T07:20:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.311+0000 7f6ad9ce4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6ad40b2250 0x7f6ad415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.311+0000 7f6ada4e5640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6ad40b2aa0 0x7f6ad415b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50538/0 (socket says 172.21.15.77:50538) 2023-11-26T07:20:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.311+0000 7f6ada4e5640 1 -- 172.21.15.77:0/2268321500 learned_addr learned my addr 172.21.15.77:0/2268321500 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.311+0000 7f6ad94e3640 1 --2- 172.21.15.77:0/2268321500 >> v2:172.21.15.159:3300/0 conn(0x7f6ad40b2630 0x7f6ad40ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.311+0000 7f6ad8ce2640 1 -- 172.21.15.77:0/2268321500 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095312686 0 0) 0x7f6ad415ab80 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.311+0000 7f6ad8ce2640 1 -- 172.21.15.77:0/2268321500 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac0003520 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.311+0000 7f6ad9ce4640 1 -- 172.21.15.77:0/2268321500 >> v2:172.21.15.159:3300/0 conn(0x7f6ad40b2630 msgr2=0x7f6ad40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.311+0000 7f6ad9ce4640 1 --2- 172.21.15.77:0/2268321500 >> v2:172.21.15.159:3300/0 conn(0x7f6ad40b2630 0x7f6ad40ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.311+0000 7f6ad9ce4640 1 -- 172.21.15.77:0/2268321500 >> v1:172.21.15.77:6789/0 conn(0x7f6ad40b2aa0 legacy=0x7f6ad415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.311+0000 7f6ad9ce4640 1 -- 172.21.15.77:0/2268321500 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad415e960 con 0x7f6ad40b2250 2023-11-26T07:20:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.313+0000 7f6ad9ce4640 1 --2- 172.21.15.77:0/2268321500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ad40b2250 0x7f6ad415df80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40ae5c0 tx=0x7f6ad002e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4467ec84f4143d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.313+0000 7f6ad8ce2640 1 -- 172.21.15.77:0/2268321500 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad002ee50 con 0x7f6ad40b2250 2023-11-26T07:20:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.313+0000 7f6ad8ce2640 1 -- 172.21.15.77:0/2268321500 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad0036440 con 0x7f6ad40b2250 2023-11-26T07:20:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.313+0000 7f6ad8ce2640 1 -- 172.21.15.77:0/2268321500 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00367d0 con 0x7f6ad40b2250 2023-11-26T07:20:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.314+0000 7f6adbf48640 1 -- 172.21.15.77:0/2268321500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ad40b2250 msgr2=0x7f6ad415df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.314+0000 7f6adbf48640 1 --2- 172.21.15.77:0/2268321500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ad40b2250 0x7f6ad415df80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40ae5c0 tx=0x7f6ad002e0a0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.314+0000 7f6adbf48640 1 -- 172.21.15.77:0/2268321500 shutdown_connections 2023-11-26T07:20:01.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.314+0000 7f6adbf48640 1 --2- 172.21.15.77:0/2268321500 >> v2:172.21.15.159:3300/0 conn(0x7f6ad40b2630 0x7f6ad40ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.314+0000 7f6adbf48640 1 --2- 172.21.15.77:0/2268321500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ad40b2250 0x7f6ad415df80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.314+0000 7f6adbf48640 1 -- 172.21.15.77:0/2268321500 >> 172.21.15.77:0/2268321500 conn(0x7f6ad406a920 msgr2=0x7f6ad406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:01.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.314+0000 7f6adbf48640 1 -- 172.21.15.77:0/2268321500 shutdown_connections 2023-11-26T07:20:01.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.314+0000 7f6adbf48640 1 -- 172.21.15.77:0/2268321500 wait complete. 2023-11-26T07:20:01.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.315+0000 7f6adbf48640 1 Processor -- start 2023-11-26T07:20:01.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.316+0000 7f6adbf48640 1 -- start start 2023-11-26T07:20:01.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.316+0000 7f6adbf48640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ad40b2250 0x7f6ad4157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6adbf48640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ad40b2630 0x7f6ad4147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6adbf48640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ad40b2aa0 0x7f6ad4071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6adbf48640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad41576b0 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6adbf48640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4155800 con 0x7f6ad40b2250 2023-11-26T07:20:01.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6adbf48640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4157e80 con 0x7f6ad40b2630 2023-11-26T07:20:01.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6ada4e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ad40b2aa0 0x7f6ad4071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6ada4e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ad40b2aa0 0x7f6ad4071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50232/0 (socket says 172.21.15.77:50232) 2023-11-26T07:20:01.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6ada4e5640 1 -- 172.21.15.77:0/3398618566 learned_addr learned my addr 172.21.15.77:0/3398618566 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:01.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6ad9ce4640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ad40b2250 0x7f6ad4157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6ada4e5640 1 -- 172.21.15.77:0/3398618566 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ad40b2630 msgr2=0x7f6ad4147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6ada4e5640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ad40b2630 0x7f6ad4147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6ada4e5640 1 -- 172.21.15.77:0/3398618566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ad40b2250 msgr2=0x7f6ad4157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6ada4e5640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ad40b2250 0x7f6ad4157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6ada4e5640 1 -- 172.21.15.77:0/3398618566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad000b6a0 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.317+0000 7f6ad9ce4640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ad40b2250 0x7f6ad4157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:01.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.318+0000 7f6ada4e5640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ad40b2aa0 0x7f6ad4071870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c9f0 tx=0x7f6acc00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.318+0000 7f6aca7fc640 1 -- 172.21.15.77:0/3398618566 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc00ab70 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.318+0000 7f6aca7fc640 1 -- 172.21.15.77:0/3398618566 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc00acd0 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.318+0000 7f6aca7fc640 1 -- 172.21.15.77:0/3398618566 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc012600 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.318+0000 7f6adbf48640 1 -- 172.21.15.77:0/3398618566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad41551f0 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.318+0000 7f6adbf48640 1 -- 172.21.15.77:0/3398618566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad4155490 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.319+0000 7f6adbf48640 1 -- 172.21.15.77:0/3398618566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad4155050 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.320+0000 7f6aca7fc640 1 -- 172.21.15.77:0/3398618566 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f6acc007070 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.321+0000 7f6aca7fc640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6ab806b110 0x7f6ab806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.321+0000 7f6aca7fc640 1 -- 172.21.15.77:0/3398618566 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f6acc089940 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.321+0000 7f6ad9ce4640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6ab806b110 0x7f6ab806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.322+0000 7f6ad9ce4640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6ab806b110 0x7f6ab806d5d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0038000 tx=0x7f6ad0032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.325+0000 7f6aca7fc640 1 -- 172.21.15.77:0/3398618566 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ad4155050 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.557+0000 7f6adbf48640 1 -- 172.21.15.77:0/3398618566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ad4155050 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.559+0000 7f6aca7fc640 1 -- 172.21.15.77:0/3398618566 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f6ad4155050 con 0x7f6ad40b2aa0 2023-11-26T07:20:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3806365439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3806365439},{"type":"v1","addr":"172.21.15.77:6836","nonce":3806365439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/694008676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":694008676},{"type":"v1","addr":"172.21.15.77:6837","nonce":694008676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4705,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/4096574472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4096574472},{"type":"v1","addr":"172.21.15.159:6834","nonce":4096574472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:43.790536+0000","modified":"2023-11-26T07:18:47.129568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6835/360332813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":360332813},{"type":"v1","addr":"172.21.15.159:6835","nonce":360332813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:20:01.562 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-11-26T07:20:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.561+0000 7f6adbf48640 1 -- 172.21.15.77:0/3398618566 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6ab806b110 msgr2=0x7f6ab806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.561+0000 7f6adbf48640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6ab806b110 0x7f6ab806d5d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0038000 tx=0x7f6ad0032000 comp rx=0 tx=0).stop 2023-11-26T07:20:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.561+0000 7f6adbf48640 1 -- 172.21.15.77:0/3398618566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ad40b2aa0 msgr2=0x7f6ad4071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.561+0000 7f6adbf48640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ad40b2aa0 0x7f6ad4071870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c9f0 tx=0x7f6acc00ceb0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.562+0000 7f6adbf48640 1 -- 172.21.15.77:0/3398618566 shutdown_connections 2023-11-26T07:20:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.562+0000 7f6adbf48640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6ab806b110 0x7f6ab806d5d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.562+0000 7f6adbf48640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ad40b2aa0 0x7f6ad4071870 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.562+0000 7f6adbf48640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ad40b2630 0x7f6ad4147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.562+0000 7f6adbf48640 1 --2- 172.21.15.77:0/3398618566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ad40b2250 0x7f6ad4157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.562+0000 7f6adbf48640 1 -- 172.21.15.77:0/3398618566 >> 172.21.15.77:0/3398618566 conn(0x7f6ad406a920 msgr2=0x7f6ad40cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.562+0000 7f6adbf48640 1 -- 172.21.15.77:0/3398618566 shutdown_connections 2023-11-26T07:20:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.562+0000 7f6adbf48640 1 -- 172.21.15.77:0/3398618566 wait complete. 2023-11-26T07:20:01.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:01.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.798+0000 7f00e7021640 1 Processor -- start 2023-11-26T07:20:01.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.798+0000 7f00e7021640 1 -- start start 2023-11-26T07:20:01.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.800+0000 7f00e7021640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f00e015c410 0x7f00e015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.800+0000 7f00e7021640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e015bf80 con 0x7f00e00b1de0 2023-11-26T07:20:01.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.800+0000 7f00e7021640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e00b1560 con 0x7f00e0144b30 2023-11-26T07:20:01.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.800+0000 7f00e7021640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e00b1280 con 0x7f00e015c410 2023-11-26T07:20:01.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.800+0000 7f00e6820640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f00e00b1de0 0x7f00e00b3c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50542/0 (socket says 172.21.15.77:50542) 2023-11-26T07:20:01.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.800+0000 7f00e6820640 1 -- 172.21.15.77:0/315357510 learned_addr learned my addr 172.21.15.77:0/315357510 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:01.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.800+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466739155 0 0) 0x7f00e015bf80 con 0x7f00e00b1de0 2023-11-26T07:20:01.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.800+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00cc003520 con 0x7f00e00b1de0 2023-11-26T07:20:01.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e581e640 1 --2- 172.21.15.77:0/315357510 >> v2:172.21.15.159:3300/0 conn(0x7f00e015c410 0x7f00e015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 484029048 0 0) 0x7f00cc003520 con 0x7f00e00b1de0 2023-11-26T07:20:01.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 >> v2:172.21.15.159:3300/0 conn(0x7f00e015c410 msgr2=0x7f00e015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:01.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 --2- 172.21.15.77:0/315357510 >> v2:172.21.15.159:3300/0 conn(0x7f00e015c410 0x7f00e015f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 >> v1:172.21.15.159:6789/0 conn(0x7f00e0144b30 legacy=0x7f00e00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:01.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e015b930 con 0x7f00e00b1de0 2023-11-26T07:20:01.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f00d80019f0 con 0x7f00e00b1de0 2023-11-26T07:20:01.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 >> v1:172.21.15.77:6789/0 conn(0x7f00e00b1de0 legacy=0x7f00e00b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00cc003970 0x7f00cc003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00cc0047c0 0x7f00cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 0x7f00cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00b1280 con 0x7f00cc005180 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc00c0b0 con 0x7f00cc003970 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc00c270 con 0x7f00cc0047c0 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.801+0000 7f00e6820640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 0x7f00cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.802+0000 7f00e581e640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00cc0047c0 0x7f00cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.802+0000 7f00e601f640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00cc003970 0x7f00cc003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.802+0000 7f00e6820640 1 -- 172.21.15.77:0/315357510 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00cc0047c0 msgr2=0x7f00cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.802+0000 7f00e6820640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00cc0047c0 0x7f00cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.802+0000 7f00e6820640 1 -- 172.21.15.77:0/315357510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00cc003970 msgr2=0x7f00cc003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:01.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.802+0000 7f00e6820640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00cc003970 0x7f00cc003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.802+0000 7f00e6820640 1 -- 172.21.15.77:0/315357510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc003520 con 0x7f00cc005180 2023-11-26T07:20:01.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.802+0000 7f00e601f640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00cc003970 0x7f00cc003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:01.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.803+0000 7f00e6820640 1 -- 172.21.15.77:0/315357510 reap_dead start 2023-11-26T07:20:01.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.803+0000 7f00e6820640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 0x7f00cc00b980 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f00d8002230 tx=0x7f00cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f4c76fd2d20593 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.803+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8034630 con 0x7f00cc005180 2023-11-26T07:20:01.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.803+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d802f070 con 0x7f00cc005180 2023-11-26T07:20:01.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.803+0000 7f00e501d640 1 -- 172.21.15.77:0/315357510 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80349f0 con 0x7f00cc005180 2023-11-26T07:20:01.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.804+0000 7f00e7021640 1 -- 172.21.15.77:0/315357510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 msgr2=0x7f00cc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.804+0000 7f00e7021640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 0x7f00cc00b980 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f00d8002230 tx=0x7f00cc0057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.804+0000 7f00e7021640 1 -- 172.21.15.77:0/315357510 shutdown_connections 2023-11-26T07:20:01.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.804+0000 7f00e7021640 1 --2- 172.21.15.77:0/315357510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 0x7f00cc00b980 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.804+0000 7f00e7021640 1 -- 172.21.15.77:0/315357510 >> 172.21.15.77:0/315357510 conn(0x7f00e00cb830 msgr2=0x7f00e00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:01.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.804+0000 7f00e7021640 1 -- 172.21.15.77:0/315357510 shutdown_connections 2023-11-26T07:20:01.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.804+0000 7f00e7021640 1 -- 172.21.15.77:0/315357510 wait complete. 2023-11-26T07:20:01.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.806+0000 7f00e7021640 1 Processor -- start 2023-11-26T07:20:01.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.806+0000 7f00e7021640 1 -- start start 2023-11-26T07:20:01.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.807+0000 7f00e7021640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 0x7f00e00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.807+0000 7f00e7021640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00e01f4260 0x7f00e01f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.807+0000 7f00e7021640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00e0136cc0 0x7f00e0137150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.807+0000 7f00e7021640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e01385b0 con 0x7f00cc005180 2023-11-26T07:20:01.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.807+0000 7f00e7021640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e01f4c20 con 0x7f00e01f4260 2023-11-26T07:20:01.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.807+0000 7f00e7021640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e0137a30 con 0x7f00e0136cc0 2023-11-26T07:20:01.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.808+0000 7f00e601f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 0x7f00e00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.808+0000 7f00e601f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 0x7f00e00b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50250/0 (socket says 172.21.15.77:50250) 2023-11-26T07:20:01.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.808+0000 7f00e601f640 1 -- 172.21.15.77:0/2565315455 learned_addr learned my addr 172.21.15.77:0/2565315455 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:01.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.808+0000 7f00e601f640 1 -- 172.21.15.77:0/2565315455 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00e0136cc0 msgr2=0x7f00e0137150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.808+0000 7f00e601f640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00e0136cc0 0x7f00e0137150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.808+0000 7f00e581e640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00e01f4260 0x7f00e01f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.808+0000 7f00e601f640 1 -- 172.21.15.77:0/2565315455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00e01f4260 msgr2=0x7f00e01f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.808+0000 7f00e601f640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00e01f4260 0x7f00e01f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.808+0000 7f00e601f640 1 -- 172.21.15.77:0/2565315455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e0137d10 con 0x7f00cc005180 2023-11-26T07:20:01.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.808+0000 7f00e601f640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 0x7f00e00b0950 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00d590 tx=0x7f00dc00da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.809+0000 7f00d6ffd640 1 -- 172.21.15.77:0/2565315455 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc007220 con 0x7f00cc005180 2023-11-26T07:20:01.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.809+0000 7f00d6ffd640 1 -- 172.21.15.77:0/2565315455 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc0073a0 con 0x7f00cc005180 2023-11-26T07:20:01.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.809+0000 7f00e7021640 1 -- 172.21.15.77:0/2565315455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e0137ff0 con 0x7f00cc005180 2023-11-26T07:20:01.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.809+0000 7f00d6ffd640 1 -- 172.21.15.77:0/2565315455 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0067d0 con 0x7f00cc005180 2023-11-26T07:20:01.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.809+0000 7f00e7021640 1 -- 172.21.15.77:0/2565315455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e00b0e90 con 0x7f00cc005180 2023-11-26T07:20:01.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.810+0000 7f00e7021640 1 -- 172.21.15.77:0/2565315455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e004e840 con 0x7f00cc005180 2023-11-26T07:20:01.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.811+0000 7f00d6ffd640 1 -- 172.21.15.77:0/2565315455 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f00dc006930 con 0x7f00cc005180 2023-11-26T07:20:01.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.812+0000 7f00d6ffd640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00c406b140 0x7f00c406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.812+0000 7f00d6ffd640 1 -- 172.21.15.77:0/2565315455 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f00dc089910 con 0x7f00cc005180 2023-11-26T07:20:01.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.812+0000 7f00e581e640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00c406b140 0x7f00c406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.813+0000 7f00e581e640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00c406b140 0x7f00c406d600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f00d0006fd0 tx=0x7f00d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:01.817+0000 7f00d6ffd640 1 -- 172.21.15.77:0/2565315455 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f00dc054510 con 0x7f00cc005180 2023-11-26T07:20:02.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.010+0000 7f00e7021640 1 -- 172.21.15.77:0/2565315455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00e006d860 con 0x7f00cc005180 2023-11-26T07:20:02.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.011+0000 7f00d6ffd640 1 -- 172.21.15.77:0/2565315455 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16610 (secure 0 0 0) 0x7f00dc057b30 con 0x7f00cc005180 2023-11-26T07:20:02.014 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:02.014 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":36,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:19:50.657201+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:42.084786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:42.792071+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:02.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.014+0000 7f00e7021640 1 -- 172.21.15.77:0/2565315455 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00c406b140 msgr2=0x7f00c406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.014+0000 7f00e7021640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00c406b140 0x7f00c406d600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f00d0006fd0 tx=0x7f00d0008040 comp rx=0 tx=0).stop 2023-11-26T07:20:02.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.014+0000 7f00e7021640 1 -- 172.21.15.77:0/2565315455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 msgr2=0x7f00e00b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.014+0000 7f00e7021640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 0x7f00e00b0950 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00d590 tx=0x7f00dc00da50 comp rx=0 tx=0).stop 2023-11-26T07:20:02.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.014+0000 7f00e7021640 1 -- 172.21.15.77:0/2565315455 shutdown_connections 2023-11-26T07:20:02.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.014+0000 7f00e7021640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00c406b140 0x7f00c406d600 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.014+0000 7f00e7021640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00e0136cc0 0x7f00e0137150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.014+0000 7f00e7021640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00e01f4260 0x7f00e01f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.014+0000 7f00e7021640 1 --2- 172.21.15.77:0/2565315455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00cc005180 0x7f00e00b0950 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.014+0000 7f00e7021640 1 -- 172.21.15.77:0/2565315455 >> 172.21.15.77:0/2565315455 conn(0x7f00e00cb830 msgr2=0x7f00e013f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:02.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.014+0000 7f00e7021640 1 -- 172.21.15.77:0/2565315455 shutdown_connections 2023-11-26T07:20:02.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.015+0000 7f00e7021640 1 -- 172.21.15.77:0/2565315455 wait complete. 2023-11-26T07:20:02.037 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:20:02.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.252+0000 7f284a3ce640 1 Processor -- start 2023-11-26T07:20:02.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.253+0000 7f284a3ce640 1 -- start start 2023-11-26T07:20:02.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.254+0000 7f284a3ce640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f284415b440 0x7f28440cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.254+0000 7f284a3ce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28440cbf20 0x7f28440c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.254+0000 7f284a3ce640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28440c57e0 0x7f28440c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.254+0000 7f284a3ce640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28440cc3d0 con 0x7f28440cbf20 2023-11-26T07:20:02.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.254+0000 7f284a3ce640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284415b820 con 0x7f284415b440 2023-11-26T07:20:02.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.254+0000 7f284a3ce640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284415eea0 con 0x7f28440c57e0 2023-11-26T07:20:02.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f28437fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28440cbf20 0x7f28440c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f28437fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28440cbf20 0x7f28440c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50252/0 (socket says 172.21.15.77:50252) 2023-11-26T07:20:02.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f28437fe640 1 -- 172.21.15.77:0/2534765747 learned_addr learned my addr 172.21.15.77:0/2534765747 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:02.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f284896b640 1 --2- 172.21.15.77:0/2534765747 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28440c57e0 0x7f28440c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f2843fff640 1 --2- 172.21.15.77:0/2534765747 >> v2:172.21.15.159:3300/0 conn(0x7f284415b440 0x7f28440cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f28437fe640 1 -- 172.21.15.77:0/2534765747 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28440c57e0 msgr2=0x7f28440c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:02.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f28437fe640 1 --2- 172.21.15.77:0/2534765747 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28440c57e0 0x7f28440c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f28437fe640 1 -- 172.21.15.77:0/2534765747 >> v2:172.21.15.159:3300/0 conn(0x7f284415b440 msgr2=0x7f28440cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:02.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f28437fe640 1 --2- 172.21.15.77:0/2534765747 >> v2:172.21.15.159:3300/0 conn(0x7f284415b440 0x7f28440cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f28437fe640 1 -- 172.21.15.77:0/2534765747 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440abf30 con 0x7f28440cbf20 2023-11-26T07:20:02.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f284896b640 1 --2- 172.21.15.77:0/2534765747 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28440c57e0 0x7f28440c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:02.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.255+0000 7f2843fff640 1 --2- 172.21.15.77:0/2534765747 >> v2:172.21.15.159:3300/0 conn(0x7f284415b440 0x7f28440cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:02.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.256+0000 7f28437fe640 1 --2- 172.21.15.77:0/2534765747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28440cbf20 0x7f28440c52a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f284406e770 tx=0x7f282c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56fed6118d6fe85 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:02.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f2842ffd640 1 -- 172.21.15.77:0/2534765747 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0317e0 con 0x7f28440cbf20 2023-11-26T07:20:02.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f2842ffd640 1 -- 172.21.15.77:0/2534765747 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c031940 con 0x7f28440cbf20 2023-11-26T07:20:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f2842ffd640 1 -- 172.21.15.77:0/2534765747 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c031cd0 con 0x7f28440cbf20 2023-11-26T07:20:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f284a3ce640 1 -- 172.21.15.77:0/2534765747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28440cbf20 msgr2=0x7f28440c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f284a3ce640 1 --2- 172.21.15.77:0/2534765747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28440cbf20 0x7f28440c52a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f284406e770 tx=0x7f282c02b880 comp rx=0 tx=0).stop 2023-11-26T07:20:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f284a3ce640 1 -- 172.21.15.77:0/2534765747 shutdown_connections 2023-11-26T07:20:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f284a3ce640 1 --2- 172.21.15.77:0/2534765747 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28440c57e0 0x7f28440c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f284a3ce640 1 --2- 172.21.15.77:0/2534765747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28440cbf20 0x7f28440c52a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f284a3ce640 1 --2- 172.21.15.77:0/2534765747 >> v2:172.21.15.159:3300/0 conn(0x7f284415b440 0x7f28440cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f284a3ce640 1 -- 172.21.15.77:0/2534765747 >> 172.21.15.77:0/2534765747 conn(0x7f28440b0c50 msgr2=0x7f28440b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f284a3ce640 1 -- 172.21.15.77:0/2534765747 shutdown_connections 2023-11-26T07:20:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.257+0000 7f284a3ce640 1 -- 172.21.15.77:0/2534765747 wait complete. 2023-11-26T07:20:02.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.259+0000 7f284a3ce640 1 Processor -- start 2023-11-26T07:20:02.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.259+0000 7f284a3ce640 1 -- start start 2023-11-26T07:20:02.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.260+0000 7f284a3ce640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28440c57e0 0x7f28441541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.260+0000 7f284a3ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28440cbf20 0x7f28441591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.260+0000 7f284a3ce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f284415b440 0x7f28441596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.260+0000 7f284a3ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28441546f0 con 0x7f28440cbf20 2023-11-26T07:20:02.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.260+0000 7f284a3ce640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440c6170 con 0x7f284415b440 2023-11-26T07:20:02.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.260+0000 7f284a3ce640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28440c6450 con 0x7f28440c57e0 2023-11-26T07:20:02.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.260+0000 7f28437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28440cbf20 0x7f28441591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.261+0000 7f28437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28440cbf20 0x7f28441591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50264/0 (socket says 172.21.15.77:50264) 2023-11-26T07:20:02.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.261+0000 7f28437fe640 1 -- 172.21.15.77:0/3568327180 learned_addr learned my addr 172.21.15.77:0/3568327180 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:02.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.261+0000 7f2843fff640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28440c57e0 0x7f28441541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.261+0000 7f28437fe640 1 -- 172.21.15.77:0/3568327180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28440c57e0 msgr2=0x7f28441541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.261+0000 7f28437fe640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28440c57e0 0x7f28441541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.261+0000 7f28437fe640 1 -- 172.21.15.77:0/3568327180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f284415b440 msgr2=0x7f28441596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.261+0000 7f284896b640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f284415b440 0x7f28441596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.261+0000 7f28437fe640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f284415b440 0x7f28441596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.261+0000 7f28437fe640 1 -- 172.21.15.77:0/3568327180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0094d0 con 0x7f28440cbf20 2023-11-26T07:20:02.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.261+0000 7f284896b640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f284415b440 0x7f28441596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:02.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.261+0000 7f28437fe640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28440cbf20 0x7f28441591a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f282c000c00 tx=0x7f282c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:02.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.262+0000 7f2840ff9640 1 -- 172.21.15.77:0/3568327180 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c032900 con 0x7f28440cbf20 2023-11-26T07:20:02.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.262+0000 7f2840ff9640 1 -- 172.21.15.77:0/3568327180 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c032a60 con 0x7f28440cbf20 2023-11-26T07:20:02.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.262+0000 7f2840ff9640 1 -- 172.21.15.77:0/3568327180 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c032e10 con 0x7f28440cbf20 2023-11-26T07:20:02.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.262+0000 7f284a3ce640 1 -- 172.21.15.77:0/3568327180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28440c6730 con 0x7f28440cbf20 2023-11-26T07:20:02.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.262+0000 7f284a3ce640 1 -- 172.21.15.77:0/3568327180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28440c6cf0 con 0x7f28440cbf20 2023-11-26T07:20:02.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.263+0000 7f284a3ce640 1 -- 172.21.15.77:0/3568327180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28440c6590 con 0x7f28440cbf20 2023-11-26T07:20:02.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.265+0000 7f2840ff9640 1 -- 172.21.15.77:0/3568327180 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f282c04e450 con 0x7f28440cbf20 2023-11-26T07:20:02.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.266+0000 7f2840ff9640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f282406b110 0x7f282406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.266+0000 7f2840ff9640 1 -- 172.21.15.77:0/3568327180 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f282c0abe90 con 0x7f28440cbf20 2023-11-26T07:20:02.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.266+0000 7f2843fff640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f282406b110 0x7f282406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.267+0000 7f2843fff640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f282406b110 0x7f282406d5d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f283400b840 tx=0x7f2834008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:02.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.270+0000 7f2840ff9640 1 -- 172.21.15.77:0/3568327180 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28440c6590 con 0x7f28440cbf20 2023-11-26T07:20:02.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.495+0000 7f284a3ce640 1 -- 172.21.15.77:0/3568327180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f28440c6590 con 0x7f28440cbf20 2023-11-26T07:20:02.499 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-26T07:20:02.497+0000 7f36d32f9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:20:02.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.500+0000 7f2840ff9640 1 -- 172.21.15.77:0/3568327180 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f28440c6590 con 0x7f28440cbf20 2023-11-26T07:20:02.503 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:20:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 -- 172.21.15.77:0/3568327180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f282406b110 msgr2=0x7f282406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f282406b110 0x7f282406d5d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f283400b840 tx=0x7f2834008040 comp rx=0 tx=0).stop 2023-11-26T07:20:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 -- 172.21.15.77:0/3568327180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28440cbf20 msgr2=0x7f28441591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28440cbf20 0x7f28441591a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f282c000c00 tx=0x7f282c0046c0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 -- 172.21.15.77:0/3568327180 shutdown_connections 2023-11-26T07:20:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f282406b110 0x7f282406d5d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f284415b440 0x7f28441596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28440cbf20 0x7f28441591a0 secure :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f282c000c00 tx=0x7f282c0046c0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 --2- 172.21.15.77:0/3568327180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28440c57e0 0x7f28441541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 -- 172.21.15.77:0/3568327180 >> 172.21.15.77:0/3568327180 conn(0x7f28440b0c50 msgr2=0x7f2844070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 -- 172.21.15.77:0/3568327180 shutdown_connections 2023-11-26T07:20:02.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.503+0000 7f284a3ce640 1 -- 172.21.15.77:0/3568327180 wait complete. 2023-11-26T07:20:02.526 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:20:02.634 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-11-26T07:20:02.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.738+0000 7f787bfff640 1 Processor -- start 2023-11-26T07:20:02.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.738+0000 7f787bfff640 1 -- start start 2023-11-26T07:20:02.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.740+0000 7f787bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f787c141b90 0x7f787c0b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.740+0000 7f787bfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f787c0b1090 0x7f787c0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.740+0000 7f787bfff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c0b14f0 con 0x7f787c071e10 2023-11-26T07:20:02.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.740+0000 7f787bfff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c1450d0 con 0x7f787c141b90 2023-11-26T07:20:02.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.740+0000 7f787bfff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c1422b0 con 0x7f787c0b1090 2023-11-26T07:20:02.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.740+0000 7f787affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f787c141b90 0x7f787c0b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.740+0000 7f787affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f787c141b90 0x7f787c0b0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50266/0 (socket says 172.21.15.77:50266) 2023-11-26T07:20:02.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.740+0000 7f787affd640 1 -- 172.21.15.77:0/1289665250 learned_addr learned my addr 172.21.15.77:0/1289665250 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:02.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.741+0000 7f7873fff640 1 --2- 172.21.15.77:0/1289665250 >> v2:172.21.15.159:3300/0 conn(0x7f787c0b1090 0x7f787c0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.741+0000 7f787affd640 1 -- 172.21.15.77:0/1289665250 >> v2:172.21.15.159:3300/0 conn(0x7f787c0b1090 msgr2=0x7f787c0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:02.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.741+0000 7f787affd640 1 --2- 172.21.15.77:0/1289665250 >> v2:172.21.15.159:3300/0 conn(0x7f787c0b1090 0x7f787c0718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.741+0000 7f787affd640 1 -- 172.21.15.77:0/1289665250 >> v1:172.21.15.159:6789/0 conn(0x7f787c071e10 legacy=0x7f787c15f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:02.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.741+0000 7f787affd640 1 -- 172.21.15.77:0/1289665250 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0725e0 con 0x7f787c141b90 2023-11-26T07:20:02.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.743+0000 7f787affd640 1 --2- 172.21.15.77:0/1289665250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787c141b90 0x7f787c0b0b50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f787c0b19a0 tx=0x7f786c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c97033cea507bcb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:02.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.743+0000 7f787a7fc640 1 -- 172.21.15.77:0/1289665250 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c031870 con 0x7f787c141b90 2023-11-26T07:20:02.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.743+0000 7f787a7fc640 1 -- 172.21.15.77:0/1289665250 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c0319d0 con 0x7f787c141b90 2023-11-26T07:20:02.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.743+0000 7f787a7fc640 1 -- 172.21.15.77:0/1289665250 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c031d60 con 0x7f787c141b90 2023-11-26T07:20:02.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.744+0000 7f787bfff640 1 -- 172.21.15.77:0/1289665250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787c141b90 msgr2=0x7f787c0b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.744+0000 7f787bfff640 1 --2- 172.21.15.77:0/1289665250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787c141b90 0x7f787c0b0b50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f787c0b19a0 tx=0x7f786c02b910 comp rx=0 tx=0).stop 2023-11-26T07:20:02.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.744+0000 7f787bfff640 1 -- 172.21.15.77:0/1289665250 shutdown_connections 2023-11-26T07:20:02.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.744+0000 7f787bfff640 1 --2- 172.21.15.77:0/1289665250 >> v2:172.21.15.159:3300/0 conn(0x7f787c0b1090 0x7f787c0718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.744+0000 7f787bfff640 1 --2- 172.21.15.77:0/1289665250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787c141b90 0x7f787c0b0b50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.744+0000 7f787bfff640 1 -- 172.21.15.77:0/1289665250 >> 172.21.15.77:0/1289665250 conn(0x7f787c06a500 msgr2=0x7f787c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:02.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.744+0000 7f787bfff640 1 -- 172.21.15.77:0/1289665250 shutdown_connections 2023-11-26T07:20:02.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.744+0000 7f787bfff640 1 -- 172.21.15.77:0/1289665250 wait complete. 2023-11-26T07:20:02.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.746+0000 7f787bfff640 1 Processor -- start 2023-11-26T07:20:02.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.746+0000 7f787bfff640 1 -- start start 2023-11-26T07:20:02.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f787bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f787c071e10 0x7f787c1f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f787bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787c0b1090 0x7f787c0ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f787bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f787c141b90 0x7f787c0b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f787bfff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0b3520 con 0x7f787c0b1090 2023-11-26T07:20:02.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f787bfff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0adca0 con 0x7f787c141b90 2023-11-26T07:20:02.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f787bfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0ad090 con 0x7f787c071e10 2023-11-26T07:20:02.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f7873fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787c0b1090 0x7f787c0ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f7873fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787c0b1090 0x7f787c0ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50276/0 (socket says 172.21.15.77:50276) 2023-11-26T07:20:02.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f7873fff640 1 -- 172.21.15.77:0/2612104927 learned_addr learned my addr 172.21.15.77:0/2612104927 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:02.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f787b7fe640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f787c141b90 0x7f787c0b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f7873fff640 1 -- 172.21.15.77:0/2612104927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f787c071e10 msgr2=0x7f787c1f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f7873fff640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f787c071e10 0x7f787c1f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f7873fff640 1 -- 172.21.15.77:0/2612104927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f787c141b90 msgr2=0x7f787c0b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f7873fff640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f787c141b90 0x7f787c0b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f7873fff640 1 -- 172.21.15.77:0/2612104927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c0094d0 con 0x7f787c0b1090 2023-11-26T07:20:02.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.747+0000 7f787b7fe640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f787c141b90 0x7f787c0b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:02.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.748+0000 7f7873fff640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787c0b1090 0x7f787c0ac840 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f786400d620 tx=0x7f786400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:02.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.748+0000 7f7878ff9640 1 -- 172.21.15.77:0/2612104927 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400b620 con 0x7f787c0b1090 2023-11-26T07:20:02.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.748+0000 7f7878ff9640 1 -- 172.21.15.77:0/2612104927 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786400b780 con 0x7f787c0b1090 2023-11-26T07:20:02.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.748+0000 7f787bfff640 1 -- 172.21.15.77:0/2612104927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c0ad370 con 0x7f787c0b1090 2023-11-26T07:20:02.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.748+0000 7f7878ff9640 1 -- 172.21.15.77:0/2612104927 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400bb30 con 0x7f787c0b1090 2023-11-26T07:20:02.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.748+0000 7f787bfff640 1 -- 172.21.15.77:0/2612104927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c0ad930 con 0x7f787c0b1090 2023-11-26T07:20:02.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.749+0000 7f787bfff640 1 -- 172.21.15.77:0/2612104927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c04e840 con 0x7f787c0b1090 2023-11-26T07:20:02.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.750+0000 7f7878ff9640 1 -- 172.21.15.77:0/2612104927 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f786400bc90 con 0x7f787c0b1090 2023-11-26T07:20:02.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.751+0000 7f7878ff9640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f785c06b110 0x7f785c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.751+0000 7f7878ff9640 1 -- 172.21.15.77:0/2612104927 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7864089f40 con 0x7f787c0b1090 2023-11-26T07:20:02.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.751+0000 7f787affd640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f785c06b110 0x7f785c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.752+0000 7f787affd640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f785c06b110 0x7f785c06d5d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f786c036000 tx=0x7f786c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:02.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.755+0000 7f7878ff9640 1 -- 172.21.15.77:0/2612104927 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7864054c90 con 0x7f787c0b1090 2023-11-26T07:20:02.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:02.985+0000 7f787bfff640 1 -- 172.21.15.77:0/2612104927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f787c0adde0 con 0x7f787c0b1090 2023-11-26T07:20:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.503+0000 7f7878ff9640 1 -- 172.21.15.77:0/2612104927 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f78640582b0 con 0x7f787c0b1090 2023-11-26T07:20:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 -- 172.21.15.77:0/2612104927 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f785c06b110 msgr2=0x7f785c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f785c06b110 0x7f785c06d5d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f786c036000 tx=0x7f786c030000 comp rx=0 tx=0).stop 2023-11-26T07:20:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 -- 172.21.15.77:0/2612104927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787c0b1090 msgr2=0x7f787c0ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787c0b1090 0x7f787c0ac840 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f786400d620 tx=0x7f786400dae0 comp rx=0 tx=0).stop 2023-11-26T07:20:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 -- 172.21.15.77:0/2612104927 shutdown_connections 2023-11-26T07:20:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f785c06b110 0x7f785c06d5d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f787c141b90 0x7f787c0b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787c0b1090 0x7f787c0ac840 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 --2- 172.21.15.77:0/2612104927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f787c071e10 0x7f787c1f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 -- 172.21.15.77:0/2612104927 >> 172.21.15.77:0/2612104927 conn(0x7f787c06a500 msgr2=0x7f787c1598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 -- 172.21.15.77:0/2612104927 shutdown_connections 2023-11-26T07:20:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.507+0000 7f787bfff640 1 -- 172.21.15.77:0/2612104927 wait complete. 2023-11-26T07:20:03.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:20:03.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.747+0000 7f8ec0490640 1 Processor -- start 2023-11-26T07:20:03.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.748+0000 7f8ec0490640 1 -- start start 2023-11-26T07:20:03.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.749+0000 7f8ec0490640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8eb80cc470 0x7f8eb80abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:03.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.749+0000 7f8ec0490640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8eb80cfb60 0x7f8eb80b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:03.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.749+0000 7f8ec0490640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb80ce270 con 0x7f8eb80ce640 2023-11-26T07:20:03.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.749+0000 7f8ec0490640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb806c560 con 0x7f8eb80cc470 2023-11-26T07:20:03.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.749+0000 7f8ec0490640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb806d0a0 con 0x7f8eb80cfb60 2023-11-26T07:20:03.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.750+0000 7f8ebe22c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8eb80cc470 0x7f8eb80abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.750+0000 7f8ebe22c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8eb80cc470 0x7f8eb80abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50278/0 (socket says 172.21.15.77:50278) 2023-11-26T07:20:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.750+0000 7f8ebe22c640 1 -- 172.21.15.77:0/3151637640 learned_addr learned my addr 172.21.15.77:0/3151637640 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.750+0000 7f8ebea2d640 1 --2- 172.21.15.77:0/3151637640 >> v2:172.21.15.159:3300/0 conn(0x7f8eb80cfb60 0x7f8eb80b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.750+0000 7f8ebe22c640 1 -- 172.21.15.77:0/3151637640 >> v2:172.21.15.159:3300/0 conn(0x7f8eb80cfb60 msgr2=0x7f8eb80b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:03.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.750+0000 7f8ebe22c640 1 --2- 172.21.15.77:0/3151637640 >> v2:172.21.15.159:3300/0 conn(0x7f8eb80cfb60 0x7f8eb80b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:03.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.750+0000 7f8ebe22c640 1 -- 172.21.15.77:0/3151637640 >> v1:172.21.15.159:6789/0 conn(0x7f8eb80ce640 legacy=0x7f8eb80cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:03.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.750+0000 7f8ebe22c640 1 -- 172.21.15.77:0/3151637640 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80b4200 con 0x7f8eb80cc470 2023-11-26T07:20:03.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.751+0000 7f8ebe22c640 1 --2- 172.21.15.77:0/3151637640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8eb80cc470 0x7f8eb80abfc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80b2170 tx=0x7f8eb402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464a5b345e2c4e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.752+0000 7f8ebd22a640 1 -- 172.21.15.77:0/3151637640 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4031870 con 0x7f8eb80cc470 2023-11-26T07:20:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.752+0000 7f8ebd22a640 1 -- 172.21.15.77:0/3151637640 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb40319d0 con 0x7f8eb80cc470 2023-11-26T07:20:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.752+0000 7f8ebd22a640 1 -- 172.21.15.77:0/3151637640 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4031d60 con 0x7f8eb80cc470 2023-11-26T07:20:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.752+0000 7f8ec0490640 1 -- 172.21.15.77:0/3151637640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8eb80cc470 msgr2=0x7f8eb80abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.752+0000 7f8ec0490640 1 --2- 172.21.15.77:0/3151637640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8eb80cc470 0x7f8eb80abfc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80b2170 tx=0x7f8eb402b910 comp rx=0 tx=0).stop 2023-11-26T07:20:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.752+0000 7f8ec0490640 1 -- 172.21.15.77:0/3151637640 shutdown_connections 2023-11-26T07:20:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.752+0000 7f8ec0490640 1 --2- 172.21.15.77:0/3151637640 >> v2:172.21.15.159:3300/0 conn(0x7f8eb80cfb60 0x7f8eb80b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.752+0000 7f8ec0490640 1 --2- 172.21.15.77:0/3151637640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8eb80cc470 0x7f8eb80abfc0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.752+0000 7f8ec0490640 1 -- 172.21.15.77:0/3151637640 >> 172.21.15.77:0/3151637640 conn(0x7f8eb806a920 msgr2=0x7f8eb806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.752+0000 7f8ec0490640 1 -- 172.21.15.77:0/3151637640 shutdown_connections 2023-11-26T07:20:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.752+0000 7f8ec0490640 1 -- 172.21.15.77:0/3151637640 wait complete. 2023-11-26T07:20:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.754+0000 7f8ec0490640 1 Processor -- start 2023-11-26T07:20:03.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.754+0000 7f8ec0490640 1 -- start start 2023-11-26T07:20:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.755+0000 7f8ec0490640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb80cc470 0x7f8eb814c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.755+0000 7f8ec0490640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8eb80ce640 0x7f8eb815d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.755+0000 7f8ec0490640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8eb80cfb60 0x7f8eb815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.755+0000 7f8ec0490640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8157490 con 0x7f8eb80cfb60 2023-11-26T07:20:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.755+0000 7f8ec0490640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8157770 con 0x7f8eb80cc470 2023-11-26T07:20:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.755+0000 7f8ec0490640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8157a50 con 0x7f8eb80ce640 2023-11-26T07:20:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.756+0000 7f8ebea2d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8eb80cfb60 0x7f8eb815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.756+0000 7f8ebea2d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8eb80cfb60 0x7f8eb815afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50294/0 (socket says 172.21.15.77:50294) 2023-11-26T07:20:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.756+0000 7f8ebea2d640 1 -- 172.21.15.77:0/2940660094 learned_addr learned my addr 172.21.15.77:0/2940660094 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.756+0000 7f8ebe22c640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb80cc470 0x7f8eb814c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.756+0000 7f8ebea2d640 1 -- 172.21.15.77:0/2940660094 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8eb80ce640 msgr2=0x7f8eb815d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.756+0000 7f8ebea2d640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8eb80ce640 0x7f8eb815d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.756+0000 7f8ebea2d640 1 -- 172.21.15.77:0/2940660094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb80cc470 msgr2=0x7f8eb814c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.756+0000 7f8ebea2d640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb80cc470 0x7f8eb814c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.756+0000 7f8ebea2d640 1 -- 172.21.15.77:0/2940660094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb40094d0 con 0x7f8eb80cfb60 2023-11-26T07:20:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.756+0000 7f8ebea2d640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8eb80cfb60 0x7f8eb815afb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000cc80 tx=0x7f8eb000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.756+0000 7f8eaeffd640 1 -- 172.21.15.77:0/2940660094 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb000ce30 con 0x7f8eb80cfb60 2023-11-26T07:20:03.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.757+0000 7f8eaeffd640 1 -- 172.21.15.77:0/2940660094 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb0003990 con 0x7f8eb80cfb60 2023-11-26T07:20:03.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.757+0000 7f8eaeffd640 1 -- 172.21.15.77:0/2940660094 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0003d20 con 0x7f8eb80cfb60 2023-11-26T07:20:03.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.757+0000 7f8ec0490640 1 -- 172.21.15.77:0/2940660094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb8157d30 con 0x7f8eb80cfb60 2023-11-26T07:20:03.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.757+0000 7f8ec0490640 1 -- 172.21.15.77:0/2940660094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb81570b0 con 0x7f8eb80cfb60 2023-11-26T07:20:03.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.758+0000 7f8ec0490640 1 -- 172.21.15.77:0/2940660094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb8158c50 con 0x7f8eb80cfb60 2023-11-26T07:20:03.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.759+0000 7f8eaeffd640 1 -- 172.21.15.77:0/2940660094 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f8eb0003e80 con 0x7f8eb80cfb60 2023-11-26T07:20:03.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.759+0000 7f8eaeffd640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e9c06b110 0x7f8e9c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:03.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.760+0000 7f8eaeffd640 1 -- 172.21.15.77:0/2940660094 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8eb0089fa0 con 0x7f8eb80cfb60 2023-11-26T07:20:03.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.760+0000 7f8ebe22c640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e9c06b110 0x7f8e9c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:03.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.761+0000 7f8ebe22c640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e9c06b110 0x7f8e9c06d5d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4036000 tx=0x7f8eb403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:03.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.764+0000 7f8eaeffd640 1 -- 172.21.15.77:0/2940660094 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8eb8158c50 con 0x7f8eb80cfb60 2023-11-26T07:20:03.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:03.956+0000 7f8ec0490640 1 -- 172.21.15.77:0/2940660094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8eb8158c50 con 0x7f8eb80cfb60 2023-11-26T07:20:04.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.850+0000 7f8eaeffd640 1 -- 172.21.15.77:0/2940660094 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8eb8158c50 con 0x7f8eb80cfb60 2023-11-26T07:20:04.854 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:20:04.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.855+0000 7f8ec0490640 1 -- 172.21.15.77:0/2940660094 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e9c06b110 msgr2=0x7f8e9c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:04.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.855+0000 7f8ec0490640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e9c06b110 0x7f8e9c06d5d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4036000 tx=0x7f8eb403c040 comp rx=0 tx=0).stop 2023-11-26T07:20:04.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.855+0000 7f8ec0490640 1 -- 172.21.15.77:0/2940660094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8eb80cfb60 msgr2=0x7f8eb815afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:04.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.855+0000 7f8ec0490640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8eb80cfb60 0x7f8eb815afb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000cc80 tx=0x7f8eb000a5c0 comp rx=0 tx=0).stop 2023-11-26T07:20:04.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.855+0000 7f8ec0490640 1 -- 172.21.15.77:0/2940660094 shutdown_connections 2023-11-26T07:20:04.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.855+0000 7f8ec0490640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8e9c06b110 0x7f8e9c06d5d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:04.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.855+0000 7f8ec0490640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8eb80cfb60 0x7f8eb815afb0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:04.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.855+0000 7f8ec0490640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8eb80ce640 0x7f8eb815d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:04.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.855+0000 7f8ec0490640 1 --2- 172.21.15.77:0/2940660094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb80cc470 0x7f8eb814c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:04.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.855+0000 7f8ec0490640 1 -- 172.21.15.77:0/2940660094 >> 172.21.15.77:0/2940660094 conn(0x7f8eb806a920 msgr2=0x7f8eb80ad630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:04.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.856+0000 7f8ec0490640 1 -- 172.21.15.77:0/2940660094 shutdown_connections 2023-11-26T07:20:04.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:04.856+0000 7f8ec0490640 1 -- 172.21.15.77:0/2940660094 wait complete. 2023-11-26T07:20:04.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:20:05.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.094+0000 7f1b1f832640 1 Processor -- start 2023-11-26T07:20:05.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.095+0000 7f1b1f832640 1 -- start start 2023-11-26T07:20:05.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.096+0000 7f1b1f832640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b1815c7f0 0x7f1b1806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:05.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.096+0000 7f1b1f832640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1b180ce6c0 0x7f1b180cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:05.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.096+0000 7f1b1f832640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b180cece0 con 0x7f1b180cf450 2023-11-26T07:20:05.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.096+0000 7f1b1f832640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b18156010 con 0x7f1b180ce6c0 2023-11-26T07:20:05.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.096+0000 7f1b1f832640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1806ce30 con 0x7f1b1815c7f0 2023-11-26T07:20:05.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.096+0000 7f1b1ddcf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1b180ce6c0 0x7f1b180cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:05.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.096+0000 7f1b1ddcf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1b180ce6c0 0x7f1b180cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50302/0 (socket says 172.21.15.77:50302) 2023-11-26T07:20:05.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.096+0000 7f1b1ddcf640 1 -- 172.21.15.77:0/1891253274 learned_addr learned my addr 172.21.15.77:0/1891253274 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:05.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.097+0000 7f1b1d5ce640 1 --2- 172.21.15.77:0/1891253274 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b1815c7f0 0x7f1b1806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:05.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.097+0000 7f1b1ddcf640 1 -- 172.21.15.77:0/1891253274 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b1815c7f0 msgr2=0x7f1b1806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:05.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.097+0000 7f1b1ddcf640 1 --2- 172.21.15.77:0/1891253274 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b1815c7f0 0x7f1b1806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:05.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.097+0000 7f1b1ddcf640 1 -- 172.21.15.77:0/1891253274 >> v1:172.21.15.159:6789/0 conn(0x7f1b180cf450 legacy=0x7f1b180cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:05.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.097+0000 7f1b1ddcf640 1 -- 172.21.15.77:0/1891253274 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1806d040 con 0x7f1b180ce6c0 2023-11-26T07:20:05.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.098+0000 7f1b1ddcf640 1 --2- 172.21.15.77:0/1891253274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b180ce6c0 0x7f1b180cf8d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009e50 tx=0x7f1b1002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4716530cf926b82 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:05.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.099+0000 7f1b0ffff640 1 -- 172.21.15.77:0/1891253274 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1002ca70 con 0x7f1b180ce6c0 2023-11-26T07:20:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.099+0000 7f1b0ffff640 1 -- 172.21.15.77:0/1891253274 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1002cbd0 con 0x7f1b180ce6c0 2023-11-26T07:20:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.099+0000 7f1b0ffff640 1 -- 172.21.15.77:0/1891253274 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100343f0 con 0x7f1b180ce6c0 2023-11-26T07:20:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.099+0000 7f1b1f832640 1 -- 172.21.15.77:0/1891253274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b180ce6c0 msgr2=0x7f1b180cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.099+0000 7f1b1f832640 1 --2- 172.21.15.77:0/1891253274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b180ce6c0 0x7f1b180cf8d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009e50 tx=0x7f1b1002bed0 comp rx=0 tx=0).stop 2023-11-26T07:20:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.100+0000 7f1b1f832640 1 -- 172.21.15.77:0/1891253274 shutdown_connections 2023-11-26T07:20:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.100+0000 7f1b1f832640 1 --2- 172.21.15.77:0/1891253274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b180ce6c0 0x7f1b180cf8d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.100+0000 7f1b1f832640 1 --2- 172.21.15.77:0/1891253274 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b1815c7f0 0x7f1b1806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.100+0000 7f1b1f832640 1 -- 172.21.15.77:0/1891253274 >> 172.21.15.77:0/1891253274 conn(0x7f1b1806a920 msgr2=0x7f1b1806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.100+0000 7f1b1f832640 1 -- 172.21.15.77:0/1891253274 shutdown_connections 2023-11-26T07:20:05.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.100+0000 7f1b1f832640 1 -- 172.21.15.77:0/1891253274 wait complete. 2023-11-26T07:20:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.102+0000 7f1b1f832640 1 Processor -- start 2023-11-26T07:20:05.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.102+0000 7f1b1f832640 1 -- start start 2023-11-26T07:20:05.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.104+0000 7f1b1f832640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b180ce6c0 0x7f1b181510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:05.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.104+0000 7f1b1f832640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b180cf450 0x7f1b180b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:05.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.104+0000 7f1b1f832640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b1815c7f0 0x7f1b1815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:05.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.104+0000 7f1b1f832640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1815de60 con 0x7f1b180ce6c0 2023-11-26T07:20:05.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.104+0000 7f1b1f832640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1815e140 con 0x7f1b180cf450 2023-11-26T07:20:05.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.104+0000 7f1b1f832640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b180ac060 con 0x7f1b1815c7f0 2023-11-26T07:20:05.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.104+0000 7f1b1d5ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b180ce6c0 0x7f1b181510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:05.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.104+0000 7f1b1d5ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b180ce6c0 0x7f1b181510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50316/0 (socket says 172.21.15.77:50316) 2023-11-26T07:20:05.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.104+0000 7f1b1d5ce640 1 -- 172.21.15.77:0/4170350572 learned_addr learned my addr 172.21.15.77:0/4170350572 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.105+0000 7f1b1ddcf640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b1815c7f0 0x7f1b1815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.105+0000 7f1b1cdcd640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b180cf450 0x7f1b180b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.105+0000 7f1b1d5ce640 1 -- 172.21.15.77:0/4170350572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b1815c7f0 msgr2=0x7f1b1815b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:05.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.105+0000 7f1b1d5ce640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b1815c7f0 0x7f1b1815b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.105+0000 7f1b1d5ce640 1 -- 172.21.15.77:0/4170350572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b180cf450 msgr2=0x7f1b180b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.105+0000 7f1b1d5ce640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b180cf450 0x7f1b180b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.105+0000 7f1b1d5ce640 1 -- 172.21.15.77:0/4170350572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b10009b30 con 0x7f1b180ce6c0 2023-11-26T07:20:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.105+0000 7f1b1ddcf640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b1815c7f0 0x7f1b1815b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.106+0000 7f1b1d5ce640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b180ce6c0 0x7f1b181510a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400d5f0 tx=0x7f1b1400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.106+0000 7f1b0dffb640 1 -- 172.21.15.77:0/4170350572 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b140125f0 con 0x7f1b180ce6c0 2023-11-26T07:20:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.106+0000 7f1b0dffb640 1 -- 172.21.15.77:0/4170350572 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b14012750 con 0x7f1b180ce6c0 2023-11-26T07:20:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.106+0000 7f1b0dffb640 1 -- 172.21.15.77:0/4170350572 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14012b00 con 0x7f1b180ce6c0 2023-11-26T07:20:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.106+0000 7f1b1f832640 1 -- 172.21.15.77:0/4170350572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b180ac340 con 0x7f1b180ce6c0 2023-11-26T07:20:05.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.106+0000 7f1b1f832640 1 -- 172.21.15.77:0/4170350572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b180b2620 con 0x7f1b180ce6c0 2023-11-26T07:20:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.108+0000 7f1b1f832640 1 -- 172.21.15.77:0/4170350572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b18067470 con 0x7f1b180ce6c0 2023-11-26T07:20:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.109+0000 7f1b0dffb640 1 -- 172.21.15.77:0/4170350572 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f1b14012c60 con 0x7f1b180ce6c0 2023-11-26T07:20:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.110+0000 7f1b0dffb640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1afc06b110 0x7f1afc06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.110+0000 7f1b0dffb640 1 -- 172.21.15.77:0/4170350572 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f1b14089cd0 con 0x7f1b180ce6c0 2023-11-26T07:20:05.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.110+0000 7f1b1cdcd640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1afc06b110 0x7f1afc06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:05.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.111+0000 7f1b1cdcd640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1afc06b110 0x7f1afc06d5d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1b180af760 tx=0x7f1b08007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:05.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.114+0000 7f1b0dffb640 1 -- 172.21.15.77:0/4170350572 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b14054b90 con 0x7f1b180ce6c0 2023-11-26T07:20:05.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.302+0000 7f1b1f832640 1 -- 172.21.15.77:0/4170350572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1b180cd730 con 0x7f1b180ce6c0 2023-11-26T07:20:05.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.859+0000 7f1b0dffb640 1 -- 172.21.15.77:0/4170350572 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1b140581b0 con 0x7f1b180ce6c0 2023-11-26T07:20:05.862 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-11-26T07:20:05.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.863+0000 7f1b1f832640 1 -- 172.21.15.77:0/4170350572 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1afc06b110 msgr2=0x7f1afc06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:05.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.863+0000 7f1b1f832640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1afc06b110 0x7f1afc06d5d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1b180af760 tx=0x7f1b08007e30 comp rx=0 tx=0).stop 2023-11-26T07:20:05.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.863+0000 7f1b1f832640 1 -- 172.21.15.77:0/4170350572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b180ce6c0 msgr2=0x7f1b181510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:05.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.863+0000 7f1b1f832640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b180ce6c0 0x7f1b181510a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400d5f0 tx=0x7f1b1400dab0 comp rx=0 tx=0).stop 2023-11-26T07:20:05.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.864+0000 7f1b1f832640 1 -- 172.21.15.77:0/4170350572 shutdown_connections 2023-11-26T07:20:05.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.864+0000 7f1b1f832640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1afc06b110 0x7f1afc06d5d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:05.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.864+0000 7f1b1f832640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b1815c7f0 0x7f1b1815b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:05.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.864+0000 7f1b1f832640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b180cf450 0x7f1b180b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:05.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.864+0000 7f1b1f832640 1 --2- 172.21.15.77:0/4170350572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b180ce6c0 0x7f1b181510a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:05.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.864+0000 7f1b1f832640 1 -- 172.21.15.77:0/4170350572 >> 172.21.15.77:0/4170350572 conn(0x7f1b1806a920 msgr2=0x7f1b180734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:05.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.865+0000 7f1b1f832640 1 -- 172.21.15.77:0/4170350572 shutdown_connections 2023-11-26T07:20:05.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:05.865+0000 7f1b1f832640 1 -- 172.21.15.77:0/4170350572 wait complete. 2023-11-26T07:20:05.890 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:20:06.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.095+0000 7ff263553640 1 Processor -- start 2023-11-26T07:20:06.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.095+0000 7ff263553640 1 -- start start 2023-11-26T07:20:06.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.096+0000 7ff263553640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff25c15b440 0x7ff25c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff263553640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff25c0c59b0 0x7ff25c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff263553640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c0cc3a0 con 0x7ff25c0cbf20 2023-11-26T07:20:06.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff263553640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25c15b820 con 0x7ff25c0c59b0 2023-11-26T07:20:06.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff263553640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c15eea0 con 0x7ff25c15b440 2023-11-26T07:20:06.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff261af0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff25c0c59b0 0x7ff25c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:06.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff261af0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff25c0c59b0 0x7ff25c06c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54516/0 (socket says 172.21.15.77:54516) 2023-11-26T07:20:06.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff261af0640 1 -- 172.21.15.77:0/3726606560 learned_addr learned my addr 172.21.15.77:0/3726606560 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:06.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff261af0640 1 -- 172.21.15.77:0/3726606560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff25c15b440 msgr2=0x7ff25c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:06.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff2612ef640 1 --2- 172.21.15.77:0/3726606560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff25c15b440 0x7ff25c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:06.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff261af0640 1 --2- 172.21.15.77:0/3726606560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff25c15b440 0x7ff25c0cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff261af0640 1 -- 172.21.15.77:0/3726606560 >> v1:172.21.15.159:6789/0 conn(0x7ff25c0cbf20 legacy=0x7ff25c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:06.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.097+0000 7ff261af0640 1 -- 172.21.15.77:0/3726606560 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c0abf30 con 0x7ff25c0c59b0 2023-11-26T07:20:06.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.099+0000 7ff261af0640 1 --2- 172.21.15.77:0/3726606560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c0c59b0 0x7ff25c06c5f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff254009e50 tx=0x7ff25402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f6a3c68d1b9eca server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:06.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.099+0000 7ff253fff640 1 -- 172.21.15.77:0/3726606560 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25402c9e0 con 0x7ff25c0c59b0 2023-11-26T07:20:06.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.099+0000 7ff253fff640 1 -- 172.21.15.77:0/3726606560 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25402cb40 con 0x7ff25c0c59b0 2023-11-26T07:20:06.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.099+0000 7ff253fff640 1 -- 172.21.15.77:0/3726606560 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2540343f0 con 0x7ff25c0c59b0 2023-11-26T07:20:06.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.099+0000 7ff263553640 1 -- 172.21.15.77:0/3726606560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c0c59b0 msgr2=0x7ff25c06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.099+0000 7ff263553640 1 --2- 172.21.15.77:0/3726606560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c0c59b0 0x7ff25c06c5f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff254009e50 tx=0x7ff25402be40 comp rx=0 tx=0).stop 2023-11-26T07:20:06.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.100+0000 7ff263553640 1 -- 172.21.15.77:0/3726606560 shutdown_connections 2023-11-26T07:20:06.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.100+0000 7ff263553640 1 --2- 172.21.15.77:0/3726606560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c0c59b0 0x7ff25c06c5f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.100+0000 7ff263553640 1 --2- 172.21.15.77:0/3726606560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff25c15b440 0x7ff25c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.100+0000 7ff263553640 1 -- 172.21.15.77:0/3726606560 >> 172.21.15.77:0/3726606560 conn(0x7ff25c0b0c50 msgr2=0x7ff25c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:06.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.100+0000 7ff263553640 1 -- 172.21.15.77:0/3726606560 shutdown_connections 2023-11-26T07:20:06.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.100+0000 7ff263553640 1 -- 172.21.15.77:0/3726606560 wait complete. 2023-11-26T07:20:06.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.101+0000 7ff263553640 1 Processor -- start 2023-11-26T07:20:06.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.102+0000 7ff263553640 1 -- start start 2023-11-26T07:20:06.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.102+0000 7ff263553640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c0c59b0 0x7ff25c154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff263553640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff25c0cbf20 0x7ff25c0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff263553640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff25c15b440 0x7ff25c1561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff263553640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c1554b0 con 0x7ff25c0c59b0 2023-11-26T07:20:06.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff263553640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0cea70 con 0x7ff25c0cbf20 2023-11-26T07:20:06.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff263553640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c155700 con 0x7ff25c15b440 2023-11-26T07:20:06.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff2612ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c0c59b0 0x7ff25c154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:06.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff2612ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c0c59b0 0x7ff25c154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54520/0 (socket says 172.21.15.77:54520) 2023-11-26T07:20:06.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff2612ef640 1 -- 172.21.15.77:0/2424175302 learned_addr learned my addr 172.21.15.77:0/2424175302 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:06.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff260aee640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff25c0cbf20 0x7ff25c0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:06.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff2612ef640 1 -- 172.21.15.77:0/2424175302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff25c15b440 msgr2=0x7ff25c1561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff2612ef640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff25c15b440 0x7ff25c1561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff2612ef640 1 -- 172.21.15.77:0/2424175302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff25c0cbf20 msgr2=0x7ff25c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff2612ef640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff25c0cbf20 0x7ff25c0c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.103+0000 7ff2612ef640 1 -- 172.21.15.77:0/2424175302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff254009b30 con 0x7ff25c0c59b0 2023-11-26T07:20:06.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.104+0000 7ff2612ef640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c0c59b0 0x7ff25c154030 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c7f0 tx=0x7ff25800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:06.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.104+0000 7ff251ffb640 1 -- 172.21.15.77:0/2424175302 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258004220 con 0x7ff25c0c59b0 2023-11-26T07:20:06.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.104+0000 7ff251ffb640 1 -- 172.21.15.77:0/2424175302 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff258004380 con 0x7ff25c0c59b0 2023-11-26T07:20:06.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.104+0000 7ff263553640 1 -- 172.21.15.77:0/2424175302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c1559e0 con 0x7ff25c0c59b0 2023-11-26T07:20:06.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.104+0000 7ff251ffb640 1 -- 172.21.15.77:0/2424175302 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258007840 con 0x7ff25c0c59b0 2023-11-26T07:20:06.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.104+0000 7ff263553640 1 -- 172.21.15.77:0/2424175302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c0ce290 con 0x7ff25c0c59b0 2023-11-26T07:20:06.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.105+0000 7ff263553640 1 -- 172.21.15.77:0/2424175302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25c155f00 con 0x7ff25c0c59b0 2023-11-26T07:20:06.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.106+0000 7ff251ffb640 1 -- 172.21.15.77:0/2424175302 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7ff258007bb0 con 0x7ff25c0c59b0 2023-11-26T07:20:06.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.107+0000 7ff251ffb640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff24006b110 0x7ff24006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.107+0000 7ff251ffb640 1 -- 172.21.15.77:0/2424175302 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff258089740 con 0x7ff25c0c59b0 2023-11-26T07:20:06.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.107+0000 7ff260aee640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff24006b110 0x7ff24006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:06.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.108+0000 7ff260aee640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff24006b110 0x7ff24006d5d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff25c1569a0 tx=0x7ff24c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:06.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.112+0000 7ff251ffb640 1 -- 172.21.15.77:0/2424175302 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff25c155f00 con 0x7ff25c0c59b0 2023-11-26T07:20:06.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.311+0000 7ff263553640 1 -- 172.21.15.77:0/2424175302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7ff25c155f00 con 0x7ff25c0c59b0 2023-11-26T07:20:06.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.316+0000 7ff251ffb640 1 -- 172.21.15.77:0/2424175302 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7ff25c155f00 con 0x7ff25c0c59b0 2023-11-26T07:20:06.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 -- 172.21.15.77:0/2424175302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff24006b110 msgr2=0x7ff24006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff24006b110 0x7ff24006d5d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff25c1569a0 tx=0x7ff24c009040 comp rx=0 tx=0).stop 2023-11-26T07:20:06.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 -- 172.21.15.77:0/2424175302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c0c59b0 msgr2=0x7ff25c154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c0c59b0 0x7ff25c154030 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c7f0 tx=0x7ff25800ccb0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 -- 172.21.15.77:0/2424175302 shutdown_connections 2023-11-26T07:20:06.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff24006b110 0x7ff24006d5d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff25c15b440 0x7ff25c1561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff25c0cbf20 0x7ff25c0c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 --2- 172.21.15.77:0/2424175302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c0c59b0 0x7ff25c154030 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 -- 172.21.15.77:0/2424175302 >> 172.21.15.77:0/2424175302 conn(0x7ff25c0b0c50 msgr2=0x7ff25c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:06.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 -- 172.21.15.77:0/2424175302 shutdown_connections 2023-11-26T07:20:06.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.319+0000 7ff263553640 1 -- 172.21.15.77:0/2424175302 wait complete. 2023-11-26T07:20:06.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:20:06.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.548+0000 7fec72000640 1 Processor -- start 2023-11-26T07:20:06.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.548+0000 7fec72000640 1 -- start start 2023-11-26T07:20:06.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.550+0000 7fec72000640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fec6c15b440 0x7fec6c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.550+0000 7fec72000640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec6c0c59b0 0x7fec6c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.550+0000 7fec72000640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c15eea0 con 0x7fec6c0cbf20 2023-11-26T07:20:06.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.550+0000 7fec72000640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6c0c5e00 con 0x7fec6c15b440 2023-11-26T07:20:06.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.550+0000 7fec72000640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0cc3d0 con 0x7fec6c0c59b0 2023-11-26T07:20:06.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.550+0000 7fec6bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec6c0c59b0 0x7fec6c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:06.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.550+0000 7fec6b7fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fec6c15b440 0x7fec6c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:06.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.551+0000 7fec6b7fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fec6c15b440 0x7fec6c0cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:49434/0 (socket says 172.21.15.77:49434) 2023-11-26T07:20:06.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.551+0000 7fec6bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec6c0c59b0 0x7fec6c06c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:44406/0 (socket says 172.21.15.77:44406) 2023-11-26T07:20:06.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.551+0000 7fec6b7fe640 1 -- 172.21.15.77:0/87392696 learned_addr learned my addr 172.21.15.77:0/87392696 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:06.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.551+0000 7fec6bfff640 1 -- 172.21.15.77:0/87392696 >> v2:172.21.15.159:3300/0 conn(0x7fec6c15b440 msgr2=0x7fec6c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:06.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.551+0000 7fec6bfff640 1 --2- 172.21.15.77:0/87392696 >> v2:172.21.15.159:3300/0 conn(0x7fec6c15b440 0x7fec6c0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.551+0000 7fec6bfff640 1 -- 172.21.15.77:0/87392696 >> v1:172.21.15.159:6789/0 conn(0x7fec6c0cbf20 legacy=0x7fec6c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.551+0000 7fec6bfff640 1 -- 172.21.15.77:0/87392696 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c0abf30 con 0x7fec6c0c59b0 2023-11-26T07:20:06.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.551+0000 7fec6b7fe640 1 --2- 172.21.15.77:0/87392696 >> v2:172.21.15.159:3300/0 conn(0x7fec6c15b440 0x7fec6c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:20:06.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.553+0000 7fec6bfff640 1 --2- 172.21.15.77:0/87392696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec6c0c59b0 0x7fec6c06c5f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fec64009d90 tx=0x7fec6402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3bf95365ebf7f5b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:06.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.553+0000 7fec6affd640 1 -- 172.21.15.77:0/87392696 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6402cbd0 con 0x7fec6c0c59b0 2023-11-26T07:20:06.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.553+0000 7fec6affd640 1 -- 172.21.15.77:0/87392696 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6402cd30 con 0x7fec6c0c59b0 2023-11-26T07:20:06.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.553+0000 7fec6affd640 1 -- 172.21.15.77:0/87392696 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6402cea0 con 0x7fec6c0c59b0 2023-11-26T07:20:06.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.554+0000 7fec72000640 1 -- 172.21.15.77:0/87392696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec6c0c59b0 msgr2=0x7fec6c06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.554+0000 7fec72000640 1 --2- 172.21.15.77:0/87392696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec6c0c59b0 0x7fec6c06c5f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fec64009d90 tx=0x7fec6402be20 comp rx=0 tx=0).stop 2023-11-26T07:20:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.554+0000 7fec72000640 1 -- 172.21.15.77:0/87392696 shutdown_connections 2023-11-26T07:20:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.554+0000 7fec72000640 1 --2- 172.21.15.77:0/87392696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec6c0c59b0 0x7fec6c06c5f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.554+0000 7fec72000640 1 --2- 172.21.15.77:0/87392696 >> v2:172.21.15.159:3300/0 conn(0x7fec6c15b440 0x7fec6c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.554+0000 7fec72000640 1 -- 172.21.15.77:0/87392696 >> 172.21.15.77:0/87392696 conn(0x7fec6c0b0c50 msgr2=0x7fec6c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.554+0000 7fec72000640 1 -- 172.21.15.77:0/87392696 shutdown_connections 2023-11-26T07:20:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.554+0000 7fec72000640 1 -- 172.21.15.77:0/87392696 wait complete. 2023-11-26T07:20:06.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.556+0000 7fec72000640 1 Processor -- start 2023-11-26T07:20:06.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.556+0000 7fec72000640 1 -- start start 2023-11-26T07:20:06.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.557+0000 7fec72000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec6c0c59b0 0x7fec6c0b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.557+0000 7fec72000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0cbf20 0x7fec6c1f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.557+0000 7fec72000640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec6c15b440 0x7fec6c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.557+0000 7fec72000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c155280 con 0x7fec6c0c59b0 2023-11-26T07:20:06.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.557+0000 7fec72000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c1f3720 con 0x7fec6c0cbf20 2023-11-26T07:20:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.557+0000 7fec72000640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c1f3420 con 0x7fec6c15b440 2023-11-26T07:20:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.557+0000 7fec6b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec6c0c59b0 0x7fec6c0b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.557+0000 7fec6b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec6c0c59b0 0x7fec6c0b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54522/0 (socket says 172.21.15.77:54522) 2023-11-26T07:20:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.557+0000 7fec6b7fe640 1 -- 172.21.15.77:0/3093548951 learned_addr learned my addr 172.21.15.77:0/3093548951 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec63fff640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0cbf20 0x7fec6c1f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec6b7fe640 1 -- 172.21.15.77:0/3093548951 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec6c15b440 msgr2=0x7fec6c0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec6b7fe640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec6c15b440 0x7fec6c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec6b7fe640 1 -- 172.21.15.77:0/3093548951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0cbf20 msgr2=0x7fec6c1f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec6b7fe640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0cbf20 0x7fec6c1f3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec6b7fe640 1 -- 172.21.15.77:0/3093548951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0094d0 con 0x7fec6c0c59b0 2023-11-26T07:20:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec6b7fe640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec6c0c59b0 0x7fec6c0b3cc0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00e9e0 tx=0x7fec5c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:06.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec68ff9640 1 -- 172.21.15.77:0/3093548951 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c00c9d0 con 0x7fec6c0c59b0 2023-11-26T07:20:06.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec68ff9640 1 -- 172.21.15.77:0/3093548951 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c00cb30 con 0x7fec6c0c59b0 2023-11-26T07:20:06.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec68ff9640 1 -- 172.21.15.77:0/3093548951 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c00cea0 con 0x7fec6c0c59b0 2023-11-26T07:20:06.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec72000640 1 -- 172.21.15.77:0/3093548951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec64009a70 con 0x7fec6c0c59b0 2023-11-26T07:20:06.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.558+0000 7fec72000640 1 -- 172.21.15.77:0/3093548951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c0b4780 con 0x7fec6c0c59b0 2023-11-26T07:20:06.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.559+0000 7fec72000640 1 -- 172.21.15.77:0/3093548951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c04e8b0 con 0x7fec6c0c59b0 2023-11-26T07:20:06.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.560+0000 7fec68ff9640 1 -- 172.21.15.77:0/3093548951 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fec5c013470 con 0x7fec6c0c59b0 2023-11-26T07:20:06.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.561+0000 7fec68ff9640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fec4c06b110 0x7fec4c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:06.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.561+0000 7fec68ff9640 1 -- 172.21.15.77:0/3093548951 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fec5c089b20 con 0x7fec6c0c59b0 2023-11-26T07:20:06.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.562+0000 7fec63fff640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fec4c06b110 0x7fec4c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:06.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.562+0000 7fec63fff640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fec4c06b110 0x7fec4c06d5d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fec6c15ee70 tx=0x7fec54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:06.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.566+0000 7fec68ff9640 1 -- 172.21.15.77:0/3093548951 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec5c054a60 con 0x7fec6c0c59b0 2023-11-26T07:20:06.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.756+0000 7fec72000640 1 -- 172.21.15.77:0/3093548951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fec6c0ca590 con 0x7fec6c0c59b0 2023-11-26T07:20:06.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.761+0000 7fec68ff9640 1 -- 172.21.15.77:0/3093548951 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fec5c058080 con 0x7fec6c0c59b0 2023-11-26T07:20:06.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 -- 172.21.15.77:0/3093548951 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fec4c06b110 msgr2=0x7fec4c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fec4c06b110 0x7fec4c06d5d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fec6c15ee70 tx=0x7fec54009040 comp rx=0 tx=0).stop 2023-11-26T07:20:06.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 -- 172.21.15.77:0/3093548951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec6c0c59b0 msgr2=0x7fec6c0b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec6c0c59b0 0x7fec6c0b3cc0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00e9e0 tx=0x7fec5c00eea0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 -- 172.21.15.77:0/3093548951 shutdown_connections 2023-11-26T07:20:06.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fec4c06b110 0x7fec4c06d5d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec6c15b440 0x7fec6c0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec6c0cbf20 0x7fec6c1f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 --2- 172.21.15.77:0/3093548951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec6c0c59b0 0x7fec6c0b3cc0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 -- 172.21.15.77:0/3093548951 >> 172.21.15.77:0/3093548951 conn(0x7fec6c0b0c50 msgr2=0x7fec6c070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:06.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 -- 172.21.15.77:0/3093548951 shutdown_connections 2023-11-26T07:20:06.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.764+0000 7fec72000640 1 -- 172.21.15.77:0/3093548951 wait complete. 2023-11-26T07:20:06.786 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2023-11-26T07:20:06.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.996+0000 7f2183c0e640 1 Processor -- start 2023-11-26T07:20:06.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.996+0000 7f2183c0e640 1 -- start start 2023-11-26T07:20:07.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.997+0000 7f2183c0e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f217c157c70 0x7f217c161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:07.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.997+0000 7f2183c0e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217c0ce0b0 con 0x7f217c0cf450 2023-11-26T07:20:07.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.997+0000 7f2183c0e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217c161960 con 0x7f217c15e390 2023-11-26T07:20:07.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.997+0000 7f2183c0e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217c15e8d0 con 0x7f217c157c70 2023-11-26T07:20:07.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.997+0000 7f21819aa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f217c157c70 0x7f217c161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:07.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.998+0000 7f21819aa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f217c157c70 0x7f217c161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54526/0 (socket says 172.21.15.77:54526) 2023-11-26T07:20:07.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.998+0000 7f21819aa640 1 -- 172.21.15.77:0/1294204461 learned_addr learned my addr 172.21.15.77:0/1294204461 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:07.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.998+0000 7f21811a9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f217c0cf450 0x7f217c15dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58074/0 (socket says 172.21.15.77:58074) 2023-11-26T07:20:07.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.998+0000 7f21819aa640 1 -- 172.21.15.77:0/1294204461 >> v1:172.21.15.159:6789/0 conn(0x7f217c15e390 legacy=0x7f217c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:07.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.998+0000 7f21819aa640 1 -- 172.21.15.77:0/1294204461 >> v1:172.21.15.77:6789/0 conn(0x7f217c0cf450 legacy=0x7f217c15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:07.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.998+0000 7f21819aa640 1 -- 172.21.15.77:0/1294204461 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c15ebb0 con 0x7f217c157c70 2023-11-26T07:20:07.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.998+0000 7f21809a8640 1 -- 172.21.15.77:0/1294204461 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332224910 0 0) 0x7f217c0ce0b0 con 0x7f217c0cf450 2023-11-26T07:20:07.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.999+0000 7f21819aa640 1 --2- 172.21.15.77:0/1294204461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f217c157c70 0x7f217c161df0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2178009870 tx=0x7f217802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3145add366182f7a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:07.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:06.999+0000 7f21809a8640 1 -- 172.21.15.77:0/1294204461 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2178031870 con 0x7f217c157c70 2023-11-26T07:20:07.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.000+0000 7f21809a8640 1 -- 172.21.15.77:0/1294204461 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21780319d0 con 0x7f217c157c70 2023-11-26T07:20:07.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.000+0000 7f21809a8640 1 -- 172.21.15.77:0/1294204461 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2178031d60 con 0x7f217c157c70 2023-11-26T07:20:07.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.000+0000 7f2183c0e640 1 -- 172.21.15.77:0/1294204461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f217c157c70 msgr2=0x7f217c161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:07.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.000+0000 7f2183c0e640 1 --2- 172.21.15.77:0/1294204461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f217c157c70 0x7f217c161df0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2178009870 tx=0x7f217802b910 comp rx=0 tx=0).stop 2023-11-26T07:20:07.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.000+0000 7f2183c0e640 1 -- 172.21.15.77:0/1294204461 shutdown_connections 2023-11-26T07:20:07.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.000+0000 7f2183c0e640 1 --2- 172.21.15.77:0/1294204461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f217c157c70 0x7f217c161df0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:07.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.000+0000 7f2183c0e640 1 -- 172.21.15.77:0/1294204461 >> 172.21.15.77:0/1294204461 conn(0x7f217c06a920 msgr2=0x7f217c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:07.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.000+0000 7f2183c0e640 1 -- 172.21.15.77:0/1294204461 shutdown_connections 2023-11-26T07:20:07.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.000+0000 7f2183c0e640 1 -- 172.21.15.77:0/1294204461 wait complete. 2023-11-26T07:20:07.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.002+0000 7f2183c0e640 1 Processor -- start 2023-11-26T07:20:07.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.002+0000 7f2183c0e640 1 -- start start 2023-11-26T07:20:07.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.003+0000 7f2183c0e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f217c0cf450 0x7f217c09a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:07.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.003+0000 7f2183c0e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f217c157c70 0x7f217c14cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:07.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.003+0000 7f2183c0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f217c15e390 0x7f217c14c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:07.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.003+0000 7f2183c0e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c14d4a0 con 0x7f217c15e390 2023-11-26T07:20:07.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.003+0000 7f2183c0e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c14d700 con 0x7f217c157c70 2023-11-26T07:20:07.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.003+0000 7f2183c0e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c14d9e0 con 0x7f217c0cf450 2023-11-26T07:20:07.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.004+0000 7f21821ab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f217c15e390 0x7f217c14c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.004+0000 7f21821ab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f217c15e390 0x7f217c14c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54528/0 (socket says 172.21.15.77:54528) 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.004+0000 7f21821ab640 1 -- 172.21.15.77:0/2590987095 learned_addr learned my addr 172.21.15.77:0/2590987095 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.004+0000 7f21821ab640 1 -- 172.21.15.77:0/2590987095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f217c0cf450 msgr2=0x7f217c09a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.004+0000 7f21821ab640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f217c0cf450 0x7f217c09a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.004+0000 7f21821ab640 1 -- 172.21.15.77:0/2590987095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f217c157c70 msgr2=0x7f217c14cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.004+0000 7f21811a9640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f217c157c70 0x7f217c14cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.004+0000 7f21821ab640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f217c157c70 0x7f217c14cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.004+0000 7f21821ab640 1 -- 172.21.15.77:0/2590987095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780094d0 con 0x7f217c15e390 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.004+0000 7f21821ab640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f217c15e390 0x7f217c14c750 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f217400c780 tx=0x7f217400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.005+0000 7f216e7fc640 1 -- 172.21.15.77:0/2590987095 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174003b70 con 0x7f217c15e390 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.005+0000 7f216e7fc640 1 -- 172.21.15.77:0/2590987095 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174003cd0 con 0x7f217c15e390 2023-11-26T07:20:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.005+0000 7f216e7fc640 1 -- 172.21.15.77:0/2590987095 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21740052b0 con 0x7f217c15e390 2023-11-26T07:20:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.005+0000 7f2183c0e640 1 -- 172.21.15.77:0/2590987095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c14dcc0 con 0x7f217c15e390 2023-11-26T07:20:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.005+0000 7f2183c0e640 1 -- 172.21.15.77:0/2590987095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c14e280 con 0x7f217c15e390 2023-11-26T07:20:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.006+0000 7f2183c0e640 1 -- 172.21.15.77:0/2590987095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217c14e4a0 con 0x7f217c15e390 2023-11-26T07:20:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.007+0000 7f216e7fc640 1 -- 172.21.15.77:0/2590987095 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f2174005410 con 0x7f217c15e390 2023-11-26T07:20:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.008+0000 7f216e7fc640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f216006b110 0x7f216006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.008+0000 7f216e7fc640 1 -- 172.21.15.77:0/2590987095 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2174088ba0 con 0x7f217c15e390 2023-11-26T07:20:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.008+0000 7f21819aa640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f216006b110 0x7f216006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.009+0000 7f21819aa640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f216006b110 0x7f216006d5d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2178036000 tx=0x7f2178030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.012+0000 7f216e7fc640 1 -- 172.21.15.77:0/2590987095 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2174053bb0 con 0x7f217c15e390 2023-11-26T07:20:07.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.290+0000 7f2183c0e640 1 -- 172.21.15.77:0/2590987095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) v1 -- 0x7f217c067470 con 0x7f217c15e390 2023-11-26T07:20:07.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.872+0000 7f216e7fc640 1 -- 172.21.15.77:0/2590987095 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v151) v1 ==== 165+0+0 (secure 0 0 0) 0x7f2174017020 con 0x7f217c15e390 2023-11-26T07:20:07.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.876+0000 7f2183c0e640 1 -- 172.21.15.77:0/2590987095 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f216006b110 msgr2=0x7f216006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:07.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.876+0000 7f2183c0e640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f216006b110 0x7f216006d5d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2178036000 tx=0x7f2178030000 comp rx=0 tx=0).stop 2023-11-26T07:20:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.877+0000 7f2183c0e640 1 -- 172.21.15.77:0/2590987095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f217c15e390 msgr2=0x7f217c14c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.877+0000 7f2183c0e640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f217c15e390 0x7f217c14c750 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f217400c780 tx=0x7f217400cc40 comp rx=0 tx=0).stop 2023-11-26T07:20:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.877+0000 7f2183c0e640 1 -- 172.21.15.77:0/2590987095 shutdown_connections 2023-11-26T07:20:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.877+0000 7f2183c0e640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f216006b110 0x7f216006d5d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.877+0000 7f2183c0e640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f217c15e390 0x7f217c14c750 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.877+0000 7f2183c0e640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f217c157c70 0x7f217c14cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.877+0000 7f2183c0e640 1 --2- 172.21.15.77:0/2590987095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f217c0cf450 0x7f217c09a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.877+0000 7f2183c0e640 1 -- 172.21.15.77:0/2590987095 >> 172.21.15.77:0/2590987095 conn(0x7f217c06a920 msgr2=0x7f217c0b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.877+0000 7f2183c0e640 1 -- 172.21.15.77:0/2590987095 shutdown_connections 2023-11-26T07:20:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:07.877+0000 7f2183c0e640 1 -- 172.21.15.77:0/2590987095 wait complete. 2023-11-26T07:20:07.902 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is in failed state and validate the reason ... ok 2023-11-26T07:20:07.902 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is cancelled during in-progress state and validate the reason 2023-11-26T07:20:07.903 INFO:tasks.cephfs_test_runner:test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:20:07.903 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:08.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.119+0000 7f2b0bfff640 1 Processor -- start 2023-11-26T07:20:08.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.119+0000 7f2b0bfff640 1 -- start start 2023-11-26T07:20:08.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.121+0000 7f2b0bfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2b0c15c410 0x7f2b0c15f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.121+0000 7f2b0bfff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c15bf80 con 0x7f2b0c0b1de0 2023-11-26T07:20:08.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.121+0000 7f2b0bfff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c0b1560 con 0x7f2b0c144b30 2023-11-26T07:20:08.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.121+0000 7f2b0bfff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c0b1280 con 0x7f2b0c15c410 2023-11-26T07:20:08.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.121+0000 7f2b0b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2b0c0b1de0 0x7f2b0c0b3c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58090/0 (socket says 172.21.15.77:58090) 2023-11-26T07:20:08.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.122+0000 7f2b0b7fe640 1 -- 172.21.15.77:0/1808901159 learned_addr learned my addr 172.21.15.77:0/1808901159 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.122+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312753797 0 0) 0x7f2b0c15bf80 con 0x7f2b0c0b1de0 2023-11-26T07:20:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.122+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af8003520 con 0x7f2b0c0b1de0 2023-11-26T07:20:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.122+0000 7f2b03fff640 1 --2- 172.21.15.77:0/1808901159 >> v2:172.21.15.159:3300/0 conn(0x7f2b0c15c410 0x7f2b0c15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.122+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3693807533 0 0) 0x7f2af8003520 con 0x7f2b0c0b1de0 2023-11-26T07:20:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.122+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 >> v2:172.21.15.159:3300/0 conn(0x7f2b0c15c410 msgr2=0x7f2b0c15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.122+0000 7f2b0a7fc640 1 --2- 172.21.15.77:0/1808901159 >> v2:172.21.15.159:3300/0 conn(0x7f2b0c15c410 0x7f2b0c15f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.122+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 >> v1:172.21.15.159:6789/0 conn(0x7f2b0c144b30 legacy=0x7f2b0c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.122+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c15b930 con 0x7f2b0c0b1de0 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.122+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f2b040019f0 con 0x7f2b0c0b1de0 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.122+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 >> v1:172.21.15.77:6789/0 conn(0x7f2b0c0b1de0 legacy=0x7f2b0c0b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b0a7fc640 1 --2- 172.21.15.77:0/1808901159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af8003970 0x7f2af8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b0a7fc640 1 --2- 172.21.15.77:0/1808901159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af80047c0 0x7f2af8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b0a7fc640 1 --2- 172.21.15.77:0/1808901159 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af8005180 0x7f2af800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0b1280 con 0x7f2af80047c0 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af800c0d0 con 0x7f2af8003970 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af800c290 con 0x7f2af8005180 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b03fff640 1 --2- 172.21.15.77:0/1808901159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af80047c0 0x7f2af8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b0affd640 1 --2- 172.21.15.77:0/1808901159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af8003970 0x7f2af8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b03fff640 1 -- 172.21.15.77:0/1808901159 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af8005180 msgr2=0x7f2af800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b03fff640 1 --2- 172.21.15.77:0/1808901159 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af8005180 0x7f2af800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b03fff640 1 -- 172.21.15.77:0/1808901159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af8003970 msgr2=0x7f2af8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b03fff640 1 --2- 172.21.15.77:0/1808901159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af8003970 0x7f2af8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b03fff640 1 -- 172.21.15.77:0/1808901159 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8003520 con 0x7f2af80047c0 2023-11-26T07:20:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.123+0000 7f2b0b7fe640 1 -- 172.21.15.77:0/1808901159 reap_dead start 2023-11-26T07:20:08.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.124+0000 7f2b03fff640 1 --2- 172.21.15.77:0/1808901159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af80047c0 0x7f2af8004c40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2af400ba30 tx=0x7f2af80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0863b5117436bd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:08.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.125+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4032660 con 0x7f2af80047c0 2023-11-26T07:20:08.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.125+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af40327c0 con 0x7f2af80047c0 2023-11-26T07:20:08.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.125+0000 7f2b0a7fc640 1 -- 172.21.15.77:0/1808901159 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4032b50 con 0x7f2af80047c0 2023-11-26T07:20:08.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.125+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1808901159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af80047c0 msgr2=0x7f2af8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.125+0000 7f2b0bfff640 1 --2- 172.21.15.77:0/1808901159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af80047c0 0x7f2af8004c40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2af400ba30 tx=0x7f2af80057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.125+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1808901159 shutdown_connections 2023-11-26T07:20:08.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.125+0000 7f2b0bfff640 1 --2- 172.21.15.77:0/1808901159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af80047c0 0x7f2af8004c40 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.125+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1808901159 >> 172.21.15.77:0/1808901159 conn(0x7f2b0c0cb830 msgr2=0x7f2b0c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:08.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.126+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1808901159 shutdown_connections 2023-11-26T07:20:08.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.126+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1808901159 wait complete. 2023-11-26T07:20:08.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.127+0000 7f2b0bfff640 1 Processor -- start 2023-11-26T07:20:08.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.127+0000 7f2b0bfff640 1 -- start start 2023-11-26T07:20:08.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.128+0000 7f2b0bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af80047c0 0x7f2b0c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.128+0000 7f2b0bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c1f2dd0 0x7f2b0c1f0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.128+0000 7f2b0bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0c0c8a50 0x7f2b0c0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.128+0000 7f2b0bfff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0c9440 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.128+0000 7f2b0bfff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c071750 con 0x7f2b0c0c8a50 2023-11-26T07:20:08.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.128+0000 7f2b0bfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c070b40 con 0x7f2af80047c0 2023-11-26T07:20:08.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.129+0000 7f2b03fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c1f2dd0 0x7f2b0c1f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.129+0000 7f2b03fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c1f2dd0 0x7f2b0c1f0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54546/0 (socket says 172.21.15.77:54546) 2023-11-26T07:20:08.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.129+0000 7f2b03fff640 1 -- 172.21.15.77:0/1141456496 learned_addr learned my addr 172.21.15.77:0/1141456496 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:08.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.129+0000 7f2b0b7fe640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0c0c8a50 0x7f2b0c0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.129+0000 7f2b03fff640 1 -- 172.21.15.77:0/1141456496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af80047c0 msgr2=0x7f2b0c0702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.129+0000 7f2b03fff640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af80047c0 0x7f2b0c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.129+0000 7f2b03fff640 1 -- 172.21.15.77:0/1141456496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0c0c8a50 msgr2=0x7f2b0c0c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.129+0000 7f2b03fff640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0c0c8a50 0x7f2b0c0c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.129+0000 7f2b03fff640 1 -- 172.21.15.77:0/1141456496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c070e20 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.129+0000 7f2b0b7fe640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0c0c8a50 0x7f2b0c0c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:08.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.130+0000 7f2b03fff640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c1f2dd0 0x7f2b0c1f0210 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2af400bb50 tx=0x7f2af4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:08.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.130+0000 7f2b037fe640 1 -- 172.21.15.77:0/1141456496 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af403ca80 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.130+0000 7f2b037fe640 1 -- 172.21.15.77:0/1141456496 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af403cc00 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.130+0000 7f2b037fe640 1 -- 172.21.15.77:0/1141456496 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4030430 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.130+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1141456496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0c071100 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.130+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1141456496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0c070830 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.131+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1141456496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0c04e840 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.132+0000 7f2b037fe640 1 -- 172.21.15.77:0/1141456496 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f2af4030590 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.133+0000 7f2b037fe640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2aec06b110 0x7f2aec06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.133+0000 7f2b037fe640 1 -- 172.21.15.77:0/1141456496 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2af40abcd0 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.133+0000 7f2b0affd640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2aec06b110 0x7f2aec06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.134+0000 7f2b0affd640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2aec06b110 0x7f2aec06d5d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2afc007fd0 tx=0x7f2afc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:08.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.137+0000 7f2b037fe640 1 -- 172.21.15.77:0/1141456496 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2af40dee90 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.328+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1141456496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b0c0718c0 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.330+0000 7f2b037fe640 1 -- 172.21.15.77:0/1141456496 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12962 (secure 0 0 0) 0x7f2af4036090 con 0x7f2b0c1f2dd0 2023-11-26T07:20:08.333 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:08.333 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":39,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:20:05.852079+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:6835/360332813":"2023-11-27T07:20:02.497900+0000","172.21.15.159:6833/360332813":"2023-11-27T07:20:02.497900+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:08.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1141456496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2aec06b110 msgr2=0x7f2aec06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2aec06b110 0x7f2aec06d5d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2afc007fd0 tx=0x7f2afc009040 comp rx=0 tx=0).stop 2023-11-26T07:20:08.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1141456496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c1f2dd0 msgr2=0x7f2b0c1f0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c1f2dd0 0x7f2b0c1f0210 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2af400bb50 tx=0x7f2af4004730 comp rx=0 tx=0).stop 2023-11-26T07:20:08.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1141456496 shutdown_connections 2023-11-26T07:20:08.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2aec06b110 0x7f2aec06d5d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0c0c8a50 0x7f2b0c0c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c1f2dd0 0x7f2b0c1f0210 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 --2- 172.21.15.77:0/1141456496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af80047c0 0x7f2b0c0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1141456496 >> 172.21.15.77:0/1141456496 conn(0x7f2b0c0cb830 msgr2=0x7f2b0c15c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:08.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1141456496 shutdown_connections 2023-11-26T07:20:08.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.333+0000 7f2b0bfff640 1 -- 172.21.15.77:0/1141456496 wait complete. 2023-11-26T07:20:08.355 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:20:08.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:20:08.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.570+0000 7f3c58848640 1 Processor -- start 2023-11-26T07:20:08.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.570+0000 7f3c58848640 1 -- start start 2023-11-26T07:20:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.572+0000 7f3c58848640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3c5415b440 0x7f3c540cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.572+0000 7f3c58848640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c540c5dc0 con 0x7f3c540c59b0 2023-11-26T07:20:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.572+0000 7f3c58848640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5415eea0 con 0x7f3c540cbf20 2023-11-26T07:20:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.572+0000 7f3c58848640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c540cc3d0 con 0x7f3c5415b440 2023-11-26T07:20:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.572+0000 7f3c52d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3c540c59b0 0x7f3c5406c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58092/0 (socket says 172.21.15.77:58092) 2023-11-26T07:20:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.572+0000 7f3c52d9d640 1 -- 172.21.15.77:0/1646027563 learned_addr learned my addr 172.21.15.77:0/1646027563 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:08.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c5259c640 1 --2- 172.21.15.77:0/1646027563 >> v2:172.21.15.159:3300/0 conn(0x7f3c5415b440 0x7f3c540cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359060968 0 0) 0x7f3c540c5dc0 con 0x7f3c540c59b0 2023-11-26T07:20:08.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c40003520 con 0x7f3c540c59b0 2023-11-26T07:20:08.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254733877 0 0) 0x7f3c40003520 con 0x7f3c540c59b0 2023-11-26T07:20:08.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 >> v2:172.21.15.159:3300/0 conn(0x7f3c5415b440 msgr2=0x7f3c540cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:08.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 --2- 172.21.15.77:0/1646027563 >> v2:172.21.15.159:3300/0 conn(0x7f3c5415b440 0x7f3c540cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 >> v1:172.21.15.159:6789/0 conn(0x7f3c540cbf20 legacy=0x7f3c540c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540abf30 con 0x7f3c540c59b0 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f3c4c0019f0 con 0x7f3c540c59b0 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 >> v1:172.21.15.77:6789/0 conn(0x7f3c540c59b0 legacy=0x7f3c5406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 0x7f3c40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c400047c0 0x7f3c40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c40005180 0x7f3c4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540cc3d0 con 0x7f3c40003970 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000c120 con 0x7f3c400047c0 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.573+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000c2e0 con 0x7f3c40005180 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.574+0000 7f3c5259c640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 0x7f3c40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.574+0000 7f3c49d9b640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c400047c0 0x7f3c40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.574+0000 7f3c52d9d640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c40005180 0x7f3c4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.574+0000 7f3c5259c640 1 -- 172.21.15.77:0/1646027563 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c40005180 msgr2=0x7f3c4000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:08.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.574+0000 7f3c5259c640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c40005180 0x7f3c4000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.574+0000 7f3c5259c640 1 -- 172.21.15.77:0/1646027563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c400047c0 msgr2=0x7f3c40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:08.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.574+0000 7f3c5259c640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c400047c0 0x7f3c40004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.574+0000 7f3c5259c640 1 -- 172.21.15.77:0/1646027563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40003520 con 0x7f3c40003970 2023-11-26T07:20:08.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.574+0000 7f3c52d9d640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c40005180 0x7f3c4000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:08.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.574+0000 7f3c52d9d640 1 -- 172.21.15.77:0/1646027563 reap_dead start 2023-11-26T07:20:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.576+0000 7f3c5259c640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 0x7f3c40003d90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009ac0 tx=0x7f3c400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b6f07b01f13207 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.576+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4402c6b0 con 0x7f3c40003970 2023-11-26T07:20:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.576+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4402c810 con 0x7f3c40003970 2023-11-26T07:20:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.576+0000 7f3c51d9b640 1 -- 172.21.15.77:0/1646027563 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4402cba0 con 0x7f3c40003970 2023-11-26T07:20:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.576+0000 7f3c58848640 1 -- 172.21.15.77:0/1646027563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 msgr2=0x7f3c40003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.576+0000 7f3c58848640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 0x7f3c40003d90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009ac0 tx=0x7f3c400057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.577+0000 7f3c58848640 1 -- 172.21.15.77:0/1646027563 shutdown_connections 2023-11-26T07:20:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.577+0000 7f3c58848640 1 --2- 172.21.15.77:0/1646027563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 0x7f3c40003d90 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.577+0000 7f3c58848640 1 -- 172.21.15.77:0/1646027563 >> 172.21.15.77:0/1646027563 conn(0x7f3c540b0c50 msgr2=0x7f3c540b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.577+0000 7f3c58848640 1 -- 172.21.15.77:0/1646027563 shutdown_connections 2023-11-26T07:20:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.577+0000 7f3c58848640 1 -- 172.21.15.77:0/1646027563 wait complete. 2023-11-26T07:20:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.579+0000 7f3c58848640 1 Processor -- start 2023-11-26T07:20:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.579+0000 7f3c58848640 1 -- start start 2023-11-26T07:20:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.580+0000 7f3c58848640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 0x7f3c540ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.580+0000 7f3c58848640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c54099ea0 0x7f3c541f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.580+0000 7f3c58848640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c541f13e0 0x7f3c541f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.580+0000 7f3c58848640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540c8ec0 con 0x7f3c40003970 2023-11-26T07:20:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.580+0000 7f3c58848640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541f2850 con 0x7f3c541f13e0 2023-11-26T07:20:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.580+0000 7f3c58848640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541f1db0 con 0x7f3c54099ea0 2023-11-26T07:20:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.580+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 0x7f3c540ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.580+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 0x7f3c540ae1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54554/0 (socket says 172.21.15.77:54554) 2023-11-26T07:20:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.580+0000 7f3c5259c640 1 -- 172.21.15.77:0/1178728908 learned_addr learned my addr 172.21.15.77:0/1178728908 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.581+0000 7f3c52d9d640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c541f13e0 0x7f3c541f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.581+0000 7f3c5259c640 1 -- 172.21.15.77:0/1178728908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c54099ea0 msgr2=0x7f3c541f0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.581+0000 7f3c5259c640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c54099ea0 0x7f3c541f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.581+0000 7f3c5259c640 1 -- 172.21.15.77:0/1178728908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c541f13e0 msgr2=0x7f3c541f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.581+0000 7f3c5259c640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c541f13e0 0x7f3c541f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.581+0000 7f3c5259c640 1 -- 172.21.15.77:0/1178728908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c541f2240 con 0x7f3c40003970 2023-11-26T07:20:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.581+0000 7f3c52d9d640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c541f13e0 0x7f3c541f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.581+0000 7f3c5259c640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 0x7f3c540ae1c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3c44037040 tx=0x7f3c44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.582+0000 7f3c4b7fe640 1 -- 172.21.15.77:0/1178728908 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44003810 con 0x7f3c40003970 2023-11-26T07:20:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.582+0000 7f3c4b7fe640 1 -- 172.21.15.77:0/1178728908 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c44003970 con 0x7f3c40003970 2023-11-26T07:20:08.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.582+0000 7f3c58848640 1 -- 172.21.15.77:0/1178728908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5409b410 con 0x7f3c40003970 2023-11-26T07:20:08.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.582+0000 7f3c4b7fe640 1 -- 172.21.15.77:0/1178728908 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44003ce0 con 0x7f3c40003970 2023-11-26T07:20:08.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.582+0000 7f3c58848640 1 -- 172.21.15.77:0/1178728908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c541f24e0 con 0x7f3c40003970 2023-11-26T07:20:08.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.583+0000 7f3c58848640 1 -- 172.21.15.77:0/1178728908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c541f20a0 con 0x7f3c40003970 2023-11-26T07:20:08.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.584+0000 7f3c4b7fe640 1 -- 172.21.15.77:0/1178728908 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f3c44040450 con 0x7f3c40003970 2023-11-26T07:20:08.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.585+0000 7f3c4b7fe640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c3406b110 0x7f3c3406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:08.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.585+0000 7f3c4b7fe640 1 -- 172.21.15.77:0/1178728908 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3c440aba80 con 0x7f3c40003970 2023-11-26T07:20:08.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.585+0000 7f3c49d9b640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c3406b110 0x7f3c3406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:08.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.586+0000 7f3c49d9b640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c3406b110 0x7f3c3406d5d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c007fd0 tx=0x7f3c3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.589+0000 7f3c4b7fe640 1 -- 172.21.15.77:0/1178728908 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c541f20a0 con 0x7f3c40003970 2023-11-26T07:20:08.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.782+0000 7f3c58848640 1 -- 172.21.15.77:0/1178728908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c541f20a0 con 0x7f3c40003970 2023-11-26T07:20:08.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.783+0000 7f3c4b7fe640 1 -- 172.21.15.77:0/1178728908 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c44039020 con 0x7f3c40003970 2023-11-26T07:20:08.785 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:20:08.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.785+0000 7f3c58848640 1 -- 172.21.15.77:0/1178728908 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c3406b110 msgr2=0x7f3c3406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.785+0000 7f3c58848640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c3406b110 0x7f3c3406d5d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c007fd0 tx=0x7f3c3c009040 comp rx=0 tx=0).stop 2023-11-26T07:20:08.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.785+0000 7f3c58848640 1 -- 172.21.15.77:0/1178728908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 msgr2=0x7f3c540ae1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:08.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.785+0000 7f3c58848640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 0x7f3c540ae1c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3c44037040 tx=0x7f3c44004730 comp rx=0 tx=0).stop 2023-11-26T07:20:08.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.785+0000 7f3c58848640 1 -- 172.21.15.77:0/1178728908 shutdown_connections 2023-11-26T07:20:08.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.785+0000 7f3c58848640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c3406b110 0x7f3c3406d5d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.785+0000 7f3c58848640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c541f13e0 0x7f3c541f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.785+0000 7f3c58848640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c54099ea0 0x7f3c541f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.785+0000 7f3c58848640 1 --2- 172.21.15.77:0/1178728908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c40003970 0x7f3c540ae1c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:08.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.785+0000 7f3c58848640 1 -- 172.21.15.77:0/1178728908 >> 172.21.15.77:0/1178728908 conn(0x7f3c540b0c50 msgr2=0x7f3c540c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:08.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.786+0000 7f3c58848640 1 -- 172.21.15.77:0/1178728908 shutdown_connections 2023-11-26T07:20:08.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:08.786+0000 7f3c58848640 1 -- 172.21.15.77:0/1178728908 wait complete. 2023-11-26T07:20:08.807 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2023-11-26T07:20:09.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.010+0000 7f7909927640 1 Processor -- start 2023-11-26T07:20:09.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.010+0000 7f7909927640 1 -- start start 2023-11-26T07:20:09.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.012+0000 7f7909927640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f790415c410 0x7f790415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:09.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.012+0000 7f7909927640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 0x7f79040b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:09.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.012+0000 7f7909927640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790415bf80 con 0x7f7904144b30 2023-11-26T07:20:09.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.012+0000 7f7909927640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79040b27b0 con 0x7f790415c410 2023-11-26T07:20:09.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.012+0000 7f7909927640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79040b1560 con 0x7f79040b1de0 2023-11-26T07:20:09.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.013+0000 7f7903fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f790415c410 0x7f790415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:09.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.013+0000 7f7909126640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 0x7f79040b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:09.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.013+0000 7f7903fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f790415c410 0x7f790415f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:49518/0 (socket says 172.21.15.77:49518) 2023-11-26T07:20:09.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.013+0000 7f7908925640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f7904144b30 0x7f79040b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:60488/0 (socket says 172.21.15.77:60488) 2023-11-26T07:20:09.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.013+0000 7f7903fff640 1 -- 172.21.15.77:0/368486096 learned_addr learned my addr 172.21.15.77:0/368486096 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:09.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.013+0000 7f7909126640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 0x7f79040b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:44464/0 (socket says 172.21.15.77:44464) 2023-11-26T07:20:09.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.014+0000 7f7903fff640 1 -- 172.21.15.77:0/368486096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 msgr2=0x7f79040b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:09.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.014+0000 7f7903fff640 1 --2- 172.21.15.77:0/368486096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 0x7f79040b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:09.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.014+0000 7f7903fff640 1 -- 172.21.15.77:0/368486096 >> v1:172.21.15.159:6789/0 conn(0x7f7904144b30 legacy=0x7f79040b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:09.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.014+0000 7f7903fff640 1 -- 172.21.15.77:0/368486096 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79040b1280 con 0x7f790415c410 2023-11-26T07:20:09.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.015+0000 7f7903fff640 1 --2- 172.21.15.77:0/368486096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f790415c410 0x7f790415f920 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009870 tx=0x7f78f002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ae6e1b5ac3e2054 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:09.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.016+0000 7f79037fe640 1 -- 172.21.15.77:0/368486096 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0030840 con 0x7f790415c410 2023-11-26T07:20:09.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.016+0000 7f79037fe640 1 -- 172.21.15.77:0/368486096 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f00309a0 con 0x7f790415c410 2023-11-26T07:20:09.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.016+0000 7f79037fe640 1 -- 172.21.15.77:0/368486096 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0030d30 con 0x7f790415c410 2023-11-26T07:20:09.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.016+0000 7f7909927640 1 -- 172.21.15.77:0/368486096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f790415c410 msgr2=0x7f790415f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:09.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.016+0000 7f7909927640 1 --2- 172.21.15.77:0/368486096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f790415c410 0x7f790415f920 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009870 tx=0x7f78f002b980 comp rx=0 tx=0).stop 2023-11-26T07:20:09.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.016+0000 7f7909927640 1 -- 172.21.15.77:0/368486096 shutdown_connections 2023-11-26T07:20:09.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.016+0000 7f7909927640 1 --2- 172.21.15.77:0/368486096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 0x7f79040b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:09.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.016+0000 7f7909927640 1 --2- 172.21.15.77:0/368486096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f790415c410 0x7f790415f920 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:09.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.016+0000 7f7909927640 1 -- 172.21.15.77:0/368486096 >> 172.21.15.77:0/368486096 conn(0x7f79040cb830 msgr2=0x7f79040cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:09.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.016+0000 7f7909927640 1 -- 172.21.15.77:0/368486096 shutdown_connections 2023-11-26T07:20:09.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.016+0000 7f7909927640 1 -- 172.21.15.77:0/368486096 wait complete. 2023-11-26T07:20:09.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.018+0000 7f7909927640 1 Processor -- start 2023-11-26T07:20:09.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.018+0000 7f7909927640 1 -- start start 2023-11-26T07:20:09.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.019+0000 7f7909927640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 0x7f79040b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:09.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.019+0000 7f7909927640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7904144b30 0x7f79040c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:09.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.019+0000 7f7909927640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f790415c410 0x7f79040a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:09.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.019+0000 7f7909927640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7904131770 con 0x7f790415c410 2023-11-26T07:20:09.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.019+0000 7f7909927640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7904133670 con 0x7f7904144b30 2023-11-26T07:20:09.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.019+0000 7f7909927640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7904130af0 con 0x7f79040b1de0 2023-11-26T07:20:09.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7909126640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f790415c410 0x7f79040a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:09.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7909126640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f790415c410 0x7f79040a8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54568/0 (socket says 172.21.15.77:54568) 2023-11-26T07:20:09.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7909126640 1 -- 172.21.15.77:0/6942153 learned_addr learned my addr 172.21.15.77:0/6942153 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:09.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7908925640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 0x7f79040b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:09.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7903fff640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7904144b30 0x7f79040c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:09.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7909126640 1 -- 172.21.15.77:0/6942153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 msgr2=0x7f79040b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:09.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7909126640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 0x7f79040b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:09.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7909126640 1 -- 172.21.15.77:0/6942153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7904144b30 msgr2=0x7f79040c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:09.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7909126640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7904144b30 0x7f79040c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:09.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7909126640 1 -- 172.21.15.77:0/6942153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f00094d0 con 0x7f790415c410 2023-11-26T07:20:09.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7908925640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 0x7f79040b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:09.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.020+0000 7f7909126640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f790415c410 0x7f79040a8430 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00efc0 tx=0x7f78fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:09.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.021+0000 7f79017fa640 1 -- 172.21.15.77:0/6942153 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc014480 con 0x7f790415c410 2023-11-26T07:20:09.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.021+0000 7f79017fa640 1 -- 172.21.15.77:0/6942153 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc00f040 con 0x7f790415c410 2023-11-26T07:20:09.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.021+0000 7f79017fa640 1 -- 172.21.15.77:0/6942153 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc014820 con 0x7f790415c410 2023-11-26T07:20:09.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.021+0000 7f7909927640 1 -- 172.21.15.77:0/6942153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7904130dd0 con 0x7f790415c410 2023-11-26T07:20:09.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.021+0000 7f7909927640 1 -- 172.21.15.77:0/6942153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7904131390 con 0x7f790415c410 2023-11-26T07:20:09.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.022+0000 7f7909927640 1 -- 172.21.15.77:0/6942153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79041318b0 con 0x7f790415c410 2023-11-26T07:20:09.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.023+0000 7f79017fa640 1 -- 172.21.15.77:0/6942153 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f78fc014980 con 0x7f790415c410 2023-11-26T07:20:09.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.024+0000 7f79017fa640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78e806b110 0x7f78e806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:09.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.024+0000 7f79017fa640 1 -- 172.21.15.77:0/6942153 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f78fc08a6c0 con 0x7f790415c410 2023-11-26T07:20:09.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.024+0000 7f7908925640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78e806b110 0x7f78e806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:09.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.025+0000 7f7908925640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78e806b110 0x7f78e806d5d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f78f8007fd0 tx=0x7f78f8007d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:09.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.028+0000 7f79017fa640 1 -- 172.21.15.77:0/6942153 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79041318b0 con 0x7f790415c410 2023-11-26T07:20:09.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.286+0000 7f7909927640 1 -- 172.21.15.77:0/6942153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) v1 -- 0x7f79041318b0 con 0x7f790415c410 2023-11-26T07:20:09.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.878+0000 7f79017fa640 1 -- 172.21.15.77:0/6942153 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v153) v1 ==== 183+0+0 (secure 0 0 0) 0x7f79041318b0 con 0x7f790415c410 2023-11-26T07:20:09.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.882+0000 7f7909927640 1 -- 172.21.15.77:0/6942153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78e806b110 msgr2=0x7f78e806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:09.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.882+0000 7f7909927640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78e806b110 0x7f78e806d5d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f78f8007fd0 tx=0x7f78f8007d60 comp rx=0 tx=0).stop 2023-11-26T07:20:09.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.882+0000 7f7909927640 1 -- 172.21.15.77:0/6942153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f790415c410 msgr2=0x7f79040a8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:09.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.882+0000 7f7909927640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f790415c410 0x7f79040a8430 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00efc0 tx=0x7f78fc00c490 comp rx=0 tx=0).stop 2023-11-26T07:20:09.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.882+0000 7f7909927640 1 -- 172.21.15.77:0/6942153 shutdown_connections 2023-11-26T07:20:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.882+0000 7f7909927640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78e806b110 0x7f78e806d5d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.882+0000 7f7909927640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f790415c410 0x7f79040a8430 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.882+0000 7f7909927640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7904144b30 0x7f79040c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.882+0000 7f7909927640 1 --2- 172.21.15.77:0/6942153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79040b1de0 0x7f79040b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.882+0000 7f7909927640 1 -- 172.21.15.77:0/6942153 >> 172.21.15.77:0/6942153 conn(0x7f79040cb830 msgr2=0x7f79040cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.883+0000 7f7909927640 1 -- 172.21.15.77:0/6942153 shutdown_connections 2023-11-26T07:20:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:09.883+0000 7f7909927640 1 -- 172.21.15.77:0/6942153 wait complete. 2023-11-26T07:20:09.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:20:10.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.121+0000 7f1b1169b640 1 Processor -- start 2023-11-26T07:20:10.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.121+0000 7f1b1169b640 1 -- start start 2023-11-26T07:20:10.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.123+0000 7f1b1169b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1b0c06de10 0x7f1b0c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:10.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.123+0000 7f1b1169b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b0c0c49f0 0x7f1b0c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:10.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.123+0000 7f1b1169b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0c15ec90 con 0x7f1b0c072160 2023-11-26T07:20:10.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.123+0000 7f1b1169b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c0cd530 con 0x7f1b0c06de10 2023-11-26T07:20:10.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.123+0000 7f1b1169b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0c4ed0 con 0x7f1b0c0c49f0 2023-11-26T07:20:10.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.123+0000 7f1b0affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1b0c072160 0x7f1b0c06d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58106/0 (socket says 172.21.15.77:58106) 2023-11-26T07:20:10.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.123+0000 7f1b0affd640 1 -- 172.21.15.77:0/678210237 learned_addr learned my addr 172.21.15.77:0/678210237 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b03fff640 1 --2- 172.21.15.77:0/678210237 >> v2:172.21.15.159:3300/0 conn(0x7f1b0c06de10 0x7f1b0c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0b7fe640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b0c0c49f0 0x7f1b0c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:10.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817787470 0 0) 0x7f1afc001110 con 0x7f1b0c072160 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1af8003520 con 0x7f1b0c072160 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1856016260 0 0) 0x7f1af8003520 con 0x7f1b0c072160 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b0c0c49f0 msgr2=0x7f1b0c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0a7fc640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b0c0c49f0 0x7f1b0c0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 >> v2:172.21.15.159:3300/0 conn(0x7f1b0c06de10 msgr2=0x7f1b0c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0a7fc640 1 --2- 172.21.15.77:0/678210237 >> v2:172.21.15.159:3300/0 conn(0x7f1b0c06de10 0x7f1b0c15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c0c51b0 con 0x7f1b0c072160 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f1afc001800 con 0x7f1b0c072160 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 >> v1:172.21.15.77:6789/0 conn(0x7f1b0c072160 legacy=0x7f1b0c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.124+0000 7f1b0a7fc640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af8003970 0x7f1af8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0a7fc640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b0c0c49f0 0x7f1af80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0a7fc640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af8004d00 0x7f1af8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0cd530 con 0x7f1af8004d00 2023-11-26T07:20:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0c4ed0 con 0x7f1af8003970 2023-11-26T07:20:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af800db90 con 0x7f1b0c0c49f0 2023-11-26T07:20:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0b7fe640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af8004d00 0x7f1af8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0b7fe640 1 -- 172.21.15.77:0/678210237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b0c0c49f0 msgr2=0x7f1af80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0b7fe640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b0c0c49f0 0x7f1af80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0affd640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af8003970 0x7f1af8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0b7fe640 1 -- 172.21.15.77:0/678210237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af8003970 msgr2=0x7f1af8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0b7fe640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af8003970 0x7f1af8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0b7fe640 1 -- 172.21.15.77:0/678210237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af8003520 con 0x7f1af8004d00 2023-11-26T07:20:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.125+0000 7f1b0affd640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af8003970 0x7f1af8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.126+0000 7f1b0b7fe640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af8004d00 0x7f1af8005180 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c06ead0 tx=0x7f1af80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd68e7eb6f14074 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.127+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0402cbd0 con 0x7f1af8004d00 2023-11-26T07:20:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.127+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0400f040 con 0x7f1af8004d00 2023-11-26T07:20:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.127+0000 7f1b0a7fc640 1 -- 172.21.15.77:0/678210237 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04034440 con 0x7f1af8004d00 2023-11-26T07:20:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.127+0000 7f1b1169b640 1 -- 172.21.15.77:0/678210237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af8004d00 msgr2=0x7f1af8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.127+0000 7f1b1169b640 1 --2- 172.21.15.77:0/678210237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af8004d00 0x7f1af8005180 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c06ead0 tx=0x7f1af80057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.127+0000 7f1b0b7fe640 1 -- 172.21.15.77:0/678210237 reap_dead start 2023-11-26T07:20:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.127+0000 7f1b1169b640 1 -- 172.21.15.77:0/678210237 shutdown_connections 2023-11-26T07:20:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.127+0000 7f1b1169b640 1 -- 172.21.15.77:0/678210237 >> 172.21.15.77:0/678210237 conn(0x7f1b0c0b0c50 msgr2=0x7f1b0c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.127+0000 7f1b1169b640 1 -- 172.21.15.77:0/678210237 shutdown_connections 2023-11-26T07:20:10.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.127+0000 7f1b1169b640 1 -- 172.21.15.77:0/678210237 wait complete. 2023-11-26T07:20:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.129+0000 7f1b1169b640 1 Processor -- start 2023-11-26T07:20:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.129+0000 7f1b1169b640 1 -- start start 2023-11-26T07:20:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.130+0000 7f1b1169b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1af8004d00 0x7f1b0c09c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.130+0000 7f1b1169b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c158d70 0x7f1b0c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.130+0000 7f1b1169b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0b1c80 0x7f1b0c0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.130+0000 7f1b1169b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c1595d0 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.130+0000 7f1b1169b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0c6170 con 0x7f1b0c158d70 2023-11-26T07:20:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.130+0000 7f1b1169b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0c6450 con 0x7f1af8004d00 2023-11-26T07:20:10.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b0b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0b1c80 0x7f1b0c0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b0b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0b1c80 0x7f1b0c0b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54596/0 (socket says 172.21.15.77:54596) 2023-11-26T07:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b0b7fe640 1 -- 172.21.15.77:0/1764127028 learned_addr learned my addr 172.21.15.77:0/1764127028 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b03fff640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c158d70 0x7f1b0c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b0b7fe640 1 -- 172.21.15.77:0/1764127028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1af8004d00 msgr2=0x7f1b0c09c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b0affd640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1af8004d00 0x7f1b0c09c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b0b7fe640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1af8004d00 0x7f1b0c09c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b0b7fe640 1 -- 172.21.15.77:0/1764127028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c158d70 msgr2=0x7f1b0c1585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b0b7fe640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c158d70 0x7f1b0c1585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b0b7fe640 1 -- 172.21.15.77:0/1764127028 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c0c6730 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b03fff640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c158d70 0x7f1b0c1585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:10.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.131+0000 7f1b0b7fe640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0b1c80 0x7f1b0c0b4100 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1b04002230 tx=0x7f1b04009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.132+0000 7f1b037fe640 1 -- 172.21.15.77:0/1764127028 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04034d50 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.132+0000 7f1b037fe640 1 -- 172.21.15.77:0/1764127028 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0402de60 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.132+0000 7f1b037fe640 1 -- 172.21.15.77:0/1764127028 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0403e680 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.132+0000 7f1b1169b640 1 -- 172.21.15.77:0/1764127028 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0c0c6a10 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.132+0000 7f1b1169b640 1 -- 172.21.15.77:0/1764127028 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0c158b00 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.133+0000 7f1b1169b640 1 -- 172.21.15.77:0/1764127028 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0c04e8b0 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.134+0000 7f1b037fe640 1 -- 172.21.15.77:0/1764127028 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f1b0403e7e0 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.135+0000 7f1b037fe640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1aec06b110 0x7f1aec06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.135+0000 7f1b037fe640 1 -- 172.21.15.77:0/1764127028 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1b040ab9c0 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.135+0000 7f1b0affd640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1aec06b110 0x7f1aec06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.136+0000 7f1b0affd640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1aec06b110 0x7f1aec06d5d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1afc001930 tx=0x7f1afc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:10.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.139+0000 7f1b037fe640 1 -- 172.21.15.77:0/1764127028 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b04076950 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.331+0000 7f1b1169b640 1 -- 172.21.15.77:0/1764127028 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1b0c0cc920 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.336+0000 7f1b037fe640 1 -- 172.21.15.77:0/1764127028 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1b04079f70 con 0x7f1b0c0b1c80 2023-11-26T07:20:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.339+0000 7f1b1169b640 1 -- 172.21.15.77:0/1764127028 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1aec06b110 msgr2=0x7f1aec06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.339+0000 7f1b1169b640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1aec06b110 0x7f1aec06d5d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1afc001930 tx=0x7f1afc009040 comp rx=0 tx=0).stop 2023-11-26T07:20:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.339+0000 7f1b1169b640 1 -- 172.21.15.77:0/1764127028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0b1c80 msgr2=0x7f1b0c0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.339+0000 7f1b1169b640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0b1c80 0x7f1b0c0b4100 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1b04002230 tx=0x7f1b04009750 comp rx=0 tx=0).stop 2023-11-26T07:20:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.339+0000 7f1b1169b640 1 -- 172.21.15.77:0/1764127028 shutdown_connections 2023-11-26T07:20:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.339+0000 7f1b1169b640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1aec06b110 0x7f1aec06d5d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.339+0000 7f1b1169b640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0b1c80 0x7f1b0c0b4100 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.339+0000 7f1b1169b640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c158d70 0x7f1b0c1585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.339+0000 7f1b1169b640 1 --2- 172.21.15.77:0/1764127028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1af8004d00 0x7f1b0c09c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.339+0000 7f1b1169b640 1 -- 172.21.15.77:0/1764127028 >> 172.21.15.77:0/1764127028 conn(0x7f1b0c0b0c50 msgr2=0x7f1b0c159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.340+0000 7f1b1169b640 1 -- 172.21.15.77:0/1764127028 shutdown_connections 2023-11-26T07:20:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:10.340+0000 7f1b1169b640 1 -- 172.21.15.77:0/1764127028 wait complete. 2023-11-26T07:20:10.361 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:20:10.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:20:10.476 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:20:10.612 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:20:10.613 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:10.613 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:10.673 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:20:10.673 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:20:10.673 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:10.732 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:20:10.732 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:10.733 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:10.792 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:20:10.792 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:20:10.792 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:10.852 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:20:10.853 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:20:10.853 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:11.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.068+0000 7f91f8940640 1 Processor -- start 2023-11-26T07:20:11.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.069+0000 7f91f8940640 1 -- start start 2023-11-26T07:20:11.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.070+0000 7f91f8940640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f91f4144b30 0x7f91f415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.070+0000 7f91f8940640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91f40b1de0 0x7f91f40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.070+0000 7f91f8940640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f415bf80 con 0x7f91f415c410 2023-11-26T07:20:11.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.070+0000 7f91f8940640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f40b27b0 con 0x7f91f4144b30 2023-11-26T07:20:11.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.070+0000 7f91f8940640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40b1560 con 0x7f91f40b1de0 2023-11-26T07:20:11.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.071+0000 7f91f2d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f91f4144b30 0x7f91f415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.071+0000 7f91f2d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f91f4144b30 0x7f91f415f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54612/0 (socket says 172.21.15.77:54612) 2023-11-26T07:20:11.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.071+0000 7f91f2d9d640 1 -- 172.21.15.77:0/138755953 learned_addr learned my addr 172.21.15.77:0/138755953 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:11.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.071+0000 7f91f2d9d640 1 -- 172.21.15.77:0/138755953 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91f40b1de0 msgr2=0x7f91f40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:11.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.071+0000 7f91f2d9d640 1 --2- 172.21.15.77:0/138755953 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91f40b1de0 0x7f91f40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.071+0000 7f91f2d9d640 1 -- 172.21.15.77:0/138755953 >> v1:172.21.15.77:6789/0 conn(0x7f91f415c410 legacy=0x7f91f40b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.071+0000 7f91f2d9d640 1 -- 172.21.15.77:0/138755953 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f40b1280 con 0x7f91f4144b30 2023-11-26T07:20:11.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.072+0000 7f91f2d9d640 1 --2- 172.21.15.77:0/138755953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91f4144b30 0x7f91f415f920 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009870 tx=0x7f91e402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c142ad38fbf4c26 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:11.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.072+0000 7f91f259c640 1 -- 172.21.15.77:0/138755953 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4030840 con 0x7f91f4144b30 2023-11-26T07:20:11.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.072+0000 7f91f259c640 1 -- 172.21.15.77:0/138755953 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e40309a0 con 0x7f91f4144b30 2023-11-26T07:20:11.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.072+0000 7f91f259c640 1 -- 172.21.15.77:0/138755953 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4030d30 con 0x7f91f4144b30 2023-11-26T07:20:11.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.073+0000 7f91f8940640 1 -- 172.21.15.77:0/138755953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91f4144b30 msgr2=0x7f91f415f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.073+0000 7f91f8940640 1 --2- 172.21.15.77:0/138755953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91f4144b30 0x7f91f415f920 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009870 tx=0x7f91e402b980 comp rx=0 tx=0).stop 2023-11-26T07:20:11.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.073+0000 7f91f8940640 1 -- 172.21.15.77:0/138755953 shutdown_connections 2023-11-26T07:20:11.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.073+0000 7f91f8940640 1 --2- 172.21.15.77:0/138755953 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91f40b1de0 0x7f91f40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.073+0000 7f91f8940640 1 --2- 172.21.15.77:0/138755953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91f4144b30 0x7f91f415f920 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.073+0000 7f91f8940640 1 -- 172.21.15.77:0/138755953 >> 172.21.15.77:0/138755953 conn(0x7f91f40cb830 msgr2=0x7f91f40cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:11.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.073+0000 7f91f8940640 1 -- 172.21.15.77:0/138755953 shutdown_connections 2023-11-26T07:20:11.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.073+0000 7f91f8940640 1 -- 172.21.15.77:0/138755953 wait complete. 2023-11-26T07:20:11.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.076+0000 7f91f8940640 1 Processor -- start 2023-11-26T07:20:11.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.076+0000 7f91f8940640 1 -- start start 2023-11-26T07:20:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.077+0000 7f91f8940640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91f40b1de0 0x7f91f4133500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.077+0000 7f91f8940640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91f4144b30 0x7f91f415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.077+0000 7f91f8940640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91f415c410 0x7f91f415d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.077+0000 7f91f8940640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40a8430 con 0x7f91f40b1de0 2023-11-26T07:20:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.077+0000 7f91f8940640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f4133a40 con 0x7f91f4144b30 2023-11-26T07:20:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.077+0000 7f91f8940640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40a8640 con 0x7f91f415c410 2023-11-26T07:20:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.077+0000 7f91f2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91f40b1de0 0x7f91f4133500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.077+0000 7f91f2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91f40b1de0 0x7f91f4133500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54618/0 (socket says 172.21.15.77:54618) 2023-11-26T07:20:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.077+0000 7f91f2d9d640 1 -- 172.21.15.77:0/4207774435 learned_addr learned my addr 172.21.15.77:0/4207774435 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.078+0000 7f91f2d9d640 1 -- 172.21.15.77:0/4207774435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91f415c410 msgr2=0x7f91f415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.078+0000 7f91f2d9d640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91f415c410 0x7f91f415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.078+0000 7f91f2d9d640 1 -- 172.21.15.77:0/4207774435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91f4144b30 msgr2=0x7f91f415d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.078+0000 7f91f2d9d640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91f4144b30 0x7f91f415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.078+0000 7f91f2d9d640 1 -- 172.21.15.77:0/4207774435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40094d0 con 0x7f91f40b1de0 2023-11-26T07:20:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.078+0000 7f91f2d9d640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91f40b1de0 0x7f91f4133500 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009870 tx=0x7f91e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:11.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.078+0000 7f91eb7fe640 1 -- 172.21.15.77:0/4207774435 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e40307f0 con 0x7f91f40b1de0 2023-11-26T07:20:11.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.078+0000 7f91eb7fe640 1 -- 172.21.15.77:0/4207774435 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e4043400 con 0x7f91f40b1de0 2023-11-26T07:20:11.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.078+0000 7f91f8940640 1 -- 172.21.15.77:0/4207774435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f40a8920 con 0x7f91f40b1de0 2023-11-26T07:20:11.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.078+0000 7f91eb7fe640 1 -- 172.21.15.77:0/4207774435 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e40437b0 con 0x7f91f40b1de0 2023-11-26T07:20:11.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.079+0000 7f91f8940640 1 -- 172.21.15.77:0/4207774435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f4130e20 con 0x7f91f40b1de0 2023-11-26T07:20:11.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.080+0000 7f91f8940640 1 -- 172.21.15.77:0/4207774435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f404e840 con 0x7f91f40b1de0 2023-11-26T07:20:11.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.080+0000 7f91eb7fe640 1 -- 172.21.15.77:0/4207774435 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f91e4043910 con 0x7f91f40b1de0 2023-11-26T07:20:11.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.081+0000 7f91eb7fe640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f91d406b140 0x7f91d406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.081+0000 7f91eb7fe640 1 -- 172.21.15.77:0/4207774435 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f91e403e070 con 0x7f91f40b1de0 2023-11-26T07:20:11.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.082+0000 7f91ebfff640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f91d406b140 0x7f91d406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.082+0000 7f91ebfff640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f91d406b140 0x7f91d406d600 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f91dc000f60 tx=0x7f91dc0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:11.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.086+0000 7f91eb7fe640 1 -- 172.21.15.77:0/4207774435 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f91e4077a60 con 0x7f91f40b1de0 2023-11-26T07:20:11.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.313+0000 7f91f8940640 1 -- 172.21.15.77:0/4207774435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91f415e880 con 0x7f91f40b1de0 2023-11-26T07:20:11.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.315+0000 7f91eb7fe640 1 -- 172.21.15.77:0/4207774435 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f91e4034020 con 0x7f91f40b1de0 2023-11-26T07:20:11.318 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:11.318 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3806365439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3806365439},{"type":"v1","addr":"172.21.15.77:6836","nonce":3806365439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/694008676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":694008676},{"type":"v1","addr":"172.21.15.77:6837","nonce":694008676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/645743073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":645743073},{"type":"v1","addr":"172.21.15.159:6835","nonce":645743073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":4705,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/4096574472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4096574472},{"type":"v1","addr":"172.21.15.159:6834","nonce":4096574472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-11-26T07:20:11.318 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 18 2023-11-26T07:20:11.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 -- 172.21.15.77:0/4207774435 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f91d406b140 msgr2=0x7f91d406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f91d406b140 0x7f91d406d600 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f91dc000f60 tx=0x7f91dc0079b0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 -- 172.21.15.77:0/4207774435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91f40b1de0 msgr2=0x7f91f4133500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91f40b1de0 0x7f91f4133500 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009870 tx=0x7f91e4004730 comp rx=0 tx=0).stop 2023-11-26T07:20:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 -- 172.21.15.77:0/4207774435 shutdown_connections 2023-11-26T07:20:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f91d406b140 0x7f91d406d600 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91f415c410 0x7f91f415d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91f4144b30 0x7f91f415d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 --2- 172.21.15.77:0/4207774435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91f40b1de0 0x7f91f4133500 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 -- 172.21.15.77:0/4207774435 >> 172.21.15.77:0/4207774435 conn(0x7f91f40cb830 msgr2=0x7f91f413f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 -- 172.21.15.77:0/4207774435 shutdown_connections 2023-11-26T07:20:11.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.318+0000 7f91f8940640 1 -- 172.21.15.77:0/4207774435 wait complete. 2023-11-26T07:20:11.340 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:20:11.340 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:20:11.340 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:20:11.340 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:20:11.341 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:20:11.341 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:20:11.341 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:20:11.341 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:20:11.341 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:20:11.341 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:20:11.341 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:20:11.341 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:20:11.342 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:20:11.342 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:20:11.342 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:20:11.342 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:20:11.357 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:20:11.357 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:20:11.361 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:20:11.362 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:20:11.363 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:20:11.363 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:20:11.365 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:20:11.365 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:20:11.411 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:20:11.412 DEBUG:teuthology.parallel:result is None 2023-11-26T07:20:11.413 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:20:11.414 DEBUG:teuthology.parallel:result is None 2023-11-26T07:20:11.419 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:20:11.419 DEBUG:teuthology.parallel:result is None 2023-11-26T07:20:11.421 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:20:11.421 DEBUG:teuthology.parallel:result is None 2023-11-26T07:20:11.421 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:20:11.568 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-26T07:20:11.572 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-26T07:20:11.578 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-11-26T07:20:11.586 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-11-26T07:20:11.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.610+0000 7f13f9b83640 1 Processor -- start 2023-11-26T07:20:11.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.610+0000 7f13f9b83640 1 -- start start 2023-11-26T07:20:11.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.611+0000 7f13f9b83640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13f415d490 0x7f13f40cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.611+0000 7f13f9b83640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f13f40d3940 0x7f13f40d1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.611+0000 7f13f9b83640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f40cea30 con 0x7f13f40b63d0 2023-11-26T07:20:11.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.611+0000 7f13f9b83640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f40d0450 con 0x7f13f40d3940 2023-11-26T07:20:11.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.612+0000 7f13f9b83640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40d0bf0 con 0x7f13f415d490 2023-11-26T07:20:11.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.612+0000 7f13f3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f13f40b63d0 0x7f13f40d3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58134/0 (socket says 172.21.15.77:58134) 2023-11-26T07:20:11.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.612+0000 7f13f3fff640 1 -- 172.21.15.77:0/419947681 learned_addr learned my addr 172.21.15.77:0/419947681 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:11.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.612+0000 7f13f8b81640 1 --2- 172.21.15.77:0/419947681 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13f415d490 0x7f13f40cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.612+0000 7f13f9382640 1 --2- 172.21.15.77:0/419947681 >> v2:172.21.15.159:3300/0 conn(0x7f13f40d3940 0x7f13f40d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.612+0000 7f13f37fe640 1 -- 172.21.15.77:0/419947681 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766627470 0 0) 0x7f13f40cea30 con 0x7f13f40b63d0 2023-11-26T07:20:11.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.612+0000 7f13f37fe640 1 -- 172.21.15.77:0/419947681 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e4003520 con 0x7f13f40b63d0 2023-11-26T07:20:11.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.612+0000 7f13f9382640 1 -- 172.21.15.77:0/419947681 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13f415d490 msgr2=0x7f13f40cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:11.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.612+0000 7f13f9382640 1 --2- 172.21.15.77:0/419947681 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13f415d490 0x7f13f40cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.612+0000 7f13f9382640 1 -- 172.21.15.77:0/419947681 >> v1:172.21.15.77:6789/0 conn(0x7f13f40b63d0 legacy=0x7f13f40d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.612+0000 7f13f9382640 1 -- 172.21.15.77:0/419947681 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f40ce750 con 0x7f13f40d3940 2023-11-26T07:20:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.614+0000 7f13f9382640 1 --2- 172.21.15.77:0/419947681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f40d3940 0x7f13f40d1250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13ec009d90 tx=0x7f13ec02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9865d845ab1ebe1a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.614+0000 7f13f37fe640 1 -- 172.21.15.77:0/419947681 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec02cc50 con 0x7f13f40d3940 2023-11-26T07:20:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.614+0000 7f13f37fe640 1 -- 172.21.15.77:0/419947681 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ec02cdb0 con 0x7f13f40d3940 2023-11-26T07:20:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.614+0000 7f13f37fe640 1 -- 172.21.15.77:0/419947681 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec034660 con 0x7f13f40d3940 2023-11-26T07:20:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.614+0000 7f13f9b83640 1 -- 172.21.15.77:0/419947681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f40d3940 msgr2=0x7f13f40d1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.614+0000 7f13f9b83640 1 --2- 172.21.15.77:0/419947681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f40d3940 0x7f13f40d1250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13ec009d90 tx=0x7f13ec02bea0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.615+0000 7f13f9b83640 1 -- 172.21.15.77:0/419947681 shutdown_connections 2023-11-26T07:20:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.615+0000 7f13f9b83640 1 --2- 172.21.15.77:0/419947681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f40d3940 0x7f13f40d1250 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.615+0000 7f13f9b83640 1 --2- 172.21.15.77:0/419947681 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13f415d490 0x7f13f40cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.615+0000 7f13f9b83640 1 -- 172.21.15.77:0/419947681 >> 172.21.15.77:0/419947681 conn(0x7f13f4061340 msgr2=0x7f13f4061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:11.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.615+0000 7f13f9b83640 1 -- 172.21.15.77:0/419947681 shutdown_connections 2023-11-26T07:20:11.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.615+0000 7f13f9b83640 1 -- 172.21.15.77:0/419947681 wait complete. 2023-11-26T07:20:11.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.616+0000 7f13f9b83640 1 Processor -- start 2023-11-26T07:20:11.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.616+0000 7f13f9b83640 1 -- start start 2023-11-26T07:20:11.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.617+0000 7f13f9b83640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13f40d3940 0x7f13f4159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.617+0000 7f13f9b83640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f415d490 0x7f13f415e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.617+0000 7f13f9b83640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13f415ee00 0x7f13f40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.617+0000 7f13f9b83640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40c9bd0 con 0x7f13f40d3940 2023-11-26T07:20:11.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.617+0000 7f13f9b83640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40cb550 con 0x7f13f415d490 2023-11-26T07:20:11.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.617+0000 7f13f9b83640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f415a100 con 0x7f13f415ee00 2023-11-26T07:20:11.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f8b81640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13f40d3940 0x7f13f4159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f415d490 0x7f13f415e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f415d490 0x7f13f415e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:49606/0 (socket says 172.21.15.77:49606) 2023-11-26T07:20:11.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f8b81640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13f40d3940 0x7f13f4159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54646/0 (socket says 172.21.15.77:54646) 2023-11-26T07:20:11.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f3fff640 1 -- 172.21.15.77:0/2638371622 learned_addr learned my addr 172.21.15.77:0/2638371622 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:11.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f9382640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13f415ee00 0x7f13f40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f3fff640 1 -- 172.21.15.77:0/2638371622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13f415ee00 msgr2=0x7f13f40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f3fff640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13f415ee00 0x7f13f40cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f3fff640 1 -- 172.21.15.77:0/2638371622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13f40d3940 msgr2=0x7f13f4159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f3fff640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13f40d3940 0x7f13f4159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f3fff640 1 -- 172.21.15.77:0/2638371622 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec009a70 con 0x7f13f415d490 2023-11-26T07:20:11.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f8b81640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13f40d3940 0x7f13f4159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:20:11.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.618+0000 7f13f3fff640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f415d490 0x7f13f415e8c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13e000c500 tx=0x7f13e000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:11.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.619+0000 7f13f17fa640 1 -- 172.21.15.77:0/2638371622 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0005ce0 con 0x7f13f415d490 2023-11-26T07:20:11.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.619+0000 7f13f17fa640 1 -- 172.21.15.77:0/2638371622 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e0005e40 con 0x7f13f415d490 2023-11-26T07:20:11.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.619+0000 7f13f9b83640 1 -- 172.21.15.77:0/2638371622 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f40cac20 con 0x7f13f415d490 2023-11-26T07:20:11.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.619+0000 7f13f17fa640 1 -- 172.21.15.77:0/2638371622 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0007330 con 0x7f13f415d490 2023-11-26T07:20:11.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.619+0000 7f13f9b83640 1 -- 172.21.15.77:0/2638371622 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f40cb1e0 con 0x7f13f415d490 2023-11-26T07:20:11.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.620+0000 7f13f9b83640 1 -- 172.21.15.77:0/2638371622 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f40cb6c0 con 0x7f13f415d490 2023-11-26T07:20:11.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.621+0000 7f13f17fa640 1 -- 172.21.15.77:0/2638371622 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f13e0007550 con 0x7f13f415d490 2023-11-26T07:20:11.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.622+0000 7f13f17fa640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13d806b110 0x7f13d806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.622+0000 7f13f17fa640 1 -- 172.21.15.77:0/2638371622 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f13e0088d00 con 0x7f13f415d490 2023-11-26T07:20:11.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.622+0000 7f13f8b81640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13d806b110 0x7f13d806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.623+0000 7f13f8b81640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13d806b110 0x7f13d806d5d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009e90 tx=0x7f13e8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:11.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.628+0000 7f13f17fa640 1 -- 172.21.15.77:0/2638371622 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13e0053f20 con 0x7f13f415d490 2023-11-26T07:20:11.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.817+0000 7f13f9b83640 1 -- 172.21.15.77:0/2638371622 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f13f404e840 con 0x7f13f415d490 2023-11-26T07:20:11.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.911+0000 7f13f17fa640 1 -- 172.21.15.77:0/2638371622 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7f13e0017020 con 0x7f13f415d490 2023-11-26T07:20:11.914 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2023-11-26T07:20:11.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 -- 172.21.15.77:0/2638371622 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13d806b110 msgr2=0x7f13d806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13d806b110 0x7f13d806d5d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009e90 tx=0x7f13e8009190 comp rx=0 tx=0).stop 2023-11-26T07:20:11.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 -- 172.21.15.77:0/2638371622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f415d490 msgr2=0x7f13f415e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f415d490 0x7f13f415e8c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13e000c500 tx=0x7f13e000c9c0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 -- 172.21.15.77:0/2638371622 shutdown_connections 2023-11-26T07:20:11.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f13d806b110 0x7f13d806d5d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13f415ee00 0x7f13f40cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13f415d490 0x7f13f415e8c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 --2- 172.21.15.77:0/2638371622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13f40d3940 0x7f13f4159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 -- 172.21.15.77:0/2638371622 >> 172.21.15.77:0/2638371622 conn(0x7f13f4061340 msgr2=0x7f13f4160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:11.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 -- 172.21.15.77:0/2638371622 shutdown_connections 2023-11-26T07:20:11.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:11.914+0000 7f13f9b83640 1 -- 172.21.15.77:0/2638371622 wait complete. 2023-11-26T07:20:11.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:20:12.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.139+0000 7fa1b869b640 1 Processor -- start 2023-11-26T07:20:12.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.139+0000 7fa1b869b640 1 -- start start 2023-11-26T07:20:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.140+0000 7fa1b869b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa1b00cd5b0 0x7fa1b00b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.140+0000 7fa1b869b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b00711e0 con 0x7fa1b00abf50 2023-11-26T07:20:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.140+0000 7fa1b869b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b00cdc80 con 0x7fa1b015b5e0 2023-11-26T07:20:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.140+0000 7fa1b869b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b00705d0 con 0x7fa1b00cd5b0 2023-11-26T07:20:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.141+0000 7fa1b6c38640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa1b00abf50 0x7fa1b0071670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58144/0 (socket says 172.21.15.77:58144) 2023-11-26T07:20:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.141+0000 7fa1b6c38640 1 -- 172.21.15.77:0/866482738 learned_addr learned my addr 172.21.15.77:0/866482738 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.141+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612129115 0 0) 0x7fa1b00711e0 con 0x7fa1b00abf50 2023-11-26T07:20:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.141+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa19c003520 con 0x7fa1b00abf50 2023-11-26T07:20:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.141+0000 7fa1b5c36640 1 --2- 172.21.15.77:0/866482738 >> v2:172.21.15.159:3300/0 conn(0x7fa1b00cd5b0 0x7fa1b00b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.141+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148585830 0 0) 0x7fa19c003520 con 0x7fa1b00abf50 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.141+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 >> v2:172.21.15.159:3300/0 conn(0x7fa1b00cd5b0 msgr2=0x7fa1b00b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.141+0000 7fa1b5435640 1 --2- 172.21.15.77:0/866482738 >> v2:172.21.15.159:3300/0 conn(0x7fa1b00cd5b0 0x7fa1b00b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.141+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 >> v1:172.21.15.159:6789/0 conn(0x7fa1b015b5e0 legacy=0x7fa1b00ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.141+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b00708b0 con 0x7fa1b00abf50 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.141+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fa1a80019f0 con 0x7fa1b00abf50 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 >> v1:172.21.15.77:6789/0 conn(0x7fa1b00abf50 legacy=0x7fa1b0071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b5435640 1 --2- 172.21.15.77:0/866482738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa19c003970 0x7fa19c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b5435640 1 --2- 172.21.15.77:0/866482738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa19c0047c0 0x7fa19c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b5435640 1 --2- 172.21.15.77:0/866482738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa19c005180 0x7fa19c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b00705d0 con 0x7fa19c005180 2023-11-26T07:20:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c00c0d0 con 0x7fa19c003970 2023-11-26T07:20:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c00c290 con 0x7fa19c0047c0 2023-11-26T07:20:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b6c38640 1 --2- 172.21.15.77:0/866482738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa19c005180 0x7fa19c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b6437640 1 --2- 172.21.15.77:0/866482738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa19c003970 0x7fa19c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b5c36640 1 --2- 172.21.15.77:0/866482738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa19c0047c0 0x7fa19c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b6c38640 1 -- 172.21.15.77:0/866482738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa19c0047c0 msgr2=0x7fa19c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b6c38640 1 --2- 172.21.15.77:0/866482738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa19c0047c0 0x7fa19c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b6c38640 1 -- 172.21.15.77:0/866482738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa19c003970 msgr2=0x7fa19c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b6c38640 1 --2- 172.21.15.77:0/866482738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa19c003970 0x7fa19c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.142+0000 7fa1b6c38640 1 -- 172.21.15.77:0/866482738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c003520 con 0x7fa19c005180 2023-11-26T07:20:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.143+0000 7fa1b6c38640 1 -- 172.21.15.77:0/866482738 reap_dead start 2023-11-26T07:20:12.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.143+0000 7fa1b6c38640 1 --2- 172.21.15.77:0/866482738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa19c005180 0x7fa19c00b980 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800a830 tx=0x7fa19c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ff4a64ccdde5c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.144+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80072d0 con 0x7fa19c005180 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.144+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a802f070 con 0x7fa19c005180 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.144+0000 7fa1b5435640 1 -- 172.21.15.77:0/866482738 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80076b0 con 0x7fa19c005180 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.144+0000 7fa1b869b640 1 -- 172.21.15.77:0/866482738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa19c005180 msgr2=0x7fa19c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.144+0000 7fa1b869b640 1 --2- 172.21.15.77:0/866482738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa19c005180 0x7fa19c00b980 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800a830 tx=0x7fa19c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.144+0000 7fa1b869b640 1 -- 172.21.15.77:0/866482738 shutdown_connections 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.144+0000 7fa1b869b640 1 --2- 172.21.15.77:0/866482738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa19c005180 0x7fa19c00b980 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.144+0000 7fa1b869b640 1 -- 172.21.15.77:0/866482738 >> 172.21.15.77:0/866482738 conn(0x7fa1b00b0c70 msgr2=0x7fa1b00b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.144+0000 7fa1b869b640 1 -- 172.21.15.77:0/866482738 shutdown_connections 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.144+0000 7fa1b869b640 1 -- 172.21.15.77:0/866482738 wait complete. 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.146+0000 7fa1b869b640 1 Processor -- start 2023-11-26T07:20:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.146+0000 7fa1b869b640 1 -- start start 2023-11-26T07:20:12.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.147+0000 7fa1b869b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa19c005180 0x7fa1b01544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.147+0000 7fa1b869b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b01512d0 0x7fa1b0151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.147+0000 7fa1b869b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1b015bc60 0x7fa1b015c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.147+0000 7fa1b869b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b015da50 con 0x7fa1b01512d0 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.147+0000 7fa1b869b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0151c70 con 0x7fa1b015bc60 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.147+0000 7fa1b869b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b015c9b0 con 0x7fa19c005180 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.148+0000 7fa1b5c36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b01512d0 0x7fa1b0151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.148+0000 7fa1b5c36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b01512d0 0x7fa1b0151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54676/0 (socket says 172.21.15.77:54676) 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.148+0000 7fa1b5c36640 1 -- 172.21.15.77:0/1433057162 learned_addr learned my addr 172.21.15.77:0/1433057162 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.148+0000 7fa1b6437640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa19c005180 0x7fa1b01544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.148+0000 7fa1b6c38640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1b015bc60 0x7fa1b015c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.148+0000 7fa1b5c36640 1 -- 172.21.15.77:0/1433057162 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa19c005180 msgr2=0x7fa1b01544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.148+0000 7fa1b5c36640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa19c005180 0x7fa1b01544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.148+0000 7fa1b5c36640 1 -- 172.21.15.77:0/1433057162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1b015bc60 msgr2=0x7fa1b015c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.148+0000 7fa1b5c36640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1b015bc60 0x7fa1b015c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.148+0000 7fa1b5c36640 1 -- 172.21.15.77:0/1433057162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b015cc90 con 0x7fa1b01512d0 2023-11-26T07:20:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.148+0000 7fa1b6437640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa19c005180 0x7fa1b01544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.149+0000 7fa1b5c36640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b01512d0 0x7fa1b0151730 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000e7e0 tx=0x7fa1a000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.149+0000 7fa1a6ffd640 1 -- 172.21.15.77:0/1433057162 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000c6d0 con 0x7fa1b01512d0 2023-11-26T07:20:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.149+0000 7fa1a6ffd640 1 -- 172.21.15.77:0/1433057162 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a000c830 con 0x7fa1b01512d0 2023-11-26T07:20:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.149+0000 7fa1a6ffd640 1 -- 172.21.15.77:0/1433057162 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000cba0 con 0x7fa1b01512d0 2023-11-26T07:20:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.149+0000 7fa1b869b640 1 -- 172.21.15.77:0/1433057162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b015cf70 con 0x7fa1b01512d0 2023-11-26T07:20:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.149+0000 7fa1b869b640 1 -- 172.21.15.77:0/1433057162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b015d530 con 0x7fa1b01512d0 2023-11-26T07:20:12.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.150+0000 7fa1b869b640 1 -- 172.21.15.77:0/1433057162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b004e8b0 con 0x7fa1b01512d0 2023-11-26T07:20:12.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.151+0000 7fa1a6ffd640 1 -- 172.21.15.77:0/1433057162 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fa1a000cd00 con 0x7fa1b01512d0 2023-11-26T07:20:12.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.152+0000 7fa1a6ffd640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa19406b110 0x7fa19406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.152+0000 7fa1a6ffd640 1 -- 172.21.15.77:0/1433057162 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa1a00896b0 con 0x7fa1b01512d0 2023-11-26T07:20:12.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.152+0000 7fa1b6437640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa19406b110 0x7fa19406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.153+0000 7fa1b6437640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa19406b110 0x7fa19406d5d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac000c00 tx=0x7fa1ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.156+0000 7fa1a6ffd640 1 -- 172.21.15.77:0/1433057162 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa1a0054610 con 0x7fa1b01512d0 2023-11-26T07:20:12.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.394+0000 7fa1b869b640 1 -- 172.21.15.77:0/1433057162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa1b00cc9e0 con 0x7fa1b01512d0 2023-11-26T07:20:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.395+0000 7fa1a6ffd640 1 -- 172.21.15.77:0/1433057162 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa1a0057c30 con 0x7fa1b01512d0 2023-11-26T07:20:12.398 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:12.398 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:20:12.398 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2023-11-26T07:20:12.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.398 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJls/H7KhAAJS2XRN0c7/K+7oskAg2PWQ==", 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJljSp5DRAAOH30kXLDMsVQpQomhskVow==", 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.399 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJlejOkOBAAdCCERoTPpw8Fk1PciaPtag==", 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:20:12.400 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJl5HpoHhAAaW2/GvlUZsizM1A5Gd3U7A==", 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.401 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDS8GJlaI6nFxAARyjS0s1azVjAfqdNZIT4BA==", 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDV8GJl+YY9IhAAPh7GuZ2EhEZBybZJJL16gA==", 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.402 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDY8GJlWjPxOhAApethgteKlUOMhor55mJc9A==", 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDc8GJl9OCqFxAAJeYH2CcWuQG8iILjc/PmTw==", 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDj8GJlVXaWGxAAfxXHfo561p+2qKX1+9C7+A==", 2023-11-26T07:20:12.404 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDm8GJlrAsENhAALSWl4bAiy33+ZxX95xvcIw==", 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.405 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDq8GJlUm5MEhAAVlkzzyqBJP1qdcuCfwhZmw==", 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.406 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDt8GJlhvw+KxAAfn+Rklyv9MbMoGvi64A3eQ==", 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJlhqOIKxAAiafAbVhNu4B+yTd/1i7+1A==", 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:20:12.407 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow r", 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDO8GJlTnRuBhAA00v94pDxY21mhcK5h8b5ag==", 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJlCgKpNhAAX0HSBMyXxclLtvXwdw4gBQ==", 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDO8GJlFP2HERAA02DfbslNoErl7daZAir6yw==", 2023-11-26T07:20:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDL8GJlGorHHhAAWxHMjiSUuG8u/Jl0dYqSBg==", 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:20:12.410 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJlYYTeIBAATi/P7CpbfWNxuKAyi2DChA==", 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:12.411 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2023-11-26T07:20:12.412 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJl07f3FBAAL3JjjVDVa3eQe+Phdo0agw==", 2023-11-26T07:20:12.412 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:20:12.412 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:20:12.412 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-26T07:20:12.412 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:20:12.412 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.412 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:12.412 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2023-11-26T07:20:12.412 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:20:12.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 -- 172.21.15.77:0/1433057162 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa19406b110 msgr2=0x7fa19406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa19406b110 0x7fa19406d5d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac000c00 tx=0x7fa1ac009040 comp rx=0 tx=0).stop 2023-11-26T07:20:12.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 -- 172.21.15.77:0/1433057162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b01512d0 msgr2=0x7fa1b0151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b01512d0 0x7fa1b0151730 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000e7e0 tx=0x7fa1a000eca0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 -- 172.21.15.77:0/1433057162 shutdown_connections 2023-11-26T07:20:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa19406b110 0x7fa19406d5d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1b015bc60 0x7fa1b015c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b01512d0 0x7fa1b0151730 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 --2- 172.21.15.77:0/1433057162 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa19c005180 0x7fa1b01544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 -- 172.21.15.77:0/1433057162 >> 172.21.15.77:0/1433057162 conn(0x7fa1b00b0c70 msgr2=0x7fa1b00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 -- 172.21.15.77:0/1433057162 shutdown_connections 2023-11-26T07:20:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.398+0000 7fa1b869b640 1 -- 172.21.15.77:0/1433057162 wait complete. 2023-11-26T07:20:12.417 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:12.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.620+0000 7f289095a640 1 Processor -- start 2023-11-26T07:20:12.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.621+0000 7f289095a640 1 -- start start 2023-11-26T07:20:12.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.622+0000 7f289095a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f288c15c7f0 0x7f288c06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.622+0000 7f289095a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f288c0cf450 0x7f288c0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.622+0000 7f289095a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f288c0cdfb0 0x7f288c0ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.622+0000 7f289095a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c156010 con 0x7f288c0cdfb0 2023-11-26T07:20:12.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.622+0000 7f289095a640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c06ce30 con 0x7f288c0cf450 2023-11-26T07:20:12.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.622+0000 7f289095a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0cfe10 con 0x7f288c15c7f0 2023-11-26T07:20:12.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.622+0000 7f288ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f288c0cdfb0 0x7f288c0ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.622+0000 7f288ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f288c0cdfb0 0x7f288c0ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54688/0 (socket says 172.21.15.77:54688) 2023-11-26T07:20:12.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.623+0000 7f288ad9d640 1 -- 172.21.15.77:0/1769244746 learned_addr learned my addr 172.21.15.77:0/1769244746 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.623+0000 7f288a59c640 1 --2- 172.21.15.77:0/1769244746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f288c15c7f0 0x7f288c06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.623+0000 7f2881d9b640 1 --2- 172.21.15.77:0/1769244746 >> v2:172.21.15.159:3300/0 conn(0x7f288c0cf450 0x7f288c0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.623+0000 7f288ad9d640 1 -- 172.21.15.77:0/1769244746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f288c15c7f0 msgr2=0x7f288c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.623+0000 7f288ad9d640 1 --2- 172.21.15.77:0/1769244746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f288c15c7f0 0x7f288c06db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.623+0000 7f288ad9d640 1 -- 172.21.15.77:0/1769244746 >> v2:172.21.15.159:3300/0 conn(0x7f288c0cf450 msgr2=0x7f288c0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.623+0000 7f288ad9d640 1 --2- 172.21.15.77:0/1769244746 >> v2:172.21.15.159:3300/0 conn(0x7f288c0cf450 0x7f288c0cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.623+0000 7f288ad9d640 1 -- 172.21.15.77:0/1769244746 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c0cece0 con 0x7f288c0cdfb0 2023-11-26T07:20:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.624+0000 7f288ad9d640 1 --2- 172.21.15.77:0/1769244746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f288c0cdfb0 0x7f288c0ce440 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f288c06b550 tx=0x7f288402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1873932a35ba351 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.624+0000 7f2889d9b640 1 -- 172.21.15.77:0/1769244746 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2884031870 con 0x7f288c0cdfb0 2023-11-26T07:20:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.624+0000 7f2889d9b640 1 -- 172.21.15.77:0/1769244746 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28840319d0 con 0x7f288c0cdfb0 2023-11-26T07:20:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.624+0000 7f2889d9b640 1 -- 172.21.15.77:0/1769244746 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2884031d60 con 0x7f288c0cdfb0 2023-11-26T07:20:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.625+0000 7f289095a640 1 -- 172.21.15.77:0/1769244746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f288c0cdfb0 msgr2=0x7f288c0ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.625+0000 7f289095a640 1 --2- 172.21.15.77:0/1769244746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f288c0cdfb0 0x7f288c0ce440 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f288c06b550 tx=0x7f288402b910 comp rx=0 tx=0).stop 2023-11-26T07:20:12.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.625+0000 7f289095a640 1 -- 172.21.15.77:0/1769244746 shutdown_connections 2023-11-26T07:20:12.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.625+0000 7f289095a640 1 --2- 172.21.15.77:0/1769244746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f288c0cdfb0 0x7f288c0ce440 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.625+0000 7f289095a640 1 --2- 172.21.15.77:0/1769244746 >> v2:172.21.15.159:3300/0 conn(0x7f288c0cf450 0x7f288c0cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.625+0000 7f289095a640 1 --2- 172.21.15.77:0/1769244746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f288c15c7f0 0x7f288c06db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.625+0000 7f289095a640 1 -- 172.21.15.77:0/1769244746 >> 172.21.15.77:0/1769244746 conn(0x7f288c06a920 msgr2=0x7f288c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:12.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.625+0000 7f289095a640 1 -- 172.21.15.77:0/1769244746 shutdown_connections 2023-11-26T07:20:12.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.625+0000 7f289095a640 1 -- 172.21.15.77:0/1769244746 wait complete. 2023-11-26T07:20:12.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.627+0000 7f289095a640 1 Processor -- start 2023-11-26T07:20:12.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.627+0000 7f289095a640 1 -- start start 2023-11-26T07:20:12.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.628+0000 7f289095a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f288c0cdfb0 0x7f288c149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.628+0000 7f289095a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f288c0cf450 0x7f288c0ad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.628+0000 7f289095a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f288c15c7f0 0x7f288c0ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.628+0000 7f289095a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c156170 con 0x7f288c15c7f0 2023-11-26T07:20:12.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.628+0000 7f289095a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c1563c0 con 0x7f288c0cdfb0 2023-11-26T07:20:12.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.628+0000 7f289095a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c1566a0 con 0x7f288c0cf450 2023-11-26T07:20:12.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.628+0000 7f288ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f288c15c7f0 0x7f288c0ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.628+0000 7f288ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f288c15c7f0 0x7f288c0ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54700/0 (socket says 172.21.15.77:54700) 2023-11-26T07:20:12.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.628+0000 7f288ad9d640 1 -- 172.21.15.77:0/1261849380 learned_addr learned my addr 172.21.15.77:0/1261849380 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:12.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.628+0000 7f2881d9b640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f288c0cf450 0x7f288c0ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.628+0000 7f288a59c640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f288c0cdfb0 0x7f288c149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.629+0000 7f288ad9d640 1 -- 172.21.15.77:0/1261849380 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f288c0cf450 msgr2=0x7f288c0ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.629+0000 7f288ad9d640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f288c0cf450 0x7f288c0ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.629+0000 7f288ad9d640 1 -- 172.21.15.77:0/1261849380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f288c0cdfb0 msgr2=0x7f288c149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.629+0000 7f288ad9d640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f288c0cdfb0 0x7f288c149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.629+0000 7f288ad9d640 1 -- 172.21.15.77:0/1261849380 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840094d0 con 0x7f288c15c7f0 2023-11-26T07:20:12.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.629+0000 7f288ad9d640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f288c15c7f0 0x7f288c0ad680 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f288402b950 tx=0x7f28840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.629+0000 7f28837fe640 1 -- 172.21.15.77:0/1261849380 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288403abe0 con 0x7f288c15c7f0 2023-11-26T07:20:12.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.629+0000 7f28837fe640 1 -- 172.21.15.77:0/1261849380 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288403ad40 con 0x7f288c15c7f0 2023-11-26T07:20:12.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.629+0000 7f28837fe640 1 -- 172.21.15.77:0/1261849380 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2884044630 con 0x7f288c15c7f0 2023-11-26T07:20:12.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.629+0000 7f289095a640 1 -- 172.21.15.77:0/1261849380 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c156980 con 0x7f288c15c7f0 2023-11-26T07:20:12.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.629+0000 7f289095a640 1 -- 172.21.15.77:0/1261849380 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c149940 con 0x7f288c15c7f0 2023-11-26T07:20:12.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.631+0000 7f289095a640 1 -- 172.21.15.77:0/1261849380 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c156ea0 con 0x7f288c15c7f0 2023-11-26T07:20:12.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.631+0000 7f28837fe640 1 -- 172.21.15.77:0/1261849380 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f2884044790 con 0x7f288c15c7f0 2023-11-26T07:20:12.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.632+0000 7f28837fe640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286c06b110 0x7f286c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.632+0000 7f28837fe640 1 -- 172.21.15.77:0/1261849380 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f288402d040 con 0x7f288c15c7f0 2023-11-26T07:20:12.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.633+0000 7f288a59c640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286c06b110 0x7f286c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.633+0000 7f288a59c640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286c06b110 0x7f286c06d5d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f287c0099c0 tx=0x7f287c003990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.636+0000 7f28837fe640 1 -- 172.21.15.77:0/1261849380 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2884076d80 con 0x7f288c15c7f0 2023-11-26T07:20:12.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.814+0000 7f289095a640 1 -- 172.21.15.77:0/1261849380 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f288c067470 con 0x7f288c15c7f0 2023-11-26T07:20:12.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.816+0000 7f28837fe640 1 -- 172.21.15.77:0/1261849380 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12833 (secure 0 0 0) 0x7f288407a3a0 con 0x7f288c15c7f0 2023-11-26T07:20:12.818 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:12.819 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":43,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:20:11.917277+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.818+0000 7f289095a640 1 -- 172.21.15.77:0/1261849380 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286c06b110 msgr2=0x7f286c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.818+0000 7f289095a640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286c06b110 0x7f286c06d5d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f287c0099c0 tx=0x7f287c003990 comp rx=0 tx=0).stop 2023-11-26T07:20:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.818+0000 7f289095a640 1 -- 172.21.15.77:0/1261849380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f288c15c7f0 msgr2=0x7f288c0ad680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.818+0000 7f289095a640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f288c15c7f0 0x7f288c0ad680 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f288402b950 tx=0x7f28840046c0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.819+0000 7f289095a640 1 -- 172.21.15.77:0/1261849380 shutdown_connections 2023-11-26T07:20:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.819+0000 7f289095a640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286c06b110 0x7f286c06d5d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.819+0000 7f289095a640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f288c15c7f0 0x7f288c0ad680 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.819+0000 7f289095a640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f288c0cf450 0x7f288c0ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.819+0000 7f289095a640 1 --2- 172.21.15.77:0/1261849380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f288c0cdfb0 0x7f288c149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.819+0000 7f289095a640 1 -- 172.21.15.77:0/1261849380 >> 172.21.15.77:0/1261849380 conn(0x7f288c06a920 msgr2=0x7f288c0cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.819+0000 7f289095a640 1 -- 172.21.15.77:0/1261849380 shutdown_connections 2023-11-26T07:20:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:12.819+0000 7f289095a640 1 -- 172.21.15.77:0/1261849380 wait complete. 2023-11-26T07:20:12.839 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:20:12.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:20:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.062+0000 7f839b1ec640 1 Processor -- start 2023-11-26T07:20:13.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.062+0000 7f839b1ec640 1 -- start start 2023-11-26T07:20:13.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f839b1ec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f839406de10 0x7f839415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f839b1ec640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83940c49f0 0x7f83940705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f839b1ec640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839415ec90 con 0x7f8394072160 2023-11-26T07:20:13.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f839b1ec640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83940cd530 con 0x7f839406de10 2023-11-26T07:20:13.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f839b1ec640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83940c4ed0 con 0x7f83940c49f0 2023-11-26T07:20:13.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f8393fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f839406de10 0x7f839415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f8393fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f839406de10 0x7f839415e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54706/0 (socket says 172.21.15.77:54706) 2023-11-26T07:20:13.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f8393fff640 1 -- 172.21.15.77:0/4098327397 learned_addr learned my addr 172.21.15.77:0/4098327397 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:13.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f8393fff640 1 -- 172.21.15.77:0/4098327397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83940c49f0 msgr2=0x7f83940705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:13.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f8393fff640 1 --2- 172.21.15.77:0/4098327397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83940c49f0 0x7f83940705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f8393fff640 1 -- 172.21.15.77:0/4098327397 >> v1:172.21.15.77:6789/0 conn(0x7f8394072160 legacy=0x7f839406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.064+0000 7f8393fff640 1 -- 172.21.15.77:0/4098327397 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940c51b0 con 0x7f839406de10 2023-11-26T07:20:13.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.066+0000 7f8393fff640 1 --2- 172.21.15.77:0/4098327397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f839406de10 0x7f839415e750 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f837c009e50 tx=0x7f837c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c3b50a1a38c8ab server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.066+0000 7f83937fe640 1 -- 172.21.15.77:0/4098327397 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c02cb20 con 0x7f839406de10 2023-11-26T07:20:13.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.066+0000 7f83937fe640 1 -- 172.21.15.77:0/4098327397 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c02cc80 con 0x7f839406de10 2023-11-26T07:20:13.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.066+0000 7f83937fe640 1 -- 172.21.15.77:0/4098327397 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0343f0 con 0x7f839406de10 2023-11-26T07:20:13.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.067+0000 7f839b1ec640 1 -- 172.21.15.77:0/4098327397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f839406de10 msgr2=0x7f839415e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.067+0000 7f839b1ec640 1 --2- 172.21.15.77:0/4098327397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f839406de10 0x7f839415e750 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f837c009e50 tx=0x7f837c02bf80 comp rx=0 tx=0).stop 2023-11-26T07:20:13.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.067+0000 7f839b1ec640 1 -- 172.21.15.77:0/4098327397 shutdown_connections 2023-11-26T07:20:13.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.067+0000 7f839b1ec640 1 --2- 172.21.15.77:0/4098327397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83940c49f0 0x7f83940705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.067+0000 7f839b1ec640 1 --2- 172.21.15.77:0/4098327397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f839406de10 0x7f839415e750 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.067+0000 7f839b1ec640 1 -- 172.21.15.77:0/4098327397 >> 172.21.15.77:0/4098327397 conn(0x7f83940b0c50 msgr2=0x7f83940b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:13.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.067+0000 7f839b1ec640 1 -- 172.21.15.77:0/4098327397 shutdown_connections 2023-11-26T07:20:13.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.067+0000 7f839b1ec640 1 -- 172.21.15.77:0/4098327397 wait complete. 2023-11-26T07:20:13.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.069+0000 7f839b1ec640 1 Processor -- start 2023-11-26T07:20:13.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.069+0000 7f839b1ec640 1 -- start start 2023-11-26T07:20:13.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f839b1ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f839406de10 0x7f83941f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f839b1ec640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8394072160 0x7f83941569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f839b1ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940c49f0 0x7f8394156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f839b1ec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8394154220 con 0x7f839406de10 2023-11-26T07:20:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f839b1ec640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8394158240 con 0x7f83940c49f0 2023-11-26T07:20:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f839b1ec640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8394157910 con 0x7f8394072160 2023-11-26T07:20:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f8398f88640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f839406de10 0x7f83941f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f8398f88640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f839406de10 0x7f83941f4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54708/0 (socket says 172.21.15.77:54708) 2023-11-26T07:20:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f8398f88640 1 -- 172.21.15.77:0/4255624536 learned_addr learned my addr 172.21.15.77:0/4255624536 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f8393fff640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8394072160 0x7f83941569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f8398f88640 1 -- 172.21.15.77:0/4255624536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8394072160 msgr2=0x7f83941569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f8398f88640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8394072160 0x7f83941569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f8398f88640 1 -- 172.21.15.77:0/4255624536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940c49f0 msgr2=0x7f8394156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f8398f88640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940c49f0 0x7f8394156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.070+0000 7f8398f88640 1 -- 172.21.15.77:0/4255624536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009b30 con 0x7f839406de10 2023-11-26T07:20:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.071+0000 7f8398f88640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f839406de10 0x7f83941f4620 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f838400c450 tx=0x7f838400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.071+0000 7f83917fa640 1 -- 172.21.15.77:0/4255624536 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83840052d0 con 0x7f839406de10 2023-11-26T07:20:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.071+0000 7f83917fa640 1 -- 172.21.15.77:0/4255624536 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8384005430 con 0x7f839406de10 2023-11-26T07:20:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.071+0000 7f839b1ec640 1 -- 172.21.15.77:0/4255624536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8394157bf0 con 0x7f839406de10 2023-11-26T07:20:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.071+0000 7f83917fa640 1 -- 172.21.15.77:0/4255624536 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384012870 con 0x7f839406de10 2023-11-26T07:20:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.071+0000 7f839b1ec640 1 -- 172.21.15.77:0/4255624536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83941534f0 con 0x7f839406de10 2023-11-26T07:20:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.073+0000 7f839b1ec640 1 -- 172.21.15.77:0/4255624536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839404e8b0 con 0x7f839406de10 2023-11-26T07:20:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.073+0000 7f83917fa640 1 -- 172.21.15.77:0/4255624536 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f83840129d0 con 0x7f839406de10 2023-11-26T07:20:13.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.074+0000 7f83917fa640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406b110 0x7f837406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.074+0000 7f83917fa640 1 -- 172.21.15.77:0/4255624536 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8384088fe0 con 0x7f839406de10 2023-11-26T07:20:13.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.074+0000 7f8393fff640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406b110 0x7f837406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.075+0000 7f8393fff640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406b110 0x7f837406d5d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f837c035000 tx=0x7f837c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.078+0000 7f83917fa640 1 -- 172.21.15.77:0/4255624536 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f83840bbe90 con 0x7f839406de10 2023-11-26T07:20:13.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.269+0000 7f839b1ec640 1 -- 172.21.15.77:0/4255624536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f839415ec90 con 0x7f839406de10 2023-11-26T07:20:13.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.270+0000 7f83917fa640 1 -- 172.21.15.77:0/4255624536 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f839415ec90 con 0x7f839406de10 2023-11-26T07:20:13.273 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:20:13.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 -- 172.21.15.77:0/4255624536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406b110 msgr2=0x7f837406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406b110 0x7f837406d5d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f837c035000 tx=0x7f837c030000 comp rx=0 tx=0).stop 2023-11-26T07:20:13.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 -- 172.21.15.77:0/4255624536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f839406de10 msgr2=0x7f83941f4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f839406de10 0x7f83941f4620 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f838400c450 tx=0x7f838400c910 comp rx=0 tx=0).stop 2023-11-26T07:20:13.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 -- 172.21.15.77:0/4255624536 shutdown_connections 2023-11-26T07:20:13.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f837406b110 0x7f837406d5d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83940c49f0 0x7f8394156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8394072160 0x7f83941569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 --2- 172.21.15.77:0/4255624536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f839406de10 0x7f83941f4620 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 -- 172.21.15.77:0/4255624536 >> 172.21.15.77:0/4255624536 conn(0x7f83940b0c50 msgr2=0x7f83940b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:13.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 -- 172.21.15.77:0/4255624536 shutdown_connections 2023-11-26T07:20:13.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.273+0000 7f839b1ec640 1 -- 172.21.15.77:0/4255624536 wait complete. 2023-11-26T07:20:13.295 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:20:13.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.506+0000 7fe57e363640 1 Processor -- start 2023-11-26T07:20:13.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.506+0000 7fe57e363640 1 -- start start 2023-11-26T07:20:13.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.508+0000 7fe57e363640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5780cf870 0x7fe57806e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.508+0000 7fe57e363640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe57806ed70 0x7fe57806f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.508+0000 7fe57e363640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5780ceba0 con 0x7fe57815eb20 2023-11-26T07:20:13.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.508+0000 7fe57e363640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57815ef00 con 0x7fe57806ed70 2023-11-26T07:20:13.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.508+0000 7fe57e363640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5780d0090 con 0x7fe5780cf870 2023-11-26T07:20:13.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.508+0000 7fe57d361640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe57815eb20 0x7fe5780cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58148/0 (socket says 172.21.15.77:58148) 2023-11-26T07:20:13.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.508+0000 7fe57d361640 1 -- 172.21.15.77:0/42542064 learned_addr learned my addr 172.21.15.77:0/42542064 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe57cb60640 1 --2- 172.21.15.77:0/42542064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5780cf870 0x7fe57806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe57db62640 1 --2- 172.21.15.77:0/42542064 >> v2:172.21.15.159:3300/0 conn(0x7fe57806ed70 0x7fe57806f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369216615 0 0) 0x7fe5780ceba0 con 0x7fe57815eb20 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe564003520 con 0x7fe57815eb20 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1388325326 0 0) 0x7fe564003520 con 0x7fe57815eb20 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5780cf870 msgr2=0x7fe57806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 --2- 172.21.15.77:0/42542064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5780cf870 0x7fe57806e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 >> v2:172.21.15.159:3300/0 conn(0x7fe57806ed70 msgr2=0x7fe57806f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 --2- 172.21.15.77:0/42542064 >> v2:172.21.15.159:3300/0 conn(0x7fe57806ed70 0x7fe57806f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5780b0070 con 0x7fe57815eb20 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fe574001670 con 0x7fe57815eb20 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe57db62640 1 --2- 172.21.15.77:0/42542064 >> v2:172.21.15.159:3300/0 conn(0x7fe57806ed70 0x7fe57806f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 >> v1:172.21.15.77:6789/0 conn(0x7fe57815eb20 legacy=0x7fe5780cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 --2- 172.21.15.77:0/42542064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5780cf870 0x7fe564003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 --2- 172.21.15.77:0/42542064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe564003ef0 0x7fe5640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 --2- 172.21.15.77:0/42542064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe564004d00 0x7fe564005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5780d0090 con 0x7fe564004d00 2023-11-26T07:20:13.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56400b980 con 0x7fe564003ef0 2023-11-26T07:20:13.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.509+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56400bb10 con 0x7fe5780cf870 2023-11-26T07:20:13.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.510+0000 7fe57db62640 1 --2- 172.21.15.77:0/42542064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe564004d00 0x7fe564005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.510+0000 7fe57db62640 1 -- 172.21.15.77:0/42542064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5780cf870 msgr2=0x7fe564003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:13.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.510+0000 7fe57db62640 1 --2- 172.21.15.77:0/42542064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5780cf870 0x7fe564003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.510+0000 7fe57db62640 1 -- 172.21.15.77:0/42542064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe564003ef0 msgr2=0x7fe5640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:13.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.510+0000 7fe57db62640 1 --2- 172.21.15.77:0/42542064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe564003ef0 0x7fe5640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.510+0000 7fe57db62640 1 -- 172.21.15.77:0/42542064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe564003520 con 0x7fe564004d00 2023-11-26T07:20:13.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.511+0000 7fe57db62640 1 --2- 172.21.15.77:0/42542064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe564004d00 0x7fe564005180 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe5700073e0 tx=0x7fe5640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ea7ffc3d4a0062 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.511+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57002cdc0 con 0x7fe564004d00 2023-11-26T07:20:13.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.511+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe570034440 con 0x7fe564004d00 2023-11-26T07:20:13.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.511+0000 7fe56ffff640 1 -- 172.21.15.77:0/42542064 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5700347b0 con 0x7fe564004d00 2023-11-26T07:20:13.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.512+0000 7fe57e363640 1 -- 172.21.15.77:0/42542064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe564004d00 msgr2=0x7fe564005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.512+0000 7fe57e363640 1 --2- 172.21.15.77:0/42542064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe564004d00 0x7fe564005180 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe5700073e0 tx=0x7fe5640057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.512+0000 7fe57db62640 1 -- 172.21.15.77:0/42542064 reap_dead start 2023-11-26T07:20:13.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.512+0000 7fe57e363640 1 -- 172.21.15.77:0/42542064 shutdown_connections 2023-11-26T07:20:13.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.512+0000 7fe57e363640 1 -- 172.21.15.77:0/42542064 >> 172.21.15.77:0/42542064 conn(0x7fe5780cda50 msgr2=0x7fe5780cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:13.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.512+0000 7fe57e363640 1 -- 172.21.15.77:0/42542064 shutdown_connections 2023-11-26T07:20:13.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.512+0000 7fe57e363640 1 -- 172.21.15.77:0/42542064 wait complete. 2023-11-26T07:20:13.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.514+0000 7fe57e363640 1 Processor -- start 2023-11-26T07:20:13.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.514+0000 7fe57e363640 1 -- start start 2023-11-26T07:20:13.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.515+0000 7fe57e363640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe578153490 0x7fe5780ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.515+0000 7fe57e363640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5780c7320 0x7fe5780c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.515+0000 7fe57e363640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5780c8e40 0x7fe5781f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.515+0000 7fe57e363640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5780c92f0 con 0x7fe5780c7320 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.515+0000 7fe57e363640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57815ad40 con 0x7fe5780c8e40 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.515+0000 7fe57e363640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5780c6280 con 0x7fe578153490 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.515+0000 7fe57cb60640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5780c7320 0x7fe5780c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.515+0000 7fe57cb60640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5780c7320 0x7fe5780c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54734/0 (socket says 172.21.15.77:54734) 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.515+0000 7fe57cb60640 1 -- 172.21.15.77:0/327904725 learned_addr learned my addr 172.21.15.77:0/327904725 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.516+0000 7fe57cb60640 1 -- 172.21.15.77:0/327904725 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe578153490 msgr2=0x7fe5780ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.516+0000 7fe57cb60640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe578153490 0x7fe5780ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.516+0000 7fe57cb60640 1 -- 172.21.15.77:0/327904725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5780c8e40 msgr2=0x7fe5781f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.516+0000 7fe57cb60640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5780c8e40 0x7fe5781f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.516+0000 7fe57cb60640 1 -- 172.21.15.77:0/327904725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5780c6560 con 0x7fe5780c7320 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.516+0000 7fe57cb60640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5780c7320 0x7fe5780c8900 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe56800e780 tx=0x7fe56800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.516+0000 7fe56dffb640 1 -- 172.21.15.77:0/327904725 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800ee90 con 0x7fe5780c7320 2023-11-26T07:20:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.516+0000 7fe56dffb640 1 -- 172.21.15.77:0/327904725 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800c8c0 con 0x7fe5780c7320 2023-11-26T07:20:13.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.516+0000 7fe56dffb640 1 -- 172.21.15.77:0/327904725 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800cc70 con 0x7fe5780c7320 2023-11-26T07:20:13.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.516+0000 7fe57e363640 1 -- 172.21.15.77:0/327904725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5780c6840 con 0x7fe5780c7320 2023-11-26T07:20:13.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.516+0000 7fe57e363640 1 -- 172.21.15.77:0/327904725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5780c6e00 con 0x7fe5780c7320 2023-11-26T07:20:13.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.518+0000 7fe57e363640 1 -- 172.21.15.77:0/327904725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe578067990 con 0x7fe5780c7320 2023-11-26T07:20:13.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.519+0000 7fe56dffb640 1 -- 172.21.15.77:0/327904725 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fe568013470 con 0x7fe5780c7320 2023-11-26T07:20:13.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.519+0000 7fe56dffb640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe55c06b110 0x7fe55c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.520+0000 7fe56dffb640 1 -- 172.21.15.77:0/327904725 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe568089b80 con 0x7fe5780c7320 2023-11-26T07:20:13.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.520+0000 7fe57d361640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe55c06b110 0x7fe55c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.520+0000 7fe57d361640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe55c06b110 0x7fe55c06d5d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe574000f60 tx=0x7fe574001530 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.524+0000 7fe56dffb640 1 -- 172.21.15.77:0/327904725 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe568054b50 con 0x7fe5780c7320 2023-11-26T07:20:13.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.715+0000 7fe57e363640 1 -- 172.21.15.77:0/327904725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe5780c48c0 con 0x7fe5780c7320 2023-11-26T07:20:13.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.716+0000 7fe56dffb640 1 -- 172.21.15.77:0/327904725 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe568017090 con 0x7fe5780c7320 2023-11-26T07:20:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:13.719 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-26T07:20:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-11-26T07:20:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-11-26T07:20:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:13.719 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-26T07:20:13.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.718+0000 7fe57e363640 1 -- 172.21.15.77:0/327904725 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe55c06b110 msgr2=0x7fe55c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.718+0000 7fe57e363640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe55c06b110 0x7fe55c06d5d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe574000f60 tx=0x7fe574001530 comp rx=0 tx=0).stop 2023-11-26T07:20:13.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.719+0000 7fe57e363640 1 -- 172.21.15.77:0/327904725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5780c7320 msgr2=0x7fe5780c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.719+0000 7fe57e363640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5780c7320 0x7fe5780c8900 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe56800e780 tx=0x7fe56800ec40 comp rx=0 tx=0).stop 2023-11-26T07:20:13.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.719+0000 7fe57e363640 1 -- 172.21.15.77:0/327904725 shutdown_connections 2023-11-26T07:20:13.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.719+0000 7fe57e363640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe55c06b110 0x7fe55c06d5d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.719+0000 7fe57e363640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5780c8e40 0x7fe5781f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.719+0000 7fe57e363640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5780c7320 0x7fe5780c8900 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.719+0000 7fe57e363640 1 --2- 172.21.15.77:0/327904725 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe578153490 0x7fe5780ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.719+0000 7fe57e363640 1 -- 172.21.15.77:0/327904725 >> 172.21.15.77:0/327904725 conn(0x7fe5780cda50 msgr2=0x7fe5780aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:13.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.719+0000 7fe57e363640 1 -- 172.21.15.77:0/327904725 shutdown_connections 2023-11-26T07:20:13.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.719+0000 7fe57e363640 1 -- 172.21.15.77:0/327904725 wait complete. 2023-11-26T07:20:13.741 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:20:13.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:20:13.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.961+0000 7f20d0b53640 1 Processor -- start 2023-11-26T07:20:13.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.961+0000 7f20d0b53640 1 -- start start 2023-11-26T07:20:13.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.962+0000 7f20d0b53640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f20cc157c70 0x7f20cc161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.962+0000 7f20d0b53640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20cc0cf450 0x7f20cc0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.962+0000 7f20d0b53640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f20cc15dc80 0x7f20cc15e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.962+0000 7f20d0b53640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20cc0cfe10 con 0x7f20cc15dc80 2023-11-26T07:20:13.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.962+0000 7f20d0b53640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20cc0ce0b0 con 0x7f20cc157c70 2023-11-26T07:20:13.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.962+0000 7f20d0b53640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc161960 con 0x7f20cc0cf450 2023-11-26T07:20:13.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.963+0000 7f20cad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f20cc15dc80 0x7f20cc15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.963+0000 7f20cad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f20cc15dc80 0x7f20cc15e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54736/0 (socket says 172.21.15.77:54736) 2023-11-26T07:20:13.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.963+0000 7f20cad9d640 1 -- 172.21.15.77:0/3939681962 learned_addr learned my addr 172.21.15.77:0/3939681962 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:13.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.963+0000 7f20c9d9b640 1 --2- 172.21.15.77:0/3939681962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20cc0cf450 0x7f20cc0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.963+0000 7f20cad9d640 1 -- 172.21.15.77:0/3939681962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20cc0cf450 msgr2=0x7f20cc0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:13.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.963+0000 7f20cad9d640 1 --2- 172.21.15.77:0/3939681962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20cc0cf450 0x7f20cc0cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.963+0000 7f20ca59c640 1 --2- 172.21.15.77:0/3939681962 >> v2:172.21.15.159:3300/0 conn(0x7f20cc157c70 0x7f20cc161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.963+0000 7f20cad9d640 1 -- 172.21.15.77:0/3939681962 >> v2:172.21.15.159:3300/0 conn(0x7f20cc157c70 msgr2=0x7f20cc161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:13.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.963+0000 7f20cad9d640 1 --2- 172.21.15.77:0/3939681962 >> v2:172.21.15.159:3300/0 conn(0x7f20cc157c70 0x7f20cc161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.963+0000 7f20cad9d640 1 -- 172.21.15.77:0/3939681962 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc15e650 con 0x7f20cc15dc80 2023-11-26T07:20:13.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.963+0000 7f20ca59c640 1 --2- 172.21.15.77:0/3939681962 >> v2:172.21.15.159:3300/0 conn(0x7f20cc157c70 0x7f20cc161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:13.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.964+0000 7f20cad9d640 1 --2- 172.21.15.77:0/3939681962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20cc15dc80 0x7f20cc15e110 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f20cc06d5e0 tx=0x7f20c402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc1d7df2b82e701 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20c959a640 1 -- 172.21.15.77:0/3939681962 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c40317d0 con 0x7f20cc15dc80 2023-11-26T07:20:13.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20c959a640 1 -- 172.21.15.77:0/3939681962 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c4031930 con 0x7f20cc15dc80 2023-11-26T07:20:13.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20c959a640 1 -- 172.21.15.77:0/3939681962 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4031cc0 con 0x7f20cc15dc80 2023-11-26T07:20:13.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20d0b53640 1 -- 172.21.15.77:0/3939681962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20cc15dc80 msgr2=0x7f20cc15e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20d0b53640 1 --2- 172.21.15.77:0/3939681962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20cc15dc80 0x7f20cc15e110 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f20cc06d5e0 tx=0x7f20c402b870 comp rx=0 tx=0).stop 2023-11-26T07:20:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20d0b53640 1 -- 172.21.15.77:0/3939681962 shutdown_connections 2023-11-26T07:20:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20d0b53640 1 --2- 172.21.15.77:0/3939681962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20cc15dc80 0x7f20cc15e110 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20d0b53640 1 --2- 172.21.15.77:0/3939681962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20cc0cf450 0x7f20cc0cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20d0b53640 1 --2- 172.21.15.77:0/3939681962 >> v2:172.21.15.159:3300/0 conn(0x7f20cc157c70 0x7f20cc161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20d0b53640 1 -- 172.21.15.77:0/3939681962 >> 172.21.15.77:0/3939681962 conn(0x7f20cc06a920 msgr2=0x7f20cc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20d0b53640 1 -- 172.21.15.77:0/3939681962 shutdown_connections 2023-11-26T07:20:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.965+0000 7f20d0b53640 1 -- 172.21.15.77:0/3939681962 wait complete. 2023-11-26T07:20:13.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.967+0000 7f20d0b53640 1 Processor -- start 2023-11-26T07:20:13.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.967+0000 7f20d0b53640 1 -- start start 2023-11-26T07:20:13.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.968+0000 7f20d0b53640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0cf450 0x7f20cc0b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.968+0000 7f20d0b53640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20cc157c70 0x7f20cc154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.968+0000 7f20d0b53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20cc15dc80 0x7f20cc1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.968+0000 7f20d0b53640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0abfc0 con 0x7f20cc15dc80 2023-11-26T07:20:13.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.968+0000 7f20d0b53640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0ace20 con 0x7f20cc0cf450 2023-11-26T07:20:13.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.968+0000 7f20d0b53640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0ac1a0 con 0x7f20cc157c70 2023-11-26T07:20:13.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20cad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20cc15dc80 0x7f20cc1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20cad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20cc15dc80 0x7f20cc1546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54744/0 (socket says 172.21.15.77:54744) 2023-11-26T07:20:13.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20cad9d640 1 -- 172.21.15.77:0/1965284136 learned_addr learned my addr 172.21.15.77:0/1965284136 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20c9d9b640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20cc157c70 0x7f20cc154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20ca59c640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0cf450 0x7f20cc0b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20cad9d640 1 -- 172.21.15.77:0/1965284136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20cc157c70 msgr2=0x7f20cc154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20cad9d640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20cc157c70 0x7f20cc154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20cad9d640 1 -- 172.21.15.77:0/1965284136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0cf450 msgr2=0x7f20cc0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20cad9d640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0cf450 0x7f20cc0b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20cad9d640 1 -- 172.21.15.77:0/1965284136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c40094d0 con 0x7f20cc15dc80 2023-11-26T07:20:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20ca59c640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0cf450 0x7f20cc0b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.969+0000 7f20cad9d640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20cc15dc80 0x7f20cc1546a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f20c40090b0 tx=0x7f20c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.970+0000 7f20c2ffd640 1 -- 172.21.15.77:0/1965284136 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4032930 con 0x7f20cc15dc80 2023-11-26T07:20:13.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.970+0000 7f20c2ffd640 1 -- 172.21.15.77:0/1965284136 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c4032a90 con 0x7f20cc15dc80 2023-11-26T07:20:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.970+0000 7f20c2ffd640 1 -- 172.21.15.77:0/1965284136 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4032e40 con 0x7f20cc15dc80 2023-11-26T07:20:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.970+0000 7f20d0b53640 1 -- 172.21.15.77:0/1965284136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc0ac480 con 0x7f20cc15dc80 2023-11-26T07:20:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.970+0000 7f20d0b53640 1 -- 172.21.15.77:0/1965284136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc0aca40 con 0x7f20cc15dc80 2023-11-26T07:20:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.971+0000 7f20d0b53640 1 -- 172.21.15.77:0/1965284136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20cc0acf60 con 0x7f20cc15dc80 2023-11-26T07:20:13.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.972+0000 7f20c2ffd640 1 -- 172.21.15.77:0/1965284136 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f20c4030070 con 0x7f20cc15dc80 2023-11-26T07:20:13.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.973+0000 7f20c2ffd640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f20ac06b110 0x7f20ac06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.973+0000 7f20c2ffd640 1 -- 172.21.15.77:0/1965284136 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f20c40ab350 con 0x7f20cc15dc80 2023-11-26T07:20:13.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.973+0000 7f20ca59c640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f20ac06b110 0x7f20ac06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.974+0000 7f20ca59c640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f20ac06b110 0x7f20ac06d5d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f20bc007f70 tx=0x7f20bc0074c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:13.977+0000 7f20c2ffd640 1 -- 172.21.15.77:0/1965284136 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f20cc0acf60 con 0x7f20cc15dc80 2023-11-26T07:20:14.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.168+0000 7f20d0b53640 1 -- 172.21.15.77:0/1965284136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f20cc0acf60 con 0x7f20cc15dc80 2023-11-26T07:20:14.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.934+0000 7f20c2ffd640 1 -- 172.21.15.77:0/1965284136 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7f20cc0acf60 con 0x7f20cc15dc80 2023-11-26T07:20:14.937 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-11-26T07:20:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.938+0000 7f20d0b53640 1 -- 172.21.15.77:0/1965284136 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f20ac06b110 msgr2=0x7f20ac06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.938+0000 7f20d0b53640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f20ac06b110 0x7f20ac06d5d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f20bc007f70 tx=0x7f20bc0074c0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.938+0000 7f20d0b53640 1 -- 172.21.15.77:0/1965284136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20cc15dc80 msgr2=0x7f20cc1546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.938+0000 7f20d0b53640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20cc15dc80 0x7f20cc1546a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f20c40090b0 tx=0x7f20c40046c0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.938+0000 7f20d0b53640 1 -- 172.21.15.77:0/1965284136 shutdown_connections 2023-11-26T07:20:14.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.938+0000 7f20d0b53640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f20ac06b110 0x7f20ac06d5d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.938+0000 7f20d0b53640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20cc15dc80 0x7f20cc1546a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.938+0000 7f20d0b53640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20cc157c70 0x7f20cc154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.938+0000 7f20d0b53640 1 --2- 172.21.15.77:0/1965284136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20cc0cf450 0x7f20cc0b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.938+0000 7f20d0b53640 1 -- 172.21.15.77:0/1965284136 >> 172.21.15.77:0/1965284136 conn(0x7f20cc06a920 msgr2=0x7f20cc15edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.939+0000 7f20d0b53640 1 -- 172.21.15.77:0/1965284136 shutdown_connections 2023-11-26T07:20:14.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:14.939+0000 7f20d0b53640 1 -- 172.21.15.77:0/1965284136 wait complete. 2023-11-26T07:20:14.968 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:20:15.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.170+0000 7f9cabe90640 1 Processor -- start 2023-11-26T07:20:15.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.170+0000 7f9cabe90640 1 -- start start 2023-11-26T07:20:15.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.172+0000 7f9cabe90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ca415b440 0x7f9ca40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.172+0000 7f9cabe90640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ca40c59b0 0x7f9ca406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.172+0000 7f9cabe90640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca415eea0 con 0x7f9ca40cbf20 2023-11-26T07:20:15.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.172+0000 7f9cabe90640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca40c5e00 con 0x7f9ca415b440 2023-11-26T07:20:15.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.172+0000 7f9cabe90640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca40cc3d0 con 0x7f9ca40c59b0 2023-11-26T07:20:15.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.172+0000 7f9ca9c2c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ca415b440 0x7f9ca40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.172+0000 7f9ca9c2c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ca415b440 0x7f9ca40cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54746/0 (socket says 172.21.15.77:54746) 2023-11-26T07:20:15.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.172+0000 7f9ca9c2c640 1 -- 172.21.15.77:0/2137387611 learned_addr learned my addr 172.21.15.77:0/2137387611 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:15.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.173+0000 7f9ca9c2c640 1 -- 172.21.15.77:0/2137387611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ca40c59b0 msgr2=0x7f9ca406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:15.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.173+0000 7f9ca9c2c640 1 --2- 172.21.15.77:0/2137387611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ca40c59b0 0x7f9ca406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.173+0000 7f9ca9c2c640 1 -- 172.21.15.77:0/2137387611 >> v1:172.21.15.159:6789/0 conn(0x7f9ca40cbf20 legacy=0x7f9ca40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:15.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.173+0000 7f9ca9c2c640 1 -- 172.21.15.77:0/2137387611 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca40abf30 con 0x7f9ca415b440 2023-11-26T07:20:15.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.174+0000 7f9ca9c2c640 1 --2- 172.21.15.77:0/2137387611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca415b440 0x7f9ca40cb9e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009870 tx=0x7f9ca002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e0b2de8e7f5e29 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:15.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.174+0000 7f9ca8c2a640 1 -- 172.21.15.77:0/2137387611 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00317c0 con 0x7f9ca415b440 2023-11-26T07:20:15.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.174+0000 7f9ca8c2a640 1 -- 172.21.15.77:0/2137387611 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0031920 con 0x7f9ca415b440 2023-11-26T07:20:15.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.174+0000 7f9ca8c2a640 1 -- 172.21.15.77:0/2137387611 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0031cb0 con 0x7f9ca415b440 2023-11-26T07:20:15.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.175+0000 7f9cabe90640 1 -- 172.21.15.77:0/2137387611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca415b440 msgr2=0x7f9ca40cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.175+0000 7f9cabe90640 1 --2- 172.21.15.77:0/2137387611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca415b440 0x7f9ca40cb9e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009870 tx=0x7f9ca002b860 comp rx=0 tx=0).stop 2023-11-26T07:20:15.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.175+0000 7f9cabe90640 1 -- 172.21.15.77:0/2137387611 shutdown_connections 2023-11-26T07:20:15.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.175+0000 7f9cabe90640 1 --2- 172.21.15.77:0/2137387611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ca40c59b0 0x7f9ca406c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.175+0000 7f9cabe90640 1 --2- 172.21.15.77:0/2137387611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca415b440 0x7f9ca40cb9e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.175+0000 7f9cabe90640 1 -- 172.21.15.77:0/2137387611 >> 172.21.15.77:0/2137387611 conn(0x7f9ca40b0c50 msgr2=0x7f9ca40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:15.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.175+0000 7f9cabe90640 1 -- 172.21.15.77:0/2137387611 shutdown_connections 2023-11-26T07:20:15.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.175+0000 7f9cabe90640 1 -- 172.21.15.77:0/2137387611 wait complete. 2023-11-26T07:20:15.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.177+0000 7f9cabe90640 1 Processor -- start 2023-11-26T07:20:15.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.178+0000 7f9cabe90640 1 -- start start 2023-11-26T07:20:15.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.179+0000 7f9cabe90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca40c59b0 0x7f9ca415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.179+0000 7f9cabe90640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ca40cbf20 0x7f9ca40c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.179+0000 7f9cabe90640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca415b440 0x7f9ca4156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.179+0000 7f9cabe90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca415d100 con 0x7f9ca40c59b0 2023-11-26T07:20:15.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.179+0000 7f9cabe90640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca40c73e0 con 0x7f9ca415b440 2023-11-26T07:20:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.179+0000 7f9cabe90640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca4157270 con 0x7f9ca40cbf20 2023-11-26T07:20:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.179+0000 7f9ca9c2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca40c59b0 0x7f9ca415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.179+0000 7f9ca9c2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca40c59b0 0x7f9ca415dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54752/0 (socket says 172.21.15.77:54752) 2023-11-26T07:20:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.179+0000 7f9ca9c2c640 1 -- 172.21.15.77:0/426299945 learned_addr learned my addr 172.21.15.77:0/426299945 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.180+0000 7f9ca942b640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ca40cbf20 0x7f9ca40c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.180+0000 7f9caa42d640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca415b440 0x7f9ca4156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.180+0000 7f9ca9c2c640 1 -- 172.21.15.77:0/426299945 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ca40cbf20 msgr2=0x7f9ca40c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.180+0000 7f9ca9c2c640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ca40cbf20 0x7f9ca40c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.180+0000 7f9ca9c2c640 1 -- 172.21.15.77:0/426299945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca415b440 msgr2=0x7f9ca4156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.180+0000 7f9ca9c2c640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca415b440 0x7f9ca4156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.180+0000 7f9ca9c2c640 1 -- 172.21.15.77:0/426299945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca00094d0 con 0x7f9ca40c59b0 2023-11-26T07:20:15.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.180+0000 7f9ca9c2c640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca40c59b0 0x7f9ca415dc80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000c00 tx=0x7f9ca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:15.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.181+0000 7f9c967fc640 1 -- 172.21.15.77:0/426299945 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0032860 con 0x7f9ca40c59b0 2023-11-26T07:20:15.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.181+0000 7f9c967fc640 1 -- 172.21.15.77:0/426299945 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca00329e0 con 0x7f9ca40c59b0 2023-11-26T07:20:15.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.181+0000 7f9c967fc640 1 -- 172.21.15.77:0/426299945 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0032d90 con 0x7f9ca40c59b0 2023-11-26T07:20:15.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.181+0000 7f9cabe90640 1 -- 172.21.15.77:0/426299945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca40c67d0 con 0x7f9ca40c59b0 2023-11-26T07:20:15.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.181+0000 7f9cabe90640 1 -- 172.21.15.77:0/426299945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca40c6d90 con 0x7f9ca40c59b0 2023-11-26T07:20:15.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.182+0000 7f9cabe90640 1 -- 172.21.15.77:0/426299945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca404e8b0 con 0x7f9ca40c59b0 2023-11-26T07:20:15.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.183+0000 7f9c967fc640 1 -- 172.21.15.77:0/426299945 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f9ca004d3f0 con 0x7f9ca40c59b0 2023-11-26T07:20:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.184+0000 7f9c967fc640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c8806b140 0x7f9c8806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.185+0000 7f9c967fc640 1 -- 172.21.15.77:0/426299945 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9ca00ab660 con 0x7f9ca40c59b0 2023-11-26T07:20:15.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.185+0000 7f9ca942b640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c8806b140 0x7f9c8806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.186+0000 7f9ca942b640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c8806b140 0x7f9c8806d600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9ca415aab0 tx=0x7f9c98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:15.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.189+0000 7f9c967fc640 1 -- 172.21.15.77:0/426299945 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ca0076730 con 0x7f9ca40c59b0 2023-11-26T07:20:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.380+0000 7f9cabe90640 1 -- 172.21.15.77:0/426299945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9ca406dc80 con 0x7f9ca40c59b0 2023-11-26T07:20:15.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.947+0000 7f9c967fc640 1 -- 172.21.15.77:0/426299945 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9ca0079d50 con 0x7f9ca40c59b0 2023-11-26T07:20:15.950 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-11-26T07:20:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.950+0000 7f9cabe90640 1 -- 172.21.15.77:0/426299945 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c8806b140 msgr2=0x7f9c8806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.950+0000 7f9cabe90640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c8806b140 0x7f9c8806d600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9ca415aab0 tx=0x7f9c98009040 comp rx=0 tx=0).stop 2023-11-26T07:20:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.950+0000 7f9cabe90640 1 -- 172.21.15.77:0/426299945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca40c59b0 msgr2=0x7f9ca415dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.950+0000 7f9cabe90640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca40c59b0 0x7f9ca415dc80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000c00 tx=0x7f9ca00046c0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.951+0000 7f9cabe90640 1 -- 172.21.15.77:0/426299945 shutdown_connections 2023-11-26T07:20:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.951+0000 7f9cabe90640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9c8806b140 0x7f9c8806d600 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.951+0000 7f9cabe90640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ca415b440 0x7f9ca4156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.951+0000 7f9cabe90640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ca40cbf20 0x7f9ca40c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.951+0000 7f9cabe90640 1 --2- 172.21.15.77:0/426299945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca40c59b0 0x7f9ca415dc80 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.951+0000 7f9cabe90640 1 -- 172.21.15.77:0/426299945 >> 172.21.15.77:0/426299945 conn(0x7f9ca40b0c50 msgr2=0x7f9ca40ac810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:15.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.951+0000 7f9cabe90640 1 -- 172.21.15.77:0/426299945 shutdown_connections 2023-11-26T07:20:15.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:15.951+0000 7f9cabe90640 1 -- 172.21.15.77:0/426299945 wait complete. 2023-11-26T07:20:15.985 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:20:16.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.169+0000 7f00da79e640 1 Processor -- start 2023-11-26T07:20:16.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.169+0000 7f00da79e640 1 -- start start 2023-11-26T07:20:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.170+0000 7f00da79e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f00d40c9650 0x7f00d40c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.170+0000 7f00da79e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d4166510 con 0x7f00d40ccbd0 2023-11-26T07:20:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.170+0000 7f00da79e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d41655f0 con 0x7f00d41660b0 2023-11-26T07:20:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.170+0000 7f00da79e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d40cc380 con 0x7f00d40c9650 2023-11-26T07:20:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f00d40ccbd0 0x7f00d40ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47476/0 (socket says 172.21.15.77:47476) 2023-11-26T07:20:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d3fff640 1 -- 172.21.15.77:0/796866738 learned_addr learned my addr 172.21.15.77:0/796866738 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969553746 0 0) 0x7f00c4001110 con 0x7f00d40ccbd0 2023-11-26T07:20:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c0003520 con 0x7f00d40ccbd0 2023-11-26T07:20:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d8d3b640 1 --2- 172.21.15.77:0/796866738 >> v2:172.21.15.159:3300/0 conn(0x7f00d40c9650 0x7f00d40c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 270931948 0 0) 0x7f00c0003520 con 0x7f00d40ccbd0 2023-11-26T07:20:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 >> v2:172.21.15.159:3300/0 conn(0x7f00d40c9650 msgr2=0x7f00d40c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d37fe640 1 --2- 172.21.15.77:0/796866738 >> v2:172.21.15.159:3300/0 conn(0x7f00d40c9650 0x7f00d40c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 >> v1:172.21.15.159:6789/0 conn(0x7f00d41660b0 legacy=0x7f00d4162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4162b30 con 0x7f00d40ccbd0 2023-11-26T07:20:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f00c4001800 con 0x7f00d40ccbd0 2023-11-26T07:20:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.171+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 >> v1:172.21.15.77:6789/0 conn(0x7f00d40ccbd0 legacy=0x7f00d40ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d37fe640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00c0003970 0x7f00c0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d37fe640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00c00047c0 0x7f00c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d37fe640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c0005180 0x7f00c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40cc380 con 0x7f00c0005180 2023-11-26T07:20:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c000c0b0 con 0x7f00c00047c0 2023-11-26T07:20:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c000c270 con 0x7f00c0003970 2023-11-26T07:20:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d8d3b640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c0005180 0x7f00c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d3fff640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00c0003970 0x7f00c0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00cbfff640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00c00047c0 0x7f00c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d8d3b640 1 -- 172.21.15.77:0/796866738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00c0003970 msgr2=0x7f00c0003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:16.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d8d3b640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00c0003970 0x7f00c0003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d8d3b640 1 -- 172.21.15.77:0/796866738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00c00047c0 msgr2=0x7f00c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:16.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d8d3b640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00c00047c0 0x7f00c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00d8d3b640 1 -- 172.21.15.77:0/796866738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c0003520 con 0x7f00c0005180 2023-11-26T07:20:16.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.172+0000 7f00cbfff640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00c00047c0 0x7f00c0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:16.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.173+0000 7f00d8d3b640 1 -- 172.21.15.77:0/796866738 reap_dead start 2023-11-26T07:20:16.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.173+0000 7f00d8d3b640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c0005180 0x7f00c000b980 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f00cc007330 tx=0x7f00c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d844ef9dca8e8c00 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.174+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc02ccd0 con 0x7f00c0005180 2023-11-26T07:20:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.174+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc02ce30 con 0x7f00c0005180 2023-11-26T07:20:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.174+0000 7f00d37fe640 1 -- 172.21.15.77:0/796866738 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc003bd0 con 0x7f00c0005180 2023-11-26T07:20:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.174+0000 7f00da79e640 1 -- 172.21.15.77:0/796866738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c0005180 msgr2=0x7f00c000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.174+0000 7f00da79e640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c0005180 0x7f00c000b980 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f00cc007330 tx=0x7f00c00057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.174+0000 7f00da79e640 1 -- 172.21.15.77:0/796866738 shutdown_connections 2023-11-26T07:20:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.174+0000 7f00da79e640 1 --2- 172.21.15.77:0/796866738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c0005180 0x7f00c000b980 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.174+0000 7f00da79e640 1 -- 172.21.15.77:0/796866738 >> 172.21.15.77:0/796866738 conn(0x7f00d40b0c50 msgr2=0x7f00d40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.174+0000 7f00da79e640 1 -- 172.21.15.77:0/796866738 shutdown_connections 2023-11-26T07:20:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.175+0000 7f00da79e640 1 -- 172.21.15.77:0/796866738 wait complete. 2023-11-26T07:20:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.176+0000 7f00da79e640 1 Processor -- start 2023-11-26T07:20:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.176+0000 7f00da79e640 1 -- start start 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.177+0000 7f00da79e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00c0005180 0x7f00d415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.177+0000 7f00da79e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00d4164ee0 0x7f00d4158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.177+0000 7f00da79e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d40c4780 0x7f00d40c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.177+0000 7f00da79e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d415f560 con 0x7f00d40c4780 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.177+0000 7f00da79e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40c5140 con 0x7f00d4164ee0 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.177+0000 7f00da79e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d415d590 con 0x7f00c0005180 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00d8d3b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d40c4780 0x7f00d40c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00d8d3b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d40c4780 0x7f00d40c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39336/0 (socket says 172.21.15.77:39336) 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00d8d3b640 1 -- 172.21.15.77:0/2198503291 learned_addr learned my addr 172.21.15.77:0/2198503291 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00d3fff640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00c0005180 0x7f00d415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00d8d3b640 1 -- 172.21.15.77:0/2198503291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00c0005180 msgr2=0x7f00d415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00d8d3b640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00c0005180 0x7f00d415c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00d8d3b640 1 -- 172.21.15.77:0/2198503291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00d4164ee0 msgr2=0x7f00d4158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00cbfff640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00d4164ee0 0x7f00d4158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00d8d3b640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00d4164ee0 0x7f00d4158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00d8d3b640 1 -- 172.21.15.77:0/2198503291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d41632f0 con 0x7f00d40c4780 2023-11-26T07:20:16.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00d3fff640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00c0005180 0x7f00d415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:16.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.178+0000 7f00d8d3b640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d40c4780 0x7f00d40c4c00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f00cc007450 tx=0x7f00cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.179+0000 7f00d17fa640 1 -- 172.21.15.77:0/2198503291 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc004550 con 0x7f00d40c4780 2023-11-26T07:20:16.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.179+0000 7f00d17fa640 1 -- 172.21.15.77:0/2198503291 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc0046d0 con 0x7f00d40c4780 2023-11-26T07:20:16.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.179+0000 7f00da79e640 1 -- 172.21.15.77:0/2198503291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d4165360 con 0x7f00d40c4780 2023-11-26T07:20:16.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.179+0000 7f00d17fa640 1 -- 172.21.15.77:0/2198503291 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc034680 con 0x7f00d40c4780 2023-11-26T07:20:16.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.179+0000 7f00da79e640 1 -- 172.21.15.77:0/2198503291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d415cfd0 con 0x7f00d40c4780 2023-11-26T07:20:16.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.180+0000 7f00da79e640 1 -- 172.21.15.77:0/2198503291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d4163480 con 0x7f00d40c4780 2023-11-26T07:20:16.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.181+0000 7f00d17fa640 1 -- 172.21.15.77:0/2198503291 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f00cc03b070 con 0x7f00d40c4780 2023-11-26T07:20:16.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.182+0000 7f00d17fa640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00b406b160 0x7f00b406d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.182+0000 7f00d17fa640 1 -- 172.21.15.77:0/2198503291 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f00cc0ab010 con 0x7f00d40c4780 2023-11-26T07:20:16.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.182+0000 7f00d3fff640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00b406b160 0x7f00b406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.183+0000 7f00d3fff640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00b406b160 0x7f00b406d620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f00c4001050 tx=0x7f00c4001dd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.187+0000 7f00d17fa640 1 -- 172.21.15.77:0/2198503291 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f00cc075ea0 con 0x7f00d40c4780 2023-11-26T07:20:16.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.409+0000 7f00da79e640 1 -- 172.21.15.77:0/2198503291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f00d404e8b0 con 0x7f00d40c4780 2023-11-26T07:20:16.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.982+0000 7f00d17fa640 1 -- 172.21.15.77:0/2198503291 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f00cc0440c0 con 0x7f00d40c4780 2023-11-26T07:20:16.985 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 6 and data pool 7 2023-11-26T07:20:16.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.996+0000 7f00da79e640 1 -- 172.21.15.77:0/2198503291 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00b406b160 msgr2=0x7f00b406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.996+0000 7f00da79e640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00b406b160 0x7f00b406d620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f00c4001050 tx=0x7f00c4001dd0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.996+0000 7f00da79e640 1 -- 172.21.15.77:0/2198503291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d40c4780 msgr2=0x7f00d40c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.996+0000 7f00da79e640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d40c4780 0x7f00d40c4c00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f00cc007450 tx=0x7f00cc004ab0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.996+0000 7f00da79e640 1 -- 172.21.15.77:0/2198503291 shutdown_connections 2023-11-26T07:20:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.996+0000 7f00da79e640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00b406b160 0x7f00b406d620 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.996+0000 7f00da79e640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d40c4780 0x7f00d40c4c00 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.996+0000 7f00da79e640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00d4164ee0 0x7f00d4158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.996+0000 7f00da79e640 1 --2- 172.21.15.77:0/2198503291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00c0005180 0x7f00d415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.996+0000 7f00da79e640 1 -- 172.21.15.77:0/2198503291 >> 172.21.15.77:0/2198503291 conn(0x7f00d40b0c50 msgr2=0x7f00d406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:17.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.998+0000 7f00da79e640 1 -- 172.21.15.77:0/2198503291 shutdown_connections 2023-11-26T07:20:17.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:16.998+0000 7f00da79e640 1 -- 172.21.15.77:0/2198503291 wait complete. 2023-11-26T07:20:17.027 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:17.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.199+0000 7f874d0c9640 1 Processor -- start 2023-11-26T07:20:17.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.200+0000 7f874d0c9640 1 -- start start 2023-11-26T07:20:17.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.201+0000 7f874d0c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f87480cfb60 0x7f87480abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.201+0000 7f874d0c9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f87480ce640 0x7f87480b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.201+0000 7f874d0c9640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87480ce270 con 0x7f87480cc470 2023-11-26T07:20:17.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.201+0000 7f874d0c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874806c560 con 0x7f87480cfb60 2023-11-26T07:20:17.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.201+0000 7f874d0c9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874806d0a0 con 0x7f87480ce640 2023-11-26T07:20:17.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.201+0000 7f873ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f87480cfb60 0x7f87480abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.202+0000 7f873ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f87480cfb60 0x7f87480abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39338/0 (socket says 172.21.15.77:39338) 2023-11-26T07:20:17.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.202+0000 7f873ffff640 1 -- 172.21.15.77:0/1438020293 learned_addr learned my addr 172.21.15.77:0/1438020293 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:17.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.202+0000 7f873ffff640 1 -- 172.21.15.77:0/1438020293 >> v2:172.21.15.159:3300/0 conn(0x7f87480ce640 msgr2=0x7f87480b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:17.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.202+0000 7f873ffff640 1 --2- 172.21.15.77:0/1438020293 >> v2:172.21.15.159:3300/0 conn(0x7f87480ce640 0x7f87480b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.202+0000 7f873ffff640 1 -- 172.21.15.77:0/1438020293 >> v1:172.21.15.159:6789/0 conn(0x7f87480cc470 legacy=0x7f87480cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:17.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.202+0000 7f873ffff640 1 -- 172.21.15.77:0/1438020293 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87480b4200 con 0x7f87480cfb60 2023-11-26T07:20:17.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.203+0000 7f873ffff640 1 --2- 172.21.15.77:0/1438020293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87480cfb60 0x7f87480abfc0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f87480cd5e0 tx=0x7f873002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44069d490ca219a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.203+0000 7f874659c640 1 -- 172.21.15.77:0/1438020293 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730031870 con 0x7f87480cfb60 2023-11-26T07:20:17.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.203+0000 7f874659c640 1 -- 172.21.15.77:0/1438020293 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87300319d0 con 0x7f87480cfb60 2023-11-26T07:20:17.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.203+0000 7f874659c640 1 -- 172.21.15.77:0/1438020293 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730031d60 con 0x7f87480cfb60 2023-11-26T07:20:17.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.204+0000 7f874d0c9640 1 -- 172.21.15.77:0/1438020293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87480cfb60 msgr2=0x7f87480abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.204+0000 7f874d0c9640 1 --2- 172.21.15.77:0/1438020293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87480cfb60 0x7f87480abfc0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f87480cd5e0 tx=0x7f873002b910 comp rx=0 tx=0).stop 2023-11-26T07:20:17.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.204+0000 7f874d0c9640 1 -- 172.21.15.77:0/1438020293 shutdown_connections 2023-11-26T07:20:17.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.204+0000 7f874d0c9640 1 --2- 172.21.15.77:0/1438020293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87480cfb60 0x7f87480abfc0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.204+0000 7f874d0c9640 1 --2- 172.21.15.77:0/1438020293 >> v2:172.21.15.159:3300/0 conn(0x7f87480ce640 0x7f87480b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.204+0000 7f874d0c9640 1 -- 172.21.15.77:0/1438020293 >> 172.21.15.77:0/1438020293 conn(0x7f874806a920 msgr2=0x7f874806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:17.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.204+0000 7f874d0c9640 1 -- 172.21.15.77:0/1438020293 shutdown_connections 2023-11-26T07:20:17.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.204+0000 7f874d0c9640 1 -- 172.21.15.77:0/1438020293 wait complete. 2023-11-26T07:20:17.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.206+0000 7f874d0c9640 1 Processor -- start 2023-11-26T07:20:17.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.206+0000 7f874d0c9640 1 -- start start 2023-11-26T07:20:17.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.206+0000 7f874d0c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87480cc470 0x7f8748156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f874d0c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87480ce640 0x7f8748165d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f874d0c9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87480cfb60 0x7f8748159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f874d0c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87481ec0f0 con 0x7f87480cc470 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f874d0c9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8748162480 con 0x7f87480cfb60 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f874d0c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8748162760 con 0x7f87480ce640 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f8746d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87480cc470 0x7f8748156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f8746d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87480cc470 0x7f8748156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39344/0 (socket says 172.21.15.77:39344) 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f8746d9d640 1 -- 172.21.15.77:0/604793998 learned_addr learned my addr 172.21.15.77:0/604793998 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f8746d9d640 1 -- 172.21.15.77:0/604793998 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87480ce640 msgr2=0x7f8748165d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f8746d9d640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87480ce640 0x7f8748165d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f8746d9d640 1 -- 172.21.15.77:0/604793998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87480cfb60 msgr2=0x7f8748159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f8746d9d640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87480cfb60 0x7f8748159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.207+0000 7f8746d9d640 1 -- 172.21.15.77:0/604793998 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87300094d0 con 0x7f87480cc470 2023-11-26T07:20:17.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.208+0000 7f8746d9d640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87480cc470 0x7f8748156180 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f873800c410 tx=0x7f873800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.208+0000 7f873f7fe640 1 -- 172.21.15.77:0/604793998 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87380035f0 con 0x7f87480cc470 2023-11-26T07:20:17.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.208+0000 7f873f7fe640 1 -- 172.21.15.77:0/604793998 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8738003750 con 0x7f87480cc470 2023-11-26T07:20:17.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.208+0000 7f873f7fe640 1 -- 172.21.15.77:0/604793998 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738003b40 con 0x7f87480cc470 2023-11-26T07:20:17.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.208+0000 7f874d0c9640 1 -- 172.21.15.77:0/604793998 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8748162a40 con 0x7f87480cc470 2023-11-26T07:20:17.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.208+0000 7f874d0c9640 1 -- 172.21.15.77:0/604793998 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8748166290 con 0x7f87480cc470 2023-11-26T07:20:17.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.209+0000 7f874d0c9640 1 -- 172.21.15.77:0/604793998 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8748067470 con 0x7f87480cc470 2023-11-26T07:20:17.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.210+0000 7f873f7fe640 1 -- 172.21.15.77:0/604793998 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f8738003ca0 con 0x7f87480cc470 2023-11-26T07:20:17.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.211+0000 7f873f7fe640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f872806b110 0x7f872806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.211+0000 7f873f7fe640 1 -- 172.21.15.77:0/604793998 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8738088d00 con 0x7f87480cc470 2023-11-26T07:20:17.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.211+0000 7f873ffff640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f872806b110 0x7f872806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.212+0000 7f873ffff640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f872806b110 0x7f872806d5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8730036000 tx=0x7f8730030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.215+0000 7f873f7fe640 1 -- 172.21.15.77:0/604793998 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87380539d0 con 0x7f87480cc470 2023-11-26T07:20:17.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.398+0000 7f874d0c9640 1 -- 172.21.15.77:0/604793998 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87480cd910 con 0x7f87480cc470 2023-11-26T07:20:17.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.401+0000 7f873f7fe640 1 -- 172.21.15.77:0/604793998 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16502 (secure 0 0 0) 0x7f8738056ff0 con 0x7f87480cc470 2023-11-26T07:20:17.404 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:17.404 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":46,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:20:16.411330+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:14.223705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:15.435670+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:17.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.403+0000 7f874d0c9640 1 -- 172.21.15.77:0/604793998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f872806b110 msgr2=0x7f872806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.403+0000 7f874d0c9640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f872806b110 0x7f872806d5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8730036000 tx=0x7f8730030000 comp rx=0 tx=0).stop 2023-11-26T07:20:17.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.403+0000 7f874d0c9640 1 -- 172.21.15.77:0/604793998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87480cc470 msgr2=0x7f8748156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.403+0000 7f874d0c9640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87480cc470 0x7f8748156180 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f873800c410 tx=0x7f873800c8d0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.403+0000 7f874d0c9640 1 -- 172.21.15.77:0/604793998 shutdown_connections 2023-11-26T07:20:17.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.404+0000 7f874d0c9640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f872806b110 0x7f872806d5d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.404+0000 7f874d0c9640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87480cfb60 0x7f8748159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.404+0000 7f874d0c9640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87480ce640 0x7f8748165d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.404+0000 7f874d0c9640 1 --2- 172.21.15.77:0/604793998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87480cc470 0x7f8748156180 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.404+0000 7f874d0c9640 1 -- 172.21.15.77:0/604793998 >> 172.21.15.77:0/604793998 conn(0x7f874806a920 msgr2=0x7f87480aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:17.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.404+0000 7f874d0c9640 1 -- 172.21.15.77:0/604793998 shutdown_connections 2023-11-26T07:20:17.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.404+0000 7f874d0c9640 1 -- 172.21.15.77:0/604793998 wait complete. 2023-11-26T07:20:17.424 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:17.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.625+0000 7f3fafcd4640 1 Processor -- start 2023-11-26T07:20:17.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.626+0000 7f3fafcd4640 1 -- start start 2023-11-26T07:20:17.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.627+0000 7f3fafcd4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fa80b21d0 0x7f3fa80cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.627+0000 7f3fafcd4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa80b3a40 con 0x7f3fa8159ce0 2023-11-26T07:20:17.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.627+0000 7f3fafcd4640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa80cdfa0 con 0x7f3fa80cba40 2023-11-26T07:20:17.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.627+0000 7f3fafcd4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa80cd9e0 con 0x7f3fa80b21d0 2023-11-26T07:20:17.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.627+0000 7f3fad26f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fa80b21d0 0x7f3fa80cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.627+0000 7f3fad26f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fa80b21d0 0x7f3fa80cf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39360/0 (socket says 172.21.15.77:39360) 2023-11-26T07:20:17.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.627+0000 7f3fad26f640 1 -- 172.21.15.77:0/4235045202 learned_addr learned my addr 172.21.15.77:0/4235045202 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:17.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.627+0000 7f3fada70640 1 --1- 172.21.15.77:0/4235045202 >> v1:172.21.15.77:6789/0 conn(0x7f3fa8159ce0 0x7f3fa806de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47490/0 (socket says 172.21.15.77:47490) 2023-11-26T07:20:17.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.628+0000 7f3fad26f640 1 -- 172.21.15.77:0/4235045202 >> v1:172.21.15.159:6789/0 conn(0x7f3fa80cba40 legacy=0x7f3fa8164af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:17.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.628+0000 7f3fad26f640 1 -- 172.21.15.77:0/4235045202 >> v1:172.21.15.77:6789/0 conn(0x7f3fa8159ce0 legacy=0x7f3fa806de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.628+0000 7f3fad26f640 1 -- 172.21.15.77:0/4235045202 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa80cdcc0 con 0x7f3fa80b21d0 2023-11-26T07:20:17.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.628+0000 7f3faca6e640 1 -- 172.21.15.77:0/4235045202 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364781452 0 0) 0x7f3fa80b3a40 con 0x7f3fa8159ce0 2023-11-26T07:20:17.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.629+0000 7f3fad26f640 1 --2- 172.21.15.77:0/4235045202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80b21d0 0x7f3fa80cf450 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009870 tx=0x7f3f9802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d952d046b287f8ef server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.629+0000 7f3faca6e640 1 -- 172.21.15.77:0/4235045202 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98030860 con 0x7f3fa80b21d0 2023-11-26T07:20:17.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.629+0000 7f3faca6e640 1 -- 172.21.15.77:0/4235045202 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f980309c0 con 0x7f3fa80b21d0 2023-11-26T07:20:17.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.629+0000 7f3faca6e640 1 -- 172.21.15.77:0/4235045202 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98030d50 con 0x7f3fa80b21d0 2023-11-26T07:20:17.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.630+0000 7f3fafcd4640 1 -- 172.21.15.77:0/4235045202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80b21d0 msgr2=0x7f3fa80cf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.630+0000 7f3fafcd4640 1 --2- 172.21.15.77:0/4235045202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80b21d0 0x7f3fa80cf450 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009870 tx=0x7f3f9802b9a0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.630+0000 7f3fafcd4640 1 -- 172.21.15.77:0/4235045202 shutdown_connections 2023-11-26T07:20:17.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.630+0000 7f3fafcd4640 1 --2- 172.21.15.77:0/4235045202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80b21d0 0x7f3fa80cf450 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.630+0000 7f3fafcd4640 1 -- 172.21.15.77:0/4235045202 >> 172.21.15.77:0/4235045202 conn(0x7f3fa806a920 msgr2=0x7f3fa806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:17.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.630+0000 7f3fafcd4640 1 -- 172.21.15.77:0/4235045202 shutdown_connections 2023-11-26T07:20:17.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.630+0000 7f3fafcd4640 1 -- 172.21.15.77:0/4235045202 wait complete. 2023-11-26T07:20:17.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.632+0000 7f3fafcd4640 1 Processor -- start 2023-11-26T07:20:17.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.632+0000 7f3fafcd4640 1 -- start start 2023-11-26T07:20:17.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fafcd4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa80b21d0 0x7f3fa80ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fafcd4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80cba40 0x7f3fa814a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fafcd4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fa8159ce0 0x7f3fa814a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fafcd4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa81f2e60 con 0x7f3fa80cba40 2023-11-26T07:20:17.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fafcd4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa81f3e30 con 0x7f3fa8159ce0 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fafcd4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa81572d0 con 0x7f3fa80b21d0 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fad26f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80cba40 0x7f3fa814a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fad26f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80cba40 0x7f3fa814a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39364/0 (socket says 172.21.15.77:39364) 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fad26f640 1 -- 172.21.15.77:0/3164148865 learned_addr learned my addr 172.21.15.77:0/3164148865 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fad26f640 1 -- 172.21.15.77:0/3164148865 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa80b21d0 msgr2=0x7f3fa80ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fad26f640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa80b21d0 0x7f3fa80ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fad26f640 1 -- 172.21.15.77:0/3164148865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fa8159ce0 msgr2=0x7f3fa814a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fad26f640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fa8159ce0 0x7f3fa814a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fad26f640 1 -- 172.21.15.77:0/3164148865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980094d0 con 0x7f3fa80cba40 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.633+0000 7f3fad26f640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80cba40 0x7f3fa814a310 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000c00 tx=0x7f3f98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.634+0000 7f3f9e7fc640 1 -- 172.21.15.77:0/3164148865 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98039d60 con 0x7f3fa80cba40 2023-11-26T07:20:17.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.634+0000 7f3f9e7fc640 1 -- 172.21.15.77:0/3164148865 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f98043400 con 0x7f3fa80cba40 2023-11-26T07:20:17.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.634+0000 7f3fafcd4640 1 -- 172.21.15.77:0/3164148865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa814ad90 con 0x7f3fa80cba40 2023-11-26T07:20:17.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.634+0000 7f3f9e7fc640 1 -- 172.21.15.77:0/3164148865 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f980437b0 con 0x7f3fa80cba40 2023-11-26T07:20:17.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.634+0000 7f3fafcd4640 1 -- 172.21.15.77:0/3164148865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa81f3350 con 0x7f3fa80cba40 2023-11-26T07:20:17.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.635+0000 7f3fafcd4640 1 -- 172.21.15.77:0/3164148865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa8067470 con 0x7f3fa80cba40 2023-11-26T07:20:17.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.636+0000 7f3f9e7fc640 1 -- 172.21.15.77:0/3164148865 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f3f98043910 con 0x7f3fa80cba40 2023-11-26T07:20:17.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.637+0000 7f3f9e7fc640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f8c06b110 0x7f3f8c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.637+0000 7f3f9e7fc640 1 -- 172.21.15.77:0/3164148865 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f9803e070 con 0x7f3fa80cba40 2023-11-26T07:20:17.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.637+0000 7f3fada70640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f8c06b110 0x7f3f8c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.638+0000 7f3fada70640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f8c06b110 0x7f3f8c06d5d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4007fd0 tx=0x7f3fa4007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.641+0000 7f3f9e7fc640 1 -- 172.21.15.77:0/3164148865 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3f98077c00 con 0x7f3fa80cba40 2023-11-26T07:20:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.830+0000 7f3fafcd4640 1 -- 172.21.15.77:0/3164148865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fa80ce180 con 0x7f3fa80cba40 2023-11-26T07:20:17.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.832+0000 7f3f9e7fc640 1 -- 172.21.15.77:0/3164148865 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16502 (secure 0 0 0) 0x7f3f9807b220 con 0x7f3fa80cba40 2023-11-26T07:20:17.835 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:17.835 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":46,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:20:16.411330+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:14.223705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:15.435670+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:17.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.834+0000 7f3fafcd4640 1 -- 172.21.15.77:0/3164148865 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f8c06b110 msgr2=0x7f3f8c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.834+0000 7f3fafcd4640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f8c06b110 0x7f3f8c06d5d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4007fd0 tx=0x7f3fa4007960 comp rx=0 tx=0).stop 2023-11-26T07:20:17.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.834+0000 7f3fafcd4640 1 -- 172.21.15.77:0/3164148865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80cba40 msgr2=0x7f3fa814a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.834+0000 7f3fafcd4640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80cba40 0x7f3fa814a310 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000c00 tx=0x7f3f98004730 comp rx=0 tx=0).stop 2023-11-26T07:20:17.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.834+0000 7f3fafcd4640 1 -- 172.21.15.77:0/3164148865 shutdown_connections 2023-11-26T07:20:17.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.834+0000 7f3fafcd4640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f8c06b110 0x7f3f8c06d5d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.834+0000 7f3fafcd4640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fa8159ce0 0x7f3fa814a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.834+0000 7f3fafcd4640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80cba40 0x7f3fa814a310 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.834+0000 7f3fafcd4640 1 --2- 172.21.15.77:0/3164148865 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa80b21d0 0x7f3fa80ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.834+0000 7f3fafcd4640 1 -- 172.21.15.77:0/3164148865 >> 172.21.15.77:0/3164148865 conn(0x7f3fa806a920 msgr2=0x7f3fa80aef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:17.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.835+0000 7f3fafcd4640 1 -- 172.21.15.77:0/3164148865 shutdown_connections 2023-11-26T07:20:17.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:17.835+0000 7f3fafcd4640 1 -- 172.21.15.77:0/3164148865 wait complete. 2023-11-26T07:20:17.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:20:18.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.072+0000 7efe4174c640 1 Processor -- start 2023-11-26T07:20:18.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.072+0000 7efe4174c640 1 -- start start 2023-11-26T07:20:18.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe4174c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe3c15b440 0x7efe3c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe4174c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efe3c0cbf20 0x7efe3c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe4174c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c15eea0 con 0x7efe3c0c57e0 2023-11-26T07:20:18.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe4174c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c0cc3d0 con 0x7efe3c15b440 2023-11-26T07:20:18.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe4174c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c15b820 con 0x7efe3c0cbf20 2023-11-26T07:20:18.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe3affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe3c15b440 0x7efe3c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe3affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe3c15b440 0x7efe3c0cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39374/0 (socket says 172.21.15.77:39374) 2023-11-26T07:20:18.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe3affd640 1 -- 172.21.15.77:0/1872906175 learned_addr learned my addr 172.21.15.77:0/1872906175 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:18.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe3b7fe640 1 --1- 172.21.15.77:0/1872906175 >> v1:172.21.15.77:6789/0 conn(0x7efe3c0c57e0 0x7efe3c0c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47504/0 (socket says 172.21.15.77:47504) 2023-11-26T07:20:18.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe3affd640 1 -- 172.21.15.77:0/1872906175 >> v2:172.21.15.159:3300/0 conn(0x7efe3c0cbf20 msgr2=0x7efe3c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:18.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe3affd640 1 --2- 172.21.15.77:0/1872906175 >> v2:172.21.15.159:3300/0 conn(0x7efe3c0cbf20 0x7efe3c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.074+0000 7efe3affd640 1 -- 172.21.15.77:0/1872906175 >> v1:172.21.15.77:6789/0 conn(0x7efe3c0c57e0 legacy=0x7efe3c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.075+0000 7efe3affd640 1 -- 172.21.15.77:0/1872906175 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c06d600 con 0x7efe3c15b440 2023-11-26T07:20:18.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.075+0000 7efe3a7fc640 1 -- 172.21.15.77:0/1872906175 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168943193 0 0) 0x7efe3c15eea0 con 0x7efe3c0c57e0 2023-11-26T07:20:18.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.076+0000 7efe3affd640 1 --2- 172.21.15.77:0/1872906175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe3c15b440 0x7efe3c0cb9e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efe3c06e890 tx=0x7efe2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d8b6a5821ed5b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.076+0000 7efe3a7fc640 1 -- 172.21.15.77:0/1872906175 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c031870 con 0x7efe3c15b440 2023-11-26T07:20:18.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.076+0000 7efe3a7fc640 1 -- 172.21.15.77:0/1872906175 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c0319d0 con 0x7efe3c15b440 2023-11-26T07:20:18.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.076+0000 7efe3a7fc640 1 -- 172.21.15.77:0/1872906175 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c031d60 con 0x7efe3c15b440 2023-11-26T07:20:18.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.077+0000 7efe4174c640 1 -- 172.21.15.77:0/1872906175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe3c15b440 msgr2=0x7efe3c0cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.077+0000 7efe4174c640 1 --2- 172.21.15.77:0/1872906175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe3c15b440 0x7efe3c0cb9e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efe3c06e890 tx=0x7efe2c02b910 comp rx=0 tx=0).stop 2023-11-26T07:20:18.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.077+0000 7efe4174c640 1 -- 172.21.15.77:0/1872906175 shutdown_connections 2023-11-26T07:20:18.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.077+0000 7efe4174c640 1 --2- 172.21.15.77:0/1872906175 >> v2:172.21.15.159:3300/0 conn(0x7efe3c0cbf20 0x7efe3c0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.077+0000 7efe4174c640 1 --2- 172.21.15.77:0/1872906175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe3c15b440 0x7efe3c0cb9e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.077+0000 7efe4174c640 1 -- 172.21.15.77:0/1872906175 >> 172.21.15.77:0/1872906175 conn(0x7efe3c0b0c50 msgr2=0x7efe3c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:18.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.077+0000 7efe4174c640 1 -- 172.21.15.77:0/1872906175 shutdown_connections 2023-11-26T07:20:18.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.077+0000 7efe4174c640 1 -- 172.21.15.77:0/1872906175 wait complete. 2023-11-26T07:20:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.079+0000 7efe4174c640 1 Processor -- start 2023-11-26T07:20:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.079+0000 7efe4174c640 1 -- start start 2023-11-26T07:20:18.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe4174c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe3c0c57e0 0x7efe3c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe4174c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe3c0cbf20 0x7efe3c0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe4174c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe3c15b440 0x7efe3c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe4174c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0b2250 con 0x7efe3c0cbf20 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe4174c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c1510e0 con 0x7efe3c15b440 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe4174c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0b24d0 con 0x7efe3c0c57e0 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe33fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe3c0cbf20 0x7efe3c0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe33fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe3c0cbf20 0x7efe3c0b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39384/0 (socket says 172.21.15.77:39384) 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe33fff640 1 -- 172.21.15.77:0/1149175026 learned_addr learned my addr 172.21.15.77:0/1149175026 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe3affd640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe3c0c57e0 0x7efe3c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe33fff640 1 -- 172.21.15.77:0/1149175026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe3c0c57e0 msgr2=0x7efe3c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe33fff640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe3c0c57e0 0x7efe3c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe33fff640 1 -- 172.21.15.77:0/1149175026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe3c15b440 msgr2=0x7efe3c150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe33fff640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe3c15b440 0x7efe3c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.080+0000 7efe33fff640 1 -- 172.21.15.77:0/1149175026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c0094d0 con 0x7efe3c0cbf20 2023-11-26T07:20:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.081+0000 7efe33fff640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe3c0cbf20 0x7efe3c0b1d10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7efe2400b4a0 tx=0x7efe2400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.081+0000 7efe337fe640 1 -- 172.21.15.77:0/1149175026 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24010610 con 0x7efe3c0cbf20 2023-11-26T07:20:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.081+0000 7efe337fe640 1 -- 172.21.15.77:0/1149175026 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe24010770 con 0x7efe3c0cbf20 2023-11-26T07:20:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.081+0000 7efe337fe640 1 -- 172.21.15.77:0/1149175026 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24010b20 con 0x7efe3c0cbf20 2023-11-26T07:20:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.081+0000 7efe4174c640 1 -- 172.21.15.77:0/1149175026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c0b27b0 con 0x7efe3c0cbf20 2023-11-26T07:20:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.081+0000 7efe4174c640 1 -- 172.21.15.77:0/1149175026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c0b2d70 con 0x7efe3c0cbf20 2023-11-26T07:20:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.082+0000 7efe4174c640 1 -- 172.21.15.77:0/1149175026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c04e8b0 con 0x7efe3c0cbf20 2023-11-26T07:20:18.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.083+0000 7efe337fe640 1 -- 172.21.15.77:0/1149175026 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7efe24010c80 con 0x7efe3c0cbf20 2023-11-26T07:20:18.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.085+0000 7efe337fe640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efe1c06b110 0x7efe1c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.085+0000 7efe337fe640 1 -- 172.21.15.77:0/1149175026 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe24089720 con 0x7efe3c0cbf20 2023-11-26T07:20:18.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.085+0000 7efe3affd640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efe1c06b110 0x7efe1c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.085+0000 7efe3affd640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efe1c06b110 0x7efe1c06d5d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efe2c036000 tx=0x7efe2c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.089+0000 7efe337fe640 1 -- 172.21.15.77:0/1149175026 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe24054430 con 0x7efe3c0cbf20 2023-11-26T07:20:18.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:18.314+0000 7efe4174c640 1 -- 172.21.15.77:0/1149175026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efe3c0b4f70 con 0x7efe3c0cbf20 2023-11-26T07:20:19.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.001+0000 7efe337fe640 1 -- 172.21.15.77:0/1149175026 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7efe24057a50 con 0x7efe3c0cbf20 2023-11-26T07:20:19.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.005+0000 7efe4174c640 1 -- 172.21.15.77:0/1149175026 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efe1c06b110 msgr2=0x7efe1c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.005+0000 7efe4174c640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efe1c06b110 0x7efe1c06d5d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efe2c036000 tx=0x7efe2c03c040 comp rx=0 tx=0).stop 2023-11-26T07:20:19.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.005+0000 7efe4174c640 1 -- 172.21.15.77:0/1149175026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe3c0cbf20 msgr2=0x7efe3c0b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.005+0000 7efe4174c640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe3c0cbf20 0x7efe3c0b1d10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7efe2400b4a0 tx=0x7efe2400b960 comp rx=0 tx=0).stop 2023-11-26T07:20:19.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.005+0000 7efe4174c640 1 -- 172.21.15.77:0/1149175026 shutdown_connections 2023-11-26T07:20:19.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.005+0000 7efe4174c640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efe1c06b110 0x7efe1c06d5d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.005+0000 7efe4174c640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe3c15b440 0x7efe3c150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.005+0000 7efe4174c640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe3c0cbf20 0x7efe3c0b1d10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.005+0000 7efe4174c640 1 --2- 172.21.15.77:0/1149175026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe3c0c57e0 0x7efe3c0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.005+0000 7efe4174c640 1 -- 172.21.15.77:0/1149175026 >> 172.21.15.77:0/1149175026 conn(0x7efe3c0b0c50 msgr2=0x7efe3c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:19.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.005+0000 7efe4174c640 1 -- 172.21.15.77:0/1149175026 shutdown_connections 2023-11-26T07:20:19.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.006+0000 7efe4174c640 1 -- 172.21.15.77:0/1149175026 wait complete. 2023-11-26T07:20:19.029 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:20:19.030 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:20:19.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.243+0000 7f26c61d5640 1 Processor -- start 2023-11-26T07:20:19.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.244+0000 7f26c61d5640 1 -- start start 2023-11-26T07:20:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.245+0000 7f26c61d5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f26c015d9b0 0x7f26c015e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.245+0000 7f26c61d5640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f26c00b28d0 0x7f26c00ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.245+0000 7f26c61d5640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c006e930 con 0x7f26c006eef0 2023-11-26T07:20:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.245+0000 7f26c61d5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c00cf0c0 con 0x7f26c015d9b0 2023-11-26T07:20:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.245+0000 7f26c61d5640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c006f5c0 con 0x7f26c00b28d0 2023-11-26T07:20:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.246+0000 7f26bf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f26c015d9b0 0x7f26c015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.246+0000 7f26bf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f26c015d9b0 0x7f26c015e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39398/0 (socket says 172.21.15.77:39398) 2023-11-26T07:20:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.246+0000 7f26bf7fe640 1 -- 172.21.15.77:0/631000144 learned_addr learned my addr 172.21.15.77:0/631000144 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.246+0000 7f26bf7fe640 1 -- 172.21.15.77:0/631000144 >> v2:172.21.15.159:3300/0 conn(0x7f26c00b28d0 msgr2=0x7f26c00ad1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.246+0000 7f26bf7fe640 1 --2- 172.21.15.77:0/631000144 >> v2:172.21.15.159:3300/0 conn(0x7f26c00b28d0 0x7f26c00ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.246+0000 7f26bf7fe640 1 -- 172.21.15.77:0/631000144 >> v1:172.21.15.159:6789/0 conn(0x7f26c006eef0 legacy=0x7f26c015e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.246+0000 7f26bf7fe640 1 -- 172.21.15.77:0/631000144 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c015dd90 con 0x7f26c015d9b0 2023-11-26T07:20:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.247+0000 7f26bf7fe640 1 --2- 172.21.15.77:0/631000144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26c015d9b0 0x7f26c015e030 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009e50 tx=0x7f26b002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bed36cd359dc0ac server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.247+0000 7f26be7fc640 1 -- 172.21.15.77:0/631000144 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b002c9f0 con 0x7f26c015d9b0 2023-11-26T07:20:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.248+0000 7f26be7fc640 1 -- 172.21.15.77:0/631000144 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b002cb50 con 0x7f26c015d9b0 2023-11-26T07:20:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.248+0000 7f26be7fc640 1 -- 172.21.15.77:0/631000144 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00343f0 con 0x7f26c015d9b0 2023-11-26T07:20:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.248+0000 7f26c61d5640 1 -- 172.21.15.77:0/631000144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26c015d9b0 msgr2=0x7f26c015e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.248+0000 7f26c61d5640 1 --2- 172.21.15.77:0/631000144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26c015d9b0 0x7f26c015e030 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009e50 tx=0x7f26b002be50 comp rx=0 tx=0).stop 2023-11-26T07:20:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.248+0000 7f26c61d5640 1 -- 172.21.15.77:0/631000144 shutdown_connections 2023-11-26T07:20:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.248+0000 7f26c61d5640 1 --2- 172.21.15.77:0/631000144 >> v2:172.21.15.159:3300/0 conn(0x7f26c00b28d0 0x7f26c00ad1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.248+0000 7f26c61d5640 1 --2- 172.21.15.77:0/631000144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26c015d9b0 0x7f26c015e030 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.248+0000 7f26c61d5640 1 -- 172.21.15.77:0/631000144 >> 172.21.15.77:0/631000144 conn(0x7f26c00999d0 msgr2=0x7f26c00b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.248+0000 7f26c61d5640 1 -- 172.21.15.77:0/631000144 shutdown_connections 2023-11-26T07:20:19.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.248+0000 7f26c61d5640 1 -- 172.21.15.77:0/631000144 wait complete. 2023-11-26T07:20:19.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.250+0000 7f26c61d5640 1 Processor -- start 2023-11-26T07:20:19.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.251+0000 7f26c61d5640 1 -- start start 2023-11-26T07:20:19.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.252+0000 7f26c61d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26c006eef0 0x7f26c00c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.252+0000 7f26c61d5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26c00b28d0 0x7f26c00afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.252+0000 7f26c61d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26c015d9b0 0x7f26c006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.252+0000 7f26c61d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c00c8070 con 0x7f26c015d9b0 2023-11-26T07:20:19.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.252+0000 7f26c61d5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c00b0630 con 0x7f26c006eef0 2023-11-26T07:20:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.252+0000 7f26c61d5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c00b03e0 con 0x7f26c00b28d0 2023-11-26T07:20:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.252+0000 7f26bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26c015d9b0 0x7f26c006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.252+0000 7f26bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26c015d9b0 0x7f26c006aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39400/0 (socket says 172.21.15.77:39400) 2023-11-26T07:20:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.252+0000 7f26bffff640 1 -- 172.21.15.77:0/1242534975 learned_addr learned my addr 172.21.15.77:0/1242534975 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26bf7fe640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26c006eef0 0x7f26c00c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26beffd640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26c00b28d0 0x7f26c00afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26bffff640 1 -- 172.21.15.77:0/1242534975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26c00b28d0 msgr2=0x7f26c00afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26bffff640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26c00b28d0 0x7f26c00afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26bffff640 1 -- 172.21.15.77:0/1242534975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26c006eef0 msgr2=0x7f26c00c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26bffff640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26c006eef0 0x7f26c00c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26bffff640 1 -- 172.21.15.77:0/1242534975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b0009b30 con 0x7f26c015d9b0 2023-11-26T07:20:19.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26bffff640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26c015d9b0 0x7f26c006aaa0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009fd0 tx=0x7f26b800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:19.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26b7fff640 1 -- 172.21.15.77:0/1242534975 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8011830 con 0x7f26c015d9b0 2023-11-26T07:20:19.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26b7fff640 1 -- 172.21.15.77:0/1242534975 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b8011990 con 0x7f26c015d9b0 2023-11-26T07:20:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26c61d5640 1 -- 172.21.15.77:0/1242534975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c00c77d0 con 0x7f26c015d9b0 2023-11-26T07:20:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.253+0000 7f26b7fff640 1 -- 172.21.15.77:0/1242534975 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8011d20 con 0x7f26c015d9b0 2023-11-26T07:20:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.254+0000 7f26c61d5640 1 -- 172.21.15.77:0/1242534975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c00c7d90 con 0x7f26c015d9b0 2023-11-26T07:20:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.254+0000 7f26c61d5640 1 -- 172.21.15.77:0/1242534975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c004e8b0 con 0x7f26c015d9b0 2023-11-26T07:20:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.256+0000 7f26b7fff640 1 -- 172.21.15.77:0/1242534975 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f26b801b460 con 0x7f26c015d9b0 2023-11-26T07:20:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.256+0000 7f26b7fff640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f26a006b110 0x7f26a006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.257+0000 7f26b7fff640 1 -- 172.21.15.77:0/1242534975 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26b8089990 con 0x7f26c015d9b0 2023-11-26T07:20:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.257+0000 7f26bf7fe640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f26a006b110 0x7f26a006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.257+0000 7f26bf7fe640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f26a006b110 0x7f26a006d5d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f26b0035000 tx=0x7f26b0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:19.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.261+0000 7f26b7fff640 1 -- 172.21.15.77:0/1242534975 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26b80580b0 con 0x7f26c015d9b0 2023-11-26T07:20:19.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:19.473+0000 7f26c61d5640 1 -- 172.21.15.77:0/1242534975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f26c00cd760 con 0x7f26c015d9b0 2023-11-26T07:20:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.015+0000 7f26b7fff640 1 -- 172.21.15.77:0/1242534975 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f26b8057c40 con 0x7f26c015d9b0 2023-11-26T07:20:20.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.018+0000 7f26c61d5640 1 -- 172.21.15.77:0/1242534975 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f26a006b110 msgr2=0x7f26a006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.018+0000 7f26c61d5640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f26a006b110 0x7f26a006d5d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f26b0035000 tx=0x7f26b0030000 comp rx=0 tx=0).stop 2023-11-26T07:20:20.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.018+0000 7f26c61d5640 1 -- 172.21.15.77:0/1242534975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26c015d9b0 msgr2=0x7f26c006aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.018+0000 7f26c61d5640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26c015d9b0 0x7f26c006aaa0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009fd0 tx=0x7f26b800b8e0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.018+0000 7f26c61d5640 1 -- 172.21.15.77:0/1242534975 shutdown_connections 2023-11-26T07:20:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.018+0000 7f26c61d5640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f26a006b110 0x7f26a006d5d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.018+0000 7f26c61d5640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26c015d9b0 0x7f26c006aaa0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.018+0000 7f26c61d5640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26c00b28d0 0x7f26c00afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.018+0000 7f26c61d5640 1 --2- 172.21.15.77:0/1242534975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26c006eef0 0x7f26c00c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.018+0000 7f26c61d5640 1 -- 172.21.15.77:0/1242534975 >> 172.21.15.77:0/1242534975 conn(0x7f26c00999d0 msgr2=0x7f26c00aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.019+0000 7f26c61d5640 1 -- 172.21.15.77:0/1242534975 shutdown_connections 2023-11-26T07:20:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.019+0000 7f26c61d5640 1 -- 172.21.15.77:0/1242534975 wait complete. 2023-11-26T07:20:20.039 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:20:20.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:20.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.244+0000 7fad5f524640 1 Processor -- start 2023-11-26T07:20:20.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.244+0000 7fad5f524640 1 -- start start 2023-11-26T07:20:20.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5f524640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fad580b2250 0x7fad5815df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5f524640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad580b2630 0x7fad580ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5f524640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5815ab80 con 0x7fad580cd470 2023-11-26T07:20:20.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5f524640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5815a990 con 0x7fad580b2250 2023-11-26T07:20:20.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5f524640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5815e680 con 0x7fad580b2630 2023-11-26T07:20:20.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5d2c0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fad580b2250 0x7fad5815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5dac1640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fad580cd470 0x7fad5815b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47508/0 (socket says 172.21.15.77:47508) 2023-11-26T07:20:20.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5dac1640 1 -- 172.21.15.77:0/3732786150 learned_addr learned my addr 172.21.15.77:0/3732786150 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:20.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5cabf640 1 --2- 172.21.15.77:0/3732786150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad580b2630 0x7fad580ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5d2c0640 1 -- 172.21.15.77:0/3732786150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad580b2630 msgr2=0x7fad580ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:20.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5d2c0640 1 --2- 172.21.15.77:0/3732786150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad580b2630 0x7fad580ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad5d2c0640 1 -- 172.21.15.77:0/3732786150 >> v1:172.21.15.77:6789/0 conn(0x7fad580cd470 legacy=0x7fad5815b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.247+0000 7fad5d2c0640 1 -- 172.21.15.77:0/3732786150 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5815e960 con 0x7fad580b2250 2023-11-26T07:20:20.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.247+0000 7fad5cabf640 1 --2- 172.21.15.77:0/3732786150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad580b2630 0x7fad580ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:20.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.246+0000 7fad4ffff640 1 -- 172.21.15.77:0/3732786150 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357276211 0 0) 0x7fad5815ab80 con 0x7fad580cd470 2023-11-26T07:20:20.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.248+0000 7fad5d2c0640 1 --2- 172.21.15.77:0/3732786150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad580b2250 0x7fad5815df80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad540097a0 tx=0x7fad5402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d5d17d22038bff server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:20.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.248+0000 7fad4ffff640 1 -- 172.21.15.77:0/3732786150 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5402d040 con 0x7fad580b2250 2023-11-26T07:20:20.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.248+0000 7fad4ffff640 1 -- 172.21.15.77:0/3732786150 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54031810 con 0x7fad580b2250 2023-11-26T07:20:20.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.248+0000 7fad4ffff640 1 -- 172.21.15.77:0/3732786150 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54031ba0 con 0x7fad580b2250 2023-11-26T07:20:20.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.248+0000 7fad5f524640 1 -- 172.21.15.77:0/3732786150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad580b2250 msgr2=0x7fad5815df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.248+0000 7fad5f524640 1 --2- 172.21.15.77:0/3732786150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad580b2250 0x7fad5815df80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad540097a0 tx=0x7fad5402b8b0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.249+0000 7fad5f524640 1 -- 172.21.15.77:0/3732786150 shutdown_connections 2023-11-26T07:20:20.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.249+0000 7fad5f524640 1 --2- 172.21.15.77:0/3732786150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad580b2630 0x7fad580ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.249+0000 7fad5f524640 1 --2- 172.21.15.77:0/3732786150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad580b2250 0x7fad5815df80 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.249+0000 7fad5f524640 1 -- 172.21.15.77:0/3732786150 >> 172.21.15.77:0/3732786150 conn(0x7fad5806a920 msgr2=0x7fad5806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:20.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.249+0000 7fad5f524640 1 -- 172.21.15.77:0/3732786150 shutdown_connections 2023-11-26T07:20:20.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.249+0000 7fad5f524640 1 -- 172.21.15.77:0/3732786150 wait complete. 2023-11-26T07:20:20.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.250+0000 7fad5f524640 1 Processor -- start 2023-11-26T07:20:20.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.251+0000 7fad5f524640 1 -- start start 2023-11-26T07:20:20.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.251+0000 7fad5f524640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad580b2250 0x7fad580aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.251+0000 7fad5f524640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad580b2630 0x7fad580adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.251+0000 7fad5f524640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad580cd470 0x7fad58155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.251+0000 7fad5f524640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58169260 con 0x7fad580cd470 2023-11-26T07:20:20.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.251+0000 7fad5f524640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580af130 con 0x7fad580b2630 2023-11-26T07:20:20.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.251+0000 7fad5f524640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad580af410 con 0x7fad580b2250 2023-11-26T07:20:20.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.252+0000 7fad5dac1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad580cd470 0x7fad58155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.252+0000 7fad5dac1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad580cd470 0x7fad58155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39414/0 (socket says 172.21.15.77:39414) 2023-11-26T07:20:20.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.252+0000 7fad5dac1640 1 -- 172.21.15.77:0/2720153926 learned_addr learned my addr 172.21.15.77:0/2720153926 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:20.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.252+0000 7fad5d2c0640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad580b2250 0x7fad580aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.252+0000 7fad5dac1640 1 -- 172.21.15.77:0/2720153926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad580b2250 msgr2=0x7fad580aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.252+0000 7fad5dac1640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad580b2250 0x7fad580aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.252+0000 7fad5dac1640 1 -- 172.21.15.77:0/2720153926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad580b2630 msgr2=0x7fad580adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.252+0000 7fad5cabf640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad580b2630 0x7fad580adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.252+0000 7fad5dac1640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad580b2630 0x7fad580adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.252+0000 7fad5dac1640 1 -- 172.21.15.77:0/2720153926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54009400 con 0x7fad580cd470 2023-11-26T07:20:20.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.252+0000 7fad5dac1640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad580cd470 0x7fad58155050 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fad5000c780 tx=0x7fad5000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:20.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.253+0000 7fad4dffb640 1 -- 172.21.15.77:0/2720153926 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000ce30 con 0x7fad580cd470 2023-11-26T07:20:20.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.253+0000 7fad4dffb640 1 -- 172.21.15.77:0/2720153926 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5000a640 con 0x7fad580cd470 2023-11-26T07:20:20.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.253+0000 7fad4dffb640 1 -- 172.21.15.77:0/2720153926 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000a9f0 con 0x7fad580cd470 2023-11-26T07:20:20.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.253+0000 7fad5f524640 1 -- 172.21.15.77:0/2720153926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad580af6f0 con 0x7fad580cd470 2023-11-26T07:20:20.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.253+0000 7fad5f524640 1 -- 172.21.15.77:0/2720153926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad58167610 con 0x7fad580cd470 2023-11-26T07:20:20.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.254+0000 7fad5f524640 1 -- 172.21.15.77:0/2720153926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad58167830 con 0x7fad580cd470 2023-11-26T07:20:20.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.255+0000 7fad4dffb640 1 -- 172.21.15.77:0/2720153926 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fad5000ab50 con 0x7fad580cd470 2023-11-26T07:20:20.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.256+0000 7fad4dffb640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad3c06b110 0x7fad3c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.256+0000 7fad4dffb640 1 -- 172.21.15.77:0/2720153926 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad50088fe0 con 0x7fad580cd470 2023-11-26T07:20:20.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.256+0000 7fad5d2c0640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad3c06b110 0x7fad3c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.257+0000 7fad5d2c0640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad3c06b110 0x7fad3c06d5d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fad54036000 tx=0x7fad5403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:20.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.260+0000 7fad4dffb640 1 -- 172.21.15.77:0/2720153926 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad50053c20 con 0x7fad580cd470 2023-11-26T07:20:20.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.486+0000 7fad5f524640 1 -- 172.21.15.77:0/2720153926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad580727e0 con 0x7fad580cd470 2023-11-26T07:20:20.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.487+0000 7fad4dffb640 1 -- 172.21.15.77:0/2720153926 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fad50018070 con 0x7fad580cd470 2023-11-26T07:20:20.490 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:20.490 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/486079893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":486079893},{"type":"v1","addr":"172.21.15.159:6833","nonce":486079893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4951,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2056565249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2056565249},{"type":"v1","addr":"172.21.15.77:6837","nonce":2056565249}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/779604697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":779604697},{"type":"v1","addr":"172.21.15.159:6835","nonce":779604697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:16.411919+0000","modified":"2023-11-26T07:20:19.475778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5664":{"gid":5664,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2496806662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2496806662},{"type":"v1","addr":"172.21.15.77:6835","nonce":2496806662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:20:20.491 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 25 2023-11-26T07:20:20.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 -- 172.21.15.77:0/2720153926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad3c06b110 msgr2=0x7fad3c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad3c06b110 0x7fad3c06d5d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fad54036000 tx=0x7fad5403c040 comp rx=0 tx=0).stop 2023-11-26T07:20:20.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 -- 172.21.15.77:0/2720153926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad580cd470 msgr2=0x7fad58155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad580cd470 0x7fad58155050 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fad5000c780 tx=0x7fad5000cc40 comp rx=0 tx=0).stop 2023-11-26T07:20:20.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 -- 172.21.15.77:0/2720153926 shutdown_connections 2023-11-26T07:20:20.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad3c06b110 0x7fad3c06d5d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad580cd470 0x7fad58155050 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad580b2630 0x7fad580adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 --2- 172.21.15.77:0/2720153926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad580b2250 0x7fad580aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 -- 172.21.15.77:0/2720153926 >> 172.21.15.77:0/2720153926 conn(0x7fad5806a920 msgr2=0x7fad5815ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:20.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 -- 172.21.15.77:0/2720153926 shutdown_connections 2023-11-26T07:20:20.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.490+0000 7fad5f524640 1 -- 172.21.15.77:0/2720153926 wait complete. 2023-11-26T07:20:20.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:20.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.722+0000 7fd6c3aee640 1 Processor -- start 2023-11-26T07:20:20.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.722+0000 7fd6c3aee640 1 -- start start 2023-11-26T07:20:20.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.723+0000 7fd6c3aee640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd6bc0b2250 0x7fd6bc15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.723+0000 7fd6c3aee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd6bc0b2aa0 0x7fd6bc15b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.723+0000 7fd6c3aee640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6bc15ab80 con 0x7fd6bc0b2630 2023-11-26T07:20:20.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.724+0000 7fd6c3aee640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6bc15a990 con 0x7fd6bc0b2aa0 2023-11-26T07:20:20.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.724+0000 7fd6c3aee640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6bc15e680 con 0x7fd6bc0b2250 2023-11-26T07:20:20.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.724+0000 7fd6c208b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd6bc0b2aa0 0x7fd6bc15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.724+0000 7fd6c208b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd6bc0b2aa0 0x7fd6bc15b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39430/0 (socket says 172.21.15.77:39430) 2023-11-26T07:20:20.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.724+0000 7fd6c208b640 1 -- 172.21.15.77:0/3197189331 learned_addr learned my addr 172.21.15.77:0/3197189331 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:20.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.724+0000 7fd6c188a640 1 --2- 172.21.15.77:0/3197189331 >> v2:172.21.15.159:3300/0 conn(0x7fd6bc0b2250 0x7fd6bc15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.724+0000 7fd6c208b640 1 -- 172.21.15.77:0/3197189331 >> v2:172.21.15.159:3300/0 conn(0x7fd6bc0b2250 msgr2=0x7fd6bc15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:20.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.724+0000 7fd6c208b640 1 --2- 172.21.15.77:0/3197189331 >> v2:172.21.15.159:3300/0 conn(0x7fd6bc0b2250 0x7fd6bc15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.724+0000 7fd6c208b640 1 -- 172.21.15.77:0/3197189331 >> v1:172.21.15.159:6789/0 conn(0x7fd6bc0b2630 legacy=0x7fd6bc0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:20.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.724+0000 7fd6c208b640 1 -- 172.21.15.77:0/3197189331 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc15e960 con 0x7fd6bc0b2aa0 2023-11-26T07:20:20.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.724+0000 7fd6c188a640 1 --2- 172.21.15.77:0/3197189331 >> v2:172.21.15.159:3300/0 conn(0x7fd6bc0b2250 0x7fd6bc15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:20.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.725+0000 7fd6c208b640 1 --2- 172.21.15.77:0/3197189331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6bc0b2aa0 0x7fd6bc15b080 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc072a70 tx=0x7fd6b402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8386256fa9f1332f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:20.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.726+0000 7fd6c0888640 1 -- 172.21.15.77:0/3197189331 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b402ca80 con 0x7fd6bc0b2aa0 2023-11-26T07:20:20.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.726+0000 7fd6c0888640 1 -- 172.21.15.77:0/3197189331 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b402cbe0 con 0x7fd6bc0b2aa0 2023-11-26T07:20:20.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.726+0000 7fd6c0888640 1 -- 172.21.15.77:0/3197189331 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40343f0 con 0x7fd6bc0b2aa0 2023-11-26T07:20:20.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.726+0000 7fd6c3aee640 1 -- 172.21.15.77:0/3197189331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6bc0b2aa0 msgr2=0x7fd6bc15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.726+0000 7fd6c3aee640 1 --2- 172.21.15.77:0/3197189331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6bc0b2aa0 0x7fd6bc15b080 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc072a70 tx=0x7fd6b402bee0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.727+0000 7fd6c3aee640 1 -- 172.21.15.77:0/3197189331 shutdown_connections 2023-11-26T07:20:20.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.727+0000 7fd6c3aee640 1 --2- 172.21.15.77:0/3197189331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6bc0b2aa0 0x7fd6bc15b080 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.727+0000 7fd6c3aee640 1 --2- 172.21.15.77:0/3197189331 >> v2:172.21.15.159:3300/0 conn(0x7fd6bc0b2250 0x7fd6bc15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.727+0000 7fd6c3aee640 1 -- 172.21.15.77:0/3197189331 >> 172.21.15.77:0/3197189331 conn(0x7fd6bc06a920 msgr2=0x7fd6bc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:20.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.727+0000 7fd6c3aee640 1 -- 172.21.15.77:0/3197189331 shutdown_connections 2023-11-26T07:20:20.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.727+0000 7fd6c3aee640 1 -- 172.21.15.77:0/3197189331 wait complete. 2023-11-26T07:20:20.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.728+0000 7fd6c3aee640 1 Processor -- start 2023-11-26T07:20:20.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.729+0000 7fd6c3aee640 1 -- start start 2023-11-26T07:20:20.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c3aee640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6bc0b2250 0x7fd6bc1f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c3aee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6bc0b2630 0x7fd6bc1479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c3aee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6bc0b2aa0 0x7fd6bc1459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c3aee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc0af590 con 0x7fd6bc0b2630 2023-11-26T07:20:20.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c3aee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc145700 con 0x7fd6bc0b2aa0 2023-11-26T07:20:20.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c3aee640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc147f20 con 0x7fd6bc0b2250 2023-11-26T07:20:20.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c1089640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6bc0b2630 0x7fd6bc1479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c1089640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6bc0b2630 0x7fd6bc1479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39444/0 (socket says 172.21.15.77:39444) 2023-11-26T07:20:20.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c1089640 1 -- 172.21.15.77:0/722145947 learned_addr learned my addr 172.21.15.77:0/722145947 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:20.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c188a640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6bc0b2250 0x7fd6bc1f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c208b640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6bc0b2aa0 0x7fd6bc1459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c1089640 1 -- 172.21.15.77:0/722145947 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6bc0b2250 msgr2=0x7fd6bc1f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c1089640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6bc0b2250 0x7fd6bc1f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c1089640 1 -- 172.21.15.77:0/722145947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6bc0b2aa0 msgr2=0x7fd6bc1459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c1089640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6bc0b2aa0 0x7fd6bc1459a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c1089640 1 -- 172.21.15.77:0/722145947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4009b30 con 0x7fd6bc0b2630 2023-11-26T07:20:20.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.730+0000 7fd6c188a640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6bc0b2250 0x7fd6bc1f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:20.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.731+0000 7fd6c1089640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6bc0b2630 0x7fd6bc1479e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00c430 tx=0x7fd6ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:20.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.731+0000 7fd6b27fc640 1 -- 172.21.15.77:0/722145947 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac011790 con 0x7fd6bc0b2630 2023-11-26T07:20:20.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.731+0000 7fd6b27fc640 1 -- 172.21.15.77:0/722145947 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac0118f0 con 0x7fd6bc0b2630 2023-11-26T07:20:20.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.731+0000 7fd6b27fc640 1 -- 172.21.15.77:0/722145947 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac011ce0 con 0x7fd6bc0b2630 2023-11-26T07:20:20.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.731+0000 7fd6c3aee640 1 -- 172.21.15.77:0/722145947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6bc0cd7c0 con 0x7fd6bc0b2630 2023-11-26T07:20:20.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.731+0000 7fd6c3aee640 1 -- 172.21.15.77:0/722145947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6bc148440 con 0x7fd6bc0b2630 2023-11-26T07:20:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.732+0000 7fd6c3aee640 1 -- 172.21.15.77:0/722145947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc067470 con 0x7fd6bc0b2630 2023-11-26T07:20:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.733+0000 7fd6b27fc640 1 -- 172.21.15.77:0/722145947 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fd6ac01c460 con 0x7fd6bc0b2630 2023-11-26T07:20:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.734+0000 7fd6b27fc640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6a006b110 0x7fd6a006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.734+0000 7fd6b27fc640 1 -- 172.21.15.77:0/722145947 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6ac0898d0 con 0x7fd6bc0b2630 2023-11-26T07:20:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.734+0000 7fd6c188a640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6a006b110 0x7fd6a006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.735+0000 7fd6c188a640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6a006b110 0x7fd6a006d5d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8006fd0 tx=0x7fd6b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:20.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.739+0000 7fd6b27fc640 1 -- 172.21.15.77:0/722145947 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6ac0546c0 con 0x7fd6bc0b2630 2023-11-26T07:20:20.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.928+0000 7fd6c3aee640 1 -- 172.21.15.77:0/722145947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6bc0c83f0 con 0x7fd6bc0b2630 2023-11-26T07:20:20.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.930+0000 7fd6b27fc640 1 -- 172.21.15.77:0/722145947 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16489 (secure 0 0 0) 0x7fd6ac057ce0 con 0x7fd6bc0b2630 2023-11-26T07:20:20.933 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:20.934 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":47,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:20:17.951994+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:14.223705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:15.435670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:20.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 -- 172.21.15.77:0/722145947 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6a006b110 msgr2=0x7fd6a006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6a006b110 0x7fd6a006d5d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8006fd0 tx=0x7fd6b8008040 comp rx=0 tx=0).stop 2023-11-26T07:20:20.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 -- 172.21.15.77:0/722145947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6bc0b2630 msgr2=0x7fd6bc1479e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6bc0b2630 0x7fd6bc1479e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00c430 tx=0x7fd6ac00c8f0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 -- 172.21.15.77:0/722145947 shutdown_connections 2023-11-26T07:20:20.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd6a006b110 0x7fd6a006d5d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6bc0b2aa0 0x7fd6bc1459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6bc0b2630 0x7fd6bc1479e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 --2- 172.21.15.77:0/722145947 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6bc0b2250 0x7fd6bc1f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 -- 172.21.15.77:0/722145947 >> 172.21.15.77:0/722145947 conn(0x7fd6bc06a920 msgr2=0x7fd6bc0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:20.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 -- 172.21.15.77:0/722145947 shutdown_connections 2023-11-26T07:20:20.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:20.933+0000 7fd6c3aee640 1 -- 172.21.15.77:0/722145947 wait complete. 2023-11-26T07:20:20.955 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:20:20.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:20:21.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.162+0000 7fbbcf80e640 1 Processor -- start 2023-11-26T07:20:21.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.162+0000 7fbbcf80e640 1 -- start start 2023-11-26T07:20:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.164+0000 7fbbcf80e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbbc81461d0 0x7fbbc80b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.164+0000 7fbbcf80e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80b4fe0 0x7fbbc80b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.164+0000 7fbbcf80e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc806d180 con 0x7fbbc80b3890 2023-11-26T07:20:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.164+0000 7fbbcf80e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc80b3d00 con 0x7fbbc81461d0 2023-11-26T07:20:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.164+0000 7fbbcf80e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc806ba70 con 0x7fbbc80b4fe0 2023-11-26T07:20:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.164+0000 7fbbcd5aa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbbc81461d0 0x7fbbc80b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.164+0000 7fbbcd5aa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbbc81461d0 0x7fbbc80b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39452/0 (socket says 172.21.15.77:39452) 2023-11-26T07:20:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.164+0000 7fbbcd5aa640 1 -- 172.21.15.77:0/3399940062 learned_addr learned my addr 172.21.15.77:0/3399940062 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.165+0000 7fbbcd5aa640 1 -- 172.21.15.77:0/3399940062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80b4fe0 msgr2=0x7fbbc80b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.165+0000 7fbbcd5aa640 1 --2- 172.21.15.77:0/3399940062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80b4fe0 0x7fbbc80b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.165+0000 7fbbcd5aa640 1 -- 172.21.15.77:0/3399940062 >> v1:172.21.15.77:6789/0 conn(0x7fbbc80b3890 legacy=0x7fbbc815dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.165+0000 7fbbcd5aa640 1 -- 172.21.15.77:0/3399940062 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc806bd50 con 0x7fbbc81461d0 2023-11-26T07:20:21.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.166+0000 7fbbcd5aa640 1 --2- 172.21.15.77:0/3399940062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbc81461d0 0x7fbbc80b4aa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009870 tx=0x7fbbc402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e1f8cb53a475b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:21.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.166+0000 7fbbbffff640 1 -- 172.21.15.77:0/3399940062 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4030840 con 0x7fbbc81461d0 2023-11-26T07:20:21.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.166+0000 7fbbbffff640 1 -- 172.21.15.77:0/3399940062 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc40309a0 con 0x7fbbc81461d0 2023-11-26T07:20:21.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.166+0000 7fbbbffff640 1 -- 172.21.15.77:0/3399940062 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4030d30 con 0x7fbbc81461d0 2023-11-26T07:20:21.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.167+0000 7fbbcf80e640 1 -- 172.21.15.77:0/3399940062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbc81461d0 msgr2=0x7fbbc80b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.167+0000 7fbbcf80e640 1 --2- 172.21.15.77:0/3399940062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbc81461d0 0x7fbbc80b4aa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009870 tx=0x7fbbc402b980 comp rx=0 tx=0).stop 2023-11-26T07:20:21.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.167+0000 7fbbcf80e640 1 -- 172.21.15.77:0/3399940062 shutdown_connections 2023-11-26T07:20:21.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.167+0000 7fbbcf80e640 1 --2- 172.21.15.77:0/3399940062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80b4fe0 0x7fbbc80b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.167+0000 7fbbcf80e640 1 --2- 172.21.15.77:0/3399940062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbc81461d0 0x7fbbc80b4aa0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.167+0000 7fbbcf80e640 1 -- 172.21.15.77:0/3399940062 >> 172.21.15.77:0/3399940062 conn(0x7fbbc8061340 msgr2=0x7fbbc8061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.167+0000 7fbbcf80e640 1 -- 172.21.15.77:0/3399940062 shutdown_connections 2023-11-26T07:20:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.167+0000 7fbbcf80e640 1 -- 172.21.15.77:0/3399940062 wait complete. 2023-11-26T07:20:21.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.169+0000 7fbbcf80e640 1 Processor -- start 2023-11-26T07:20:21.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.169+0000 7fbbcf80e640 1 -- start start 2023-11-26T07:20:21.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcf80e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbc80b3890 0x7fbbc80b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcf80e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80b4fe0 0x7fbbc80cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcf80e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbc81461d0 0x7fbbc80d0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcf80e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80cb6c0 con 0x7fbbc80b3890 2023-11-26T07:20:21.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcf80e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80cb9a0 con 0x7fbbc81461d0 2023-11-26T07:20:21.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcf80e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80cbc80 con 0x7fbbc80b4fe0 2023-11-26T07:20:21.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcd5aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbc80b3890 0x7fbbc80b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcd5aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbc80b3890 0x7fbbc80b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39456/0 (socket says 172.21.15.77:39456) 2023-11-26T07:20:21.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcd5aa640 1 -- 172.21.15.77:0/1555841768 learned_addr learned my addr 172.21.15.77:0/1555841768 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:21.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcd5aa640 1 -- 172.21.15.77:0/1555841768 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80b4fe0 msgr2=0x7fbbc80cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcd5aa640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80b4fe0 0x7fbbc80cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcd5aa640 1 -- 172.21.15.77:0/1555841768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbc81461d0 msgr2=0x7fbbc80d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcd5aa640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbc81461d0 0x7fbbc80d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.170+0000 7fbbcd5aa640 1 -- 172.21.15.77:0/1555841768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40094d0 con 0x7fbbc80b3890 2023-11-26T07:20:21.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.171+0000 7fbbcd5aa640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbc80b3890 0x7fbbc80b28f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009870 tx=0x7fbbc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:21.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.171+0000 7fbbbdffb640 1 -- 172.21.15.77:0/1555841768 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc40307f0 con 0x7fbbc80b3890 2023-11-26T07:20:21.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.171+0000 7fbbbdffb640 1 -- 172.21.15.77:0/1555841768 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc4039d90 con 0x7fbbc80b3890 2023-11-26T07:20:21.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.171+0000 7fbbbdffb640 1 -- 172.21.15.77:0/1555841768 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4043630 con 0x7fbbc80b3890 2023-11-26T07:20:21.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.171+0000 7fbbcf80e640 1 -- 172.21.15.77:0/1555841768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc80cbf60 con 0x7fbbc80b3890 2023-11-26T07:20:21.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.171+0000 7fbbcf80e640 1 -- 172.21.15.77:0/1555841768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc80cab10 con 0x7fbbc80b3890 2023-11-26T07:20:21.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.172+0000 7fbbcf80e640 1 -- 172.21.15.77:0/1555841768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc8067470 con 0x7fbbc80b3890 2023-11-26T07:20:21.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.173+0000 7fbbbdffb640 1 -- 172.21.15.77:0/1555841768 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fbbc4042390 con 0x7fbbc80b3890 2023-11-26T07:20:21.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.174+0000 7fbbbdffb640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbbac06b110 0x7fbbac06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.174+0000 7fbbbdffb640 1 -- 172.21.15.77:0/1555841768 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbc40abf00 con 0x7fbbc80b3890 2023-11-26T07:20:21.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.174+0000 7fbbccda9640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbbac06b110 0x7fbbac06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.175+0000 7fbbccda9640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbbac06b110 0x7fbbac06d5d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80cf510 tx=0x7fbbb8006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:21.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.178+0000 7fbbbdffb640 1 -- 172.21.15.77:0/1555841768 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbbc4076ba0 con 0x7fbbc80b3890 2023-11-26T07:20:21.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.351+0000 7fbbcf80e640 1 -- 172.21.15.77:0/1555841768 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbc80cbb10 con 0x7fbbac06b110 2023-11-26T07:20:21.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.368+0000 7fbbbdffb640 1 -- 172.21.15.77:0/1555841768 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286547 (secure 0 0 0) 0x7fbbc80cbb10 con 0x7fbbac06b110 2023-11-26T07:20:21.375 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:21.376 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:20:21.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 -- 172.21.15.77:0/1555841768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbbac06b110 msgr2=0x7fbbac06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbbac06b110 0x7fbbac06d5d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80cf510 tx=0x7fbbb8006c90 comp rx=0 tx=0).stop 2023-11-26T07:20:21.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 -- 172.21.15.77:0/1555841768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbc80b3890 msgr2=0x7fbbc80b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbc80b3890 0x7fbbc80b28f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009870 tx=0x7fbbc4004730 comp rx=0 tx=0).stop 2023-11-26T07:20:21.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 -- 172.21.15.77:0/1555841768 shutdown_connections 2023-11-26T07:20:21.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbbac06b110 0x7fbbac06d5d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbc81461d0 0x7fbbc80d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80b4fe0 0x7fbbc80cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 --2- 172.21.15.77:0/1555841768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbc80b3890 0x7fbbc80b28f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 -- 172.21.15.77:0/1555841768 >> 172.21.15.77:0/1555841768 conn(0x7fbbc8061340 msgr2=0x7fbbc8142eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:21.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 -- 172.21.15.77:0/1555841768 shutdown_connections 2023-11-26T07:20:21.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.374+0000 7fbbcf80e640 1 -- 172.21.15.77:0/1555841768 wait complete. 2023-11-26T07:20:21.395 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-11-26T07:20:19.655150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234172,"kb_used_data":5508,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740548,"statfs":{"total":773094113280,"available":772854321152,"internally_reserved":0,"allocated":5640192,"data_stored":2986176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.718456"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963624+0000","last_change":"2023-11-26T07:20:16.990779+0000","last_active":"2023-11-26T07:20:17.963624+0000","last_peered":"2023-11-26T07:20:17.963624+0000","last_clean":"2023-11-26T07:20:17.963624+0000","last_became_active":"2023-11-26T07:20:16.986755+0000","last_became_peered":"2023-11-26T07:20:16.986755+0000","last_unstale":"2023-11-26T07:20:17.963624+0000","last_undegraded":"2023-11-26T07:20:17.963624+0000","last_fullsized":"2023-11-26T07:20:17.963624+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:14:21.822454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391656+0000","last_change":"2023-11-26T07:20:16.994996+0000","last_active":"2023-11-26T07:20:18.391656+0000","last_peered":"2023-11-26T07:20:18.391656+0000","last_clean":"2023-11-26T07:20:18.391656+0000","last_became_active":"2023-11-26T07:20:16.994849+0000","last_became_peered":"2023-11-26T07:20:16.994849+0000","last_unstale":"2023-11-26T07:20:18.391656+0000","last_undegraded":"2023-11-26T07:20:18.391656+0000","last_fullsized":"2023-11-26T07:20:18.391656+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:58.565378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391052+0000","last_change":"2023-11-26T07:20:16.999352+0000","last_active":"2023-11-26T07:20:18.391052+0000","last_peered":"2023-11-26T07:20:18.391052+0000","last_clean":"2023-11-26T07:20:18.391052+0000","last_became_active":"2023-11-26T07:20:16.998933+0000","last_became_peered":"2023-11-26T07:20:16.998933+0000","last_unstale":"2023-11-26T07:20:18.391052+0000","last_undegraded":"2023-11-26T07:20:18.391052+0000","last_fullsized":"2023-11-26T07:20:18.391052+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:55.080962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962520+0000","last_change":"2023-11-26T07:20:16.993993+0000","last_active":"2023-11-26T07:20:17.962520+0000","last_peered":"2023-11-26T07:20:17.962520+0000","last_clean":"2023-11-26T07:20:17.962520+0000","last_became_active":"2023-11-26T07:20:16.993657+0000","last_became_peered":"2023-11-26T07:20:16.993657+0000","last_unstale":"2023-11-26T07:20:17.962520+0000","last_undegraded":"2023-11-26T07:20:17.962520+0000","last_fullsized":"2023-11-26T07:20:17.962520+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:53:44.848707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392668+0000","last_change":"2023-11-26T07:20:16.995349+0000","last_active":"2023-11-26T07:20:18.392668+0000","last_peered":"2023-11-26T07:20:18.392668+0000","last_clean":"2023-11-26T07:20:18.392668+0000","last_became_active":"2023-11-26T07:20:16.993334+0000","last_became_peered":"2023-11-26T07:20:16.993334+0000","last_unstale":"2023-11-26T07:20:18.392668+0000","last_undegraded":"2023-11-26T07:20:18.392668+0000","last_fullsized":"2023-11-26T07:20:18.392668+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:52:58.161718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960709+0000","last_change":"2023-11-26T07:20:16.983731+0000","last_active":"2023-11-26T07:20:17.960709+0000","last_peered":"2023-11-26T07:20:17.960709+0000","last_clean":"2023-11-26T07:20:17.960709+0000","last_became_active":"2023-11-26T07:20:16.980935+0000","last_became_peered":"2023-11-26T07:20:16.980935+0000","last_unstale":"2023-11-26T07:20:17.960709+0000","last_undegraded":"2023-11-26T07:20:17.960709+0000","last_fullsized":"2023-11-26T07:20:17.960709+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:31:47.980430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962499+0000","last_change":"2023-11-26T07:20:16.994843+0000","last_active":"2023-11-26T07:20:17.962499+0000","last_peered":"2023-11-26T07:20:17.962499+0000","last_clean":"2023-11-26T07:20:17.962499+0000","last_became_active":"2023-11-26T07:20:16.994034+0000","last_became_peered":"2023-11-26T07:20:16.994034+0000","last_unstale":"2023-11-26T07:20:17.962499+0000","last_undegraded":"2023-11-26T07:20:17.962499+0000","last_fullsized":"2023-11-26T07:20:17.962499+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:56:49.545401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960138+0000","last_change":"2023-11-26T07:20:16.997894+0000","last_active":"2023-11-26T07:20:17.960138+0000","last_peered":"2023-11-26T07:20:17.960138+0000","last_clean":"2023-11-26T07:20:17.960138+0000","last_became_active":"2023-11-26T07:20:16.996259+0000","last_became_peered":"2023-11-26T07:20:16.996259+0000","last_unstale":"2023-11-26T07:20:17.960138+0000","last_undegraded":"2023-11-26T07:20:17.960138+0000","last_fullsized":"2023-11-26T07:20:17.960138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:55.080962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962038+0000","last_change":"2023-11-26T07:20:17.005263+0000","last_active":"2023-11-26T07:20:17.962038+0000","last_peered":"2023-11-26T07:20:17.962038+0000","last_clean":"2023-11-26T07:20:17.962038+0000","last_became_active":"2023-11-26T07:20:17.005011+0000","last_became_peered":"2023-11-26T07:20:17.005011+0000","last_unstale":"2023-11-26T07:20:17.962038+0000","last_undegraded":"2023-11-26T07:20:17.962038+0000","last_fullsized":"2023-11-26T07:20:17.962038+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:25:36.126327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961733+0000","last_change":"2023-11-26T07:20:16.995183+0000","last_active":"2023-11-26T07:20:17.961733+0000","last_peered":"2023-11-26T07:20:17.961733+0000","last_clean":"2023-11-26T07:20:17.961733+0000","last_became_active":"2023-11-26T07:20:16.994591+0000","last_became_peered":"2023-11-26T07:20:16.994591+0000","last_unstale":"2023-11-26T07:20:17.961733+0000","last_undegraded":"2023-11-26T07:20:17.961733+0000","last_fullsized":"2023-11-26T07:20:17.961733+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:24:35.846137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961425+0000","last_change":"2023-11-26T07:20:16.996278+0000","last_active":"2023-11-26T07:20:17.961425+0000","last_peered":"2023-11-26T07:20:17.961425+0000","last_clean":"2023-11-26T07:20:17.961425+0000","last_became_active":"2023-11-26T07:20:16.995979+0000","last_became_peered":"2023-11-26T07:20:16.995979+0000","last_unstale":"2023-11-26T07:20:17.961425+0000","last_undegraded":"2023-11-26T07:20:17.961425+0000","last_fullsized":"2023-11-26T07:20:17.961425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:40:30.261602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391322+0000","last_change":"2023-11-26T07:20:16.983256+0000","last_active":"2023-11-26T07:20:18.391322+0000","last_peered":"2023-11-26T07:20:18.391322+0000","last_clean":"2023-11-26T07:20:18.391322+0000","last_became_active":"2023-11-26T07:20:16.982958+0000","last_became_peered":"2023-11-26T07:20:16.982958+0000","last_unstale":"2023-11-26T07:20:18.391322+0000","last_undegraded":"2023-11-26T07:20:18.391322+0000","last_fullsized":"2023-11-26T07:20:18.391322+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:37.708106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390190+0000","last_change":"2023-11-26T07:20:16.981723+0000","last_active":"2023-11-26T07:20:18.390190+0000","last_peered":"2023-11-26T07:20:18.390190+0000","last_clean":"2023-11-26T07:20:18.390190+0000","last_became_active":"2023-11-26T07:20:16.981460+0000","last_became_peered":"2023-11-26T07:20:16.981460+0000","last_unstale":"2023-11-26T07:20:18.390190+0000","last_undegraded":"2023-11-26T07:20:18.390190+0000","last_fullsized":"2023-11-26T07:20:18.390190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:01:30.099284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961203+0000","last_change":"2023-11-26T07:20:17.004463+0000","last_active":"2023-11-26T07:20:17.961203+0000","last_peered":"2023-11-26T07:20:17.961203+0000","last_clean":"2023-11-26T07:20:17.961203+0000","last_became_active":"2023-11-26T07:20:17.004173+0000","last_became_peered":"2023-11-26T07:20:17.004173+0000","last_unstale":"2023-11-26T07:20:17.961203+0000","last_undegraded":"2023-11-26T07:20:17.961203+0000","last_fullsized":"2023-11-26T07:20:17.961203+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:30:31.266629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960440+0000","last_change":"2023-11-26T07:20:16.986680+0000","last_active":"2023-11-26T07:20:17.960440+0000","last_peered":"2023-11-26T07:20:17.960440+0000","last_clean":"2023-11-26T07:20:17.960440+0000","last_became_active":"2023-11-26T07:20:16.985830+0000","last_became_peered":"2023-11-26T07:20:16.985830+0000","last_unstale":"2023-11-26T07:20:17.960440+0000","last_undegraded":"2023-11-26T07:20:17.960440+0000","last_fullsized":"2023-11-26T07:20:17.960440+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:35:01.221601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.311549+0000","last_change":"2023-11-26T07:20:16.991698+0000","last_active":"2023-11-26T07:20:18.311549+0000","last_peered":"2023-11-26T07:20:18.311549+0000","last_clean":"2023-11-26T07:20:18.311549+0000","last_became_active":"2023-11-26T07:20:16.991406+0000","last_became_peered":"2023-11-26T07:20:16.991406+0000","last_unstale":"2023-11-26T07:20:18.311549+0000","last_undegraded":"2023-11-26T07:20:18.311549+0000","last_fullsized":"2023-11-26T07:20:18.311549+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:26:15.532735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392122+0000","last_change":"2023-11-26T07:20:16.988808+0000","last_active":"2023-11-26T07:20:18.392122+0000","last_peered":"2023-11-26T07:20:18.392122+0000","last_clean":"2023-11-26T07:20:18.392122+0000","last_became_active":"2023-11-26T07:20:16.985646+0000","last_became_peered":"2023-11-26T07:20:16.985646+0000","last_unstale":"2023-11-26T07:20:18.392122+0000","last_undegraded":"2023-11-26T07:20:18.392122+0000","last_fullsized":"2023-11-26T07:20:18.392122+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:24:35.846137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391794+0000","last_change":"2023-11-26T07:20:16.988928+0000","last_active":"2023-11-26T07:20:18.391794+0000","last_peered":"2023-11-26T07:20:18.391794+0000","last_clean":"2023-11-26T07:20:18.391794+0000","last_became_active":"2023-11-26T07:20:16.988267+0000","last_became_peered":"2023-11-26T07:20:16.988267+0000","last_unstale":"2023-11-26T07:20:18.391794+0000","last_undegraded":"2023-11-26T07:20:18.391794+0000","last_fullsized":"2023-11-26T07:20:18.391794+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:40:30.261602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312512+0000","last_change":"2023-11-26T07:20:16.992793+0000","last_active":"2023-11-26T07:20:18.312512+0000","last_peered":"2023-11-26T07:20:18.312512+0000","last_clean":"2023-11-26T07:20:18.312512+0000","last_became_active":"2023-11-26T07:20:16.992429+0000","last_became_peered":"2023-11-26T07:20:16.992429+0000","last_unstale":"2023-11-26T07:20:18.312512+0000","last_undegraded":"2023-11-26T07:20:18.312512+0000","last_fullsized":"2023-11-26T07:20:18.312512+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:04.054812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390451+0000","last_change":"2023-11-26T07:20:16.988296+0000","last_active":"2023-11-26T07:20:18.390451+0000","last_peered":"2023-11-26T07:20:18.390451+0000","last_clean":"2023-11-26T07:20:18.390451+0000","last_became_active":"2023-11-26T07:20:16.987985+0000","last_became_peered":"2023-11-26T07:20:16.987985+0000","last_unstale":"2023-11-26T07:20:18.390451+0000","last_undegraded":"2023-11-26T07:20:18.390451+0000","last_fullsized":"2023-11-26T07:20:18.390451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:17:24.635775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960936+0000","last_change":"2023-11-26T07:20:16.993459+0000","last_active":"2023-11-26T07:20:17.960936+0000","last_peered":"2023-11-26T07:20:17.960936+0000","last_clean":"2023-11-26T07:20:17.960936+0000","last_became_active":"2023-11-26T07:20:16.993108+0000","last_became_peered":"2023-11-26T07:20:16.993108+0000","last_unstale":"2023-11-26T07:20:17.960936+0000","last_undegraded":"2023-11-26T07:20:17.960936+0000","last_fullsized":"2023-11-26T07:20:17.960936+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:01.386594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961396+0000","last_change":"2023-11-26T07:20:16.993293+0000","last_active":"2023-11-26T07:20:17.961396+0000","last_peered":"2023-11-26T07:20:17.961396+0000","last_clean":"2023-11-26T07:20:17.961396+0000","last_became_active":"2023-11-26T07:20:16.992951+0000","last_became_peered":"2023-11-26T07:20:16.992951+0000","last_unstale":"2023-11-26T07:20:17.961396+0000","last_undegraded":"2023-11-26T07:20:17.961396+0000","last_fullsized":"2023-11-26T07:20:17.961396+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:39:40.120254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.311975+0000","last_change":"2023-11-26T07:20:16.993188+0000","last_active":"2023-11-26T07:20:18.311975+0000","last_peered":"2023-11-26T07:20:18.311975+0000","last_clean":"2023-11-26T07:20:18.311975+0000","last_became_active":"2023-11-26T07:20:16.992910+0000","last_became_peered":"2023-11-26T07:20:16.992910+0000","last_unstale":"2023-11-26T07:20:18.311975+0000","last_undegraded":"2023-11-26T07:20:18.311975+0000","last_fullsized":"2023-11-26T07:20:18.311975+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:24:05.332594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.311606+0000","last_change":"2023-11-26T07:20:16.996479+0000","last_active":"2023-11-26T07:20:18.311606+0000","last_peered":"2023-11-26T07:20:18.311606+0000","last_clean":"2023-11-26T07:20:18.311606+0000","last_became_active":"2023-11-26T07:20:16.995938+0000","last_became_peered":"2023-11-26T07:20:16.995938+0000","last_unstale":"2023-11-26T07:20:18.311606+0000","last_undegraded":"2023-11-26T07:20:18.311606+0000","last_fullsized":"2023-11-26T07:20:18.311606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:50:39.220243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312686+0000","last_change":"2023-11-26T07:20:17.005512+0000","last_active":"2023-11-26T07:20:18.312686+0000","last_peered":"2023-11-26T07:20:18.312686+0000","last_clean":"2023-11-26T07:20:18.312686+0000","last_became_active":"2023-11-26T07:20:17.005113+0000","last_became_peered":"2023-11-26T07:20:17.005113+0000","last_unstale":"2023-11-26T07:20:18.312686+0000","last_undegraded":"2023-11-26T07:20:18.312686+0000","last_fullsized":"2023-11-26T07:20:18.312686+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:17:02.695245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390451+0000","last_change":"2023-11-26T07:20:16.979621+0000","last_active":"2023-11-26T07:20:18.390451+0000","last_peered":"2023-11-26T07:20:18.390451+0000","last_clean":"2023-11-26T07:20:18.390451+0000","last_became_active":"2023-11-26T07:20:16.976154+0000","last_became_peered":"2023-11-26T07:20:16.976154+0000","last_unstale":"2023-11-26T07:20:18.390451+0000","last_undegraded":"2023-11-26T07:20:18.390451+0000","last_fullsized":"2023-11-26T07:20:18.390451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:05:50.192916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391613+0000","last_change":"2023-11-26T07:20:16.987756+0000","last_active":"2023-11-26T07:20:18.391613+0000","last_peered":"2023-11-26T07:20:18.391613+0000","last_clean":"2023-11-26T07:20:18.391613+0000","last_became_active":"2023-11-26T07:20:16.987371+0000","last_became_peered":"2023-11-26T07:20:16.987371+0000","last_unstale":"2023-11-26T07:20:18.391613+0000","last_undegraded":"2023-11-26T07:20:18.391613+0000","last_fullsized":"2023-11-26T07:20:18.391613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:30:31.266629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391713+0000","last_change":"2023-11-26T07:20:16.982887+0000","last_active":"2023-11-26T07:20:18.391713+0000","last_peered":"2023-11-26T07:20:18.391713+0000","last_clean":"2023-11-26T07:20:18.391713+0000","last_became_active":"2023-11-26T07:20:16.982475+0000","last_became_peered":"2023-11-26T07:20:16.982475+0000","last_unstale":"2023-11-26T07:20:18.391713+0000","last_undegraded":"2023-11-26T07:20:18.391713+0000","last_fullsized":"2023-11-26T07:20:18.391713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:56:49.545401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312403+0000","last_change":"2023-11-26T07:20:17.003224+0000","last_active":"2023-11-26T07:20:18.312403+0000","last_peered":"2023-11-26T07:20:18.312403+0000","last_clean":"2023-11-26T07:20:18.312403+0000","last_became_active":"2023-11-26T07:20:17.002887+0000","last_became_peered":"2023-11-26T07:20:17.002887+0000","last_unstale":"2023-11-26T07:20:18.312403+0000","last_undegraded":"2023-11-26T07:20:18.312403+0000","last_fullsized":"2023-11-26T07:20:18.312403+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:58:29.600139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391166+0000","last_change":"2023-11-26T07:20:16.981350+0000","last_active":"2023-11-26T07:20:18.391166+0000","last_peered":"2023-11-26T07:20:18.391166+0000","last_clean":"2023-11-26T07:20:18.391166+0000","last_became_active":"2023-11-26T07:20:16.980682+0000","last_became_peered":"2023-11-26T07:20:16.980682+0000","last_unstale":"2023-11-26T07:20:18.391166+0000","last_undegraded":"2023-11-26T07:20:18.391166+0000","last_fullsized":"2023-11-26T07:20:18.391166+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:15.511229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960612+0000","last_change":"2023-11-26T07:20:16.969832+0000","last_active":"2023-11-26T07:20:17.960612+0000","last_peered":"2023-11-26T07:20:17.960612+0000","last_clean":"2023-11-26T07:20:17.960612+0000","last_became_active":"2023-11-26T07:20:16.969195+0000","last_became_peered":"2023-11-26T07:20:16.969195+0000","last_unstale":"2023-11-26T07:20:17.960612+0000","last_undegraded":"2023-11-26T07:20:17.960612+0000","last_fullsized":"2023-11-26T07:20:17.960612+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:47:52.949612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390429+0000","last_change":"2023-11-26T07:20:16.998869+0000","last_active":"2023-11-26T07:20:18.390429+0000","last_peered":"2023-11-26T07:20:18.390429+0000","last_clean":"2023-11-26T07:20:18.390429+0000","last_became_active":"2023-11-26T07:20:16.998580+0000","last_became_peered":"2023-11-26T07:20:16.998580+0000","last_unstale":"2023-11-26T07:20:18.390429+0000","last_undegraded":"2023-11-26T07:20:18.390429+0000","last_fullsized":"2023-11-26T07:20:18.390429+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:07:11.738124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.307558+0000","last_change":"2023-11-26T07:20:16.995148+0000","last_active":"2023-11-26T07:20:18.307558+0000","last_peered":"2023-11-26T07:20:18.307558+0000","last_clean":"2023-11-26T07:20:18.307558+0000","last_became_active":"2023-11-26T07:20:16.994865+0000","last_became_peered":"2023-11-26T07:20:16.994865+0000","last_unstale":"2023-11-26T07:20:18.307558+0000","last_undegraded":"2023-11-26T07:20:18.307558+0000","last_fullsized":"2023-11-26T07:20:18.307558+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:15.511229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963113+0000","last_change":"2023-11-26T07:20:15.978792+0000","last_active":"2023-11-26T07:20:17.963113+0000","last_peered":"2023-11-26T07:20:17.963113+0000","last_clean":"2023-11-26T07:20:17.963113+0000","last_became_active":"2023-11-26T07:20:15.978545+0000","last_became_peered":"2023-11-26T07:20:15.978545+0000","last_unstale":"2023-11-26T07:20:17.963113+0000","last_undegraded":"2023-11-26T07:20:17.963113+0000","last_fullsized":"2023-11-26T07:20:17.963113+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:36.693572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312722+0000","last_change":"2023-11-26T07:20:16.989253+0000","last_active":"2023-11-26T07:20:18.312722+0000","last_peered":"2023-11-26T07:20:18.312722+0000","last_clean":"2023-11-26T07:20:18.312722+0000","last_became_active":"2023-11-26T07:20:16.988793+0000","last_became_peered":"2023-11-26T07:20:16.988793+0000","last_unstale":"2023-11-26T07:20:18.312722+0000","last_undegraded":"2023-11-26T07:20:18.312722+0000","last_fullsized":"2023-11-26T07:20:18.312722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:56.168119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392254+0000","last_change":"2023-11-26T07:20:15.982589+0000","last_active":"2023-11-26T07:20:18.392254+0000","last_peered":"2023-11-26T07:20:18.392254+0000","last_clean":"2023-11-26T07:20:18.392254+0000","last_became_active":"2023-11-26T07:20:15.982227+0000","last_became_peered":"2023-11-26T07:20:15.982227+0000","last_unstale":"2023-11-26T07:20:18.392254+0000","last_undegraded":"2023-11-26T07:20:18.392254+0000","last_fullsized":"2023-11-26T07:20:18.392254+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:57.930622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392053+0000","last_change":"2023-11-26T07:20:16.974256+0000","last_active":"2023-11-26T07:20:18.392053+0000","last_peered":"2023-11-26T07:20:18.392053+0000","last_clean":"2023-11-26T07:20:18.392053+0000","last_became_active":"2023-11-26T07:20:16.973517+0000","last_became_peered":"2023-11-26T07:20:16.973517+0000","last_unstale":"2023-11-26T07:20:18.392053+0000","last_undegraded":"2023-11-26T07:20:18.392053+0000","last_fullsized":"2023-11-26T07:20:18.392053+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:30.789590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.307928+0000","last_change":"2023-11-26T07:20:15.980841+0000","last_active":"2023-11-26T07:20:18.307928+0000","last_peered":"2023-11-26T07:20:18.307928+0000","last_clean":"2023-11-26T07:20:18.307928+0000","last_became_active":"2023-11-26T07:20:15.980454+0000","last_became_peered":"2023-11-26T07:20:15.980454+0000","last_unstale":"2023-11-26T07:20:18.307928+0000","last_undegraded":"2023-11-26T07:20:18.307928+0000","last_fullsized":"2023-11-26T07:20:18.307928+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:55.153585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.308136+0000","last_change":"2023-11-26T07:20:16.997122+0000","last_active":"2023-11-26T07:20:18.308136+0000","last_peered":"2023-11-26T07:20:18.308136+0000","last_clean":"2023-11-26T07:20:18.308136+0000","last_became_active":"2023-11-26T07:20:16.996796+0000","last_became_peered":"2023-11-26T07:20:16.996796+0000","last_unstale":"2023-11-26T07:20:18.308136+0000","last_undegraded":"2023-11-26T07:20:18.308136+0000","last_fullsized":"2023-11-26T07:20:18.308136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:40:21.764188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962923+0000","last_change":"2023-11-26T07:20:15.988743+0000","last_active":"2023-11-26T07:20:17.962923+0000","last_peered":"2023-11-26T07:20:17.962923+0000","last_clean":"2023-11-26T07:20:17.962923+0000","last_became_active":"2023-11-26T07:20:15.988456+0000","last_became_peered":"2023-11-26T07:20:15.988456+0000","last_unstale":"2023-11-26T07:20:17.962923+0000","last_undegraded":"2023-11-26T07:20:17.962923+0000","last_fullsized":"2023-11-26T07:20:17.962923+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:12:30.913501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391543+0000","last_change":"2023-11-26T07:20:16.990767+0000","last_active":"2023-11-26T07:20:18.391543+0000","last_peered":"2023-11-26T07:20:18.391543+0000","last_clean":"2023-11-26T07:20:18.391543+0000","last_became_active":"2023-11-26T07:20:16.990398+0000","last_became_peered":"2023-11-26T07:20:16.990398+0000","last_unstale":"2023-11-26T07:20:18.391543+0000","last_undegraded":"2023-11-26T07:20:18.391543+0000","last_fullsized":"2023-11-26T07:20:18.391543+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:40:21.764188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961541+0000","last_change":"2023-11-26T07:20:15.987819+0000","last_active":"2023-11-26T07:20:17.961541+0000","last_peered":"2023-11-26T07:20:17.961541+0000","last_clean":"2023-11-26T07:20:17.961541+0000","last_became_active":"2023-11-26T07:20:15.987475+0000","last_became_peered":"2023-11-26T07:20:15.987475+0000","last_unstale":"2023-11-26T07:20:17.961541+0000","last_undegraded":"2023-11-26T07:20:17.961541+0000","last_fullsized":"2023-11-26T07:20:17.961541+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:14:20.807919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962394+0000","last_change":"2023-11-26T07:20:16.991555+0000","last_active":"2023-11-26T07:20:17.962394+0000","last_peered":"2023-11-26T07:20:17.962394+0000","last_clean":"2023-11-26T07:20:17.962394+0000","last_became_active":"2023-11-26T07:20:16.991270+0000","last_became_peered":"2023-11-26T07:20:16.991270+0000","last_unstale":"2023-11-26T07:20:17.962394+0000","last_undegraded":"2023-11-26T07:20:17.962394+0000","last_fullsized":"2023-11-26T07:20:17.962394+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:08:10.592186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391820+0000","last_change":"2023-11-26T07:20:15.985753+0000","last_active":"2023-11-26T07:20:18.391820+0000","last_peered":"2023-11-26T07:20:18.391820+0000","last_clean":"2023-11-26T07:20:18.391820+0000","last_became_active":"2023-11-26T07:20:15.985475+0000","last_became_peered":"2023-11-26T07:20:15.985475+0000","last_unstale":"2023-11-26T07:20:18.391820+0000","last_undegraded":"2023-11-26T07:20:18.391820+0000","last_fullsized":"2023-11-26T07:20:18.391820+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:38.268982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960296+0000","last_change":"2023-11-26T07:20:16.997680+0000","last_active":"2023-11-26T07:20:17.960296+0000","last_peered":"2023-11-26T07:20:17.960296+0000","last_clean":"2023-11-26T07:20:17.960296+0000","last_became_active":"2023-11-26T07:20:16.996588+0000","last_became_peered":"2023-11-26T07:20:16.996588+0000","last_unstale":"2023-11-26T07:20:17.960296+0000","last_undegraded":"2023-11-26T07:20:17.960296+0000","last_fullsized":"2023-11-26T07:20:17.960296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:15.511229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390434+0000","last_change":"2023-11-26T07:20:15.974187+0000","last_active":"2023-11-26T07:20:18.390434+0000","last_peered":"2023-11-26T07:20:18.390434+0000","last_clean":"2023-11-26T07:20:18.390434+0000","last_became_active":"2023-11-26T07:20:15.973885+0000","last_became_peered":"2023-11-26T07:20:15.973885+0000","last_unstale":"2023-11-26T07:20:18.390434+0000","last_undegraded":"2023-11-26T07:20:18.390434+0000","last_fullsized":"2023-11-26T07:20:18.390434+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:40:20.749653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.311622+0000","last_change":"2023-11-26T07:20:16.993220+0000","last_active":"2023-11-26T07:20:18.311622+0000","last_peered":"2023-11-26T07:20:18.311622+0000","last_clean":"2023-11-26T07:20:18.311622+0000","last_became_active":"2023-11-26T07:20:16.992915+0000","last_became_peered":"2023-11-26T07:20:16.992915+0000","last_unstale":"2023-11-26T07:20:18.311622+0000","last_undegraded":"2023-11-26T07:20:18.311622+0000","last_fullsized":"2023-11-26T07:20:18.311622+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:06.969279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960418+0000","last_change":"2023-11-26T07:20:15.978069+0000","last_active":"2023-11-26T07:20:17.960418+0000","last_peered":"2023-11-26T07:20:17.960418+0000","last_clean":"2023-11-26T07:20:17.960418+0000","last_became_active":"2023-11-26T07:20:15.976583+0000","last_became_peered":"2023-11-26T07:20:15.976583+0000","last_unstale":"2023-11-26T07:20:17.960418+0000","last_undegraded":"2023-11-26T07:20:17.960418+0000","last_fullsized":"2023-11-26T07:20:17.960418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:38.268982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392071+0000","last_change":"2023-11-26T07:20:16.989098+0000","last_active":"2023-11-26T07:20:18.392071+0000","last_peered":"2023-11-26T07:20:18.392071+0000","last_clean":"2023-11-26T07:20:18.392071+0000","last_became_active":"2023-11-26T07:20:16.988653+0000","last_became_peered":"2023-11-26T07:20:16.988653+0000","last_unstale":"2023-11-26T07:20:18.392071+0000","last_undegraded":"2023-11-26T07:20:18.392071+0000","last_fullsized":"2023-11-26T07:20:18.392071+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:39:40.120254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392288+0000","last_change":"2023-11-26T07:20:15.984750+0000","last_active":"2023-11-26T07:20:18.392288+0000","last_peered":"2023-11-26T07:20:18.392288+0000","last_clean":"2023-11-26T07:20:18.392288+0000","last_became_active":"2023-11-26T07:20:15.984479+0000","last_became_peered":"2023-11-26T07:20:15.984479+0000","last_unstale":"2023-11-26T07:20:18.392288+0000","last_undegraded":"2023-11-26T07:20:18.392288+0000","last_fullsized":"2023-11-26T07:20:18.392288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:03.040278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963670+0000","last_change":"2023-11-26T07:20:16.990634+0000","last_active":"2023-11-26T07:20:17.963670+0000","last_peered":"2023-11-26T07:20:17.963670+0000","last_clean":"2023-11-26T07:20:17.963670+0000","last_became_active":"2023-11-26T07:20:16.987075+0000","last_became_peered":"2023-11-26T07:20:16.987075+0000","last_unstale":"2023-11-26T07:20:17.963670+0000","last_undegraded":"2023-11-26T07:20:17.963670+0000","last_fullsized":"2023-11-26T07:20:17.963670+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:56:47.557897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961966+0000","last_change":"2023-11-26T07:20:15.982606+0000","last_active":"2023-11-26T07:20:17.961966+0000","last_peered":"2023-11-26T07:20:17.961966+0000","last_clean":"2023-11-26T07:20:17.961966+0000","last_became_active":"2023-11-26T07:20:15.982313+0000","last_became_peered":"2023-11-26T07:20:15.982313+0000","last_unstale":"2023-11-26T07:20:17.961966+0000","last_undegraded":"2023-11-26T07:20:17.961966+0000","last_fullsized":"2023-11-26T07:20:17.961966+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:03.040278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961636+0000","last_change":"2023-11-26T07:20:16.990581+0000","last_active":"2023-11-26T07:20:17.961636+0000","last_peered":"2023-11-26T07:20:17.961636+0000","last_clean":"2023-11-26T07:20:17.961636+0000","last_became_active":"2023-11-26T07:20:16.990285+0000","last_became_peered":"2023-11-26T07:20:16.990285+0000","last_unstale":"2023-11-26T07:20:17.961636+0000","last_undegraded":"2023-11-26T07:20:17.961636+0000","last_fullsized":"2023-11-26T07:20:17.961636+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:21:55.441220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963264+0000","last_change":"2023-11-26T07:20:15.992949+0000","last_active":"2023-11-26T07:20:17.963264+0000","last_peered":"2023-11-26T07:20:17.963264+0000","last_clean":"2023-11-26T07:20:17.963264+0000","last_became_active":"2023-11-26T07:20:15.992697+0000","last_became_peered":"2023-11-26T07:20:15.992697+0000","last_unstale":"2023-11-26T07:20:17.963264+0000","last_undegraded":"2023-11-26T07:20:17.963264+0000","last_fullsized":"2023-11-26T07:20:17.963264+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:24:34.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962939+0000","last_change":"2023-11-26T07:20:16.994905+0000","last_active":"2023-11-26T07:20:17.962939+0000","last_peered":"2023-11-26T07:20:17.962939+0000","last_clean":"2023-11-26T07:20:17.962939+0000","last_became_active":"2023-11-26T07:20:16.994624+0000","last_became_peered":"2023-11-26T07:20:16.994624+0000","last_unstale":"2023-11-26T07:20:17.962939+0000","last_undegraded":"2023-11-26T07:20:17.962939+0000","last_fullsized":"2023-11-26T07:20:17.962939+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:52:58.161718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390439+0000","last_change":"2023-11-26T07:20:15.975988+0000","last_active":"2023-11-26T07:20:18.390439+0000","last_peered":"2023-11-26T07:20:18.390439+0000","last_clean":"2023-11-26T07:20:18.390439+0000","last_became_active":"2023-11-26T07:20:15.975689+0000","last_became_peered":"2023-11-26T07:20:15.975689+0000","last_unstale":"2023-11-26T07:20:18.390439+0000","last_undegraded":"2023-11-26T07:20:18.390439+0000","last_fullsized":"2023-11-26T07:20:18.390439+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:14:19.501389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312412+0000","last_change":"2023-11-26T07:20:16.992039+0000","last_active":"2023-11-26T07:20:18.312412+0000","last_peered":"2023-11-26T07:20:18.312412+0000","last_clean":"2023-11-26T07:20:18.312412+0000","last_became_active":"2023-11-26T07:20:16.991763+0000","last_became_peered":"2023-11-26T07:20:16.991763+0000","last_unstale":"2023-11-26T07:20:18.312412+0000","last_undegraded":"2023-11-26T07:20:18.312412+0000","last_fullsized":"2023-11-26T07:20:18.312412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:09:47.504406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961690+0000","last_change":"2023-11-26T07:20:15.975862+0000","last_active":"2023-11-26T07:20:17.961690+0000","last_peered":"2023-11-26T07:20:17.961690+0000","last_clean":"2023-11-26T07:20:17.961690+0000","last_became_active":"2023-11-26T07:20:15.975525+0000","last_became_peered":"2023-11-26T07:20:15.975525+0000","last_unstale":"2023-11-26T07:20:17.961690+0000","last_undegraded":"2023-11-26T07:20:17.961690+0000","last_fullsized":"2023-11-26T07:20:17.961690+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:56:46.543363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962488+0000","last_change":"2023-11-26T07:20:16.985147+0000","last_active":"2023-11-26T07:20:17.962488+0000","last_peered":"2023-11-26T07:20:17.962488+0000","last_clean":"2023-11-26T07:20:17.962488+0000","last_became_active":"2023-11-26T07:20:16.984837+0000","last_became_peered":"2023-11-26T07:20:16.984837+0000","last_unstale":"2023-11-26T07:20:17.962488+0000","last_undegraded":"2023-11-26T07:20:17.962488+0000","last_fullsized":"2023-11-26T07:20:17.962488+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:12:31.928035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962798+0000","last_change":"2023-11-26T07:20:15.983804+0000","last_active":"2023-11-26T07:20:17.962798+0000","last_peered":"2023-11-26T07:20:17.962798+0000","last_clean":"2023-11-26T07:20:17.962798+0000","last_became_active":"2023-11-26T07:20:15.983517+0000","last_became_peered":"2023-11-26T07:20:15.983517+0000","last_unstale":"2023-11-26T07:20:17.962798+0000","last_undegraded":"2023-11-26T07:20:17.962798+0000","last_fullsized":"2023-11-26T07:20:17.962798+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:40:29.247068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960490+0000","last_change":"2023-11-26T07:20:16.990559+0000","last_active":"2023-11-26T07:20:17.960490+0000","last_peered":"2023-11-26T07:20:17.960490+0000","last_clean":"2023-11-26T07:20:17.960490+0000","last_became_active":"2023-11-26T07:20:16.990243+0000","last_became_peered":"2023-11-26T07:20:16.990243+0000","last_unstale":"2023-11-26T07:20:17.960490+0000","last_undegraded":"2023-11-26T07:20:17.960490+0000","last_fullsized":"2023-11-26T07:20:17.960490+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:25:21.154910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960726+0000","last_change":"2023-11-26T07:20:15.975865+0000","last_active":"2023-11-26T07:20:17.960726+0000","last_peered":"2023-11-26T07:20:17.960726+0000","last_clean":"2023-11-26T07:20:17.960726+0000","last_became_active":"2023-11-26T07:20:15.975558+0000","last_became_peered":"2023-11-26T07:20:15.975558+0000","last_unstale":"2023-11-26T07:20:17.960726+0000","last_undegraded":"2023-11-26T07:20:17.960726+0000","last_fullsized":"2023-11-26T07:20:17.960726+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:44:27.994232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962651+0000","last_change":"2023-11-26T07:20:16.990013+0000","last_active":"2023-11-26T07:20:17.962651+0000","last_peered":"2023-11-26T07:20:17.962651+0000","last_clean":"2023-11-26T07:20:17.962651+0000","last_became_active":"2023-11-26T07:20:16.989703+0000","last_became_peered":"2023-11-26T07:20:16.989703+0000","last_unstale":"2023-11-26T07:20:17.962651+0000","last_undegraded":"2023-11-26T07:20:17.962651+0000","last_fullsized":"2023-11-26T07:20:17.962651+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:30.789590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960529+0000","last_change":"2023-11-26T07:20:15.970561+0000","last_active":"2023-11-26T07:20:17.960529+0000","last_peered":"2023-11-26T07:20:17.960529+0000","last_clean":"2023-11-26T07:20:17.960529+0000","last_became_active":"2023-11-26T07:20:15.970232+0000","last_became_peered":"2023-11-26T07:20:15.970232+0000","last_unstale":"2023-11-26T07:20:17.960529+0000","last_undegraded":"2023-11-26T07:20:17.960529+0000","last_fullsized":"2023-11-26T07:20:17.960529+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:45:04.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390855+0000","last_change":"2023-11-26T07:20:16.986463+0000","last_active":"2023-11-26T07:20:18.390855+0000","last_peered":"2023-11-26T07:20:18.390855+0000","last_clean":"2023-11-26T07:20:18.390855+0000","last_became_active":"2023-11-26T07:20:16.986163+0000","last_became_peered":"2023-11-26T07:20:16.986163+0000","last_unstale":"2023-11-26T07:20:18.390855+0000","last_undegraded":"2023-11-26T07:20:18.390855+0000","last_fullsized":"2023-11-26T07:20:18.390855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:54:42.573778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390805+0000","last_change":"2023-11-26T07:20:15.975489+0000","last_active":"2023-11-26T07:20:18.390805+0000","last_peered":"2023-11-26T07:20:18.390805+0000","last_clean":"2023-11-26T07:20:18.390805+0000","last_became_active":"2023-11-26T07:20:15.975124+0000","last_became_peered":"2023-11-26T07:20:15.975124+0000","last_unstale":"2023-11-26T07:20:18.390805+0000","last_undegraded":"2023-11-26T07:20:18.390805+0000","last_fullsized":"2023-11-26T07:20:18.390805+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:54:29.672254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962415+0000","last_change":"2023-11-26T07:20:17.002557+0000","last_active":"2023-11-26T07:20:17.962415+0000","last_peered":"2023-11-26T07:20:17.962415+0000","last_clean":"2023-11-26T07:20:17.962415+0000","last_became_active":"2023-11-26T07:20:16.999816+0000","last_became_peered":"2023-11-26T07:20:16.999816+0000","last_unstale":"2023-11-26T07:20:17.962415+0000","last_undegraded":"2023-11-26T07:20:17.962415+0000","last_fullsized":"2023-11-26T07:20:17.962415+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:44:29.008766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392316+0000","last_change":"2023-11-26T07:20:15.978946+0000","last_active":"2023-11-26T07:20:18.392316+0000","last_peered":"2023-11-26T07:20:18.392316+0000","last_clean":"2023-11-26T07:20:18.392316+0000","last_became_active":"2023-11-26T07:20:15.978457+0000","last_became_peered":"2023-11-26T07:20:15.978457+0000","last_unstale":"2023-11-26T07:20:18.392316+0000","last_undegraded":"2023-11-26T07:20:18.392316+0000","last_fullsized":"2023-11-26T07:20:18.392316+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:58:28.585604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312226+0000","last_change":"2023-11-26T07:20:16.978504+0000","last_active":"2023-11-26T07:20:18.312226+0000","last_peered":"2023-11-26T07:20:18.312226+0000","last_clean":"2023-11-26T07:20:18.312226+0000","last_became_active":"2023-11-26T07:20:16.977917+0000","last_became_peered":"2023-11-26T07:20:16.977917+0000","last_unstale":"2023-11-26T07:20:18.312226+0000","last_undegraded":"2023-11-26T07:20:18.312226+0000","last_fullsized":"2023-11-26T07:20:18.312226+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:58.945156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391261+0000","last_change":"2023-11-26T07:20:15.977919+0000","last_active":"2023-11-26T07:20:18.391261+0000","last_peered":"2023-11-26T07:20:18.391261+0000","last_clean":"2023-11-26T07:20:18.391261+0000","last_became_active":"2023-11-26T07:20:15.975595+0000","last_became_peered":"2023-11-26T07:20:15.975595+0000","last_unstale":"2023-11-26T07:20:18.391261+0000","last_undegraded":"2023-11-26T07:20:18.391261+0000","last_fullsized":"2023-11-26T07:20:18.391261+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:25:35.111793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312202+0000","last_change":"2023-11-26T07:20:17.005537+0000","last_active":"2023-11-26T07:20:18.312202+0000","last_peered":"2023-11-26T07:20:18.312202+0000","last_clean":"2023-11-26T07:20:18.312202+0000","last_became_active":"2023-11-26T07:20:17.005104+0000","last_became_peered":"2023-11-26T07:20:17.005104+0000","last_unstale":"2023-11-26T07:20:18.312202+0000","last_undegraded":"2023-11-26T07:20:18.312202+0000","last_fullsized":"2023-11-26T07:20:18.312202+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:28:52.694125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962096+0000","last_change":"2023-11-26T07:20:15.982857+0000","last_active":"2023-11-26T07:20:17.962096+0000","last_peered":"2023-11-26T07:20:17.962096+0000","last_clean":"2023-11-26T07:20:17.962096+0000","last_became_active":"2023-11-26T07:20:15.982465+0000","last_became_peered":"2023-11-26T07:20:15.982465+0000","last_unstale":"2023-11-26T07:20:17.962096+0000","last_undegraded":"2023-11-26T07:20:17.962096+0000","last_fullsized":"2023-11-26T07:20:17.962096+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:03.816661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961076+0000","last_change":"2023-11-26T07:20:16.991172+0000","last_active":"2023-11-26T07:20:17.961076+0000","last_peered":"2023-11-26T07:20:17.961076+0000","last_clean":"2023-11-26T07:20:17.961076+0000","last_became_active":"2023-11-26T07:20:16.990893+0000","last_became_peered":"2023-11-26T07:20:16.990893+0000","last_unstale":"2023-11-26T07:20:17.961076+0000","last_undegraded":"2023-11-26T07:20:17.961076+0000","last_fullsized":"2023-11-26T07:20:17.961076+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:16.296693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961939+0000","last_change":"2023-11-26T07:20:15.981588+0000","last_active":"2023-11-26T07:20:17.961939+0000","last_peered":"2023-11-26T07:20:17.961939+0000","last_clean":"2023-11-26T07:20:17.961939+0000","last_became_active":"2023-11-26T07:20:15.981141+0000","last_became_peered":"2023-11-26T07:20:15.981141+0000","last_unstale":"2023-11-26T07:20:17.961939+0000","last_undegraded":"2023-11-26T07:20:17.961939+0000","last_fullsized":"2023-11-26T07:20:17.961939+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:35:48.572384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.307503+0000","last_change":"2023-11-26T07:20:16.995410+0000","last_active":"2023-11-26T07:20:18.307503+0000","last_peered":"2023-11-26T07:20:18.307503+0000","last_clean":"2023-11-26T07:20:18.307503+0000","last_became_active":"2023-11-26T07:20:16.995037+0000","last_became_peered":"2023-11-26T07:20:16.995037+0000","last_unstale":"2023-11-26T07:20:18.307503+0000","last_undegraded":"2023-11-26T07:20:18.307503+0000","last_fullsized":"2023-11-26T07:20:18.307503+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:55.080962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392346+0000","last_change":"2023-11-26T07:20:15.975979+0000","last_active":"2023-11-26T07:20:18.392346+0000","last_peered":"2023-11-26T07:20:18.392346+0000","last_clean":"2023-11-26T07:20:18.392346+0000","last_became_active":"2023-11-26T07:20:15.975699+0000","last_became_peered":"2023-11-26T07:20:15.975699+0000","last_unstale":"2023-11-26T07:20:18.392346+0000","last_undegraded":"2023-11-26T07:20:18.392346+0000","last_fullsized":"2023-11-26T07:20:18.392346+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:03:13.831363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390116+0000","last_change":"2023-11-26T07:20:16.988654+0000","last_active":"2023-11-26T07:20:18.390116+0000","last_peered":"2023-11-26T07:20:18.390116+0000","last_clean":"2023-11-26T07:20:18.390116+0000","last_became_active":"2023-11-26T07:20:16.987853+0000","last_became_peered":"2023-11-26T07:20:16.987853+0000","last_unstale":"2023-11-26T07:20:18.390116+0000","last_undegraded":"2023-11-26T07:20:18.390116+0000","last_fullsized":"2023-11-26T07:20:18.390116+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:03:50.682485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960804+0000","last_change":"2023-11-26T07:20:15.983378+0000","last_active":"2023-11-26T07:20:17.960804+0000","last_peered":"2023-11-26T07:20:17.960804+0000","last_clean":"2023-11-26T07:20:17.960804+0000","last_became_active":"2023-11-26T07:20:15.983169+0000","last_became_peered":"2023-11-26T07:20:15.983169+0000","last_unstale":"2023-11-26T07:20:17.960804+0000","last_undegraded":"2023-11-26T07:20:17.960804+0000","last_fullsized":"2023-11-26T07:20:17.960804+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:17:23.621241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960681+0000","last_change":"2023-11-26T07:20:17.004759+0000","last_active":"2023-11-26T07:20:17.960681+0000","last_peered":"2023-11-26T07:20:17.960681+0000","last_clean":"2023-11-26T07:20:17.960681+0000","last_became_active":"2023-11-26T07:20:17.004473+0000","last_became_peered":"2023-11-26T07:20:17.004473+0000","last_unstale":"2023-11-26T07:20:17.960681+0000","last_undegraded":"2023-11-26T07:20:17.960681+0000","last_fullsized":"2023-11-26T07:20:17.960681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:40:21.764188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961905+0000","last_change":"2023-11-26T07:20:15.983542+0000","last_active":"2023-11-26T07:20:17.961905+0000","last_peered":"2023-11-26T07:20:17.961905+0000","last_clean":"2023-11-26T07:20:17.961905+0000","last_became_active":"2023-11-26T07:20:15.983268+0000","last_became_peered":"2023-11-26T07:20:15.983268+0000","last_unstale":"2023-11-26T07:20:17.961905+0000","last_undegraded":"2023-11-26T07:20:17.961905+0000","last_fullsized":"2023-11-26T07:20:17.961905+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:57.550844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312870+0000","last_change":"2023-11-26T07:20:16.989074+0000","last_active":"2023-11-26T07:20:18.312870+0000","last_peered":"2023-11-26T07:20:18.312870+0000","last_clean":"2023-11-26T07:20:18.312870+0000","last_became_active":"2023-11-26T07:20:16.988468+0000","last_became_peered":"2023-11-26T07:20:16.988468+0000","last_unstale":"2023-11-26T07:20:18.312870+0000","last_undegraded":"2023-11-26T07:20:18.312870+0000","last_fullsized":"2023-11-26T07:20:18.312870+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:39.283516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962804+0000","last_change":"2023-11-26T07:20:15.981967+0000","last_active":"2023-11-26T07:20:17.962804+0000","last_peered":"2023-11-26T07:20:17.962804+0000","last_clean":"2023-11-26T07:20:17.962804+0000","last_became_active":"2023-11-26T07:20:15.981776+0000","last_became_peered":"2023-11-26T07:20:15.981776+0000","last_unstale":"2023-11-26T07:20:17.962804+0000","last_undegraded":"2023-11-26T07:20:17.962804+0000","last_fullsized":"2023-11-26T07:20:17.962804+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:52:57.147184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962611+0000","last_change":"2023-11-26T07:20:16.998796+0000","last_active":"2023-11-26T07:20:17.962611+0000","last_peered":"2023-11-26T07:20:17.962611+0000","last_clean":"2023-11-26T07:20:17.962611+0000","last_became_active":"2023-11-26T07:20:16.998525+0000","last_became_peered":"2023-11-26T07:20:16.998525+0000","last_unstale":"2023-11-26T07:20:17.962611+0000","last_undegraded":"2023-11-26T07:20:17.962611+0000","last_fullsized":"2023-11-26T07:20:17.962611+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:37.708106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963401+0000","last_change":"2023-11-26T07:20:15.993182+0000","last_active":"2023-11-26T07:20:17.963401+0000","last_peered":"2023-11-26T07:20:17.963401+0000","last_clean":"2023-11-26T07:20:17.963401+0000","last_became_active":"2023-11-26T07:20:15.992900+0000","last_became_peered":"2023-11-26T07:20:15.992900+0000","last_unstale":"2023-11-26T07:20:17.963401+0000","last_undegraded":"2023-11-26T07:20:17.963401+0000","last_fullsized":"2023-11-26T07:20:17.963401+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:25:35.111793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963200+0000","last_change":"2023-11-26T07:20:16.994381+0000","last_active":"2023-11-26T07:20:17.963200+0000","last_peered":"2023-11-26T07:20:17.963200+0000","last_clean":"2023-11-26T07:20:17.963200+0000","last_became_active":"2023-11-26T07:20:16.993643+0000","last_became_peered":"2023-11-26T07:20:16.993643+0000","last_unstale":"2023-11-26T07:20:17.963200+0000","last_undegraded":"2023-11-26T07:20:17.963200+0000","last_fullsized":"2023-11-26T07:20:17.963200+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:27:12.829229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.307238+0000","last_change":"2023-11-26T07:20:15.977133+0000","last_active":"2023-11-26T07:20:18.307238+0000","last_peered":"2023-11-26T07:20:18.307238+0000","last_clean":"2023-11-26T07:20:18.307238+0000","last_became_active":"2023-11-26T07:20:15.976852+0000","last_became_peered":"2023-11-26T07:20:15.976852+0000","last_unstale":"2023-11-26T07:20:18.307238+0000","last_undegraded":"2023-11-26T07:20:18.307238+0000","last_fullsized":"2023-11-26T07:20:18.307238+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:38.268982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961424+0000","last_change":"2023-11-26T07:20:16.997620+0000","last_active":"2023-11-26T07:20:17.961424+0000","last_peered":"2023-11-26T07:20:17.961424+0000","last_clean":"2023-11-26T07:20:17.961424+0000","last_became_active":"2023-11-26T07:20:16.993834+0000","last_became_peered":"2023-11-26T07:20:16.993834+0000","last_unstale":"2023-11-26T07:20:17.961424+0000","last_undegraded":"2023-11-26T07:20:17.961424+0000","last_fullsized":"2023-11-26T07:20:17.961424+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:51:01.549831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963287+0000","last_change":"2023-11-26T07:20:15.993054+0000","last_active":"2023-11-26T07:20:17.963287+0000","last_peered":"2023-11-26T07:20:17.963287+0000","last_clean":"2023-11-26T07:20:17.963287+0000","last_became_active":"2023-11-26T07:20:15.992773+0000","last_became_peered":"2023-11-26T07:20:15.992773+0000","last_unstale":"2023-11-26T07:20:17.963287+0000","last_undegraded":"2023-11-26T07:20:17.963287+0000","last_fullsized":"2023-11-26T07:20:17.963287+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:44:27.994232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961095+0000","last_change":"2023-11-26T07:20:16.991822+0000","last_active":"2023-11-26T07:20:17.961095+0000","last_peered":"2023-11-26T07:20:17.961095+0000","last_clean":"2023-11-26T07:20:17.961095+0000","last_became_active":"2023-11-26T07:20:16.991564+0000","last_became_peered":"2023-11-26T07:20:16.991564+0000","last_unstale":"2023-11-26T07:20:17.961095+0000","last_undegraded":"2023-11-26T07:20:17.961095+0000","last_fullsized":"2023-11-26T07:20:17.961095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:56:37.081269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392051+0000","last_change":"2023-11-26T07:20:15.983504+0000","last_active":"2023-11-26T07:20:18.392051+0000","last_peered":"2023-11-26T07:20:18.392051+0000","last_clean":"2023-11-26T07:20:18.392051+0000","last_became_active":"2023-11-26T07:20:15.983211+0000","last_became_peered":"2023-11-26T07:20:15.983211+0000","last_unstale":"2023-11-26T07:20:18.392051+0000","last_undegraded":"2023-11-26T07:20:18.392051+0000","last_fullsized":"2023-11-26T07:20:18.392051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:45:04.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390290+0000","last_change":"2023-11-26T07:20:16.996511+0000","last_active":"2023-11-26T07:20:18.390290+0000","last_peered":"2023-11-26T07:20:18.390290+0000","last_clean":"2023-11-26T07:20:18.390290+0000","last_became_active":"2023-11-26T07:20:16.996240+0000","last_became_peered":"2023-11-26T07:20:16.996240+0000","last_unstale":"2023-11-26T07:20:18.390290+0000","last_undegraded":"2023-11-26T07:20:18.390290+0000","last_fullsized":"2023-11-26T07:20:18.390290+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:53:44.848707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.307613+0000","last_change":"2023-11-26T07:20:15.977663+0000","last_active":"2023-11-26T07:20:18.307613+0000","last_peered":"2023-11-26T07:20:18.307613+0000","last_clean":"2023-11-26T07:20:18.307613+0000","last_became_active":"2023-11-26T07:20:15.977360+0000","last_became_peered":"2023-11-26T07:20:15.977360+0000","last_unstale":"2023-11-26T07:20:18.307613+0000","last_undegraded":"2023-11-26T07:20:18.307613+0000","last_fullsized":"2023-11-26T07:20:18.307613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:17:01.680711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391052+0000","last_change":"2023-11-26T07:20:16.993550+0000","last_active":"2023-11-26T07:20:18.391052+0000","last_peered":"2023-11-26T07:20:18.391052+0000","last_clean":"2023-11-26T07:20:18.391052+0000","last_became_active":"2023-11-26T07:20:16.992053+0000","last_became_peered":"2023-11-26T07:20:16.992053+0000","last_unstale":"2023-11-26T07:20:18.391052+0000","last_undegraded":"2023-11-26T07:20:18.391052+0000","last_fullsized":"2023-11-26T07:20:18.391052+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:31:16.099652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960635+0000","last_change":"2023-11-26T07:20:15.978284+0000","last_active":"2023-11-26T07:20:17.960635+0000","last_peered":"2023-11-26T07:20:17.960635+0000","last_clean":"2023-11-26T07:20:17.960635+0000","last_became_active":"2023-11-26T07:20:15.974502+0000","last_became_peered":"2023-11-26T07:20:15.974502+0000","last_unstale":"2023-11-26T07:20:17.960635+0000","last_undegraded":"2023-11-26T07:20:17.960635+0000","last_fullsized":"2023-11-26T07:20:17.960635+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:31:15.085118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961858+0000","last_change":"2023-11-26T07:20:16.995356+0000","last_active":"2023-11-26T07:20:17.961858+0000","last_peered":"2023-11-26T07:20:17.961858+0000","last_clean":"2023-11-26T07:20:17.961858+0000","last_became_active":"2023-11-26T07:20:16.994936+0000","last_became_peered":"2023-11-26T07:20:16.994936+0000","last_unstale":"2023-11-26T07:20:17.961858+0000","last_undegraded":"2023-11-26T07:20:17.961858+0000","last_fullsized":"2023-11-26T07:20:17.961858+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:03:14.845898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391814+0000","last_change":"2023-11-26T07:20:15.974989+0000","last_active":"2023-11-26T07:20:18.391814+0000","last_peered":"2023-11-26T07:20:18.391814+0000","last_clean":"2023-11-26T07:20:18.391814+0000","last_became_active":"2023-11-26T07:20:15.974518+0000","last_became_peered":"2023-11-26T07:20:15.974518+0000","last_unstale":"2023-11-26T07:20:18.391814+0000","last_undegraded":"2023-11-26T07:20:18.391814+0000","last_fullsized":"2023-11-26T07:20:18.391814+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:44:27.994232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-26T07:20:16.977257+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:20:16.977257+0000","last_peered":"2023-11-26T07:20:16.977257+0000","last_clean":"2023-11-26T07:20:16.977257+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:20:16.977257+0000","last_undegraded":"2023-11-26T07:20:16.977257+0000","last_fullsized":"2023-11-26T07:20:16.977257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1150976,"data_stored":817898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.052,"15min":1.034},"min":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0629999999999999,"15min":1.0649999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.627}]},{"osd":1,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.048,"15min":1.046},"min":{"1min":0.77000000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2310000000000001,"15min":1.2290000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.7509999999999999,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.90700000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.181,"15min":1.1619999999999999},"min":{"1min":1.0149999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.7230000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.292,"15min":1.302},"min":{"1min":0.76700000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.6899999999999999,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.79300000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.234,"15min":1.242},"min":{"1min":0.79900000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.694,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.373,"15min":1.369},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.8280000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.0720000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3720000000000001,"15min":1.3660000000000001},"min":{"1min":1.024,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.992,"5min":2.774,"15min":2.774},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.522,"5min":1.4770000000000001,"15min":1.4690000000000001},"min":{"1min":1.161,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.907,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.151}]},{"osd":5,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.51,"15min":1.508},"min":{"1min":1.0740000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.97,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.014},{"interface":"front","average":{"1min":1.5,"5min":1.49,"15min":1.488},"min":{"1min":1.042,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.9530000000000001,"5min":2.149,"15min":2.149},"last":1.1060000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6299999999999999,"5min":1.6819999999999999,"15min":1.6910000000000001},"min":{"1min":1.2869999999999999,"5min":0.75,"15min":0.75},"max":{"1min":2.0619999999999998,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.661,"15min":1.655},"min":{"1min":1.3520000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.1349999999999998,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.1930000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":228112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1180000000000001,"15min":1.1220000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4810000000000001,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":1.022},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.2410000000000001,"15min":1.2789999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.464,"5min":3.169,"15min":3.169},"last":1.1439999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1919999999999999,"15min":1.1879999999999999},"min":{"1min":0.80300000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4670000000000001,"5min":1.929,"15min":1.929},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.097,"5min":1.1160000000000001,"15min":1.119},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5329999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.96999999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1120000000000001,"15min":1.1180000000000001},"min":{"1min":0.77400000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.276},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3640000000000001,"15min":1.3879999999999999},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.591,"5min":3.1110000000000002,"15min":3.1110000000000002},"last":1.343}]},{"osd":3,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2629999999999999,"15min":1.266},"min":{"1min":0.92700000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.663,"5min":1.669,"15min":1.669},"last":1.514},{"interface":"front","average":{"1min":1.159,"5min":1.24,"15min":1.254},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.4990000000000001,"5min":1.712,"15min":1.712},"last":1.5640000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.361,"15min":1.367},"min":{"1min":0.93400000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6120000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.196},{"interface":"front","average":{"1min":1.284,"5min":1.3500000000000001,"15min":1.361},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.708,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.3919999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3899999999999999,"15min":1.403},"min":{"1min":0.86199999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.554,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.647},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.516,"15min":1.53},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.714,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.45}]},{"osd":7,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.5229999999999999,"15min":1.538},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.843,"5min":2.004,"15min":2.004},"last":1.758},{"interface":"front","average":{"1min":1.448,"5min":1.5469999999999999,"15min":1.5629999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.744,"5min":1.901,"15min":1.901},"last":1.8220000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":221210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.036,"15min":1.018},"min":{"1min":0.68100000000000005,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.288},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0189999999999999,"15min":1.002},"min":{"1min":0.72799999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.3260000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0589999999999999,"15min":1.052},"min":{"1min":0.72599999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.1639999999999999,"15min":1.1659999999999999},"min":{"1min":0.69899999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.577,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.4139999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4810000000000001,"5min":1.694,"15min":1.694},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2889999999999999,"15min":1.3},"min":{"1min":0.84399999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.585,"5min":1.988,"15min":1.988},"last":1.4590000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2929999999999999,"15min":1.3069999999999999},"min":{"1min":0.81499999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5229999999999999,"5min":1.992,"15min":1.992},"last":1.155},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1839999999999999,"15min":1.1899999999999999},"min":{"1min":0.86599999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4950000000000001,"5min":1.605,"15min":1.605},"last":1.5149999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4690000000000001,"15min":1.4730000000000001},"min":{"1min":1.1870000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.74,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.617},{"interface":"front","average":{"1min":1.379,"5min":1.456,"15min":1.4690000000000001},"min":{"1min":1.0329999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.9139999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.97499999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.544,"15min":1.5529999999999999},"min":{"1min":1.0149999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.0030000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.095},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.448,"15min":1.4630000000000001},"min":{"1min":0.998,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.91600000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.5940000000000001,"15min":1.6100000000000001},"min":{"1min":1.0600000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.827,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.573},{"interface":"front","average":{"1min":1.526,"5min":1.5980000000000001,"15min":1.6100000000000001},"min":{"1min":1.093,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.365}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":552960,"data_stored":222752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.1319999999999999,"15min":1.1499999999999999},"min":{"1min":0.73099999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.5029999999999999,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.012},{"interface":"front","average":{"1min":1.135,"5min":1.0229999999999999,"15min":1.004},"min":{"1min":0.79400000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4690000000000001,"5min":1.643,"15min":1.643},"last":1.3360000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1659999999999999,"15min":1.173},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5049999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.262},{"interface":"front","average":{"1min":1.22,"5min":1.236,"15min":1.238},"min":{"1min":0.749,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.6839999999999999,"5min":1.766,"15min":1.766},"last":1.4259999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2789999999999999,"15min":1.2909999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.486,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.514},{"interface":"front","average":{"1min":1.238,"5min":1.2889999999999999,"15min":1.2969999999999999},"min":{"1min":0.88300000000000001,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.7270000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.147}]},{"osd":3,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.325,"15min":1.3240000000000001},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.7310000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.304},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.339,"15min":1.349},"min":{"1min":0.93999999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.663,"5min":1.73,"15min":1.73},"last":1.4650000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.367,"15min":1.3660000000000001},"min":{"1min":0.99399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.8700000000000001,"5min":1.909,"15min":1.909},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.504,"15min":1.512},"min":{"1min":0.99099999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8680000000000001,"5min":2.899,"15min":2.899},"last":1.383}]},{"osd":6,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.506,"15min":1.5129999999999999},"min":{"1min":0.92000000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.891,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.6419999999999999,"15min":1.6499999999999999},"min":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"max":{"1min":1.9299999999999999,"5min":3.008,"15min":3.008},"last":1.6240000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.7470000000000001,"15min":1.7649999999999999},"min":{"1min":1.2410000000000001,"5min":1.214,"15min":1.214},"max":{"1min":1.994,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.718,"15min":1.7230000000000001},"min":{"1min":1.3009999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":2.3260000000000001,"5min":3.085,"15min":3.085},"last":1.861}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":221778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.84899999999999998,"15min":0.86899999999999999},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.121,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.6499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.51400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.323,"5min":1.764,"15min":1.764},"last":1.506}]},{"osd":1,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.83599999999999997,"15min":0.85699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.508,"5min":1.784,"15min":1.784},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.165,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.2450000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.0549999999999999,"15min":1.0820000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5089999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.095,"15min":1.119},"min":{"1min":0.53600000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.494,"5min":2.379,"15min":2.379},"last":1.3879999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.131,"15min":1.137},"min":{"1min":0.76500000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.49,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.329,"15min":1.365},"min":{"1min":0.80200000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.468,"5min":2.859,"15min":2.859},"last":1.3340000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.3400000000000001,"15min":1.3740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5409999999999999,"5min":2.504,"15min":2.504},"last":1.141},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.244,"15min":1.2609999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.631,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.288}]},{"osd":6,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.419,"15min":1.4630000000000001},"min":{"1min":0.80400000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.415,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.4139999999999999,"15min":1.4530000000000001},"min":{"1min":0.78600000000000003,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.5680000000000001,"5min":3.226,"15min":3.226},"last":1.5349999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.27,"15min":1.2929999999999999},"min":{"1min":0.82899999999999996,"5min":0.75,"15min":0.75},"max":{"1min":1.4299999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.484,"15min":1.524},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.706,"5min":3.956,"15min":3.956},"last":1.474}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":229074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.484,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.91600000000000004,"5min":1.0760000000000001,"15min":1.1020000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0459999999999998,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.244}]},{"osd":1,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.96199999999999997,"15min":0.99399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.044,"5min":1.645,"15min":1.645},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.03,"15min":1.052},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.585,"5min":1.901,"15min":1.901},"last":1.0960000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.0649999999999999,"15min":1.091},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.2240000000000002,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":1.046},{"interface":"front","average":{"1min":1.028,"5min":1.2330000000000001,"15min":1.2669999999999999},"min":{"1min":0.63500000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.8939999999999999,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.4590000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.266,"15min":1.29},"min":{"1min":0.82799999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.4430000000000001,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.29},{"interface":"front","average":{"1min":1.171,"5min":1.288,"15min":1.3080000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7150000000000001,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.3779999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.2450000000000001,"15min":1.2629999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.649,"5min":1.901,"15min":1.901},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.387,"15min":1.415},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.77,"5min":2.395,"15min":2.395},"last":1.1950000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.452,"15min":1.472},"min":{"1min":1.0580000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.833,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.349,"15min":1.3580000000000001},"min":{"1min":0.92400000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.0750000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.329}]},{"osd":7,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4930000000000001,"15min":1.5149999999999999},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.1309999999999998,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.607},{"interface":"front","average":{"1min":1.393,"5min":1.4399999999999999,"15min":1.448},"min":{"1min":0.99399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1320000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.4890000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":227510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.441,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1160000000000001,"5min":1.498,"15min":1.498},"last":1.589},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.96399999999999997,"15min":0.97699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.393,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.1830000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.85999999999999999,"15min":0.872},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.218,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.002,"15min":1.0089999999999999},"min":{"1min":0.59699999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2450000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.0920000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0800000000000001,"15min":1.0840000000000001},"min":{"1min":0.67900000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.677,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.468},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0700000000000001,"15min":1.077},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.635,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.70899999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.246,"15min":1.254},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7,"5min":2.294,"15min":2.294},"last":1.28},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.2629999999999999,"15min":1.2769999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.73,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.413}]},{"osd":5,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3560000000000001,"15min":1.3879999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.6439999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3839999999999999,"15min":1.3879999999999999},"min":{"1min":0.83899999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8260000000000001,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.6870000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3879999999999999,"15min":1.401},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.788,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.359,"15min":1.373},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6020000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.325}]},{"osd":7,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3819999999999999,"15min":1.3839999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.748,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.77},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.514,"15min":1.5289999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.9630000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.548}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":817842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.746,"15min":0.755},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.026,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.878},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.86899999999999999,"15min":0.89500000000000002},"min":{"1min":0.46700000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.298,"5min":1.448,"15min":1.448},"last":0.81699999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.92500000000000004,"15min":0.95899999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.353,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.98899999999999999,"15min":1.02},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.4590000000000001,"5min":1.641,"15min":1.641},"last":1.4039999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.88500000000000001,"15min":0.91400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1899999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.88,"5min":1.1120000000000001,"15min":1.1499999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4039999999999999,"5min":2.137,"15min":2.137},"last":1.0720000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2789999999999999,"15min":1.296},"min":{"1min":0.77600000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.579,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.468},{"interface":"front","average":{"1min":1.091,"5min":1.2030000000000001,"15min":1.222},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.78,"5min":1.909,"15min":1.909},"last":1.3560000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.234,"15min":1.26},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.506,"5min":1.728,"15min":1.728},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.23,"5min":1.3600000000000001,"15min":1.3819999999999999},"min":{"1min":0.81499999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.698,"5min":2.202,"15min":2.202},"last":1.839}]},{"osd":6,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.381,"15min":1.405},"min":{"1min":0.77300000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.3320000000000001,"15min":1.367},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.992,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.1180000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.399,"15min":1.4350000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8959999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.2809999999999999,"15min":1.321},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6639999999999999,"5min":2.585,"15min":2.585},"last":1.486}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:20:21.401 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:20:21.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.640+0000 7f892c8bb640 1 Processor -- start 2023-11-26T07:20:21.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.640+0000 7f892c8bb640 1 -- start start 2023-11-26T07:20:21.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.641+0000 7f892c8bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89280cc150 0x7f8928164af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.641+0000 7f892c8bb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89280b3a40 con 0x7f8928159ce0 2023-11-26T07:20:21.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.641+0000 7f892c8bb640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89280cdfa0 con 0x7f89280b21d0 2023-11-26T07:20:21.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.641+0000 7f892c8bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89280cd9e0 con 0x7f89280cc150 2023-11-26T07:20:21.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.641+0000 7f892659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8928159ce0 0x7f892806de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47526/0 (socket says 172.21.15.77:47526) 2023-11-26T07:20:21.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.641+0000 7f892659c640 1 -- 172.21.15.77:0/1131833421 learned_addr learned my addr 172.21.15.77:0/1131833421 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:21.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221165527 0 0) 0x7f89280b3a40 con 0x7f8928159ce0 2023-11-26T07:20:21.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8914003520 con 0x7f8928159ce0 2023-11-26T07:20:21.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8926d9d640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89280cc150 0x7f8928164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3070853761 0 0) 0x7f8914003520 con 0x7f8928159ce0 2023-11-26T07:20:21.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89280cc150 msgr2=0x7f8928164af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:21.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89280cc150 0x7f8928164af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 >> v1:172.21.15.159:6789/0 conn(0x7f89280b21d0 legacy=0x7f89280cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280cdcc0 con 0x7f8928159ce0 2023-11-26T07:20:21.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f8918001670 con 0x7f8928159ce0 2023-11-26T07:20:21.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 >> v1:172.21.15.77:6789/0 conn(0x7f8928159ce0 legacy=0x7f892806de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89140039a0 0x7f8914003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140047c0 0x7f8914004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89280cc150 0x7f8914005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280cd9e0 con 0x7f89140039a0 2023-11-26T07:20:21.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891400bb40 con 0x7f89140047c0 2023-11-26T07:20:21.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.642+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891400bd00 con 0x7f89280cc150 2023-11-26T07:20:21.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.643+0000 7f892659c640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89140039a0 0x7f8914003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.643+0000 7f891ffff640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140047c0 0x7f8914004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.643+0000 7f892659c640 1 -- 172.21.15.77:0/1131833421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89280cc150 msgr2=0x7f8914005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:21.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.643+0000 7f892659c640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89280cc150 0x7f8914005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.643+0000 7f892659c640 1 -- 172.21.15.77:0/1131833421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140047c0 msgr2=0x7f8914004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:21.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.643+0000 7f892659c640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140047c0 0x7f8914004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.643+0000 7f892659c640 1 -- 172.21.15.77:0/1131833421 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8914003520 con 0x7f89140039a0 2023-11-26T07:20:21.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.643+0000 7f891ffff640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140047c0 0x7f8914004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:21.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.644+0000 7f892659c640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89140039a0 0x7f8914003dc0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f891800c0e0 tx=0x7f89140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc14e4bf8f1d7c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:21.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.645+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918005ad0 con 0x7f89140039a0 2023-11-26T07:20:21.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.645+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8918005c30 con 0x7f89140039a0 2023-11-26T07:20:21.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.645+0000 7f8925d9b640 1 -- 172.21.15.77:0/1131833421 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891802c810 con 0x7f89140039a0 2023-11-26T07:20:21.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.645+0000 7f892c8bb640 1 -- 172.21.15.77:0/1131833421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89140039a0 msgr2=0x7f8914003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.645+0000 7f892c8bb640 1 --2- 172.21.15.77:0/1131833421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89140039a0 0x7f8914003dc0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f891800c0e0 tx=0x7f89140057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.645+0000 7f8926d9d640 1 -- 172.21.15.77:0/1131833421 reap_dead start 2023-11-26T07:20:21.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.645+0000 7f892c8bb640 1 -- 172.21.15.77:0/1131833421 shutdown_connections 2023-11-26T07:20:21.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.645+0000 7f892c8bb640 1 -- 172.21.15.77:0/1131833421 >> 172.21.15.77:0/1131833421 conn(0x7f892806a920 msgr2=0x7f892806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:21.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.645+0000 7f892c8bb640 1 -- 172.21.15.77:0/1131833421 shutdown_connections 2023-11-26T07:20:21.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.645+0000 7f892c8bb640 1 -- 172.21.15.77:0/1131833421 wait complete. 2023-11-26T07:20:21.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.647+0000 7f892c8bb640 1 Processor -- start 2023-11-26T07:20:21.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.647+0000 7f892c8bb640 1 -- start start 2023-11-26T07:20:21.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.648+0000 7f892c8bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140039a0 0x7f89281442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.648+0000 7f892c8bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8928140fa0 0x7f8928155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.648+0000 7f892c8bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928156420 0x7f89281f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.648+0000 7f892c8bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89281568a0 con 0x7f8928156420 2023-11-26T07:20:21.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.648+0000 7f892c8bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8928158200 con 0x7f89140039a0 2023-11-26T07:20:21.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.648+0000 7f892c8bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89281584e0 con 0x7f8928140fa0 2023-11-26T07:20:21.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.648+0000 7f8926d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928156420 0x7f89281f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.649+0000 7f8926d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928156420 0x7f89281f2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39482/0 (socket says 172.21.15.77:39482) 2023-11-26T07:20:21.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.649+0000 7f8926d9d640 1 -- 172.21.15.77:0/455652552 learned_addr learned my addr 172.21.15.77:0/455652552 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:21.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.649+0000 7f891ffff640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8928140fa0 0x7f8928155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.649+0000 7f8926d9d640 1 -- 172.21.15.77:0/455652552 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8928140fa0 msgr2=0x7f8928155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.649+0000 7f8926d9d640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8928140fa0 0x7f8928155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.649+0000 7f8926d9d640 1 -- 172.21.15.77:0/455652552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140039a0 msgr2=0x7f89281442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.649+0000 7f8926d9d640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140039a0 0x7f89281442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.649+0000 7f8926d9d640 1 -- 172.21.15.77:0/455652552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89281587c0 con 0x7f8928156420 2023-11-26T07:20:21.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.649+0000 7f8926d9d640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928156420 0x7f89281f2000 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8928072700 tx=0x7f892000d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:21.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.649+0000 7f891effd640 1 -- 172.21.15.77:0/455652552 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000f040 con 0x7f8928156420 2023-11-26T07:20:21.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.650+0000 7f891effd640 1 -- 172.21.15.77:0/455652552 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8920007e60 con 0x7f8928156420 2023-11-26T07:20:21.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.650+0000 7f891effd640 1 -- 172.21.15.77:0/455652552 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000ddb0 con 0x7f8928156420 2023-11-26T07:20:21.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.650+0000 7f892c8bb640 1 -- 172.21.15.77:0/455652552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8928158aa0 con 0x7f8928156420 2023-11-26T07:20:21.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.650+0000 7f892c8bb640 1 -- 172.21.15.77:0/455652552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8928144820 con 0x7f8928156420 2023-11-26T07:20:21.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.651+0000 7f892c8bb640 1 -- 172.21.15.77:0/455652552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8928158fc0 con 0x7f8928156420 2023-11-26T07:20:21.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.652+0000 7f891effd640 1 -- 172.21.15.77:0/455652552 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f8920003990 con 0x7f8928156420 2023-11-26T07:20:21.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.653+0000 7f891effd640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b140 0x7f890806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.653+0000 7f891effd640 1 -- 172.21.15.77:0/455652552 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89200897d0 con 0x7f8928156420 2023-11-26T07:20:21.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.653+0000 7f892659c640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b140 0x7f890806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.654+0000 7f892659c640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b140 0x7f890806d600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8918034000 tx=0x7f8918007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:21.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.657+0000 7f891effd640 1 -- 172.21.15.77:0/455652552 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8928158fc0 con 0x7f8928156420 2023-11-26T07:20:21.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.844+0000 7f892c8bb640 1 -- 172.21.15.77:0/455652552 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89280b3f50 con 0x7f890806b140 2023-11-26T07:20:21.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.853+0000 7f891effd640 1 -- 172.21.15.77:0/455652552 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286547 (secure 0 0 0) 0x7f8918001430 con 0x7f890806b140 2023-11-26T07:20:21.860 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:21.861 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:20:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.858+0000 7f892c8bb640 1 -- 172.21.15.77:0/455652552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b140 msgr2=0x7f890806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.858+0000 7f892c8bb640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b140 0x7f890806d600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8918034000 tx=0x7f8918007000 comp rx=0 tx=0).stop 2023-11-26T07:20:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.858+0000 7f892c8bb640 1 -- 172.21.15.77:0/455652552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928156420 msgr2=0x7f89281f2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.858+0000 7f892c8bb640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928156420 0x7f89281f2000 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8928072700 tx=0x7f892000d490 comp rx=0 tx=0).stop 2023-11-26T07:20:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.859+0000 7f892c8bb640 1 -- 172.21.15.77:0/455652552 shutdown_connections 2023-11-26T07:20:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.859+0000 7f892c8bb640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b140 0x7f890806d600 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.859+0000 7f892c8bb640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928156420 0x7f89281f2000 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.859+0000 7f892c8bb640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8928140fa0 0x7f8928155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.859+0000 7f892c8bb640 1 --2- 172.21.15.77:0/455652552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140039a0 0x7f89281442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.859+0000 7f892c8bb640 1 -- 172.21.15.77:0/455652552 >> 172.21.15.77:0/455652552 conn(0x7f892806a920 msgr2=0x7f8928155650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.859+0000 7f892c8bb640 1 -- 172.21.15.77:0/455652552 shutdown_connections 2023-11-26T07:20:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:21.859+0000 7f892c8bb640 1 -- 172.21.15.77:0/455652552 wait complete. 2023-11-26T07:20:21.878 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-11-26T07:20:21.655916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234172,"kb_used_data":5508,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740548,"statfs":{"total":773094113280,"available":772854321152,"internally_reserved":0,"allocated":5640192,"data_stored":2986176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002002"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963624+0000","last_change":"2023-11-26T07:20:16.990779+0000","last_active":"2023-11-26T07:20:17.963624+0000","last_peered":"2023-11-26T07:20:17.963624+0000","last_clean":"2023-11-26T07:20:17.963624+0000","last_became_active":"2023-11-26T07:20:16.986755+0000","last_became_peered":"2023-11-26T07:20:16.986755+0000","last_unstale":"2023-11-26T07:20:17.963624+0000","last_undegraded":"2023-11-26T07:20:17.963624+0000","last_fullsized":"2023-11-26T07:20:17.963624+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:14:21.822454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391656+0000","last_change":"2023-11-26T07:20:16.994996+0000","last_active":"2023-11-26T07:20:18.391656+0000","last_peered":"2023-11-26T07:20:18.391656+0000","last_clean":"2023-11-26T07:20:18.391656+0000","last_became_active":"2023-11-26T07:20:16.994849+0000","last_became_peered":"2023-11-26T07:20:16.994849+0000","last_unstale":"2023-11-26T07:20:18.391656+0000","last_undegraded":"2023-11-26T07:20:18.391656+0000","last_fullsized":"2023-11-26T07:20:18.391656+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:58.565378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391052+0000","last_change":"2023-11-26T07:20:16.999352+0000","last_active":"2023-11-26T07:20:18.391052+0000","last_peered":"2023-11-26T07:20:18.391052+0000","last_clean":"2023-11-26T07:20:18.391052+0000","last_became_active":"2023-11-26T07:20:16.998933+0000","last_became_peered":"2023-11-26T07:20:16.998933+0000","last_unstale":"2023-11-26T07:20:18.391052+0000","last_undegraded":"2023-11-26T07:20:18.391052+0000","last_fullsized":"2023-11-26T07:20:18.391052+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:55.080962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962520+0000","last_change":"2023-11-26T07:20:16.993993+0000","last_active":"2023-11-26T07:20:17.962520+0000","last_peered":"2023-11-26T07:20:17.962520+0000","last_clean":"2023-11-26T07:20:17.962520+0000","last_became_active":"2023-11-26T07:20:16.993657+0000","last_became_peered":"2023-11-26T07:20:16.993657+0000","last_unstale":"2023-11-26T07:20:17.962520+0000","last_undegraded":"2023-11-26T07:20:17.962520+0000","last_fullsized":"2023-11-26T07:20:17.962520+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:53:44.848707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392668+0000","last_change":"2023-11-26T07:20:16.995349+0000","last_active":"2023-11-26T07:20:18.392668+0000","last_peered":"2023-11-26T07:20:18.392668+0000","last_clean":"2023-11-26T07:20:18.392668+0000","last_became_active":"2023-11-26T07:20:16.993334+0000","last_became_peered":"2023-11-26T07:20:16.993334+0000","last_unstale":"2023-11-26T07:20:18.392668+0000","last_undegraded":"2023-11-26T07:20:18.392668+0000","last_fullsized":"2023-11-26T07:20:18.392668+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:52:58.161718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960709+0000","last_change":"2023-11-26T07:20:16.983731+0000","last_active":"2023-11-26T07:20:17.960709+0000","last_peered":"2023-11-26T07:20:17.960709+0000","last_clean":"2023-11-26T07:20:17.960709+0000","last_became_active":"2023-11-26T07:20:16.980935+0000","last_became_peered":"2023-11-26T07:20:16.980935+0000","last_unstale":"2023-11-26T07:20:17.960709+0000","last_undegraded":"2023-11-26T07:20:17.960709+0000","last_fullsized":"2023-11-26T07:20:17.960709+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:31:47.980430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962499+0000","last_change":"2023-11-26T07:20:16.994843+0000","last_active":"2023-11-26T07:20:17.962499+0000","last_peered":"2023-11-26T07:20:17.962499+0000","last_clean":"2023-11-26T07:20:17.962499+0000","last_became_active":"2023-11-26T07:20:16.994034+0000","last_became_peered":"2023-11-26T07:20:16.994034+0000","last_unstale":"2023-11-26T07:20:17.962499+0000","last_undegraded":"2023-11-26T07:20:17.962499+0000","last_fullsized":"2023-11-26T07:20:17.962499+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:56:49.545401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960138+0000","last_change":"2023-11-26T07:20:16.997894+0000","last_active":"2023-11-26T07:20:17.960138+0000","last_peered":"2023-11-26T07:20:17.960138+0000","last_clean":"2023-11-26T07:20:17.960138+0000","last_became_active":"2023-11-26T07:20:16.996259+0000","last_became_peered":"2023-11-26T07:20:16.996259+0000","last_unstale":"2023-11-26T07:20:17.960138+0000","last_undegraded":"2023-11-26T07:20:17.960138+0000","last_fullsized":"2023-11-26T07:20:17.960138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:55.080962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962038+0000","last_change":"2023-11-26T07:20:17.005263+0000","last_active":"2023-11-26T07:20:17.962038+0000","last_peered":"2023-11-26T07:20:17.962038+0000","last_clean":"2023-11-26T07:20:17.962038+0000","last_became_active":"2023-11-26T07:20:17.005011+0000","last_became_peered":"2023-11-26T07:20:17.005011+0000","last_unstale":"2023-11-26T07:20:17.962038+0000","last_undegraded":"2023-11-26T07:20:17.962038+0000","last_fullsized":"2023-11-26T07:20:17.962038+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:25:36.126327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961733+0000","last_change":"2023-11-26T07:20:16.995183+0000","last_active":"2023-11-26T07:20:17.961733+0000","last_peered":"2023-11-26T07:20:17.961733+0000","last_clean":"2023-11-26T07:20:17.961733+0000","last_became_active":"2023-11-26T07:20:16.994591+0000","last_became_peered":"2023-11-26T07:20:16.994591+0000","last_unstale":"2023-11-26T07:20:17.961733+0000","last_undegraded":"2023-11-26T07:20:17.961733+0000","last_fullsized":"2023-11-26T07:20:17.961733+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:24:35.846137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961425+0000","last_change":"2023-11-26T07:20:16.996278+0000","last_active":"2023-11-26T07:20:17.961425+0000","last_peered":"2023-11-26T07:20:17.961425+0000","last_clean":"2023-11-26T07:20:17.961425+0000","last_became_active":"2023-11-26T07:20:16.995979+0000","last_became_peered":"2023-11-26T07:20:16.995979+0000","last_unstale":"2023-11-26T07:20:17.961425+0000","last_undegraded":"2023-11-26T07:20:17.961425+0000","last_fullsized":"2023-11-26T07:20:17.961425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:40:30.261602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391322+0000","last_change":"2023-11-26T07:20:16.983256+0000","last_active":"2023-11-26T07:20:18.391322+0000","last_peered":"2023-11-26T07:20:18.391322+0000","last_clean":"2023-11-26T07:20:18.391322+0000","last_became_active":"2023-11-26T07:20:16.982958+0000","last_became_peered":"2023-11-26T07:20:16.982958+0000","last_unstale":"2023-11-26T07:20:18.391322+0000","last_undegraded":"2023-11-26T07:20:18.391322+0000","last_fullsized":"2023-11-26T07:20:18.391322+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:37.708106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390190+0000","last_change":"2023-11-26T07:20:16.981723+0000","last_active":"2023-11-26T07:20:18.390190+0000","last_peered":"2023-11-26T07:20:18.390190+0000","last_clean":"2023-11-26T07:20:18.390190+0000","last_became_active":"2023-11-26T07:20:16.981460+0000","last_became_peered":"2023-11-26T07:20:16.981460+0000","last_unstale":"2023-11-26T07:20:18.390190+0000","last_undegraded":"2023-11-26T07:20:18.390190+0000","last_fullsized":"2023-11-26T07:20:18.390190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:01:30.099284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961203+0000","last_change":"2023-11-26T07:20:17.004463+0000","last_active":"2023-11-26T07:20:17.961203+0000","last_peered":"2023-11-26T07:20:17.961203+0000","last_clean":"2023-11-26T07:20:17.961203+0000","last_became_active":"2023-11-26T07:20:17.004173+0000","last_became_peered":"2023-11-26T07:20:17.004173+0000","last_unstale":"2023-11-26T07:20:17.961203+0000","last_undegraded":"2023-11-26T07:20:17.961203+0000","last_fullsized":"2023-11-26T07:20:17.961203+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:30:31.266629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960440+0000","last_change":"2023-11-26T07:20:16.986680+0000","last_active":"2023-11-26T07:20:17.960440+0000","last_peered":"2023-11-26T07:20:17.960440+0000","last_clean":"2023-11-26T07:20:17.960440+0000","last_became_active":"2023-11-26T07:20:16.985830+0000","last_became_peered":"2023-11-26T07:20:16.985830+0000","last_unstale":"2023-11-26T07:20:17.960440+0000","last_undegraded":"2023-11-26T07:20:17.960440+0000","last_fullsized":"2023-11-26T07:20:17.960440+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:35:01.221601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.311549+0000","last_change":"2023-11-26T07:20:16.991698+0000","last_active":"2023-11-26T07:20:18.311549+0000","last_peered":"2023-11-26T07:20:18.311549+0000","last_clean":"2023-11-26T07:20:18.311549+0000","last_became_active":"2023-11-26T07:20:16.991406+0000","last_became_peered":"2023-11-26T07:20:16.991406+0000","last_unstale":"2023-11-26T07:20:18.311549+0000","last_undegraded":"2023-11-26T07:20:18.311549+0000","last_fullsized":"2023-11-26T07:20:18.311549+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:26:15.532735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392122+0000","last_change":"2023-11-26T07:20:16.988808+0000","last_active":"2023-11-26T07:20:18.392122+0000","last_peered":"2023-11-26T07:20:18.392122+0000","last_clean":"2023-11-26T07:20:18.392122+0000","last_became_active":"2023-11-26T07:20:16.985646+0000","last_became_peered":"2023-11-26T07:20:16.985646+0000","last_unstale":"2023-11-26T07:20:18.392122+0000","last_undegraded":"2023-11-26T07:20:18.392122+0000","last_fullsized":"2023-11-26T07:20:18.392122+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:24:35.846137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391794+0000","last_change":"2023-11-26T07:20:16.988928+0000","last_active":"2023-11-26T07:20:18.391794+0000","last_peered":"2023-11-26T07:20:18.391794+0000","last_clean":"2023-11-26T07:20:18.391794+0000","last_became_active":"2023-11-26T07:20:16.988267+0000","last_became_peered":"2023-11-26T07:20:16.988267+0000","last_unstale":"2023-11-26T07:20:18.391794+0000","last_undegraded":"2023-11-26T07:20:18.391794+0000","last_fullsized":"2023-11-26T07:20:18.391794+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:40:30.261602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312512+0000","last_change":"2023-11-26T07:20:16.992793+0000","last_active":"2023-11-26T07:20:18.312512+0000","last_peered":"2023-11-26T07:20:18.312512+0000","last_clean":"2023-11-26T07:20:18.312512+0000","last_became_active":"2023-11-26T07:20:16.992429+0000","last_became_peered":"2023-11-26T07:20:16.992429+0000","last_unstale":"2023-11-26T07:20:18.312512+0000","last_undegraded":"2023-11-26T07:20:18.312512+0000","last_fullsized":"2023-11-26T07:20:18.312512+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:04.054812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390451+0000","last_change":"2023-11-26T07:20:16.988296+0000","last_active":"2023-11-26T07:20:18.390451+0000","last_peered":"2023-11-26T07:20:18.390451+0000","last_clean":"2023-11-26T07:20:18.390451+0000","last_became_active":"2023-11-26T07:20:16.987985+0000","last_became_peered":"2023-11-26T07:20:16.987985+0000","last_unstale":"2023-11-26T07:20:18.390451+0000","last_undegraded":"2023-11-26T07:20:18.390451+0000","last_fullsized":"2023-11-26T07:20:18.390451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:17:24.635775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960936+0000","last_change":"2023-11-26T07:20:16.993459+0000","last_active":"2023-11-26T07:20:17.960936+0000","last_peered":"2023-11-26T07:20:17.960936+0000","last_clean":"2023-11-26T07:20:17.960936+0000","last_became_active":"2023-11-26T07:20:16.993108+0000","last_became_peered":"2023-11-26T07:20:16.993108+0000","last_unstale":"2023-11-26T07:20:17.960936+0000","last_undegraded":"2023-11-26T07:20:17.960936+0000","last_fullsized":"2023-11-26T07:20:17.960936+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:40:01.386594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961396+0000","last_change":"2023-11-26T07:20:16.993293+0000","last_active":"2023-11-26T07:20:17.961396+0000","last_peered":"2023-11-26T07:20:17.961396+0000","last_clean":"2023-11-26T07:20:17.961396+0000","last_became_active":"2023-11-26T07:20:16.992951+0000","last_became_peered":"2023-11-26T07:20:16.992951+0000","last_unstale":"2023-11-26T07:20:17.961396+0000","last_undegraded":"2023-11-26T07:20:17.961396+0000","last_fullsized":"2023-11-26T07:20:17.961396+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:39:40.120254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.311975+0000","last_change":"2023-11-26T07:20:16.993188+0000","last_active":"2023-11-26T07:20:18.311975+0000","last_peered":"2023-11-26T07:20:18.311975+0000","last_clean":"2023-11-26T07:20:18.311975+0000","last_became_active":"2023-11-26T07:20:16.992910+0000","last_became_peered":"2023-11-26T07:20:16.992910+0000","last_unstale":"2023-11-26T07:20:18.311975+0000","last_undegraded":"2023-11-26T07:20:18.311975+0000","last_fullsized":"2023-11-26T07:20:18.311975+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:24:05.332594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.311606+0000","last_change":"2023-11-26T07:20:16.996479+0000","last_active":"2023-11-26T07:20:18.311606+0000","last_peered":"2023-11-26T07:20:18.311606+0000","last_clean":"2023-11-26T07:20:18.311606+0000","last_became_active":"2023-11-26T07:20:16.995938+0000","last_became_peered":"2023-11-26T07:20:16.995938+0000","last_unstale":"2023-11-26T07:20:18.311606+0000","last_undegraded":"2023-11-26T07:20:18.311606+0000","last_fullsized":"2023-11-26T07:20:18.311606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:50:39.220243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312686+0000","last_change":"2023-11-26T07:20:17.005512+0000","last_active":"2023-11-26T07:20:18.312686+0000","last_peered":"2023-11-26T07:20:18.312686+0000","last_clean":"2023-11-26T07:20:18.312686+0000","last_became_active":"2023-11-26T07:20:17.005113+0000","last_became_peered":"2023-11-26T07:20:17.005113+0000","last_unstale":"2023-11-26T07:20:18.312686+0000","last_undegraded":"2023-11-26T07:20:18.312686+0000","last_fullsized":"2023-11-26T07:20:18.312686+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:17:02.695245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390451+0000","last_change":"2023-11-26T07:20:16.979621+0000","last_active":"2023-11-26T07:20:18.390451+0000","last_peered":"2023-11-26T07:20:18.390451+0000","last_clean":"2023-11-26T07:20:18.390451+0000","last_became_active":"2023-11-26T07:20:16.976154+0000","last_became_peered":"2023-11-26T07:20:16.976154+0000","last_unstale":"2023-11-26T07:20:18.390451+0000","last_undegraded":"2023-11-26T07:20:18.390451+0000","last_fullsized":"2023-11-26T07:20:18.390451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:05:50.192916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391613+0000","last_change":"2023-11-26T07:20:16.987756+0000","last_active":"2023-11-26T07:20:18.391613+0000","last_peered":"2023-11-26T07:20:18.391613+0000","last_clean":"2023-11-26T07:20:18.391613+0000","last_became_active":"2023-11-26T07:20:16.987371+0000","last_became_peered":"2023-11-26T07:20:16.987371+0000","last_unstale":"2023-11-26T07:20:18.391613+0000","last_undegraded":"2023-11-26T07:20:18.391613+0000","last_fullsized":"2023-11-26T07:20:18.391613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:30:31.266629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391713+0000","last_change":"2023-11-26T07:20:16.982887+0000","last_active":"2023-11-26T07:20:18.391713+0000","last_peered":"2023-11-26T07:20:18.391713+0000","last_clean":"2023-11-26T07:20:18.391713+0000","last_became_active":"2023-11-26T07:20:16.982475+0000","last_became_peered":"2023-11-26T07:20:16.982475+0000","last_unstale":"2023-11-26T07:20:18.391713+0000","last_undegraded":"2023-11-26T07:20:18.391713+0000","last_fullsized":"2023-11-26T07:20:18.391713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:56:49.545401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312403+0000","last_change":"2023-11-26T07:20:17.003224+0000","last_active":"2023-11-26T07:20:18.312403+0000","last_peered":"2023-11-26T07:20:18.312403+0000","last_clean":"2023-11-26T07:20:18.312403+0000","last_became_active":"2023-11-26T07:20:17.002887+0000","last_became_peered":"2023-11-26T07:20:17.002887+0000","last_unstale":"2023-11-26T07:20:18.312403+0000","last_undegraded":"2023-11-26T07:20:18.312403+0000","last_fullsized":"2023-11-26T07:20:18.312403+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:58:29.600139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391166+0000","last_change":"2023-11-26T07:20:16.981350+0000","last_active":"2023-11-26T07:20:18.391166+0000","last_peered":"2023-11-26T07:20:18.391166+0000","last_clean":"2023-11-26T07:20:18.391166+0000","last_became_active":"2023-11-26T07:20:16.980682+0000","last_became_peered":"2023-11-26T07:20:16.980682+0000","last_unstale":"2023-11-26T07:20:18.391166+0000","last_undegraded":"2023-11-26T07:20:18.391166+0000","last_fullsized":"2023-11-26T07:20:18.391166+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:15.511229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960612+0000","last_change":"2023-11-26T07:20:16.969832+0000","last_active":"2023-11-26T07:20:17.960612+0000","last_peered":"2023-11-26T07:20:17.960612+0000","last_clean":"2023-11-26T07:20:17.960612+0000","last_became_active":"2023-11-26T07:20:16.969195+0000","last_became_peered":"2023-11-26T07:20:16.969195+0000","last_unstale":"2023-11-26T07:20:17.960612+0000","last_undegraded":"2023-11-26T07:20:17.960612+0000","last_fullsized":"2023-11-26T07:20:17.960612+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:47:52.949612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390429+0000","last_change":"2023-11-26T07:20:16.998869+0000","last_active":"2023-11-26T07:20:18.390429+0000","last_peered":"2023-11-26T07:20:18.390429+0000","last_clean":"2023-11-26T07:20:18.390429+0000","last_became_active":"2023-11-26T07:20:16.998580+0000","last_became_peered":"2023-11-26T07:20:16.998580+0000","last_unstale":"2023-11-26T07:20:18.390429+0000","last_undegraded":"2023-11-26T07:20:18.390429+0000","last_fullsized":"2023-11-26T07:20:18.390429+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:07:11.738124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.307558+0000","last_change":"2023-11-26T07:20:16.995148+0000","last_active":"2023-11-26T07:20:18.307558+0000","last_peered":"2023-11-26T07:20:18.307558+0000","last_clean":"2023-11-26T07:20:18.307558+0000","last_became_active":"2023-11-26T07:20:16.994865+0000","last_became_peered":"2023-11-26T07:20:16.994865+0000","last_unstale":"2023-11-26T07:20:18.307558+0000","last_undegraded":"2023-11-26T07:20:18.307558+0000","last_fullsized":"2023-11-26T07:20:18.307558+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:15.511229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963113+0000","last_change":"2023-11-26T07:20:15.978792+0000","last_active":"2023-11-26T07:20:17.963113+0000","last_peered":"2023-11-26T07:20:17.963113+0000","last_clean":"2023-11-26T07:20:17.963113+0000","last_became_active":"2023-11-26T07:20:15.978545+0000","last_became_peered":"2023-11-26T07:20:15.978545+0000","last_unstale":"2023-11-26T07:20:17.963113+0000","last_undegraded":"2023-11-26T07:20:17.963113+0000","last_fullsized":"2023-11-26T07:20:17.963113+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:36.693572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312722+0000","last_change":"2023-11-26T07:20:16.989253+0000","last_active":"2023-11-26T07:20:18.312722+0000","last_peered":"2023-11-26T07:20:18.312722+0000","last_clean":"2023-11-26T07:20:18.312722+0000","last_became_active":"2023-11-26T07:20:16.988793+0000","last_became_peered":"2023-11-26T07:20:16.988793+0000","last_unstale":"2023-11-26T07:20:18.312722+0000","last_undegraded":"2023-11-26T07:20:18.312722+0000","last_fullsized":"2023-11-26T07:20:18.312722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:56.168119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392254+0000","last_change":"2023-11-26T07:20:15.982589+0000","last_active":"2023-11-26T07:20:18.392254+0000","last_peered":"2023-11-26T07:20:18.392254+0000","last_clean":"2023-11-26T07:20:18.392254+0000","last_became_active":"2023-11-26T07:20:15.982227+0000","last_became_peered":"2023-11-26T07:20:15.982227+0000","last_unstale":"2023-11-26T07:20:18.392254+0000","last_undegraded":"2023-11-26T07:20:18.392254+0000","last_fullsized":"2023-11-26T07:20:18.392254+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:57.930622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392053+0000","last_change":"2023-11-26T07:20:16.974256+0000","last_active":"2023-11-26T07:20:18.392053+0000","last_peered":"2023-11-26T07:20:18.392053+0000","last_clean":"2023-11-26T07:20:18.392053+0000","last_became_active":"2023-11-26T07:20:16.973517+0000","last_became_peered":"2023-11-26T07:20:16.973517+0000","last_unstale":"2023-11-26T07:20:18.392053+0000","last_undegraded":"2023-11-26T07:20:18.392053+0000","last_fullsized":"2023-11-26T07:20:18.392053+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:30.789590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.307928+0000","last_change":"2023-11-26T07:20:15.980841+0000","last_active":"2023-11-26T07:20:18.307928+0000","last_peered":"2023-11-26T07:20:18.307928+0000","last_clean":"2023-11-26T07:20:18.307928+0000","last_became_active":"2023-11-26T07:20:15.980454+0000","last_became_peered":"2023-11-26T07:20:15.980454+0000","last_unstale":"2023-11-26T07:20:18.307928+0000","last_undegraded":"2023-11-26T07:20:18.307928+0000","last_fullsized":"2023-11-26T07:20:18.307928+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:55.153585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.308136+0000","last_change":"2023-11-26T07:20:16.997122+0000","last_active":"2023-11-26T07:20:18.308136+0000","last_peered":"2023-11-26T07:20:18.308136+0000","last_clean":"2023-11-26T07:20:18.308136+0000","last_became_active":"2023-11-26T07:20:16.996796+0000","last_became_peered":"2023-11-26T07:20:16.996796+0000","last_unstale":"2023-11-26T07:20:18.308136+0000","last_undegraded":"2023-11-26T07:20:18.308136+0000","last_fullsized":"2023-11-26T07:20:18.308136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:40:21.764188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962923+0000","last_change":"2023-11-26T07:20:15.988743+0000","last_active":"2023-11-26T07:20:17.962923+0000","last_peered":"2023-11-26T07:20:17.962923+0000","last_clean":"2023-11-26T07:20:17.962923+0000","last_became_active":"2023-11-26T07:20:15.988456+0000","last_became_peered":"2023-11-26T07:20:15.988456+0000","last_unstale":"2023-11-26T07:20:17.962923+0000","last_undegraded":"2023-11-26T07:20:17.962923+0000","last_fullsized":"2023-11-26T07:20:17.962923+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:12:30.913501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391543+0000","last_change":"2023-11-26T07:20:16.990767+0000","last_active":"2023-11-26T07:20:18.391543+0000","last_peered":"2023-11-26T07:20:18.391543+0000","last_clean":"2023-11-26T07:20:18.391543+0000","last_became_active":"2023-11-26T07:20:16.990398+0000","last_became_peered":"2023-11-26T07:20:16.990398+0000","last_unstale":"2023-11-26T07:20:18.391543+0000","last_undegraded":"2023-11-26T07:20:18.391543+0000","last_fullsized":"2023-11-26T07:20:18.391543+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:40:21.764188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961541+0000","last_change":"2023-11-26T07:20:15.987819+0000","last_active":"2023-11-26T07:20:17.961541+0000","last_peered":"2023-11-26T07:20:17.961541+0000","last_clean":"2023-11-26T07:20:17.961541+0000","last_became_active":"2023-11-26T07:20:15.987475+0000","last_became_peered":"2023-11-26T07:20:15.987475+0000","last_unstale":"2023-11-26T07:20:17.961541+0000","last_undegraded":"2023-11-26T07:20:17.961541+0000","last_fullsized":"2023-11-26T07:20:17.961541+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:14:20.807919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962394+0000","last_change":"2023-11-26T07:20:16.991555+0000","last_active":"2023-11-26T07:20:17.962394+0000","last_peered":"2023-11-26T07:20:17.962394+0000","last_clean":"2023-11-26T07:20:17.962394+0000","last_became_active":"2023-11-26T07:20:16.991270+0000","last_became_peered":"2023-11-26T07:20:16.991270+0000","last_unstale":"2023-11-26T07:20:17.962394+0000","last_undegraded":"2023-11-26T07:20:17.962394+0000","last_fullsized":"2023-11-26T07:20:17.962394+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:08:10.592186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391820+0000","last_change":"2023-11-26T07:20:15.985753+0000","last_active":"2023-11-26T07:20:18.391820+0000","last_peered":"2023-11-26T07:20:18.391820+0000","last_clean":"2023-11-26T07:20:18.391820+0000","last_became_active":"2023-11-26T07:20:15.985475+0000","last_became_peered":"2023-11-26T07:20:15.985475+0000","last_unstale":"2023-11-26T07:20:18.391820+0000","last_undegraded":"2023-11-26T07:20:18.391820+0000","last_fullsized":"2023-11-26T07:20:18.391820+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:38.268982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960296+0000","last_change":"2023-11-26T07:20:16.997680+0000","last_active":"2023-11-26T07:20:17.960296+0000","last_peered":"2023-11-26T07:20:17.960296+0000","last_clean":"2023-11-26T07:20:17.960296+0000","last_became_active":"2023-11-26T07:20:16.996588+0000","last_became_peered":"2023-11-26T07:20:16.996588+0000","last_unstale":"2023-11-26T07:20:17.960296+0000","last_undegraded":"2023-11-26T07:20:17.960296+0000","last_fullsized":"2023-11-26T07:20:17.960296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:15.511229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390434+0000","last_change":"2023-11-26T07:20:15.974187+0000","last_active":"2023-11-26T07:20:18.390434+0000","last_peered":"2023-11-26T07:20:18.390434+0000","last_clean":"2023-11-26T07:20:18.390434+0000","last_became_active":"2023-11-26T07:20:15.973885+0000","last_became_peered":"2023-11-26T07:20:15.973885+0000","last_unstale":"2023-11-26T07:20:18.390434+0000","last_undegraded":"2023-11-26T07:20:18.390434+0000","last_fullsized":"2023-11-26T07:20:18.390434+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:40:20.749653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.311622+0000","last_change":"2023-11-26T07:20:16.993220+0000","last_active":"2023-11-26T07:20:18.311622+0000","last_peered":"2023-11-26T07:20:18.311622+0000","last_clean":"2023-11-26T07:20:18.311622+0000","last_became_active":"2023-11-26T07:20:16.992915+0000","last_became_peered":"2023-11-26T07:20:16.992915+0000","last_unstale":"2023-11-26T07:20:18.311622+0000","last_undegraded":"2023-11-26T07:20:18.311622+0000","last_fullsized":"2023-11-26T07:20:18.311622+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:06.969279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960418+0000","last_change":"2023-11-26T07:20:15.978069+0000","last_active":"2023-11-26T07:20:17.960418+0000","last_peered":"2023-11-26T07:20:17.960418+0000","last_clean":"2023-11-26T07:20:17.960418+0000","last_became_active":"2023-11-26T07:20:15.976583+0000","last_became_peered":"2023-11-26T07:20:15.976583+0000","last_unstale":"2023-11-26T07:20:17.960418+0000","last_undegraded":"2023-11-26T07:20:17.960418+0000","last_fullsized":"2023-11-26T07:20:17.960418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:38.268982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392071+0000","last_change":"2023-11-26T07:20:16.989098+0000","last_active":"2023-11-26T07:20:18.392071+0000","last_peered":"2023-11-26T07:20:18.392071+0000","last_clean":"2023-11-26T07:20:18.392071+0000","last_became_active":"2023-11-26T07:20:16.988653+0000","last_became_peered":"2023-11-26T07:20:16.988653+0000","last_unstale":"2023-11-26T07:20:18.392071+0000","last_undegraded":"2023-11-26T07:20:18.392071+0000","last_fullsized":"2023-11-26T07:20:18.392071+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:39:40.120254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392288+0000","last_change":"2023-11-26T07:20:15.984750+0000","last_active":"2023-11-26T07:20:18.392288+0000","last_peered":"2023-11-26T07:20:18.392288+0000","last_clean":"2023-11-26T07:20:18.392288+0000","last_became_active":"2023-11-26T07:20:15.984479+0000","last_became_peered":"2023-11-26T07:20:15.984479+0000","last_unstale":"2023-11-26T07:20:18.392288+0000","last_undegraded":"2023-11-26T07:20:18.392288+0000","last_fullsized":"2023-11-26T07:20:18.392288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:03.040278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963670+0000","last_change":"2023-11-26T07:20:16.990634+0000","last_active":"2023-11-26T07:20:17.963670+0000","last_peered":"2023-11-26T07:20:17.963670+0000","last_clean":"2023-11-26T07:20:17.963670+0000","last_became_active":"2023-11-26T07:20:16.987075+0000","last_became_peered":"2023-11-26T07:20:16.987075+0000","last_unstale":"2023-11-26T07:20:17.963670+0000","last_undegraded":"2023-11-26T07:20:17.963670+0000","last_fullsized":"2023-11-26T07:20:17.963670+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:56:47.557897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961966+0000","last_change":"2023-11-26T07:20:15.982606+0000","last_active":"2023-11-26T07:20:17.961966+0000","last_peered":"2023-11-26T07:20:17.961966+0000","last_clean":"2023-11-26T07:20:17.961966+0000","last_became_active":"2023-11-26T07:20:15.982313+0000","last_became_peered":"2023-11-26T07:20:15.982313+0000","last_unstale":"2023-11-26T07:20:17.961966+0000","last_undegraded":"2023-11-26T07:20:17.961966+0000","last_fullsized":"2023-11-26T07:20:17.961966+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:03.040278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961636+0000","last_change":"2023-11-26T07:20:16.990581+0000","last_active":"2023-11-26T07:20:17.961636+0000","last_peered":"2023-11-26T07:20:17.961636+0000","last_clean":"2023-11-26T07:20:17.961636+0000","last_became_active":"2023-11-26T07:20:16.990285+0000","last_became_peered":"2023-11-26T07:20:16.990285+0000","last_unstale":"2023-11-26T07:20:17.961636+0000","last_undegraded":"2023-11-26T07:20:17.961636+0000","last_fullsized":"2023-11-26T07:20:17.961636+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:21:55.441220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963264+0000","last_change":"2023-11-26T07:20:15.992949+0000","last_active":"2023-11-26T07:20:17.963264+0000","last_peered":"2023-11-26T07:20:17.963264+0000","last_clean":"2023-11-26T07:20:17.963264+0000","last_became_active":"2023-11-26T07:20:15.992697+0000","last_became_peered":"2023-11-26T07:20:15.992697+0000","last_unstale":"2023-11-26T07:20:17.963264+0000","last_undegraded":"2023-11-26T07:20:17.963264+0000","last_fullsized":"2023-11-26T07:20:17.963264+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:24:34.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962939+0000","last_change":"2023-11-26T07:20:16.994905+0000","last_active":"2023-11-26T07:20:17.962939+0000","last_peered":"2023-11-26T07:20:17.962939+0000","last_clean":"2023-11-26T07:20:17.962939+0000","last_became_active":"2023-11-26T07:20:16.994624+0000","last_became_peered":"2023-11-26T07:20:16.994624+0000","last_unstale":"2023-11-26T07:20:17.962939+0000","last_undegraded":"2023-11-26T07:20:17.962939+0000","last_fullsized":"2023-11-26T07:20:17.962939+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:52:58.161718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390439+0000","last_change":"2023-11-26T07:20:15.975988+0000","last_active":"2023-11-26T07:20:18.390439+0000","last_peered":"2023-11-26T07:20:18.390439+0000","last_clean":"2023-11-26T07:20:18.390439+0000","last_became_active":"2023-11-26T07:20:15.975689+0000","last_became_peered":"2023-11-26T07:20:15.975689+0000","last_unstale":"2023-11-26T07:20:18.390439+0000","last_undegraded":"2023-11-26T07:20:18.390439+0000","last_fullsized":"2023-11-26T07:20:18.390439+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:14:19.501389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312412+0000","last_change":"2023-11-26T07:20:16.992039+0000","last_active":"2023-11-26T07:20:18.312412+0000","last_peered":"2023-11-26T07:20:18.312412+0000","last_clean":"2023-11-26T07:20:18.312412+0000","last_became_active":"2023-11-26T07:20:16.991763+0000","last_became_peered":"2023-11-26T07:20:16.991763+0000","last_unstale":"2023-11-26T07:20:18.312412+0000","last_undegraded":"2023-11-26T07:20:18.312412+0000","last_fullsized":"2023-11-26T07:20:18.312412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:09:47.504406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961690+0000","last_change":"2023-11-26T07:20:15.975862+0000","last_active":"2023-11-26T07:20:17.961690+0000","last_peered":"2023-11-26T07:20:17.961690+0000","last_clean":"2023-11-26T07:20:17.961690+0000","last_became_active":"2023-11-26T07:20:15.975525+0000","last_became_peered":"2023-11-26T07:20:15.975525+0000","last_unstale":"2023-11-26T07:20:17.961690+0000","last_undegraded":"2023-11-26T07:20:17.961690+0000","last_fullsized":"2023-11-26T07:20:17.961690+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:56:46.543363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962488+0000","last_change":"2023-11-26T07:20:16.985147+0000","last_active":"2023-11-26T07:20:17.962488+0000","last_peered":"2023-11-26T07:20:17.962488+0000","last_clean":"2023-11-26T07:20:17.962488+0000","last_became_active":"2023-11-26T07:20:16.984837+0000","last_became_peered":"2023-11-26T07:20:16.984837+0000","last_unstale":"2023-11-26T07:20:17.962488+0000","last_undegraded":"2023-11-26T07:20:17.962488+0000","last_fullsized":"2023-11-26T07:20:17.962488+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:12:31.928035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962798+0000","last_change":"2023-11-26T07:20:15.983804+0000","last_active":"2023-11-26T07:20:17.962798+0000","last_peered":"2023-11-26T07:20:17.962798+0000","last_clean":"2023-11-26T07:20:17.962798+0000","last_became_active":"2023-11-26T07:20:15.983517+0000","last_became_peered":"2023-11-26T07:20:15.983517+0000","last_unstale":"2023-11-26T07:20:17.962798+0000","last_undegraded":"2023-11-26T07:20:17.962798+0000","last_fullsized":"2023-11-26T07:20:17.962798+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:40:29.247068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960490+0000","last_change":"2023-11-26T07:20:16.990559+0000","last_active":"2023-11-26T07:20:17.960490+0000","last_peered":"2023-11-26T07:20:17.960490+0000","last_clean":"2023-11-26T07:20:17.960490+0000","last_became_active":"2023-11-26T07:20:16.990243+0000","last_became_peered":"2023-11-26T07:20:16.990243+0000","last_unstale":"2023-11-26T07:20:17.960490+0000","last_undegraded":"2023-11-26T07:20:17.960490+0000","last_fullsized":"2023-11-26T07:20:17.960490+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:25:21.154910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960726+0000","last_change":"2023-11-26T07:20:15.975865+0000","last_active":"2023-11-26T07:20:17.960726+0000","last_peered":"2023-11-26T07:20:17.960726+0000","last_clean":"2023-11-26T07:20:17.960726+0000","last_became_active":"2023-11-26T07:20:15.975558+0000","last_became_peered":"2023-11-26T07:20:15.975558+0000","last_unstale":"2023-11-26T07:20:17.960726+0000","last_undegraded":"2023-11-26T07:20:17.960726+0000","last_fullsized":"2023-11-26T07:20:17.960726+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:44:27.994232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962651+0000","last_change":"2023-11-26T07:20:16.990013+0000","last_active":"2023-11-26T07:20:17.962651+0000","last_peered":"2023-11-26T07:20:17.962651+0000","last_clean":"2023-11-26T07:20:17.962651+0000","last_became_active":"2023-11-26T07:20:16.989703+0000","last_became_peered":"2023-11-26T07:20:16.989703+0000","last_unstale":"2023-11-26T07:20:17.962651+0000","last_undegraded":"2023-11-26T07:20:17.962651+0000","last_fullsized":"2023-11-26T07:20:17.962651+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:30.789590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960529+0000","last_change":"2023-11-26T07:20:15.970561+0000","last_active":"2023-11-26T07:20:17.960529+0000","last_peered":"2023-11-26T07:20:17.960529+0000","last_clean":"2023-11-26T07:20:17.960529+0000","last_became_active":"2023-11-26T07:20:15.970232+0000","last_became_peered":"2023-11-26T07:20:15.970232+0000","last_unstale":"2023-11-26T07:20:17.960529+0000","last_undegraded":"2023-11-26T07:20:17.960529+0000","last_fullsized":"2023-11-26T07:20:17.960529+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:45:04.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390855+0000","last_change":"2023-11-26T07:20:16.986463+0000","last_active":"2023-11-26T07:20:18.390855+0000","last_peered":"2023-11-26T07:20:18.390855+0000","last_clean":"2023-11-26T07:20:18.390855+0000","last_became_active":"2023-11-26T07:20:16.986163+0000","last_became_peered":"2023-11-26T07:20:16.986163+0000","last_unstale":"2023-11-26T07:20:18.390855+0000","last_undegraded":"2023-11-26T07:20:18.390855+0000","last_fullsized":"2023-11-26T07:20:18.390855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:54:42.573778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390805+0000","last_change":"2023-11-26T07:20:15.975489+0000","last_active":"2023-11-26T07:20:18.390805+0000","last_peered":"2023-11-26T07:20:18.390805+0000","last_clean":"2023-11-26T07:20:18.390805+0000","last_became_active":"2023-11-26T07:20:15.975124+0000","last_became_peered":"2023-11-26T07:20:15.975124+0000","last_unstale":"2023-11-26T07:20:18.390805+0000","last_undegraded":"2023-11-26T07:20:18.390805+0000","last_fullsized":"2023-11-26T07:20:18.390805+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:54:29.672254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962415+0000","last_change":"2023-11-26T07:20:17.002557+0000","last_active":"2023-11-26T07:20:17.962415+0000","last_peered":"2023-11-26T07:20:17.962415+0000","last_clean":"2023-11-26T07:20:17.962415+0000","last_became_active":"2023-11-26T07:20:16.999816+0000","last_became_peered":"2023-11-26T07:20:16.999816+0000","last_unstale":"2023-11-26T07:20:17.962415+0000","last_undegraded":"2023-11-26T07:20:17.962415+0000","last_fullsized":"2023-11-26T07:20:17.962415+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:44:29.008766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392316+0000","last_change":"2023-11-26T07:20:15.978946+0000","last_active":"2023-11-26T07:20:18.392316+0000","last_peered":"2023-11-26T07:20:18.392316+0000","last_clean":"2023-11-26T07:20:18.392316+0000","last_became_active":"2023-11-26T07:20:15.978457+0000","last_became_peered":"2023-11-26T07:20:15.978457+0000","last_unstale":"2023-11-26T07:20:18.392316+0000","last_undegraded":"2023-11-26T07:20:18.392316+0000","last_fullsized":"2023-11-26T07:20:18.392316+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:58:28.585604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312226+0000","last_change":"2023-11-26T07:20:16.978504+0000","last_active":"2023-11-26T07:20:18.312226+0000","last_peered":"2023-11-26T07:20:18.312226+0000","last_clean":"2023-11-26T07:20:18.312226+0000","last_became_active":"2023-11-26T07:20:16.977917+0000","last_became_peered":"2023-11-26T07:20:16.977917+0000","last_unstale":"2023-11-26T07:20:18.312226+0000","last_undegraded":"2023-11-26T07:20:18.312226+0000","last_fullsized":"2023-11-26T07:20:18.312226+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:25:58.945156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391261+0000","last_change":"2023-11-26T07:20:15.977919+0000","last_active":"2023-11-26T07:20:18.391261+0000","last_peered":"2023-11-26T07:20:18.391261+0000","last_clean":"2023-11-26T07:20:18.391261+0000","last_became_active":"2023-11-26T07:20:15.975595+0000","last_became_peered":"2023-11-26T07:20:15.975595+0000","last_unstale":"2023-11-26T07:20:18.391261+0000","last_undegraded":"2023-11-26T07:20:18.391261+0000","last_fullsized":"2023-11-26T07:20:18.391261+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:25:35.111793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312202+0000","last_change":"2023-11-26T07:20:17.005537+0000","last_active":"2023-11-26T07:20:18.312202+0000","last_peered":"2023-11-26T07:20:18.312202+0000","last_clean":"2023-11-26T07:20:18.312202+0000","last_became_active":"2023-11-26T07:20:17.005104+0000","last_became_peered":"2023-11-26T07:20:17.005104+0000","last_unstale":"2023-11-26T07:20:18.312202+0000","last_undegraded":"2023-11-26T07:20:18.312202+0000","last_fullsized":"2023-11-26T07:20:18.312202+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:28:52.694125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962096+0000","last_change":"2023-11-26T07:20:15.982857+0000","last_active":"2023-11-26T07:20:17.962096+0000","last_peered":"2023-11-26T07:20:17.962096+0000","last_clean":"2023-11-26T07:20:17.962096+0000","last_became_active":"2023-11-26T07:20:15.982465+0000","last_became_peered":"2023-11-26T07:20:15.982465+0000","last_unstale":"2023-11-26T07:20:17.962096+0000","last_undegraded":"2023-11-26T07:20:17.962096+0000","last_fullsized":"2023-11-26T07:20:17.962096+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:03.816661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961076+0000","last_change":"2023-11-26T07:20:16.991172+0000","last_active":"2023-11-26T07:20:17.961076+0000","last_peered":"2023-11-26T07:20:17.961076+0000","last_clean":"2023-11-26T07:20:17.961076+0000","last_became_active":"2023-11-26T07:20:16.990893+0000","last_became_peered":"2023-11-26T07:20:16.990893+0000","last_unstale":"2023-11-26T07:20:17.961076+0000","last_undegraded":"2023-11-26T07:20:17.961076+0000","last_fullsized":"2023-11-26T07:20:17.961076+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:16.296693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961939+0000","last_change":"2023-11-26T07:20:15.981588+0000","last_active":"2023-11-26T07:20:17.961939+0000","last_peered":"2023-11-26T07:20:17.961939+0000","last_clean":"2023-11-26T07:20:17.961939+0000","last_became_active":"2023-11-26T07:20:15.981141+0000","last_became_peered":"2023-11-26T07:20:15.981141+0000","last_unstale":"2023-11-26T07:20:17.961939+0000","last_undegraded":"2023-11-26T07:20:17.961939+0000","last_fullsized":"2023-11-26T07:20:17.961939+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:35:48.572384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.307503+0000","last_change":"2023-11-26T07:20:16.995410+0000","last_active":"2023-11-26T07:20:18.307503+0000","last_peered":"2023-11-26T07:20:18.307503+0000","last_clean":"2023-11-26T07:20:18.307503+0000","last_became_active":"2023-11-26T07:20:16.995037+0000","last_became_peered":"2023-11-26T07:20:16.995037+0000","last_unstale":"2023-11-26T07:20:18.307503+0000","last_undegraded":"2023-11-26T07:20:18.307503+0000","last_fullsized":"2023-11-26T07:20:18.307503+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:55.080962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392346+0000","last_change":"2023-11-26T07:20:15.975979+0000","last_active":"2023-11-26T07:20:18.392346+0000","last_peered":"2023-11-26T07:20:18.392346+0000","last_clean":"2023-11-26T07:20:18.392346+0000","last_became_active":"2023-11-26T07:20:15.975699+0000","last_became_peered":"2023-11-26T07:20:15.975699+0000","last_unstale":"2023-11-26T07:20:18.392346+0000","last_undegraded":"2023-11-26T07:20:18.392346+0000","last_fullsized":"2023-11-26T07:20:18.392346+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:03:13.831363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390116+0000","last_change":"2023-11-26T07:20:16.988654+0000","last_active":"2023-11-26T07:20:18.390116+0000","last_peered":"2023-11-26T07:20:18.390116+0000","last_clean":"2023-11-26T07:20:18.390116+0000","last_became_active":"2023-11-26T07:20:16.987853+0000","last_became_peered":"2023-11-26T07:20:16.987853+0000","last_unstale":"2023-11-26T07:20:18.390116+0000","last_undegraded":"2023-11-26T07:20:18.390116+0000","last_fullsized":"2023-11-26T07:20:18.390116+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:03:50.682485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960804+0000","last_change":"2023-11-26T07:20:15.983378+0000","last_active":"2023-11-26T07:20:17.960804+0000","last_peered":"2023-11-26T07:20:17.960804+0000","last_clean":"2023-11-26T07:20:17.960804+0000","last_became_active":"2023-11-26T07:20:15.983169+0000","last_became_peered":"2023-11-26T07:20:15.983169+0000","last_unstale":"2023-11-26T07:20:17.960804+0000","last_undegraded":"2023-11-26T07:20:17.960804+0000","last_fullsized":"2023-11-26T07:20:17.960804+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:17:23.621241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960681+0000","last_change":"2023-11-26T07:20:17.004759+0000","last_active":"2023-11-26T07:20:17.960681+0000","last_peered":"2023-11-26T07:20:17.960681+0000","last_clean":"2023-11-26T07:20:17.960681+0000","last_became_active":"2023-11-26T07:20:17.004473+0000","last_became_peered":"2023-11-26T07:20:17.004473+0000","last_unstale":"2023-11-26T07:20:17.960681+0000","last_undegraded":"2023-11-26T07:20:17.960681+0000","last_fullsized":"2023-11-26T07:20:17.960681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:40:21.764188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961905+0000","last_change":"2023-11-26T07:20:15.983542+0000","last_active":"2023-11-26T07:20:17.961905+0000","last_peered":"2023-11-26T07:20:17.961905+0000","last_clean":"2023-11-26T07:20:17.961905+0000","last_became_active":"2023-11-26T07:20:15.983268+0000","last_became_peered":"2023-11-26T07:20:15.983268+0000","last_unstale":"2023-11-26T07:20:17.961905+0000","last_undegraded":"2023-11-26T07:20:17.961905+0000","last_fullsized":"2023-11-26T07:20:17.961905+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:57.550844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.312870+0000","last_change":"2023-11-26T07:20:16.989074+0000","last_active":"2023-11-26T07:20:18.312870+0000","last_peered":"2023-11-26T07:20:18.312870+0000","last_clean":"2023-11-26T07:20:18.312870+0000","last_became_active":"2023-11-26T07:20:16.988468+0000","last_became_peered":"2023-11-26T07:20:16.988468+0000","last_unstale":"2023-11-26T07:20:18.312870+0000","last_undegraded":"2023-11-26T07:20:18.312870+0000","last_fullsized":"2023-11-26T07:20:18.312870+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:39.283516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962804+0000","last_change":"2023-11-26T07:20:15.981967+0000","last_active":"2023-11-26T07:20:17.962804+0000","last_peered":"2023-11-26T07:20:17.962804+0000","last_clean":"2023-11-26T07:20:17.962804+0000","last_became_active":"2023-11-26T07:20:15.981776+0000","last_became_peered":"2023-11-26T07:20:15.981776+0000","last_unstale":"2023-11-26T07:20:17.962804+0000","last_undegraded":"2023-11-26T07:20:17.962804+0000","last_fullsized":"2023-11-26T07:20:17.962804+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:52:57.147184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.962611+0000","last_change":"2023-11-26T07:20:16.998796+0000","last_active":"2023-11-26T07:20:17.962611+0000","last_peered":"2023-11-26T07:20:17.962611+0000","last_clean":"2023-11-26T07:20:17.962611+0000","last_became_active":"2023-11-26T07:20:16.998525+0000","last_became_peered":"2023-11-26T07:20:16.998525+0000","last_unstale":"2023-11-26T07:20:17.962611+0000","last_undegraded":"2023-11-26T07:20:17.962611+0000","last_fullsized":"2023-11-26T07:20:17.962611+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:37.708106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963401+0000","last_change":"2023-11-26T07:20:15.993182+0000","last_active":"2023-11-26T07:20:17.963401+0000","last_peered":"2023-11-26T07:20:17.963401+0000","last_clean":"2023-11-26T07:20:17.963401+0000","last_became_active":"2023-11-26T07:20:15.992900+0000","last_became_peered":"2023-11-26T07:20:15.992900+0000","last_unstale":"2023-11-26T07:20:17.963401+0000","last_undegraded":"2023-11-26T07:20:17.963401+0000","last_fullsized":"2023-11-26T07:20:17.963401+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:25:35.111793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963200+0000","last_change":"2023-11-26T07:20:16.994381+0000","last_active":"2023-11-26T07:20:17.963200+0000","last_peered":"2023-11-26T07:20:17.963200+0000","last_clean":"2023-11-26T07:20:17.963200+0000","last_became_active":"2023-11-26T07:20:16.993643+0000","last_became_peered":"2023-11-26T07:20:16.993643+0000","last_unstale":"2023-11-26T07:20:17.963200+0000","last_undegraded":"2023-11-26T07:20:17.963200+0000","last_fullsized":"2023-11-26T07:20:17.963200+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:27:12.829229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.307238+0000","last_change":"2023-11-26T07:20:15.977133+0000","last_active":"2023-11-26T07:20:18.307238+0000","last_peered":"2023-11-26T07:20:18.307238+0000","last_clean":"2023-11-26T07:20:18.307238+0000","last_became_active":"2023-11-26T07:20:15.976852+0000","last_became_peered":"2023-11-26T07:20:15.976852+0000","last_unstale":"2023-11-26T07:20:18.307238+0000","last_undegraded":"2023-11-26T07:20:18.307238+0000","last_fullsized":"2023-11-26T07:20:18.307238+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:38.268982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961424+0000","last_change":"2023-11-26T07:20:16.997620+0000","last_active":"2023-11-26T07:20:17.961424+0000","last_peered":"2023-11-26T07:20:17.961424+0000","last_clean":"2023-11-26T07:20:17.961424+0000","last_became_active":"2023-11-26T07:20:16.993834+0000","last_became_peered":"2023-11-26T07:20:16.993834+0000","last_unstale":"2023-11-26T07:20:17.961424+0000","last_undegraded":"2023-11-26T07:20:17.961424+0000","last_fullsized":"2023-11-26T07:20:17.961424+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:51:01.549831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.963287+0000","last_change":"2023-11-26T07:20:15.993054+0000","last_active":"2023-11-26T07:20:17.963287+0000","last_peered":"2023-11-26T07:20:17.963287+0000","last_clean":"2023-11-26T07:20:17.963287+0000","last_became_active":"2023-11-26T07:20:15.992773+0000","last_became_peered":"2023-11-26T07:20:15.992773+0000","last_unstale":"2023-11-26T07:20:17.963287+0000","last_undegraded":"2023-11-26T07:20:17.963287+0000","last_fullsized":"2023-11-26T07:20:17.963287+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:44:27.994232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961095+0000","last_change":"2023-11-26T07:20:16.991822+0000","last_active":"2023-11-26T07:20:17.961095+0000","last_peered":"2023-11-26T07:20:17.961095+0000","last_clean":"2023-11-26T07:20:17.961095+0000","last_became_active":"2023-11-26T07:20:16.991564+0000","last_became_peered":"2023-11-26T07:20:16.991564+0000","last_unstale":"2023-11-26T07:20:17.961095+0000","last_undegraded":"2023-11-26T07:20:17.961095+0000","last_fullsized":"2023-11-26T07:20:17.961095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:56:37.081269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.392051+0000","last_change":"2023-11-26T07:20:15.983504+0000","last_active":"2023-11-26T07:20:18.392051+0000","last_peered":"2023-11-26T07:20:18.392051+0000","last_clean":"2023-11-26T07:20:18.392051+0000","last_became_active":"2023-11-26T07:20:15.983211+0000","last_became_peered":"2023-11-26T07:20:15.983211+0000","last_unstale":"2023-11-26T07:20:18.392051+0000","last_undegraded":"2023-11-26T07:20:18.392051+0000","last_fullsized":"2023-11-26T07:20:18.392051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:45:04.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.390290+0000","last_change":"2023-11-26T07:20:16.996511+0000","last_active":"2023-11-26T07:20:18.390290+0000","last_peered":"2023-11-26T07:20:18.390290+0000","last_clean":"2023-11-26T07:20:18.390290+0000","last_became_active":"2023-11-26T07:20:16.996240+0000","last_became_peered":"2023-11-26T07:20:16.996240+0000","last_unstale":"2023-11-26T07:20:18.390290+0000","last_undegraded":"2023-11-26T07:20:18.390290+0000","last_fullsized":"2023-11-26T07:20:18.390290+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:53:44.848707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.307613+0000","last_change":"2023-11-26T07:20:15.977663+0000","last_active":"2023-11-26T07:20:18.307613+0000","last_peered":"2023-11-26T07:20:18.307613+0000","last_clean":"2023-11-26T07:20:18.307613+0000","last_became_active":"2023-11-26T07:20:15.977360+0000","last_became_peered":"2023-11-26T07:20:15.977360+0000","last_unstale":"2023-11-26T07:20:18.307613+0000","last_undegraded":"2023-11-26T07:20:18.307613+0000","last_fullsized":"2023-11-26T07:20:18.307613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:17:01.680711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391052+0000","last_change":"2023-11-26T07:20:16.993550+0000","last_active":"2023-11-26T07:20:18.391052+0000","last_peered":"2023-11-26T07:20:18.391052+0000","last_clean":"2023-11-26T07:20:18.391052+0000","last_became_active":"2023-11-26T07:20:16.992053+0000","last_became_peered":"2023-11-26T07:20:16.992053+0000","last_unstale":"2023-11-26T07:20:18.391052+0000","last_undegraded":"2023-11-26T07:20:18.391052+0000","last_fullsized":"2023-11-26T07:20:18.391052+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:31:16.099652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.960635+0000","last_change":"2023-11-26T07:20:15.978284+0000","last_active":"2023-11-26T07:20:17.960635+0000","last_peered":"2023-11-26T07:20:17.960635+0000","last_clean":"2023-11-26T07:20:17.960635+0000","last_became_active":"2023-11-26T07:20:15.974502+0000","last_became_peered":"2023-11-26T07:20:15.974502+0000","last_unstale":"2023-11-26T07:20:17.960635+0000","last_undegraded":"2023-11-26T07:20:17.960635+0000","last_fullsized":"2023-11-26T07:20:17.960635+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:31:15.085118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:17.961858+0000","last_change":"2023-11-26T07:20:16.995356+0000","last_active":"2023-11-26T07:20:17.961858+0000","last_peered":"2023-11-26T07:20:17.961858+0000","last_clean":"2023-11-26T07:20:17.961858+0000","last_became_active":"2023-11-26T07:20:16.994936+0000","last_became_peered":"2023-11-26T07:20:16.994936+0000","last_unstale":"2023-11-26T07:20:17.961858+0000","last_undegraded":"2023-11-26T07:20:17.961858+0000","last_fullsized":"2023-11-26T07:20:17.961858+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:15.936415+0000","last_clean_scrub_stamp":"2023-11-26T07:20:15.936415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:03:14.845898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:18.391814+0000","last_change":"2023-11-26T07:20:15.974989+0000","last_active":"2023-11-26T07:20:18.391814+0000","last_peered":"2023-11-26T07:20:18.391814+0000","last_clean":"2023-11-26T07:20:18.391814+0000","last_became_active":"2023-11-26T07:20:15.974518+0000","last_became_peered":"2023-11-26T07:20:15.974518+0000","last_unstale":"2023-11-26T07:20:18.391814+0000","last_undegraded":"2023-11-26T07:20:18.391814+0000","last_fullsized":"2023-11-26T07:20:18.391814+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:14.921881+0000","last_clean_scrub_stamp":"2023-11-26T07:20:14.921881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:44:27.994232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-26T07:20:16.977257+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:20:16.977257+0000","last_peered":"2023-11-26T07:20:16.977257+0000","last_clean":"2023-11-26T07:20:16.977257+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:20:16.977257+0000","last_undegraded":"2023-11-26T07:20:16.977257+0000","last_fullsized":"2023-11-26T07:20:16.977257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1150976,"data_stored":817898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.052,"15min":1.034},"min":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0629999999999999,"15min":1.0649999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.627}]},{"osd":1,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.048,"15min":1.046},"min":{"1min":0.77000000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2310000000000001,"15min":1.2290000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.7509999999999999,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.90700000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.181,"15min":1.1619999999999999},"min":{"1min":1.0149999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.7230000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.292,"15min":1.302},"min":{"1min":0.76700000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.6899999999999999,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.79300000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.234,"15min":1.242},"min":{"1min":0.79900000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.694,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.373,"15min":1.369},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.8280000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.0720000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3720000000000001,"15min":1.3660000000000001},"min":{"1min":1.024,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.992,"5min":2.774,"15min":2.774},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.522,"5min":1.4770000000000001,"15min":1.4690000000000001},"min":{"1min":1.161,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.907,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.151}]},{"osd":5,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.51,"15min":1.508},"min":{"1min":1.0740000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.97,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.014},{"interface":"front","average":{"1min":1.5,"5min":1.49,"15min":1.488},"min":{"1min":1.042,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.9530000000000001,"5min":2.149,"15min":2.149},"last":1.1060000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6299999999999999,"5min":1.6819999999999999,"15min":1.6910000000000001},"min":{"1min":1.2869999999999999,"5min":0.75,"15min":0.75},"max":{"1min":2.0619999999999998,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.661,"15min":1.655},"min":{"1min":1.3520000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.1349999999999998,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.1930000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":228112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1180000000000001,"15min":1.1220000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4810000000000001,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":1.022},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.2410000000000001,"15min":1.2789999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.464,"5min":3.169,"15min":3.169},"last":1.1439999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1919999999999999,"15min":1.1879999999999999},"min":{"1min":0.80300000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4670000000000001,"5min":1.929,"15min":1.929},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.097,"5min":1.1160000000000001,"15min":1.119},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5329999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.96999999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1120000000000001,"15min":1.1180000000000001},"min":{"1min":0.77400000000000002,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.276},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3640000000000001,"15min":1.3879999999999999},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.591,"5min":3.1110000000000002,"15min":3.1110000000000002},"last":1.343}]},{"osd":3,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2629999999999999,"15min":1.266},"min":{"1min":0.92700000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.663,"5min":1.669,"15min":1.669},"last":1.514},{"interface":"front","average":{"1min":1.159,"5min":1.24,"15min":1.254},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.4990000000000001,"5min":1.712,"15min":1.712},"last":1.5640000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.361,"15min":1.367},"min":{"1min":0.93400000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6120000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.196},{"interface":"front","average":{"1min":1.284,"5min":1.3500000000000001,"15min":1.361},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.708,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.3919999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3899999999999999,"15min":1.403},"min":{"1min":0.86199999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.554,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.647},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.516,"15min":1.53},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.714,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.45}]},{"osd":7,"last update":"Sun Nov 26 07:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.5229999999999999,"15min":1.538},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.843,"5min":2.004,"15min":2.004},"last":1.758},{"interface":"front","average":{"1min":1.448,"5min":1.5469999999999999,"15min":1.5629999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.744,"5min":1.901,"15min":1.901},"last":1.8220000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":221210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.036,"15min":1.018},"min":{"1min":0.68100000000000005,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.288},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0189999999999999,"15min":1.002},"min":{"1min":0.72799999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.3260000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0589999999999999,"15min":1.052},"min":{"1min":0.72599999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.1639999999999999,"15min":1.1659999999999999},"min":{"1min":0.69899999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.577,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.4139999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4810000000000001,"5min":1.694,"15min":1.694},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2889999999999999,"15min":1.3},"min":{"1min":0.84399999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.585,"5min":1.988,"15min":1.988},"last":1.4590000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2929999999999999,"15min":1.3069999999999999},"min":{"1min":0.81499999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5229999999999999,"5min":1.992,"15min":1.992},"last":1.155},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1839999999999999,"15min":1.1899999999999999},"min":{"1min":0.86599999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4950000000000001,"5min":1.605,"15min":1.605},"last":1.5149999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4690000000000001,"15min":1.4730000000000001},"min":{"1min":1.1870000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.74,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.617},{"interface":"front","average":{"1min":1.379,"5min":1.456,"15min":1.4690000000000001},"min":{"1min":1.0329999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.9139999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.97499999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.544,"15min":1.5529999999999999},"min":{"1min":1.0149999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.0030000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.095},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.448,"15min":1.4630000000000001},"min":{"1min":0.998,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.91600000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.5940000000000001,"15min":1.6100000000000001},"min":{"1min":1.0600000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.827,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.573},{"interface":"front","average":{"1min":1.526,"5min":1.5980000000000001,"15min":1.6100000000000001},"min":{"1min":1.093,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.365}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":552960,"data_stored":222752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.1319999999999999,"15min":1.1499999999999999},"min":{"1min":0.73099999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.5029999999999999,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.012},{"interface":"front","average":{"1min":1.135,"5min":1.0229999999999999,"15min":1.004},"min":{"1min":0.79400000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4690000000000001,"5min":1.643,"15min":1.643},"last":1.3360000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1659999999999999,"15min":1.173},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5049999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.262},{"interface":"front","average":{"1min":1.22,"5min":1.236,"15min":1.238},"min":{"1min":0.749,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.6839999999999999,"5min":1.766,"15min":1.766},"last":1.4259999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2789999999999999,"15min":1.2909999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.486,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.514},{"interface":"front","average":{"1min":1.238,"5min":1.2889999999999999,"15min":1.2969999999999999},"min":{"1min":0.88300000000000001,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.7270000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.147}]},{"osd":3,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.325,"15min":1.3240000000000001},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.7310000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.304},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.339,"15min":1.349},"min":{"1min":0.93999999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.663,"5min":1.73,"15min":1.73},"last":1.4650000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.367,"15min":1.3660000000000001},"min":{"1min":0.99399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.8700000000000001,"5min":1.909,"15min":1.909},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.504,"15min":1.512},"min":{"1min":0.99099999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8680000000000001,"5min":2.899,"15min":2.899},"last":1.383}]},{"osd":6,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.506,"15min":1.5129999999999999},"min":{"1min":0.92000000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.891,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.6419999999999999,"15min":1.6499999999999999},"min":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"max":{"1min":1.9299999999999999,"5min":3.008,"15min":3.008},"last":1.6240000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:19:30 2023","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.7470000000000001,"15min":1.7649999999999999},"min":{"1min":1.2410000000000001,"5min":1.214,"15min":1.214},"max":{"1min":1.994,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.718,"15min":1.7230000000000001},"min":{"1min":1.3009999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":2.3260000000000001,"5min":3.085,"15min":3.085},"last":1.861}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":221778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.84899999999999998,"15min":0.86899999999999999},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.121,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.6499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.51400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.323,"5min":1.764,"15min":1.764},"last":1.506}]},{"osd":1,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.83599999999999997,"15min":0.85699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.508,"5min":1.784,"15min":1.784},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.165,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.2450000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.0549999999999999,"15min":1.0820000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5089999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.095,"15min":1.119},"min":{"1min":0.53600000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.494,"5min":2.379,"15min":2.379},"last":1.3879999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.131,"15min":1.137},"min":{"1min":0.76500000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.49,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.329,"15min":1.365},"min":{"1min":0.80200000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.468,"5min":2.859,"15min":2.859},"last":1.3340000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.3400000000000001,"15min":1.3740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5409999999999999,"5min":2.504,"15min":2.504},"last":1.141},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.244,"15min":1.2609999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.631,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.288}]},{"osd":6,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.419,"15min":1.4630000000000001},"min":{"1min":0.80400000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.415,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.4139999999999999,"15min":1.4530000000000001},"min":{"1min":0.78600000000000003,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.5680000000000001,"5min":3.226,"15min":3.226},"last":1.5349999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.27,"15min":1.2929999999999999},"min":{"1min":0.82899999999999996,"5min":0.75,"15min":0.75},"max":{"1min":1.4299999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.484,"15min":1.524},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.706,"5min":3.956,"15min":3.956},"last":1.474}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":229074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.484,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.91600000000000004,"5min":1.0760000000000001,"15min":1.1020000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0459999999999998,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.244}]},{"osd":1,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.96199999999999997,"15min":0.99399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.044,"5min":1.645,"15min":1.645},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.03,"15min":1.052},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.585,"5min":1.901,"15min":1.901},"last":1.0960000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.0649999999999999,"15min":1.091},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.2240000000000002,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":1.046},{"interface":"front","average":{"1min":1.028,"5min":1.2330000000000001,"15min":1.2669999999999999},"min":{"1min":0.63500000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.8939999999999999,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.4590000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.266,"15min":1.29},"min":{"1min":0.82799999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.4430000000000001,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.29},{"interface":"front","average":{"1min":1.171,"5min":1.288,"15min":1.3080000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7150000000000001,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.3779999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.2450000000000001,"15min":1.2629999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.649,"5min":1.901,"15min":1.901},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.387,"15min":1.415},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.77,"5min":2.395,"15min":2.395},"last":1.1950000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.452,"15min":1.472},"min":{"1min":1.0580000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.833,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.349,"15min":1.3580000000000001},"min":{"1min":0.92400000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.0750000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.329}]},{"osd":7,"last update":"Sun Nov 26 07:19:28 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4930000000000001,"15min":1.5149999999999999},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.1309999999999998,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.607},{"interface":"front","average":{"1min":1.393,"5min":1.4399999999999999,"15min":1.448},"min":{"1min":0.99399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1320000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.4890000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":227510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.441,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1160000000000001,"5min":1.498,"15min":1.498},"last":1.589},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.96399999999999997,"15min":0.97699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.393,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.1830000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.85999999999999999,"15min":0.872},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.218,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.002,"15min":1.0089999999999999},"min":{"1min":0.59699999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2450000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.0920000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0800000000000001,"15min":1.0840000000000001},"min":{"1min":0.67900000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.677,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.468},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0700000000000001,"15min":1.077},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.635,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.70899999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.246,"15min":1.254},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7,"5min":2.294,"15min":2.294},"last":1.28},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.2629999999999999,"15min":1.2769999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.73,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.413}]},{"osd":5,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3560000000000001,"15min":1.3879999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.6439999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3839999999999999,"15min":1.3879999999999999},"min":{"1min":0.83899999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8260000000000001,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.6870000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3879999999999999,"15min":1.401},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.788,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.359,"15min":1.373},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6020000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.325}]},{"osd":7,"last update":"Sun Nov 26 07:19:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3819999999999999,"15min":1.3839999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.748,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.77},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.514,"15min":1.5289999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.9630000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.548}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":817842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.746,"15min":0.755},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.026,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.878},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.86899999999999999,"15min":0.89500000000000002},"min":{"1min":0.46700000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.298,"5min":1.448,"15min":1.448},"last":0.81699999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.92500000000000004,"15min":0.95899999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.353,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.98899999999999999,"15min":1.02},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.4590000000000001,"5min":1.641,"15min":1.641},"last":1.4039999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.88500000000000001,"15min":0.91400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1899999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.88,"5min":1.1120000000000001,"15min":1.1499999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4039999999999999,"5min":2.137,"15min":2.137},"last":1.0720000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2789999999999999,"15min":1.296},"min":{"1min":0.77600000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.579,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.468},{"interface":"front","average":{"1min":1.091,"5min":1.2030000000000001,"15min":1.222},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.78,"5min":1.909,"15min":1.909},"last":1.3560000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.234,"15min":1.26},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.506,"5min":1.728,"15min":1.728},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.23,"5min":1.3600000000000001,"15min":1.3819999999999999},"min":{"1min":0.81499999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.698,"5min":2.202,"15min":2.202},"last":1.839}]},{"osd":6,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.381,"15min":1.405},"min":{"1min":0.77300000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.3320000000000001,"15min":1.367},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.992,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.1180000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:19:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.399,"15min":1.4350000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8959999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.2809999999999999,"15min":1.321},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6639999999999999,"5min":2.585,"15min":2.585},"last":1.486}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:20:21.883 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:20:21.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:20:21.916 INFO:tasks.ceph.mds.c.smithi077.stderr:2023-11-26T07:20:21.913+0000 7fb657b56640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:20:22.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.142+0000 7f033359e640 1 Processor -- start 2023-11-26T07:20:22.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.142+0000 7f033359e640 1 -- start start 2023-11-26T07:20:22.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.144+0000 7f033359e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f03340725b0 0x7f0334071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.144+0000 7f033359e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f033415de90 0x7f033415e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.144+0000 7f033359e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033415ebe0 con 0x7f033415d810 2023-11-26T07:20:22.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.144+0000 7f033359e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0334070860 con 0x7f03340725b0 2023-11-26T07:20:22.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.144+0000 7f033359e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0334070b40 con 0x7f033415de90 2023-11-26T07:20:22.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.144+0000 7f0331d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f03340725b0 0x7f0334071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.144+0000 7f033259c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f033415d810 0x7f0334071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47530/0 (socket says 172.21.15.77:47530) 2023-11-26T07:20:22.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.144+0000 7f033259c640 1 -- 172.21.15.77:0/1049656836 learned_addr learned my addr 172.21.15.77:0/1049656836 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:22.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.145+0000 7f0332d9d640 1 --2- 172.21.15.77:0/1049656836 >> v2:172.21.15.159:3300/0 conn(0x7f033415de90 0x7f033415e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.145+0000 7f0331d9b640 1 -- 172.21.15.77:0/1049656836 >> v2:172.21.15.159:3300/0 conn(0x7f033415de90 msgr2=0x7f033415e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:22.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.145+0000 7f0331d9b640 1 --2- 172.21.15.77:0/1049656836 >> v2:172.21.15.159:3300/0 conn(0x7f033415de90 0x7f033415e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.145+0000 7f0331d9b640 1 -- 172.21.15.77:0/1049656836 >> v1:172.21.15.77:6789/0 conn(0x7f033415d810 legacy=0x7f0334071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.145+0000 7f0331d9b640 1 -- 172.21.15.77:0/1049656836 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0334070e20 con 0x7f03340725b0 2023-11-26T07:20:22.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.145+0000 7f0332d9d640 1 --2- 172.21.15.77:0/1049656836 >> v2:172.21.15.159:3300/0 conn(0x7f033415de90 0x7f033415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:22.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.146+0000 7f0331d9b640 1 --2- 172.21.15.77:0/1049656836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03340725b0 0x7f0334071620 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0334070370 tx=0x7f032802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da58daf395bd5558 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.146+0000 7f033159a640 1 -- 172.21.15.77:0/1049656836 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328031830 con 0x7f03340725b0 2023-11-26T07:20:22.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.146+0000 7f033159a640 1 -- 172.21.15.77:0/1049656836 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328031990 con 0x7f03340725b0 2023-11-26T07:20:22.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.146+0000 7f033159a640 1 -- 172.21.15.77:0/1049656836 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328031d20 con 0x7f03340725b0 2023-11-26T07:20:22.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.147+0000 7f033359e640 1 -- 172.21.15.77:0/1049656836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03340725b0 msgr2=0x7f0334071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.147+0000 7f033359e640 1 --2- 172.21.15.77:0/1049656836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03340725b0 0x7f0334071620 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0334070370 tx=0x7f032802b8d0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.147+0000 7f033359e640 1 -- 172.21.15.77:0/1049656836 shutdown_connections 2023-11-26T07:20:22.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.147+0000 7f033359e640 1 --2- 172.21.15.77:0/1049656836 >> v2:172.21.15.159:3300/0 conn(0x7f033415de90 0x7f033415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.147+0000 7f033359e640 1 --2- 172.21.15.77:0/1049656836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03340725b0 0x7f0334071620 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.147+0000 7f033359e640 1 -- 172.21.15.77:0/1049656836 >> 172.21.15.77:0/1049656836 conn(0x7f033406a500 msgr2=0x7f033406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:22.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.147+0000 7f033359e640 1 -- 172.21.15.77:0/1049656836 shutdown_connections 2023-11-26T07:20:22.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.147+0000 7f033359e640 1 -- 172.21.15.77:0/1049656836 wait complete. 2023-11-26T07:20:22.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.149+0000 7f033359e640 1 Processor -- start 2023-11-26T07:20:22.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.149+0000 7f033359e640 1 -- start start 2023-11-26T07:20:22.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.150+0000 7f033359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340725b0 0x7f0334150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.150+0000 7f033359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415d810 0x7f0334153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.150+0000 7f033359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f033415de90 0x7f033414fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.150+0000 7f033359e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0334157f40 con 0x7f033415d810 2023-11-26T07:20:22.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.150+0000 7f033359e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0334150f50 con 0x7f03340725b0 2023-11-26T07:20:22.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.150+0000 7f033359e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03341583d0 con 0x7f033415de90 2023-11-26T07:20:22.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.150+0000 7f0331d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415d810 0x7f0334153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.150+0000 7f0331d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415d810 0x7f0334153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39494/0 (socket says 172.21.15.77:39494) 2023-11-26T07:20:22.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.150+0000 7f0331d9b640 1 -- 172.21.15.77:0/899464937 learned_addr learned my addr 172.21.15.77:0/899464937 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:22.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.151+0000 7f0331d9b640 1 -- 172.21.15.77:0/899464937 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f033415de90 msgr2=0x7f033414fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.151+0000 7f0331d9b640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f033415de90 0x7f033414fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.151+0000 7f0331d9b640 1 -- 172.21.15.77:0/899464937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340725b0 msgr2=0x7f0334150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.151+0000 7f033259c640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340725b0 0x7f0334150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.151+0000 7f0331d9b640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340725b0 0x7f0334150640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.151+0000 7f0331d9b640 1 -- 172.21.15.77:0/899464937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0328009400 con 0x7f033415d810 2023-11-26T07:20:22.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.151+0000 7f0331d9b640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415d810 0x7f0334153260 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0328009890 tx=0x7f03280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.151+0000 7f0322ffd640 1 -- 172.21.15.77:0/899464937 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032803ba70 con 0x7f033415d810 2023-11-26T07:20:22.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.152+0000 7f0322ffd640 1 -- 172.21.15.77:0/899464937 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032803bbf0 con 0x7f033415d810 2023-11-26T07:20:22.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.152+0000 7f0322ffd640 1 -- 172.21.15.77:0/899464937 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328045400 con 0x7f033415d810 2023-11-26T07:20:22.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.152+0000 7f033359e640 1 -- 172.21.15.77:0/899464937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03341586b0 con 0x7f033415d810 2023-11-26T07:20:22.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.152+0000 7f033359e640 1 -- 172.21.15.77:0/899464937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0334157b60 con 0x7f033415d810 2023-11-26T07:20:22.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.153+0000 7f033359e640 1 -- 172.21.15.77:0/899464937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033404e840 con 0x7f033415d810 2023-11-26T07:20:22.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.154+0000 7f0322ffd640 1 -- 172.21.15.77:0/899464937 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f032804e440 con 0x7f033415d810 2023-11-26T07:20:22.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.155+0000 7f0322ffd640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f031406b140 0x7f031406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.155+0000 7f0322ffd640 1 -- 172.21.15.77:0/899464937 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03280abea0 con 0x7f033415d810 2023-11-26T07:20:22.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.155+0000 7f033259c640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f031406b140 0x7f031406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.156+0000 7f033259c640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f031406b140 0x7f031406d600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0324005880 tx=0x7f0324009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.159+0000 7f0322ffd640 1 -- 172.21.15.77:0/899464937 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0328076af0 con 0x7f033415d810 2023-11-26T07:20:22.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.417+0000 7f033359e640 1 -- 172.21.15.77:0/899464937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f03340cce20 con 0x7f033415d810 2023-11-26T07:20:22.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.423+0000 7f0322ffd640 1 -- 172.21.15.77:0/899464937 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+147 (secure 0 0 0) 0x7f03280350b0 con 0x7f033415d810 2023-11-26T07:20:22.425 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-11-26T07:20:22.426 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDN8GJlhqOIKxAAiafAbVhNu4B+yTd/1i7+1A== 2023-11-26T07:20:22.426 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2023-11-26T07:20:22.426 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2023-11-26T07:20:22.426 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:20:22.426 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2023-11-26T07:20:22.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.425+0000 7f033359e640 1 -- 172.21.15.77:0/899464937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f031406b140 msgr2=0x7f031406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.425+0000 7f033359e640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f031406b140 0x7f031406d600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0324005880 tx=0x7f0324009040 comp rx=0 tx=0).stop 2023-11-26T07:20:22.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.425+0000 7f033359e640 1 -- 172.21.15.77:0/899464937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415d810 msgr2=0x7f0334153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.425+0000 7f033359e640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415d810 0x7f0334153260 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0328009890 tx=0x7f03280046c0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.426+0000 7f033359e640 1 -- 172.21.15.77:0/899464937 shutdown_connections 2023-11-26T07:20:22.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.426+0000 7f033359e640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f031406b140 0x7f031406d600 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.426+0000 7f033359e640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f033415de90 0x7f033414fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.426+0000 7f033359e640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415d810 0x7f0334153260 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.426+0000 7f033359e640 1 --2- 172.21.15.77:0/899464937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03340725b0 0x7f0334150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.426+0000 7f033359e640 1 -- 172.21.15.77:0/899464937 >> 172.21.15.77:0/899464937 conn(0x7f033406a500 msgr2=0x7f033406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:22.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.426+0000 7f033359e640 1 -- 172.21.15.77:0/899464937 shutdown_connections 2023-11-26T07:20:22.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.426+0000 7f033359e640 1 -- 172.21.15.77:0/899464937 wait complete. 2023-11-26T07:20:22.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:22.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.654+0000 7f3fb759e640 1 Processor -- start 2023-11-26T07:20:22.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.654+0000 7f3fb759e640 1 -- start start 2023-11-26T07:20:22.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.656+0000 7f3fb759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fb814b100 0x7f3fb8162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.656+0000 7f3fb759e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fb80703f0 0x7f3fb8165c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.656+0000 7f3fb759e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb8162eb0 con 0x7f3fb8166150 2023-11-26T07:20:22.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.656+0000 7f3fb759e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb81654a0 con 0x7f3fb80703f0 2023-11-26T07:20:22.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.656+0000 7f3fb759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80ccf00 con 0x7f3fb814b100 2023-11-26T07:20:22.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.656+0000 7f3faffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fb80703f0 0x7f3fb8165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.656+0000 7f3fb6d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3fb8166150 0x7f3fb80cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47534/0 (socket says 172.21.15.77:47534) 2023-11-26T07:20:22.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.656+0000 7f3fb6d9d640 1 -- 172.21.15.77:0/542374821 learned_addr learned my addr 172.21.15.77:0/542374821 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:22.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.656+0000 7f3fb659c640 1 --2- 172.21.15.77:0/542374821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fb814b100 0x7f3fb8162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.657+0000 7f3faffff640 1 -- 172.21.15.77:0/542374821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fb814b100 msgr2=0x7f3fb8162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:22.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.657+0000 7f3faffff640 1 --2- 172.21.15.77:0/542374821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fb814b100 0x7f3fb8162970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.657+0000 7f3faffff640 1 -- 172.21.15.77:0/542374821 >> v1:172.21.15.77:6789/0 conn(0x7f3fb8166150 legacy=0x7f3fb80cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.657+0000 7f3faffff640 1 -- 172.21.15.77:0/542374821 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb80708f0 con 0x7f3fb80703f0 2023-11-26T07:20:22.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.657+0000 7f3fb5d9b640 1 -- 172.21.15.77:0/542374821 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106890063 0 0) 0x7f3fb0001490 con 0x7f3fb8166150 2023-11-26T07:20:22.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.658+0000 7f3faffff640 1 --2- 172.21.15.77:0/542374821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fb80703f0 0x7f3fb8165c10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00097a0 tx=0x7f3fa002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4c1005c631796d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.658+0000 7f3fb5d9b640 1 -- 172.21.15.77:0/542374821 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa002e070 con 0x7f3fb80703f0 2023-11-26T07:20:22.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.658+0000 7f3fb5d9b640 1 -- 172.21.15.77:0/542374821 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa00315a0 con 0x7f3fb80703f0 2023-11-26T07:20:22.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.658+0000 7f3fb5d9b640 1 -- 172.21.15.77:0/542374821 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0031930 con 0x7f3fb80703f0 2023-11-26T07:20:22.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.659+0000 7f3fb759e640 1 -- 172.21.15.77:0/542374821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fb80703f0 msgr2=0x7f3fb8165c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.659+0000 7f3fb759e640 1 --2- 172.21.15.77:0/542374821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fb80703f0 0x7f3fb8165c10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00097a0 tx=0x7f3fa002b840 comp rx=0 tx=0).stop 2023-11-26T07:20:22.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.659+0000 7f3fb759e640 1 -- 172.21.15.77:0/542374821 shutdown_connections 2023-11-26T07:20:22.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.659+0000 7f3fb759e640 1 --2- 172.21.15.77:0/542374821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fb80703f0 0x7f3fb8165c10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.659+0000 7f3fb759e640 1 --2- 172.21.15.77:0/542374821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fb814b100 0x7f3fb8162970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.659+0000 7f3fb759e640 1 -- 172.21.15.77:0/542374821 >> 172.21.15.77:0/542374821 conn(0x7f3fb80cb830 msgr2=0x7f3fb80cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:22.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.659+0000 7f3fb759e640 1 -- 172.21.15.77:0/542374821 shutdown_connections 2023-11-26T07:20:22.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.659+0000 7f3fb759e640 1 -- 172.21.15.77:0/542374821 wait complete. 2023-11-26T07:20:22.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.661+0000 7f3fb759e640 1 Processor -- start 2023-11-26T07:20:22.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.661+0000 7f3fb759e640 1 -- start start 2023-11-26T07:20:22.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fb80703f0 0x7f3fb81f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb814b100 0x7f3fb8160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fb80b22d0 0x7f3fb80b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80b3070 con 0x7f3fb80703f0 2023-11-26T07:20:22.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb759e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb81f7d30 con 0x7f3fb814b100 2023-11-26T07:20:22.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80b2d90 con 0x7f3fb80b22d0 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fb80703f0 0x7f3fb81f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fb80703f0 0x7f3fb81f77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39502/0 (socket says 172.21.15.77:39502) 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb659c640 1 -- 172.21.15.77:0/2362480481 learned_addr learned my addr 172.21.15.77:0/2362480481 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb6d9d640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fb80b22d0 0x7f3fb80b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb659c640 1 -- 172.21.15.77:0/2362480481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fb80b22d0 msgr2=0x7f3fb80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb659c640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fb80b22d0 0x7f3fb80b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3faffff640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb814b100 0x7f3fb8160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.662+0000 7f3fb659c640 1 -- 172.21.15.77:0/2362480481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb814b100 msgr2=0x7f3fb8160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.663+0000 7f3fb659c640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb814b100 0x7f3fb8160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.663+0000 7f3fb659c640 1 -- 172.21.15.77:0/2362480481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa0009400 con 0x7f3fb80703f0 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.663+0000 7f3faffff640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb814b100 0x7f3fb8160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:22.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.663+0000 7f3fb659c640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fb80703f0 0x7f3fb81f77f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800d800 tx=0x7f3fa800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.663+0000 7f3faeffd640 1 -- 172.21.15.77:0/2362480481 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800b6c0 con 0x7f3fb80703f0 2023-11-26T07:20:22.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.663+0000 7f3faeffd640 1 -- 172.21.15.77:0/2362480481 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa800b820 con 0x7f3fb80703f0 2023-11-26T07:20:22.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.663+0000 7f3faeffd640 1 -- 172.21.15.77:0/2362480481 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800bbb0 con 0x7f3fb80703f0 2023-11-26T07:20:22.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.663+0000 7f3fb759e640 1 -- 172.21.15.77:0/2362480481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb8143960 con 0x7f3fb80703f0 2023-11-26T07:20:22.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.663+0000 7f3fb759e640 1 -- 172.21.15.77:0/2362480481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb8143f20 con 0x7f3fb80703f0 2023-11-26T07:20:22.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.664+0000 7f3fb759e640 1 -- 172.21.15.77:0/2362480481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb81437c0 con 0x7f3fb80703f0 2023-11-26T07:20:22.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.665+0000 7f3faeffd640 1 -- 172.21.15.77:0/2362480481 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f3fa800bd10 con 0x7f3fb80703f0 2023-11-26T07:20:22.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.666+0000 7f3faeffd640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9806b110 0x7f3f9806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.666+0000 7f3faeffd640 1 -- 172.21.15.77:0/2362480481 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fa808a0d0 con 0x7f3fb80703f0 2023-11-26T07:20:22.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.666+0000 7f3faffff640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9806b110 0x7f3f9806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.667+0000 7f3faffff640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9806b110 0x7f3f9806d5d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0036000 tx=0x7f3fa003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.671+0000 7f3faeffd640 1 -- 172.21.15.77:0/2362480481 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3fb81437c0 con 0x7f3fb80703f0 2023-11-26T07:20:22.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.901+0000 7f3fb759e640 1 -- 172.21.15.77:0/2362480481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fb81437c0 con 0x7f3fb80703f0 2023-11-26T07:20:22.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.903+0000 7f3faeffd640 1 -- 172.21.15.77:0/2362480481 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f3fb81437c0 con 0x7f3fb80703f0 2023-11-26T07:20:22.905 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:20:22.906 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/486079893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":486079893},{"type":"v1","addr":"172.21.15.159:6833","nonce":486079893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4951,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2056565249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2056565249},{"type":"v1","addr":"172.21.15.77:6837","nonce":2056565249}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/779604697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":779604697},{"type":"v1","addr":"172.21.15.159:6835","nonce":779604697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:16.411919+0000","modified":"2023-11-26T07:20:19.475778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5664":{"gid":5664,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2496806662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2496806662},{"type":"v1","addr":"172.21.15.77:6835","nonce":2496806662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:20:22.906 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 25 2023-11-26T07:20:22.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.905+0000 7f3fb759e640 1 -- 172.21.15.77:0/2362480481 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9806b110 msgr2=0x7f3f9806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.905+0000 7f3fb759e640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9806b110 0x7f3f9806d5d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0036000 tx=0x7f3fa003d040 comp rx=0 tx=0).stop 2023-11-26T07:20:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.906+0000 7f3fb759e640 1 -- 172.21.15.77:0/2362480481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fb80703f0 msgr2=0x7f3fb81f77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.906+0000 7f3fb759e640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fb80703f0 0x7f3fb81f77f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800d800 tx=0x7f3fa800dcc0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.906+0000 7f3fb759e640 1 -- 172.21.15.77:0/2362480481 shutdown_connections 2023-11-26T07:20:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.906+0000 7f3fb759e640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3f9806b110 0x7f3f9806d5d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.906+0000 7f3fb759e640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fb80b22d0 0x7f3fb80b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.906+0000 7f3fb759e640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb814b100 0x7f3fb8160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.906+0000 7f3fb759e640 1 --2- 172.21.15.77:0/2362480481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fb80703f0 0x7f3fb81f77f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.906+0000 7f3fb759e640 1 -- 172.21.15.77:0/2362480481 >> 172.21.15.77:0/2362480481 conn(0x7f3fb80cb830 msgr2=0x7f3fb8164d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.906+0000 7f3fb759e640 1 -- 172.21.15.77:0/2362480481 shutdown_connections 2023-11-26T07:20:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:22.906+0000 7f3fb759e640 1 -- 172.21.15.77:0/2362480481 wait complete. 2023-11-26T07:20:23.330 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:20:16.411919+0000', 'modified': '2023-11-26T07:20:19.475778+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5664}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5664': {'gid': 5664, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6835/2496806662', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 2496806662}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 2496806662}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:20:23.331 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:20:23.331 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-26T07:20:23.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.551+0000 7ff52a6ff640 1 Processor -- start 2023-11-26T07:20:23.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.551+0000 7ff52a6ff640 1 -- start start 2023-11-26T07:20:23.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.553+0000 7ff52a6ff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff52415b1d0 0x7ff524071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.553+0000 7ff52a6ff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff524070550 0x7ff5240b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.553+0000 7ff52a6ff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff5240b1080 0x7ff52406c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.553+0000 7ff52a6ff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5240b14f0 con 0x7ff524070550 2023-11-26T07:20:23.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.553+0000 7ff52a6ff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5240ca0e0 con 0x7ff52415b1d0 2023-11-26T07:20:23.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.553+0000 7ff52a6ff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff524072800 con 0x7ff5240b1080 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.553+0000 7ff528efc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff524070550 0x7ff5240b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.553+0000 7ff528efc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff524070550 0x7ff5240b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39518/0 (socket says 172.21.15.77:39518) 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.553+0000 7ff528efc640 1 -- 172.21.15.77:0/1738083934 learned_addr learned my addr 172.21.15.77:0/1738083934 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.554+0000 7ff5296fd640 1 --2- 172.21.15.77:0/1738083934 >> v2:172.21.15.159:3300/0 conn(0x7ff52415b1d0 0x7ff524071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.554+0000 7ff529efe640 1 --2- 172.21.15.77:0/1738083934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff5240b1080 0x7ff52406c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.554+0000 7ff528efc640 1 -- 172.21.15.77:0/1738083934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff5240b1080 msgr2=0x7ff52406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.554+0000 7ff528efc640 1 --2- 172.21.15.77:0/1738083934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff5240b1080 0x7ff52406c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.554+0000 7ff528efc640 1 -- 172.21.15.77:0/1738083934 >> v2:172.21.15.159:3300/0 conn(0x7ff52415b1d0 msgr2=0x7ff524071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.554+0000 7ff528efc640 1 --2- 172.21.15.77:0/1738083934 >> v2:172.21.15.159:3300/0 conn(0x7ff52415b1d0 0x7ff524071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.554+0000 7ff528efc640 1 -- 172.21.15.77:0/1738083934 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240c97b0 con 0x7ff524070550 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.554+0000 7ff529efe640 1 --2- 172.21.15.77:0/1738083934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff5240b1080 0x7ff52406c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.555+0000 7ff528efc640 1 --2- 172.21.15.77:0/1738083934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff524070550 0x7ff5240b0b40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff52406e7a0 tx=0x7ff51402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cec858164da49a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.556+0000 7ff51bfff640 1 -- 172.21.15.77:0/1738083934 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514031870 con 0x7ff524070550 2023-11-26T07:20:23.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.556+0000 7ff51bfff640 1 -- 172.21.15.77:0/1738083934 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5140319d0 con 0x7ff524070550 2023-11-26T07:20:23.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.556+0000 7ff51bfff640 1 -- 172.21.15.77:0/1738083934 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514031d60 con 0x7ff524070550 2023-11-26T07:20:23.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.556+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1738083934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff524070550 msgr2=0x7ff5240b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.556+0000 7ff52a6ff640 1 --2- 172.21.15.77:0/1738083934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff524070550 0x7ff5240b0b40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff52406e7a0 tx=0x7ff51402b910 comp rx=0 tx=0).stop 2023-11-26T07:20:23.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.557+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1738083934 shutdown_connections 2023-11-26T07:20:23.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.557+0000 7ff52a6ff640 1 --2- 172.21.15.77:0/1738083934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff5240b1080 0x7ff52406c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.557+0000 7ff52a6ff640 1 --2- 172.21.15.77:0/1738083934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff524070550 0x7ff5240b0b40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.557+0000 7ff52a6ff640 1 --2- 172.21.15.77:0/1738083934 >> v2:172.21.15.159:3300/0 conn(0x7ff52415b1d0 0x7ff524071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.557+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1738083934 >> 172.21.15.77:0/1738083934 conn(0x7ff5240cbb40 msgr2=0x7ff5240cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:23.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.557+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1738083934 shutdown_connections 2023-11-26T07:20:23.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.557+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1738083934 wait complete. 2023-11-26T07:20:23.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.558+0000 7ff52a6ff640 1 Processor -- start 2023-11-26T07:20:23.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.559+0000 7ff52a6ff640 1 -- start start 2023-11-26T07:20:23.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff52a6ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff524070550 0x7ff52415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff52a6ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5240b1080 0x7ff5240b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff52a6ff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff52415b1d0 0x7ff5241554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff52a6ff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240ccd30 con 0x7ff5240b1080 2023-11-26T07:20:23.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff52a6ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240cd010 con 0x7ff524070550 2023-11-26T07:20:23.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff52a6ff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240cd2f0 con 0x7ff52415b1d0 2023-11-26T07:20:23.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff528efc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5240b1080 0x7ff5240b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff528efc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5240b1080 0x7ff5240b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39528/0 (socket says 172.21.15.77:39528) 2023-11-26T07:20:23.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff528efc640 1 -- 172.21.15.77:0/1423445821 learned_addr learned my addr 172.21.15.77:0/1423445821 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:23.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff5296fd640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff524070550 0x7ff52415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff529efe640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff52415b1d0 0x7ff5241554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff528efc640 1 -- 172.21.15.77:0/1423445821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff52415b1d0 msgr2=0x7ff5241554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.560+0000 7ff528efc640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff52415b1d0 0x7ff5241554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.561+0000 7ff528efc640 1 -- 172.21.15.77:0/1423445821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff524070550 msgr2=0x7ff52415c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.561+0000 7ff528efc640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff524070550 0x7ff52415c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.561+0000 7ff528efc640 1 -- 172.21.15.77:0/1423445821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5140094d0 con 0x7ff5240b1080 2023-11-26T07:20:23.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.561+0000 7ff528efc640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5240b1080 0x7ff5240b00c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff51402b950 tx=0x7ff5140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.561+0000 7ff519ffb640 1 -- 172.21.15.77:0/1423445821 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51403abe0 con 0x7ff5240b1080 2023-11-26T07:20:23.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.561+0000 7ff519ffb640 1 -- 172.21.15.77:0/1423445821 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51403ad60 con 0x7ff5240b1080 2023-11-26T07:20:23.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.561+0000 7ff519ffb640 1 -- 172.21.15.77:0/1423445821 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514044630 con 0x7ff5240b1080 2023-11-26T07:20:23.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.561+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1423445821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5240cd5d0 con 0x7ff5240b1080 2023-11-26T07:20:23.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.561+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1423445821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52415c750 con 0x7ff5240b1080 2023-11-26T07:20:23.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.563+0000 7ff519ffb640 1 -- 172.21.15.77:0/1423445821 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7ff51404d450 con 0x7ff5240b1080 2023-11-26T07:20:23.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.564+0000 7ff519ffb640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff50806b110 0x7ff50806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.564+0000 7ff519ffb640 1 -- 172.21.15.77:0/1423445821 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff51402d040 con 0x7ff5240b1080 2023-11-26T07:20:23.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.565+0000 7ff5296fd640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff50806b110 0x7ff50806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.565+0000 7ff52e5d5740 1 Processor -- start 2023-11-26T07:20:23.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.565+0000 7ff52e5d5740 1 -- start start 2023-11-26T07:20:23.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.565+0000 7ff5296fd640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff50806b110 0x7ff50806d5d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff520009a30 tx=0x7ff520008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.566+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f7070 0x5606c81f7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.566+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f1d70 0x5606c81f6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.566+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f67b0 0x5606c823a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.566+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c8155880 con 0x5606c81f67b0 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.566+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c8164ae0 con 0x5606c81f1d70 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.566+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c81621d0 con 0x5606c81f7070 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff529efe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f67b0 0x5606c823a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff529efe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f67b0 0x5606c823a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39536/0 (socket says 172.21.15.77:39536) 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff529efe640 1 -- 172.21.15.77:0/738557667 learned_addr learned my addr 172.21.15.77:0/738557667 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff528efc640 1 --2- 172.21.15.77:0/738557667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f1d70 0x5606c81f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff5296fd640 1 --2- 172.21.15.77:0/738557667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f7070 0x5606c81f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff529efe640 1 -- 172.21.15.77:0/738557667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f7070 msgr2=0x5606c81f7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff529efe640 1 --2- 172.21.15.77:0/738557667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f7070 0x5606c81f7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff529efe640 1 -- 172.21.15.77:0/738557667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f1d70 msgr2=0x5606c81f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff529efe640 1 --2- 172.21.15.77:0/738557667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f1d70 0x5606c81f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff529efe640 1 -- 172.21.15.77:0/738557667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606c8125860 con 0x5606c81f67b0 2023-11-26T07:20:23.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff528efc640 1 --2- 172.21.15.77:0/738557667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f1d70 0x5606c81f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:23.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff5296fd640 1 --2- 172.21.15.77:0/738557667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f7070 0x5606c81f7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:23.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.567+0000 7ff529efe640 1 --2- 172.21.15.77:0/738557667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f67b0 0x5606c823a730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009ab0 tx=0x7ff51c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249209594cffe789 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff506ffd640 1 -- 172.21.15.77:0/738557667 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c013580 con 0x5606c81f67b0 2023-11-26T07:20:23.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff506ffd640 1 -- 172.21.15.77:0/738557667 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c00f050 con 0x5606c81f67b0 2023-11-26T07:20:23.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff506ffd640 1 -- 172.21.15.77:0/738557667 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0138e0 con 0x5606c81f67b0 2023-11-26T07:20:23.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff52e5d5740 1 -- 172.21.15.77:0/738557667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f67b0 msgr2=0x5606c823a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/738557667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f67b0 0x5606c823a730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009ab0 tx=0x7ff51c009f70 comp rx=0 tx=0).stop 2023-11-26T07:20:23.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff52e5d5740 1 -- 172.21.15.77:0/738557667 shutdown_connections 2023-11-26T07:20:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/738557667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f67b0 0x5606c823a730 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/738557667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f1d70 0x5606c81f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/738557667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f7070 0x5606c81f7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff52e5d5740 1 -- 172.21.15.77:0/738557667 >> 172.21.15.77:0/738557667 conn(0x5606c81b8c70 msgr2=0x5606c823cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff52e5d5740 1 -- 172.21.15.77:0/738557667 shutdown_connections 2023-11-26T07:20:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.568+0000 7ff52e5d5740 1 -- 172.21.15.77:0/738557667 wait complete. 2023-11-26T07:20:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.569+0000 7ff52e5d5740 1 -- start start 2023-11-26T07:20:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.569+0000 7ff52e5d5740 1 Processor -- start 2023-11-26T07:20:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.570+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c820e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.570+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c82438b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.570+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8243df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c815dac0 con 0x5606c81f7070 2023-11-26T07:20:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c80fa2f0 con 0x5606c81f67b0 2023-11-26T07:20:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c8117c70 con 0x5606c81f1d70 2023-11-26T07:20:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff52e5d5740 10 client.0 _ll_register_callbacks cb 0x5606c811c3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:20:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff529efe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8243df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff529efe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8243df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39540/0 (socket says 172.21.15.77:39540) 2023-11-26T07:20:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff529efe640 1 -- 172.21.15.77:0/2432452936 learned_addr learned my addr 172.21.15.77:0/2432452936 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff5296fd640 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c820e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff529efe640 1 -- 172.21.15.77:0/2432452936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 msgr2=0x5606c820e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff528efc640 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c82438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff529efe640 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c820e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff529efe640 1 -- 172.21.15.77:0/2432452936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 msgr2=0x5606c82438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff529efe640 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c82438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.571+0000 7ff529efe640 1 -- 172.21.15.77:0/2432452936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c0096b0 con 0x5606c81f7070 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.572+0000 7ff529efe640 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8243df0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff51c016040 tx=0x7ff51c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8effad382f2468 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.572+0000 7ff4fffff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.572+0000 7ff4fffff640 1 -- 172.21.15.77:0/2432452936 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c003990 con 0x5606c81f7070 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.572+0000 7ff4fffff640 1 -- 172.21.15.77:0/2432452936 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff51c013e00 con 0x5606c81f7070 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.572+0000 7ff52e5d5740 1 -- 172.21.15.77:0/2432452936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606c8156aa0 con 0x5606c81f7070 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.572+0000 7ff4fffff640 1 -- 172.21.15.77:0/2432452936 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff51c028430 con 0x5606c81f7070 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.572+0000 7ff52e5d5740 10 client.5823 fetch_fsmap learned FSMap version 25 2023-11-26T07:20:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.572+0000 7ff52e5d5740 1 -- 172.21.15.77:0/2432452936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x5606c815c140 con 0x5606c81f7070 2023-11-26T07:20:23.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.572+0000 7ff4fffff640 1 -- 172.21.15.77:0/2432452936 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5606c8156aa0 con 0x5606c81f7070 2023-11-26T07:20:23.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.573+0000 7ff4fffff640 1 -- 172.21.15.77:0/2432452936 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff51c028590 con 0x5606c81f7070 2023-11-26T07:20:23.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.573+0000 7ff52e5d5740 10 client.5823 fetch_fsmap finished waiting for FSMap version 25 2023-11-26T07:20:23.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.573+0000 7ff52e5d5740 10 client.5823 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-26T07:20:23.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.573+0000 7ff52e5d5740 20 client.5823 populate_metadata read hostname 'smithi077' 2023-11-26T07:20:23.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.573+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.77:6834/2496806662,v1:172.21.15.77:6835/2496806662] conn(0x5606c821ca30 0x5606c821fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.573+0000 7ff52e5d5740 4 client.5823 mds_command: new command op to 5664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:20:23.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.573+0000 7ff52e5d5740 1 -- 172.21.15.77:0/2432452936 --> [v2:172.21.15.77:6834/2496806662,v1:172.21.15.77:6835/2496806662] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606c81567c0 con 0x5606c821ca30 2023-11-26T07:20:23.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.573+0000 7ff5296fd640 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.77:6834/2496806662,v1:172.21.15.77:6835/2496806662] conn(0x5606c821ca30 0x5606c821fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.574+0000 7ff5296fd640 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.77:6834/2496806662,v1:172.21.15.77:6835/2496806662] conn(0x5606c821ca30 0x5606c821fef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=696e72e97ebc6863 server_cookie=f6e920cd2b30734f in_seq=0 out_seq=0 2023-11-26T07:20:23.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.574+0000 7ff4fffff640 10 client.5823 ms_handle_connect on v2:172.21.15.77:6834/2496806662 2023-11-26T07:20:23.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.574+0000 7ff4fffff640 1 -- 172.21.15.77:0/2432452936 <== mds.0 v2:172.21.15.77:6834/2496806662 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5606c81567c0 con 0x5606c821ca30 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.574+0000 7ff4fffff640 10 client.5823 handle_command_reply: tid=0 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 1 client.5823 shutdown 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 1 -- 172.21.15.77:0/2432452936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 msgr2=0x5606c8243df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8243df0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff51c016040 tx=0x7ff51c004ab0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 1 -- 172.21.15.77:0/2432452936 shutdown_connections 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8243df0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.77:6834/2496806662,v1:172.21.15.77:6835/2496806662] conn(0x5606c821ca30 0x5606c821fef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c82438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff4fffff640 0 client.5823 ms_handle_reset on v2:172.21.15.77:6834/2496806662 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/2432452936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c820e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 1 -- 172.21.15.77:0/2432452936 >> 172.21.15.77:0/2432452936 conn(0x5606c81b8c70 msgr2=0x5606c8239d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 1 -- 172.21.15.77:0/2432452936 shutdown_connections 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 1 -- 172.21.15.77:0/2432452936 wait complete. 2023-11-26T07:20:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.575+0000 7ff52e5d5740 20 client.5823 trim_cache size 0 max 16384 2023-11-26T07:20:23.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.592+0000 7ff52e5d5740 1 Processor -- start 2023-11-26T07:20:23.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.592+0000 7ff52e5d5740 1 -- start start 2023-11-26T07:20:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.593+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c82215f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.593+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c825f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.593+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8241150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.593+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c7ec0f20 con 0x5606c81f7070 2023-11-26T07:20:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.593+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c81662f0 con 0x5606c81f67b0 2023-11-26T07:20:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.593+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c815f9a0 con 0x5606c81f1d70 2023-11-26T07:20:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.593+0000 7ff529efe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8241150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff529efe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8241150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39546/0 (socket says 172.21.15.77:39546) 2023-11-26T07:20:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff529efe640 1 -- 172.21.15.77:0/1829784989 learned_addr learned my addr 172.21.15.77:0/1829784989 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:23.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff528efc640 1 --2- 172.21.15.77:0/1829784989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c825f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff529efe640 1 -- 172.21.15.77:0/1829784989 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 msgr2=0x5606c82215f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff5296fd640 1 --2- 172.21.15.77:0/1829784989 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c82215f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff529efe640 1 --2- 172.21.15.77:0/1829784989 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c82215f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff529efe640 1 -- 172.21.15.77:0/1829784989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 msgr2=0x5606c825f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff529efe640 1 --2- 172.21.15.77:0/1829784989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c825f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff529efe640 1 -- 172.21.15.77:0/1829784989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606c80f9b80 con 0x5606c81f7070 2023-11-26T07:20:23.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff5296fd640 1 --2- 172.21.15.77:0/1829784989 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c82215f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:23.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff528efc640 1 --2- 172.21.15.77:0/1829784989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c825f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.594+0000 7ff529efe640 1 --2- 172.21.15.77:0/1829784989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8241150 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff51c003f20 tx=0x7ff51c021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f28b11ff4724dd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff5077fe640 1 -- 172.21.15.77:0/1829784989 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c003990 con 0x5606c81f7070 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff5077fe640 1 -- 172.21.15.77:0/1829784989 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c023070 con 0x5606c81f7070 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff5077fe640 1 -- 172.21.15.77:0/1829784989 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c013ea0 con 0x5606c81f7070 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1829784989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 msgr2=0x5606c8241150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/1829784989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8241150 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff51c003f20 tx=0x7ff51c021070 comp rx=0 tx=0).stop 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1829784989 shutdown_connections 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/1829784989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8241150 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/1829784989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c825f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/1829784989 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c82215f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1829784989 >> 172.21.15.77:0/1829784989 conn(0x5606c81b8c70 msgr2=0x5606c820d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1829784989 shutdown_connections 2023-11-26T07:20:23.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.595+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1829784989 wait complete. 2023-11-26T07:20:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.596+0000 7ff52e5d5740 1 -- start start 2023-11-26T07:20:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.596+0000 7ff52e5d5740 1 Processor -- start 2023-11-26T07:20:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.597+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c82af210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.597+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c82247c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.597+0000 7ff52e5d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8224d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.597+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c824f9a0 con 0x5606c81f7070 2023-11-26T07:20:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.597+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c82af750 con 0x5606c81f67b0 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.597+0000 7ff52e5d5740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c8225240 con 0x5606c81f1d70 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.597+0000 7ff52e5d5740 10 client.0 _ll_register_callbacks cb 0x7ff51c0098d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.598+0000 7ff529efe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8224d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.598+0000 7ff529efe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8224d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39560/0 (socket says 172.21.15.77:39560) 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.598+0000 7ff529efe640 1 -- 172.21.15.77:0/1250921730 learned_addr learned my addr 172.21.15.77:0/1250921730 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.598+0000 7ff528efc640 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c82247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.598+0000 7ff5296fd640 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c82af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.598+0000 7ff529efe640 1 -- 172.21.15.77:0/1250921730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 msgr2=0x5606c82af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.598+0000 7ff529efe640 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c82af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.598+0000 7ff529efe640 1 -- 172.21.15.77:0/1250921730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 msgr2=0x5606c82247c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.598+0000 7ff529efe640 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c82247c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.598+0000 7ff529efe640 1 -- 172.21.15.77:0/1250921730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606c815c140 con 0x5606c81f7070 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff529efe640 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8224d00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff51c028aa0 tx=0x7ff51c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a64d48ab9e9f480 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff4fffff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff4fffff640 1 -- 172.21.15.77:0/1250921730 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c043070 con 0x5606c81f7070 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff4fffff640 1 -- 172.21.15.77:0/1250921730 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff51c003990 con 0x5606c81f7070 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1250921730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff51c00f050 con 0x5606c81f7070 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff4fffff640 1 -- 172.21.15.77:0/1250921730 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff51c013c60 con 0x5606c81f7070 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff52e5d5740 10 client.5829 fetch_fsmap learned FSMap version 25 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1250921730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x5606c811f170 con 0x5606c81f7070 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff4fffff640 1 -- 172.21.15.77:0/1250921730 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c00f050 con 0x5606c81f7070 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff4fffff640 1 -- 172.21.15.77:0/1250921730 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff51c046020 con 0x5606c81f7070 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff52e5d5740 10 client.5829 fetch_fsmap finished waiting for FSMap version 25 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff52e5d5740 10 client.5829 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff52e5d5740 20 client.5829 populate_metadata read hostname 'smithi077' 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.599+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.77:6834/2496806662,v1:172.21.15.77:6835/2496806662] conn(0x5606c8242ce0 0x5606c82430c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.600+0000 7ff52e5d5740 4 client.5829 mds_command: new command op to 5664 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:20:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.600+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1250921730 --> [v2:172.21.15.77:6834/2496806662,v1:172.21.15.77:6835/2496806662] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5606c7e5e6c0 con 0x5606c8242ce0 2023-11-26T07:20:23.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.600+0000 7ff5296fd640 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.77:6834/2496806662,v1:172.21.15.77:6835/2496806662] conn(0x5606c8242ce0 0x5606c82430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.600+0000 7ff5296fd640 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.77:6834/2496806662,v1:172.21.15.77:6835/2496806662] conn(0x5606c8242ce0 0x5606c82430c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a341a809ca1c3f3 server_cookie=3f10be31cc2b5471 in_seq=0 out_seq=0 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.600+0000 7ff4fffff640 10 client.5829 ms_handle_connect on v2:172.21.15.77:6834/2496806662 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff4fffff640 1 -- 172.21.15.77:0/1250921730 <== mds.0 v2:172.21.15.77:6834/2496806662 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5606c7e5e6c0 con 0x5606c8242ce0 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff4fffff640 10 client.5829 handle_command_reply: tid=0 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 1 client.5829 shutdown 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1250921730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 msgr2=0x5606c8224d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8224d00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff51c028aa0 tx=0x7ff51c003cd0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1250921730 shutdown_connections 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606c81f7070 0x5606c8224d00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.77:6834/2496806662,v1:172.21.15.77:6835/2496806662] conn(0x5606c8242ce0 0x5606c82430c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606c81f67b0 0x5606c82247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 1 --2- 172.21.15.77:0/1250921730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5606c81f1d70 0x5606c82af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff4fffff640 0 client.5829 ms_handle_reset on v2:172.21.15.77:6834/2496806662 2023-11-26T07:20:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1250921730 >> 172.21.15.77:0/1250921730 conn(0x5606c81b8c70 msgr2=0x5606c8244800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1250921730 shutdown_connections 2023-11-26T07:20:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 1 -- 172.21.15.77:0/1250921730 wait complete. 2023-11-26T07:20:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.601+0000 7ff52e5d5740 20 client.5829 trim_cache size 0 max 16384 2023-11-26T07:20:23.607 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:20:23.607 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "957368bd-e942-499b-9938-86266ae9bafb", 2023-11-26T07:20:23.607 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-26T07:20:23.607 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 5664, 2023-11-26T07:20:23.607 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-26T07:20:23.607 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-26T07:20:23.607 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-26T07:20:23.608 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 6.6198775269999999, 2023-11-26T07:20:23.608 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 25, 2023-11-26T07:20:23.608 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 47, 2023-11-26T07:20:23.608 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 47, 2023-11-26T07:20:23.608 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 12.031010224999999 2023-11-26T07:20:23.608 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1423445821 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff50806b110 msgr2=0x7ff50806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff50806b110 0x7ff50806d5d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff520009a30 tx=0x7ff520008040 comp rx=0 tx=0).stop 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1423445821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5240b1080 msgr2=0x7ff5240b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5240b1080 0x7ff5240b00c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff51402b950 tx=0x7ff5140046c0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1423445821 shutdown_connections 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff50806b110 0x7ff50806d5d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff52415b1d0 0x7ff5241554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5240b1080 0x7ff5240b00c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 --2- 172.21.15.77:0/1423445821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff524070550 0x7ff52415c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1423445821 >> 172.21.15.77:0/1423445821 conn(0x7ff5240cbb40 msgr2=0x7ff52409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1423445821 shutdown_connections 2023-11-26T07:20:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.602+0000 7ff52a6ff640 1 -- 172.21.15.77:0/1423445821 wait complete. 2023-11-26T07:20:23.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:20:23.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.824+0000 7fb45e11d640 1 Processor -- start 2023-11-26T07:20:23.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.824+0000 7fb45e11d640 1 -- start start 2023-11-26T07:20:23.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.826+0000 7fb45e11d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb4580b2250 0x7fb45815df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.826+0000 7fb45e11d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4580b2aa0 0x7fb45815b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.826+0000 7fb45e11d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45815ab80 con 0x7fb4580b2630 2023-11-26T07:20:23.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.826+0000 7fb45e11d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45815a990 con 0x7fb4580b2250 2023-11-26T07:20:23.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.826+0000 7fb45e11d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45815e680 con 0x7fb4580b2aa0 2023-11-26T07:20:23.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.827+0000 7fb4577fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb4580b2250 0x7fb45815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.827+0000 7fb44ffff640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fb4580b2630 0x7fb4580ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:55622/0 (socket says 172.21.15.77:55622) 2023-11-26T07:20:23.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.827+0000 7fb44ffff640 1 -- 172.21.15.77:0/2079012239 learned_addr learned my addr 172.21.15.77:0/2079012239 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:23.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.827+0000 7fb457fff640 1 --2- 172.21.15.77:0/2079012239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4580b2aa0 0x7fb45815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.827+0000 7fb456ffd640 1 -- 172.21.15.77:0/2079012239 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115128219 0 0) 0x7fb45815ab80 con 0x7fb4580b2630 2023-11-26T07:20:23.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.827+0000 7fb456ffd640 1 -- 172.21.15.77:0/2079012239 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb444003520 con 0x7fb4580b2630 2023-11-26T07:20:23.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.828+0000 7fb457fff640 1 -- 172.21.15.77:0/2079012239 >> v2:172.21.15.159:3300/0 conn(0x7fb4580b2250 msgr2=0x7fb45815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.828+0000 7fb457fff640 1 --2- 172.21.15.77:0/2079012239 >> v2:172.21.15.159:3300/0 conn(0x7fb4580b2250 0x7fb45815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.828+0000 7fb457fff640 1 -- 172.21.15.77:0/2079012239 >> v1:172.21.15.159:6789/0 conn(0x7fb4580b2630 legacy=0x7fb4580ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.828+0000 7fb457fff640 1 -- 172.21.15.77:0/2079012239 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45815e960 con 0x7fb4580b2aa0 2023-11-26T07:20:23.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.828+0000 7fb4577fe640 1 --2- 172.21.15.77:0/2079012239 >> v2:172.21.15.159:3300/0 conn(0x7fb4580b2250 0x7fb45815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:20:23.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.829+0000 7fb457fff640 1 --2- 172.21.15.77:0/2079012239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4580b2aa0 0x7fb45815b080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb450009d90 tx=0x7fb45002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f66e48192ac9b2c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.830+0000 7fb456ffd640 1 -- 172.21.15.77:0/2079012239 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45002cc60 con 0x7fb4580b2aa0 2023-11-26T07:20:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.830+0000 7fb456ffd640 1 -- 172.21.15.77:0/2079012239 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45002cdc0 con 0x7fb4580b2aa0 2023-11-26T07:20:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.830+0000 7fb456ffd640 1 -- 172.21.15.77:0/2079012239 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450034660 con 0x7fb4580b2aa0 2023-11-26T07:20:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.830+0000 7fb45e11d640 1 -- 172.21.15.77:0/2079012239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4580b2aa0 msgr2=0x7fb45815b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.830+0000 7fb45e11d640 1 --2- 172.21.15.77:0/2079012239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4580b2aa0 0x7fb45815b080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb450009d90 tx=0x7fb45002beb0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.830+0000 7fb45e11d640 1 -- 172.21.15.77:0/2079012239 shutdown_connections 2023-11-26T07:20:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.830+0000 7fb45e11d640 1 --2- 172.21.15.77:0/2079012239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4580b2aa0 0x7fb45815b080 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.830+0000 7fb45e11d640 1 --2- 172.21.15.77:0/2079012239 >> v2:172.21.15.159:3300/0 conn(0x7fb4580b2250 0x7fb45815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.830+0000 7fb45e11d640 1 -- 172.21.15.77:0/2079012239 >> 172.21.15.77:0/2079012239 conn(0x7fb45806a920 msgr2=0x7fb45806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.831+0000 7fb45e11d640 1 -- 172.21.15.77:0/2079012239 shutdown_connections 2023-11-26T07:20:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.831+0000 7fb45e11d640 1 -- 172.21.15.77:0/2079012239 wait complete. 2023-11-26T07:20:23.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.832+0000 7fb45e11d640 1 Processor -- start 2023-11-26T07:20:23.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.832+0000 7fb45e11d640 1 -- start start 2023-11-26T07:20:23.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.833+0000 7fb45e11d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4580b2250 0x7fb45814db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.833+0000 7fb45e11d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4580b2630 0x7fb4580ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.833+0000 7fb45e11d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4580b2aa0 0x7fb458071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.833+0000 7fb45e11d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45815a310 con 0x7fb4580b2250 2023-11-26T07:20:23.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.833+0000 7fb45e11d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45815a030 con 0x7fb4580b2aa0 2023-11-26T07:20:23.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.833+0000 7fb45e11d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580710e0 con 0x7fb4580b2630 2023-11-26T07:20:23.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb4577fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4580b2250 0x7fb45814db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb4577fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4580b2250 0x7fb45814db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39576/0 (socket says 172.21.15.77:39576) 2023-11-26T07:20:23.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb4577fe640 1 -- 172.21.15.77:0/399006290 learned_addr learned my addr 172.21.15.77:0/399006290 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:23.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb457fff640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4580b2aa0 0x7fb458071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb4577fe640 1 -- 172.21.15.77:0/399006290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4580b2630 msgr2=0x7fb4580ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb44ffff640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4580b2630 0x7fb4580ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb4577fe640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4580b2630 0x7fb4580ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb4577fe640 1 -- 172.21.15.77:0/399006290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4580b2aa0 msgr2=0x7fb458071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb4577fe640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4580b2aa0 0x7fb458071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb4577fe640 1 -- 172.21.15.77:0/399006290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb448009400 con 0x7fb4580b2250 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb457fff640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4580b2aa0 0x7fb458071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.834+0000 7fb4577fe640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4580b2250 0x7fb45814db20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb44800ebe0 tx=0x7fb44800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.835+0000 7fb454ff9640 1 -- 172.21.15.77:0/399006290 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448009760 con 0x7fb4580b2250 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.835+0000 7fb454ff9640 1 -- 172.21.15.77:0/399006290 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44800cc30 con 0x7fb4580b2250 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.835+0000 7fb454ff9640 1 -- 172.21.15.77:0/399006290 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800eee0 con 0x7fb4580b2250 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.835+0000 7fb45e11d640 1 -- 172.21.15.77:0/399006290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb450009a70 con 0x7fb4580b2250 2023-11-26T07:20:23.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.835+0000 7fb45e11d640 1 -- 172.21.15.77:0/399006290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4580cd7c0 con 0x7fb4580b2250 2023-11-26T07:20:23.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.836+0000 7fb45e11d640 1 -- 172.21.15.77:0/399006290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4580728c0 con 0x7fb4580b2250 2023-11-26T07:20:23.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.837+0000 7fb454ff9640 1 -- 172.21.15.77:0/399006290 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fb448013470 con 0x7fb4580b2250 2023-11-26T07:20:23.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.838+0000 7fb454ff9640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb43806b110 0x7fb43806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.838+0000 7fb454ff9640 1 -- 172.21.15.77:0/399006290 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb448089da0 con 0x7fb4580b2250 2023-11-26T07:20:23.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.838+0000 7fb44ffff640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb43806b110 0x7fb43806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.839+0000 7fb44ffff640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb43806b110 0x7fb43806d5d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb45809d1c0 tx=0x7fb440009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:23.843+0000 7fb454ff9640 1 -- 172.21.15.77:0/399006290 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb448054ab0 con 0x7fb4580b2250 2023-11-26T07:20:24.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.075+0000 7fb45e11d640 1 -- 172.21.15.77:0/399006290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb458067470 con 0x7fb4580b2250 2023-11-26T07:20:24.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.076+0000 7fb454ff9640 1 -- 172.21.15.77:0/399006290 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb4480580d0 con 0x7fb4580b2250 2023-11-26T07:20:24.079 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:20:24.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 -- 172.21.15.77:0/399006290 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb43806b110 msgr2=0x7fb43806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb43806b110 0x7fb43806d5d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb45809d1c0 tx=0x7fb440009040 comp rx=0 tx=0).stop 2023-11-26T07:20:24.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 -- 172.21.15.77:0/399006290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4580b2250 msgr2=0x7fb45814db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4580b2250 0x7fb45814db20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb44800ebe0 tx=0x7fb44800c520 comp rx=0 tx=0).stop 2023-11-26T07:20:24.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 -- 172.21.15.77:0/399006290 shutdown_connections 2023-11-26T07:20:24.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb43806b110 0x7fb43806d5d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4580b2aa0 0x7fb458071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4580b2630 0x7fb4580ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 --2- 172.21.15.77:0/399006290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4580b2250 0x7fb45814db20 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 -- 172.21.15.77:0/399006290 >> 172.21.15.77:0/399006290 conn(0x7fb45806a920 msgr2=0x7fb4580ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:24.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 -- 172.21.15.77:0/399006290 shutdown_connections 2023-11-26T07:20:24.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:24.079+0000 7fb45e11d640 1 -- 172.21.15.77:0/399006290 wait complete. 2023-11-26T07:20:24.100 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:20:24.101 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:20:24.101 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-26T07:20:24.101 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:20:24.101 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:20:24.101 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:20:24.101 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:20:24.101 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:20:24.101 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:20:24.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:24.101 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-26T07:20:24.154 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:20:24.154 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:20:24.154 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:20:24.154 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:24.154 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-26T07:20:24.154 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:24.154 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:20:24.154 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42225sec preferred_lft 42225sec 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:20:24.155 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 36:2c:fb:c0:b0:85 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::609f:3dff:fe4d:944c/64 scope link 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether ba:55:90:99:11:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::b855:90ff:fe99:11fe/64 scope link 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 36:2c:fb:c0:b0:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::342c:fbff:fec0:b085/64 scope link 2023-11-26T07:20:24.156 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:24.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:24.157 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:20:24.244 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-26T07:20:24.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:24.249 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-26T07:20:24.303 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-26T07:20:24.303 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:20:24.303 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:20:24.303 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:20:24.303 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:20:24.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:24.304 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:20:24.304 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:20:24.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:20:24.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:20:24.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:20:24.304 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:20:24.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:24.491 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-26T07:20:24.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:20:24.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:20:24.540 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:20:24.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:24.540 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-26T07:20:24.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:20:24.628 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:20:24.681 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:20:24.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:20:24.681 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:20:24.732 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:20:24.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:24.732 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:20:24.870 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:20:24.871 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:20:24.871 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:20:24.892 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:20:24.892 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:20:24.892 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:20:24.892 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:20:24.893 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:20:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:20:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:20:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:20:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:20:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:20:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:20:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:20:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:20:24.923 INFO:teuthology.orchestra.run.smithi077.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-26T07:20:24.923 INFO:teuthology.orchestra.run.smithi077.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:20:24.923 INFO:teuthology.orchestra.run.smithi077.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:20:24.923 INFO:teuthology.orchestra.run.smithi077.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:20:24.923 INFO:teuthology.orchestra.run.smithi077.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:20:24.928 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:20:24.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:24.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:20:25.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:25.020 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:20:25.090 INFO:teuthology.orchestra.run.smithi077.stdout:client4772 2023-11-26T07:20:25.090 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:25.090 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:25.141 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:20:25.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.348+0000 7ff2c88da640 1 Processor -- start 2023-11-26T07:20:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.348+0000 7ff2c88da640 1 -- start start 2023-11-26T07:20:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.349+0000 7ff2c88da640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff2c40b2250 0x7ff2c415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.349+0000 7ff2c88da640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2c40b2630 0x7ff2c40ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.349+0000 7ff2c88da640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c415ab80 con 0x7ff2c40b2aa0 2023-11-26T07:20:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.349+0000 7ff2c88da640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c415a990 con 0x7ff2c40b2630 2023-11-26T07:20:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.349+0000 7ff2c88da640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c415e680 con 0x7ff2c40b2250 2023-11-26T07:20:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.350+0000 7ff2b9d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2c40b2630 0x7ff2c40ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.350+0000 7ff2b9d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2c40b2630 0x7ff2c40ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39582/0 (socket says 172.21.15.77:39582) 2023-11-26T07:20:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.350+0000 7ff2b9d9b640 1 -- 172.21.15.77:0/1555939087 learned_addr learned my addr 172.21.15.77:0/1555939087 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.350+0000 7ff2b9d9b640 1 -- 172.21.15.77:0/1555939087 >> v2:172.21.15.159:3300/0 conn(0x7ff2c40b2250 msgr2=0x7ff2c415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.350+0000 7ff2b9d9b640 1 --2- 172.21.15.77:0/1555939087 >> v2:172.21.15.159:3300/0 conn(0x7ff2c40b2250 0x7ff2c415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.350+0000 7ff2b9d9b640 1 -- 172.21.15.77:0/1555939087 >> v1:172.21.15.159:6789/0 conn(0x7ff2c40b2aa0 legacy=0x7ff2c415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.350+0000 7ff2b9d9b640 1 -- 172.21.15.77:0/1555939087 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c415e960 con 0x7ff2c40b2630 2023-11-26T07:20:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.351+0000 7ff2b9d9b640 1 --2- 172.21.15.77:0/1555939087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2c40b2630 0x7ff2c40ccf30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4072a70 tx=0x7ff2ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3302301a5d402ec8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.352+0000 7ff2c1d9b640 1 -- 172.21.15.77:0/1555939087 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac031870 con 0x7ff2c40b2630 2023-11-26T07:20:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.352+0000 7ff2c1d9b640 1 -- 172.21.15.77:0/1555939087 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac0319d0 con 0x7ff2c40b2630 2023-11-26T07:20:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.352+0000 7ff2c1d9b640 1 -- 172.21.15.77:0/1555939087 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac031d60 con 0x7ff2c40b2630 2023-11-26T07:20:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.352+0000 7ff2c88da640 1 -- 172.21.15.77:0/1555939087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2c40b2630 msgr2=0x7ff2c40ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.352+0000 7ff2c88da640 1 --2- 172.21.15.77:0/1555939087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2c40b2630 0x7ff2c40ccf30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4072a70 tx=0x7ff2ac02b910 comp rx=0 tx=0).stop 2023-11-26T07:20:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.353+0000 7ff2c88da640 1 -- 172.21.15.77:0/1555939087 shutdown_connections 2023-11-26T07:20:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.353+0000 7ff2c88da640 1 --2- 172.21.15.77:0/1555939087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2c40b2630 0x7ff2c40ccf30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.353+0000 7ff2c88da640 1 --2- 172.21.15.77:0/1555939087 >> v2:172.21.15.159:3300/0 conn(0x7ff2c40b2250 0x7ff2c415df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.353+0000 7ff2c88da640 1 -- 172.21.15.77:0/1555939087 >> 172.21.15.77:0/1555939087 conn(0x7ff2c406a920 msgr2=0x7ff2c406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.353+0000 7ff2c88da640 1 -- 172.21.15.77:0/1555939087 shutdown_connections 2023-11-26T07:20:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.353+0000 7ff2c88da640 1 -- 172.21.15.77:0/1555939087 wait complete. 2023-11-26T07:20:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.354+0000 7ff2c88da640 1 Processor -- start 2023-11-26T07:20:25.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.355+0000 7ff2c88da640 1 -- start start 2023-11-26T07:20:25.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.355+0000 7ff2c88da640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2c40b2250 0x7ff2c40aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:25.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.355+0000 7ff2c88da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2c40b2630 0x7ff2c4143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:25.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.355+0000 7ff2c88da640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2c40b2aa0 0x7ff2c415d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:25.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2c88da640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40b18e0 con 0x7ff2c40b2630 2023-11-26T07:20:25.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2c88da640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4097020 con 0x7ff2c40b2250 2023-11-26T07:20:25.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2c88da640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4097300 con 0x7ff2c40b2aa0 2023-11-26T07:20:25.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2b9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2c40b2630 0x7ff2c4143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:25.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2b9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2c40b2630 0x7ff2c4143fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39598/0 (socket says 172.21.15.77:39598) 2023-11-26T07:20:25.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2b9d9b640 1 -- 172.21.15.77:0/747395043 learned_addr learned my addr 172.21.15.77:0/747395043 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2b9d9b640 1 -- 172.21.15.77:0/747395043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2c40b2aa0 msgr2=0x7ff2c415d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2b9d9b640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2c40b2aa0 0x7ff2c415d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2b9d9b640 1 -- 172.21.15.77:0/747395043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2c40b2250 msgr2=0x7ff2c40aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2b9d9b640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2c40b2250 0x7ff2c40aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2b9d9b640 1 -- 172.21.15.77:0/747395043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac0094d0 con 0x7ff2c40b2630 2023-11-26T07:20:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.356+0000 7ff2b9d9b640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2c40b2630 0x7ff2c4143fd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac000c00 tx=0x7ff2ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.357+0000 7ff2bb7fe640 1 -- 172.21.15.77:0/747395043 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac03ad10 con 0x7ff2c40b2630 2023-11-26T07:20:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.357+0000 7ff2bb7fe640 1 -- 172.21.15.77:0/747395043 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac03ae70 con 0x7ff2c40b2630 2023-11-26T07:20:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.357+0000 7ff2bb7fe640 1 -- 172.21.15.77:0/747395043 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac044610 con 0x7ff2c40b2630 2023-11-26T07:20:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.357+0000 7ff2c88da640 1 -- 172.21.15.77:0/747395043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c40975e0 con 0x7ff2c40b2630 2023-11-26T07:20:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.357+0000 7ff2c88da640 1 -- 172.21.15.77:0/747395043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c4097ba0 con 0x7ff2c40b2630 2023-11-26T07:20:25.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.358+0000 7ff2c88da640 1 -- 172.21.15.77:0/747395043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c4067470 con 0x7ff2c40b2630 2023-11-26T07:20:25.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.359+0000 7ff2bb7fe640 1 -- 172.21.15.77:0/747395043 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7ff2ac04d450 con 0x7ff2c40b2630 2023-11-26T07:20:25.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.360+0000 7ff2bb7fe640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2a406b110 0x7ff2a406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:25.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.360+0000 7ff2bb7fe640 1 -- 172.21.15.77:0/747395043 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2ac02d040 con 0x7ff2c40b2630 2023-11-26T07:20:25.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.360+0000 7ff2c259c640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2a406b110 0x7ff2a406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:25.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.361+0000 7ff2c259c640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2a406b110 0x7ff2a406d5d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009710 tx=0x7ff2b4006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:25.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.364+0000 7ff2bb7fe640 1 -- 172.21.15.77:0/747395043 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2ac076ed0 con 0x7ff2c40b2630 2023-11-26T07:20:25.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:20:25.462 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:20:25.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.593+0000 7ff2c88da640 1 -- 172.21.15.77:0/747395043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff2c415e040 con 0x7ff2c40b2630 2023-11-26T07:20:25.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.594+0000 7ff2bb7fe640 1 -- 172.21.15.77:0/747395043 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff2ac07a4f0 con 0x7ff2c40b2630 2023-11-26T07:20:25.596 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:20:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 -- 172.21.15.77:0/747395043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2a406b110 msgr2=0x7ff2a406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2a406b110 0x7ff2a406d5d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009710 tx=0x7ff2b4006c90 comp rx=0 tx=0).stop 2023-11-26T07:20:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 -- 172.21.15.77:0/747395043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2c40b2630 msgr2=0x7ff2c4143fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2c40b2630 0x7ff2c4143fd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac000c00 tx=0x7ff2ac0046c0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 -- 172.21.15.77:0/747395043 shutdown_connections 2023-11-26T07:20:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2a406b110 0x7ff2a406d5d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2c40b2aa0 0x7ff2c415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2c40b2630 0x7ff2c4143fd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 --2- 172.21.15.77:0/747395043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2c40b2250 0x7ff2c40aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 -- 172.21.15.77:0/747395043 >> 172.21.15.77:0/747395043 conn(0x7ff2c406a920 msgr2=0x7ff2c4159170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 -- 172.21.15.77:0/747395043 shutdown_connections 2023-11-26T07:20:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:25.596+0000 7ff2c88da640 1 -- 172.21.15.77:0/747395043 wait complete. 2023-11-26T07:20:25.617 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:20:25.617 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:20:25.618 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-11-26T07:20:25.618 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:20:25.618 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:20:25.618 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:20:25.618 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:20:25.618 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:20:25.618 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:20:25.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:25.618 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-11-26T07:20:25.673 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:20:25.673 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:20:25.673 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:20:25.673 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:25.673 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-11-26T07:20:25.673 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42182sec preferred_lft 42182sec 2023-11-26T07:20:25.674 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 5a:27:d9:14:0a:5b brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::5429:19ff:fe3d:266e/64 scope link 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether be:e0:26:a8:90:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::bce0:26ff:fea8:90e7/64 scope link 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 5a:27:d9:14:0a:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::5827:d9ff:fe14:a5b/64 scope link 2023-11-26T07:20:25.675 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:25.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:25.676 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:20:25.761 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-11-26T07:20:25.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:25.765 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-11-26T07:20:25.816 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-11-26T07:20:25.816 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:20:25.816 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:20:25.817 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:20:25.817 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:20:25.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:25.817 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:20:25.817 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:20:25.817 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:20:25.817 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:20:25.817 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:20:25.817 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:20:25.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:25.995 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-11-26T07:20:26.046 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:20:26.046 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:20:26.047 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:20:26.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:26.047 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-11-26T07:20:26.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:20:26.143 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:20:26.196 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:20:26.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:20:26.196 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:20:26.246 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:20:26.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:26.247 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:20:26.381 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:20:26.382 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:20:26.382 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:20:26.404 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:20:26.404 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:20:26.404 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:20:26.404 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:20:26.404 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:20:26.436 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:20:26.436 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:20:26.436 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:20:26.436 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:20:26.436 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:20:26.436 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:20:26.436 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:20:26.437 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:20:26.441 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-26T07:20:26.441 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:20:26.441 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:20:26.441 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:20:26.441 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:20:26.445 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:20:26.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:26.446 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:20:26.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:26.530 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:20:26.586 INFO:teuthology.orchestra.run.smithi159.stdout:client5841 2023-11-26T07:20:26.586 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:20:26.586 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:26.639 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:20:26.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.867+0000 7f400b12e640 1 Processor -- start 2023-11-26T07:20:26.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.867+0000 7f400b12e640 1 -- start start 2023-11-26T07:20:26.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.869+0000 7f400b12e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f40040d0050 0x7f400415d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.869+0000 7f400b12e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400415ea30 con 0x7f4004160b00 2023-11-26T07:20:26.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.869+0000 7f400b12e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400415de20 con 0x7f40040cfbe0 2023-11-26T07:20:26.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.869+0000 7f400b12e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400415e100 con 0x7f40040d0050 2023-11-26T07:20:26.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.869+0000 7f400a12c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4004160b00 0x7f40040d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48008/0 (socket says 172.21.15.77:48008) 2023-11-26T07:20:26.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.869+0000 7f400a12c640 1 -- 172.21.15.77:0/2308410170 learned_addr learned my addr 172.21.15.77:0/2308410170 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:26.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742980611 0 0) 0x7f400415ea30 con 0x7f4004160b00 2023-11-26T07:20:26.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fec003520 con 0x7f4004160b00 2023-11-26T07:20:26.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400a92d640 1 --2- 172.21.15.77:0/2308410170 >> v2:172.21.15.159:3300/0 conn(0x7f40040d0050 0x7f400415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3428299214 0 0) 0x7f3fec003520 con 0x7f4004160b00 2023-11-26T07:20:26.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 >> v2:172.21.15.159:3300/0 conn(0x7f40040d0050 msgr2=0x7f400415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:26.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 --2- 172.21.15.77:0/2308410170 >> v2:172.21.15.159:3300/0 conn(0x7f40040d0050 0x7f400415d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 >> v1:172.21.15.159:6789/0 conn(0x7f40040cfbe0 legacy=0x7f400415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:26.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400415e3e0 con 0x7f4004160b00 2023-11-26T07:20:26.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f3ff40019f0 con 0x7f4004160b00 2023-11-26T07:20:26.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 >> v1:172.21.15.77:6789/0 conn(0x7f4004160b00 legacy=0x7f40040d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 --2- 172.21.15.77:0/2308410170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec0039c0 0x7f3fec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 --2- 172.21.15.77:0/2308410170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fec0047c0 0x7f3fec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 --2- 172.21.15.77:0/2308410170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0051d0 0x7f3fec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400415e100 con 0x7f3fec0039c0 2023-11-26T07:20:26.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec00c100 con 0x7f3fec0051d0 2023-11-26T07:20:26.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec00c2c0 con 0x7f3fec0047c0 2023-11-26T07:20:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.870+0000 7f400a12c640 1 --2- 172.21.15.77:0/2308410170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec0039c0 0x7f3fec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.871+0000 7f400a12c640 1 -- 172.21.15.77:0/2308410170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fec0047c0 msgr2=0x7f3fec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.871+0000 7f400a12c640 1 --2- 172.21.15.77:0/2308410170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fec0047c0 0x7f3fec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.871+0000 7f400a12c640 1 -- 172.21.15.77:0/2308410170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0051d0 msgr2=0x7f3fec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.871+0000 7f400a12c640 1 --2- 172.21.15.77:0/2308410170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0051d0 0x7f3fec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.871+0000 7f400a12c640 1 -- 172.21.15.77:0/2308410170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec003520 con 0x7f3fec0039c0 2023-11-26T07:20:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.871+0000 7f400a92d640 1 -- 172.21.15.77:0/2308410170 reap_dead start 2023-11-26T07:20:26.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.872+0000 7f400a12c640 1 --2- 172.21.15.77:0/2308410170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec0039c0 0x7f3fec003dc0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400a7e0 tx=0x7f3fec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443b942e360dabf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:26.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.872+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4034630 con 0x7f3fec0039c0 2023-11-26T07:20:26.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.872+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff402f070 con 0x7f3fec0039c0 2023-11-26T07:20:26.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.872+0000 7f400912a640 1 -- 172.21.15.77:0/2308410170 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff40349d0 con 0x7f3fec0039c0 2023-11-26T07:20:26.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.873+0000 7f400b12e640 1 -- 172.21.15.77:0/2308410170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec0039c0 msgr2=0x7f3fec003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.873+0000 7f400b12e640 1 --2- 172.21.15.77:0/2308410170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec0039c0 0x7f3fec003dc0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400a7e0 tx=0x7f3fec0057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.873+0000 7f400b12e640 1 -- 172.21.15.77:0/2308410170 shutdown_connections 2023-11-26T07:20:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.873+0000 7f400b12e640 1 --2- 172.21.15.77:0/2308410170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec0039c0 0x7f3fec003dc0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.873+0000 7f400b12e640 1 -- 172.21.15.77:0/2308410170 >> 172.21.15.77:0/2308410170 conn(0x7f400409c510 msgr2=0x7f40040d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.873+0000 7f400b12e640 1 -- 172.21.15.77:0/2308410170 shutdown_connections 2023-11-26T07:20:26.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.873+0000 7f400b12e640 1 -- 172.21.15.77:0/2308410170 wait complete. 2023-11-26T07:20:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.875+0000 7f400b12e640 1 Processor -- start 2023-11-26T07:20:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.875+0000 7f400b12e640 1 -- start start 2023-11-26T07:20:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.876+0000 7f400b12e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0039c0 0x7f4004157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.876+0000 7f400b12e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40040c82f0 0x7f40040c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.876+0000 7f400b12e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40040b7350 0x7f40040b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.876+0000 7f400b12e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40040b7d10 con 0x7f40040b7350 2023-11-26T07:20:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.876+0000 7f400b12e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4004157fa0 con 0x7f3fec0039c0 2023-11-26T07:20:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.876+0000 7f400b12e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40040c8e40 con 0x7f40040c82f0 2023-11-26T07:20:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.876+0000 7f400a92d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40040b7350 0x7f40040b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.876+0000 7f400a92d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40040b7350 0x7f40040b77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34858/0 (socket says 172.21.15.77:34858) 2023-11-26T07:20:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.876+0000 7f400a92d640 1 -- 172.21.15.77:0/3613499697 learned_addr learned my addr 172.21.15.77:0/3613499697 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f400a92d640 1 -- 172.21.15.77:0/3613499697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40040c82f0 msgr2=0x7f40040c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f400992b640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40040c82f0 0x7f40040c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f400a12c640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0039c0 0x7f4004157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f400a92d640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40040c82f0 0x7f40040c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f400a92d640 1 -- 172.21.15.77:0/3613499697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0039c0 msgr2=0x7f4004157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f400a92d640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0039c0 0x7f4004157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f400a92d640 1 -- 172.21.15.77:0/3613499697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40040c9120 con 0x7f40040b7350 2023-11-26T07:20:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f400992b640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40040c82f0 0x7f40040c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f400a92d640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40040b7350 0x7f40040b77d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f40040d4150 tx=0x7f3ffc00d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f4002ffd640 1 -- 172.21.15.77:0/3613499697 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc004240 con 0x7f40040b7350 2023-11-26T07:20:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f4002ffd640 1 -- 172.21.15.77:0/3613499697 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc0043c0 con 0x7f40040b7350 2023-11-26T07:20:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f4002ffd640 1 -- 172.21.15.77:0/3613499697 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc003850 con 0x7f40040b7350 2023-11-26T07:20:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.877+0000 7f400b12e640 1 -- 172.21.15.77:0/3613499697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40040c9400 con 0x7f40040b7350 2023-11-26T07:20:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.878+0000 7f400b12e640 1 -- 172.21.15.77:0/3613499697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40040c99c0 con 0x7f40040b7350 2023-11-26T07:20:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.878+0000 7f400b12e640 1 -- 172.21.15.77:0/3613499697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40040c9b50 con 0x7f40040b7350 2023-11-26T07:20:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.880+0000 7f4002ffd640 1 -- 172.21.15.77:0/3613499697 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f3ffc0039b0 con 0x7f40040b7350 2023-11-26T07:20:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.880+0000 7f4002ffd640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3ff006b140 0x7f3ff006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.881+0000 7f4002ffd640 1 -- 172.21.15.77:0/3613499697 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ffc089500 con 0x7f40040b7350 2023-11-26T07:20:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.881+0000 7f400a12c640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3ff006b140 0x7f3ff006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.881+0000 7f400a12c640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3ff006b140 0x7f3ff006d600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4034000 tx=0x7f3ff4036040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:26.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:26.885+0000 7f4002ffd640 1 -- 172.21.15.77:0/3613499697 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3ffc0542b0 con 0x7f40040b7350 2023-11-26T07:20:27.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.115+0000 7f400b12e640 1 -- 172.21.15.77:0/3613499697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f400404e840 con 0x7f40040b7350 2023-11-26T07:20:27.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.170+0000 7f4002ffd640 1 -- 172.21.15.77:0/3613499697 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 136+0+0 (secure 0 0 0) 0x7f3ffc0578d0 con 0x7f40040b7350 2023-11-26T07:20:27.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.173+0000 7f400b12e640 1 -- 172.21.15.77:0/3613499697 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3ff006b140 msgr2=0x7f3ff006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.173+0000 7f400b12e640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3ff006b140 0x7f3ff006d600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4034000 tx=0x7f3ff4036040 comp rx=0 tx=0).stop 2023-11-26T07:20:27.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.173+0000 7f400b12e640 1 -- 172.21.15.77:0/3613499697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40040b7350 msgr2=0x7f40040b77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.173+0000 7f400b12e640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40040b7350 0x7f40040b77d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f40040d4150 tx=0x7f3ffc00d8a0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.174+0000 7f400b12e640 1 -- 172.21.15.77:0/3613499697 shutdown_connections 2023-11-26T07:20:27.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.174+0000 7f400b12e640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3ff006b140 0x7f3ff006d600 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.174+0000 7f400b12e640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40040b7350 0x7f40040b77d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.174+0000 7f400b12e640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40040c82f0 0x7f40040c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.174+0000 7f400b12e640 1 --2- 172.21.15.77:0/3613499697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fec0039c0 0x7f4004157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.174+0000 7f400b12e640 1 -- 172.21.15.77:0/3613499697 >> 172.21.15.77:0/3613499697 conn(0x7f400409c510 msgr2=0x7f400406c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:27.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.174+0000 7f400b12e640 1 -- 172.21.15.77:0/3613499697 shutdown_connections 2023-11-26T07:20:27.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.174+0000 7f400b12e640 1 -- 172.21.15.77:0/3613499697 wait complete. 2023-11-26T07:20:27.198 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:20:27.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.413+0000 7f03542e0640 1 Processor -- start 2023-11-26T07:20:27.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.413+0000 7f03542e0640 1 -- start start 2023-11-26T07:20:27.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.414+0000 7f03542e0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f034c15d270 0x7f034c15d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.414+0000 7f03542e0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f034c161260 0x7f034c1616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.414+0000 7f03542e0640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034c15db90 con 0x7f034c0ceb10 2023-11-26T07:20:27.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.414+0000 7f03542e0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c161ce0 con 0x7f034c161260 2023-11-26T07:20:27.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.414+0000 7f03542e0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c161fc0 con 0x7f034c15d270 2023-11-26T07:20:27.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.415+0000 7f035187b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f034c161260 0x7f034c1616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.415+0000 7f035187b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f034c161260 0x7f034c1616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34866/0 (socket says 172.21.15.77:34866) 2023-11-26T07:20:27.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.415+0000 7f035187b640 1 -- 172.21.15.77:0/2103973788 learned_addr learned my addr 172.21.15.77:0/2103973788 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:27.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.415+0000 7f035187b640 1 -- 172.21.15.77:0/2103973788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f034c15d270 msgr2=0x7f034c15d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:27.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.415+0000 7f035187b640 1 --2- 172.21.15.77:0/2103973788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f034c15d270 0x7f034c15d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.415+0000 7f035187b640 1 -- 172.21.15.77:0/2103973788 >> v1:172.21.15.159:6789/0 conn(0x7f034c0ceb10 legacy=0x7f034c0d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:27.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.415+0000 7f035187b640 1 -- 172.21.15.77:0/2103973788 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c0ce310 con 0x7f034c161260 2023-11-26T07:20:27.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.416+0000 7f035187b640 1 --2- 172.21.15.77:0/2103973788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034c161260 0x7f034c1616c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f033c009870 tx=0x7f033c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e78e5688c6c631 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.417+0000 7f035107a640 1 -- 172.21.15.77:0/2103973788 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c031640 con 0x7f034c161260 2023-11-26T07:20:27.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.417+0000 7f035107a640 1 -- 172.21.15.77:0/2103973788 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c0317a0 con 0x7f034c161260 2023-11-26T07:20:27.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.417+0000 7f035107a640 1 -- 172.21.15.77:0/2103973788 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c031b30 con 0x7f034c161260 2023-11-26T07:20:27.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.417+0000 7f03542e0640 1 -- 172.21.15.77:0/2103973788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034c161260 msgr2=0x7f034c1616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.417+0000 7f03542e0640 1 --2- 172.21.15.77:0/2103973788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034c161260 0x7f034c1616c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f033c009870 tx=0x7f033c02b8f0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.417+0000 7f03542e0640 1 -- 172.21.15.77:0/2103973788 shutdown_connections 2023-11-26T07:20:27.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.417+0000 7f03542e0640 1 --2- 172.21.15.77:0/2103973788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034c161260 0x7f034c1616c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.417+0000 7f03542e0640 1 --2- 172.21.15.77:0/2103973788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f034c15d270 0x7f034c15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.417+0000 7f03542e0640 1 -- 172.21.15.77:0/2103973788 >> 172.21.15.77:0/2103973788 conn(0x7f034c08af60 msgr2=0x7f034c09c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:27.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.418+0000 7f03542e0640 1 -- 172.21.15.77:0/2103973788 shutdown_connections 2023-11-26T07:20:27.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.418+0000 7f03542e0640 1 -- 172.21.15.77:0/2103973788 wait complete. 2023-11-26T07:20:27.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.419+0000 7f03542e0640 1 Processor -- start 2023-11-26T07:20:27.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.419+0000 7f03542e0640 1 -- start start 2023-11-26T07:20:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.420+0000 7f03542e0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f034c0ceb10 0x7f034c1e9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.420+0000 7f03542e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034c15d270 0x7f034c0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.420+0000 7f03542e0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f034c161260 0x7f034c15ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.420+0000 7f03542e0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c160230 con 0x7f034c15d270 2023-11-26T07:20:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.420+0000 7f03542e0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c15f990 con 0x7f034c0ceb10 2023-11-26T07:20:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.420+0000 7f03542e0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c15fc70 con 0x7f034c161260 2023-11-26T07:20:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.421+0000 7f035187b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034c15d270 0x7f034c0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.421+0000 7f035187b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034c15d270 0x7f034c0b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34874/0 (socket says 172.21.15.77:34874) 2023-11-26T07:20:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.421+0000 7f035187b640 1 -- 172.21.15.77:0/1513607836 learned_addr learned my addr 172.21.15.77:0/1513607836 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.421+0000 7f035187b640 1 -- 172.21.15.77:0/1513607836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f034c161260 msgr2=0x7f034c15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.421+0000 7f035187b640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f034c161260 0x7f034c15ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.421+0000 7f035187b640 1 -- 172.21.15.77:0/1513607836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f034c0ceb10 msgr2=0x7f034c1e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.421+0000 7f035187b640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f034c0ceb10 0x7f034c1e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.421+0000 7f035187b640 1 -- 172.21.15.77:0/1513607836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0094d0 con 0x7f034c15d270 2023-11-26T07:20:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.421+0000 7f035187b640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034c15d270 0x7f034c0b1fe0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f033c009870 tx=0x7f033c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.422+0000 7f0342ffd640 1 -- 172.21.15.77:0/1513607836 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c03ac60 con 0x7f034c15d270 2023-11-26T07:20:27.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.422+0000 7f0342ffd640 1 -- 172.21.15.77:0/1513607836 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c03adc0 con 0x7f034c15d270 2023-11-26T07:20:27.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.422+0000 7f0342ffd640 1 -- 172.21.15.77:0/1513607836 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c044630 con 0x7f034c15d270 2023-11-26T07:20:27.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.422+0000 7f03542e0640 1 -- 172.21.15.77:0/1513607836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c15ff50 con 0x7f034c15d270 2023-11-26T07:20:27.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.422+0000 7f03542e0640 1 -- 172.21.15.77:0/1513607836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c0b2520 con 0x7f034c15d270 2023-11-26T07:20:27.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.423+0000 7f03542e0640 1 -- 172.21.15.77:0/1513607836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034c154260 con 0x7f034c15d270 2023-11-26T07:20:27.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.424+0000 7f0342ffd640 1 -- 172.21.15.77:0/1513607836 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f033c02f050 con 0x7f034c15d270 2023-11-26T07:20:27.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.425+0000 7f0342ffd640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f033006b110 0x7f033006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.425+0000 7f0342ffd640 1 -- 172.21.15.77:0/1513607836 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f033c0abbc0 con 0x7f034c15d270 2023-11-26T07:20:27.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.425+0000 7f035207c640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f033006b110 0x7f033006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.426+0000 7f035207c640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f033006b110 0x7f033006d5d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0348009710 tx=0x7f0348006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.429+0000 7f0342ffd640 1 -- 172.21.15.77:0/1513607836 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f034c154260 con 0x7f034c15d270 2023-11-26T07:20:27.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.643+0000 7f03542e0640 1 -- 172.21.15.77:0/1513607836 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f034c067590 con 0x7f033006b110 2023-11-26T07:20:27.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.646+0000 7f0342ffd640 1 -- 172.21.15.77:0/1513607836 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f034c067590 con 0x7f033006b110 2023-11-26T07:20:27.649 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-26T07:20:27.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:20:27.649 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cephfs" 2023-11-26T07:20:27.649 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:27.650 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-26T07:20:27.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 -- 172.21.15.77:0/1513607836 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f033006b110 msgr2=0x7f033006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f033006b110 0x7f033006d5d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0348009710 tx=0x7f0348006c90 comp rx=0 tx=0).stop 2023-11-26T07:20:27.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 -- 172.21.15.77:0/1513607836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034c15d270 msgr2=0x7f034c0b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034c15d270 0x7f034c0b1fe0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f033c009870 tx=0x7f033c0046c0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 -- 172.21.15.77:0/1513607836 shutdown_connections 2023-11-26T07:20:27.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f033006b110 0x7f033006d5d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f034c161260 0x7f034c15ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034c15d270 0x7f034c0b1fe0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 --2- 172.21.15.77:0/1513607836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f034c0ceb10 0x7f034c1e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 -- 172.21.15.77:0/1513607836 >> 172.21.15.77:0/1513607836 conn(0x7f034c08af60 msgr2=0x7f034c06bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 -- 172.21.15.77:0/1513607836 shutdown_connections 2023-11-26T07:20:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.649+0000 7f03542e0640 1 -- 172.21.15.77:0/1513607836 wait complete. 2023-11-26T07:20:27.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:20:27.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.878+0000 7f50e923d640 1 Processor -- start 2023-11-26T07:20:27.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.878+0000 7f50e923d640 1 -- start start 2023-11-26T07:20:27.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.880+0000 7f50e923d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f50e415b440 0x7f50e40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.880+0000 7f50e923d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50e40c59b0 0x7f50e406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.880+0000 7f50e923d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e415eea0 con 0x7f50e40cbf20 2023-11-26T07:20:27.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.880+0000 7f50e923d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e40c5e00 con 0x7f50e415b440 2023-11-26T07:20:27.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.880+0000 7f50e923d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40cc3d0 con 0x7f50e40c59b0 2023-11-26T07:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.880+0000 7f50e2d9d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f50e415b440 0x7f50e40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.880+0000 7f50e359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50e40c59b0 0x7f50e406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.881+0000 7f50e2d9d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f50e415b440 0x7f50e40cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:41416/0 (socket says 172.21.15.77:41416) 2023-11-26T07:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.881+0000 7f50e2d9d640 1 -- 172.21.15.77:0/931520641 learned_addr learned my addr 172.21.15.77:0/931520641 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.880+0000 7f50e259c640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f50e40cbf20 0x7f50e40c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:53922/0 (socket says 172.21.15.77:53922) 2023-11-26T07:20:27.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.881+0000 7f50e2d9d640 1 -- 172.21.15.77:0/931520641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50e40c59b0 msgr2=0x7f50e406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:27.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.881+0000 7f50e2d9d640 1 --2- 172.21.15.77:0/931520641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50e40c59b0 0x7f50e406c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.881+0000 7f50e2d9d640 1 -- 172.21.15.77:0/931520641 >> v1:172.21.15.159:6789/0 conn(0x7f50e40cbf20 legacy=0x7f50e40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.881+0000 7f50e2d9d640 1 -- 172.21.15.77:0/931520641 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e40abf30 con 0x7f50e415b440 2023-11-26T07:20:27.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.883+0000 7f50e2d9d640 1 --2- 172.21.15.77:0/931520641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50e415b440 0x7f50e40cb9e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009870 tx=0x7f50d402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f1f4b6be2c742a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.883+0000 7f50e1d9b640 1 -- 172.21.15.77:0/931520641 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4031640 con 0x7f50e415b440 2023-11-26T07:20:27.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.883+0000 7f50e1d9b640 1 -- 172.21.15.77:0/931520641 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d40317a0 con 0x7f50e415b440 2023-11-26T07:20:27.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.883+0000 7f50e1d9b640 1 -- 172.21.15.77:0/931520641 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4031b30 con 0x7f50e415b440 2023-11-26T07:20:27.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.884+0000 7f50e923d640 1 -- 172.21.15.77:0/931520641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50e415b440 msgr2=0x7f50e40cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.884+0000 7f50e923d640 1 --2- 172.21.15.77:0/931520641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50e415b440 0x7f50e40cb9e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009870 tx=0x7f50d402b8f0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.884+0000 7f50e923d640 1 -- 172.21.15.77:0/931520641 shutdown_connections 2023-11-26T07:20:27.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.884+0000 7f50e923d640 1 --2- 172.21.15.77:0/931520641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50e40c59b0 0x7f50e406c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.884+0000 7f50e923d640 1 --2- 172.21.15.77:0/931520641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50e415b440 0x7f50e40cb9e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.884+0000 7f50e923d640 1 -- 172.21.15.77:0/931520641 >> 172.21.15.77:0/931520641 conn(0x7f50e40b0c50 msgr2=0x7f50e40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:27.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.884+0000 7f50e923d640 1 -- 172.21.15.77:0/931520641 shutdown_connections 2023-11-26T07:20:27.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.884+0000 7f50e923d640 1 -- 172.21.15.77:0/931520641 wait complete. 2023-11-26T07:20:27.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.886+0000 7f50e923d640 1 Processor -- start 2023-11-26T07:20:27.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.886+0000 7f50e923d640 1 -- start start 2023-11-26T07:20:27.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.887+0000 7f50e923d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50e40c59b0 0x7f50e40c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.887+0000 7f50e923d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50e40cbf20 0x7f50e4152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.887+0000 7f50e923d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50e415b440 0x7f50e40ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.887+0000 7f50e923d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e41f6950 con 0x7f50e40cbf20 2023-11-26T07:20:27.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.887+0000 7f50e923d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40c89c0 con 0x7f50e415b440 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.887+0000 7f50e923d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e41f6bf0 con 0x7f50e40c59b0 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.887+0000 7f50e259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50e40cbf20 0x7f50e4152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.888+0000 7f50e259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50e40cbf20 0x7f50e4152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34876/0 (socket says 172.21.15.77:34876) 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.888+0000 7f50e259c640 1 -- 172.21.15.77:0/2794691487 learned_addr learned my addr 172.21.15.77:0/2794691487 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.888+0000 7f50e2d9d640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50e40c59b0 0x7f50e40c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.888+0000 7f50e359e640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50e415b440 0x7f50e40ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.888+0000 7f50e259c640 1 -- 172.21.15.77:0/2794691487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50e40c59b0 msgr2=0x7f50e40c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.888+0000 7f50e259c640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50e40c59b0 0x7f50e40c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.888+0000 7f50e259c640 1 -- 172.21.15.77:0/2794691487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50e415b440 msgr2=0x7f50e40ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.888+0000 7f50e259c640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50e415b440 0x7f50e40ad6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.888+0000 7f50e259c640 1 -- 172.21.15.77:0/2794691487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40094d0 con 0x7f50e40cbf20 2023-11-26T07:20:27.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.888+0000 7f50e259c640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50e40cbf20 0x7f50e4152630 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f50d800c400 tx=0x7f50d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.889+0000 7f50cb7fe640 1 -- 172.21.15.77:0/2794691487 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d80074e0 con 0x7f50e40cbf20 2023-11-26T07:20:27.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.889+0000 7f50cb7fe640 1 -- 172.21.15.77:0/2794691487 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8007640 con 0x7f50e40cbf20 2023-11-26T07:20:27.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.889+0000 7f50cb7fe640 1 -- 172.21.15.77:0/2794691487 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8004a00 con 0x7f50e40cbf20 2023-11-26T07:20:27.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.889+0000 7f50e923d640 1 -- 172.21.15.77:0/2794691487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e41f6ed0 con 0x7f50e40cbf20 2023-11-26T07:20:27.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.889+0000 7f50e923d640 1 -- 172.21.15.77:0/2794691487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e41f76d0 con 0x7f50e40cbf20 2023-11-26T07:20:27.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.890+0000 7f50e923d640 1 -- 172.21.15.77:0/2794691487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e41f73f0 con 0x7f50e40cbf20 2023-11-26T07:20:27.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.891+0000 7f50cb7fe640 1 -- 172.21.15.77:0/2794691487 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f50d8004b60 con 0x7f50e40cbf20 2023-11-26T07:20:27.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.892+0000 7f50cb7fe640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f50d006b110 0x7f50d006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.892+0000 7f50cb7fe640 1 -- 172.21.15.77:0/2794691487 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50d80894a0 con 0x7f50e40cbf20 2023-11-26T07:20:27.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.892+0000 7f50e2d9d640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f50d006b110 0x7f50d006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.893+0000 7f50e2d9d640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f50d006b110 0x7f50d006d5d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50d4036000 tx=0x7f50d403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:27.896+0000 7f50cb7fe640 1 -- 172.21.15.77:0/2794691487 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50e41f73f0 con 0x7f50e40cbf20 2023-11-26T07:20:28.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.086+0000 7f50e923d640 1 -- 172.21.15.77:0/2794691487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f50e41f73f0 con 0x7f50e40cbf20 2023-11-26T07:20:28.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.087+0000 7f50cb7fe640 1 -- 172.21.15.77:0/2794691487 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f50e41f73f0 con 0x7f50e40cbf20 2023-11-26T07:20:28.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 -- 172.21.15.77:0/2794691487 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f50d006b110 msgr2=0x7f50d006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f50d006b110 0x7f50d006d5d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50d4036000 tx=0x7f50d403c040 comp rx=0 tx=0).stop 2023-11-26T07:20:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 -- 172.21.15.77:0/2794691487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50e40cbf20 msgr2=0x7f50e4152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50e40cbf20 0x7f50e4152630 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f50d800c400 tx=0x7f50d800c8c0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 -- 172.21.15.77:0/2794691487 shutdown_connections 2023-11-26T07:20:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f50d006b110 0x7f50d006d5d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50e415b440 0x7f50e40ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50e40cbf20 0x7f50e4152630 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 --2- 172.21.15.77:0/2794691487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50e40c59b0 0x7f50e40c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 -- 172.21.15.77:0/2794691487 >> 172.21.15.77:0/2794691487 conn(0x7f50e40b0c50 msgr2=0x7f50e40cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 -- 172.21.15.77:0/2794691487 shutdown_connections 2023-11-26T07:20:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.090+0000 7f50e923d640 1 -- 172.21.15.77:0/2794691487 wait complete. 2023-11-26T07:20:28.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol51880 --mode=777 2023-11-26T07:20:28.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.320+0000 7fb34df67640 1 Processor -- start 2023-11-26T07:20:28.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.320+0000 7fb34df67640 1 -- start start 2023-11-26T07:20:28.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.322+0000 7fb34df67640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb348144510 0x7fb34806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.322+0000 7fb34df67640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb34815edd0 0x7fb3480b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.322+0000 7fb34df67640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3481448f0 con 0x7fb3480ccd00 2023-11-26T07:20:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.322+0000 7fb34df67640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb348144d80 con 0x7fb34815edd0 2023-11-26T07:20:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.322+0000 7fb34df67640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34815f2d0 con 0x7fb348144510 2023-11-26T07:20:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.322+0000 7fb347fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb34815edd0 0x7fb3480b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.322+0000 7fb347fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb34815edd0 0x7fb3480b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34878/0 (socket says 172.21.15.77:34878) 2023-11-26T07:20:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.322+0000 7fb347fff640 1 -- 172.21.15.77:0/1110798709 learned_addr learned my addr 172.21.15.77:0/1110798709 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.323+0000 7fb34cf65640 1 --2- 172.21.15.77:0/1110798709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb348144510 0x7fb34806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.323+0000 7fb347fff640 1 -- 172.21.15.77:0/1110798709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb348144510 msgr2=0x7fb34806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.323+0000 7fb347fff640 1 --2- 172.21.15.77:0/1110798709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb348144510 0x7fb34806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.323+0000 7fb347fff640 1 -- 172.21.15.77:0/1110798709 >> v1:172.21.15.159:6789/0 conn(0x7fb3480ccd00 legacy=0x7fb3480b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.323+0000 7fb347fff640 1 -- 172.21.15.77:0/1110798709 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34815f5b0 con 0x7fb34815edd0 2023-11-26T07:20:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.323+0000 7fb34cf65640 1 --2- 172.21.15.77:0/1110798709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb348144510 0x7fb34806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.324+0000 7fb347fff640 1 --2- 172.21.15.77:0/1110798709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb34815edd0 0x7fb3480b0ae0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb334009850 tx=0x7fb33402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102c97fcfeaab860 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.324+0000 7fb3477fe640 1 -- 172.21.15.77:0/1110798709 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33402e070 con 0x7fb34815edd0 2023-11-26T07:20:28.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.324+0000 7fb3477fe640 1 -- 172.21.15.77:0/1110798709 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb334004030 con 0x7fb34815edd0 2023-11-26T07:20:28.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.324+0000 7fb3477fe640 1 -- 172.21.15.77:0/1110798709 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334004420 con 0x7fb34815edd0 2023-11-26T07:20:28.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.325+0000 7fb34df67640 1 -- 172.21.15.77:0/1110798709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb34815edd0 msgr2=0x7fb3480b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.325+0000 7fb34df67640 1 --2- 172.21.15.77:0/1110798709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb34815edd0 0x7fb3480b0ae0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb334009850 tx=0x7fb33402b840 comp rx=0 tx=0).stop 2023-11-26T07:20:28.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.325+0000 7fb34df67640 1 -- 172.21.15.77:0/1110798709 shutdown_connections 2023-11-26T07:20:28.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.325+0000 7fb34df67640 1 --2- 172.21.15.77:0/1110798709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb34815edd0 0x7fb3480b0ae0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.325+0000 7fb34df67640 1 --2- 172.21.15.77:0/1110798709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb348144510 0x7fb34806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.325+0000 7fb34df67640 1 -- 172.21.15.77:0/1110798709 >> 172.21.15.77:0/1110798709 conn(0x7fb3480cb8a0 msgr2=0x7fb3480cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:28.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.325+0000 7fb34df67640 1 -- 172.21.15.77:0/1110798709 shutdown_connections 2023-11-26T07:20:28.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.325+0000 7fb34df67640 1 -- 172.21.15.77:0/1110798709 wait complete. 2023-11-26T07:20:28.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.327+0000 7fb34df67640 1 Processor -- start 2023-11-26T07:20:28.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.327+0000 7fb34df67640 1 -- start start 2023-11-26T07:20:28.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34df67640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3480ccd00 0x7fb3481401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34df67640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb348144510 0x7fb348157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34df67640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb34815edd0 0x7fb34806cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34df67640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34813cf70 con 0x7fb3480ccd00 2023-11-26T07:20:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34df67640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34813d390 con 0x7fb348144510 2023-11-26T07:20:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34df67640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34813c2f0 con 0x7fb34815edd0 2023-11-26T07:20:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34cf65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3480ccd00 0x7fb3481401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34cf65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3480ccd00 0x7fb3481401e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34886/0 (socket says 172.21.15.77:34886) 2023-11-26T07:20:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34cf65640 1 -- 172.21.15.77:0/2450184338 learned_addr learned my addr 172.21.15.77:0/2450184338 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:28.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34d766640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb34815edd0 0x7fb34806cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34cf65640 1 -- 172.21.15.77:0/2450184338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb34815edd0 msgr2=0x7fb34806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb347fff640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb348144510 0x7fb348157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34cf65640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb34815edd0 0x7fb34806cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34cf65640 1 -- 172.21.15.77:0/2450184338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb348144510 msgr2=0x7fb348157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34cf65640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb348144510 0x7fb348157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.328+0000 7fb34cf65640 1 -- 172.21.15.77:0/2450184338 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb334009460 con 0x7fb3480ccd00 2023-11-26T07:20:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.329+0000 7fb34d766640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb34815edd0 0x7fb34806cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.329+0000 7fb347fff640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb348144510 0x7fb348157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.329+0000 7fb34cf65640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3480ccd00 0x7fb3481401e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c820 tx=0x7fb33c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.329+0000 7fb3457fa640 1 -- 172.21.15.77:0/2450184338 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c007a30 con 0x7fb3480ccd00 2023-11-26T07:20:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.329+0000 7fb3457fa640 1 -- 172.21.15.77:0/2450184338 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c007b90 con 0x7fb3480ccd00 2023-11-26T07:20:28.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.329+0000 7fb3457fa640 1 -- 172.21.15.77:0/2450184338 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00ce70 con 0x7fb3480ccd00 2023-11-26T07:20:28.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.329+0000 7fb34df67640 1 -- 172.21.15.77:0/2450184338 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34813c5d0 con 0x7fb3480ccd00 2023-11-26T07:20:28.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.329+0000 7fb34df67640 1 -- 172.21.15.77:0/2450184338 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34813cb90 con 0x7fb3480ccd00 2023-11-26T07:20:28.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.330+0000 7fb34df67640 1 -- 172.21.15.77:0/2450184338 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34804e840 con 0x7fb3480ccd00 2023-11-26T07:20:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.331+0000 7fb3457fa640 1 -- 172.21.15.77:0/2450184338 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fb33c0113f0 con 0x7fb3480ccd00 2023-11-26T07:20:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.332+0000 7fb3457fa640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb32c06b140 0x7fb32c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.332+0000 7fb3457fa640 1 -- 172.21.15.77:0/2450184338 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb33c089cc0 con 0x7fb3480ccd00 2023-11-26T07:20:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.332+0000 7fb347fff640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb32c06b140 0x7fb32c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.333+0000 7fb347fff640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb32c06b140 0x7fb32c06d600 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb334034000 tx=0x7fb334008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.337+0000 7fb3457fa640 1 -- 172.21.15.77:0/2450184338 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb33c054910 con 0x7fb3480ccd00 2023-11-26T07:20:28.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.542+0000 7fb34df67640 1 -- 172.21.15.77:0/2450184338 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol51880", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3480b3c30 con 0x7fb32c06b140 2023-11-26T07:20:28.556 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:28.554+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:28.557 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:28.554+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:28.557 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:28.554+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:28.557 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:28.554+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:28.557 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:28.554+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:28.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.615+0000 7fb3457fa640 1 -- 172.21.15.77:0/2450184338 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb3340420d0 con 0x7fb32c06b140 2023-11-26T07:20:28.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.617+0000 7fb34df67640 1 -- 172.21.15.77:0/2450184338 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb32c06b140 msgr2=0x7fb32c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.617+0000 7fb34df67640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb32c06b140 0x7fb32c06d600 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb334034000 tx=0x7fb334008030 comp rx=0 tx=0).stop 2023-11-26T07:20:28.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.617+0000 7fb34df67640 1 -- 172.21.15.77:0/2450184338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3480ccd00 msgr2=0x7fb3481401e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.617+0000 7fb34df67640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3480ccd00 0x7fb3481401e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c820 tx=0x7fb33c00cc20 comp rx=0 tx=0).stop 2023-11-26T07:20:28.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.617+0000 7fb34df67640 1 -- 172.21.15.77:0/2450184338 shutdown_connections 2023-11-26T07:20:28.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.617+0000 7fb34df67640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb32c06b140 0x7fb32c06d600 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.617+0000 7fb34df67640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb34815edd0 0x7fb34806cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.617+0000 7fb34df67640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb348144510 0x7fb348157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.617+0000 7fb34df67640 1 --2- 172.21.15.77:0/2450184338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3480ccd00 0x7fb3481401e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.617+0000 7fb34df67640 1 -- 172.21.15.77:0/2450184338 >> 172.21.15.77:0/2450184338 conn(0x7fb3480cb8a0 msgr2=0x7fb3480b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:28.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.617+0000 7fb34df67640 1 -- 172.21.15.77:0/2450184338 shutdown_connections 2023-11-26T07:20:28.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.618+0000 7fb34df67640 1 -- 172.21.15.77:0/2450184338 wait complete. 2023-11-26T07:20:28.637 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol51880 2023-11-26T07:20:28.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.829+0000 7fc898105640 1 Processor -- start 2023-11-26T07:20:28.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.829+0000 7fc898105640 1 -- start start 2023-11-26T07:20:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.831+0000 7fc898105640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc89015b440 0x7fc8900cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.831+0000 7fc898105640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc8900c59b0 0x7fc89006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.831+0000 7fc898105640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8900cc3a0 con 0x7fc8900cbf20 2023-11-26T07:20:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.831+0000 7fc898105640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89015b820 con 0x7fc8900c59b0 2023-11-26T07:20:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.831+0000 7fc898105640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89015eea0 con 0x7fc89015b440 2023-11-26T07:20:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.832+0000 7fc8966a2640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc8900c59b0 0x7fc89006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.832+0000 7fc895ea1640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc89015b440 0x7fc8900cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.832+0000 7fc8956a0640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fc8900cbf20 0x7fc8900c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:53932/0 (socket says 172.21.15.77:53932) 2023-11-26T07:20:28.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.832+0000 7fc8956a0640 1 -- 172.21.15.77:0/3076417591 learned_addr learned my addr 172.21.15.77:0/3076417591 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:28.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.832+0000 7fc8966a2640 1 -- 172.21.15.77:0/3076417591 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc89015b440 msgr2=0x7fc8900cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:28.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.832+0000 7fc8966a2640 1 --2- 172.21.15.77:0/3076417591 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc89015b440 0x7fc8900cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.832+0000 7fc8966a2640 1 -- 172.21.15.77:0/3076417591 >> v1:172.21.15.159:6789/0 conn(0x7fc8900cbf20 legacy=0x7fc8900c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.832+0000 7fc8966a2640 1 -- 172.21.15.77:0/3076417591 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8900abf30 con 0x7fc8900c59b0 2023-11-26T07:20:28.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.834+0000 7fc8966a2640 1 --2- 172.21.15.77:0/3076417591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8900c59b0 0x7fc89006c5f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc888009d90 tx=0x7fc88802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6379b69409d0329 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.834+0000 7fc894e9f640 1 -- 172.21.15.77:0/3076417591 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88802cbc0 con 0x7fc8900c59b0 2023-11-26T07:20:28.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.834+0000 7fc894e9f640 1 -- 172.21.15.77:0/3076417591 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88802cd20 con 0x7fc8900c59b0 2023-11-26T07:20:28.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.834+0000 7fc894e9f640 1 -- 172.21.15.77:0/3076417591 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888034660 con 0x7fc8900c59b0 2023-11-26T07:20:28.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.835+0000 7fc898105640 1 -- 172.21.15.77:0/3076417591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8900c59b0 msgr2=0x7fc89006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.835+0000 7fc898105640 1 --2- 172.21.15.77:0/3076417591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8900c59b0 0x7fc89006c5f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc888009d90 tx=0x7fc88802be10 comp rx=0 tx=0).stop 2023-11-26T07:20:28.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.835+0000 7fc898105640 1 -- 172.21.15.77:0/3076417591 shutdown_connections 2023-11-26T07:20:28.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.835+0000 7fc898105640 1 --2- 172.21.15.77:0/3076417591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8900c59b0 0x7fc89006c5f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.835+0000 7fc898105640 1 --2- 172.21.15.77:0/3076417591 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc89015b440 0x7fc8900cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.835+0000 7fc898105640 1 -- 172.21.15.77:0/3076417591 >> 172.21.15.77:0/3076417591 conn(0x7fc8900b0c50 msgr2=0x7fc8900b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:28.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.835+0000 7fc898105640 1 -- 172.21.15.77:0/3076417591 shutdown_connections 2023-11-26T07:20:28.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.835+0000 7fc898105640 1 -- 172.21.15.77:0/3076417591 wait complete. 2023-11-26T07:20:28.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.837+0000 7fc898105640 1 Processor -- start 2023-11-26T07:20:28.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.837+0000 7fc898105640 1 -- start start 2023-11-26T07:20:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc898105640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8900c59b0 0x7fc8900ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc898105640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8900cbf20 0x7fc8901540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc898105640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89015b440 0x7fc8901566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc898105640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900adbb0 con 0x7fc8900c59b0 2023-11-26T07:20:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc898105640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc890157730 con 0x7fc89015b440 2023-11-26T07:20:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc898105640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8901545f0 con 0x7fc8900cbf20 2023-11-26T07:20:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc895ea1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8900c59b0 0x7fc8900ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc895ea1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8900c59b0 0x7fc8900ad670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34908/0 (socket says 172.21.15.77:34908) 2023-11-26T07:20:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc895ea1640 1 -- 172.21.15.77:0/1021232505 learned_addr learned my addr 172.21.15.77:0/1021232505 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc8956a0640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8900cbf20 0x7fc8901540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc8966a2640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89015b440 0x7fc8901566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc895ea1640 1 -- 172.21.15.77:0/1021232505 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8900cbf20 msgr2=0x7fc8901540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc895ea1640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8900cbf20 0x7fc8901540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc895ea1640 1 -- 172.21.15.77:0/1021232505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89015b440 msgr2=0x7fc8901566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc895ea1640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89015b440 0x7fc8901566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc895ea1640 1 -- 172.21.15.77:0/1021232505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888009a70 con 0x7fc8900c59b0 2023-11-26T07:20:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc8966a2640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89015b440 0x7fc8901566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.839+0000 7fc8956a0640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8900cbf20 0x7fc8901540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.840+0000 7fc895ea1640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8900c59b0 0x7fc8900ad670 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00e8d0 tx=0x7fc88c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.840+0000 7fc8867fc640 1 -- 172.21.15.77:0/1021232505 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c0094f0 con 0x7fc8900c59b0 2023-11-26T07:20:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.840+0000 7fc8867fc640 1 -- 172.21.15.77:0/1021232505 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c00c940 con 0x7fc8900c59b0 2023-11-26T07:20:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.840+0000 7fc898105640 1 -- 172.21.15.77:0/1021232505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc890156bf0 con 0x7fc8900c59b0 2023-11-26T07:20:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.840+0000 7fc8867fc640 1 -- 172.21.15.77:0/1021232505 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c00ccf0 con 0x7fc8900c59b0 2023-11-26T07:20:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.840+0000 7fc898105640 1 -- 172.21.15.77:0/1021232505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc890156f40 con 0x7fc8900c59b0 2023-11-26T07:20:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.841+0000 7fc898105640 1 -- 172.21.15.77:0/1021232505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89004e8b0 con 0x7fc8900c59b0 2023-11-26T07:20:28.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.842+0000 7fc8867fc640 1 -- 172.21.15.77:0/1021232505 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fc88c013470 con 0x7fc8900c59b0 2023-11-26T07:20:28.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.843+0000 7fc8867fc640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc87406b110 0x7fc87406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.843+0000 7fc8867fc640 1 -- 172.21.15.77:0/1021232505 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc88c089f20 con 0x7fc8900c59b0 2023-11-26T07:20:28.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.843+0000 7fc8956a0640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc87406b110 0x7fc87406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.844+0000 7fc8956a0640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc87406b110 0x7fc87406d5d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc8900c9980 tx=0x7fc880009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:28.847+0000 7fc8867fc640 1 -- 172.21.15.77:0/1021232505 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc88c054cb0 con 0x7fc8900c59b0 2023-11-26T07:20:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.065+0000 7fc898105640 1 -- 172.21.15.77:0/1021232505 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol51880", "target": ["mon-mgr", ""]}) v1 -- 0x7fc89015f6b0 con 0x7fc87406b110 2023-11-26T07:20:29.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.073+0000 7fc8867fc640 1 -- 172.21.15.77:0/1021232505 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7fc8800013d0 con 0x7fc87406b110 2023-11-26T07:20:29.076 INFO:teuthology.orchestra.run.smithi077.stdout:/volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590 2023-11-26T07:20:29.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.075+0000 7fc898105640 1 -- 172.21.15.77:0/1021232505 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc87406b110 msgr2=0x7fc87406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.075+0000 7fc898105640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc87406b110 0x7fc87406d5d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc8900c9980 tx=0x7fc880009040 comp rx=0 tx=0).stop 2023-11-26T07:20:29.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.075+0000 7fc898105640 1 -- 172.21.15.77:0/1021232505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8900c59b0 msgr2=0x7fc8900ad670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.075+0000 7fc898105640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8900c59b0 0x7fc8900ad670 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00e8d0 tx=0x7fc88c00ed90 comp rx=0 tx=0).stop 2023-11-26T07:20:29.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.075+0000 7fc898105640 1 -- 172.21.15.77:0/1021232505 shutdown_connections 2023-11-26T07:20:29.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.075+0000 7fc898105640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc87406b110 0x7fc87406d5d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.076+0000 7fc898105640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89015b440 0x7fc8901566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.076+0000 7fc898105640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8900cbf20 0x7fc8901540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.076+0000 7fc898105640 1 --2- 172.21.15.77:0/1021232505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8900c59b0 0x7fc8900ad670 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.076+0000 7fc898105640 1 -- 172.21.15.77:0/1021232505 >> 172.21.15.77:0/1021232505 conn(0x7fc8900b0c50 msgr2=0x7fc890158050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:29.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.076+0000 7fc898105640 1 -- 172.21.15.77:0/1021232505 shutdown_connections 2023-11-26T07:20:29.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:29.076+0000 7fc898105640 1 -- 172.21.15.77:0/1021232505 wait complete. 2023-11-26T07:20:29.096 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol51880 with 200 files each 1MB size under directory volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590 2023-11-26T07:20:29.096 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:29.096 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:29.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:29.146 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:29.289 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:29.289 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:29.289 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324218 s, 32.3 MB/s 2023-11-26T07:20:29.292 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:29.292 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:29.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:29.349 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221096 s, 47.4 MB/s 2023-11-26T07:20:29.420 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:29.421 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:29.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:29.475 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:29.551 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:29.551 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:29.551 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244425 s, 42.9 MB/s 2023-11-26T07:20:29.553 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:29.553 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:29.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:29.610 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:29.681 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:29.681 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:29.681 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216977 s, 48.3 MB/s 2023-11-26T07:20:29.682 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:29.682 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:29.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:29.734 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:29.811 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:29.811 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:29.811 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245648 s, 42.7 MB/s 2023-11-26T07:20:29.813 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:29.813 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:29.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:29.870 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:29.959 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:29.959 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:29.959 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312946 s, 33.5 MB/s 2023-11-26T07:20:29.961 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:29.961 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:30.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:30.018 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:30.093 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231065 s, 45.4 MB/s 2023-11-26T07:20:30.205 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:30.205 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:30.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:30.268 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:30.399 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:30.399 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:30.399 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294802 s, 35.6 MB/s 2023-11-26T07:20:30.401 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:30.401 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:30.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:30.460 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:30.545 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:30.545 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:30.545 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295368 s, 35.5 MB/s 2023-11-26T07:20:30.547 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:30.547 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:30.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:30.601 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348667 s, 30.1 MB/s 2023-11-26T07:20:30.690 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:30.691 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:30.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:30.747 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:30.825 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:30.825 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:30.826 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268357 s, 39.1 MB/s 2023-11-26T07:20:30.827 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:30.827 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:30.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:30.884 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:30.963 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:30.963 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:30.963 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267214 s, 39.2 MB/s 2023-11-26T07:20:30.964 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:30.965 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:31.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:31.021 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:31.099 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:31.099 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:31.099 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256421 s, 40.9 MB/s 2023-11-26T07:20:31.101 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:31.101 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:31.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:31.159 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:31.236 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:31.236 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:31.236 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207957 s, 50.4 MB/s 2023-11-26T07:20:31.238 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:31.238 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:31.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:31.292 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:31.368 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:31.369 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:31.369 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236775 s, 44.3 MB/s 2023-11-26T07:20:31.370 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:31.370 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:31.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:31.428 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0419598 s, 25.0 MB/s 2023-11-26T07:20:31.524 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:31.524 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:31.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:31.583 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:31.650 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:31.650 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:31.650 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168056 s, 62.4 MB/s 2023-11-26T07:20:31.652 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:31.652 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:31.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:31.705 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:31.793 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:31.793 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:31.793 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349394 s, 30.0 MB/s 2023-11-26T07:20:31.795 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:31.795 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:31.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:31.851 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:31.927 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:31.927 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:31.927 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214093 s, 49.0 MB/s 2023-11-26T07:20:31.928 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:31.928 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:31.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:31.982 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:32.055 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:32.056 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:32.056 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254456 s, 41.2 MB/s 2023-11-26T07:20:32.057 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:32.057 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:32.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:32.115 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:32.202 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:32.203 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:32.203 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347505 s, 30.2 MB/s 2023-11-26T07:20:32.204 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:32.204 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:32.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:32.264 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:32.343 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:32.343 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:32.343 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025603 s, 41.0 MB/s 2023-11-26T07:20:32.344 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:32.344 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:32.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:32.402 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:32.490 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:32.490 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:32.491 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343597 s, 30.5 MB/s 2023-11-26T07:20:32.492 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:32.492 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:32.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:32.549 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172248 s, 60.9 MB/s 2023-11-26T07:20:32.618 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:32.618 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:32.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:32.670 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:32.750 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:32.750 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:32.750 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256069 s, 40.9 MB/s 2023-11-26T07:20:32.752 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:32.752 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:32.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:32.811 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:32.895 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:32.895 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:32.895 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330937 s, 31.7 MB/s 2023-11-26T07:20:32.897 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:32.897 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:32.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:32.951 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:33.038 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:33.039 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:33.039 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315102 s, 33.3 MB/s 2023-11-26T07:20:33.040 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:33.041 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:33.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:33.096 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261081 s, 40.2 MB/s 2023-11-26T07:20:33.177 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:33.177 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:33.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:33.236 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:33.317 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:33.317 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:33.317 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257704 s, 40.7 MB/s 2023-11-26T07:20:33.319 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:33.319 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:33.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:33.376 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242972 s, 43.2 MB/s 2023-11-26T07:20:33.457 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:33.457 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:33.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:33.514 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:33.590 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:33.590 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:33.590 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220388 s, 47.6 MB/s 2023-11-26T07:20:33.592 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:33.592 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:33.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:33.652 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:33.731 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:33.731 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:33.732 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024652 s, 42.5 MB/s 2023-11-26T07:20:33.733 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:33.733 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:33.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:33.786 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:33.865 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:33.865 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:33.865 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256509 s, 40.9 MB/s 2023-11-26T07:20:33.866 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:33.867 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:33.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:33.924 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:34.002 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:34.002 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:34.002 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263313 s, 39.8 MB/s 2023-11-26T07:20:34.004 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:34.004 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:34.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:34.056 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:34.178 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:34.178 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:34.179 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236266 s, 44.4 MB/s 2023-11-26T07:20:34.180 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:34.180 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:34.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:34.240 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:34.317 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:34.318 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:34.318 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229736 s, 45.6 MB/s 2023-11-26T07:20:34.319 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:34.319 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:34.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:34.378 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:34.460 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:34.460 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241845 s, 43.4 MB/s 2023-11-26T07:20:34.462 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:34.462 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:34.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:34.515 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:34.588 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:34.588 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:34.588 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021701 s, 48.3 MB/s 2023-11-26T07:20:34.589 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:34.589 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:34.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:34.642 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:34.727 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:34.727 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:34.727 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029432 s, 35.6 MB/s 2023-11-26T07:20:34.729 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:34.729 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:34.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:34.785 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:34.870 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:34.870 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:34.870 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320762 s, 32.7 MB/s 2023-11-26T07:20:34.872 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:34.872 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:34.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:34.930 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:35.016 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:35.016 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:35.016 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316665 s, 33.1 MB/s 2023-11-26T07:20:35.017 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:35.018 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:35.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:35.074 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:35.147 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:35.147 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:35.147 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225379 s, 46.5 MB/s 2023-11-26T07:20:35.149 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:35.149 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:35.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:35.203 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:35.280 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:35.281 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:35.281 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230551 s, 45.5 MB/s 2023-11-26T07:20:35.282 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:35.282 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:35.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:35.340 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:35.416 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:35.416 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:35.416 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225534 s, 46.5 MB/s 2023-11-26T07:20:35.417 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:35.417 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:35.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:35.475 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:35.562 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:35.562 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:35.562 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333303 s, 31.5 MB/s 2023-11-26T07:20:35.564 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:35.564 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:35.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:35.620 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:35.703 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:35.704 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:35.704 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270402 s, 38.8 MB/s 2023-11-26T07:20:35.705 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:35.705 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:35.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:35.759 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:35.827 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:35.827 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:35.827 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207862 s, 50.4 MB/s 2023-11-26T07:20:35.829 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:35.829 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:35.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:35.880 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:36.004 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:36.004 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:36.004 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239847 s, 43.7 MB/s 2023-11-26T07:20:36.006 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:36.006 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:36.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:36.066 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:36.141 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:36.142 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:36.142 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208021 s, 50.4 MB/s 2023-11-26T07:20:36.143 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:36.143 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:36.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:36.201 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:36.276 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:36.276 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:36.276 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269668 s, 38.9 MB/s 2023-11-26T07:20:36.278 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:36.278 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:36.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:36.333 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:36.403 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:36.403 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:36.403 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228156 s, 46.0 MB/s 2023-11-26T07:20:36.405 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:36.405 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:36.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:36.460 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:36.537 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:36.537 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:36.537 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238491 s, 44.0 MB/s 2023-11-26T07:20:36.539 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:36.539 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:36.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:36.599 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:36.670 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:36.670 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:36.670 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200105 s, 52.4 MB/s 2023-11-26T07:20:36.672 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:36.672 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:36.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:36.727 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:36.805 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:36.805 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:36.805 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235387 s, 44.5 MB/s 2023-11-26T07:20:36.806 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:36.807 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:36.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:36.862 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:36.940 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:36.940 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:36.940 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234584 s, 44.7 MB/s 2023-11-26T07:20:36.942 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:36.942 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:36.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:36.993 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:37.114 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:37.114 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:37.114 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244736 s, 42.8 MB/s 2023-11-26T07:20:37.115 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:37.115 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:37.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:37.167 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:37.292 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:37.292 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:37.292 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232166 s, 45.2 MB/s 2023-11-26T07:20:37.294 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:37.294 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:37.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:37.352 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:37.426 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:37.427 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:37.427 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233779 s, 44.9 MB/s 2023-11-26T07:20:37.428 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:37.428 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:37.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:37.483 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:37.561 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:37.561 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:37.561 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265438 s, 39.5 MB/s 2023-11-26T07:20:37.563 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:37.563 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:37.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:37.619 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:37.691 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:37.692 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:37.692 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202173 s, 51.9 MB/s 2023-11-26T07:20:37.693 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:37.693 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:37.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:37.745 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:37.869 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:37.869 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:37.869 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02303 s, 45.5 MB/s 2023-11-26T07:20:37.871 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:37.871 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:37.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:37.928 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024979 s, 42.0 MB/s 2023-11-26T07:20:38.009 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:38.009 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:38.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.065 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:38.137 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:38.137 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:38.137 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018383 s, 57.0 MB/s 2023-11-26T07:20:38.139 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:38.139 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:38.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.194 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:38.272 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:38.272 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:38.272 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236662 s, 44.3 MB/s 2023-11-26T07:20:38.273 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:38.274 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:38.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.330 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:38.414 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:38.414 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:38.414 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283677 s, 37.0 MB/s 2023-11-26T07:20:38.416 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:38.416 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:38.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.472 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:38.547 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:38.547 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:38.547 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221471 s, 47.3 MB/s 2023-11-26T07:20:38.548 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:38.548 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:38.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.605 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:38.685 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:38.685 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:38.685 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264546 s, 39.6 MB/s 2023-11-26T07:20:38.687 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:38.687 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:38.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.744 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:38.816 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:38.816 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:38.816 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228265 s, 45.9 MB/s 2023-11-26T07:20:38.818 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:38.818 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:38.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.874 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:38.953 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:38.953 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:38.953 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260147 s, 40.3 MB/s 2023-11-26T07:20:38.955 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:38.955 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:39.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.012 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:39.089 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:39.089 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:39.089 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025057 s, 41.8 MB/s 2023-11-26T07:20:39.091 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:39.091 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:39.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.148 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:39.225 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:39.226 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:39.226 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241691 s, 43.4 MB/s 2023-11-26T07:20:39.227 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:39.227 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:39.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.284 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:39.356 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:39.356 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:39.356 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021228 s, 49.4 MB/s 2023-11-26T07:20:39.358 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:39.358 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:39.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.408 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:39.494 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:39.494 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:39.494 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0366827 s, 28.6 MB/s 2023-11-26T07:20:39.496 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:39.496 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:39.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.553 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:39.622 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:39.623 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:39.623 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178067 s, 58.9 MB/s 2023-11-26T07:20:39.624 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:39.624 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:39.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.677 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:39.800 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:39.800 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:39.800 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233557 s, 44.9 MB/s 2023-11-26T07:20:39.802 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:39.802 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:39.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.857 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:39.943 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:39.943 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:39.943 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311761 s, 33.6 MB/s 2023-11-26T07:20:39.944 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:39.944 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:40.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.000 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:40.077 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:40.077 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:40.077 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217291 s, 48.3 MB/s 2023-11-26T07:20:40.079 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:40.079 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:40.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.136 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:40.213 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:40.213 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:40.213 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240835 s, 43.5 MB/s 2023-11-26T07:20:40.215 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:40.215 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:40.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.271 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:40.352 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:40.352 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:40.353 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279134 s, 37.6 MB/s 2023-11-26T07:20:40.354 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:40.354 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:40.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.410 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263183 s, 39.8 MB/s 2023-11-26T07:20:40.493 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:40.493 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:40.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.552 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:40.630 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:40.630 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:40.630 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251626 s, 41.7 MB/s 2023-11-26T07:20:40.632 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:40.632 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:40.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.690 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:40.764 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:40.764 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:40.764 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216493 s, 48.4 MB/s 2023-11-26T07:20:40.766 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:40.766 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:40.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.819 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:40.893 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:40.893 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:40.893 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211991 s, 49.5 MB/s 2023-11-26T07:20:40.895 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:40.895 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:40.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.953 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:41.025 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:41.025 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:41.025 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172472 s, 60.8 MB/s 2023-11-26T07:20:41.027 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:41.027 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:41.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:41.077 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:41.205 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:41.206 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:41.206 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269656 s, 38.9 MB/s 2023-11-26T07:20:41.207 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:41.208 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:41.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:41.264 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261798 s, 40.1 MB/s 2023-11-26T07:20:41.346 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:41.346 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:41.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:41.403 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:41.492 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:41.492 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:41.493 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0369014 s, 28.4 MB/s 2023-11-26T07:20:41.494 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:41.495 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:41.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:41.550 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:41.631 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:41.631 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:41.631 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031197 s, 33.6 MB/s 2023-11-26T07:20:41.632 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:41.633 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:41.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:41.688 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:41.763 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:41.763 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:41.763 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247873 s, 42.3 MB/s 2023-11-26T07:20:41.764 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:41.765 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:41.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:41.818 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259936 s, 40.3 MB/s 2023-11-26T07:20:41.899 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:41.899 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:41.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:41.953 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023813 s, 44.0 MB/s 2023-11-26T07:20:42.025 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:42.025 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:42.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:42.081 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:42.154 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:42.154 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:42.154 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200114 s, 52.4 MB/s 2023-11-26T07:20:42.155 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:42.155 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:42.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:42.211 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:42.289 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:42.289 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:42.289 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246526 s, 42.5 MB/s 2023-11-26T07:20:42.291 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:42.291 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:42.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:42.346 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:42.435 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:42.435 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:42.435 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361485 s, 29.0 MB/s 2023-11-26T07:20:42.437 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:42.437 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:42.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:42.496 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:42.573 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:42.574 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:42.574 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228601 s, 45.9 MB/s 2023-11-26T07:20:42.575 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:42.575 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:42.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:42.631 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:42.715 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:42.715 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:42.715 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296289 s, 35.4 MB/s 2023-11-26T07:20:42.717 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:42.717 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:42.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:42.772 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:42.849 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264864 s, 39.6 MB/s 2023-11-26T07:20:42.851 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:42.851 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:42.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:42.905 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:42.988 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:42.989 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:42.989 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293523 s, 35.7 MB/s 2023-11-26T07:20:42.990 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:42.990 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.044 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.112 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:43.112 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:43.112 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198739 s, 52.8 MB/s 2023-11-26T07:20:43.114 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:43.114 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.169 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.245 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:43.246 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:43.246 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243958 s, 43.0 MB/s 2023-11-26T07:20:43.247 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:43.247 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.301 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.374 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:43.374 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:43.374 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203162 s, 51.6 MB/s 2023-11-26T07:20:43.375 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:43.375 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.425 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.554 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:43.554 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:43.554 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030093 s, 34.8 MB/s 2023-11-26T07:20:43.556 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:43.556 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.613 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.692 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:43.692 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:43.692 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264793 s, 39.6 MB/s 2023-11-26T07:20:43.694 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:43.694 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.750 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.825 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:43.825 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:43.825 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205127 s, 51.1 MB/s 2023-11-26T07:20:43.827 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:43.827 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.879 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.947 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:43.947 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:43.947 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187683 s, 55.9 MB/s 2023-11-26T07:20:43.948 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:43.949 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.000 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.073 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:44.074 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:44.074 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228219 s, 45.9 MB/s 2023-11-26T07:20:44.075 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:44.075 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.131 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.204 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:44.204 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:44.204 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238226 s, 44.0 MB/s 2023-11-26T07:20:44.206 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:44.206 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.263 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021808 s, 48.1 MB/s 2023-11-26T07:20:44.337 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:44.337 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.393 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.467 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:44.468 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:44.468 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230607 s, 45.5 MB/s 2023-11-26T07:20:44.469 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:44.469 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.526 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.604 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:44.605 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:44.605 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248921 s, 42.1 MB/s 2023-11-26T07:20:44.606 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:44.606 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.660 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.735 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:44.735 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:44.736 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229386 s, 45.7 MB/s 2023-11-26T07:20:44.737 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:44.737 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.789 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027415 s, 38.2 MB/s 2023-11-26T07:20:44.920 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:44.920 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.978 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.058 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:45.058 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:45.058 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254096 s, 41.3 MB/s 2023-11-26T07:20:45.059 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:45.060 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.115 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.191 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:45.191 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:45.191 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224492 s, 46.7 MB/s 2023-11-26T07:20:45.192 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:45.192 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.250 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.325 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:45.325 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:45.325 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216833 s, 48.4 MB/s 2023-11-26T07:20:45.327 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:45.327 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.384 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.462 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:45.462 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:45.462 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025555 s, 41.0 MB/s 2023-11-26T07:20:45.464 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:45.464 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.521 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.593 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:45.594 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:45.594 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191231 s, 54.8 MB/s 2023-11-26T07:20:45.595 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:45.595 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.652 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.725 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:45.725 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:45.726 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213517 s, 49.1 MB/s 2023-11-26T07:20:45.727 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:45.727 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.784 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.858 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:45.858 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:45.858 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242942 s, 43.2 MB/s 2023-11-26T07:20:45.860 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:45.860 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.918 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.994 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:45.994 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:45.994 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242024 s, 43.3 MB/s 2023-11-26T07:20:45.995 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:45.996 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.052 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.126 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:46.126 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:46.126 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219377 s, 47.8 MB/s 2023-11-26T07:20:46.128 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:46.128 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.181 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.255 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:46.255 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:46.255 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226483 s, 46.3 MB/s 2023-11-26T07:20:46.257 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:46.257 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.313 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.390 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:46.390 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:46.390 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247094 s, 42.4 MB/s 2023-11-26T07:20:46.392 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:46.392 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.449 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.528 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:46.528 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:46.528 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241966 s, 43.3 MB/s 2023-11-26T07:20:46.530 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:46.530 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.586 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.662 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:46.662 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:46.662 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229099 s, 45.8 MB/s 2023-11-26T07:20:46.663 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:46.664 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.717 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190713 s, 55.0 MB/s 2023-11-26T07:20:46.786 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:46.786 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.839 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.914 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:46.914 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:46.915 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277776 s, 37.7 MB/s 2023-11-26T07:20:46.916 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:46.916 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.971 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.046 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:47.046 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:47.046 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233017 s, 45.0 MB/s 2023-11-26T07:20:47.048 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:47.048 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.098 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.172 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:47.172 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:47.172 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232229 s, 45.2 MB/s 2023-11-26T07:20:47.173 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:47.173 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.228 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.308 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:47.308 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:47.308 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264456 s, 39.7 MB/s 2023-11-26T07:20:47.310 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:47.310 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.365 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.440 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:47.441 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:47.441 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226007 s, 46.4 MB/s 2023-11-26T07:20:47.442 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:47.442 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.500 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.578 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:47.578 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:47.578 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241156 s, 43.5 MB/s 2023-11-26T07:20:47.580 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:47.580 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.636 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.712 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:47.712 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:47.712 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248012 s, 42.3 MB/s 2023-11-26T07:20:47.713 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:47.713 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.767 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.890 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:47.890 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:47.890 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234392 s, 44.7 MB/s 2023-11-26T07:20:47.892 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:47.892 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.945 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.019 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:48.020 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:48.020 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223413 s, 46.9 MB/s 2023-11-26T07:20:48.021 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:48.021 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.074 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.192 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:48.192 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:48.192 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018373 s, 57.1 MB/s 2023-11-26T07:20:48.193 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:48.194 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.248 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.322 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:48.323 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:48.323 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238968 s, 43.9 MB/s 2023-11-26T07:20:48.324 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:48.325 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.384 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.465 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:48.465 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:48.465 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265361 s, 39.5 MB/s 2023-11-26T07:20:48.467 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:48.467 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.526 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.601 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:48.601 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:48.602 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226894 s, 46.2 MB/s 2023-11-26T07:20:48.603 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:48.603 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.661 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.741 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:48.741 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:48.742 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233434 s, 44.9 MB/s 2023-11-26T07:20:48.743 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:48.743 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.800 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231471 s, 45.3 MB/s 2023-11-26T07:20:48.878 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:48.878 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.935 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.017 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:49.018 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:49.018 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266537 s, 39.3 MB/s 2023-11-26T07:20:49.019 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:49.020 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.074 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.144 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:49.144 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:49.144 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178496 s, 58.7 MB/s 2023-11-26T07:20:49.145 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:49.145 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.194 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.322 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:49.323 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:49.323 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281266 s, 37.3 MB/s 2023-11-26T07:20:49.324 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:49.324 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.382 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221546 s, 47.3 MB/s 2023-11-26T07:20:49.459 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:49.460 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.517 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.594 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:49.594 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:49.594 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260464 s, 40.3 MB/s 2023-11-26T07:20:49.596 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:49.596 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.653 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.733 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:49.733 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:49.733 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261167 s, 40.1 MB/s 2023-11-26T07:20:49.735 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:49.735 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.788 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.858 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:49.858 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:49.858 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020756 s, 50.5 MB/s 2023-11-26T07:20:49.859 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:49.860 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.909 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.028 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:50.029 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:50.029 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193093 s, 54.3 MB/s 2023-11-26T07:20:50.030 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:50.030 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.089 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.167 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:50.167 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:50.167 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023777 s, 44.1 MB/s 2023-11-26T07:20:50.169 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:50.169 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.226 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.305 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:50.305 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:50.306 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236266 s, 44.4 MB/s 2023-11-26T07:20:50.307 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:50.307 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.365 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221348 s, 47.4 MB/s 2023-11-26T07:20:50.440 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:50.440 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.494 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217425 s, 48.2 MB/s 2023-11-26T07:20:50.567 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:50.567 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.625 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.702 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:50.702 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:50.703 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249931 s, 42.0 MB/s 2023-11-26T07:20:50.704 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:50.704 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.760 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.832 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:50.832 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210365 s, 49.8 MB/s 2023-11-26T07:20:50.834 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:50.834 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.891 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235391 s, 44.5 MB/s 2023-11-26T07:20:50.972 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:50.972 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.031 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.110 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:51.110 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:51.110 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255179 s, 41.1 MB/s 2023-11-26T07:20:51.112 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:51.112 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.170 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265211 s, 39.5 MB/s 2023-11-26T07:20:51.253 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:51.253 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.311 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.396 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:51.396 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:51.396 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296323 s, 35.4 MB/s 2023-11-26T07:20:51.398 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:51.398 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.457 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.540 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:51.540 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:51.540 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288213 s, 36.4 MB/s 2023-11-26T07:20:51.541 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:51.541 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.599 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.671 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:51.671 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:51.671 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229691 s, 45.7 MB/s 2023-11-26T07:20:51.673 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:51.673 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.728 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284043 s, 36.9 MB/s 2023-11-26T07:20:51.811 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:51.811 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.867 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.946 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:51.946 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:51.946 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248328 s, 42.2 MB/s 2023-11-26T07:20:51.947 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:51.947 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.004 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297683 s, 35.2 MB/s 2023-11-26T07:20:52.093 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:52.093 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.150 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207795 s, 50.5 MB/s 2023-11-26T07:20:52.225 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:52.225 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.282 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.357 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:52.357 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:52.357 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234012 s, 44.8 MB/s 2023-11-26T07:20:52.359 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:52.359 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.412 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.483 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:52.483 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:52.483 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218765 s, 47.9 MB/s 2023-11-26T07:20:52.485 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:52.485 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.541 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.620 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:52.621 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:52.621 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223665 s, 46.9 MB/s 2023-11-26T07:20:52.622 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:52.623 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.680 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.753 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:52.754 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:52.754 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215684 s, 48.6 MB/s 2023-11-26T07:20:52.755 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:52.755 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.814 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.889 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:52.890 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:52.890 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241654 s, 43.4 MB/s 2023-11-26T07:20:52.891 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:52.891 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.946 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.020 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:53.020 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:53.020 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021536 s, 48.7 MB/s 2023-11-26T07:20:53.022 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:53.022 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.078 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219721 s, 47.7 MB/s 2023-11-26T07:20:53.155 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:53.156 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.214 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.289 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:53.289 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:53.289 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212899 s, 49.3 MB/s 2023-11-26T07:20:53.290 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:53.291 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.340 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.464 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:53.464 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:53.464 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236781 s, 44.3 MB/s 2023-11-26T07:20:53.465 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:53.466 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.523 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.599 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:53.599 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:53.599 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224428 s, 46.7 MB/s 2023-11-26T07:20:53.600 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:53.601 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.658 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.734 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:53.734 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:53.734 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206091 s, 50.9 MB/s 2023-11-26T07:20:53.736 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:53.736 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.791 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250982 s, 41.8 MB/s 2023-11-26T07:20:53.871 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:53.871 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.927 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.004 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:54.005 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:54.005 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237275 s, 44.2 MB/s 2023-11-26T07:20:54.006 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:54.006 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.062 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.133 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:54.133 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:54.133 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210384 s, 49.8 MB/s 2023-11-26T07:20:54.135 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:54.135 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.191 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.271 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:54.272 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:54.272 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264443 s, 39.7 MB/s 2023-11-26T07:20:54.273 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:54.273 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.329 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.411 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:54.411 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:54.411 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259816 s, 40.4 MB/s 2023-11-26T07:20:54.413 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:54.413 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.469 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.544 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:54.545 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:54.545 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217984 s, 48.1 MB/s 2023-11-26T07:20:54.546 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:54.546 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.604 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.677 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:54.677 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:54.677 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208207 s, 50.4 MB/s 2023-11-26T07:20:54.679 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:54.680 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.732 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.851 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:54.852 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:54.852 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018837 s, 55.7 MB/s 2023-11-26T07:20:54.853 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:54.853 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.906 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.981 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:54.981 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:54.981 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221549 s, 47.3 MB/s 2023-11-26T07:20:54.982 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:54.983 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.037 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.104 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:55.105 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179335 s, 58.5 MB/s 2023-11-26T07:20:55.106 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:55.106 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.162 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.241 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:55.241 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:55.241 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240041 s, 43.7 MB/s 2023-11-26T07:20:55.243 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:55.243 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.301 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.379 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:55.379 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:55.379 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244632 s, 42.9 MB/s 2023-11-26T07:20:55.380 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:55.381 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.437 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.515 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:55.515 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:55.515 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239973 s, 43.7 MB/s 2023-11-26T07:20:55.517 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:55.517 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.575 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.601 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:20:55.626 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:20:55.650 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:55.651 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:55.651 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206989 s, 50.7 MB/s 2023-11-26T07:20:55.652 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:55.652 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.740 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.863 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:55.864 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:55.864 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225484 s, 46.5 MB/s 2023-11-26T07:20:55.865 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:55.865 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.922 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.002 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:56.003 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:56.003 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282763 s, 37.1 MB/s 2023-11-26T07:20:56.004 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:56.004 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.057 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.182 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:56.182 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:56.182 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233609 s, 44.9 MB/s 2023-11-26T07:20:56.184 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:56.184 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.243 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.324 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:56.324 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:56.325 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264031 s, 39.7 MB/s 2023-11-26T07:20:56.326 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:56.326 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.384 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273288 s, 38.4 MB/s 2023-11-26T07:20:56.466 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:56.466 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.521 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.593 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:56.594 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:56.594 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213866 s, 49.0 MB/s 2023-11-26T07:20:56.595 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:56.595 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.646 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.775 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:56.775 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:56.775 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295834 s, 35.4 MB/s 2023-11-26T07:20:56.777 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:56.777 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.830 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.954 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:56.955 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:56.955 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022101 s, 47.4 MB/s 2023-11-26T07:20:56.956 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:56.956 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:57.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:57.015 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:57.086 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:57.086 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:57.086 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217279 s, 48.3 MB/s 2023-11-26T07:20:57.087 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:20:57.087 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:57.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:57.136 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol51880/bd118f6c-cade-4bd1-8ba3-c34ce999b590/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:57.264 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:20:57.265 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:20:57.265 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027915 s, 37.6 MB/s 2023-11-26T07:20:57.266 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol51880 subvol_snap95310 2023-11-26T07:20:57.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.484+0000 7f672759e640 1 Processor -- start 2023-11-26T07:20:57.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.484+0000 7f672759e640 1 -- start start 2023-11-26T07:20:57.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.486+0000 7f672759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f672815edd0 0x7f672806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.486+0000 7f672759e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67281448f0 con 0x7f6728144510 2023-11-26T07:20:57.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.486+0000 7f672759e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6728144d80 con 0x7f67280b11f0 2023-11-26T07:20:57.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.486+0000 7f672759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672815f2d0 con 0x7f672815edd0 2023-11-26T07:20:57.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.486+0000 7f672659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6728144510 0x7f67280b0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33784/0 (socket says 172.21.15.77:33784) 2023-11-26T07:20:57.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.486+0000 7f672659c640 1 -- 172.21.15.77:0/84582697 learned_addr learned my addr 172.21.15.77:0/84582697 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:57.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f6726d9d640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f672815edd0 0x7f672806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:57.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097208306 0 0) 0x7f67281448f0 con 0x7f6728144510 2023-11-26T07:20:57.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6710003520 con 0x7f6728144510 2023-11-26T07:20:57.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2498354963 0 0) 0x7f6710003520 con 0x7f6728144510 2023-11-26T07:20:57.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f672815edd0 msgr2=0x7f672806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:57.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f672815edd0 0x7f672806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 >> v1:172.21.15.159:6789/0 conn(0x7f67280b11f0 legacy=0x7f67280b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:57.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672815f5b0 con 0x7f6728144510 2023-11-26T07:20:57.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f6718001670 con 0x7f6728144510 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 >> v1:172.21.15.77:6789/0 conn(0x7f6728144510 legacy=0x7f67280b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 0x7f6710003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f672815edd0 0x7f67100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6710004d00 0x7f6710005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672815f2d0 con 0x7f67100039a0 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671000bab0 con 0x7f6710004d00 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671000bc70 con 0x7f672815edd0 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.487+0000 7f672659c640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 0x7f6710003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.488+0000 7f6726d9d640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6710004d00 0x7f6710005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.488+0000 7f672659c640 1 -- 172.21.15.77:0/84582697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f672815edd0 msgr2=0x7f67100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.488+0000 7f672659c640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f672815edd0 0x7f67100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.488+0000 7f672659c640 1 -- 172.21.15.77:0/84582697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6710004d00 msgr2=0x7f6710005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.488+0000 7f672659c640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6710004d00 0x7f6710005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.488+0000 7f672659c640 1 -- 172.21.15.77:0/84582697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6710003520 con 0x7f67100039a0 2023-11-26T07:20:57.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.488+0000 7f6726d9d640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6710004d00 0x7f6710005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:57.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.489+0000 7f672659c640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 0x7f6710003dc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f671800c240 tx=0x7f67100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ff9ec558245faf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:57.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.489+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6718005ad0 con 0x7f67100039a0 2023-11-26T07:20:57.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.489+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6718005c50 con 0x7f67100039a0 2023-11-26T07:20:57.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.489+0000 7f672559a640 1 -- 172.21.15.77:0/84582697 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671802c7f0 con 0x7f67100039a0 2023-11-26T07:20:57.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.490+0000 7f672759e640 1 -- 172.21.15.77:0/84582697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 msgr2=0x7f6710003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:57.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.490+0000 7f672759e640 1 --2- 172.21.15.77:0/84582697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 0x7f6710003dc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f671800c240 tx=0x7f67100057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.490+0000 7f6726d9d640 1 -- 172.21.15.77:0/84582697 reap_dead start 2023-11-26T07:20:57.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.490+0000 7f672759e640 1 -- 172.21.15.77:0/84582697 shutdown_connections 2023-11-26T07:20:57.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.490+0000 7f672759e640 1 -- 172.21.15.77:0/84582697 >> 172.21.15.77:0/84582697 conn(0x7f67280cb8a0 msgr2=0x7f67280cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:57.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.490+0000 7f672759e640 1 -- 172.21.15.77:0/84582697 shutdown_connections 2023-11-26T07:20:57.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.490+0000 7f672759e640 1 -- 172.21.15.77:0/84582697 wait complete. 2023-11-26T07:20:57.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.492+0000 7f672759e640 1 Processor -- start 2023-11-26T07:20:57.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.492+0000 7f672759e640 1 -- start start 2023-11-26T07:20:57.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.493+0000 7f672759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 0x7f67281f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.493+0000 7f672759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6728142940 0x7f6728141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.493+0000 7f672759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6728142da0 0x7f67281f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.493+0000 7f672759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67281f1220 con 0x7f67100039a0 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.493+0000 7f672759e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672815c8b0 con 0x7f6728142da0 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.493+0000 7f672759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672815cb90 con 0x7f6728142940 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.493+0000 7f672659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 0x7f67281f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.493+0000 7f672659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 0x7f67281f0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51902/0 (socket says 172.21.15.77:51902) 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.493+0000 7f672659c640 1 -- 172.21.15.77:0/1041911693 learned_addr learned my addr 172.21.15.77:0/1041911693 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.494+0000 7f672659c640 1 -- 172.21.15.77:0/1041911693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6728142940 msgr2=0x7f6728141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.494+0000 7f672659c640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6728142940 0x7f6728141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.494+0000 7f672659c640 1 -- 172.21.15.77:0/1041911693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6728142da0 msgr2=0x7f67281f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.494+0000 7f6726d9d640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6728142da0 0x7f67281f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.494+0000 7f672659c640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6728142da0 0x7f67281f3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.494+0000 7f672659c640 1 -- 172.21.15.77:0/1041911693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672815ce70 con 0x7f67100039a0 2023-11-26T07:20:57.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.494+0000 7f672659c640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 0x7f67281f0ce0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f671800c2a0 tx=0x7f6718001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:57.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.494+0000 7f6716ffd640 1 -- 172.21.15.77:0/1041911693 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671802cc00 con 0x7f67100039a0 2023-11-26T07:20:57.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.494+0000 7f6716ffd640 1 -- 172.21.15.77:0/1041911693 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671802cd60 con 0x7f67100039a0 2023-11-26T07:20:57.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.494+0000 7f6716ffd640 1 -- 172.21.15.77:0/1041911693 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67180072b0 con 0x7f67100039a0 2023-11-26T07:20:57.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.494+0000 7f672759e640 1 -- 172.21.15.77:0/1041911693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672815d150 con 0x7f67100039a0 2023-11-26T07:20:57.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.495+0000 7f672759e640 1 -- 172.21.15.77:0/1041911693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67281417c0 con 0x7f67100039a0 2023-11-26T07:20:57.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.496+0000 7f672759e640 1 -- 172.21.15.77:0/1041911693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672804e840 con 0x7f67100039a0 2023-11-26T07:20:57.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.496+0000 7f6716ffd640 1 -- 172.21.15.77:0/1041911693 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) v1 ==== 89537+0+0 (secure 0 0 0) 0x7f6718032070 con 0x7f67100039a0 2023-11-26T07:20:57.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.498+0000 7f6716ffd640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f670806b1a0 0x7f670806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.498+0000 7f6716ffd640 1 -- 172.21.15.77:0/1041911693 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f671803c040 con 0x7f67100039a0 2023-11-26T07:20:57.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.498+0000 7f6725d9b640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f670806b1a0 0x7f670806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:57.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.499+0000 7f6725d9b640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f670806b1a0 0x7f670806d660 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f671c007fd0 tx=0x7f671c0079e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.503+0000 7f6716ffd640 1 -- 172.21.15.77:0/1041911693 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6718075930 con 0x7f67100039a0 2023-11-26T07:20:57.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.724+0000 7f672759e640 1 -- 172.21.15.77:0/1041911693 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol51880", "snap_name": "subvol_snap95310", "target": ["mon-mgr", ""]}) v1 -- 0x7f6728158460 con 0x7f670806b1a0 2023-11-26T07:20:57.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.771+0000 7f6716ffd640 1 -- 172.21.15.77:0/1041911693 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6728158460 con 0x7f670806b1a0 2023-11-26T07:20:57.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.775+0000 7f672759e640 1 -- 172.21.15.77:0/1041911693 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f670806b1a0 msgr2=0x7f670806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:57.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.775+0000 7f672759e640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f670806b1a0 0x7f670806d660 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f671c007fd0 tx=0x7f671c0079e0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.775+0000 7f672759e640 1 -- 172.21.15.77:0/1041911693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 msgr2=0x7f67281f0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:57.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.775+0000 7f672759e640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 0x7f67281f0ce0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f671800c2a0 tx=0x7f6718001a00 comp rx=0 tx=0).stop 2023-11-26T07:20:57.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.775+0000 7f672759e640 1 -- 172.21.15.77:0/1041911693 shutdown_connections 2023-11-26T07:20:57.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.775+0000 7f672759e640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f670806b1a0 0x7f670806d660 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.775+0000 7f672759e640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6728142da0 0x7f67281f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.775+0000 7f672759e640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6728142940 0x7f6728141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.775+0000 7f672759e640 1 --2- 172.21.15.77:0/1041911693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67100039a0 0x7f67281f0ce0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.775+0000 7f672759e640 1 -- 172.21.15.77:0/1041911693 >> 172.21.15.77:0/1041911693 conn(0x7f67280cb8a0 msgr2=0x7f67280b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:57.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.775+0000 7f672759e640 1 -- 172.21.15.77:0/1041911693 shutdown_connections 2023-11-26T07:20:57.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.776+0000 7f672759e640 1 -- 172.21.15.77:0/1041911693 wait complete. 2023-11-26T07:20:57.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:20:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.982+0000 7f9ce277a640 1 Processor -- start 2023-11-26T07:20:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.982+0000 7f9ce277a640 1 -- start start 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.983+0000 7f9ce277a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9cdc15b260 0x7f9cdc06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.984+0000 7f9ce277a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cdc06e580 0x7f9cdc0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.984+0000 7f9ce277a640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc06d5c0 con 0x7f9cdc0b1080 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.984+0000 7f9ce277a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cdc0b1530 con 0x7f9cdc15b260 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.984+0000 7f9ce277a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc15b640 con 0x7f9cdc06e580 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.984+0000 7f9ce1778640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9cdc15b260 0x7f9cdc06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.984+0000 7f9ce1778640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9cdc15b260 0x7f9cdc06e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51906/0 (socket says 172.21.15.77:51906) 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.984+0000 7f9ce1778640 1 -- 172.21.15.77:0/3680134461 learned_addr learned my addr 172.21.15.77:0/3680134461 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.984+0000 7f9ce1778640 1 -- 172.21.15.77:0/3680134461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cdc06e580 msgr2=0x7f9cdc0b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.984+0000 7f9ce1778640 1 --2- 172.21.15.77:0/3680134461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cdc06e580 0x7f9cdc0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.984+0000 7f9ce1778640 1 -- 172.21.15.77:0/3680134461 >> v1:172.21.15.159:6789/0 conn(0x7f9cdc0b1080 legacy=0x7f9cdc0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.984+0000 7f9ce1778640 1 -- 172.21.15.77:0/3680134461 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc15ed20 con 0x7f9cdc15b260 2023-11-26T07:20:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.985+0000 7f9ce1778640 1 --2- 172.21.15.77:0/3680134461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cdc15b260 0x7f9cdc06e040 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009870 tx=0x7f9cd802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ad032b42a2e668 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.986+0000 7f9cd3fff640 1 -- 172.21.15.77:0/3680134461 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8031740 con 0x7f9cdc15b260 2023-11-26T07:20:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.986+0000 7f9cd3fff640 1 -- 172.21.15.77:0/3680134461 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd80318a0 con 0x7f9cdc15b260 2023-11-26T07:20:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.986+0000 7f9cd3fff640 1 -- 172.21.15.77:0/3680134461 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8031c30 con 0x7f9cdc15b260 2023-11-26T07:20:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.987+0000 7f9ce277a640 1 -- 172.21.15.77:0/3680134461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cdc15b260 msgr2=0x7f9cdc06e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.987+0000 7f9ce277a640 1 --2- 172.21.15.77:0/3680134461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cdc15b260 0x7f9cdc06e040 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009870 tx=0x7f9cd802b7e0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.987+0000 7f9ce277a640 1 -- 172.21.15.77:0/3680134461 shutdown_connections 2023-11-26T07:20:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.987+0000 7f9ce277a640 1 --2- 172.21.15.77:0/3680134461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cdc06e580 0x7f9cdc0b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.987+0000 7f9ce277a640 1 --2- 172.21.15.77:0/3680134461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cdc15b260 0x7f9cdc06e040 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.987+0000 7f9ce277a640 1 -- 172.21.15.77:0/3680134461 >> 172.21.15.77:0/3680134461 conn(0x7f9cdc0cbb40 msgr2=0x7f9cdc0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.987+0000 7f9ce277a640 1 -- 172.21.15.77:0/3680134461 shutdown_connections 2023-11-26T07:20:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.987+0000 7f9ce277a640 1 -- 172.21.15.77:0/3680134461 wait complete. 2023-11-26T07:20:57.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.988+0000 7f9ce277a640 1 Processor -- start 2023-11-26T07:20:57.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.989+0000 7f9ce277a640 1 -- start start 2023-11-26T07:20:57.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.989+0000 7f9ce277a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cdc06e580 0x7f9cdc0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce277a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cdc0b1080 0x7f9cdc0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce277a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cdc15b260 0x7f9cdc15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce277a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc0c9f80 con 0x7f9cdc15b260 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce277a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc0ca250 con 0x7f9cdc06e580 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce277a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc0ca530 con 0x7f9cdc0b1080 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce1f79640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cdc15b260 0x7f9cdc15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce1f79640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cdc15b260 0x7f9cdc15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51914/0 (socket says 172.21.15.77:51914) 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce1f79640 1 -- 172.21.15.77:0/3942162988 learned_addr learned my addr 172.21.15.77:0/3942162988 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce1f79640 1 -- 172.21.15.77:0/3942162988 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cdc0b1080 msgr2=0x7f9cdc0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce1f79640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cdc0b1080 0x7f9cdc0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce1f79640 1 -- 172.21.15.77:0/3942162988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cdc06e580 msgr2=0x7f9cdc0b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce1f79640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cdc06e580 0x7f9cdc0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.990+0000 7f9ce1f79640 1 -- 172.21.15.77:0/3942162988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd80094d0 con 0x7f9cdc15b260 2023-11-26T07:20:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.991+0000 7f9ce1f79640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cdc15b260 0x7f9cdc15d950 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400b970 tx=0x7f9cd400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.991+0000 7f9cd1ffb640 1 -- 172.21.15.77:0/3942162988 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd400cb40 con 0x7f9cdc15b260 2023-11-26T07:20:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.991+0000 7f9cd1ffb640 1 -- 172.21.15.77:0/3942162988 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd400cca0 con 0x7f9cdc15b260 2023-11-26T07:20:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.991+0000 7f9cd1ffb640 1 -- 172.21.15.77:0/3942162988 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4014680 con 0x7f9cdc15b260 2023-11-26T07:20:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.991+0000 7f9ce277a640 1 -- 172.21.15.77:0/3942162988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cdc0ca810 con 0x7f9cdc15b260 2023-11-26T07:20:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.991+0000 7f9ce277a640 1 -- 172.21.15.77:0/3942162988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cdc0cadd0 con 0x7f9cdc15b260 2023-11-26T07:20:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.992+0000 7f9ce277a640 1 -- 172.21.15.77:0/3942162988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cdc0cafc0 con 0x7f9cdc15b260 2023-11-26T07:20:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.993+0000 7f9cd1ffb640 1 -- 172.21.15.77:0/3942162988 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) v1 ==== 89537+0+0 (secure 0 0 0) 0x7f9cd401d3b0 con 0x7f9cdc15b260 2023-11-26T07:20:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.994+0000 7f9cd1ffb640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9cc006b1a0 0x7f9cc006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.994+0000 7f9cd1ffb640 1 -- 172.21.15.77:0/3942162988 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cd4089a30 con 0x7f9cdc15b260 2023-11-26T07:20:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.995+0000 7f9ce1778640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9cc006b1a0 0x7f9cc006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.995+0000 7f9ce1778640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9cc006b1a0 0x7f9cc006d660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8035000 tx=0x7f9cd8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:57.999+0000 7f9cd1ffb640 1 -- 172.21.15.77:0/3942162988 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9cd4054620 con 0x7f9cdc15b260 2023-11-26T07:20:58.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.187+0000 7f9ce277a640 1 -- 172.21.15.77:0/3942162988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f9cdc04e840 con 0x7f9cdc15b260 2023-11-26T07:20:58.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.194+0000 7f9cd1ffb640 1 -- 172.21.15.77:0/3942162988 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v15)=0 v15) v1 ==== 130+0+0 (secure 0 0 0) 0x7f9cd405e070 con 0x7f9cdc15b260 2023-11-26T07:20:58.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 -- 172.21.15.77:0/3942162988 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9cc006b1a0 msgr2=0x7f9cc006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:58.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9cc006b1a0 0x7f9cc006d660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8035000 tx=0x7f9cd8030000 comp rx=0 tx=0).stop 2023-11-26T07:20:58.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 -- 172.21.15.77:0/3942162988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cdc15b260 msgr2=0x7f9cdc15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:58.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cdc15b260 0x7f9cdc15d950 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400b970 tx=0x7f9cd400be30 comp rx=0 tx=0).stop 2023-11-26T07:20:58.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 -- 172.21.15.77:0/3942162988 shutdown_connections 2023-11-26T07:20:58.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9cc006b1a0 0x7f9cc006d660 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cdc15b260 0x7f9cdc15d950 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cdc0b1080 0x7f9cdc0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 --2- 172.21.15.77:0/3942162988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cdc06e580 0x7f9cdc0b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 -- 172.21.15.77:0/3942162988 >> 172.21.15.77:0/3942162988 conn(0x7f9cdc0cbb40 msgr2=0x7f9cdc0c4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:58.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 -- 172.21.15.77:0/3942162988 shutdown_connections 2023-11-26T07:20:58.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.197+0000 7f9ce277a640 1 -- 172.21.15.77:0/3942162988 wait complete. 2023-11-26T07:20:58.212 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.210+0000 7f59b45fb640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.213 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.210+0000 7f59b45fb640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.213 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.210+0000 7f59b45fb640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.213 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.210+0000 7f59b45fb640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.213 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.210+0000 7f59b45fb640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol51880 subvol_snap95310 subvol_clone82110 2023-11-26T07:20:58.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.413+0000 7fddbf0cf640 1 Processor -- start 2023-11-26T07:20:58.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.413+0000 7fddbf0cf640 1 -- start start 2023-11-26T07:20:58.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.414+0000 7fddbf0cf640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb815d720 0x7fddb80d3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:58.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.414+0000 7fddbf0cf640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fddb806ca90 0x7fddb80b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:58.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.414+0000 7fddbf0cf640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb815db00 con 0x7fddb80d3870 2023-11-26T07:20:58.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.414+0000 7fddbf0cf640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb80d0ce0 con 0x7fddb806ca90 2023-11-26T07:20:58.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.414+0000 7fddbf0cf640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb806d400 con 0x7fddb815d720 2023-11-26T07:20:58.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.415+0000 7fddb7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fddb80d3870 0x7fddb80b0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33798/0 (socket says 172.21.15.77:33798) 2023-11-26T07:20:58.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.415+0000 7fddb7fff640 1 -- 172.21.15.77:0/2572960911 learned_addr learned my addr 172.21.15.77:0/2572960911 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.415+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755937099 0 0) 0x7fddb815db00 con 0x7fddb80d3870 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.415+0000 7fddbce6b640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb815d720 0x7fddb80d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.415+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdda8003520 con 0x7fddb80d3870 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.415+0000 7fddbd66c640 1 --2- 172.21.15.77:0/2572960911 >> v2:172.21.15.159:3300/0 conn(0x7fddb806ca90 0x7fddb80b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.415+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1859122318 0 0) 0x7fdda8003520 con 0x7fddb80d3870 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb815d720 msgr2=0x7fddb80d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb815d720 0x7fddb80d3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 >> v2:172.21.15.159:3300/0 conn(0x7fddb806ca90 msgr2=0x7fddb80b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 --2- 172.21.15.77:0/2572960911 >> v2:172.21.15.159:3300/0 conn(0x7fddb806ca90 0x7fddb80b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80d3cf0 con 0x7fddb80d3870 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fdda4001670 con 0x7fddb80d3870 2023-11-26T07:20:58.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 >> v1:172.21.15.77:6789/0 conn(0x7fddb80d3870 legacy=0x7fddb80b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb815d720 0x7fdda8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdda8003f40 0x7fdda80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdda8004d00 0x7fdda8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80d0ce0 con 0x7fdda8004d00 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb806d400 con 0x7fdda8003f40 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda800ba30 con 0x7fddb815d720 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddbd66c640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdda8004d00 0x7fdda8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddbce6b640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb815d720 0x7fdda8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddb7fff640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdda8003f40 0x7fdda80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddbd66c640 1 -- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb815d720 msgr2=0x7fdda8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.416+0000 7fddbd66c640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb815d720 0x7fdda8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.417+0000 7fddbd66c640 1 -- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdda8003f40 msgr2=0x7fdda80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:58.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.417+0000 7fddbd66c640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdda8003f40 0x7fdda80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.417+0000 7fddbd66c640 1 -- 172.21.15.77:0/2572960911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda8003520 con 0x7fdda8004d00 2023-11-26T07:20:58.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.417+0000 7fddb7fff640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdda8003f40 0x7fdda80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:58.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.418+0000 7fddbd66c640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdda8004d00 0x7fdda8005180 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009fc0 tx=0x7fdda80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701446c24613b6ef server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:58.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.418+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb002cc60 con 0x7fdda8004d00 2023-11-26T07:20:58.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.418+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000f040 con 0x7fdda8004d00 2023-11-26T07:20:58.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.418+0000 7fddb77fe640 1 -- 172.21.15.77:0/2572960911 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0034440 con 0x7fdda8004d00 2023-11-26T07:20:58.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.418+0000 7fddbf0cf640 1 -- 172.21.15.77:0/2572960911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdda8004d00 msgr2=0x7fdda8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:58.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.418+0000 7fddbf0cf640 1 --2- 172.21.15.77:0/2572960911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdda8004d00 0x7fdda8005180 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009fc0 tx=0x7fdda80057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.418+0000 7fddbd66c640 1 -- 172.21.15.77:0/2572960911 reap_dead start 2023-11-26T07:20:58.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.419+0000 7fddbf0cf640 1 -- 172.21.15.77:0/2572960911 shutdown_connections 2023-11-26T07:20:58.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.419+0000 7fddbf0cf640 1 -- 172.21.15.77:0/2572960911 >> 172.21.15.77:0/2572960911 conn(0x7fddb808af60 msgr2=0x7fddb809c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:58.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.419+0000 7fddbf0cf640 1 -- 172.21.15.77:0/2572960911 shutdown_connections 2023-11-26T07:20:58.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.419+0000 7fddbf0cf640 1 -- 172.21.15.77:0/2572960911 wait complete. 2023-11-26T07:20:58.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.420+0000 7fddbf0cf640 1 Processor -- start 2023-11-26T07:20:58.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.421+0000 7fddbf0cf640 1 -- start start 2023-11-26T07:20:58.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.421+0000 7fddbf0cf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdda8004d00 0x7fddb80c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:58.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.421+0000 7fddbf0cf640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb81f6180 0x7fddb81511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:58.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.421+0000 7fddbf0cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb80b7bd0 0x7fddb80b8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.421+0000 7fddbf0cf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80b8590 con 0x7fddb80b7bd0 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.421+0000 7fddbf0cf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8151ac0 con 0x7fdda8004d00 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.421+0000 7fddbf0cf640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c8560 con 0x7fddb81f6180 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.422+0000 7fddbd66c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb80b7bd0 0x7fddb80b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.422+0000 7fddbd66c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb80b7bd0 0x7fddb80b8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51950/0 (socket says 172.21.15.77:51950) 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.422+0000 7fddbd66c640 1 -- 172.21.15.77:0/228789976 learned_addr learned my addr 172.21.15.77:0/228789976 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.422+0000 7fddbd66c640 1 -- 172.21.15.77:0/228789976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb81f6180 msgr2=0x7fddb81511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.422+0000 7fddbd66c640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb81f6180 0x7fddb81511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.422+0000 7fddbd66c640 1 -- 172.21.15.77:0/228789976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdda8004d00 msgr2=0x7fddb80c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.422+0000 7fddbd66c640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdda8004d00 0x7fddb80c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.422+0000 7fddbd66c640 1 -- 172.21.15.77:0/228789976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80c8840 con 0x7fddb80b7bd0 2023-11-26T07:20:58.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.422+0000 7fddbd66c640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb80b7bd0 0x7fddb80b8050 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fddb0037040 tx=0x7fddb0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.423+0000 7fddb57fa640 1 -- 172.21.15.77:0/228789976 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0034d50 con 0x7fddb80b7bd0 2023-11-26T07:20:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.423+0000 7fddb57fa640 1 -- 172.21.15.77:0/228789976 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb0003990 con 0x7fddb80b7bd0 2023-11-26T07:20:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.423+0000 7fddb57fa640 1 -- 172.21.15.77:0/228789976 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0003d40 con 0x7fddb80b7bd0 2023-11-26T07:20:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.423+0000 7fddbf0cf640 1 -- 172.21.15.77:0/228789976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80c7760 con 0x7fddb80b7bd0 2023-11-26T07:20:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.423+0000 7fddbf0cf640 1 -- 172.21.15.77:0/228789976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb80c7d20 con 0x7fddb80b7bd0 2023-11-26T07:20:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.424+0000 7fddbf0cf640 1 -- 172.21.15.77:0/228789976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb804e8b0 con 0x7fddb80b7bd0 2023-11-26T07:20:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.425+0000 7fddb57fa640 1 -- 172.21.15.77:0/228789976 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) v1 ==== 89537+0+0 (secure 0 0 0) 0x7fddb0004030 con 0x7fddb80b7bd0 2023-11-26T07:20:58.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.426+0000 7fddb57fa640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd9c06b1d0 0x7fdd9c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:58.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.426+0000 7fddb57fa640 1 -- 172.21.15.77:0/228789976 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddb00ab200 con 0x7fddb80b7bd0 2023-11-26T07:20:58.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.426+0000 7fddbce6b640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd9c06b1d0 0x7fdd9c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:58.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.427+0000 7fddbce6b640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd9c06b1d0 0x7fdd9c06d690 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fddac009910 tx=0x7fddac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:58.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.430+0000 7fddb57fa640 1 -- 172.21.15.77:0/228789976 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fddb0075fa0 con 0x7fddb80b7bd0 2023-11-26T07:20:58.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.653+0000 7fddbf0cf640 1 -- 172.21.15.77:0/228789976 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol51880", "snap_name": "subvol_snap95310", "target_sub_name": "subvol_clone82110", "target": ["mon-mgr", ""]}) v1 -- 0x7fddb80b06c0 con 0x7fdd9c06b1d0 2023-11-26T07:20:58.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.793+0000 7fddb57fa640 1 -- 172.21.15.77:0/228789976 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fddac011860 con 0x7fdd9c06b1d0 2023-11-26T07:20:58.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 -- 172.21.15.77:0/228789976 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd9c06b1d0 msgr2=0x7fdd9c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:58.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd9c06b1d0 0x7fdd9c06d690 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fddac009910 tx=0x7fddac008040 comp rx=0 tx=0).stop 2023-11-26T07:20:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 -- 172.21.15.77:0/228789976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb80b7bd0 msgr2=0x7fddb80b8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb80b7bd0 0x7fddb80b8050 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fddb0037040 tx=0x7fddb0009750 comp rx=0 tx=0).stop 2023-11-26T07:20:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 -- 172.21.15.77:0/228789976 shutdown_connections 2023-11-26T07:20:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd9c06b1d0 0x7fdd9c06d690 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb80b7bd0 0x7fddb80b8050 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddb81f6180 0x7fddb81511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 --2- 172.21.15.77:0/228789976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdda8004d00 0x7fddb80c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 -- 172.21.15.77:0/228789976 >> 172.21.15.77:0/228789976 conn(0x7fddb808af60 msgr2=0x7fddb815e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 -- 172.21.15.77:0/228789976 shutdown_connections 2023-11-26T07:20:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:58.797+0000 7fddbf0cf640 1 -- 172.21.15.77:0/228789976 wait complete. 2023-11-26T07:20:58.803 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.800+0000 7f59b7e02640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.803 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.800+0000 7f59b7e02640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.803 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.800+0000 7f59b7e02640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.803 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.800+0000 7f59b7e02640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.803 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.800+0000 7f59b7e02640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.822 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82110 2023-11-26T07:20:58.828 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.822+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.828 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.822+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.828 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.822+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.828 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.822+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:58.828 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:20:58.822+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:59.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.004+0000 7f7ee5d16640 1 Processor -- start 2023-11-26T07:20:59.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.004+0000 7f7ee5d16640 1 -- start start 2023-11-26T07:20:59.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.006+0000 7f7ee5d16640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee00c59b0 0x7f7ee0166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:59.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.006+0000 7f7ee5d16640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee015eea0 con 0x7f7ee015b440 2023-11-26T07:20:59.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.006+0000 7f7ee5d16640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee006d600 con 0x7f7ee00cc0f0 2023-11-26T07:20:59.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.006+0000 7f7ee5d16640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00c5e00 con 0x7f7ee00c59b0 2023-11-26T07:20:59.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.006+0000 7f7edf7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7ee015b440 0x7f7ee00cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33810/0 (socket says 172.21.15.77:33810) 2023-11-26T07:20:59.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.006+0000 7f7edf7fe640 1 -- 172.21.15.77:0/884715278 learned_addr learned my addr 172.21.15.77:0/884715278 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:20:59.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.006+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598249331 0 0) 0x7f7ee015eea0 con 0x7f7ee015b440 2023-11-26T07:20:59.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.006+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec8003520 con 0x7f7ee015b440 2023-11-26T07:20:59.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.006+0000 7f7edffff640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee00c59b0 0x7f7ee0166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:59.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2204864626 0 0) 0x7f7ec8003520 con 0x7f7ee015b440 2023-11-26T07:20:59.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee00c59b0 msgr2=0x7f7ee0166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:59.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee00c59b0 0x7f7ee0166230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 >> v1:172.21.15.159:6789/0 conn(0x7f7ee00cc0f0 legacy=0x7f7ee00c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:59.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee00abf30 con 0x7f7ee015b440 2023-11-26T07:20:59.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f7ed0001670 con 0x7f7ee015b440 2023-11-26T07:20:59.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 >> v1:172.21.15.77:6789/0 conn(0x7f7ee015b440 legacy=0x7f7ee00cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:59.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec80039a0 0x7f7ec8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:59.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ec80047c0 0x7f7ec8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:59.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec80051d0 0x7f7ec800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:59.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec800c0a0 con 0x7f7ec80051d0 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec800c210 con 0x7f7ec80039a0 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec800c3d0 con 0x7f7ec80047c0 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7edffff640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee00c59b0 0x7f7ee0166230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7edffff640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec80051d0 0x7f7ec800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7edf7fe640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec80039a0 0x7f7ec8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.007+0000 7f7edeffd640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ec80047c0 0x7f7ec8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.008+0000 7f7edffff640 1 -- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ec80047c0 msgr2=0x7f7ec8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.008+0000 7f7edffff640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ec80047c0 0x7f7ec8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.008+0000 7f7edffff640 1 -- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec80039a0 msgr2=0x7f7ec8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.008+0000 7f7edffff640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ec80039a0 0x7f7ec8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.008+0000 7f7edffff640 1 -- 172.21.15.77:0/884715278 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec8003520 con 0x7f7ec80051d0 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.009+0000 7f7edffff640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec80051d0 0x7f7ec800b980 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00c5d90 tx=0x7f7ec80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba970fe73d0b958 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:59.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.009+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed802cc80 con 0x7f7ec80051d0 2023-11-26T07:20:59.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.009+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed802cde0 con 0x7f7ec80051d0 2023-11-26T07:20:59.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.009+0000 7f7ede7fc640 1 -- 172.21.15.77:0/884715278 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8003bb0 con 0x7f7ec80051d0 2023-11-26T07:20:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.009+0000 7f7ee5d16640 1 -- 172.21.15.77:0/884715278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec80051d0 msgr2=0x7f7ec800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.009+0000 7f7ee5d16640 1 --2- 172.21.15.77:0/884715278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec80051d0 0x7f7ec800b980 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00c5d90 tx=0x7f7ec80057f0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.009+0000 7f7edffff640 1 -- 172.21.15.77:0/884715278 reap_dead start 2023-11-26T07:20:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.009+0000 7f7ee5d16640 1 -- 172.21.15.77:0/884715278 shutdown_connections 2023-11-26T07:20:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.009+0000 7f7ee5d16640 1 -- 172.21.15.77:0/884715278 >> 172.21.15.77:0/884715278 conn(0x7f7ee00b0c50 msgr2=0x7f7ee00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.010+0000 7f7ee5d16640 1 -- 172.21.15.77:0/884715278 shutdown_connections 2023-11-26T07:20:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.010+0000 7f7ee5d16640 1 -- 172.21.15.77:0/884715278 wait complete. 2023-11-26T07:20:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.011+0000 7f7ee5d16640 1 Processor -- start 2023-11-26T07:20:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.011+0000 7f7ee5d16640 1 -- start start 2023-11-26T07:20:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.012+0000 7f7ee5d16640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ec80051d0 0x7f7ee0152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.012+0000 7f7ee5d16640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ee01594c0 0x7f7ee00c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.012+0000 7f7ee5d16640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ee0152260 0x7f7ee015a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:59.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.012+0000 7f7ee5d16640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00c6610 con 0x7f7ee0152260 2023-11-26T07:20:59.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.012+0000 7f7ee5d16640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0159940 con 0x7f7ee01594c0 2023-11-26T07:20:59.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.012+0000 7f7ee5d16640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0159b50 con 0x7f7ec80051d0 2023-11-26T07:20:59.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ee0152260 0x7f7ee015a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:59.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ee0152260 0x7f7ee015a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51992/0 (socket says 172.21.15.77:51992) 2023-11-26T07:20:59.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edffff640 1 -- 172.21.15.77:0/2422372659 learned_addr learned my addr 172.21.15.77:0/2422372659 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:20:59.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edeffd640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ee01594c0 0x7f7ee00c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:59.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edffff640 1 -- 172.21.15.77:0/2422372659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ec80051d0 msgr2=0x7f7ee0152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:59.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edf7fe640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ec80051d0 0x7f7ee0152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:59.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edffff640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ec80051d0 0x7f7ee0152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edffff640 1 -- 172.21.15.77:0/2422372659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ee01594c0 msgr2=0x7f7ee00c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:59.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edffff640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ee01594c0 0x7f7ee00c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edffff640 1 -- 172.21.15.77:0/2422372659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee00b1c80 con 0x7f7ee0152260 2023-11-26T07:20:59.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edeffd640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ee01594c0 0x7f7ee00c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:59.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.013+0000 7f7edffff640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ee0152260 0x7f7ee015a0a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7ed802bd30 tx=0x7f7ed8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:59.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.014+0000 7f7ec7fff640 1 -- 172.21.15.77:0/2422372659 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed803c070 con 0x7f7ee0152260 2023-11-26T07:20:59.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.014+0000 7f7ec7fff640 1 -- 172.21.15.77:0/2422372659 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed8003e30 con 0x7f7ee0152260 2023-11-26T07:20:59.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.014+0000 7f7ec7fff640 1 -- 172.21.15.77:0/2422372659 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8004730 con 0x7f7ee0152260 2023-11-26T07:20:59.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.014+0000 7f7ee5d16640 1 -- 172.21.15.77:0/2422372659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee00b1f60 con 0x7f7ee0152260 2023-11-26T07:20:59.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.014+0000 7f7ee5d16640 1 -- 172.21.15.77:0/2422372659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee00b2520 con 0x7f7ee0152260 2023-11-26T07:20:59.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.015+0000 7f7ee5d16640 1 -- 172.21.15.77:0/2422372659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee00c5220 con 0x7f7ee0152260 2023-11-26T07:20:59.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.016+0000 7f7ec7fff640 1 -- 172.21.15.77:0/2422372659 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) v1 ==== 89537+0+0 (secure 0 0 0) 0x7f7ed8037460 con 0x7f7ee0152260 2023-11-26T07:20:59.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.017+0000 7f7ec7fff640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ecc06b1a0 0x7f7ecc06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:59.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.017+0000 7f7ec7fff640 1 -- 172.21.15.77:0/2422372659 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ed80ab1a0 con 0x7f7ee0152260 2023-11-26T07:20:59.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.017+0000 7f7edf7fe640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ecc06b1a0 0x7f7ecc06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:59.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.018+0000 7f7edf7fe640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ecc06b1a0 0x7f7ecc06d660 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0001c90 tx=0x7f7ed00013f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:59.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.021+0000 7f7ec7fff640 1 -- 172.21.15.77:0/2422372659 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ed8075eb0 con 0x7f7ee0152260 2023-11-26T07:20:59.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.249+0000 7f7ee5d16640 1 -- 172.21.15.77:0/2422372659 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82110", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ee015f3d0 con 0x7f7ecc06b1a0 2023-11-26T07:20:59.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.261+0000 7f7ec7fff640 1 -- 172.21.15.77:0/2422372659 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f7ed0001500 con 0x7f7ecc06b1a0 2023-11-26T07:20:59.264 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:20:59.264 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:20:59.264 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "pending", 2023-11-26T07:20:59.264 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:20:59.264 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:20:59.264 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol51880", 2023-11-26T07:20:59.264 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap95310" 2023-11-26T07:20:59.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:59.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:20:59.264 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:20:59.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.263+0000 7f7ee5d16640 1 -- 172.21.15.77:0/2422372659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ecc06b1a0 msgr2=0x7f7ecc06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:59.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.263+0000 7f7ee5d16640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ecc06b1a0 0x7f7ecc06d660 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0001c90 tx=0x7f7ed00013f0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.264+0000 7f7ee5d16640 1 -- 172.21.15.77:0/2422372659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ee0152260 msgr2=0x7f7ee015a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:59.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.264+0000 7f7ee5d16640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ee0152260 0x7f7ee015a0a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7ed802bd30 tx=0x7f7ed8004ab0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.264+0000 7f7ee5d16640 1 -- 172.21.15.77:0/2422372659 shutdown_connections 2023-11-26T07:20:59.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.264+0000 7f7ee5d16640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ecc06b1a0 0x7f7ecc06d660 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.264+0000 7f7ee5d16640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ee0152260 0x7f7ee015a0a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.264+0000 7f7ee5d16640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ee01594c0 0x7f7ee00c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.264+0000 7f7ee5d16640 1 --2- 172.21.15.77:0/2422372659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ec80051d0 0x7f7ee0152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:59.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.264+0000 7f7ee5d16640 1 -- 172.21.15.77:0/2422372659 >> 172.21.15.77:0/2422372659 conn(0x7f7ee00b0c50 msgr2=0x7f7ee00cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:59.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.264+0000 7f7ee5d16640 1 -- 172.21.15.77:0/2422372659 shutdown_connections 2023-11-26T07:20:59.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:20:59.264+0000 7f7ee5d16640 1 -- 172.21.15.77:0/2422372659 wait complete. 2023-11-26T07:21:00.284 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82110 2023-11-26T07:21:00.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.506+0000 7fb8ccf61640 1 Processor -- start 2023-11-26T07:21:00.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.506+0000 7fb8ccf61640 1 -- start start 2023-11-26T07:21:00.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.507+0000 7fb8ccf61640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c8161b10 0x7fb8c8168260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:00.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.508+0000 7fb8ccf61640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c8161fa0 con 0x7fb8c80c67c0 2023-11-26T07:21:00.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.508+0000 7fb8ccf61640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c815de00 con 0x7fb8c8140520 2023-11-26T07:21:00.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.508+0000 7fb8ccf61640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c815e0e0 con 0x7fb8c8161b10 2023-11-26T07:21:00.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.508+0000 7fb8bffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb8c80c67c0 0x7fb8c8161400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33820/0 (socket says 172.21.15.77:33820) 2023-11-26T07:21:00.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.508+0000 7fb8bffff640 1 -- 172.21.15.77:0/1519001215 learned_addr learned my addr 172.21.15.77:0/1519001215 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:00.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.508+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827034009 0 0) 0x7fb8c8161fa0 con 0x7fb8c80c67c0 2023-11-26T07:21:00.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.508+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a8003520 con 0x7fb8c80c67c0 2023-11-26T07:21:00.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.508+0000 7fb8c6d9d640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c8161b10 0x7fb8c8168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:00.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 53169805 0 0) 0x7fb8a8003520 con 0x7fb8c80c67c0 2023-11-26T07:21:00.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c8161b10 msgr2=0x7fb8c8168260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:00.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c8161b10 0x7fb8c8168260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:00.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 >> v1:172.21.15.159:6789/0 conn(0x7fb8c8140520 legacy=0x7fb8c80c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:00.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c815e3c0 con 0x7fb8c80c67c0 2023-11-26T07:21:00.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fb8b0001690 con 0x7fb8c80c67c0 2023-11-26T07:21:00.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 >> v1:172.21.15.77:6789/0 conn(0x7fb8c80c67c0 legacy=0x7fb8c8161400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:00.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a80039a0 0x7fb8a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:00.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 0x7fb8a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:00.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c8161b10 0x7fb8a8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:00.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c815e0e0 con 0x7fb8a80047c0 2023-11-26T07:21:00.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a800bb10 con 0x7fb8a80039a0 2023-11-26T07:21:00.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a800bcd0 con 0x7fb8c8161b10 2023-11-26T07:21:00.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.509+0000 7fb8bffff640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 0x7fb8a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:00.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.510+0000 7fb8c659c640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a80039a0 0x7fb8a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:00.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.510+0000 7fb8c6d9d640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c8161b10 0x7fb8a8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:00.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.510+0000 7fb8bffff640 1 -- 172.21.15.77:0/1519001215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c8161b10 msgr2=0x7fb8a8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:00.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.510+0000 7fb8bffff640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c8161b10 0x7fb8a8005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:00.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.510+0000 7fb8bffff640 1 -- 172.21.15.77:0/1519001215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a80039a0 msgr2=0x7fb8a8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:00.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.510+0000 7fb8bffff640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a80039a0 0x7fb8a8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:00.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.510+0000 7fb8bffff640 1 -- 172.21.15.77:0/1519001215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a8003520 con 0x7fb8a80047c0 2023-11-26T07:21:00.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.511+0000 7fb8bffff640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 0x7fb8a8004c40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000c160 tx=0x7fb8a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3efb4a0acbb1da7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:00.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.512+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0005ad0 con 0x7fb8a80047c0 2023-11-26T07:21:00.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.512+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b0005c30 con 0x7fb8a80047c0 2023-11-26T07:21:00.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.512+0000 7fb8c5d9b640 1 -- 172.21.15.77:0/1519001215 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b002c7c0 con 0x7fb8a80047c0 2023-11-26T07:21:00.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.512+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1519001215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 msgr2=0x7fb8a8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:00.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.512+0000 7fb8ccf61640 1 --2- 172.21.15.77:0/1519001215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 0x7fb8a8004c40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000c160 tx=0x7fb8a80057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:00.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.512+0000 7fb8c6d9d640 1 -- 172.21.15.77:0/1519001215 reap_dead start 2023-11-26T07:21:00.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.513+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1519001215 shutdown_connections 2023-11-26T07:21:00.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.513+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1519001215 >> 172.21.15.77:0/1519001215 conn(0x7fb8c80b2e40 msgr2=0x7fb8c80b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:00.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.513+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1519001215 shutdown_connections 2023-11-26T07:21:00.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.513+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1519001215 wait complete. 2023-11-26T07:21:00.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.514+0000 7fb8ccf61640 1 Processor -- start 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.515+0000 7fb8ccf61640 1 -- start start 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.515+0000 7fb8ccf61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 0x7fb8c80c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.515+0000 7fb8ccf61640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c80c83e0 0x7fb8c8153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8ccf61640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8c80c8860 0x7fb8c806c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8ccf61640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c80ca5c0 con 0x7fb8a80047c0 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8ccf61640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c80ca8a0 con 0x7fb8c80c8860 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8ccf61640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c80cab80 con 0x7fb8c80c83e0 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8c659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 0x7fb8c80c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8c659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 0x7fb8c80c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52010/0 (socket says 172.21.15.77:52010) 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8c659c640 1 -- 172.21.15.77:0/1972826053 learned_addr learned my addr 172.21.15.77:0/1972826053 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8c659c640 1 -- 172.21.15.77:0/1972826053 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c80c83e0 msgr2=0x7fb8c8153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8c659c640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c80c83e0 0x7fb8c8153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8c659c640 1 -- 172.21.15.77:0/1972826053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8c80c8860 msgr2=0x7fb8c806c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:00.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8c659c640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8c80c8860 0x7fb8c806c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:00.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.516+0000 7fb8c659c640 1 -- 172.21.15.77:0/1972826053 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c80cae60 con 0x7fb8a80047c0 2023-11-26T07:21:00.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.517+0000 7fb8c659c640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 0x7fb8c80c9fc0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800f820 tx=0x7fb8b800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:00.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.517+0000 7fb8beffd640 1 -- 172.21.15.77:0/1972826053 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80050d0 con 0x7fb8a80047c0 2023-11-26T07:21:00.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.517+0000 7fb8beffd640 1 -- 172.21.15.77:0/1972826053 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b8005230 con 0x7fb8a80047c0 2023-11-26T07:21:00.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.517+0000 7fb8beffd640 1 -- 172.21.15.77:0/1972826053 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800d730 con 0x7fb8a80047c0 2023-11-26T07:21:00.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.517+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1972826053 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c80cb140 con 0x7fb8a80047c0 2023-11-26T07:21:00.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.517+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1972826053 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c815b710 con 0x7fb8a80047c0 2023-11-26T07:21:00.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.518+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1972826053 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c804e8b0 con 0x7fb8a80047c0 2023-11-26T07:21:00.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.519+0000 7fb8beffd640 1 -- 172.21.15.77:0/1972826053 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 10) v1 ==== 89690+0+0 (secure 0 0 0) 0x7fb8b800d890 con 0x7fb8a80047c0 2023-11-26T07:21:00.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.520+0000 7fb8beffd640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8ac06b350 0x7fb8ac06d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:00.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.520+0000 7fb8beffd640 1 -- 172.21.15.77:0/1972826053 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8b8089d40 con 0x7fb8a80047c0 2023-11-26T07:21:00.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.521+0000 7fb8bffff640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8ac06b350 0x7fb8ac06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:00.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.521+0000 7fb8bffff640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8ac06b350 0x7fb8ac06d810 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000c160 tx=0x7fb8b0007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:00.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.525+0000 7fb8beffd640 1 -- 172.21.15.77:0/1972826053 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8b8090080 con 0x7fb8a80047c0 2023-11-26T07:21:00.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.747+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1972826053 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82110", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8c8153c40 con 0x7fb8ac06b350 2023-11-26T07:21:00.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.756+0000 7fb8beffd640 1 -- 172.21.15.77:0/1972826053 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7fb8c8153c40 con 0x7fb8ac06b350 2023-11-26T07:21:00.759 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:21:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:21:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "pending", 2023-11-26T07:21:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:21:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:21:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol51880", 2023-11-26T07:21:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap95310" 2023-11-26T07:21:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:00.759 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:21:00.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.758+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1972826053 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8ac06b350 msgr2=0x7fb8ac06d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:00.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.758+0000 7fb8ccf61640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8ac06b350 0x7fb8ac06d810 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000c160 tx=0x7fb8b0007000 comp rx=0 tx=0).stop 2023-11-26T07:21:00.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.758+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1972826053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 msgr2=0x7fb8c80c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:00.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.759+0000 7fb8ccf61640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 0x7fb8c80c9fc0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800f820 tx=0x7fb8b800fce0 comp rx=0 tx=0).stop 2023-11-26T07:21:00.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.759+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1972826053 shutdown_connections 2023-11-26T07:21:00.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.759+0000 7fb8ccf61640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb8ac06b350 0x7fb8ac06d810 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:00.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.759+0000 7fb8ccf61640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8c80c8860 0x7fb8c806c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:00.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.759+0000 7fb8ccf61640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8c80c83e0 0x7fb8c8153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:00.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.759+0000 7fb8ccf61640 1 --2- 172.21.15.77:0/1972826053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8a80047c0 0x7fb8c80c9fc0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:00.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.759+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1972826053 >> 172.21.15.77:0/1972826053 conn(0x7fb8c80b2e40 msgr2=0x7fb8c815fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:00.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.759+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1972826053 shutdown_connections 2023-11-26T07:21:00.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:00.759+0000 7fb8ccf61640 1 -- 172.21.15.77:0/1972826053 wait complete. 2023-11-26T07:21:01.780 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82110 2023-11-26T07:21:02.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:01.999+0000 7efdfc748640 1 Processor -- start 2023-11-26T07:21:02.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:01.999+0000 7efdfc748640 1 -- start start 2023-11-26T07:21:02.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.000+0000 7efdfc748640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efdf40cc0f0 0x7efdf40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:02.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.000+0000 7efdfc748640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efdf40c57e0 0x7efdf406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:02.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.000+0000 7efdfc748640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf415eea0 con 0x7efdf415b440 2023-11-26T07:21:02.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.000+0000 7efdfc748640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf415b820 con 0x7efdf40c57e0 2023-11-26T07:21:02.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.000+0000 7efdfc748640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf40abf30 con 0x7efdf40cc0f0 2023-11-26T07:21:02.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.001+0000 7efdface5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efdf40c57e0 0x7efdf406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:02.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.001+0000 7efdface5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efdf40c57e0 0x7efdf406c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52016/0 (socket says 172.21.15.77:52016) 2023-11-26T07:21:02.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.001+0000 7efdface5640 1 -- 172.21.15.77:0/3655893801 learned_addr learned my addr 172.21.15.77:0/3655893801 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:02.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.001+0000 7efdfa4e4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efdf415b440 0x7efdf40cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33830/0 (socket says 172.21.15.77:33830) 2023-11-26T07:21:02.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.001+0000 7efdf9ce3640 1 --2- 172.21.15.77:0/3655893801 >> v2:172.21.15.159:3300/0 conn(0x7efdf40cc0f0 0x7efdf40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:02.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.001+0000 7efdface5640 1 -- 172.21.15.77:0/3655893801 >> v2:172.21.15.159:3300/0 conn(0x7efdf40cc0f0 msgr2=0x7efdf40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:02.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.001+0000 7efdface5640 1 --2- 172.21.15.77:0/3655893801 >> v2:172.21.15.159:3300/0 conn(0x7efdf40cc0f0 0x7efdf40c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:02.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.001+0000 7efdface5640 1 -- 172.21.15.77:0/3655893801 >> v1:172.21.15.77:6789/0 conn(0x7efdf415b440 legacy=0x7efdf40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:02.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.001+0000 7efdface5640 1 -- 172.21.15.77:0/3655893801 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf415f0f0 con 0x7efdf40c57e0 2023-11-26T07:21:02.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.001+0000 7efdf9ce3640 1 --2- 172.21.15.77:0/3655893801 >> v2:172.21.15.159:3300/0 conn(0x7efdf40cc0f0 0x7efdf40c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:02.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.003+0000 7efdface5640 1 --2- 172.21.15.77:0/3655893801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf40c57e0 0x7efdf406c5f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efdf406e720 tx=0x7efdec02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5791834ac640b51a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:02.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.003+0000 7efdf94e2640 1 -- 172.21.15.77:0/3655893801 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec02ca80 con 0x7efdf40c57e0 2023-11-26T07:21:02.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.003+0000 7efdf94e2640 1 -- 172.21.15.77:0/3655893801 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec02cbe0 con 0x7efdf40c57e0 2023-11-26T07:21:02.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.003+0000 7efdf94e2640 1 -- 172.21.15.77:0/3655893801 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec0343f0 con 0x7efdf40c57e0 2023-11-26T07:21:02.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.003+0000 7efdfc748640 1 -- 172.21.15.77:0/3655893801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf40c57e0 msgr2=0x7efdf406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:02.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.003+0000 7efdfc748640 1 --2- 172.21.15.77:0/3655893801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf40c57e0 0x7efdf406c5f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efdf406e720 tx=0x7efdec02bee0 comp rx=0 tx=0).stop 2023-11-26T07:21:02.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.003+0000 7efdfc748640 1 -- 172.21.15.77:0/3655893801 shutdown_connections 2023-11-26T07:21:02.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.004+0000 7efdfc748640 1 --2- 172.21.15.77:0/3655893801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf40c57e0 0x7efdf406c5f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:02.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.004+0000 7efdfc748640 1 --2- 172.21.15.77:0/3655893801 >> v2:172.21.15.159:3300/0 conn(0x7efdf40cc0f0 0x7efdf40c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:02.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.004+0000 7efdfc748640 1 -- 172.21.15.77:0/3655893801 >> 172.21.15.77:0/3655893801 conn(0x7efdf40b0c50 msgr2=0x7efdf40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:02.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.004+0000 7efdfc748640 1 -- 172.21.15.77:0/3655893801 shutdown_connections 2023-11-26T07:21:02.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.004+0000 7efdfc748640 1 -- 172.21.15.77:0/3655893801 wait complete. 2023-11-26T07:21:02.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.005+0000 7efdfc748640 1 Processor -- start 2023-11-26T07:21:02.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.006+0000 7efdfc748640 1 -- start start 2023-11-26T07:21:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfc748640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf40c57e0 0x7efdf40ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfc748640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf40cc0f0 0x7efdf40adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfc748640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf415b440 0x7efdf40ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfc748640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf41f3970 con 0x7efdf40c57e0 2023-11-26T07:21:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfc748640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4156300 con 0x7efdf415b440 2023-11-26T07:21:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfc748640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40ae1f0 con 0x7efdf40cc0f0 2023-11-26T07:21:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfa4e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf40c57e0 0x7efdf40ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfa4e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf40c57e0 0x7efdf40ac130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52020/0 (socket says 172.21.15.77:52020) 2023-11-26T07:21:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfa4e4640 1 -- 172.21.15.77:0/2847014712 learned_addr learned my addr 172.21.15.77:0/2847014712 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:02.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfa4e4640 1 -- 172.21.15.77:0/2847014712 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf40cc0f0 msgr2=0x7efdf40adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:02.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfa4e4640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf40cc0f0 0x7efdf40adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:02.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfa4e4640 1 -- 172.21.15.77:0/2847014712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf415b440 msgr2=0x7efdf40ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:02.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfa4e4640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf415b440 0x7efdf40ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:02.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.007+0000 7efdfa4e4640 1 -- 172.21.15.77:0/2847014712 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec009b30 con 0x7efdf40c57e0 2023-11-26T07:21:02.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.008+0000 7efdfa4e4640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf40c57e0 0x7efdf40ac130 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efdf000c3e0 tx=0x7efdf000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:02.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.008+0000 7efdeaffd640 1 -- 172.21.15.77:0/2847014712 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf00074e0 con 0x7efdf40c57e0 2023-11-26T07:21:02.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.008+0000 7efdeaffd640 1 -- 172.21.15.77:0/2847014712 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf0007640 con 0x7efdf40c57e0 2023-11-26T07:21:02.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.008+0000 7efdfc748640 1 -- 172.21.15.77:0/2847014712 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf41f2cf0 con 0x7efdf40c57e0 2023-11-26T07:21:02.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.008+0000 7efdeaffd640 1 -- 172.21.15.77:0/2847014712 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf00049e0 con 0x7efdf40c57e0 2023-11-26T07:21:02.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.008+0000 7efdfc748640 1 -- 172.21.15.77:0/2847014712 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf41f32b0 con 0x7efdf40c57e0 2023-11-26T07:21:02.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.009+0000 7efdfc748640 1 -- 172.21.15.77:0/2847014712 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf404e8b0 con 0x7efdf40c57e0 2023-11-26T07:21:02.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.010+0000 7efdeaffd640 1 -- 172.21.15.77:0/2847014712 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 10) v1 ==== 89690+0+0 (secure 0 0 0) 0x7efdf0004b40 con 0x7efdf40c57e0 2023-11-26T07:21:02.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.012+0000 7efdeaffd640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdd806b350 0x7efdd806d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:02.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.012+0000 7efdeaffd640 1 -- 172.21.15.77:0/2847014712 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdf0089690 con 0x7efdf40c57e0 2023-11-26T07:21:02.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.012+0000 7efdf9ce3640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdd806b350 0x7efdd806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:02.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.012+0000 7efdf9ce3640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdd806b350 0x7efdd806d810 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efde4006fd0 tx=0x7efde4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:02.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.016+0000 7efdeaffd640 1 -- 172.21.15.77:0/2847014712 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efdf0054280 con 0x7efdf40c57e0 2023-11-26T07:21:02.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.243+0000 7efdfc748640 1 -- 172.21.15.77:0/2847014712 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82110", "target": ["mon-mgr", ""]}) v1 -- 0x7efdf415f990 con 0x7efdd806b350 2023-11-26T07:21:02.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.255+0000 7efdeaffd640 1 -- 172.21.15.77:0/2847014712 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7efde400ae40 con 0x7efdd806b350 2023-11-26T07:21:02.258 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:21:02.258 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:21:02.258 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "pending", 2023-11-26T07:21:02.259 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:21:02.259 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:21:02.259 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol51880", 2023-11-26T07:21:02.259 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap95310" 2023-11-26T07:21:02.259 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:02.259 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:02.259 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:21:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.258+0000 7efdfc748640 1 -- 172.21.15.77:0/2847014712 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdd806b350 msgr2=0x7efdd806d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.258+0000 7efdfc748640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdd806b350 0x7efdd806d810 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efde4006fd0 tx=0x7efde4008040 comp rx=0 tx=0).stop 2023-11-26T07:21:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.258+0000 7efdfc748640 1 -- 172.21.15.77:0/2847014712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf40c57e0 msgr2=0x7efdf40ac130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:02.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.258+0000 7efdfc748640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf40c57e0 0x7efdf40ac130 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efdf000c3e0 tx=0x7efdf000c8a0 comp rx=0 tx=0).stop 2023-11-26T07:21:02.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.258+0000 7efdfc748640 1 -- 172.21.15.77:0/2847014712 shutdown_connections 2023-11-26T07:21:02.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.258+0000 7efdfc748640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdd806b350 0x7efdd806d810 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:02.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.259+0000 7efdfc748640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf415b440 0x7efdf40ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:02.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.259+0000 7efdfc748640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf40cc0f0 0x7efdf40adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:02.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.259+0000 7efdfc748640 1 --2- 172.21.15.77:0/2847014712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf40c57e0 0x7efdf40ac130 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:02.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.259+0000 7efdfc748640 1 -- 172.21.15.77:0/2847014712 >> 172.21.15.77:0/2847014712 conn(0x7efdf40b0c50 msgr2=0x7efdf406c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:02.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.259+0000 7efdfc748640 1 -- 172.21.15.77:0/2847014712 shutdown_connections 2023-11-26T07:21:02.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:02.259+0000 7efdfc748640 1 -- 172.21.15.77:0/2847014712 wait complete. 2023-11-26T07:21:03.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82110 2023-11-26T07:21:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.503+0000 7fd52f59e640 1 Processor -- start 2023-11-26T07:21:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.503+0000 7fd52f59e640 1 -- start start 2023-11-26T07:21:03.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52f59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd53015a1c0 0x7fd53006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:03.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52f59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5300b0b40 0x7fd5300b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:03.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52f59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd53015ded0 0x7fd53015e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:03.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52f59e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53006d430 con 0x7fd53015a1c0 2023-11-26T07:21:03.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52f59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5300b14e0 con 0x7fd53015ded0 2023-11-26T07:21:03.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52f59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53015ec50 con 0x7fd5300b0b40 2023-11-26T07:21:03.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52e59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd53015a1c0 0x7fd53006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52e59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd53015a1c0 0x7fd53006d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52022/0 (socket says 172.21.15.77:52022) 2023-11-26T07:21:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52e59c640 1 -- 172.21.15.77:0/4046925722 learned_addr learned my addr 172.21.15.77:0/4046925722 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd527fff640 1 --2- 172.21.15.77:0/4046925722 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5300b0b40 0x7fd5300b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52ed9d640 1 --2- 172.21.15.77:0/4046925722 >> v2:172.21.15.159:3300/0 conn(0x7fd53015ded0 0x7fd53015e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52e59c640 1 -- 172.21.15.77:0/4046925722 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5300b0b40 msgr2=0x7fd5300b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52e59c640 1 --2- 172.21.15.77:0/4046925722 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5300b0b40 0x7fd5300b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52e59c640 1 -- 172.21.15.77:0/4046925722 >> v2:172.21.15.159:3300/0 conn(0x7fd53015ded0 msgr2=0x7fd53015e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52e59c640 1 --2- 172.21.15.77:0/4046925722 >> v2:172.21.15.159:3300/0 conn(0x7fd53015ded0 0x7fd53015e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52e59c640 1 -- 172.21.15.77:0/4046925722 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53006cb00 con 0x7fd53015a1c0 2023-11-26T07:21:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd527fff640 1 --2- 172.21.15.77:0/4046925722 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5300b0b40 0x7fd5300b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.505+0000 7fd52ed9d640 1 --2- 172.21.15.77:0/4046925722 >> v2:172.21.15.159:3300/0 conn(0x7fd53015ded0 0x7fd53015e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.507+0000 7fd52e59c640 1 --2- 172.21.15.77:0/4046925722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd53015a1c0 0x7fd53006d8c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd5300ccc20 tx=0x7fd52002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e1f10f51acb035 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.507+0000 7fd52dd9b640 1 -- 172.21.15.77:0/4046925722 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520031870 con 0x7fd53015a1c0 2023-11-26T07:21:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.507+0000 7fd52dd9b640 1 -- 172.21.15.77:0/4046925722 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5200319d0 con 0x7fd53015a1c0 2023-11-26T07:21:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.507+0000 7fd52dd9b640 1 -- 172.21.15.77:0/4046925722 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520031d60 con 0x7fd53015a1c0 2023-11-26T07:21:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.507+0000 7fd52f59e640 1 -- 172.21.15.77:0/4046925722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd53015a1c0 msgr2=0x7fd53006d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.507+0000 7fd52f59e640 1 --2- 172.21.15.77:0/4046925722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd53015a1c0 0x7fd53006d8c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd5300ccc20 tx=0x7fd52002b910 comp rx=0 tx=0).stop 2023-11-26T07:21:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.508+0000 7fd52f59e640 1 -- 172.21.15.77:0/4046925722 shutdown_connections 2023-11-26T07:21:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.508+0000 7fd52f59e640 1 --2- 172.21.15.77:0/4046925722 >> v2:172.21.15.159:3300/0 conn(0x7fd53015ded0 0x7fd53015e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.508+0000 7fd52f59e640 1 --2- 172.21.15.77:0/4046925722 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5300b0b40 0x7fd5300b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:03.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.508+0000 7fd52f59e640 1 --2- 172.21.15.77:0/4046925722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd53015a1c0 0x7fd53006d8c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:03.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.508+0000 7fd52f59e640 1 -- 172.21.15.77:0/4046925722 >> 172.21.15.77:0/4046925722 conn(0x7fd5300cbb40 msgr2=0x7fd5300cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:03.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.508+0000 7fd52f59e640 1 -- 172.21.15.77:0/4046925722 shutdown_connections 2023-11-26T07:21:03.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.508+0000 7fd52f59e640 1 -- 172.21.15.77:0/4046925722 wait complete. 2023-11-26T07:21:03.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.509+0000 7fd52f59e640 1 Processor -- start 2023-11-26T07:21:03.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.510+0000 7fd52f59e640 1 -- start start 2023-11-26T07:21:03.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd52f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5300b0b40 0x7fd5300b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:03.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd52f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd53015a1c0 0x7fd53015d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:03.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd52f59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd53015ded0 0x7fd53014f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:03.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd52f59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53015b7e0 con 0x7fd53015a1c0 2023-11-26T07:21:03.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd52f59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53015ab60 con 0x7fd5300b0b40 2023-11-26T07:21:03.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd52f59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53015ae40 con 0x7fd53015ded0 2023-11-26T07:21:03.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd527fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd53015a1c0 0x7fd53015d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:03.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd527fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd53015a1c0 0x7fd53015d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52036/0 (socket says 172.21.15.77:52036) 2023-11-26T07:21:03.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd527fff640 1 -- 172.21.15.77:0/1058071558 learned_addr learned my addr 172.21.15.77:0/1058071558 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:03.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd527fff640 1 -- 172.21.15.77:0/1058071558 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd53015ded0 msgr2=0x7fd53014f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:03.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd527fff640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd53015ded0 0x7fd53014f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:03.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd527fff640 1 -- 172.21.15.77:0/1058071558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5300b0b40 msgr2=0x7fd5300b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:03.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd527fff640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5300b0b40 0x7fd5300b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:03.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.511+0000 7fd527fff640 1 -- 172.21.15.77:0/1058071558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200094d0 con 0x7fd53015a1c0 2023-11-26T07:21:03.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.512+0000 7fd527fff640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd53015a1c0 0x7fd53015d070 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c7c0 tx=0x7fd51800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:03.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.512+0000 7fd526ffd640 1 -- 172.21.15.77:0/1058071558 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518007a30 con 0x7fd53015a1c0 2023-11-26T07:21:03.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.512+0000 7fd526ffd640 1 -- 172.21.15.77:0/1058071558 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd518007b90 con 0x7fd53015a1c0 2023-11-26T07:21:03.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.512+0000 7fd526ffd640 1 -- 172.21.15.77:0/1058071558 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51800ce70 con 0x7fd53015a1c0 2023-11-26T07:21:03.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.512+0000 7fd52f59e640 1 -- 172.21.15.77:0/1058071558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53015b120 con 0x7fd53015a1c0 2023-11-26T07:21:03.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.512+0000 7fd52f59e640 1 -- 172.21.15.77:0/1058071558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5300b3130 con 0x7fd53015a1c0 2023-11-26T07:21:03.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.513+0000 7fd52f59e640 1 -- 172.21.15.77:0/1058071558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53015b920 con 0x7fd53015a1c0 2023-11-26T07:21:03.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.514+0000 7fd526ffd640 1 -- 172.21.15.77:0/1058071558 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 10) v1 ==== 89690+0+0 (secure 0 0 0) 0x7fd5180113f0 con 0x7fd53015a1c0 2023-11-26T07:21:03.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.516+0000 7fd526ffd640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd51006b350 0x7fd51006d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:03.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.516+0000 7fd526ffd640 1 -- 172.21.15.77:0/1058071558 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd51808a040 con 0x7fd53015a1c0 2023-11-26T07:21:03.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.516+0000 7fd52e59c640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd51006b350 0x7fd51006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:03.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.516+0000 7fd52e59c640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd51006b350 0x7fd51006d810 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd520036000 tx=0x7fd520030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:03.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.520+0000 7fd526ffd640 1 -- 172.21.15.77:0/1058071558 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd53015b920 con 0x7fd53015a1c0 2023-11-26T07:21:03.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.746+0000 7fd52f59e640 1 -- 172.21.15.77:0/1058071558 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82110", "target": ["mon-mgr", ""]}) v1 -- 0x7fd530071b50 con 0x7fd51006b350 2023-11-26T07:21:03.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.761+0000 7fd526ffd640 1 -- 172.21.15.77:0/1058071558 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7fd530071b50 con 0x7fd51006b350 2023-11-26T07:21:03.766 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:21:03.766 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:21:03.766 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "pending", 2023-11-26T07:21:03.766 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:21:03.766 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:21:03.766 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol51880", 2023-11-26T07:21:03.766 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap95310" 2023-11-26T07:21:03.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:03.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:03.767 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:21:03.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 -- 172.21.15.77:0/1058071558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd51006b350 msgr2=0x7fd51006d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:03.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd51006b350 0x7fd51006d810 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd520036000 tx=0x7fd520030000 comp rx=0 tx=0).stop 2023-11-26T07:21:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 -- 172.21.15.77:0/1058071558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd53015a1c0 msgr2=0x7fd53015d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd53015a1c0 0x7fd53015d070 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c7c0 tx=0x7fd51800cc80 comp rx=0 tx=0).stop 2023-11-26T07:21:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 -- 172.21.15.77:0/1058071558 shutdown_connections 2023-11-26T07:21:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd51006b350 0x7fd51006d810 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd53015ded0 0x7fd53014f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd53015a1c0 0x7fd53015d070 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 --2- 172.21.15.77:0/1058071558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5300b0b40 0x7fd5300b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 -- 172.21.15.77:0/1058071558 >> 172.21.15.77:0/1058071558 conn(0x7fd5300cbb40 msgr2=0x7fd5300cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 -- 172.21.15.77:0/1058071558 shutdown_connections 2023-11-26T07:21:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:03.764+0000 7fd52f59e640 1 -- 172.21.15.77:0/1058071558 wait complete. 2023-11-26T07:21:04.786 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82110 2023-11-26T07:21:05.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.011+0000 7f0879d4e640 1 Processor -- start 2023-11-26T07:21:05.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.011+0000 7f0879d4e640 1 -- start start 2023-11-26T07:21:05.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.013+0000 7f0879d4e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f08740d1f40 0x7f08740ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:05.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.013+0000 7f0879d4e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08740d15e0 con 0x7f087415d7d0 2023-11-26T07:21:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.013+0000 7f0879d4e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08740d0280 con 0x7f087415d3f0 2023-11-26T07:21:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.013+0000 7f0879d4e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08740b0eb0 con 0x7f08740d1f40 2023-11-26T07:21:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.013+0000 7f0873fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f087415d7d0 0x7f08740cdd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33842/0 (socket says 172.21.15.77:33842) 2023-11-26T07:21:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.013+0000 7f0873fff640 1 -- 172.21.15.77:0/3218998409 learned_addr learned my addr 172.21.15.77:0/3218998409 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.013+0000 7f087954d640 1 --2- 172.21.15.77:0/3218998409 >> v2:172.21.15.77:3300/0 conn(0x7f08740d1f40 0x7f08740ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.014+0000 7f087954d640 1 -- 172.21.15.77:0/3218998409 >> v1:172.21.15.159:6789/0 conn(0x7f087415d3f0 legacy=0x7f08740d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.014+0000 7f08737fe640 1 -- 172.21.15.77:0/3218998409 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087450849 0 0) 0x7f08740d15e0 con 0x7f087415d7d0 2023-11-26T07:21:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.014+0000 7f087954d640 1 -- 172.21.15.77:0/3218998409 >> v1:172.21.15.77:6789/0 conn(0x7f087415d7d0 legacy=0x7f08740cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:05.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.014+0000 7f087954d640 1 -- 172.21.15.77:0/3218998409 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08740d1300 con 0x7f08740d1f40 2023-11-26T07:21:05.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.015+0000 7f087954d640 1 --2- 172.21.15.77:0/3218998409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08740d1f40 0x7f08740ce450 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f086c009d90 tx=0x7f086c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c587ad9b87121c8e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:05.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.015+0000 7f08737fe640 1 -- 172.21.15.77:0/3218998409 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c02cc60 con 0x7f08740d1f40 2023-11-26T07:21:05.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.015+0000 7f08737fe640 1 -- 172.21.15.77:0/3218998409 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c02cdc0 con 0x7f08740d1f40 2023-11-26T07:21:05.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.015+0000 7f08737fe640 1 -- 172.21.15.77:0/3218998409 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c034660 con 0x7f08740d1f40 2023-11-26T07:21:05.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.016+0000 7f0879d4e640 1 -- 172.21.15.77:0/3218998409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08740d1f40 msgr2=0x7f08740ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:05.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.016+0000 7f0879d4e640 1 --2- 172.21.15.77:0/3218998409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08740d1f40 0x7f08740ce450 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f086c009d90 tx=0x7f086c02beb0 comp rx=0 tx=0).stop 2023-11-26T07:21:05.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.016+0000 7f0879d4e640 1 -- 172.21.15.77:0/3218998409 shutdown_connections 2023-11-26T07:21:05.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.016+0000 7f0879d4e640 1 --2- 172.21.15.77:0/3218998409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08740d1f40 0x7f08740ce450 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:05.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.016+0000 7f0879d4e640 1 -- 172.21.15.77:0/3218998409 >> 172.21.15.77:0/3218998409 conn(0x7f087409c5b0 msgr2=0x7f08740d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:05.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.016+0000 7f0879d4e640 1 -- 172.21.15.77:0/3218998409 shutdown_connections 2023-11-26T07:21:05.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.016+0000 7f0879d4e640 1 -- 172.21.15.77:0/3218998409 wait complete. 2023-11-26T07:21:05.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.018+0000 7f0879d4e640 1 Processor -- start 2023-11-26T07:21:05.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.018+0000 7f0879d4e640 1 -- start start 2023-11-26T07:21:05.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0879d4e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08740d1f40 0x7f08741f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:05.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0879d4e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087415d3f0 0x7f08740b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:05.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0879d4e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f087415d7d0 0x7f08740b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:05.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0879d4e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0874149f40 con 0x7f087415d3f0 2023-11-26T07:21:05.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0879d4e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08740b4d30 con 0x7f087415d7d0 2023-11-26T07:21:05.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0879d4e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08740b2eb0 con 0x7f08740d1f40 2023-11-26T07:21:05.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0873fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087415d3f0 0x7f08740b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:05.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0873fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087415d3f0 0x7f08740b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52054/0 (socket says 172.21.15.77:52054) 2023-11-26T07:21:05.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0873fff640 1 -- 172.21.15.77:0/1382259017 learned_addr learned my addr 172.21.15.77:0/1382259017 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0873fff640 1 -- 172.21.15.77:0/1382259017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08740d1f40 msgr2=0x7f08741f0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0873fff640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08740d1f40 0x7f08741f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0873fff640 1 -- 172.21.15.77:0/1382259017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f087415d7d0 msgr2=0x7f08740b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0873fff640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f087415d7d0 0x7f08740b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.019+0000 7f0873fff640 1 -- 172.21.15.77:0/1382259017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c009a70 con 0x7f087415d3f0 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.020+0000 7f0873fff640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087415d3f0 0x7f08740b2970 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f086000c490 tx=0x7f086000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.020+0000 7f08717fa640 1 -- 172.21.15.77:0/1382259017 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600074e0 con 0x7f087415d3f0 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.020+0000 7f08717fa640 1 -- 172.21.15.77:0/1382259017 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860007640 con 0x7f087415d3f0 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.020+0000 7f08717fa640 1 -- 172.21.15.77:0/1382259017 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0860004a20 con 0x7f087415d3f0 2023-11-26T07:21:05.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.020+0000 7f0879d4e640 1 -- 172.21.15.77:0/1382259017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08741f38d0 con 0x7f087415d3f0 2023-11-26T07:21:05.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.020+0000 7f0879d4e640 1 -- 172.21.15.77:0/1382259017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08740b49c0 con 0x7f087415d3f0 2023-11-26T07:21:05.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.021+0000 7f0879d4e640 1 -- 172.21.15.77:0/1382259017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087404e840 con 0x7f087415d3f0 2023-11-26T07:21:05.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.022+0000 7f08717fa640 1 -- 172.21.15.77:0/1382259017 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 10) v1 ==== 89690+0+0 (secure 0 0 0) 0x7f0860004b80 con 0x7f087415d3f0 2023-11-26T07:21:05.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.023+0000 7f08717fa640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f085806b350 0x7f085806d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:05.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.023+0000 7f08717fa640 1 -- 172.21.15.77:0/1382259017 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0860088fc0 con 0x7f087415d3f0 2023-11-26T07:21:05.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.023+0000 7f0878d4c640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f085806b350 0x7f085806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:05.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.024+0000 7f0878d4c640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f085806b350 0x7f085806d810 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f08740b18f0 tx=0x7f08680079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:05.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.027+0000 7f08717fa640 1 -- 172.21.15.77:0/1382259017 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0860053ab0 con 0x7f087415d3f0 2023-11-26T07:21:05.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:05.253+0000 7f0879d4e640 1 -- 172.21.15.77:0/1382259017 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82110", "target": ["mon-mgr", ""]}) v1 -- 0x7f08740b4ea0 con 0x7f085806b350 2023-11-26T07:21:06.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.611+0000 7f08717fa640 1 -- 172.21.15.77:0/1382259017 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7f08740b4ea0 con 0x7f085806b350 2023-11-26T07:21:06.614 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:21:06.614 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:21:06.614 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "in-progress", 2023-11-26T07:21:06.614 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:21:06.614 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:21:06.614 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol51880", 2023-11-26T07:21:06.614 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap95310" 2023-11-26T07:21:06.614 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:06.614 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:06.614 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:21:06.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.614+0000 7f0879d4e640 1 -- 172.21.15.77:0/1382259017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f085806b350 msgr2=0x7f085806d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:06.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.614+0000 7f0879d4e640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f085806b350 0x7f085806d810 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f08740b18f0 tx=0x7f08680079b0 comp rx=0 tx=0).stop 2023-11-26T07:21:06.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.614+0000 7f0879d4e640 1 -- 172.21.15.77:0/1382259017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087415d3f0 msgr2=0x7f08740b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:06.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.614+0000 7f0879d4e640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087415d3f0 0x7f08740b2970 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f086000c490 tx=0x7f086000c950 comp rx=0 tx=0).stop 2023-11-26T07:21:06.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.614+0000 7f0879d4e640 1 -- 172.21.15.77:0/1382259017 shutdown_connections 2023-11-26T07:21:06.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.614+0000 7f0879d4e640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f085806b350 0x7f085806d810 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:06.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.614+0000 7f0879d4e640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f087415d7d0 0x7f08740b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.614+0000 7f0879d4e640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087415d3f0 0x7f08740b2970 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.614+0000 7f0879d4e640 1 --2- 172.21.15.77:0/1382259017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08740d1f40 0x7f08741f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.614+0000 7f0879d4e640 1 -- 172.21.15.77:0/1382259017 >> 172.21.15.77:0/1382259017 conn(0x7f087409c5b0 msgr2=0x7f0874160490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.615+0000 7f0879d4e640 1 -- 172.21.15.77:0/1382259017 shutdown_connections 2023-11-26T07:21:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.615+0000 7f0879d4e640 1 -- 172.21.15.77:0/1382259017 wait complete. 2023-11-26T07:21:06.637 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone82110 2023-11-26T07:21:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.853+0000 7fd900533640 1 Processor -- start 2023-11-26T07:21:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.853+0000 7fd900533640 1 -- start start 2023-11-26T07:21:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.854+0000 7fd900533640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f8072160 0x7fd8f815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.854+0000 7fd900533640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f815ec90 con 0x7fd8f806de10 2023-11-26T07:21:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.854+0000 7fd900533640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f80cd530 con 0x7fd8f80c49f0 2023-11-26T07:21:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.854+0000 7fd900533640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80c4ed0 con 0x7fd8f8072160 2023-11-26T07:21:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.855+0000 7fd8fead0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd8f806de10 0x7fd8f80705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49376/0 (socket says 172.21.15.77:49376) 2023-11-26T07:21:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.855+0000 7fd8fead0640 1 -- 172.21.15.77:0/3093316344 learned_addr learned my addr 172.21.15.77:0/3093316344 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.855+0000 7fd8fe2cf640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f8072160 0x7fd8f815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.855+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177851928 0 0) 0x7fd8f0001490 con 0x7fd8f806de10 2023-11-26T07:21:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.855+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8e4005730 con 0x7fd8f806de10 2023-11-26T07:21:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.855+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2624010676 0 0) 0x7fd8e4005730 con 0x7fd8f806de10 2023-11-26T07:21:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f8072160 msgr2=0x7fd8f815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f8072160 0x7fd8f815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 >> v1:172.21.15.159:6789/0 conn(0x7fd8f80c49f0 legacy=0x7fd8f806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f80c51b0 con 0x7fd8f806de10 2023-11-26T07:21:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fd8f0001b80 con 0x7fd8f806de10 2023-11-26T07:21:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 >> v1:172.21.15.77:6789/0 conn(0x7fd8f806de10 legacy=0x7fd8f80705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:06.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f8072160 0x7fd8e4005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:06.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 0x7fd8e40069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:06.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8e4006f10 0x7fd8e4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:06.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80c4ed0 con 0x7fd8e4006180 2023-11-26T07:21:06.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e400dcd0 con 0x7fd8e4006f10 2023-11-26T07:21:06.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e400de90 con 0x7fd8f8072160 2023-11-26T07:21:06.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fdace640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 0x7fd8e40069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:06.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fe2cf640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f8072160 0x7fd8e4005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:06.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.856+0000 7fd8fead0640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8e4006f10 0x7fd8e4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.857+0000 7fd8fdace640 1 -- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f8072160 msgr2=0x7fd8e4005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.857+0000 7fd8fdace640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f8072160 0x7fd8e4005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.857+0000 7fd8fdace640 1 -- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8e4006f10 msgr2=0x7fd8e4007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.857+0000 7fd8fdace640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8e4006f10 0x7fd8e4007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.857+0000 7fd8fdace640 1 -- 172.21.15.77:0/3093316344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e4005730 con 0x7fd8e4006180 2023-11-26T07:21:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.857+0000 7fd8fe2cf640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f8072160 0x7fd8e4005bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.858+0000 7fd8fdace640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 0x7fd8e40069d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8001750 tx=0x7fd8e4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb3387e7fb8cae3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.858+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80052d0 con 0x7fd8e4006180 2023-11-26T07:21:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.858+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e802e050 con 0x7fd8e4006180 2023-11-26T07:21:06.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.858+0000 7fd8fd2cd640 1 -- 172.21.15.77:0/3093316344 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8003830 con 0x7fd8e4006180 2023-11-26T07:21:06.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.859+0000 7fd900533640 1 -- 172.21.15.77:0/3093316344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 msgr2=0x7fd8e40069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:06.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.859+0000 7fd900533640 1 --2- 172.21.15.77:0/3093316344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 0x7fd8e40069d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8001750 tx=0x7fd8e4007a00 comp rx=0 tx=0).stop 2023-11-26T07:21:06.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.859+0000 7fd8fead0640 1 -- 172.21.15.77:0/3093316344 reap_dead start 2023-11-26T07:21:06.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.859+0000 7fd900533640 1 -- 172.21.15.77:0/3093316344 shutdown_connections 2023-11-26T07:21:06.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.859+0000 7fd900533640 1 -- 172.21.15.77:0/3093316344 >> 172.21.15.77:0/3093316344 conn(0x7fd8f80b0c50 msgr2=0x7fd8f80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:06.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.859+0000 7fd900533640 1 -- 172.21.15.77:0/3093316344 shutdown_connections 2023-11-26T07:21:06.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.859+0000 7fd900533640 1 -- 172.21.15.77:0/3093316344 wait complete. 2023-11-26T07:21:06.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.861+0000 7fd900533640 1 Processor -- start 2023-11-26T07:21:06.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.862+0000 7fd900533640 1 -- start start 2023-11-26T07:21:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.862+0000 7fd900533640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 0x7fd8f8156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.862+0000 7fd900533640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8f815ae80 0x7fd8f81574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.862+0000 7fd900533640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f80cb290 0x7fd8f80cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.862+0000 7fd900533640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80cbc50 con 0x7fd8e4006180 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.862+0000 7fd900533640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f815b630 con 0x7fd8f815ae80 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.862+0000 7fd900533640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f815b8f0 con 0x7fd8f80cb290 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.863+0000 7fd8fe2cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 0x7fd8f8156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.863+0000 7fd8fe2cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 0x7fd8f8156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55106/0 (socket says 172.21.15.77:55106) 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.863+0000 7fd8fe2cf640 1 -- 172.21.15.77:0/3060598864 learned_addr learned my addr 172.21.15.77:0/3060598864 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.863+0000 7fd8fe2cf640 1 -- 172.21.15.77:0/3060598864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f80cb290 msgr2=0x7fd8f80cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.863+0000 7fd8fead0640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f80cb290 0x7fd8f80cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.863+0000 7fd8fdace640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8f815ae80 0x7fd8f81574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.863+0000 7fd8fe2cf640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f80cb290 0x7fd8f80cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.863+0000 7fd8fe2cf640 1 -- 172.21.15.77:0/3060598864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8f815ae80 msgr2=0x7fd8f81574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.863+0000 7fd8fe2cf640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8f815ae80 0x7fd8f81574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.863+0000 7fd8fe2cf640 1 -- 172.21.15.77:0/3060598864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f815bbd0 con 0x7fd8e4006180 2023-11-26T07:21:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.864+0000 7fd8fe2cf640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 0x7fd8f8156ea0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40116d0 tx=0x7fd8f4011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.864+0000 7fd8eeffd640 1 -- 172.21.15.77:0/3060598864 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400f9c0 con 0x7fd8e4006180 2023-11-26T07:21:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.864+0000 7fd8eeffd640 1 -- 172.21.15.77:0/3060598864 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f400fb20 con 0x7fd8e4006180 2023-11-26T07:21:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.864+0000 7fd8eeffd640 1 -- 172.21.15.77:0/3060598864 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400fed0 con 0x7fd8e4006180 2023-11-26T07:21:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.864+0000 7fd900533640 1 -- 172.21.15.77:0/3060598864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f815beb0 con 0x7fd8e4006180 2023-11-26T07:21:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.864+0000 7fd900533640 1 -- 172.21.15.77:0/3060598864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f815c470 con 0x7fd8e4006180 2023-11-26T07:21:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.866+0000 7fd900533640 1 -- 172.21.15.77:0/3060598864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f804e8b0 con 0x7fd8e4006180 2023-11-26T07:21:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.866+0000 7fd8eeffd640 1 -- 172.21.15.77:0/3060598864 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 10) v1 ==== 89690+0+0 (secure 0 0 0) 0x7fd8f4015460 con 0x7fd8e4006180 2023-11-26T07:21:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.867+0000 7fd8eeffd640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd8dc06b350 0x7fd8dc06d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.867+0000 7fd8eeffd640 1 -- 172.21.15.77:0/3060598864 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8f408a620 con 0x7fd8e4006180 2023-11-26T07:21:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.868+0000 7fd8fdace640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd8dc06b350 0x7fd8dc06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.869+0000 7fd8fdace640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd8dc06b350 0x7fd8dc06d810 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8033000 tx=0x7fd8e8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:06.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:06.873+0000 7fd8eeffd640 1 -- 172.21.15.77:0/3060598864 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8f4055180 con 0x7fd8e4006180 2023-11-26T07:21:07.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.127+0000 7fd900533640 1 -- 172.21.15.77:0/3060598864 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone82110", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8f80c5a50 con 0x7fd8dc06b350 2023-11-26T07:21:07.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.316+0000 7fd8eeffd640 1 -- 172.21.15.77:0/3060598864 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd8e8005470 con 0x7fd8dc06b350 2023-11-26T07:21:07.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.319+0000 7fd900533640 1 -- 172.21.15.77:0/3060598864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd8dc06b350 msgr2=0x7fd8dc06d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:07.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.319+0000 7fd900533640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd8dc06b350 0x7fd8dc06d810 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8033000 tx=0x7fd8e8009030 comp rx=0 tx=0).stop 2023-11-26T07:21:07.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.319+0000 7fd900533640 1 -- 172.21.15.77:0/3060598864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 msgr2=0x7fd8f8156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:07.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.319+0000 7fd900533640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 0x7fd8f8156ea0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40116d0 tx=0x7fd8f4011b90 comp rx=0 tx=0).stop 2023-11-26T07:21:07.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.319+0000 7fd900533640 1 -- 172.21.15.77:0/3060598864 shutdown_connections 2023-11-26T07:21:07.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.319+0000 7fd900533640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd8dc06b350 0x7fd8dc06d810 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:07.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.319+0000 7fd900533640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8f80cb290 0x7fd8f80cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:07.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.319+0000 7fd900533640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8f815ae80 0x7fd8f81574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:07.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.319+0000 7fd900533640 1 --2- 172.21.15.77:0/3060598864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e4006180 0x7fd8f8156ea0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:07.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.319+0000 7fd900533640 1 -- 172.21.15.77:0/3060598864 >> 172.21.15.77:0/3060598864 conn(0x7fd8f80b0c50 msgr2=0x7fd8f80ac930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:07.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.320+0000 7fd900533640 1 -- 172.21.15.77:0/3060598864 shutdown_connections 2023-11-26T07:21:07.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.320+0000 7fd900533640 1 -- 172.21.15.77:0/3060598864 wait complete. 2023-11-26T07:21:07.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82110 2023-11-26T07:21:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.551+0000 7efe0d885640 1 Processor -- start 2023-11-26T07:21:07.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.551+0000 7efe0d885640 1 -- start start 2023-11-26T07:21:07.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.552+0000 7efe0d885640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efe080b0fb0 0x7efe0806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:07.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.552+0000 7efe0d885640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0815ed20 con 0x7efe080b0b40 2023-11-26T07:21:07.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.552+0000 7efe0d885640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0815f8a0 con 0x7efe0815b260 2023-11-26T07:21:07.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.552+0000 7efe0d885640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0815b640 con 0x7efe080b0fb0 2023-11-26T07:21:07.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.553+0000 7efdfffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efe080b0b40 0x7efe0806c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49380/0 (socket says 172.21.15.77:49380) 2023-11-26T07:21:07.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.553+0000 7efdfffff640 1 -- 172.21.15.77:0/2364426855 learned_addr learned my addr 172.21.15.77:0/2364426855 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:07.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.553+0000 7efe0d084640 1 --2- 172.21.15.77:0/2364426855 >> v2:172.21.15.159:3300/0 conn(0x7efe080b0fb0 0x7efe0806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:07.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.553+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970447275 0 0) 0x7efe0815ed20 con 0x7efe080b0b40 2023-11-26T07:21:07.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.553+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf0003520 con 0x7efe080b0b40 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4008983853 0 0) 0x7efdf0003520 con 0x7efe080b0b40 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 >> v2:172.21.15.159:3300/0 conn(0x7efe080b0fb0 msgr2=0x7efe0806ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 --2- 172.21.15.77:0/2364426855 >> v2:172.21.15.159:3300/0 conn(0x7efe080b0fb0 0x7efe0806ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 >> v1:172.21.15.159:6789/0 conn(0x7efe0815b260 legacy=0x7efe0806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0806e750 con 0x7efe080b0b40 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7efdf8001670 con 0x7efe080b0b40 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 >> v1:172.21.15.77:6789/0 conn(0x7efe080b0b40 legacy=0x7efe0806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 --2- 172.21.15.77:0/2364426855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf0003970 0x7efdf0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 --2- 172.21.15.77:0/2364426855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 0x7efdf0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 --2- 172.21.15.77:0/2364426855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf00052a0 0x7efdf000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0815b640 con 0x7efdf00047c0 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf000c170 con 0x7efdf0003970 2023-11-26T07:21:07.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf000c330 con 0x7efdf00052a0 2023-11-26T07:21:07.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.554+0000 7efdfffff640 1 --2- 172.21.15.77:0/2364426855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 0x7efdf0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:07.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.555+0000 7efdfffff640 1 -- 172.21.15.77:0/2364426855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf00052a0 msgr2=0x7efdf000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:07.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.555+0000 7efdfffff640 1 --2- 172.21.15.77:0/2364426855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf00052a0 0x7efdf000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:07.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.555+0000 7efdfffff640 1 -- 172.21.15.77:0/2364426855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf0003970 msgr2=0x7efdf0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:07.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.555+0000 7efdfffff640 1 --2- 172.21.15.77:0/2364426855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf0003970 0x7efdf0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:07.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.555+0000 7efdfffff640 1 -- 172.21.15.77:0/2364426855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0003520 con 0x7efdf00047c0 2023-11-26T07:21:07.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.555+0000 7efe0d084640 1 -- 172.21.15.77:0/2364426855 reap_dead start 2023-11-26T07:21:07.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.556+0000 7efdfffff640 1 --2- 172.21.15.77:0/2364426855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 0x7efdf0004c40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efdf800c210 tx=0x7efdf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2a4349faa7b580 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:07.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.556+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8005ad0 con 0x7efdf00047c0 2023-11-26T07:21:07.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.556+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8005c30 con 0x7efdf00047c0 2023-11-26T07:21:07.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.556+0000 7efdff7fe640 1 -- 172.21.15.77:0/2364426855 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf802ca70 con 0x7efdf00047c0 2023-11-26T07:21:07.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.556+0000 7efe0d885640 1 -- 172.21.15.77:0/2364426855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 msgr2=0x7efdf0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:07.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.556+0000 7efe0d885640 1 --2- 172.21.15.77:0/2364426855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 0x7efdf0004c40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efdf800c210 tx=0x7efdf00057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:07.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.557+0000 7efe0d885640 1 -- 172.21.15.77:0/2364426855 shutdown_connections 2023-11-26T07:21:07.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.557+0000 7efe0d885640 1 --2- 172.21.15.77:0/2364426855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 0x7efdf0004c40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:07.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.557+0000 7efe0d885640 1 -- 172.21.15.77:0/2364426855 >> 172.21.15.77:0/2364426855 conn(0x7efe080cbb40 msgr2=0x7efe080cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:07.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.557+0000 7efe0d885640 1 -- 172.21.15.77:0/2364426855 shutdown_connections 2023-11-26T07:21:07.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.557+0000 7efe0d885640 1 -- 172.21.15.77:0/2364426855 wait complete. 2023-11-26T07:21:07.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.558+0000 7efe0d885640 1 Processor -- start 2023-11-26T07:21:07.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.559+0000 7efe0d885640 1 -- start start 2023-11-26T07:21:07.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.559+0000 7efe0d885640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 0x7efe080b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.559+0000 7efe0d885640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe080b2220 0x7efe081f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0d885640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe081f7160 0x7efe0815e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0d885640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe081f7610 con 0x7efdf00047c0 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0d885640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0815dbf0 con 0x7efe080b2220 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0d885640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0815cfe0 con 0x7efe081f7160 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0c883640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 0x7efe080b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0c883640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 0x7efe080b1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55120/0 (socket says 172.21.15.77:55120) 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0c883640 1 -- 172.21.15.77:0/2292768368 learned_addr learned my addr 172.21.15.77:0/2292768368 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efdfffff640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe080b2220 0x7efe081f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0c883640 1 -- 172.21.15.77:0/2292768368 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe081f7160 msgr2=0x7efe0815e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0c883640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe081f7160 0x7efe0815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:07.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0c883640 1 -- 172.21.15.77:0/2292768368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe080b2220 msgr2=0x7efe081f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0c883640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe080b2220 0x7efe081f6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.560+0000 7efe0c883640 1 -- 172.21.15.77:0/2292768368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0815d2c0 con 0x7efdf00047c0 2023-11-26T07:21:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.561+0000 7efe0c883640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 0x7efe080b1ce0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7efe0400c480 tx=0x7efe0400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.561+0000 7efdfd7fa640 1 -- 172.21.15.77:0/2292768368 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040052d0 con 0x7efdf00047c0 2023-11-26T07:21:07.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.561+0000 7efdfd7fa640 1 -- 172.21.15.77:0/2292768368 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04005430 con 0x7efdf00047c0 2023-11-26T07:21:07.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.561+0000 7efdfd7fa640 1 -- 172.21.15.77:0/2292768368 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04012870 con 0x7efdf00047c0 2023-11-26T07:21:07.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.561+0000 7efe0d885640 1 -- 172.21.15.77:0/2292768368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0815d5a0 con 0x7efdf00047c0 2023-11-26T07:21:07.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.561+0000 7efe0d885640 1 -- 172.21.15.77:0/2292768368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe08149df0 con 0x7efdf00047c0 2023-11-26T07:21:07.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.562+0000 7efe0d885640 1 -- 172.21.15.77:0/2292768368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0806d8e0 con 0x7efdf00047c0 2023-11-26T07:21:07.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.563+0000 7efdfd7fa640 1 -- 172.21.15.77:0/2292768368 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 10) v1 ==== 89690+0+0 (secure 0 0 0) 0x7efe040129d0 con 0x7efdf00047c0 2023-11-26T07:21:07.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.564+0000 7efdfd7fa640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdf406b380 0x7efdf406d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:07.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.564+0000 7efdfd7fa640 1 -- 172.21.15.77:0/2292768368 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe04089990 con 0x7efdf00047c0 2023-11-26T07:21:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.564+0000 7efdfffff640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdf406b380 0x7efdf406d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:07.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.565+0000 7efdfffff640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdf406b380 0x7efdf406d840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efdf8034000 tx=0x7efdf8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:07.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.570+0000 7efdfd7fa640 1 -- 172.21.15.77:0/2292768368 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe04057ed0 con 0x7efdf00047c0 2023-11-26T07:21:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:07.796+0000 7efe0d885640 1 -- 172.21.15.77:0/2292768368 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82110", "target": ["mon-mgr", ""]}) v1 -- 0x7efe08067de0 con 0x7efdf406b380 2023-11-26T07:21:08.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.344+0000 7efdfd7fa640 1 -- 172.21.15.77:0/2292768368 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+264 (secure 0 0 0) 0x7efe08067de0 con 0x7efdf406b380 2023-11-26T07:21:08.347 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:21:08.347 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:21:08.347 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "canceled", 2023-11-26T07:21:08.347 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:21:08.347 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:21:08.347 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol51880", 2023-11-26T07:21:08.348 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap95310" 2023-11-26T07:21:08.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:08.348 INFO:teuthology.orchestra.run.smithi077.stdout: "failure": { 2023-11-26T07:21:08.348 INFO:teuthology.orchestra.run.smithi077.stdout: "errno": "4", 2023-11-26T07:21:08.348 INFO:teuthology.orchestra.run.smithi077.stdout: "error_msg": "user interrupted clone operation" 2023-11-26T07:21:08.348 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:08.348 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:08.348 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:21:08.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.347+0000 7efe0d885640 1 -- 172.21.15.77:0/2292768368 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdf406b380 msgr2=0x7efdf406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.347+0000 7efe0d885640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdf406b380 0x7efdf406d840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efdf8034000 tx=0x7efdf8009030 comp rx=0 tx=0).stop 2023-11-26T07:21:08.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.347+0000 7efe0d885640 1 -- 172.21.15.77:0/2292768368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 msgr2=0x7efe080b1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.347+0000 7efe0d885640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 0x7efe080b1ce0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7efe0400c480 tx=0x7efe0400c940 comp rx=0 tx=0).stop 2023-11-26T07:21:08.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.348+0000 7efe0d885640 1 -- 172.21.15.77:0/2292768368 shutdown_connections 2023-11-26T07:21:08.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.348+0000 7efe0d885640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efdf406b380 0x7efdf406d840 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.348+0000 7efe0d885640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe081f7160 0x7efe0815e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.348+0000 7efe0d885640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe080b2220 0x7efe081f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.348+0000 7efe0d885640 1 --2- 172.21.15.77:0/2292768368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00047c0 0x7efe080b1ce0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.348+0000 7efe0d885640 1 -- 172.21.15.77:0/2292768368 >> 172.21.15.77:0/2292768368 conn(0x7efe080cbb40 msgr2=0x7efe080cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:08.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.348+0000 7efe0d885640 1 -- 172.21.15.77:0/2292768368 shutdown_connections 2023-11-26T07:21:08.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.348+0000 7efe0d885640 1 -- 172.21.15.77:0/2292768368 wait complete. 2023-11-26T07:21:08.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone82110 --force 2023-11-26T07:21:08.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.584+0000 7f31ed56c640 1 Processor -- start 2023-11-26T07:21:08.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.585+0000 7f31ed56c640 1 -- start start 2023-11-26T07:21:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.586+0000 7f31ed56c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31e80d0210 0x7f31e80b3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.586+0000 7f31ed56c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f31e80aee20 0x7f31e8161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.586+0000 7f31ed56c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e80722d0 con 0x7f31e815d510 2023-11-26T07:21:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.586+0000 7f31ed56c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80725b0 con 0x7f31e80aee20 2023-11-26T07:21:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.587+0000 7f31ed56c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8160f20 con 0x7f31e80d0210 2023-11-26T07:21:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.587+0000 7f31ecd6b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f31e80aee20 0x7f31e8161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.587+0000 7f31ecd6b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f31e80aee20 0x7f31e8161720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55128/0 (socket says 172.21.15.77:55128) 2023-11-26T07:21:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.587+0000 7f31ecd6b640 1 -- 172.21.15.77:0/2102912145 learned_addr learned my addr 172.21.15.77:0/2102912145 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.587+0000 7f31e7fff640 1 --2- 172.21.15.77:0/2102912145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31e80d0210 0x7f31e80b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.587+0000 7f31ecd6b640 1 -- 172.21.15.77:0/2102912145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31e80d0210 msgr2=0x7f31e80b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.587+0000 7f31ecd6b640 1 --2- 172.21.15.77:0/2102912145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31e80d0210 0x7f31e80b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.587+0000 7f31ecd6b640 1 -- 172.21.15.77:0/2102912145 >> v1:172.21.15.159:6789/0 conn(0x7f31e815d510 legacy=0x7f31e80d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.587+0000 7f31ecd6b640 1 -- 172.21.15.77:0/2102912145 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e8161200 con 0x7f31e80aee20 2023-11-26T07:21:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.587+0000 7f31e7fff640 1 --2- 172.21.15.77:0/2102912145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31e80d0210 0x7f31e80b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.589+0000 7f31ecd6b640 1 --2- 172.21.15.77:0/2102912145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31e80aee20 0x7f31e8161720 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009870 tx=0x7f31e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22ded5dc1c11f41 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.589+0000 7f31e6ffd640 1 -- 172.21.15.77:0/2102912145 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0031640 con 0x7f31e80aee20 2023-11-26T07:21:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.589+0000 7f31e6ffd640 1 -- 172.21.15.77:0/2102912145 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e00317a0 con 0x7f31e80aee20 2023-11-26T07:21:08.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.589+0000 7f31e6ffd640 1 -- 172.21.15.77:0/2102912145 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0031b30 con 0x7f31e80aee20 2023-11-26T07:21:08.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.589+0000 7f31ed56c640 1 -- 172.21.15.77:0/2102912145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31e80aee20 msgr2=0x7f31e8161720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.590+0000 7f31ed56c640 1 --2- 172.21.15.77:0/2102912145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31e80aee20 0x7f31e8161720 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009870 tx=0x7f31e002b8f0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.590+0000 7f31ed56c640 1 -- 172.21.15.77:0/2102912145 shutdown_connections 2023-11-26T07:21:08.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.590+0000 7f31ed56c640 1 --2- 172.21.15.77:0/2102912145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31e80aee20 0x7f31e8161720 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.590+0000 7f31ed56c640 1 --2- 172.21.15.77:0/2102912145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31e80d0210 0x7f31e80b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.590+0000 7f31ed56c640 1 -- 172.21.15.77:0/2102912145 >> 172.21.15.77:0/2102912145 conn(0x7f31e806d860 msgr2=0x7f31e806dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:08.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.590+0000 7f31ed56c640 1 -- 172.21.15.77:0/2102912145 shutdown_connections 2023-11-26T07:21:08.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.590+0000 7f31ed56c640 1 -- 172.21.15.77:0/2102912145 wait complete. 2023-11-26T07:21:08.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.592+0000 7f31ed56c640 1 Processor -- start 2023-11-26T07:21:08.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.592+0000 7f31ed56c640 1 -- start start 2023-11-26T07:21:08.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.593+0000 7f31ed56c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31e80aee20 0x7f31e80afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.593+0000 7f31ed56c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31e80d0210 0x7f31e8155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.593+0000 7f31ed56c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31e815d510 0x7f31e80cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.593+0000 7f31ed56c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80b2470 con 0x7f31e815d510 2023-11-26T07:21:08.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.593+0000 7f31ed56c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80b1b40 con 0x7f31e80d0210 2023-11-26T07:21:08.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.593+0000 7f31ed56c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80b1e20 con 0x7f31e80aee20 2023-11-26T07:21:08.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.594+0000 7f31ecd6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31e815d510 0x7f31e80cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.594+0000 7f31ecd6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31e815d510 0x7f31e80cf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55130/0 (socket says 172.21.15.77:55130) 2023-11-26T07:21:08.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.594+0000 7f31ecd6b640 1 -- 172.21.15.77:0/3347744240 learned_addr learned my addr 172.21.15.77:0/3347744240 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:08.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.594+0000 7f31e7fff640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31e80aee20 0x7f31e80afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.594+0000 7f31e77fe640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31e80d0210 0x7f31e8155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.594+0000 7f31ecd6b640 1 -- 172.21.15.77:0/3347744240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31e80aee20 msgr2=0x7f31e80afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.594+0000 7f31ecd6b640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31e80aee20 0x7f31e80afff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.594+0000 7f31ecd6b640 1 -- 172.21.15.77:0/3347744240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31e80d0210 msgr2=0x7f31e8155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.594+0000 7f31ecd6b640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31e80d0210 0x7f31e8155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.594+0000 7f31ecd6b640 1 -- 172.21.15.77:0/3347744240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e00094d0 con 0x7f31e815d510 2023-11-26T07:21:08.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.594+0000 7f31e77fe640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31e80d0210 0x7f31e8155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:08.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.595+0000 7f31ecd6b640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31e815d510 0x7f31e80cf0f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f31e002b930 tx=0x7f31e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:08.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.595+0000 7f31e4ff9640 1 -- 172.21.15.77:0/3347744240 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e003ab10 con 0x7f31e815d510 2023-11-26T07:21:08.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.595+0000 7f31e4ff9640 1 -- 172.21.15.77:0/3347744240 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e003ac90 con 0x7f31e815d510 2023-11-26T07:21:08.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.595+0000 7f31e4ff9640 1 -- 172.21.15.77:0/3347744240 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00443f0 con 0x7f31e815d510 2023-11-26T07:21:08.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.595+0000 7f31ed56c640 1 -- 172.21.15.77:0/3347744240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e80b2100 con 0x7f31e815d510 2023-11-26T07:21:08.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.595+0000 7f31ed56c640 1 -- 172.21.15.77:0/3347744240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e81557d0 con 0x7f31e815d510 2023-11-26T07:21:08.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.596+0000 7f31ed56c640 1 -- 172.21.15.77:0/3347744240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e80b25e0 con 0x7f31e815d510 2023-11-26T07:21:08.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.597+0000 7f31e4ff9640 1 -- 172.21.15.77:0/3347744240 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 10) v1 ==== 89690+0+0 (secure 0 0 0) 0x7f31e002f050 con 0x7f31e815d510 2023-11-26T07:21:08.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.598+0000 7f31e4ff9640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31c806b380 0x7f31c806d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.598+0000 7f31e4ff9640 1 -- 172.21.15.77:0/3347744240 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31e00abee0 con 0x7f31e815d510 2023-11-26T07:21:08.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.598+0000 7f31e7fff640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31c806b380 0x7f31c806d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.599+0000 7f31e7fff640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31c806b380 0x7f31c806d840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f31d8008f80 tx=0x7f31d80084d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:08.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.603+0000 7f31e4ff9640 1 -- 172.21.15.77:0/3347744240 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31e00767f0 con 0x7f31e815d510 2023-11-26T07:21:08.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.819+0000 7f31ed56c640 1 -- 172.21.15.77:0/3347744240 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone82110", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f31e80b1cb0 con 0x7f31c806b380 2023-11-26T07:21:08.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.840+0000 7f31e4ff9640 1 -- 172.21.15.77:0/3347744240 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f31e80b1cb0 con 0x7f31c806b380 2023-11-26T07:21:08.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.842+0000 7f31ed56c640 1 -- 172.21.15.77:0/3347744240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31c806b380 msgr2=0x7f31c806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.842+0000 7f31ed56c640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31c806b380 0x7f31c806d840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f31d8008f80 tx=0x7f31d80084d0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.842+0000 7f31ed56c640 1 -- 172.21.15.77:0/3347744240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31e815d510 msgr2=0x7f31e80cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.842+0000 7f31ed56c640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31e815d510 0x7f31e80cf0f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f31e002b930 tx=0x7f31e00046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.843+0000 7f31ed56c640 1 -- 172.21.15.77:0/3347744240 shutdown_connections 2023-11-26T07:21:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.843+0000 7f31ed56c640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f31c806b380 0x7f31c806d840 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.843+0000 7f31ed56c640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31e815d510 0x7f31e80cf0f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.843+0000 7f31ed56c640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31e80d0210 0x7f31e8155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.843+0000 7f31ed56c640 1 --2- 172.21.15.77:0/3347744240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31e80aee20 0x7f31e80afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.843+0000 7f31ed56c640 1 -- 172.21.15.77:0/3347744240 >> 172.21.15.77:0/3347744240 conn(0x7f31e806d860 msgr2=0x7f31e806e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.843+0000 7f31ed56c640 1 -- 172.21.15.77:0/3347744240 shutdown_connections 2023-11-26T07:21:08.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:08.843+0000 7f31ed56c640 1 -- 172.21.15.77:0/3347744240 wait complete. 2023-11-26T07:21:08.860 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:21:08.858+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:08.861 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:21:08.858+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:08.861 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:21:08.858+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:08.861 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:21:08.858+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:08.861 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:21:08.858+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:08.866 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol51880 subvol_snap95310 2023-11-26T07:21:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.063+0000 7faa01cb4640 1 Processor -- start 2023-11-26T07:21:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.063+0000 7faa01cb4640 1 -- start start 2023-11-26T07:21:09.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.064+0000 7faa01cb4640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa9fc0cf450 0x7fa9fc0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.064+0000 7faa01cb4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc0cece0 con 0x7fa9fc15c7f0 2023-11-26T07:21:09.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.064+0000 7faa01cb4640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc06d040 con 0x7fa9fc0cdfb0 2023-11-26T07:21:09.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.064+0000 7faa01cb4640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9fc0cfe40 con 0x7fa9fc0cf450 2023-11-26T07:21:09.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.064+0000 7fa9fb7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa9fc15c7f0 0x7fa9fc06db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49382/0 (socket says 172.21.15.77:49382) 2023-11-26T07:21:09.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.064+0000 7fa9fb7fe640 1 -- 172.21.15.77:0/381146873 learned_addr learned my addr 172.21.15.77:0/381146873 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:09.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.065+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237791548 0 0) 0x7fa9fc0cece0 con 0x7fa9fc15c7f0 2023-11-26T07:21:09.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.065+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9e8003520 con 0x7fa9fc15c7f0 2023-11-26T07:21:09.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.065+0000 7fa9f3fff640 1 --2- 172.21.15.77:0/381146873 >> v2:172.21.15.159:3300/0 conn(0x7fa9fc0cf450 0x7fa9fc0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.065+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 523266553 0 0) 0x7fa9e8003520 con 0x7fa9fc15c7f0 2023-11-26T07:21:09.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.065+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 >> v2:172.21.15.159:3300/0 conn(0x7fa9fc0cf450 msgr2=0x7fa9fc0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:09.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.065+0000 7fa9faffd640 1 --2- 172.21.15.77:0/381146873 >> v2:172.21.15.159:3300/0 conn(0x7fa9fc0cf450 0x7fa9fc0cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.065+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 >> v1:172.21.15.159:6789/0 conn(0x7fa9fc0cdfb0 legacy=0x7fa9fc0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.065+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc06d320 con 0x7fa9fc15c7f0 2023-11-26T07:21:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.065+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fa9ec001670 con 0x7fa9fc15c7f0 2023-11-26T07:21:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.065+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 >> v1:172.21.15.77:6789/0 conn(0x7fa9fc15c7f0 legacy=0x7fa9fc06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9faffd640 1 --2- 172.21.15.77:0/381146873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9e8003970 0x7fa9e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9faffd640 1 --2- 172.21.15.77:0/381146873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9e80047c0 0x7fa9e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9faffd640 1 --2- 172.21.15.77:0/381146873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9e8005180 0x7fa9e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0cfe40 con 0x7fa9e8003970 2023-11-26T07:21:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e800c080 con 0x7fa9e8005180 2023-11-26T07:21:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e800c240 con 0x7fa9e80047c0 2023-11-26T07:21:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9fb7fe640 1 --2- 172.21.15.77:0/381146873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9e8003970 0x7fa9e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9f3fff640 1 --2- 172.21.15.77:0/381146873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9e80047c0 0x7fa9e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9fb7fe640 1 -- 172.21.15.77:0/381146873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9e80047c0 msgr2=0x7fa9e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9fb7fe640 1 --2- 172.21.15.77:0/381146873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9e80047c0 0x7fa9e8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9fb7fe640 1 -- 172.21.15.77:0/381146873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9e8005180 msgr2=0x7fa9e800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9fb7fe640 1 --2- 172.21.15.77:0/381146873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9e8005180 0x7fa9e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9fb7fe640 1 -- 172.21.15.77:0/381146873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc06d320 con 0x7fa9e8003970 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.066+0000 7fa9fbfff640 1 -- 172.21.15.77:0/381146873 reap_dead start 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.067+0000 7fa9fb7fe640 1 --2- 172.21.15.77:0/381146873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9e8003970 0x7fa9e8003d90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00c340 tx=0x7fa9e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d672885498e66e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.068+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec02cbb0 con 0x7fa9e8003970 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.068+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec02cd10 con 0x7fa9e8003970 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.068+0000 7fa9faffd640 1 -- 172.21.15.77:0/381146873 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec005b10 con 0x7fa9e8003970 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.068+0000 7faa01cb4640 1 -- 172.21.15.77:0/381146873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9e8003970 msgr2=0x7fa9e8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.068+0000 7faa01cb4640 1 --2- 172.21.15.77:0/381146873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9e8003970 0x7fa9e8003d90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00c340 tx=0x7fa9e80057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.069+0000 7faa01cb4640 1 -- 172.21.15.77:0/381146873 shutdown_connections 2023-11-26T07:21:09.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.069+0000 7faa01cb4640 1 --2- 172.21.15.77:0/381146873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9e8003970 0x7fa9e8003d90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.069+0000 7faa01cb4640 1 -- 172.21.15.77:0/381146873 >> 172.21.15.77:0/381146873 conn(0x7fa9fc06a920 msgr2=0x7fa9fc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:09.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.069+0000 7faa01cb4640 1 -- 172.21.15.77:0/381146873 shutdown_connections 2023-11-26T07:21:09.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.069+0000 7faa01cb4640 1 -- 172.21.15.77:0/381146873 wait complete. 2023-11-26T07:21:09.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.071+0000 7faa01cb4640 1 Processor -- start 2023-11-26T07:21:09.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.071+0000 7faa01cb4640 1 -- start start 2023-11-26T07:21:09.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.072+0000 7faa01cb4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9e8003970 0x7fa9fc1e4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.072+0000 7faa01cb4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9fc158380 0x7fa9fc098990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.072+0000 7faa01cb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc0adc20 0x7fa9fc0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.072+0000 7faa01cb4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc098ed0 con 0x7fa9fc158380 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.072+0000 7faa01cb4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0ae5e0 con 0x7fa9fc0adc20 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.072+0000 7faa01cb4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc1e60d0 con 0x7fa9e8003970 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.072+0000 7fa9f3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9fc158380 0x7fa9fc098990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.073+0000 7fa9f3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9fc158380 0x7fa9fc098990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55160/0 (socket says 172.21.15.77:55160) 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.073+0000 7fa9f3fff640 1 -- 172.21.15.77:0/2144837519 learned_addr learned my addr 172.21.15.77:0/2144837519 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.073+0000 7fa9fb7fe640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9e8003970 0x7fa9fc1e4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.073+0000 7fa9fbfff640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc0adc20 0x7fa9fc0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.073+0000 7fa9f3fff640 1 -- 172.21.15.77:0/2144837519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9e8003970 msgr2=0x7fa9fc1e4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.073+0000 7fa9f3fff640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9e8003970 0x7fa9fc1e4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.073+0000 7fa9f3fff640 1 -- 172.21.15.77:0/2144837519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc0adc20 msgr2=0x7fa9fc0ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.073+0000 7fa9f3fff640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc0adc20 0x7fa9fc0ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.073+0000 7fa9f3fff640 1 -- 172.21.15.77:0/2144837519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc14fd60 con 0x7fa9fc158380 2023-11-26T07:21:09.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.073+0000 7fa9fbfff640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc0adc20 0x7fa9fc0ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:09.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.073+0000 7fa9f3fff640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9fc158380 0x7fa9fc098990 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400e7e0 tx=0x7fa9e400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.074+0000 7fa9f8ff9640 1 -- 172.21.15.77:0/2144837519 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e400c6d0 con 0x7fa9fc158380 2023-11-26T07:21:09.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.074+0000 7fa9f8ff9640 1 -- 172.21.15.77:0/2144837519 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e400c830 con 0x7fa9fc158380 2023-11-26T07:21:09.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.074+0000 7faa01cb4640 1 -- 172.21.15.77:0/2144837519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9fc158800 con 0x7fa9fc158380 2023-11-26T07:21:09.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.074+0000 7fa9f8ff9640 1 -- 172.21.15.77:0/2144837519 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e400cba0 con 0x7fa9fc158380 2023-11-26T07:21:09.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.074+0000 7faa01cb4640 1 -- 172.21.15.77:0/2144837519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc1e57a0 con 0x7fa9fc158380 2023-11-26T07:21:09.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.075+0000 7faa01cb4640 1 -- 172.21.15.77:0/2144837519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc067470 con 0x7fa9fc158380 2023-11-26T07:21:09.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.076+0000 7fa9f8ff9640 1 -- 172.21.15.77:0/2144837519 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 10) v1 ==== 89690+0+0 (secure 0 0 0) 0x7fa9e400cd00 con 0x7fa9fc158380 2023-11-26T07:21:09.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.077+0000 7fa9f8ff9640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa9dc06b350 0x7fa9dc06d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.077+0000 7fa9f8ff9640 1 -- 172.21.15.77:0/2144837519 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9e4089ce0 con 0x7fa9fc158380 2023-11-26T07:21:09.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.077+0000 7fa9fb7fe640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa9dc06b350 0x7fa9dc06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.078+0000 7fa9fb7fe640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa9dc06b350 0x7fa9dc06d810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec034000 tx=0x7fa9ec009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.081+0000 7fa9f8ff9640 1 -- 172.21.15.77:0/2144837519 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9e40545f0 con 0x7fa9fc158380 2023-11-26T07:21:09.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.308+0000 7faa01cb4640 1 -- 172.21.15.77:0/2144837519 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol51880", "snap_name": "subvol_snap95310", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9fc1542b0 con 0x7fa9dc06b350 2023-11-26T07:21:09.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.374+0000 7fa9f8ff9640 1 -- 172.21.15.77:0/2144837519 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa9fc1542b0 con 0x7fa9dc06b350 2023-11-26T07:21:09.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.377+0000 7faa01cb4640 1 -- 172.21.15.77:0/2144837519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa9dc06b350 msgr2=0x7fa9dc06d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.377+0000 7faa01cb4640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa9dc06b350 0x7fa9dc06d810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec034000 tx=0x7fa9ec009030 comp rx=0 tx=0).stop 2023-11-26T07:21:09.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.377+0000 7faa01cb4640 1 -- 172.21.15.77:0/2144837519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9fc158380 msgr2=0x7fa9fc098990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.377+0000 7faa01cb4640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9fc158380 0x7fa9fc098990 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400e7e0 tx=0x7fa9e400eca0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.377+0000 7faa01cb4640 1 -- 172.21.15.77:0/2144837519 shutdown_connections 2023-11-26T07:21:09.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.377+0000 7faa01cb4640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa9dc06b350 0x7fa9dc06d810 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.377+0000 7faa01cb4640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc0adc20 0x7fa9fc0ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.377+0000 7faa01cb4640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9fc158380 0x7fa9fc098990 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.377+0000 7faa01cb4640 1 --2- 172.21.15.77:0/2144837519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9e8003970 0x7fa9fc1e4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.378+0000 7faa01cb4640 1 -- 172.21.15.77:0/2144837519 >> 172.21.15.77:0/2144837519 conn(0x7fa9fc06a920 msgr2=0x7fa9fc0af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.378+0000 7faa01cb4640 1 -- 172.21.15.77:0/2144837519 shutdown_connections 2023-11-26T07:21:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.378+0000 7faa01cb4640 1 -- 172.21.15.77:0/2144837519 wait complete. 2023-11-26T07:21:09.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol51880 2023-11-26T07:21:09.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.601+0000 7ff2f1239640 1 Processor -- start 2023-11-26T07:21:09.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.602+0000 7ff2f1239640 1 -- start start 2023-11-26T07:21:09.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.603+0000 7ff2f1239640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff2ec15b260 0x7ff2ec06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.603+0000 7ff2f1239640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2ec06e580 0x7ff2ec0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.603+0000 7ff2f1239640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec06d5c0 con 0x7ff2ec0b1080 2023-11-26T07:21:09.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.603+0000 7ff2f1239640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec15b640 con 0x7ff2ec06e580 2023-11-26T07:21:09.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.603+0000 7ff2f1239640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec0b14d0 con 0x7ff2ec15b260 2023-11-26T07:21:09.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.603+0000 7ff2e3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2ec06e580 0x7ff2ec0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.603+0000 7ff2e3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2ec06e580 0x7ff2ec0b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55176/0 (socket says 172.21.15.77:55176) 2023-11-26T07:21:09.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.603+0000 7ff2e3fff640 1 -- 172.21.15.77:0/267118291 learned_addr learned my addr 172.21.15.77:0/267118291 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:09.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.604+0000 7ff2e3fff640 1 -- 172.21.15.77:0/267118291 >> v2:172.21.15.159:3300/0 conn(0x7ff2ec15b260 msgr2=0x7ff2ec06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:09.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.604+0000 7ff2ebfff640 1 --2- 172.21.15.77:0/267118291 >> v2:172.21.15.159:3300/0 conn(0x7ff2ec15b260 0x7ff2ec06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.604+0000 7ff2e3fff640 1 --2- 172.21.15.77:0/267118291 >> v2:172.21.15.159:3300/0 conn(0x7ff2ec15b260 0x7ff2ec06e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.604+0000 7ff2e3fff640 1 -- 172.21.15.77:0/267118291 >> v1:172.21.15.159:6789/0 conn(0x7ff2ec0b1080 legacy=0x7ff2ec0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:09.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.604+0000 7ff2e3fff640 1 -- 172.21.15.77:0/267118291 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec15ed20 con 0x7ff2ec06e580 2023-11-26T07:21:09.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.604+0000 7ff2ebfff640 1 --2- 172.21.15.77:0/267118291 >> v2:172.21.15.159:3300/0 conn(0x7ff2ec15b260 0x7ff2ec06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:09.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.605+0000 7ff2e3fff640 1 --2- 172.21.15.77:0/267118291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2ec06e580 0x7ff2ec0b0b40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0d0160 tx=0x7ff2d402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a93bb1467885b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.605+0000 7ff2eb7fe640 1 -- 172.21.15.77:0/267118291 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4031750 con 0x7ff2ec06e580 2023-11-26T07:21:09.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.605+0000 7ff2eb7fe640 1 -- 172.21.15.77:0/267118291 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d40318b0 con 0x7ff2ec06e580 2023-11-26T07:21:09.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.605+0000 7ff2eb7fe640 1 -- 172.21.15.77:0/267118291 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4031c40 con 0x7ff2ec06e580 2023-11-26T07:21:09.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.606+0000 7ff2f1239640 1 -- 172.21.15.77:0/267118291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2ec06e580 msgr2=0x7ff2ec0b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.606+0000 7ff2f1239640 1 --2- 172.21.15.77:0/267118291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2ec06e580 0x7ff2ec0b0b40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0d0160 tx=0x7ff2d402b7f0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.606+0000 7ff2f1239640 1 -- 172.21.15.77:0/267118291 shutdown_connections 2023-11-26T07:21:09.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.606+0000 7ff2f1239640 1 --2- 172.21.15.77:0/267118291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2ec06e580 0x7ff2ec0b0b40 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.606+0000 7ff2f1239640 1 --2- 172.21.15.77:0/267118291 >> v2:172.21.15.159:3300/0 conn(0x7ff2ec15b260 0x7ff2ec06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.606+0000 7ff2f1239640 1 -- 172.21.15.77:0/267118291 >> 172.21.15.77:0/267118291 conn(0x7ff2ec0cbb40 msgr2=0x7ff2ec0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:09.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.606+0000 7ff2f1239640 1 -- 172.21.15.77:0/267118291 shutdown_connections 2023-11-26T07:21:09.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.606+0000 7ff2f1239640 1 -- 172.21.15.77:0/267118291 wait complete. 2023-11-26T07:21:09.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.608+0000 7ff2f1239640 1 Processor -- start 2023-11-26T07:21:09.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.608+0000 7ff2f1239640 1 -- start start 2023-11-26T07:21:09.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.609+0000 7ff2f1239640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2ec06e580 0x7ff2ec15e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.609+0000 7ff2f1239640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0b1080 0x7ff2ec15c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.609+0000 7ff2f1239640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2ec15b260 0x7ff2ec14c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.609+0000 7ff2f1239640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec15d5d0 con 0x7ff2ec15b260 2023-11-26T07:21:09.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.609+0000 7ff2f1239640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec15c6d0 con 0x7ff2ec0b1080 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.609+0000 7ff2f1239640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec14ca70 con 0x7ff2ec06e580 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.609+0000 7ff2f0a38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2ec15b260 0x7ff2ec14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.609+0000 7ff2f0a38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2ec15b260 0x7ff2ec14c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55178/0 (socket says 172.21.15.77:55178) 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.609+0000 7ff2f0a38640 1 -- 172.21.15.77:0/3247795123 learned_addr learned my addr 172.21.15.77:0/3247795123 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2ebfff640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2ec06e580 0x7ff2ec15e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2f0a38640 1 -- 172.21.15.77:0/3247795123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2ec06e580 msgr2=0x7ff2ec15e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2f0a38640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2ec06e580 0x7ff2ec15e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2f0a38640 1 -- 172.21.15.77:0/3247795123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0b1080 msgr2=0x7ff2ec15c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2e3fff640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0b1080 0x7ff2ec15c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2f0a38640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0b1080 0x7ff2ec15c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2f0a38640 1 -- 172.21.15.77:0/3247795123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d40094d0 con 0x7ff2ec15b260 2023-11-26T07:21:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2f0a38640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2ec15b260 0x7ff2ec14c530 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400b970 tx=0x7ff2e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2e97fa640 1 -- 172.21.15.77:0/3247795123 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e400cb40 con 0x7ff2ec15b260 2023-11-26T07:21:09.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2e97fa640 1 -- 172.21.15.77:0/3247795123 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e400cca0 con 0x7ff2ec15b260 2023-11-26T07:21:09.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2e97fa640 1 -- 172.21.15.77:0/3247795123 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4014680 con 0x7ff2ec15b260 2023-11-26T07:21:09.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2f1239640 1 -- 172.21.15.77:0/3247795123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec15c950 con 0x7ff2ec15b260 2023-11-26T07:21:09.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.610+0000 7ff2f1239640 1 -- 172.21.15.77:0/3247795123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec15cf10 con 0x7ff2ec15b260 2023-11-26T07:21:09.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.611+0000 7ff2f1239640 1 -- 172.21.15.77:0/3247795123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec04e840 con 0x7ff2ec15b260 2023-11-26T07:21:09.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.612+0000 7ff2e97fa640 1 -- 172.21.15.77:0/3247795123 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 10) v1 ==== 89690+0+0 (secure 0 0 0) 0x7ff2e401d3b0 con 0x7ff2ec15b260 2023-11-26T07:21:09.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.614+0000 7ff2e97fa640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2cc06b380 0x7ff2cc06d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.614+0000 7ff2e97fa640 1 -- 172.21.15.77:0/3247795123 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2e4089c70 con 0x7ff2ec15b260 2023-11-26T07:21:09.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.614+0000 7ff2ebfff640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2cc06b380 0x7ff2cc06d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.614+0000 7ff2ebfff640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2cc06b380 0x7ff2cc06d840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc008850 tx=0x7ff2dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.618+0000 7ff2e97fa640 1 -- 172.21.15.77:0/3247795123 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2e40546d0 con 0x7ff2ec15b260 2023-11-26T07:21:09.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.758+0000 7ff2e97fa640 1 -- 172.21.15.77:0/3247795123 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7ff2e4054aa0 con 0x7ff2ec15b260 2023-11-26T07:21:09.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.825+0000 7ff2f1239640 1 -- 172.21.15.77:0/3247795123 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol51880", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2ec15ef70 con 0x7ff2cc06b380 2023-11-26T07:21:09.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.855+0000 7ff2e97fa640 1 -- 172.21.15.77:0/3247795123 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff2dc00c040 con 0x7ff2cc06b380 2023-11-26T07:21:09.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.857+0000 7ff2f1239640 1 -- 172.21.15.77:0/3247795123 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2cc06b380 msgr2=0x7ff2cc06d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.857+0000 7ff2f1239640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2cc06b380 0x7ff2cc06d840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc008850 tx=0x7ff2dc008040 comp rx=0 tx=0).stop 2023-11-26T07:21:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.858+0000 7ff2f1239640 1 -- 172.21.15.77:0/3247795123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2ec15b260 msgr2=0x7ff2ec14c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.858+0000 7ff2f1239640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2ec15b260 0x7ff2ec14c530 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400b970 tx=0x7ff2e400be30 comp rx=0 tx=0).stop 2023-11-26T07:21:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.858+0000 7ff2f1239640 1 -- 172.21.15.77:0/3247795123 shutdown_connections 2023-11-26T07:21:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.858+0000 7ff2f1239640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2cc06b380 0x7ff2cc06d840 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.858+0000 7ff2f1239640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2ec15b260 0x7ff2ec14c530 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.858+0000 7ff2f1239640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2ec0b1080 0x7ff2ec15c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.858+0000 7ff2f1239640 1 --2- 172.21.15.77:0/3247795123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2ec06e580 0x7ff2ec15e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.858+0000 7ff2f1239640 1 -- 172.21.15.77:0/3247795123 >> 172.21.15.77:0/3247795123 conn(0x7ff2ec0cbb40 msgr2=0x7ff2ec0af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.858+0000 7ff2f1239640 1 -- 172.21.15.77:0/3247795123 shutdown_connections 2023-11-26T07:21:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:09.858+0000 7ff2f1239640 1 -- 172.21.15.77:0/3247795123 wait complete. 2023-11-26T07:21:09.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:09.880 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:21:09.931 INFO:teuthology.orchestra.run.smithi077.stdout:3 2023-11-26T07:21:14.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:14.933 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:21:14.996 INFO:teuthology.orchestra.run.smithi077.stdout:2 2023-11-26T07:21:14.998 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:21:14.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:21:15.115 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:21:15.237 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:21:15.237 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:15.237 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:15.295 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:15.295 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:15.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:15.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.550+0000 7f12a4808640 1 Processor -- start 2023-11-26T07:21:15.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.551+0000 7f12a4808640 1 -- start start 2023-11-26T07:21:15.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.552+0000 7f12a4808640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a0144b30 0x7f12a015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.552+0000 7f12a4808640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f12a00b1de0 0x7f12a00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.552+0000 7f12a4808640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a015bf80 con 0x7f12a015c410 2023-11-26T07:21:15.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.552+0000 7f12a4808640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a00b27b0 con 0x7f12a00b1de0 2023-11-26T07:21:15.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.552+0000 7f12a4808640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00b1560 con 0x7f12a0144b30 2023-11-26T07:21:15.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.552+0000 7f129659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f12a015c410 0x7f12a00b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49388/0 (socket says 172.21.15.77:49388) 2023-11-26T07:21:15.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.552+0000 7f129659c640 1 -- 172.21.15.77:0/102541397 learned_addr learned my addr 172.21.15.77:0/102541397 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129f59e640 1 --2- 172.21.15.77:0/102541397 >> v2:172.21.15.159:3300/0 conn(0x7f12a00b1de0 0x7f12a00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129ed9d640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a0144b30 0x7f12a015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108830154 0 0) 0x7f12a015bf80 con 0x7f12a015c410 2023-11-26T07:21:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f128c003520 con 0x7f12a015c410 2023-11-26T07:21:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4028839936 0 0) 0x7f128c003520 con 0x7f12a015c410 2023-11-26T07:21:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a0144b30 msgr2=0x7f12a015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a0144b30 0x7f12a015f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 >> v2:172.21.15.159:3300/0 conn(0x7f12a00b1de0 msgr2=0x7f12a00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 --2- 172.21.15.77:0/102541397 >> v2:172.21.15.159:3300/0 conn(0x7f12a00b1de0 0x7f12a00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a00b1280 con 0x7f12a015c410 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f1288001670 con 0x7f12a015c410 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 >> v1:172.21.15.77:6789/0 conn(0x7f12a015c410 legacy=0x7f12a00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f128c003970 0x7f128c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a0144b30 0x7f128c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f128c004d00 0x7f128c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00b27b0 con 0x7f128c003970 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00b1560 con 0x7f128c004d00 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c00ba30 con 0x7f12a0144b30 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.553+0000 7f129ed9d640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f128c003970 0x7f128c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.554+0000 7f129659c640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a0144b30 0x7f128c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.554+0000 7f129f59e640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f128c004d00 0x7f128c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.554+0000 7f129ed9d640 1 -- 172.21.15.77:0/102541397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a0144b30 msgr2=0x7f128c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.554+0000 7f129ed9d640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a0144b30 0x7f128c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.554+0000 7f129ed9d640 1 -- 172.21.15.77:0/102541397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f128c004d00 msgr2=0x7f128c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.554+0000 7f129ed9d640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f128c004d00 0x7f128c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.554+0000 7f129ed9d640 1 -- 172.21.15.77:0/102541397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c003520 con 0x7f128c003970 2023-11-26T07:21:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.555+0000 7f129ed9d640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f128c003970 0x7f128c003d90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f129000ba60 tx=0x7f128c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbca92b4f1ae9a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.555+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290032630 con 0x7f128c003970 2023-11-26T07:21:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.555+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290032790 con 0x7f128c003970 2023-11-26T07:21:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.555+0000 7f129e59c640 1 -- 172.21.15.77:0/102541397 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290032b20 con 0x7f128c003970 2023-11-26T07:21:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.556+0000 7f12a4808640 1 -- 172.21.15.77:0/102541397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f128c003970 msgr2=0x7f128c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.556+0000 7f12a4808640 1 --2- 172.21.15.77:0/102541397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f128c003970 0x7f128c003d90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f129000ba60 tx=0x7f128c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.556+0000 7f129f59e640 1 -- 172.21.15.77:0/102541397 reap_dead start 2023-11-26T07:21:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.556+0000 7f12a4808640 1 -- 172.21.15.77:0/102541397 shutdown_connections 2023-11-26T07:21:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.556+0000 7f12a4808640 1 -- 172.21.15.77:0/102541397 >> 172.21.15.77:0/102541397 conn(0x7f12a00cb830 msgr2=0x7f12a00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.556+0000 7f12a4808640 1 -- 172.21.15.77:0/102541397 shutdown_connections 2023-11-26T07:21:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.556+0000 7f12a4808640 1 -- 172.21.15.77:0/102541397 wait complete. 2023-11-26T07:21:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.558+0000 7f12a4808640 1 Processor -- start 2023-11-26T07:21:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.558+0000 7f12a4808640 1 -- start start 2023-11-26T07:21:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f12a4808640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f128c003970 0x7f12a01f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f12a4808640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a01f3840 0x7f12a0142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f12a4808640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a01431a0 0x7f12a01f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f12a4808640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a0143620 con 0x7f12a01431a0 2023-11-26T07:21:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f12a4808640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a014d780 con 0x7f128c003970 2023-11-26T07:21:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f12a4808640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a01f2200 con 0x7f12a01f3840 2023-11-26T07:21:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f129f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a01431a0 0x7f12a01f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f129f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a01431a0 0x7f12a01f40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55210/0 (socket says 172.21.15.77:55210) 2023-11-26T07:21:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f129f59e640 1 -- 172.21.15.77:0/1685521014 learned_addr learned my addr 172.21.15.77:0/1685521014 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f129ed9d640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f128c003970 0x7f12a01f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f129659c640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a01f3840 0x7f12a0142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f129f59e640 1 -- 172.21.15.77:0/1685521014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a01f3840 msgr2=0x7f12a0142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f129f59e640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a01f3840 0x7f12a0142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f129f59e640 1 -- 172.21.15.77:0/1685521014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f128c003970 msgr2=0x7f12a01f1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f129f59e640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f128c003970 0x7f12a01f1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f129f59e640 1 -- 172.21.15.77:0/1685521014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a014d990 con 0x7f12a01431a0 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.559+0000 7f129ed9d640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f128c003970 0x7f12a01f1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.560+0000 7f129f59e640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a01431a0 0x7f12a01f40f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f12a00b50a0 tx=0x7f1298009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.560+0000 7f1297fff640 1 -- 172.21.15.77:0/1685521014 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298007cf0 con 0x7f12a01431a0 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.560+0000 7f1297fff640 1 -- 172.21.15.77:0/1685521014 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1298007e70 con 0x7f12a01431a0 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.560+0000 7f1297fff640 1 -- 172.21.15.77:0/1685521014 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298014620 con 0x7f12a01431a0 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.560+0000 7f12a4808640 1 -- 172.21.15.77:0/1685521014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a014dc70 con 0x7f12a01431a0 2023-11-26T07:21:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.560+0000 7f12a4808640 1 -- 172.21.15.77:0/1685521014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a014e230 con 0x7f12a01431a0 2023-11-26T07:21:15.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.561+0000 7f12a4808640 1 -- 172.21.15.77:0/1685521014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a004e840 con 0x7f12a01431a0 2023-11-26T07:21:15.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.562+0000 7f1297fff640 1 -- 172.21.15.77:0/1685521014 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f129801d3b0 con 0x7f12a01431a0 2023-11-26T07:21:15.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.563+0000 7f1297fff640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f128006b3e0 0x7f128006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.563+0000 7f1297fff640 1 -- 172.21.15.77:0/1685521014 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f1298089d40 con 0x7f12a01431a0 2023-11-26T07:21:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.563+0000 7f129ed9d640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f128006b3e0 0x7f128006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.564+0000 7f129ed9d640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f128006b3e0 0x7f128006d8a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f129000ba30 tx=0x7f129003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:15.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.568+0000 7f1297fff640 1 -- 172.21.15.77:0/1685521014 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1298054540 con 0x7f12a01431a0 2023-11-26T07:21:15.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.763+0000 7f12a4808640 1 -- 172.21.15.77:0/1685521014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12a006d860 con 0x7f12a01431a0 2023-11-26T07:21:15.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.765+0000 7f1297fff640 1 -- 172.21.15.77:0/1685521014 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16597 (secure 0 0 0) 0x7f1298019090 con 0x7f12a01431a0 2023-11-26T07:21:15.767 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:15.767 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":48,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:21:11.749045+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:14.223705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:15.435670+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:15.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 -- 172.21.15.77:0/1685521014 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f128006b3e0 msgr2=0x7f128006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:15.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f128006b3e0 0x7f128006d8a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f129000ba30 tx=0x7f129003d040 comp rx=0 tx=0).stop 2023-11-26T07:21:15.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 -- 172.21.15.77:0/1685521014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a01431a0 msgr2=0x7f12a01f40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:15.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a01431a0 0x7f12a01f40f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f12a00b50a0 tx=0x7f1298009d40 comp rx=0 tx=0).stop 2023-11-26T07:21:15.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 -- 172.21.15.77:0/1685521014 shutdown_connections 2023-11-26T07:21:15.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f128006b3e0 0x7f128006d8a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a01431a0 0x7f12a01f40f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12a01f3840 0x7f12a0142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 --2- 172.21.15.77:0/1685521014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f128c003970 0x7f12a01f1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 -- 172.21.15.77:0/1685521014 >> 172.21.15.77:0/1685521014 conn(0x7f12a00cb830 msgr2=0x7f12a00cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:15.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 -- 172.21.15.77:0/1685521014 shutdown_connections 2023-11-26T07:21:15.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.768+0000 7f12a4808640 1 -- 172.21.15.77:0/1685521014 wait complete. 2023-11-26T07:21:15.789 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:20:14.223705+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:20:15.435670+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:21:15.790 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:21:15.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.998+0000 7f1a69b48640 1 Processor -- start 2023-11-26T07:21:16.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:15.998+0000 7f1a69b48640 1 -- start start 2023-11-26T07:21:16.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.000+0000 7f1a69b48640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1a640ccbd0 0x7f1a641660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.000+0000 7f1a69b48640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1a640ccfb0 0x7f1a64162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.000+0000 7f1a69b48640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a641655f0 con 0x7f1a64162540 2023-11-26T07:21:16.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.000+0000 7f1a69b48640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640cc380 con 0x7f1a640ccbd0 2023-11-26T07:21:16.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.000+0000 7f1a69b48640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a64162b30 con 0x7f1a640ccfb0 2023-11-26T07:21:16.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.000+0000 7f1a63fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1a64162540 0x7f1a640c9650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41220/0 (socket says 172.21.15.77:41220) 2023-11-26T07:21:16.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.000+0000 7f1a637fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1a640ccbd0 0x7f1a641660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.000+0000 7f1a63fff640 1 -- 172.21.15.77:0/1709726899 learned_addr learned my addr 172.21.15.77:0/1709726899 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:16.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.001+0000 7f1a62ffd640 1 --2- 172.21.15.77:0/1709726899 >> v2:172.21.15.159:3300/0 conn(0x7f1a640ccfb0 0x7f1a64162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.001+0000 7f1a637fe640 1 -- 172.21.15.77:0/1709726899 >> v2:172.21.15.159:3300/0 conn(0x7f1a640ccfb0 msgr2=0x7f1a64162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:16.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.001+0000 7f1a637fe640 1 --2- 172.21.15.77:0/1709726899 >> v2:172.21.15.159:3300/0 conn(0x7f1a640ccfb0 0x7f1a64162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.001+0000 7f1a637fe640 1 -- 172.21.15.77:0/1709726899 >> v1:172.21.15.77:6789/0 conn(0x7f1a64162540 legacy=0x7f1a640c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.001+0000 7f1a637fe640 1 -- 172.21.15.77:0/1709726899 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a64162e10 con 0x7f1a640ccbd0 2023-11-26T07:21:16.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.001+0000 7f1a627fc640 1 -- 172.21.15.77:0/1709726899 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497965521 0 0) 0x7f1a641655f0 con 0x7f1a64162540 2023-11-26T07:21:16.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.002+0000 7f1a637fe640 1 --2- 172.21.15.77:0/1709726899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a640ccbd0 0x7f1a641660b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1a6406e700 tx=0x7f1a5402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e702ab2b2485ece server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:16.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.002+0000 7f1a627fc640 1 -- 172.21.15.77:0/1709726899 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54031830 con 0x7f1a640ccbd0 2023-11-26T07:21:16.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.003+0000 7f1a627fc640 1 -- 172.21.15.77:0/1709726899 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54031990 con 0x7f1a640ccbd0 2023-11-26T07:21:16.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.003+0000 7f1a627fc640 1 -- 172.21.15.77:0/1709726899 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54031d20 con 0x7f1a640ccbd0 2023-11-26T07:21:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.003+0000 7f1a69b48640 1 -- 172.21.15.77:0/1709726899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a640ccbd0 msgr2=0x7f1a641660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.003+0000 7f1a69b48640 1 --2- 172.21.15.77:0/1709726899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a640ccbd0 0x7f1a641660b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1a6406e700 tx=0x7f1a5402b8d0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.003+0000 7f1a69b48640 1 -- 172.21.15.77:0/1709726899 shutdown_connections 2023-11-26T07:21:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.003+0000 7f1a69b48640 1 --2- 172.21.15.77:0/1709726899 >> v2:172.21.15.159:3300/0 conn(0x7f1a640ccfb0 0x7f1a64162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.003+0000 7f1a69b48640 1 --2- 172.21.15.77:0/1709726899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a640ccbd0 0x7f1a641660b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.003+0000 7f1a69b48640 1 -- 172.21.15.77:0/1709726899 >> 172.21.15.77:0/1709726899 conn(0x7f1a640b0c50 msgr2=0x7f1a640b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.003+0000 7f1a69b48640 1 -- 172.21.15.77:0/1709726899 shutdown_connections 2023-11-26T07:21:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.003+0000 7f1a69b48640 1 -- 172.21.15.77:0/1709726899 wait complete. 2023-11-26T07:21:16.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.005+0000 7f1a69b48640 1 Processor -- start 2023-11-26T07:21:16.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.005+0000 7f1a69b48640 1 -- start start 2023-11-26T07:21:16.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.006+0000 7f1a69b48640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a640ccbd0 0x7f1a64158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.006+0000 7f1a69b48640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a640ccfb0 0x7f1a640b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.006+0000 7f1a69b48640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a64162540 0x7f1a640ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.006+0000 7f1a69b48640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640ac5e0 con 0x7f1a64162540 2023-11-26T07:21:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.006+0000 7f1a69b48640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640abfd0 con 0x7f1a640ccfb0 2023-11-26T07:21:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.006+0000 7f1a69b48640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640b26d0 con 0x7f1a640ccbd0 2023-11-26T07:21:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.007+0000 7f1a63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a64162540 0x7f1a640ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.007+0000 7f1a63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a64162540 0x7f1a640ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42906/0 (socket says 172.21.15.77:42906) 2023-11-26T07:21:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.007+0000 7f1a63fff640 1 -- 172.21.15.77:0/156232643 learned_addr learned my addr 172.21.15.77:0/156232643 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.007+0000 7f1a62ffd640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a640ccfb0 0x7f1a640b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.007+0000 7f1a637fe640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a640ccbd0 0x7f1a64158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.007+0000 7f1a63fff640 1 -- 172.21.15.77:0/156232643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a640ccbd0 msgr2=0x7f1a64158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.007+0000 7f1a63fff640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a640ccbd0 0x7f1a64158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.007+0000 7f1a63fff640 1 -- 172.21.15.77:0/156232643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a640ccfb0 msgr2=0x7f1a640b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.007+0000 7f1a63fff640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a640ccfb0 0x7f1a640b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.007+0000 7f1a63fff640 1 -- 172.21.15.77:0/156232643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a54009400 con 0x7f1a64162540 2023-11-26T07:21:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.007+0000 7f1a63fff640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a64162540 0x7f1a640ca8e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c7e0 tx=0x7f1a5c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:16.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.008+0000 7f1a4bfff640 1 -- 172.21.15.77:0/156232643 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00a640 con 0x7f1a64162540 2023-11-26T07:21:16.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.008+0000 7f1a4bfff640 1 -- 172.21.15.77:0/156232643 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00a7c0 con 0x7f1a64162540 2023-11-26T07:21:16.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.008+0000 7f1a69b48640 1 -- 172.21.15.77:0/156232643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a640ac270 con 0x7f1a64162540 2023-11-26T07:21:16.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.008+0000 7f1a4bfff640 1 -- 172.21.15.77:0/156232643 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00ab70 con 0x7f1a64162540 2023-11-26T07:21:16.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.008+0000 7f1a69b48640 1 -- 172.21.15.77:0/156232643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a64158800 con 0x7f1a64162540 2023-11-26T07:21:16.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.009+0000 7f1a69b48640 1 -- 172.21.15.77:0/156232643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a640ac790 con 0x7f1a64162540 2023-11-26T07:21:16.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.010+0000 7f1a4bfff640 1 -- 172.21.15.77:0/156232643 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f1a5c00acd0 con 0x7f1a64162540 2023-11-26T07:21:16.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.011+0000 7f1a4bfff640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a5006b410 0x7f1a5006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.011+0000 7f1a4bfff640 1 -- 172.21.15.77:0/156232643 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f1a5c089940 con 0x7f1a64162540 2023-11-26T07:21:16.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.012+0000 7f1a637fe640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a5006b410 0x7f1a5006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.012+0000 7f1a637fe640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a5006b410 0x7f1a5006d8d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1a54036000 tx=0x7f1a5403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:16.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.016+0000 7f1a4bfff640 1 -- 172.21.15.77:0/156232643 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a640ac790 con 0x7f1a64162540 2023-11-26T07:21:16.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.206+0000 7f1a69b48640 1 -- 172.21.15.77:0/156232643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a640ac400 con 0x7f1a64162540 2023-11-26T07:21:16.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.207+0000 7f1a4bfff640 1 -- 172.21.15.77:0/156232643 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a5c018020 con 0x7f1a64162540 2023-11-26T07:21:16.209 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:21:16.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 -- 172.21.15.77:0/156232643 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a5006b410 msgr2=0x7f1a5006d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a5006b410 0x7f1a5006d8d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1a54036000 tx=0x7f1a5403c040 comp rx=0 tx=0).stop 2023-11-26T07:21:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 -- 172.21.15.77:0/156232643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a64162540 msgr2=0x7f1a640ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a64162540 0x7f1a640ca8e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c7e0 tx=0x7f1a5c00cca0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 -- 172.21.15.77:0/156232643 shutdown_connections 2023-11-26T07:21:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a5006b410 0x7f1a5006d8d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a64162540 0x7f1a640ca8e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a640ccfb0 0x7f1a640b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 --2- 172.21.15.77:0/156232643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a640ccbd0 0x7f1a64158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 -- 172.21.15.77:0/156232643 >> 172.21.15.77:0/156232643 conn(0x7f1a640b0c50 msgr2=0x7f1a6406c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 -- 172.21.15.77:0/156232643 shutdown_connections 2023-11-26T07:21:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.210+0000 7f1a69b48640 1 -- 172.21.15.77:0/156232643 wait complete. 2023-11-26T07:21:16.229 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:21:16.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.443+0000 7f45fe7f5640 1 Processor -- start 2023-11-26T07:21:16.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.444+0000 7f45fe7f5640 1 -- start start 2023-11-26T07:21:16.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.445+0000 7f45fe7f5640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f45f80d4010 0x7f45f80cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.445+0000 7f45fe7f5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f80cf300 con 0x7f45f815d580 2023-11-26T07:21:16.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.445+0000 7f45fe7f5640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f80d1090 con 0x7f45f80cfc80 2023-11-26T07:21:16.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.445+0000 7f45fe7f5640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f80d1370 con 0x7f45f80d4010 2023-11-26T07:21:16.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.446+0000 7f45f7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f45f815d580 0x7f45f80d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41222/0 (socket says 172.21.15.77:41222) 2023-11-26T07:21:16.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.446+0000 7f45f7fff640 1 -- 172.21.15.77:0/6640658 learned_addr learned my addr 172.21.15.77:0/6640658 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:16.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.446+0000 7f45f77fe640 1 --2- 172.21.15.77:0/6640658 >> v2:172.21.15.159:3300/0 conn(0x7f45f80d4010 0x7f45f80cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.446+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201512844 0 0) 0x7f45f80cf300 con 0x7f45f815d580 2023-11-26T07:21:16.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.446+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e0003520 con 0x7f45f815d580 2023-11-26T07:21:16.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.446+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3358900904 0 0) 0x7f45e0003520 con 0x7f45f815d580 2023-11-26T07:21:16.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.446+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 >> v2:172.21.15.159:3300/0 conn(0x7f45f80d4010 msgr2=0x7f45f80cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.446+0000 7f45f6ffd640 1 --2- 172.21.15.77:0/6640658 >> v2:172.21.15.159:3300/0 conn(0x7f45f80d4010 0x7f45f80cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.446+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 >> v1:172.21.15.159:6789/0 conn(0x7f45f80cfc80 legacy=0x7f45f80d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f80d1650 con 0x7f45f815d580 2023-11-26T07:21:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f45e80019f0 con 0x7f45f815d580 2023-11-26T07:21:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 >> v1:172.21.15.77:6789/0 conn(0x7f45f815d580 legacy=0x7f45f80d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f6ffd640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e0003970 0x7f45e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f6ffd640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00047c0 0x7f45e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f6ffd640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e0005180 0x7f45e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80d1370 con 0x7f45e0003970 2023-11-26T07:21:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e000c020 con 0x7f45e00047c0 2023-11-26T07:21:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e000c1e0 con 0x7f45e0005180 2023-11-26T07:21:16.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f7fff640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e0003970 0x7f45e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f77fe640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00047c0 0x7f45e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45fcd92640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e0005180 0x7f45e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f7fff640 1 -- 172.21.15.77:0/6640658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e0005180 msgr2=0x7f45e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:16.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f7fff640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e0005180 0x7f45e000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f7fff640 1 -- 172.21.15.77:0/6640658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00047c0 msgr2=0x7f45e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:16.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f7fff640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00047c0 0x7f45e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45f7fff640 1 -- 172.21.15.77:0/6640658 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0003520 con 0x7f45e0003970 2023-11-26T07:21:16.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.447+0000 7f45fcd92640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e0005180 0x7f45e000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:16.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.448+0000 7f45fcd92640 1 -- 172.21.15.77:0/6640658 reap_dead start 2023-11-26T07:21:16.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.449+0000 7f45f7fff640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e0003970 0x7f45e0003d90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f45e800a830 tx=0x7f45e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60fa527a20cc273 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:16.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.449+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80072d0 con 0x7f45e0003970 2023-11-26T07:21:16.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.449+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e802f070 con 0x7f45e0003970 2023-11-26T07:21:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.449+0000 7f45f6ffd640 1 -- 172.21.15.77:0/6640658 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8007730 con 0x7f45e0003970 2023-11-26T07:21:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.449+0000 7f45fe7f5640 1 -- 172.21.15.77:0/6640658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e0003970 msgr2=0x7f45e0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.449+0000 7f45fe7f5640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e0003970 0x7f45e0003d90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f45e800a830 tx=0x7f45e00057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.450+0000 7f45fe7f5640 1 -- 172.21.15.77:0/6640658 shutdown_connections 2023-11-26T07:21:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.450+0000 7f45fe7f5640 1 --2- 172.21.15.77:0/6640658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e0003970 0x7f45e0003d90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.450+0000 7f45fe7f5640 1 -- 172.21.15.77:0/6640658 >> 172.21.15.77:0/6640658 conn(0x7f45f809c770 msgr2=0x7f45f80d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.450+0000 7f45fe7f5640 1 -- 172.21.15.77:0/6640658 shutdown_connections 2023-11-26T07:21:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.450+0000 7f45fe7f5640 1 -- 172.21.15.77:0/6640658 wait complete. 2023-11-26T07:21:16.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.451+0000 7f45fe7f5640 1 Processor -- start 2023-11-26T07:21:16.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.452+0000 7f45fe7f5640 1 -- start start 2023-11-26T07:21:16.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45fe7f5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e0003970 0x7f45f8149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45fe7f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45f80b6010 0x7f45f80cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45fe7f5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45f81f2ce0 0x7f45f8148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45fe7f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f814c770 con 0x7f45f80b6010 2023-11-26T07:21:16.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45fe7f5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80b6470 con 0x7f45e0003970 2023-11-26T07:21:16.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45fe7f5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80b9210 con 0x7f45f81f2ce0 2023-11-26T07:21:16.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45f80b6010 0x7f45f80cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45f80b6010 0x7f45f80cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42918/0 (socket says 172.21.15.77:42918) 2023-11-26T07:21:16.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45f77fe640 1 -- 172.21.15.77:0/3709196304 learned_addr learned my addr 172.21.15.77:0/3709196304 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:16.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45f7fff640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e0003970 0x7f45f8149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45fcd92640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45f81f2ce0 0x7f45f8148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45f77fe640 1 -- 172.21.15.77:0/3709196304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45f81f2ce0 msgr2=0x7f45f8148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45f77fe640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45f81f2ce0 0x7f45f8148860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45f77fe640 1 -- 172.21.15.77:0/3709196304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e0003970 msgr2=0x7f45f8149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45f77fe640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e0003970 0x7f45f8149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.453+0000 7f45f77fe640 1 -- 172.21.15.77:0/3709196304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f80b8c50 con 0x7f45f80b6010 2023-11-26T07:21:16.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.454+0000 7f45f77fe640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45f80b6010 0x7f45f80cc7f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f45ec011700 tx=0x7f45ec011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:16.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.454+0000 7f45f4ff9640 1 -- 172.21.15.77:0/3709196304 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00f9c0 con 0x7f45f80b6010 2023-11-26T07:21:16.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.454+0000 7f45f4ff9640 1 -- 172.21.15.77:0/3709196304 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec00fb20 con 0x7f45f80b6010 2023-11-26T07:21:16.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.454+0000 7f45f4ff9640 1 -- 172.21.15.77:0/3709196304 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00fe90 con 0x7f45f80b6010 2023-11-26T07:21:16.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.454+0000 7f45fe7f5640 1 -- 172.21.15.77:0/3709196304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f80b8f30 con 0x7f45f80b6010 2023-11-26T07:21:16.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.454+0000 7f45fe7f5640 1 -- 172.21.15.77:0/3709196304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f80cc2d0 con 0x7f45f80b6010 2023-11-26T07:21:16.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.455+0000 7f45fe7f5640 1 -- 172.21.15.77:0/3709196304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f80cc490 con 0x7f45f80b6010 2023-11-26T07:21:16.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.456+0000 7f45f4ff9640 1 -- 172.21.15.77:0/3709196304 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f45ec015460 con 0x7f45f80b6010 2023-11-26T07:21:16.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.457+0000 7f45f4ff9640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f45e406b3e0 0x7f45e406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.457+0000 7f45f4ff9640 1 -- 172.21.15.77:0/3709196304 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f45ec08a5b0 con 0x7f45f80b6010 2023-11-26T07:21:16.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.457+0000 7f45f7fff640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f45e406b3e0 0x7f45e406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.458+0000 7f45f7fff640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f45e406b3e0 0x7f45e406d8a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f45e8034000 tx=0x7f45e8007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:16.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.462+0000 7f45f4ff9640 1 -- 172.21.15.77:0/3709196304 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45ec054d20 con 0x7f45f80b6010 2023-11-26T07:21:16.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.660+0000 7f45fe7f5640 1 -- 172.21.15.77:0/3709196304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45f804e8b0 con 0x7f45f80b6010 2023-11-26T07:21:16.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.661+0000 7f45f4ff9640 1 -- 172.21.15.77:0/3709196304 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45ec058340 con 0x7f45f80b6010 2023-11-26T07:21:16.662 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:21:16.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.663+0000 7f45fe7f5640 1 -- 172.21.15.77:0/3709196304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f45e406b3e0 msgr2=0x7f45e406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.663+0000 7f45fe7f5640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f45e406b3e0 0x7f45e406d8a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f45e8034000 tx=0x7f45e8007000 comp rx=0 tx=0).stop 2023-11-26T07:21:16.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.663+0000 7f45fe7f5640 1 -- 172.21.15.77:0/3709196304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45f80b6010 msgr2=0x7f45f80cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.663+0000 7f45fe7f5640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45f80b6010 0x7f45f80cc7f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f45ec011700 tx=0x7f45ec011bc0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.663+0000 7f45fe7f5640 1 -- 172.21.15.77:0/3709196304 shutdown_connections 2023-11-26T07:21:16.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.663+0000 7f45fe7f5640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f45e406b3e0 0x7f45e406d8a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.663+0000 7f45fe7f5640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45f81f2ce0 0x7f45f8148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.663+0000 7f45fe7f5640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45f80b6010 0x7f45f80cc7f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.663+0000 7f45fe7f5640 1 --2- 172.21.15.77:0/3709196304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e0003970 0x7f45f8149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.663+0000 7f45fe7f5640 1 -- 172.21.15.77:0/3709196304 >> 172.21.15.77:0/3709196304 conn(0x7f45f809c770 msgr2=0x7f45f80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:16.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.664+0000 7f45fe7f5640 1 -- 172.21.15.77:0/3709196304 shutdown_connections 2023-11-26T07:21:16.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.664+0000 7f45fe7f5640 1 -- 172.21.15.77:0/3709196304 wait complete. 2023-11-26T07:21:16.683 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:21:16.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.885+0000 7f89caeee640 1 Processor -- start 2023-11-26T07:21:16.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.885+0000 7f89caeee640 1 -- start start 2023-11-26T07:21:16.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.887+0000 7f89caeee640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f89c40cc0f0 0x7f89c40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.887+0000 7f89caeee640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c415eea0 con 0x7f89c40c57e0 2023-11-26T07:21:16.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.887+0000 7f89caeee640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c40abf30 con 0x7f89c415b440 2023-11-26T07:21:16.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.887+0000 7f89caeee640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c415b820 con 0x7f89c40cc0f0 2023-11-26T07:21:16.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.887+0000 7f89c948b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f89c40c57e0 0x7f89c406c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41236/0 (socket says 172.21.15.77:41236) 2023-11-26T07:21:16.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.887+0000 7f89c948b640 1 -- 172.21.15.77:0/3169825688 learned_addr learned my addr 172.21.15.77:0/3169825688 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:16.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.888+0000 7f89c3fff640 1 --2- 172.21.15.77:0/3169825688 >> v2:172.21.15.159:3300/0 conn(0x7f89c40cc0f0 0x7f89c40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.888+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519532432 0 0) 0x7f89c415eea0 con 0x7f89c40c57e0 2023-11-26T07:21:16.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.888+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b4003520 con 0x7f89c40c57e0 2023-11-26T07:21:16.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.888+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1131080381 0 0) 0x7f89b4003520 con 0x7f89c40c57e0 2023-11-26T07:21:16.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.888+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 >> v2:172.21.15.159:3300/0 conn(0x7f89c40cc0f0 msgr2=0x7f89c40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:16.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.888+0000 7f89c37fe640 1 --2- 172.21.15.77:0/3169825688 >> v2:172.21.15.159:3300/0 conn(0x7f89c40cc0f0 0x7f89c40c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.888+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 >> v1:172.21.15.159:6789/0 conn(0x7f89c415b440 legacy=0x7f89c40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.888+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c415f0f0 con 0x7f89c40c57e0 2023-11-26T07:21:16.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.888+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f89bc0019f0 con 0x7f89c40c57e0 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.888+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 >> v1:172.21.15.77:6789/0 conn(0x7f89c40c57e0 legacy=0x7f89c406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c37fe640 1 --2- 172.21.15.77:0/3169825688 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b4003970 0x7f89b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c37fe640 1 --2- 172.21.15.77:0/3169825688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 0x7f89b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c37fe640 1 --2- 172.21.15.77:0/3169825688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b4005180 0x7f89b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c415b820 con 0x7f89b40047c0 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b400c120 con 0x7f89b4005180 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b400c2e0 con 0x7f89b4003970 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c3fff640 1 --2- 172.21.15.77:0/3169825688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 0x7f89b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c8c8a640 1 --2- 172.21.15.77:0/3169825688 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b4003970 0x7f89b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c948b640 1 --2- 172.21.15.77:0/3169825688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b4005180 0x7f89b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c3fff640 1 -- 172.21.15.77:0/3169825688 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b4003970 msgr2=0x7f89b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:16.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c3fff640 1 --2- 172.21.15.77:0/3169825688 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b4003970 0x7f89b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c3fff640 1 -- 172.21.15.77:0/3169825688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b4005180 msgr2=0x7f89b400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:16.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c3fff640 1 --2- 172.21.15.77:0/3169825688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b4005180 0x7f89b400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c948b640 1 -- 172.21.15.77:0/3169825688 reap_dead start 2023-11-26T07:21:16.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.889+0000 7f89c3fff640 1 -- 172.21.15.77:0/3169825688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4003520 con 0x7f89b40047c0 2023-11-26T07:21:16.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.891+0000 7f89c3fff640 1 --2- 172.21.15.77:0/3169825688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 0x7f89b4004c40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009aa0 tx=0x7f89b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb846c9d97df5f46 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:16.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.891+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b002c6b0 con 0x7f89b40047c0 2023-11-26T07:21:16.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.891+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b002c810 con 0x7f89b40047c0 2023-11-26T07:21:16.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.891+0000 7f89c37fe640 1 -- 172.21.15.77:0/3169825688 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b002cbc0 con 0x7f89b40047c0 2023-11-26T07:21:16.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.892+0000 7f89caeee640 1 -- 172.21.15.77:0/3169825688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 msgr2=0x7f89b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.892+0000 7f89caeee640 1 --2- 172.21.15.77:0/3169825688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 0x7f89b4004c40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009aa0 tx=0x7f89b40057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.892+0000 7f89caeee640 1 -- 172.21.15.77:0/3169825688 shutdown_connections 2023-11-26T07:21:16.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.892+0000 7f89caeee640 1 --2- 172.21.15.77:0/3169825688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 0x7f89b4004c40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.892+0000 7f89caeee640 1 -- 172.21.15.77:0/3169825688 >> 172.21.15.77:0/3169825688 conn(0x7f89c40b0c50 msgr2=0x7f89c40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:16.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.892+0000 7f89caeee640 1 -- 172.21.15.77:0/3169825688 shutdown_connections 2023-11-26T07:21:16.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.892+0000 7f89caeee640 1 -- 172.21.15.77:0/3169825688 wait complete. 2023-11-26T07:21:16.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.894+0000 7f89caeee640 1 Processor -- start 2023-11-26T07:21:16.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.894+0000 7f89caeee640 1 -- start start 2023-11-26T07:21:16.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89caeee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 0x7f89c414e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89caeee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89c40c87e0 0x7f89c40c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89caeee640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89c4159c10 0x7f89c415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89caeee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40c8fa0 con 0x7f89b40047c0 2023-11-26T07:21:16.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89caeee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c415a5e0 con 0x7f89c40c87e0 2023-11-26T07:21:16.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89caeee640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40ae1d0 con 0x7f89c4159c10 2023-11-26T07:21:16.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89c8c8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 0x7f89c414e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89c8c8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 0x7f89c414e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42944/0 (socket says 172.21.15.77:42944) 2023-11-26T07:21:16.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89c8c8a640 1 -- 172.21.15.77:0/2086654730 learned_addr learned my addr 172.21.15.77:0/2086654730 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:16.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89c8c8a640 1 -- 172.21.15.77:0/2086654730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89c4159c10 msgr2=0x7f89c415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89c8c8a640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89c4159c10 0x7f89c415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89c8c8a640 1 -- 172.21.15.77:0/2086654730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89c40c87e0 msgr2=0x7f89c40c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:16.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.895+0000 7f89c8c8a640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89c40c87e0 0x7f89c40c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:16.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.896+0000 7f89c8c8a640 1 -- 172.21.15.77:0/2086654730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c40c8cc0 con 0x7f89b40047c0 2023-11-26T07:21:16.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.896+0000 7f89c8c8a640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 0x7f89c414e5a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f89b800e4d0 tx=0x7f89b800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:16.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.896+0000 7f89c17fa640 1 -- 172.21.15.77:0/2086654730 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b80053a0 con 0x7f89b40047c0 2023-11-26T07:21:16.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.896+0000 7f89c17fa640 1 -- 172.21.15.77:0/2086654730 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b80035f0 con 0x7f89b40047c0 2023-11-26T07:21:16.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.896+0000 7f89caeee640 1 -- 172.21.15.77:0/2086654730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c40adc10 con 0x7f89b40047c0 2023-11-26T07:21:16.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.896+0000 7f89c17fa640 1 -- 172.21.15.77:0/2086654730 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b80039a0 con 0x7f89b40047c0 2023-11-26T07:21:16.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.896+0000 7f89caeee640 1 -- 172.21.15.77:0/2086654730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c414eae0 con 0x7f89b40047c0 2023-11-26T07:21:16.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.897+0000 7f89caeee640 1 -- 172.21.15.77:0/2086654730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c40ada70 con 0x7f89b40047c0 2023-11-26T07:21:16.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.898+0000 7f89c17fa640 1 -- 172.21.15.77:0/2086654730 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f89b8003b00 con 0x7f89b40047c0 2023-11-26T07:21:16.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.900+0000 7f89c17fa640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89a806b3d0 0x7f89a806d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:16.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.900+0000 7f89c17fa640 1 -- 172.21.15.77:0/2086654730 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f89b8089db0 con 0x7f89b40047c0 2023-11-26T07:21:16.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.900+0000 7f89c3fff640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89a806b3d0 0x7f89a806d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:16.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.901+0000 7f89c3fff640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89a806b3d0 0x7f89a806d890 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f89b0036000 tx=0x7f89b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:16.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:16.904+0000 7f89c17fa640 1 -- 172.21.15.77:0/2086654730 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89c40ada70 con 0x7f89b40047c0 2023-11-26T07:21:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.098+0000 7f89caeee640 1 -- 172.21.15.77:0/2086654730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89c40ada70 con 0x7f89b40047c0 2023-11-26T07:21:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.099+0000 7f89c17fa640 1 -- 172.21.15.77:0/2086654730 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89c40ada70 con 0x7f89b40047c0 2023-11-26T07:21:17.100 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:21:17.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.101+0000 7f89caeee640 1 -- 172.21.15.77:0/2086654730 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89a806b3d0 msgr2=0x7f89a806d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.101+0000 7f89caeee640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89a806b3d0 0x7f89a806d890 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f89b0036000 tx=0x7f89b002e000 comp rx=0 tx=0).stop 2023-11-26T07:21:17.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.101+0000 7f89caeee640 1 -- 172.21.15.77:0/2086654730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 msgr2=0x7f89c414e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.101+0000 7f89caeee640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 0x7f89c414e5a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f89b800e4d0 tx=0x7f89b800e990 comp rx=0 tx=0).stop 2023-11-26T07:21:17.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.101+0000 7f89caeee640 1 -- 172.21.15.77:0/2086654730 shutdown_connections 2023-11-26T07:21:17.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.101+0000 7f89caeee640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89a806b3d0 0x7f89a806d890 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.101+0000 7f89caeee640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89c4159c10 0x7f89c415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.101+0000 7f89caeee640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89c40c87e0 0x7f89c40c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.101+0000 7f89caeee640 1 --2- 172.21.15.77:0/2086654730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89b40047c0 0x7f89c414e5a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.101+0000 7f89caeee640 1 -- 172.21.15.77:0/2086654730 >> 172.21.15.77:0/2086654730 conn(0x7f89c40b0c50 msgr2=0x7f89c40cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:17.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.102+0000 7f89caeee640 1 -- 172.21.15.77:0/2086654730 shutdown_connections 2023-11-26T07:21:17.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.102+0000 7f89caeee640 1 -- 172.21.15.77:0/2086654730 wait complete. 2023-11-26T07:21:17.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:21:17.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.332+0000 7f6258190640 1 Processor -- start 2023-11-26T07:21:17.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.333+0000 7f6258190640 1 -- start start 2023-11-26T07:21:17.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.334+0000 7f6258190640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62500cfb90 0x7f6250161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.334+0000 7f6258190640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f62500b2400 0x7f62500cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.334+0000 7f6258190640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62501612f0 con 0x7f6250161fa0 2023-11-26T07:21:17.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.334+0000 7f6258190640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62500cff70 con 0x7f62500b2400 2023-11-26T07:21:17.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.334+0000 7f6258190640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62500afb20 con 0x7f62500cfb90 2023-11-26T07:21:17.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f625572b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6250161fa0 0x7f625006ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41240/0 (socket says 172.21.15.77:41240) 2023-11-26T07:21:17.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f625572b640 1 -- 172.21.15.77:0/797886572 learned_addr learned my addr 172.21.15.77:0/797886572 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:17.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f6255f2c640 1 --2- 172.21.15.77:0/797886572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62500cfb90 0x7f6250161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504383705 0 0) 0x7f62501612f0 con 0x7f6250161fa0 2023-11-26T07:21:17.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f623c003520 con 0x7f6250161fa0 2023-11-26T07:21:17.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f625672d640 1 --2- 172.21.15.77:0/797886572 >> v2:172.21.15.159:3300/0 conn(0x7f62500b2400 0x7f62500cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 651005197 0 0) 0x7f623c003520 con 0x7f6250161fa0 2023-11-26T07:21:17.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62500cfb90 msgr2=0x7f6250161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:17.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f6254f2a640 1 --2- 172.21.15.77:0/797886572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62500cfb90 0x7f6250161a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 >> v2:172.21.15.159:3300/0 conn(0x7f62500b2400 msgr2=0x7f62500cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:17.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f6254f2a640 1 --2- 172.21.15.77:0/797886572 >> v2:172.21.15.159:3300/0 conn(0x7f62500b2400 0x7f62500cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625006a850 con 0x7f6250161fa0 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f6240001670 con 0x7f6250161fa0 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.335+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 >> v1:172.21.15.77:6789/0 conn(0x7f6250161fa0 legacy=0x7f625006ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6254f2a640 1 --2- 172.21.15.77:0/797886572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c0039a0 0x7f623c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6254f2a640 1 --2- 172.21.15.77:0/797886572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62500cfb90 0x7f623c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6254f2a640 1 --2- 172.21.15.77:0/797886572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f623c004d00 0x7f623c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62500cff70 con 0x7f623c0039a0 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62500afb20 con 0x7f623c004d00 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c00ba90 con 0x7f62500cfb90 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6255f2c640 1 --2- 172.21.15.77:0/797886572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c0039a0 0x7f623c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6255f2c640 1 -- 172.21.15.77:0/797886572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62500cfb90 msgr2=0x7f623c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6255f2c640 1 --2- 172.21.15.77:0/797886572 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62500cfb90 0x7f623c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6255f2c640 1 -- 172.21.15.77:0/797886572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f623c004d00 msgr2=0x7f623c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:17.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6255f2c640 1 --2- 172.21.15.77:0/797886572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f623c004d00 0x7f623c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.336+0000 7f6255f2c640 1 -- 172.21.15.77:0/797886572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c003520 con 0x7f623c0039a0 2023-11-26T07:21:17.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.337+0000 7f6255f2c640 1 --2- 172.21.15.77:0/797886572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c0039a0 0x7f623c003dc0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f624c009ac0 tx=0x7f623c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba296cb502c76a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:17.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.338+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c02c630 con 0x7f623c0039a0 2023-11-26T07:21:17.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.338+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c02c790 con 0x7f623c0039a0 2023-11-26T07:21:17.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.338+0000 7f6254f2a640 1 -- 172.21.15.77:0/797886572 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c02cb20 con 0x7f623c0039a0 2023-11-26T07:21:17.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.338+0000 7f6258190640 1 -- 172.21.15.77:0/797886572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c0039a0 msgr2=0x7f623c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.338+0000 7f6258190640 1 --2- 172.21.15.77:0/797886572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c0039a0 0x7f623c003dc0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f624c009ac0 tx=0x7f623c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.338+0000 7f625672d640 1 -- 172.21.15.77:0/797886572 reap_dead start 2023-11-26T07:21:17.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.338+0000 7f6258190640 1 -- 172.21.15.77:0/797886572 shutdown_connections 2023-11-26T07:21:17.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.338+0000 7f6258190640 1 -- 172.21.15.77:0/797886572 >> 172.21.15.77:0/797886572 conn(0x7f62500999d0 msgr2=0x7f62500b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:17.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.338+0000 7f6258190640 1 -- 172.21.15.77:0/797886572 shutdown_connections 2023-11-26T07:21:17.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.338+0000 7f6258190640 1 -- 172.21.15.77:0/797886572 wait complete. 2023-11-26T07:21:17.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.340+0000 7f6258190640 1 Processor -- start 2023-11-26T07:21:17.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.340+0000 7f6258190640 1 -- start start 2023-11-26T07:21:17.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.341+0000 7f6258190640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f623c0039a0 0x7f6250160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.341+0000 7f6258190640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6250151f60 0x7f62500c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.341+0000 7f6258190640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62501f3730 0x7f62500b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.341+0000 7f6258190640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625015e850 con 0x7f62501f3730 2023-11-26T07:21:17.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.341+0000 7f6258190640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625015f3d0 con 0x7f623c0039a0 2023-11-26T07:21:17.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.341+0000 7f6258190640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62500c81d0 con 0x7f6250151f60 2023-11-26T07:21:17.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.342+0000 7f625672d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62501f3730 0x7f62500b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.342+0000 7f625672d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62501f3730 0x7f62500b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42970/0 (socket says 172.21.15.77:42970) 2023-11-26T07:21:17.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.342+0000 7f625672d640 1 -- 172.21.15.77:0/3292358649 learned_addr learned my addr 172.21.15.77:0/3292358649 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.342+0000 7f625672d640 1 -- 172.21.15.77:0/3292358649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6250151f60 msgr2=0x7f62500c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.342+0000 7f625572b640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6250151f60 0x7f62500c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.342+0000 7f625672d640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6250151f60 0x7f62500c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.342+0000 7f625672d640 1 -- 172.21.15.77:0/3292358649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f623c0039a0 msgr2=0x7f6250160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.342+0000 7f625672d640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f623c0039a0 0x7f6250160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.342+0000 7f625672d640 1 -- 172.21.15.77:0/3292358649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625015eaa0 con 0x7f62501f3730 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.343+0000 7f625672d640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62501f3730 0x7f62500b16b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6250161250 tx=0x7f624800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.343+0000 7f62467fc640 1 -- 172.21.15.77:0/3292358649 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624800ed90 con 0x7f62501f3730 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.343+0000 7f62467fc640 1 -- 172.21.15.77:0/3292358649 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6248014420 con 0x7f62501f3730 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.343+0000 7f6258190640 1 -- 172.21.15.77:0/3292358649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625015ed80 con 0x7f62501f3730 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.343+0000 7f62467fc640 1 -- 172.21.15.77:0/3292358649 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62480147d0 con 0x7f62501f3730 2023-11-26T07:21:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.343+0000 7f6258190640 1 -- 172.21.15.77:0/3292358649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62501523e0 con 0x7f62501f3730 2023-11-26T07:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.344+0000 7f6258190640 1 -- 172.21.15.77:0/3292358649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625004e8b0 con 0x7f62501f3730 2023-11-26T07:21:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.345+0000 7f62467fc640 1 -- 172.21.15.77:0/3292358649 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f6248014930 con 0x7f62501f3730 2023-11-26T07:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.346+0000 7f62467fc640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f623406b410 0x7f623406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.346+0000 7f62467fc640 1 -- 172.21.15.77:0/3292358649 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f624808a510 con 0x7f62501f3730 2023-11-26T07:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.346+0000 7f6255f2c640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f623406b410 0x7f623406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.347+0000 7f6255f2c640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f623406b410 0x7f623406d8d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f624c036000 tx=0x7f624c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:17.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.351+0000 7f62467fc640 1 -- 172.21.15.77:0/3292358649 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6248054df0 con 0x7f62501f3730 2023-11-26T07:21:17.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.549+0000 7f6258190640 1 -- 172.21.15.77:0/3292358649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f625015f510 con 0x7f62501f3730 2023-11-26T07:21:17.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.550+0000 7f62467fc640 1 -- 172.21.15.77:0/3292358649 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6248058410 con 0x7f62501f3730 2023-11-26T07:21:17.551 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:21:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.552+0000 7f6258190640 1 -- 172.21.15.77:0/3292358649 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f623406b410 msgr2=0x7f623406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.552+0000 7f6258190640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f623406b410 0x7f623406d8d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f624c036000 tx=0x7f624c02e000 comp rx=0 tx=0).stop 2023-11-26T07:21:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.552+0000 7f6258190640 1 -- 172.21.15.77:0/3292358649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62501f3730 msgr2=0x7f62500b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.552+0000 7f6258190640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62501f3730 0x7f62500b16b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6250161250 tx=0x7f624800e4b0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.552+0000 7f6258190640 1 -- 172.21.15.77:0/3292358649 shutdown_connections 2023-11-26T07:21:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.553+0000 7f6258190640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f623406b410 0x7f623406d8d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.553+0000 7f6258190640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62501f3730 0x7f62500b16b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.553+0000 7f6258190640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6250151f60 0x7f62500c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.553+0000 7f6258190640 1 --2- 172.21.15.77:0/3292358649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f623c0039a0 0x7f6250160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.553+0000 7f6258190640 1 -- 172.21.15.77:0/3292358649 >> 172.21.15.77:0/3292358649 conn(0x7f62500999d0 msgr2=0x7f62500afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.553+0000 7f6258190640 1 -- 172.21.15.77:0/3292358649 shutdown_connections 2023-11-26T07:21:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:17.553+0000 7f6258190640 1 -- 172.21.15.77:0/3292358649 wait complete. 2023-11-26T07:21:17.572 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-26T07:21:17.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:17.573 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-26T07:21:17.685 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:21:17.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:17.686 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:21:17.746 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:21:17.746 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:17.790 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:21:17.790 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:17.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:18.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.070+0000 7f0c8910d640 1 Processor -- start 2023-11-26T07:21:18.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.070+0000 7f0c8910d640 1 -- start start 2023-11-26T07:21:18.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.072+0000 7f0c8910d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0c84143870 0x7f0c84146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.072+0000 7f0c8910d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c84161080 0x7f0c840b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.072+0000 7f0c8910d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c84161510 con 0x7f0c84146eb0 2023-11-26T07:21:18.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.072+0000 7f0c8910d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c84070460 con 0x7f0c84143870 2023-11-26T07:21:18.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.072+0000 7f0c8910d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c841617f0 con 0x7f0c84161080 2023-11-26T07:21:18.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.072+0000 7f0c83fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0c84143870 0x7f0c84146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.072+0000 7f0c83fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0c84143870 0x7f0c84146970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:47674/0 (socket says 172.21.15.77:47674) 2023-11-26T07:21:18.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.072+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c84161080 0x7f0c840b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.072+0000 7f0c8890c640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f0c84146eb0 0x7f0c8406c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:35696/0 (socket says 172.21.15.77:35696) 2023-11-26T07:21:18.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.072+0000 7f0c83fff640 1 -- 172.21.15.77:0/2949839450 learned_addr learned my addr 172.21.15.77:0/2949839450 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:18.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.073+0000 7f0c83fff640 1 -- 172.21.15.77:0/2949839450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c84161080 msgr2=0x7f0c840b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:18.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.073+0000 7f0c83fff640 1 --2- 172.21.15.77:0/2949839450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c84161080 0x7f0c840b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.073+0000 7f0c83fff640 1 -- 172.21.15.77:0/2949839450 >> v1:172.21.15.159:6789/0 conn(0x7f0c84146eb0 legacy=0x7f0c8406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.073+0000 7f0c83fff640 1 -- 172.21.15.77:0/2949839450 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c84161ad0 con 0x7f0c84143870 2023-11-26T07:21:18.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.074+0000 7f0c83fff640 1 --2- 172.21.15.77:0/2949839450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c84143870 0x7f0c84146970 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009870 tx=0x7f0c7402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeb7275a3a172e6b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.075+0000 7f0c837fe640 1 -- 172.21.15.77:0/2949839450 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74030840 con 0x7f0c84143870 2023-11-26T07:21:18.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.075+0000 7f0c837fe640 1 -- 172.21.15.77:0/2949839450 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c740309a0 con 0x7f0c84143870 2023-11-26T07:21:18.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.075+0000 7f0c837fe640 1 -- 172.21.15.77:0/2949839450 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74030d30 con 0x7f0c84143870 2023-11-26T07:21:18.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.076+0000 7f0c8910d640 1 -- 172.21.15.77:0/2949839450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c84143870 msgr2=0x7f0c84146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.076+0000 7f0c8910d640 1 --2- 172.21.15.77:0/2949839450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c84143870 0x7f0c84146970 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009870 tx=0x7f0c7402b980 comp rx=0 tx=0).stop 2023-11-26T07:21:18.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.076+0000 7f0c8910d640 1 -- 172.21.15.77:0/2949839450 shutdown_connections 2023-11-26T07:21:18.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.076+0000 7f0c8910d640 1 --2- 172.21.15.77:0/2949839450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c84161080 0x7f0c840b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.076+0000 7f0c8910d640 1 --2- 172.21.15.77:0/2949839450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c84143870 0x7f0c84146970 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.076+0000 7f0c8910d640 1 -- 172.21.15.77:0/2949839450 >> 172.21.15.77:0/2949839450 conn(0x7f0c840cb830 msgr2=0x7f0c840cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:18.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.076+0000 7f0c8910d640 1 -- 172.21.15.77:0/2949839450 shutdown_connections 2023-11-26T07:21:18.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.076+0000 7f0c8910d640 1 -- 172.21.15.77:0/2949839450 wait complete. 2023-11-26T07:21:18.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.078+0000 7f0c8910d640 1 Processor -- start 2023-11-26T07:21:18.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.078+0000 7f0c8910d640 1 -- start start 2023-11-26T07:21:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.079+0000 7f0c8910d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c84143870 0x7f0c8415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.079+0000 7f0c8910d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c84146eb0 0x7f0c8415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.079+0000 7f0c8910d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c840b49b0 0x7f0c84143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.079+0000 7f0c8910d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8415d4a0 con 0x7f0c840b49b0 2023-11-26T07:21:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.079+0000 7f0c8910d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8415e120 con 0x7f0c84143870 2023-11-26T07:21:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.079+0000 7f0c8910d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8415e400 con 0x7f0c84146eb0 2023-11-26T07:21:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c8890c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c840b49b0 0x7f0c84143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c8890c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c840b49b0 0x7f0c84143dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42984/0 (socket says 172.21.15.77:42984) 2023-11-26T07:21:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c8890c640 1 -- 172.21.15.77:0/4238286062 learned_addr learned my addr 172.21.15.77:0/4238286062 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c84146eb0 0x7f0c8415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c83fff640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c84143870 0x7f0c8415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c8890c640 1 -- 172.21.15.77:0/4238286062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c84146eb0 msgr2=0x7f0c8415cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c8890c640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c84146eb0 0x7f0c8415cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c8890c640 1 -- 172.21.15.77:0/4238286062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c84143870 msgr2=0x7f0c8415db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c8890c640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c84143870 0x7f0c8415db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c8890c640 1 -- 172.21.15.77:0/4238286062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c740094d0 con 0x7f0c840b49b0 2023-11-26T07:21:18.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c7bfff640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c84146eb0 0x7f0c8415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:18.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.080+0000 7f0c83fff640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c84143870 0x7f0c8415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:18.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.081+0000 7f0c8890c640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c840b49b0 0x7f0c84143dd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c730 tx=0x7f0c7c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.081+0000 7f0c817fa640 1 -- 172.21.15.77:0/4238286062 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00ce40 con 0x7f0c840b49b0 2023-11-26T07:21:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.081+0000 7f0c817fa640 1 -- 172.21.15.77:0/4238286062 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c00a640 con 0x7f0c840b49b0 2023-11-26T07:21:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.081+0000 7f0c8910d640 1 -- 172.21.15.77:0/4238286062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8415e6e0 con 0x7f0c840b49b0 2023-11-26T07:21:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.081+0000 7f0c817fa640 1 -- 172.21.15.77:0/4238286062 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00a9b0 con 0x7f0c840b49b0 2023-11-26T07:21:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.081+0000 7f0c8910d640 1 -- 172.21.15.77:0/4238286062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8415eca0 con 0x7f0c840b49b0 2023-11-26T07:21:18.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.082+0000 7f0c8910d640 1 -- 172.21.15.77:0/4238286062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8415eec0 con 0x7f0c840b49b0 2023-11-26T07:21:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.083+0000 7f0c817fa640 1 -- 172.21.15.77:0/4238286062 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f0c7c00ab10 con 0x7f0c840b49b0 2023-11-26T07:21:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.084+0000 7f0c817fa640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c6406b410 0x7f0c6406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.084+0000 7f0c817fa640 1 -- 172.21.15.77:0/4238286062 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0c7c089690 con 0x7f0c840b49b0 2023-11-26T07:21:18.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.084+0000 7f0c83fff640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c6406b410 0x7f0c6406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.085+0000 7f0c83fff640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c6406b410 0x7f0c6406d8d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0c74036000 tx=0x7f0c7403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.088+0000 7f0c817fa640 1 -- 172.21.15.77:0/4238286062 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c7c054020 con 0x7f0c840b49b0 2023-11-26T07:21:18.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.280+0000 7f0c8910d640 1 -- 172.21.15.77:0/4238286062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c840ad840 con 0x7f0c840b49b0 2023-11-26T07:21:18.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.283+0000 7f0c817fa640 1 -- 172.21.15.77:0/4238286062 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16706 (secure 0 0 0) 0x7f0c7c017020 con 0x7f0c840b49b0 2023-11-26T07:21:18.284 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:18.285 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":50,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:21:17.774167+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:14.223705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:15.435670+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.285+0000 7f0c8910d640 1 -- 172.21.15.77:0/4238286062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c6406b410 msgr2=0x7f0c6406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.285+0000 7f0c8910d640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c6406b410 0x7f0c6406d8d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0c74036000 tx=0x7f0c7403b040 comp rx=0 tx=0).stop 2023-11-26T07:21:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.285+0000 7f0c8910d640 1 -- 172.21.15.77:0/4238286062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c840b49b0 msgr2=0x7f0c84143dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.285+0000 7f0c8910d640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c840b49b0 0x7f0c84143dd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c730 tx=0x7f0c7c00cbf0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.285+0000 7f0c8910d640 1 -- 172.21.15.77:0/4238286062 shutdown_connections 2023-11-26T07:21:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.286+0000 7f0c8910d640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0c6406b410 0x7f0c6406d8d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.286+0000 7f0c8910d640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c840b49b0 0x7f0c84143dd0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.286+0000 7f0c8910d640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c84146eb0 0x7f0c8415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.286+0000 7f0c8910d640 1 --2- 172.21.15.77:0/4238286062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c84143870 0x7f0c8415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.286+0000 7f0c8910d640 1 -- 172.21.15.77:0/4238286062 >> 172.21.15.77:0/4238286062 conn(0x7f0c840cb830 msgr2=0x7f0c84144f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:18.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.286+0000 7f0c8910d640 1 -- 172.21.15.77:0/4238286062 shutdown_connections 2023-11-26T07:21:18.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.286+0000 7f0c8910d640 1 -- 172.21.15.77:0/4238286062 wait complete. 2023-11-26T07:21:18.307 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:20:14.223705+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:20:15.435670+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:21:18.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:21:18.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.516+0000 7f4d32d06640 1 Processor -- start 2023-11-26T07:21:18.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.516+0000 7f4d32d06640 1 -- start start 2023-11-26T07:21:18.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.517+0000 7f4d32d06640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2c0b0b40 0x7f4d2c0b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.517+0000 7f4d32d06640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4d2c06c5b0 0x7f4d2c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.517+0000 7f4d32d06640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c15ed20 con 0x7f4d2c15b260 2023-11-26T07:21:18.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.517+0000 7f4d32d06640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c15b640 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.517+0000 7f4d32d06640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c15f8a0 con 0x7f4d2c0b0b40 2023-11-26T07:21:18.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.518+0000 7f4d31503640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2c0b0b40 0x7f4d2c0b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.518+0000 7f4d32505640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4d2c06c5b0 0x7f4d2c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.518+0000 7f4d31d04640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f4d2c15b260 0x7f4d2c06e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:35710/0 (socket says 172.21.15.77:35710) 2023-11-26T07:21:18.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.518+0000 7f4d31503640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2c0b0b40 0x7f4d2c0b0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:52630/0 (socket says 172.21.15.77:52630) 2023-11-26T07:21:18.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.518+0000 7f4d31d04640 1 -- 172.21.15.77:0/2270613035 learned_addr learned my addr 172.21.15.77:0/2270613035 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:18.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.519+0000 7f4d32505640 1 -- 172.21.15.77:0/2270613035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2c0b0b40 msgr2=0x7f4d2c0b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:18.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.519+0000 7f4d32505640 1 --2- 172.21.15.77:0/2270613035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2c0b0b40 0x7f4d2c0b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.519+0000 7f4d32505640 1 -- 172.21.15.77:0/2270613035 >> v1:172.21.15.159:6789/0 conn(0x7f4d2c15b260 legacy=0x7f4d2c06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.519+0000 7f4d32505640 1 -- 172.21.15.77:0/2270613035 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0b14c0 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.520+0000 7f4d32505640 1 --2- 172.21.15.77:0/2270613035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d2c06c5b0 0x7f4d2c06ca40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d240097a0 tx=0x7f4d2402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b426fa00053d3ec server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.521+0000 7f4d30d02640 1 -- 172.21.15.77:0/2270613035 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2402f050 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.521+0000 7f4d30d02640 1 -- 172.21.15.77:0/2270613035 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d24031700 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.521+0000 7f4d30d02640 1 -- 172.21.15.77:0/2270613035 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24031a90 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.521+0000 7f4d32d06640 1 -- 172.21.15.77:0/2270613035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d2c06c5b0 msgr2=0x7f4d2c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.521+0000 7f4d32d06640 1 --2- 172.21.15.77:0/2270613035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d2c06c5b0 0x7f4d2c06ca40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d240097a0 tx=0x7f4d2402b7a0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.521+0000 7f4d32d06640 1 -- 172.21.15.77:0/2270613035 shutdown_connections 2023-11-26T07:21:18.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.521+0000 7f4d32d06640 1 --2- 172.21.15.77:0/2270613035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2c0b0b40 0x7f4d2c0b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.521+0000 7f4d32d06640 1 --2- 172.21.15.77:0/2270613035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d2c06c5b0 0x7f4d2c06ca40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.521+0000 7f4d32d06640 1 -- 172.21.15.77:0/2270613035 >> 172.21.15.77:0/2270613035 conn(0x7f4d2c0cbb40 msgr2=0x7f4d2c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:18.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.522+0000 7f4d32d06640 1 -- 172.21.15.77:0/2270613035 shutdown_connections 2023-11-26T07:21:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.522+0000 7f4d32d06640 1 -- 172.21.15.77:0/2270613035 wait complete. 2023-11-26T07:21:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.523+0000 7f4d32d06640 1 Processor -- start 2023-11-26T07:21:18.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.523+0000 7f4d32d06640 1 -- start start 2023-11-26T07:21:18.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.524+0000 7f4d32d06640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c06c5b0 0x7f4d2c1f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.524+0000 7f4d32d06640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d2c0b0b40 0x7f4d2c15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.524+0000 7f4d32d06640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2c15b260 0x7f4d2c15cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.524+0000 7f4d32d06640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c147040 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.524+0000 7f4d32d06640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c09a290 con 0x7f4d2c0b0b40 2023-11-26T07:21:18.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.524+0000 7f4d32d06640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c09c9b0 con 0x7f4d2c15b260 2023-11-26T07:21:18.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.524+0000 7f4d31d04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c06c5b0 0x7f4d2c1f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d31d04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c06c5b0 0x7f4d2c1f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42986/0 (socket says 172.21.15.77:42986) 2023-11-26T07:21:18.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d31d04640 1 -- 172.21.15.77:0/1293171718 learned_addr learned my addr 172.21.15.77:0/1293171718 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:18.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d31d04640 1 -- 172.21.15.77:0/1293171718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2c15b260 msgr2=0x7f4d2c15cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d31d04640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2c15b260 0x7f4d2c15cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d31d04640 1 -- 172.21.15.77:0/1293171718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d2c0b0b40 msgr2=0x7f4d2c15c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d31d04640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d2c0b0b40 0x7f4d2c15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d31d04640 1 -- 172.21.15.77:0/1293171718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d24009400 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d31d04640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c06c5b0 0x7f4d2c1f2960 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00cbc0 tx=0x7f4d1c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d2a7fc640 1 -- 172.21.15.77:0/1293171718 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00aca0 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d2a7fc640 1 -- 172.21.15.77:0/1293171718 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c00ae00 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d2a7fc640 1 -- 172.21.15.77:0/1293171718 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c012600 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.525+0000 7f4d32d06640 1 -- 172.21.15.77:0/1293171718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c09cc90 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.526+0000 7f4d32d06640 1 -- 172.21.15.77:0/1293171718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c15a640 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.527+0000 7f4d32d06640 1 -- 172.21.15.77:0/1293171718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c09c7e0 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.528+0000 7f4d2a7fc640 1 -- 172.21.15.77:0/1293171718 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f4d1c007070 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.529+0000 7f4d2a7fc640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d1806b3e0 0x7f4d1806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.529+0000 7f4d2a7fc640 1 -- 172.21.15.77:0/1293171718 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4d1c08a000 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.529+0000 7f4d31503640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d1806b3e0 0x7f4d1806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.530+0000 7f4d31503640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d1806b3e0 0x7f4d1806d8a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4d20006a90 tx=0x7f4d20006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.533+0000 7f4d2a7fc640 1 -- 172.21.15.77:0/1293171718 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4d1c054800 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.726+0000 7f4d32d06640 1 -- 172.21.15.77:0/1293171718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d2c09a570 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.727+0000 7f4d2a7fc640 1 -- 172.21.15.77:0/1293171718 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d1c017070 con 0x7f4d2c06c5b0 2023-11-26T07:21:18.728 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:21:18.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 -- 172.21.15.77:0/1293171718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d1806b3e0 msgr2=0x7f4d1806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d1806b3e0 0x7f4d1806d8a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4d20006a90 tx=0x7f4d20006a20 comp rx=0 tx=0).stop 2023-11-26T07:21:18.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 -- 172.21.15.77:0/1293171718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c06c5b0 msgr2=0x7f4d2c1f2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c06c5b0 0x7f4d2c1f2960 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00cbc0 tx=0x7f4d1c00a060 comp rx=0 tx=0).stop 2023-11-26T07:21:18.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 -- 172.21.15.77:0/1293171718 shutdown_connections 2023-11-26T07:21:18.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4d1806b3e0 0x7f4d1806d8a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d2c15b260 0x7f4d2c15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d2c0b0b40 0x7f4d2c15c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 --2- 172.21.15.77:0/1293171718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c06c5b0 0x7f4d2c1f2960 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 -- 172.21.15.77:0/1293171718 >> 172.21.15.77:0/1293171718 conn(0x7f4d2c0cbb40 msgr2=0x7f4d2c0ac070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:18.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 -- 172.21.15.77:0/1293171718 shutdown_connections 2023-11-26T07:21:18.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.729+0000 7f4d32d06640 1 -- 172.21.15.77:0/1293171718 wait complete. 2023-11-26T07:21:18.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:21:18.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.942+0000 7f5e0803d640 1 Processor -- start 2023-11-26T07:21:18.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.943+0000 7f5e0803d640 1 -- start start 2023-11-26T07:21:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.944+0000 7f5e0803d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5e0015d720 0x7f5e000d3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.944+0000 7f5e0803d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5e000d3870 0x7f5e000b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.944+0000 7f5e0803d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0015db00 con 0x7f5e000b1400 2023-11-26T07:21:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.944+0000 7f5e0803d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e000d3d20 con 0x7f5e000d3870 2023-11-26T07:21:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.944+0000 7f5e0803d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e000d0ce0 con 0x7f5e0015d720 2023-11-26T07:21:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.945+0000 7f5e055d8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5e000d3870 0x7f5e000b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.945+0000 7f5e065da640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5e000b1400 0x7f5e000b1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41244/0 (socket says 172.21.15.77:41244) 2023-11-26T07:21:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.945+0000 7f5e065da640 1 -- 172.21.15.77:0/3265762797 learned_addr learned my addr 172.21.15.77:0/3265762797 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:18.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.945+0000 7f5e05dd9640 1 --2- 172.21.15.77:0/3265762797 >> v2:172.21.15.159:3300/0 conn(0x7f5e0015d720 0x7f5e000d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.945+0000 7f5e055d8640 1 -- 172.21.15.77:0/3265762797 >> v2:172.21.15.159:3300/0 conn(0x7f5e0015d720 msgr2=0x7f5e000d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:18.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.945+0000 7f5e055d8640 1 --2- 172.21.15.77:0/3265762797 >> v2:172.21.15.159:3300/0 conn(0x7f5e0015d720 0x7f5e000d3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.945+0000 7f5e055d8640 1 -- 172.21.15.77:0/3265762797 >> v1:172.21.15.77:6789/0 conn(0x7f5e000b1400 legacy=0x7f5e000b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.945+0000 7f5e055d8640 1 -- 172.21.15.77:0/3265762797 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0006d400 con 0x7f5e000d3870 2023-11-26T07:21:18.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.945+0000 7f5e05dd9640 1 --2- 172.21.15.77:0/3265762797 >> v2:172.21.15.159:3300/0 conn(0x7f5e0015d720 0x7f5e000d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:18.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.946+0000 7f5e055d8640 1 --2- 172.21.15.77:0/3265762797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e000d3870 0x7f5e000b0ec0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5e0008b890 tx=0x7f5df002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0676f91ec381c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.946+0000 7f5e04dd7640 1 -- 172.21.15.77:0/3265762797 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df002e070 con 0x7f5e000d3870 2023-11-26T07:21:18.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.947+0000 7f5e04dd7640 1 -- 172.21.15.77:0/3265762797 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df00315a0 con 0x7f5e000d3870 2023-11-26T07:21:18.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.947+0000 7f5e04dd7640 1 -- 172.21.15.77:0/3265762797 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0031930 con 0x7f5e000d3870 2023-11-26T07:21:18.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.947+0000 7f5e0803d640 1 -- 172.21.15.77:0/3265762797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e000d3870 msgr2=0x7f5e000b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.947+0000 7f5e0803d640 1 --2- 172.21.15.77:0/3265762797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e000d3870 0x7f5e000b0ec0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5e0008b890 tx=0x7f5df002b840 comp rx=0 tx=0).stop 2023-11-26T07:21:18.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.947+0000 7f5e0803d640 1 -- 172.21.15.77:0/3265762797 shutdown_connections 2023-11-26T07:21:18.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.947+0000 7f5e0803d640 1 --2- 172.21.15.77:0/3265762797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e000d3870 0x7f5e000b0ec0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.947+0000 7f5e0803d640 1 --2- 172.21.15.77:0/3265762797 >> v2:172.21.15.159:3300/0 conn(0x7f5e0015d720 0x7f5e000d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.947+0000 7f5e0803d640 1 -- 172.21.15.77:0/3265762797 >> 172.21.15.77:0/3265762797 conn(0x7f5e0008af60 msgr2=0x7f5e0009c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:18.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.947+0000 7f5e0803d640 1 -- 172.21.15.77:0/3265762797 shutdown_connections 2023-11-26T07:21:18.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.947+0000 7f5e0803d640 1 -- 172.21.15.77:0/3265762797 wait complete. 2023-11-26T07:21:18.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.949+0000 7f5e0803d640 1 Processor -- start 2023-11-26T07:21:18.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.949+0000 7f5e0803d640 1 -- start start 2023-11-26T07:21:18.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.950+0000 7f5e0803d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e000b1400 0x7f5e0014a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.950+0000 7f5e0803d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e000d3870 0x7f5e0014aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.950+0000 7f5e0803d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e0015d720 0x7f5e0015fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.950+0000 7f5e0803d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e000cd410 con 0x7f5e000d3870 2023-11-26T07:21:18.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.950+0000 7f5e0803d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0015f890 con 0x7f5e0015d720 2023-11-26T07:21:18.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.950+0000 7f5e0803d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e000c7000 con 0x7f5e000b1400 2023-11-26T07:21:18.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.950+0000 7f5e055d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e000d3870 0x7f5e0014aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.950+0000 7f5e055d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e000d3870 0x7f5e0014aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43002/0 (socket says 172.21.15.77:43002) 2023-11-26T07:21:18.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.950+0000 7f5e055d8640 1 -- 172.21.15.77:0/275048314 learned_addr learned my addr 172.21.15.77:0/275048314 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:18.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.951+0000 7f5e05dd9640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e000b1400 0x7f5e0014a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.951+0000 7f5e055d8640 1 -- 172.21.15.77:0/275048314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e000b1400 msgr2=0x7f5e0014a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.951+0000 7f5e065da640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e0015d720 0x7f5e0015fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.951+0000 7f5e055d8640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e000b1400 0x7f5e0014a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.951+0000 7f5e055d8640 1 -- 172.21.15.77:0/275048314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e0015d720 msgr2=0x7f5e0015fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.951+0000 7f5e055d8640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e0015d720 0x7f5e0015fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.951+0000 7f5e055d8640 1 -- 172.21.15.77:0/275048314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0009400 con 0x7f5e000d3870 2023-11-26T07:21:18.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.951+0000 7f5e065da640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e0015d720 0x7f5e0015fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:18.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.951+0000 7f5e05dd9640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e000b1400 0x7f5e0014a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:18.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.951+0000 7f5e055d8640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e000d3870 0x7f5e0014aa60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000c00 tx=0x7f5df00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.951+0000 7f5df67fc640 1 -- 172.21.15.77:0/275048314 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0032900 con 0x7f5e000d3870 2023-11-26T07:21:18.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.952+0000 7f5df67fc640 1 -- 172.21.15.77:0/275048314 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0032a60 con 0x7f5e000d3870 2023-11-26T07:21:18.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.952+0000 7f5df67fc640 1 -- 172.21.15.77:0/275048314 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0032dd0 con 0x7f5e000d3870 2023-11-26T07:21:18.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.952+0000 7f5e0803d640 1 -- 172.21.15.77:0/275048314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e000cd130 con 0x7f5e000d3870 2023-11-26T07:21:18.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.952+0000 7f5e0803d640 1 -- 172.21.15.77:0/275048314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e000c6c20 con 0x7f5e000d3870 2023-11-26T07:21:18.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.953+0000 7f5e0803d640 1 -- 172.21.15.77:0/275048314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e000b06a0 con 0x7f5e000d3870 2023-11-26T07:21:18.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.954+0000 7f5df67fc640 1 -- 172.21.15.77:0/275048314 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f5df00453f0 con 0x7f5e000d3870 2023-11-26T07:21:18.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.954+0000 7f5df67fc640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5de406b3e0 0x7f5de406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.955+0000 7f5df67fc640 1 -- 172.21.15.77:0/275048314 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5df00ac6e0 con 0x7f5e000d3870 2023-11-26T07:21:18.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.955+0000 7f5e05dd9640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5de406b3e0 0x7f5de406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.955+0000 7f5e05dd9640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5de406b3e0 0x7f5de406d8a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc006fd0 tx=0x7f5dfc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:18.959+0000 7f5df67fc640 1 -- 172.21.15.77:0/275048314 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e000b06a0 con 0x7f5e000d3870 2023-11-26T07:21:19.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.149+0000 7f5e0803d640 1 -- 172.21.15.77:0/275048314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e000b06a0 con 0x7f5e000d3870 2023-11-26T07:21:19.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.149+0000 7f5df67fc640 1 -- 172.21.15.77:0/275048314 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e000b06a0 con 0x7f5e000d3870 2023-11-26T07:21:19.151 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:21:19.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 -- 172.21.15.77:0/275048314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5de406b3e0 msgr2=0x7f5de406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5de406b3e0 0x7f5de406d8a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc006fd0 tx=0x7f5dfc008040 comp rx=0 tx=0).stop 2023-11-26T07:21:19.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 -- 172.21.15.77:0/275048314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e000d3870 msgr2=0x7f5e0014aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e000d3870 0x7f5e0014aa60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000c00 tx=0x7f5df00046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 -- 172.21.15.77:0/275048314 shutdown_connections 2023-11-26T07:21:19.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5de406b3e0 0x7f5de406d8a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e0015d720 0x7f5e0015fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e000d3870 0x7f5e0014aa60 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 --2- 172.21.15.77:0/275048314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e000b1400 0x7f5e0014a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 -- 172.21.15.77:0/275048314 >> 172.21.15.77:0/275048314 conn(0x7f5e0008af60 msgr2=0x7f5e000b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:19.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 -- 172.21.15.77:0/275048314 shutdown_connections 2023-11-26T07:21:19.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.152+0000 7f5e0803d640 1 -- 172.21.15.77:0/275048314 wait complete. 2023-11-26T07:21:19.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:21:19.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.382+0000 7f1d01d43640 1 Processor -- start 2023-11-26T07:21:19.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.382+0000 7f1d01d43640 1 -- start start 2023-11-26T07:21:19.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.384+0000 7f1d01d43640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1cfc1608f0 0x7f1cfc0d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.384+0000 7f1d01d43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cfc0d3890 0x7f1cfc0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.384+0000 7f1d01d43640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cfc160cd0 con 0x7f1cfc0ce260 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.384+0000 7f1d01d43640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cfc0b8f60 con 0x7f1cfc1608f0 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.384+0000 7f1d01d43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc0cdcb0 con 0x7f1cfc0d3890 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.384+0000 7f1d00d41640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1cfc1608f0 0x7f1cfc0d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.384+0000 7f1cfbfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1cfc0ce260 0x7f1cfc0d3180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41250/0 (socket says 172.21.15.77:41250) 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.384+0000 7f1cfbfff640 1 -- 172.21.15.77:0/3702317364 learned_addr learned my addr 172.21.15.77:0/3702317364 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.385+0000 7f1cfb7fe640 1 -- 172.21.15.77:0/3702317364 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043235820 0 0) 0x7f1cfc160cd0 con 0x7f1cfc0ce260 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.385+0000 7f1d01542640 1 --2- 172.21.15.77:0/3702317364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cfc0d3890 0x7f1cfc0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.385+0000 7f1cfb7fe640 1 -- 172.21.15.77:0/3702317364 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cec003520 con 0x7f1cfc0ce260 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.385+0000 7f1d00d41640 1 -- 172.21.15.77:0/3702317364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cfc0d3890 msgr2=0x7f1cfc0b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.385+0000 7f1d00d41640 1 --2- 172.21.15.77:0/3702317364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cfc0d3890 0x7f1cfc0b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.385+0000 7f1d00d41640 1 -- 172.21.15.77:0/3702317364 >> v1:172.21.15.77:6789/0 conn(0x7f1cfc0ce260 legacy=0x7f1cfc0d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.385+0000 7f1d00d41640 1 -- 172.21.15.77:0/3702317364 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc0cdf90 con 0x7f1cfc1608f0 2023-11-26T07:21:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.386+0000 7f1d00d41640 1 --2- 172.21.15.77:0/3702317364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cfc1608f0 0x7f1cfc0d1ac0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00097a0 tx=0x7f1cf002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e095b2fa85dfa46a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.386+0000 7f1cfb7fe640 1 -- 172.21.15.77:0/3702317364 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf002d040 con 0x7f1cfc1608f0 2023-11-26T07:21:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.386+0000 7f1cfb7fe640 1 -- 172.21.15.77:0/3702317364 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf0031810 con 0x7f1cfc1608f0 2023-11-26T07:21:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.386+0000 7f1cfb7fe640 1 -- 172.21.15.77:0/3702317364 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0031ba0 con 0x7f1cfc1608f0 2023-11-26T07:21:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.387+0000 7f1d01d43640 1 -- 172.21.15.77:0/3702317364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cfc1608f0 msgr2=0x7f1cfc0d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.387+0000 7f1d01d43640 1 --2- 172.21.15.77:0/3702317364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cfc1608f0 0x7f1cfc0d1ac0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00097a0 tx=0x7f1cf002b8b0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.387+0000 7f1d01d43640 1 -- 172.21.15.77:0/3702317364 shutdown_connections 2023-11-26T07:21:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.387+0000 7f1d01d43640 1 --2- 172.21.15.77:0/3702317364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cfc0d3890 0x7f1cfc0b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.387+0000 7f1d01d43640 1 --2- 172.21.15.77:0/3702317364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cfc1608f0 0x7f1cfc0d1ac0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.387+0000 7f1d01d43640 1 -- 172.21.15.77:0/3702317364 >> 172.21.15.77:0/3702317364 conn(0x7f1cfc061340 msgr2=0x7f1cfc061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:19.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.387+0000 7f1d01d43640 1 -- 172.21.15.77:0/3702317364 shutdown_connections 2023-11-26T07:21:19.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.387+0000 7f1d01d43640 1 -- 172.21.15.77:0/3702317364 wait complete. 2023-11-26T07:21:19.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.389+0000 7f1d01d43640 1 Processor -- start 2023-11-26T07:21:19.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.389+0000 7f1d01d43640 1 -- start start 2023-11-26T07:21:19.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.390+0000 7f1d01d43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cfc0ce260 0x7f1cfc154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.390+0000 7f1d01d43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cfc0d3890 0x7f1cfc1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.390+0000 7f1d01d43640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc1608f0 0x7f1cfc1f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.390+0000 7f1d01d43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc148fd0 con 0x7f1cfc0ce260 2023-11-26T07:21:19.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.390+0000 7f1d01d43640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc0cb980 con 0x7f1cfc1608f0 2023-11-26T07:21:19.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.390+0000 7f1d01d43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc0cbc60 con 0x7f1cfc0d3890 2023-11-26T07:21:19.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.391+0000 7f1d00d41640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cfc0ce260 0x7f1cfc154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.391+0000 7f1d00d41640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cfc0ce260 0x7f1cfc154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43020/0 (socket says 172.21.15.77:43020) 2023-11-26T07:21:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.391+0000 7f1d00d41640 1 -- 172.21.15.77:0/670044689 learned_addr learned my addr 172.21.15.77:0/670044689 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.391+0000 7f1cfbfff640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cfc0d3890 0x7f1cfc1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.391+0000 7f1d01542640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc1608f0 0x7f1cfc1f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.391+0000 7f1d00d41640 1 -- 172.21.15.77:0/670044689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cfc0d3890 msgr2=0x7f1cfc1528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.391+0000 7f1d00d41640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cfc0d3890 0x7f1cfc1528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.391+0000 7f1d00d41640 1 -- 172.21.15.77:0/670044689 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc1608f0 msgr2=0x7f1cfc1f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.391+0000 7f1d00d41640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc1608f0 0x7f1cfc1f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.391+0000 7f1d00d41640 1 -- 172.21.15.77:0/670044689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf0009400 con 0x7f1cfc0ce260 2023-11-26T07:21:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.391+0000 7f1d01542640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc1608f0 0x7f1cfc1f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.392+0000 7f1d00d41640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cfc0ce260 0x7f1cfc154860 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00098c0 tx=0x7f1cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.392+0000 7f1cf97fa640 1 -- 172.21.15.77:0/670044689 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0006e10 con 0x7f1cfc0ce260 2023-11-26T07:21:19.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.392+0000 7f1cf97fa640 1 -- 172.21.15.77:0/670044689 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf003ad60 con 0x7f1cfc0ce260 2023-11-26T07:21:19.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.392+0000 7f1cf97fa640 1 -- 172.21.15.77:0/670044689 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0044620 con 0x7f1cfc0ce260 2023-11-26T07:21:19.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.392+0000 7f1d01d43640 1 -- 172.21.15.77:0/670044689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cfc0cbf40 con 0x7f1cfc0ce260 2023-11-26T07:21:19.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.392+0000 7f1d01d43640 1 -- 172.21.15.77:0/670044689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cfc0cc500 con 0x7f1cfc0ce260 2023-11-26T07:21:19.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.393+0000 7f1d01d43640 1 -- 172.21.15.77:0/670044689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cfc04e840 con 0x7f1cfc0ce260 2023-11-26T07:21:19.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.394+0000 7f1cf97fa640 1 -- 172.21.15.77:0/670044689 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f1cf004d440 con 0x7f1cfc0ce260 2023-11-26T07:21:19.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.395+0000 7f1cf97fa640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1ce006b3e0 0x7f1ce006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.395+0000 7f1cf97fa640 1 -- 172.21.15.77:0/670044689 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1cf00ac470 con 0x7f1cfc0ce260 2023-11-26T07:21:19.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.395+0000 7f1cfbfff640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1ce006b3e0 0x7f1ce006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.396+0000 7f1cfbfff640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1ce006b3e0 0x7f1ce006d8a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc15ed50 tx=0x7f1ce8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.399+0000 7f1cf97fa640 1 -- 172.21.15.77:0/670044689 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1cf0076b40 con 0x7f1cfc0ce260 2023-11-26T07:21:19.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.575+0000 7f1d01d43640 1 -- 172.21.15.77:0/670044689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1cfc15ff90 con 0x7f1cfc0ce260 2023-11-26T07:21:19.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.577+0000 7f1cf97fa640 1 -- 172.21.15.77:0/670044689 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1cf007a160 con 0x7f1cfc0ce260 2023-11-26T07:21:19.578 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:21:19.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 -- 172.21.15.77:0/670044689 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1ce006b3e0 msgr2=0x7f1ce006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1ce006b3e0 0x7f1ce006d8a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc15ed50 tx=0x7f1ce8009040 comp rx=0 tx=0).stop 2023-11-26T07:21:19.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 -- 172.21.15.77:0/670044689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cfc0ce260 msgr2=0x7f1cfc154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cfc0ce260 0x7f1cfc154860 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00098c0 tx=0x7f1cf00046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 -- 172.21.15.77:0/670044689 shutdown_connections 2023-11-26T07:21:19.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1ce006b3e0 0x7f1ce006d8a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc1608f0 0x7f1cfc1f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cfc0d3890 0x7f1cfc1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 --2- 172.21.15.77:0/670044689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cfc0ce260 0x7f1cfc154860 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 -- 172.21.15.77:0/670044689 >> 172.21.15.77:0/670044689 conn(0x7f1cfc061340 msgr2=0x7f1cfc15f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:19.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 -- 172.21.15.77:0/670044689 shutdown_connections 2023-11-26T07:21:19.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.579+0000 7f1d01d43640 1 -- 172.21.15.77:0/670044689 wait complete. 2023-11-26T07:21:19.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:21:19.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.810+0000 7f8b6ed67640 1 Processor -- start 2023-11-26T07:21:19.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.810+0000 7f8b6ed67640 1 -- start start 2023-11-26T07:21:19.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.811+0000 7f8b6ed67640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b6815a1c0 0x7f8b68070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.811+0000 7f8b6ed67640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b6806d640 0x7f8b6806da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.811+0000 7f8b6ed67640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6806dfd0 con 0x7f8b680b15e0 2023-11-26T07:21:19.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.811+0000 7f8b6ed67640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b680cd920 con 0x7f8b6815a1c0 2023-11-26T07:21:19.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.812+0000 7f8b6ed67640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680b1a50 con 0x7f8b6806d640 2023-11-26T07:21:19.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.812+0000 7f8b6dd65640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b6815a1c0 0x7f8b68070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.812+0000 7f8b6dd65640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b6815a1c0 0x7f8b68070ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43028/0 (socket says 172.21.15.77:43028) 2023-11-26T07:21:19.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.812+0000 7f8b6dd65640 1 -- 172.21.15.77:0/1052409208 learned_addr learned my addr 172.21.15.77:0/1052409208 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:19.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.812+0000 7f8b6dd65640 1 -- 172.21.15.77:0/1052409208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b6806d640 msgr2=0x7f8b6806da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.812+0000 7f8b6e566640 1 --2- 172.21.15.77:0/1052409208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b6806d640 0x7f8b6806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.812+0000 7f8b6dd65640 1 --2- 172.21.15.77:0/1052409208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b6806d640 0x7f8b6806da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.812+0000 7f8b6dd65640 1 -- 172.21.15.77:0/1052409208 >> v1:172.21.15.159:6789/0 conn(0x7f8b680b15e0 legacy=0x7f8b6815dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.812+0000 7f8b6dd65640 1 -- 172.21.15.77:0/1052409208 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6815e580 con 0x7f8b6815a1c0 2023-11-26T07:21:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.813+0000 7f8b6dd65640 1 --2- 172.21.15.77:0/1052409208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6815a1c0 0x7f8b68070ea0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009870 tx=0x7f8b6402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6479100afe5e365 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.814+0000 7f8b6cd63640 1 -- 172.21.15.77:0/1052409208 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64030840 con 0x7f8b6815a1c0 2023-11-26T07:21:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.814+0000 7f8b6cd63640 1 -- 172.21.15.77:0/1052409208 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b640309a0 con 0x7f8b6815a1c0 2023-11-26T07:21:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.814+0000 7f8b6cd63640 1 -- 172.21.15.77:0/1052409208 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64030d30 con 0x7f8b6815a1c0 2023-11-26T07:21:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.814+0000 7f8b6ed67640 1 -- 172.21.15.77:0/1052409208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6815a1c0 msgr2=0x7f8b68070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.814+0000 7f8b6ed67640 1 --2- 172.21.15.77:0/1052409208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6815a1c0 0x7f8b68070ea0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009870 tx=0x7f8b6402b980 comp rx=0 tx=0).stop 2023-11-26T07:21:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.814+0000 7f8b6ed67640 1 -- 172.21.15.77:0/1052409208 shutdown_connections 2023-11-26T07:21:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.814+0000 7f8b6ed67640 1 --2- 172.21.15.77:0/1052409208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b6806d640 0x7f8b6806da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.814+0000 7f8b6ed67640 1 --2- 172.21.15.77:0/1052409208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6815a1c0 0x7f8b68070ea0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.814+0000 7f8b6ed67640 1 -- 172.21.15.77:0/1052409208 >> 172.21.15.77:0/1052409208 conn(0x7f8b680cbb40 msgr2=0x7f8b680cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.814+0000 7f8b6ed67640 1 -- 172.21.15.77:0/1052409208 shutdown_connections 2023-11-26T07:21:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.814+0000 7f8b6ed67640 1 -- 172.21.15.77:0/1052409208 wait complete. 2023-11-26T07:21:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.816+0000 7f8b6ed67640 1 Processor -- start 2023-11-26T07:21:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.816+0000 7f8b6ed67640 1 -- start start 2023-11-26T07:21:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.817+0000 7f8b6ed67640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b6806d640 0x7f8b68159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.817+0000 7f8b6ed67640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b680b15e0 0x7f8b680b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.817+0000 7f8b6ed67640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6815a1c0 0x7f8b680b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.817+0000 7f8b6ed67640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680b4990 con 0x7f8b6815a1c0 2023-11-26T07:21:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.817+0000 7f8b6ed67640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680b4490 con 0x7f8b680b15e0 2023-11-26T07:21:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.817+0000 7f8b6ed67640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b68159750 con 0x7f8b6806d640 2023-11-26T07:21:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6e566640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6815a1c0 0x7f8b680b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6e566640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6815a1c0 0x7f8b680b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43044/0 (socket says 172.21.15.77:43044) 2023-11-26T07:21:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6e566640 1 -- 172.21.15.77:0/864625216 learned_addr learned my addr 172.21.15.77:0/864625216 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6dd65640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b6806d640 0x7f8b68159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6e566640 1 -- 172.21.15.77:0/864625216 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b6806d640 msgr2=0x7f8b68159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6e566640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b6806d640 0x7f8b68159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6e566640 1 -- 172.21.15.77:0/864625216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b680b15e0 msgr2=0x7f8b680b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6d564640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b680b15e0 0x7f8b680b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6e566640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b680b15e0 0x7f8b680b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6e566640 1 -- 172.21.15.77:0/864625216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b640094d0 con 0x7f8b6815a1c0 2023-11-26T07:21:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6d564640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b680b15e0 0x7f8b680b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.818+0000 7f8b6e566640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6815a1c0 0x7f8b680b3f50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000cd70 tx=0x7f8b6000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.819+0000 7f8b5e7fc640 1 -- 172.21.15.77:0/864625216 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b60003b90 con 0x7f8b6815a1c0 2023-11-26T07:21:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.819+0000 7f8b5e7fc640 1 -- 172.21.15.77:0/864625216 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b60003cf0 con 0x7f8b6815a1c0 2023-11-26T07:21:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.819+0000 7f8b5e7fc640 1 -- 172.21.15.77:0/864625216 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b60004240 con 0x7f8b6815a1c0 2023-11-26T07:21:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.819+0000 7f8b6ed67640 1 -- 172.21.15.77:0/864625216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6815a8e0 con 0x7f8b6815a1c0 2023-11-26T07:21:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.819+0000 7f8b6ed67640 1 -- 172.21.15.77:0/864625216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6815aea0 con 0x7f8b6815a1c0 2023-11-26T07:21:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.820+0000 7f8b6ed67640 1 -- 172.21.15.77:0/864625216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6804e840 con 0x7f8b6815a1c0 2023-11-26T07:21:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.821+0000 7f8b5e7fc640 1 -- 172.21.15.77:0/864625216 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f8b600043a0 con 0x7f8b6815a1c0 2023-11-26T07:21:19.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.822+0000 7f8b5e7fc640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b4c06b3e0 0x7f8b4c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.822+0000 7f8b5e7fc640 1 -- 172.21.15.77:0/864625216 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8b60012070 con 0x7f8b6815a1c0 2023-11-26T07:21:19.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.822+0000 7f8b6dd65640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b4c06b3e0 0x7f8b4c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.822+0000 7f8b6dd65640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b4c06b3e0 0x7f8b4c06d8a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b64036000 tx=0x7f8b6403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:19.826+0000 7f8b5e7fc640 1 -- 172.21.15.77:0/864625216 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b600552b0 con 0x7f8b6815a1c0 2023-11-26T07:21:20.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.030+0000 7f8b6ed67640 1 -- 172.21.15.77:0/864625216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8b680cd4d0 con 0x7f8b6815a1c0 2023-11-26T07:21:20.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.030+0000 7f8b5e7fc640 1 -- 172.21.15.77:0/864625216 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8b600588d0 con 0x7f8b6815a1c0 2023-11-26T07:21:20.032 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:21:20.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.033+0000 7f8b6ed67640 1 -- 172.21.15.77:0/864625216 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b4c06b3e0 msgr2=0x7f8b4c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:20.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.033+0000 7f8b6ed67640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b4c06b3e0 0x7f8b4c06d8a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b64036000 tx=0x7f8b6403b040 comp rx=0 tx=0).stop 2023-11-26T07:21:20.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.033+0000 7f8b6ed67640 1 -- 172.21.15.77:0/864625216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6815a1c0 msgr2=0x7f8b680b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:20.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.033+0000 7f8b6ed67640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6815a1c0 0x7f8b680b3f50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000cd70 tx=0x7f8b6000a660 comp rx=0 tx=0).stop 2023-11-26T07:21:20.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.033+0000 7f8b6ed67640 1 -- 172.21.15.77:0/864625216 shutdown_connections 2023-11-26T07:21:20.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.033+0000 7f8b6ed67640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b4c06b3e0 0x7f8b4c06d8a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.033+0000 7f8b6ed67640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6815a1c0 0x7f8b680b3f50 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.033+0000 7f8b6ed67640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b680b15e0 0x7f8b680b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.033+0000 7f8b6ed67640 1 --2- 172.21.15.77:0/864625216 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b6806d640 0x7f8b68159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.033+0000 7f8b6ed67640 1 -- 172.21.15.77:0/864625216 >> 172.21.15.77:0/864625216 conn(0x7f8b680cbb40 msgr2=0x7f8b680adca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:20.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.034+0000 7f8b6ed67640 1 -- 172.21.15.77:0/864625216 shutdown_connections 2023-11-26T07:21:20.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.034+0000 7f8b6ed67640 1 -- 172.21.15.77:0/864625216 wait complete. 2023-11-26T07:21:20.054 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-26T07:21:20.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:20.055 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-26T07:21:20.170 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:21:20.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:20.171 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:21:20.221 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:20.221 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:20.281 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:21:20.282 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:21:20.282 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:20.338 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:21:20.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:20.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.561+0000 7f95b1b05640 1 Processor -- start 2023-11-26T07:21:20.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.561+0000 7f95b1b05640 1 -- start start 2023-11-26T07:21:20.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.563+0000 7f95b1b05640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f95ac157c70 0x7f95ac161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.563+0000 7f95b1b05640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f95ac15e390 0x7f95ac0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.563+0000 7f95b1b05640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ac0ce0b0 con 0x7f95ac0cf450 2023-11-26T07:21:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.563+0000 7f95b1b05640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ac0cfe40 con 0x7f95ac15e390 2023-11-26T07:21:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.563+0000 7f95b1b05640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ac161960 con 0x7f95ac157c70 2023-11-26T07:21:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.563+0000 7f95a2ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f95ac0cf450 0x7f95ac15dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41258/0 (socket says 172.21.15.77:41258) 2023-11-26T07:21:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.563+0000 7f95a2ffd640 1 -- 172.21.15.77:0/1987361556 learned_addr learned my addr 172.21.15.77:0/1987361556 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.563+0000 7f95abfff640 1 --2- 172.21.15.77:0/1987361556 >> v2:172.21.15.77:3300/0 conn(0x7f95ac15e390 0x7f95ac0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:20.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.564+0000 7f95ab7fe640 1 --2- 172.21.15.77:0/1987361556 >> v2:172.21.15.159:3300/0 conn(0x7f95ac157c70 0x7f95ac161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:20.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.564+0000 7f95aaffd640 1 -- 172.21.15.77:0/1987361556 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218969490 0 0) 0x7f95ac0ce0b0 con 0x7f95ac0cf450 2023-11-26T07:21:20.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.564+0000 7f95aaffd640 1 -- 172.21.15.77:0/1987361556 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9598003520 con 0x7f95ac0cf450 2023-11-26T07:21:20.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.564+0000 7f95abfff640 1 -- 172.21.15.77:0/1987361556 >> v2:172.21.15.159:3300/0 conn(0x7f95ac157c70 msgr2=0x7f95ac161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:20.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.564+0000 7f95abfff640 1 --2- 172.21.15.77:0/1987361556 >> v2:172.21.15.159:3300/0 conn(0x7f95ac157c70 0x7f95ac161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.564+0000 7f95abfff640 1 -- 172.21.15.77:0/1987361556 >> v1:172.21.15.77:6789/0 conn(0x7f95ac0cf450 legacy=0x7f95ac15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:20.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.564+0000 7f95abfff640 1 -- 172.21.15.77:0/1987361556 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac15e8d0 con 0x7f95ac15e390 2023-11-26T07:21:20.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.565+0000 7f95abfff640 1 --2- 172.21.15.77:0/1987361556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95ac15e390 0x7f95ac0cf900 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f95ac06d5e0 tx=0x7f95a402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32212587f3ca2808 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:20.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.565+0000 7f95aaffd640 1 -- 172.21.15.77:0/1987361556 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a402cbe0 con 0x7f95ac15e390 2023-11-26T07:21:20.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.565+0000 7f95aaffd640 1 -- 172.21.15.77:0/1987361556 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a402cd40 con 0x7f95ac15e390 2023-11-26T07:21:20.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.565+0000 7f95aaffd640 1 -- 172.21.15.77:0/1987361556 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4034640 con 0x7f95ac15e390 2023-11-26T07:21:20.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.566+0000 7f95b1b05640 1 -- 172.21.15.77:0/1987361556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95ac15e390 msgr2=0x7f95ac0cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:20.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.566+0000 7f95b1b05640 1 --2- 172.21.15.77:0/1987361556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95ac15e390 0x7f95ac0cf900 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f95ac06d5e0 tx=0x7f95a402be30 comp rx=0 tx=0).stop 2023-11-26T07:21:20.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.566+0000 7f95b1b05640 1 -- 172.21.15.77:0/1987361556 shutdown_connections 2023-11-26T07:21:20.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.566+0000 7f95b1b05640 1 --2- 172.21.15.77:0/1987361556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95ac15e390 0x7f95ac0cf900 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.566+0000 7f95b1b05640 1 --2- 172.21.15.77:0/1987361556 >> v2:172.21.15.159:3300/0 conn(0x7f95ac157c70 0x7f95ac161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.566+0000 7f95b1b05640 1 -- 172.21.15.77:0/1987361556 >> 172.21.15.77:0/1987361556 conn(0x7f95ac06a920 msgr2=0x7f95ac06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:20.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.566+0000 7f95b1b05640 1 -- 172.21.15.77:0/1987361556 shutdown_connections 2023-11-26T07:21:20.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.566+0000 7f95b1b05640 1 -- 172.21.15.77:0/1987361556 wait complete. 2023-11-26T07:21:20.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.568+0000 7f95b1b05640 1 Processor -- start 2023-11-26T07:21:20.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.568+0000 7f95b1b05640 1 -- start start 2023-11-26T07:21:20.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.569+0000 7f95b1b05640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95ac0cf450 0x7f95ac147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:20.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.569+0000 7f95b1b05640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95ac157c70 0x7f95ac099140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:20.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.569+0000 7f95b1b05640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95ac15e390 0x7f95ac09af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:20.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.569+0000 7f95b1b05640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac099b20 con 0x7f95ac157c70 2023-11-26T07:21:20.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.569+0000 7f95b1b05640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac099e00 con 0x7f95ac15e390 2023-11-26T07:21:20.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.569+0000 7f95b1b05640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac09a0e0 con 0x7f95ac0cf450 2023-11-26T07:21:20.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.569+0000 7f95a2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95ac157c70 0x7f95ac099140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:20.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.569+0000 7f95a2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95ac157c70 0x7f95ac099140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43068/0 (socket says 172.21.15.77:43068) 2023-11-26T07:21:20.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.569+0000 7f95a2ffd640 1 -- 172.21.15.77:0/3377104016 learned_addr learned my addr 172.21.15.77:0/3377104016 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:20.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95ab7fe640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95ac0cf450 0x7f95ac147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:20.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95a2ffd640 1 -- 172.21.15.77:0/3377104016 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95ac0cf450 msgr2=0x7f95ac147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:20.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95a2ffd640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95ac0cf450 0x7f95ac147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95a2ffd640 1 -- 172.21.15.77:0/3377104016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95ac15e390 msgr2=0x7f95ac09af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:20.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95a2ffd640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95ac15e390 0x7f95ac09af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95a2ffd640 1 -- 172.21.15.77:0/3377104016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a4009a70 con 0x7f95ac157c70 2023-11-26T07:21:20.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95a2ffd640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95ac157c70 0x7f95ac099140 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f959400c390 tx=0x7f959400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:20.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95a8ff9640 1 -- 172.21.15.77:0/3377104016 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594005ce0 con 0x7f95ac157c70 2023-11-26T07:21:20.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95a8ff9640 1 -- 172.21.15.77:0/3377104016 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9594005e40 con 0x7f95ac157c70 2023-11-26T07:21:20.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95a8ff9640 1 -- 172.21.15.77:0/3377104016 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940072f0 con 0x7f95ac157c70 2023-11-26T07:21:20.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95b1b05640 1 -- 172.21.15.77:0/3377104016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac09a3c0 con 0x7f95ac157c70 2023-11-26T07:21:20.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.570+0000 7f95b1b05640 1 -- 172.21.15.77:0/3377104016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac147860 con 0x7f95ac157c70 2023-11-26T07:21:20.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.572+0000 7f95b1b05640 1 -- 172.21.15.77:0/3377104016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ac09a8e0 con 0x7f95ac157c70 2023-11-26T07:21:20.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.572+0000 7f95a8ff9640 1 -- 172.21.15.77:0/3377104016 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f9594007450 con 0x7f95ac157c70 2023-11-26T07:21:20.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.573+0000 7f95a8ff9640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f958c06b3e0 0x7f958c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:20.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.573+0000 7f95a8ff9640 1 -- 172.21.15.77:0/3377104016 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9594089700 con 0x7f95ac157c70 2023-11-26T07:21:20.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.574+0000 7f95ab7fe640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f958c06b3e0 0x7f958c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:20.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.574+0000 7f95ab7fe640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f958c06b3e0 0x7f958c06d8a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f959c006fd0 tx=0x7f959c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:20.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.577+0000 7f95a8ff9640 1 -- 172.21.15.77:0/3377104016 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95ac09a8e0 con 0x7f95ac157c70 2023-11-26T07:21:20.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.811+0000 7f95b1b05640 1 -- 172.21.15.77:0/3377104016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95ac09a8e0 con 0x7f95ac157c70 2023-11-26T07:21:20.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.813+0000 7f95a8ff9640 1 -- 172.21.15.77:0/3377104016 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f95ac09a8e0 con 0x7f95ac157c70 2023-11-26T07:21:20.815 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:20.815 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/486079893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":486079893},{"type":"v1","addr":"172.21.15.159:6833","nonce":486079893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4951,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2056565249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2056565249},{"type":"v1","addr":"172.21.15.77:6837","nonce":2056565249}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/779604697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":779604697},{"type":"v1","addr":"172.21.15.159:6835","nonce":779604697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:16.411919+0000","modified":"2023-11-26T07:20:19.475778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5664":{"gid":5664,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2496806662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2496806662},{"type":"v1","addr":"172.21.15.77:6835","nonce":2496806662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:21:20.815 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 26 2023-11-26T07:21:20.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.815+0000 7f95b1b05640 1 -- 172.21.15.77:0/3377104016 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f958c06b3e0 msgr2=0x7f958c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:20.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.815+0000 7f95b1b05640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f958c06b3e0 0x7f958c06d8a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f959c006fd0 tx=0x7f959c008040 comp rx=0 tx=0).stop 2023-11-26T07:21:20.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.815+0000 7f95b1b05640 1 -- 172.21.15.77:0/3377104016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95ac157c70 msgr2=0x7f95ac099140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:20.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.815+0000 7f95b1b05640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95ac157c70 0x7f95ac099140 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f959400c390 tx=0x7f959400c850 comp rx=0 tx=0).stop 2023-11-26T07:21:20.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.815+0000 7f95b1b05640 1 -- 172.21.15.77:0/3377104016 shutdown_connections 2023-11-26T07:21:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.815+0000 7f95b1b05640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f958c06b3e0 0x7f958c06d8a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.815+0000 7f95b1b05640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95ac15e390 0x7f95ac09af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.815+0000 7f95b1b05640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95ac157c70 0x7f95ac099140 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.815+0000 7f95b1b05640 1 --2- 172.21.15.77:0/3377104016 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95ac0cf450 0x7f95ac147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.815+0000 7f95b1b05640 1 -- 172.21.15.77:0/3377104016 >> 172.21.15.77:0/3377104016 conn(0x7f95ac06a920 msgr2=0x7f95ac155d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.816+0000 7f95b1b05640 1 -- 172.21.15.77:0/3377104016 shutdown_connections 2023-11-26T07:21:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:20.816+0000 7f95b1b05640 1 -- 172.21.15.77:0/3377104016 wait complete. 2023-11-26T07:21:20.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:21.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.047+0000 7f5717815640 1 Processor -- start 2023-11-26T07:21:21.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.047+0000 7f5717815640 1 -- start start 2023-11-26T07:21:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.049+0000 7f5717815640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f57101590a0 0x7f571015c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.049+0000 7f5717815640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57100b4d10 0x7f57100b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.049+0000 7f5717815640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571006e160 con 0x7f57100cd550 2023-11-26T07:21:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.049+0000 7f5717815640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5710159480 con 0x7f57101590a0 2023-11-26T07:21:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.049+0000 7f5717815640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571006d630 con 0x7f57100b4d10 2023-11-26T07:21:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.049+0000 7f57155b1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f57101590a0 0x7f571015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.049+0000 7f57155b1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f57101590a0 0x7f571015c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43080/0 (socket says 172.21.15.77:43080) 2023-11-26T07:21:21.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.049+0000 7f57155b1640 1 -- 172.21.15.77:0/4037964800 learned_addr learned my addr 172.21.15.77:0/4037964800 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:21.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.050+0000 7f5715db2640 1 --2- 172.21.15.77:0/4037964800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57100b4d10 0x7f57100b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.050+0000 7f57155b1640 1 -- 172.21.15.77:0/4037964800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57100b4d10 msgr2=0x7f57100b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:21.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.050+0000 7f57155b1640 1 --2- 172.21.15.77:0/4037964800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57100b4d10 0x7f57100b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.050+0000 7f57155b1640 1 -- 172.21.15.77:0/4037964800 >> v1:172.21.15.159:6789/0 conn(0x7f57100cd550 legacy=0x7f571006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:21.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.050+0000 7f57155b1640 1 -- 172.21.15.77:0/4037964800 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57100cdd10 con 0x7f57101590a0 2023-11-26T07:21:21.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.051+0000 7f57155b1640 1 --2- 172.21.15.77:0/4037964800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57101590a0 0x7f571015c520 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f570c009e50 tx=0x7f570c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68a0c56683ba387 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:21.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.051+0000 7f5707fff640 1 -- 172.21.15.77:0/4037964800 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c02c9e0 con 0x7f57101590a0 2023-11-26T07:21:21.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.051+0000 7f5707fff640 1 -- 172.21.15.77:0/4037964800 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c02cb40 con 0x7f57101590a0 2023-11-26T07:21:21.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.051+0000 7f5707fff640 1 -- 172.21.15.77:0/4037964800 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0343f0 con 0x7f57101590a0 2023-11-26T07:21:21.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.052+0000 7f5717815640 1 -- 172.21.15.77:0/4037964800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57101590a0 msgr2=0x7f571015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.052+0000 7f5717815640 1 --2- 172.21.15.77:0/4037964800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57101590a0 0x7f571015c520 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f570c009e50 tx=0x7f570c02be40 comp rx=0 tx=0).stop 2023-11-26T07:21:21.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.052+0000 7f5717815640 1 -- 172.21.15.77:0/4037964800 shutdown_connections 2023-11-26T07:21:21.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.052+0000 7f5717815640 1 --2- 172.21.15.77:0/4037964800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57100b4d10 0x7f57100b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.052+0000 7f5717815640 1 --2- 172.21.15.77:0/4037964800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57101590a0 0x7f571015c520 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.052+0000 7f5717815640 1 -- 172.21.15.77:0/4037964800 >> 172.21.15.77:0/4037964800 conn(0x7f5710071d40 msgr2=0x7f571006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:21.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.052+0000 7f5717815640 1 -- 172.21.15.77:0/4037964800 shutdown_connections 2023-11-26T07:21:21.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.052+0000 7f5717815640 1 -- 172.21.15.77:0/4037964800 wait complete. 2023-11-26T07:21:21.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.054+0000 7f5717815640 1 Processor -- start 2023-11-26T07:21:21.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.055+0000 7f5717815640 1 -- start start 2023-11-26T07:21:21.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.056+0000 7f5717815640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57100b4d10 0x7f571015d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.056+0000 7f5717815640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57100cd550 0x7f57100cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.056+0000 7f5717815640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57101590a0 0x7f571015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.056+0000 7f5717815640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571015c520 con 0x7f57100cd550 2023-11-26T07:21:21.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.056+0000 7f5717815640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571015d0a0 con 0x7f57101590a0 2023-11-26T07:21:21.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.056+0000 7f5717815640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571015c770 con 0x7f57100b4d10 2023-11-26T07:21:21.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.056+0000 7f5714db0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57100cd550 0x7f57100cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.056+0000 7f5714db0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57100cd550 0x7f57100cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43096/0 (socket says 172.21.15.77:43096) 2023-11-26T07:21:21.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.056+0000 7f5714db0640 1 -- 172.21.15.77:0/1441735337 learned_addr learned my addr 172.21.15.77:0/1441735337 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:21.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.056+0000 7f57155b1640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57100b4d10 0x7f571015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.056+0000 7f5715db2640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57101590a0 0x7f571015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.057+0000 7f5714db0640 1 -- 172.21.15.77:0/1441735337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57100b4d10 msgr2=0x7f571015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.057+0000 7f5714db0640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57100b4d10 0x7f571015d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.057+0000 7f5714db0640 1 -- 172.21.15.77:0/1441735337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57101590a0 msgr2=0x7f571015a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.057+0000 7f5714db0640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57101590a0 0x7f571015a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.057+0000 7f5714db0640 1 -- 172.21.15.77:0/1441735337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c009b30 con 0x7f57100cd550 2023-11-26T07:21:21.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.057+0000 7f5714db0640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57100cd550 0x7f57100cc1e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f570000c460 tx=0x7f570000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:21.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.057+0000 7f5705ffb640 1 -- 172.21.15.77:0/1441735337 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5700012830 con 0x7f57100cd550 2023-11-26T07:21:21.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.057+0000 7f5705ffb640 1 -- 172.21.15.77:0/1441735337 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57000129d0 con 0x7f57100cd550 2023-11-26T07:21:21.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.057+0000 7f5705ffb640 1 -- 172.21.15.77:0/1441735337 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5700012d80 con 0x7f57100cd550 2023-11-26T07:21:21.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.057+0000 7f5717815640 1 -- 172.21.15.77:0/1441735337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571015ca50 con 0x7f57100cd550 2023-11-26T07:21:21.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.057+0000 7f5717815640 1 -- 172.21.15.77:0/1441735337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57100cc720 con 0x7f57100cd550 2023-11-26T07:21:21.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.058+0000 7f5717815640 1 -- 172.21.15.77:0/1441735337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571015d230 con 0x7f57100cd550 2023-11-26T07:21:21.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.059+0000 7f5705ffb640 1 -- 172.21.15.77:0/1441735337 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f570001b400 con 0x7f57100cd550 2023-11-26T07:21:21.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.060+0000 7f5705ffb640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56f406b410 0x7f56f406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.060+0000 7f5705ffb640 1 -- 172.21.15.77:0/1441735337 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f570008a070 con 0x7f57100cd550 2023-11-26T07:21:21.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.061+0000 7f57155b1640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56f406b410 0x7f56f406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.061+0000 7f57155b1640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56f406b410 0x7f56f406d8d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f570c035000 tx=0x7f570c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:21.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.065+0000 7f5705ffb640 1 -- 172.21.15.77:0/1441735337 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5700054810 con 0x7f57100cd550 2023-11-26T07:21:21.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.258+0000 7f5717815640 1 -- 172.21.15.77:0/1441735337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5710067470 con 0x7f57100cd550 2023-11-26T07:21:21.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.260+0000 7f5705ffb640 1 -- 172.21.15.77:0/1441735337 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16706 (secure 0 0 0) 0x7f5700057e30 con 0x7f57100cd550 2023-11-26T07:21:21.262 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:21.262 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":51,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:21:20.690555+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:14.223705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:15.435670+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:21.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.262+0000 7f5717815640 1 -- 172.21.15.77:0/1441735337 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56f406b410 msgr2=0x7f56f406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.262+0000 7f5717815640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56f406b410 0x7f56f406d8d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f570c035000 tx=0x7f570c030000 comp rx=0 tx=0).stop 2023-11-26T07:21:21.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.262+0000 7f5717815640 1 -- 172.21.15.77:0/1441735337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57100cd550 msgr2=0x7f57100cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.262+0000 7f5717815640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57100cd550 0x7f57100cc1e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f570000c460 tx=0x7f570000c920 comp rx=0 tx=0).stop 2023-11-26T07:21:21.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.262+0000 7f5717815640 1 -- 172.21.15.77:0/1441735337 shutdown_connections 2023-11-26T07:21:21.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.262+0000 7f5717815640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56f406b410 0x7f56f406d8d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.262+0000 7f5717815640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57101590a0 0x7f571015a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.262+0000 7f5717815640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57100cd550 0x7f57100cc1e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.262+0000 7f5717815640 1 --2- 172.21.15.77:0/1441735337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57100b4d10 0x7f571015d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.263+0000 7f5717815640 1 -- 172.21.15.77:0/1441735337 >> 172.21.15.77:0/1441735337 conn(0x7f5710071d40 msgr2=0x7f57100ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:21.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.263+0000 7f5717815640 1 -- 172.21.15.77:0/1441735337 shutdown_connections 2023-11-26T07:21:21.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.263+0000 7f5717815640 1 -- 172.21.15.77:0/1441735337 wait complete. 2023-11-26T07:21:21.282 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:20:14.223705+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:20:15.435670+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:21:21.282 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:21:21.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.492+0000 7f2a1cc9b640 1 Processor -- start 2023-11-26T07:21:21.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.492+0000 7f2a1cc9b640 1 -- start start 2023-11-26T07:21:21.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.494+0000 7f2a1cc9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2a180d1c20 0x7f2a1806bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.494+0000 7f2a1cc9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a180d2000 0x7f2a180cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.494+0000 7f2a1cc9b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2a180d0200 0x7f2a181605f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.494+0000 7f2a1cc9b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a180ce410 con 0x7f2a180d1c20 2023-11-26T07:21:21.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.494+0000 7f2a1cc9b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a180d06f0 con 0x7f2a180d0200 2023-11-26T07:21:21.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.494+0000 7f2a1cc9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180d09d0 con 0x7f2a180d2000 2023-11-26T07:21:21.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.494+0000 7f2a1659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2a180d1c20 0x7f2a1806bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.494+0000 7f2a1659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2a180d1c20 0x7f2a1806bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43102/0 (socket says 172.21.15.77:43102) 2023-11-26T07:21:21.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.494+0000 7f2a1659c640 1 -- 172.21.15.77:0/2055875465 learned_addr learned my addr 172.21.15.77:0/2055875465 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:21.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.495+0000 7f2a15d9b640 1 --2- 172.21.15.77:0/2055875465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a180d2000 0x7f2a180cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.495+0000 7f2a1659c640 1 -- 172.21.15.77:0/2055875465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a180d2000 msgr2=0x7f2a180cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:21.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.495+0000 7f2a1659c640 1 --2- 172.21.15.77:0/2055875465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a180d2000 0x7f2a180cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.495+0000 7f2a1659c640 1 -- 172.21.15.77:0/2055875465 >> v2:172.21.15.159:3300/0 conn(0x7f2a180d0200 msgr2=0x7f2a181605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:21.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.495+0000 7f2a1659c640 1 --2- 172.21.15.77:0/2055875465 >> v2:172.21.15.159:3300/0 conn(0x7f2a180d0200 0x7f2a181605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.495+0000 7f2a1659c640 1 -- 172.21.15.77:0/2055875465 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a180ce0a0 con 0x7f2a180d1c20 2023-11-26T07:21:21.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.495+0000 7f2a15d9b640 1 --2- 172.21.15.77:0/2055875465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a180d2000 0x7f2a180cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:21.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.496+0000 7f2a1659c640 1 --2- 172.21.15.77:0/2055875465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a180d1c20 0x7f2a1806bb60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2a180b94a0 tx=0x7f2a0802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da961c04ffbe1926 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:21.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.496+0000 7f2a1559a640 1 -- 172.21.15.77:0/2055875465 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0802ca70 con 0x7f2a180d1c20 2023-11-26T07:21:21.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.496+0000 7f2a1559a640 1 -- 172.21.15.77:0/2055875465 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0802cbd0 con 0x7f2a180d1c20 2023-11-26T07:21:21.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.496+0000 7f2a1559a640 1 -- 172.21.15.77:0/2055875465 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080343f0 con 0x7f2a180d1c20 2023-11-26T07:21:21.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.497+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/2055875465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a180d1c20 msgr2=0x7f2a1806bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.497+0000 7f2a1cc9b640 1 --2- 172.21.15.77:0/2055875465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a180d1c20 0x7f2a1806bb60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2a180b94a0 tx=0x7f2a0802bed0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.497+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/2055875465 shutdown_connections 2023-11-26T07:21:21.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.497+0000 7f2a1cc9b640 1 --2- 172.21.15.77:0/2055875465 >> v2:172.21.15.159:3300/0 conn(0x7f2a180d0200 0x7f2a181605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.497+0000 7f2a1cc9b640 1 --2- 172.21.15.77:0/2055875465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a180d2000 0x7f2a180cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.497+0000 7f2a1cc9b640 1 --2- 172.21.15.77:0/2055875465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a180d1c20 0x7f2a1806bb60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.497+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/2055875465 >> 172.21.15.77:0/2055875465 conn(0x7f2a1808cea0 msgr2=0x7f2a1809c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:21.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.497+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/2055875465 shutdown_connections 2023-11-26T07:21:21.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.497+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/2055875465 wait complete. 2023-11-26T07:21:21.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.499+0000 7f2a1cc9b640 1 Processor -- start 2023-11-26T07:21:21.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.499+0000 7f2a1cc9b640 1 -- start start 2023-11-26T07:21:21.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.500+0000 7f2a1cc9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a180d0200 0x7f2a1815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.500+0000 7f2a1cc9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a180d1c20 0x7f2a18159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.500+0000 7f2a1cc9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a180d2000 0x7f2a180ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.500+0000 7f2a1cc9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180b4ba0 con 0x7f2a180d0200 2023-11-26T07:21:21.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.500+0000 7f2a1cc9b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180cd360 con 0x7f2a180d1c20 2023-11-26T07:21:21.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.500+0000 7f2a1cc9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180cd640 con 0x7f2a180d2000 2023-11-26T07:21:21.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.501+0000 7f2a1659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a180d0200 0x7f2a1815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.501+0000 7f2a1659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a180d0200 0x7f2a1815b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43116/0 (socket says 172.21.15.77:43116) 2023-11-26T07:21:21.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.501+0000 7f2a1659c640 1 -- 172.21.15.77:0/3319396070 learned_addr learned my addr 172.21.15.77:0/3319396070 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:21.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.501+0000 7f2a16d9d640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a180d2000 0x7f2a180ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.501+0000 7f2a15d9b640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a180d1c20 0x7f2a18159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.501+0000 7f2a1659c640 1 -- 172.21.15.77:0/3319396070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a180d2000 msgr2=0x7f2a180ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.501+0000 7f2a1659c640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a180d2000 0x7f2a180ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.501+0000 7f2a1659c640 1 -- 172.21.15.77:0/3319396070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a180d1c20 msgr2=0x7f2a18159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.501+0000 7f2a1659c640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a180d1c20 0x7f2a18159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.501+0000 7f2a1659c640 1 -- 172.21.15.77:0/3319396070 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08009b30 con 0x7f2a180d0200 2023-11-26T07:21:21.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.502+0000 7f2a1659c640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a180d0200 0x7f2a1815b4c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2a08000f80 tx=0x7f2a08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:21.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.502+0000 7f2a0effd640 1 -- 172.21.15.77:0/3319396070 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0803e450 con 0x7f2a180d0200 2023-11-26T07:21:21.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.502+0000 7f2a0effd640 1 -- 172.21.15.77:0/3319396070 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0803e5f0 con 0x7f2a180d0200 2023-11-26T07:21:21.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.502+0000 7f2a0effd640 1 -- 172.21.15.77:0/3319396070 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0803e9a0 con 0x7f2a180d0200 2023-11-26T07:21:21.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.502+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/3319396070 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1815acc0 con 0x7f2a180d0200 2023-11-26T07:21:21.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.502+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/3319396070 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a180cd010 con 0x7f2a180d0200 2023-11-26T07:21:21.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.503+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/3319396070 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1804e8b0 con 0x7f2a180d0200 2023-11-26T07:21:21.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.504+0000 7f2a0effd640 1 -- 172.21.15.77:0/3319396070 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f2a0803eb00 con 0x7f2a180d0200 2023-11-26T07:21:21.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.505+0000 7f2a0effd640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f29f806b3e0 0x7f29f806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.505+0000 7f2a0effd640 1 -- 172.21.15.77:0/3319396070 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2a080ad1a0 con 0x7f2a180d0200 2023-11-26T07:21:21.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.505+0000 7f2a15d9b640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f29f806b3e0 0x7f29f806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.506+0000 7f2a15d9b640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f29f806b3e0 0x7f29f806d8a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2a1815a4c0 tx=0x7f2a00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:21.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.511+0000 7f2a0effd640 1 -- 172.21.15.77:0/3319396070 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a08077a60 con 0x7f2a180d0200 2023-11-26T07:21:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.708+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/3319396070 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a1806b770 con 0x7f2a180d0200 2023-11-26T07:21:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.709+0000 7f2a0effd640 1 -- 172.21.15.77:0/3319396070 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a0803edb0 con 0x7f2a180d0200 2023-11-26T07:21:21.711 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:21:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.711+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/3319396070 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f29f806b3e0 msgr2=0x7f29f806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.711+0000 7f2a1cc9b640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f29f806b3e0 0x7f29f806d8a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2a1815a4c0 tx=0x7f2a00008040 comp rx=0 tx=0).stop 2023-11-26T07:21:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.712+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/3319396070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a180d0200 msgr2=0x7f2a1815b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.712+0000 7f2a1cc9b640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a180d0200 0x7f2a1815b4c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2a08000f80 tx=0x7f2a08004a40 comp rx=0 tx=0).stop 2023-11-26T07:21:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.712+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/3319396070 shutdown_connections 2023-11-26T07:21:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.712+0000 7f2a1cc9b640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f29f806b3e0 0x7f29f806d8a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.712+0000 7f2a1cc9b640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a180d2000 0x7f2a180ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.712+0000 7f2a1cc9b640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a180d1c20 0x7f2a18159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.712+0000 7f2a1cc9b640 1 --2- 172.21.15.77:0/3319396070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a180d0200 0x7f2a1815b4c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.712+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/3319396070 >> 172.21.15.77:0/3319396070 conn(0x7f2a1808cea0 msgr2=0x7f2a180b85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:21.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.712+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/3319396070 shutdown_connections 2023-11-26T07:21:21.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.712+0000 7f2a1cc9b640 1 -- 172.21.15.77:0/3319396070 wait complete. 2023-11-26T07:21:21.732 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:21:21.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.943+0000 7f626d4b2640 1 Processor -- start 2023-11-26T07:21:21.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.943+0000 7f626d4b2640 1 -- start start 2023-11-26T07:21:21.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.944+0000 7f626d4b2640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f626809ccf0 0x7f62680abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.944+0000 7f626d4b2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f62680ac390 0x7f626806cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.945+0000 7f626d4b2640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680706f0 con 0x7f6268144a30 2023-11-26T07:21:21.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.945+0000 7f626d4b2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680ac840 con 0x7f62680ac390 2023-11-26T07:21:21.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.945+0000 7f626d4b2640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626815c7d0 con 0x7f626809ccf0 2023-11-26T07:21:21.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.945+0000 7f62677fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f62680ac390 0x7f626806cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.945+0000 7f62677fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f62680ac390 0x7f626806cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43128/0 (socket says 172.21.15.77:43128) 2023-11-26T07:21:21.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.945+0000 7f62677fe640 1 -- 172.21.15.77:0/2048539371 learned_addr learned my addr 172.21.15.77:0/2048539371 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:21.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.945+0000 7f62677fe640 1 -- 172.21.15.77:0/2048539371 >> v2:172.21.15.159:3300/0 conn(0x7f626809ccf0 msgr2=0x7f62680abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:21.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.945+0000 7f62677fe640 1 --2- 172.21.15.77:0/2048539371 >> v2:172.21.15.159:3300/0 conn(0x7f626809ccf0 0x7f62680abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.945+0000 7f62677fe640 1 -- 172.21.15.77:0/2048539371 >> v1:172.21.15.159:6789/0 conn(0x7f6268144a30 legacy=0x7f626815b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:21.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.945+0000 7f62677fe640 1 -- 172.21.15.77:0/2048539371 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626806ca30 con 0x7f62680ac390 2023-11-26T07:21:21.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.947+0000 7f62677fe640 1 --2- 172.21.15.77:0/2048539371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62680ac390 0x7f626806cec0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f626806ea40 tx=0x7f626002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc1fe746b49db5c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:21.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.947+0000 7f6265ffb640 1 -- 172.21.15.77:0/2048539371 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260031800 con 0x7f62680ac390 2023-11-26T07:21:21.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.947+0000 7f6265ffb640 1 -- 172.21.15.77:0/2048539371 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6260031960 con 0x7f62680ac390 2023-11-26T07:21:21.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.947+0000 7f6265ffb640 1 -- 172.21.15.77:0/2048539371 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260031cf0 con 0x7f62680ac390 2023-11-26T07:21:21.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.947+0000 7f626d4b2640 1 -- 172.21.15.77:0/2048539371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62680ac390 msgr2=0x7f626806cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.947+0000 7f626d4b2640 1 --2- 172.21.15.77:0/2048539371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62680ac390 0x7f626806cec0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f626806ea40 tx=0x7f626002b8a0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.948+0000 7f626d4b2640 1 -- 172.21.15.77:0/2048539371 shutdown_connections 2023-11-26T07:21:21.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.948+0000 7f626d4b2640 1 --2- 172.21.15.77:0/2048539371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62680ac390 0x7f626806cec0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.948+0000 7f626d4b2640 1 --2- 172.21.15.77:0/2048539371 >> v2:172.21.15.159:3300/0 conn(0x7f626809ccf0 0x7f62680abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.948+0000 7f626d4b2640 1 -- 172.21.15.77:0/2048539371 >> 172.21.15.77:0/2048539371 conn(0x7f62680b0b70 msgr2=0x7f62680b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:21.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.948+0000 7f626d4b2640 1 -- 172.21.15.77:0/2048539371 shutdown_connections 2023-11-26T07:21:21.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.948+0000 7f626d4b2640 1 -- 172.21.15.77:0/2048539371 wait complete. 2023-11-26T07:21:21.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.950+0000 7f626d4b2640 1 Processor -- start 2023-11-26T07:21:21.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.950+0000 7f626d4b2640 1 -- start start 2023-11-26T07:21:21.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.951+0000 7f626d4b2640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f626809ccf0 0x7f62680b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.951+0000 7f626d4b2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62680ac390 0x7f62681f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.951+0000 7f626d4b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6268144a30 0x7f62680b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.951+0000 7f626d4b2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62681f3250 con 0x7f6268144a30 2023-11-26T07:21:21.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.951+0000 7f626d4b2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62681f77f0 con 0x7f62680ac390 2023-11-26T07:21:21.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.951+0000 7f626d4b2640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62681f3460 con 0x7f626809ccf0 2023-11-26T07:21:21.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.951+0000 7f62677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6268144a30 0x7f62680b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.952+0000 7f62677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6268144a30 0x7f62680b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43144/0 (socket says 172.21.15.77:43144) 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.952+0000 7f62677fe640 1 -- 172.21.15.77:0/4171390485 learned_addr learned my addr 172.21.15.77:0/4171390485 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.952+0000 7f62677fe640 1 -- 172.21.15.77:0/4171390485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f626809ccf0 msgr2=0x7f62680b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.952+0000 7f62677fe640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f626809ccf0 0x7f62680b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.952+0000 7f62677fe640 1 -- 172.21.15.77:0/4171390485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62680ac390 msgr2=0x7f62681f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.952+0000 7f62677fe640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62680ac390 0x7f62681f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.952+0000 7f62677fe640 1 -- 172.21.15.77:0/4171390485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600094d0 con 0x7f6268144a30 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.952+0000 7f62677fe640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6268144a30 0x7f62680b0200 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6260009960 tx=0x7f62600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.952+0000 7f625f7fe640 1 -- 172.21.15.77:0/4171390485 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626003ad20 con 0x7f6268144a30 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.953+0000 7f625f7fe640 1 -- 172.21.15.77:0/4171390485 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62600443f0 con 0x7f6268144a30 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.953+0000 7f625f7fe640 1 -- 172.21.15.77:0/4171390485 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626003aea0 con 0x7f6268144a30 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.953+0000 7f626d4b2640 1 -- 172.21.15.77:0/4171390485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62681f6f50 con 0x7f6268144a30 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.953+0000 7f626d4b2640 1 -- 172.21.15.77:0/4171390485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62681f7510 con 0x7f6268144a30 2023-11-26T07:21:21.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.954+0000 7f626d4b2640 1 -- 172.21.15.77:0/4171390485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62680acaf0 con 0x7f6268144a30 2023-11-26T07:21:21.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.955+0000 7f625f7fe640 1 -- 172.21.15.77:0/4171390485 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f62600447a0 con 0x7f6268144a30 2023-11-26T07:21:21.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.956+0000 7f625f7fe640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f624806b3e0 0x7f624806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:21.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.956+0000 7f625f7fe640 1 -- 172.21.15.77:0/4171390485 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f626002e070 con 0x7f6268144a30 2023-11-26T07:21:21.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.956+0000 7f6266ffd640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f624806b3e0 0x7f624806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:21.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.956+0000 7f6266ffd640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f624806b3e0 0x7f624806d8a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6268072420 tx=0x7f6258006ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:21.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:21.960+0000 7f625f7fe640 1 -- 172.21.15.77:0/4171390485 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6260076d70 con 0x7f6268144a30 2023-11-26T07:21:22.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.150+0000 7f626d4b2640 1 -- 172.21.15.77:0/4171390485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f626804e840 con 0x7f6268144a30 2023-11-26T07:21:22.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.152+0000 7f625f7fe640 1 -- 172.21.15.77:0/4171390485 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f626007a390 con 0x7f6268144a30 2023-11-26T07:21:22.154 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:21:22.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.154+0000 7f626d4b2640 1 -- 172.21.15.77:0/4171390485 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f624806b3e0 msgr2=0x7f624806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.154+0000 7f626d4b2640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f624806b3e0 0x7f624806d8a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6268072420 tx=0x7f6258006ba0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.154+0000 7f626d4b2640 1 -- 172.21.15.77:0/4171390485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6268144a30 msgr2=0x7f62680b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.154+0000 7f626d4b2640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6268144a30 0x7f62680b0200 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6260009960 tx=0x7f62600046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.154+0000 7f626d4b2640 1 -- 172.21.15.77:0/4171390485 shutdown_connections 2023-11-26T07:21:22.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.154+0000 7f626d4b2640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f624806b3e0 0x7f624806d8a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.154+0000 7f626d4b2640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6268144a30 0x7f62680b0200 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.154+0000 7f626d4b2640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62680ac390 0x7f62681f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.154+0000 7f626d4b2640 1 --2- 172.21.15.77:0/4171390485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f626809ccf0 0x7f62680b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.154+0000 7f626d4b2640 1 -- 172.21.15.77:0/4171390485 >> 172.21.15.77:0/4171390485 conn(0x7f62680b0b70 msgr2=0x7f626813fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:22.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.155+0000 7f626d4b2640 1 -- 172.21.15.77:0/4171390485 shutdown_connections 2023-11-26T07:21:22.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.155+0000 7f626d4b2640 1 -- 172.21.15.77:0/4171390485 wait complete. 2023-11-26T07:21:22.175 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:21:22.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.387+0000 7f5c98d1d640 1 Processor -- start 2023-11-26T07:21:22.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.387+0000 7f5c98d1d640 1 -- start start 2023-11-26T07:21:22.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c98d1d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c9406de10 0x7f5c9415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c98d1d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5c940c49f0 0x7f5c940705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c98d1d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9415ec90 con 0x7f5c94072160 2023-11-26T07:21:22.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c98d1d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c940cd530 con 0x7f5c940c49f0 2023-11-26T07:21:22.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c98d1d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940c4ed0 con 0x7f5c9406de10 2023-11-26T07:21:22.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c9259c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5c94072160 0x7f5c9406d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41264/0 (socket says 172.21.15.77:41264) 2023-11-26T07:21:22.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c9259c640 1 -- 172.21.15.77:0/2490011058 learned_addr learned my addr 172.21.15.77:0/2490011058 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:22.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c92d9d640 1 --2- 172.21.15.77:0/2490011058 >> v2:172.21.15.77:3300/0 conn(0x7f5c940c49f0 0x7f5c940705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:22.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c9159a640 1 -- 172.21.15.77:0/2490011058 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861990514 0 0) 0x7f5c84001490 con 0x7f5c94072160 2023-11-26T07:21:22.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c92d9d640 1 -- 172.21.15.77:0/2490011058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c9406de10 msgr2=0x7f5c9415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:22.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c92d9d640 1 --2- 172.21.15.77:0/2490011058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c9406de10 0x7f5c9415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c92d9d640 1 -- 172.21.15.77:0/2490011058 >> v1:172.21.15.77:6789/0 conn(0x7f5c94072160 legacy=0x7f5c9406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.389+0000 7f5c92d9d640 1 -- 172.21.15.77:0/2490011058 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940c51b0 con 0x7f5c940c49f0 2023-11-26T07:21:22.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.391+0000 7f5c92d9d640 1 --2- 172.21.15.77:0/2490011058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940c49f0 0x7f5c940705c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0097a0 tx=0x7f5c8c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59b607f614e9f5d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:22.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.391+0000 7f5c9159a640 1 -- 172.21.15.77:0/2490011058 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c02d040 con 0x7f5c940c49f0 2023-11-26T07:21:22.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.391+0000 7f5c9159a640 1 -- 172.21.15.77:0/2490011058 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c031810 con 0x7f5c940c49f0 2023-11-26T07:21:22.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.391+0000 7f5c9159a640 1 -- 172.21.15.77:0/2490011058 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c031ba0 con 0x7f5c940c49f0 2023-11-26T07:21:22.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.391+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2490011058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940c49f0 msgr2=0x7f5c940705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.391+0000 7f5c98d1d640 1 --2- 172.21.15.77:0/2490011058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940c49f0 0x7f5c940705c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0097a0 tx=0x7f5c8c02b8b0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.391+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2490011058 shutdown_connections 2023-11-26T07:21:22.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.391+0000 7f5c98d1d640 1 --2- 172.21.15.77:0/2490011058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940c49f0 0x7f5c940705c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.391+0000 7f5c98d1d640 1 --2- 172.21.15.77:0/2490011058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c9406de10 0x7f5c9415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.391+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2490011058 >> 172.21.15.77:0/2490011058 conn(0x7f5c940b0c50 msgr2=0x7f5c940b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:22.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.392+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2490011058 shutdown_connections 2023-11-26T07:21:22.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.392+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2490011058 wait complete. 2023-11-26T07:21:22.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.393+0000 7f5c98d1d640 1 Processor -- start 2023-11-26T07:21:22.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.393+0000 7f5c98d1d640 1 -- start start 2023-11-26T07:21:22.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.394+0000 7f5c98d1d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c9406de10 0x7f5c94153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.394+0000 7f5c98d1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c94072160 0x7f5c94159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.394+0000 7f5c98d1d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c940c49f0 0x7f5c94151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.394+0000 7f5c98d1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940c72f0 con 0x7f5c94072160 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.394+0000 7f5c98d1d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94150d30 con 0x7f5c9406de10 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.394+0000 7f5c98d1d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c941543d0 con 0x7f5c940c49f0 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.395+0000 7f5c91d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c94072160 0x7f5c94159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.395+0000 7f5c91d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c94072160 0x7f5c94159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43158/0 (socket says 172.21.15.77:43158) 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.395+0000 7f5c91d9b640 1 -- 172.21.15.77:0/2514297607 learned_addr learned my addr 172.21.15.77:0/2514297607 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.395+0000 7f5c91d9b640 1 -- 172.21.15.77:0/2514297607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c940c49f0 msgr2=0x7f5c94151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.395+0000 7f5c91d9b640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c940c49f0 0x7f5c94151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.395+0000 7f5c91d9b640 1 -- 172.21.15.77:0/2514297607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c9406de10 msgr2=0x7f5c94153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.395+0000 7f5c91d9b640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c9406de10 0x7f5c94153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.395+0000 7f5c91d9b640 1 -- 172.21.15.77:0/2514297607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c009400 con 0x7f5c94072160 2023-11-26T07:21:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.395+0000 7f5c91d9b640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c94072160 0x7f5c94159a00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00b4a0 tx=0x7f5c7c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:22.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.396+0000 7f5c8affd640 1 -- 172.21.15.77:0/2514297607 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c010610 con 0x7f5c94072160 2023-11-26T07:21:22.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.396+0000 7f5c8affd640 1 -- 172.21.15.77:0/2514297607 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c010770 con 0x7f5c94072160 2023-11-26T07:21:22.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.396+0000 7f5c8affd640 1 -- 172.21.15.77:0/2514297607 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c010b20 con 0x7f5c94072160 2023-11-26T07:21:22.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.396+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2514297607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c941546b0 con 0x7f5c94072160 2023-11-26T07:21:22.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.396+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2514297607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c94154c70 con 0x7f5c94072160 2023-11-26T07:21:22.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.397+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2514297607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9404e8b0 con 0x7f5c94072160 2023-11-26T07:21:22.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.398+0000 7f5c8affd640 1 -- 172.21.15.77:0/2514297607 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f5c7c010c80 con 0x7f5c94072160 2023-11-26T07:21:22.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.399+0000 7f5c8affd640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5c7406b3e0 0x7f5c7406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.399+0000 7f5c8affd640 1 -- 172.21.15.77:0/2514297607 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5c7c089c90 con 0x7f5c94072160 2023-11-26T07:21:22.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.399+0000 7f5c9259c640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5c7406b3e0 0x7f5c7406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:22.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.400+0000 7f5c9259c640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5c7406b3e0 0x7f5c7406d8a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5c940ac0a0 tx=0x7f5c84001690 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:22.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.403+0000 7f5c8affd640 1 -- 172.21.15.77:0/2514297607 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c7c0544c0 con 0x7f5c94072160 2023-11-26T07:21:22.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.595+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2514297607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c94151010 con 0x7f5c94072160 2023-11-26T07:21:22.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.595+0000 7f5c8affd640 1 -- 172.21.15.77:0/2514297607 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c7c01e0a0 con 0x7f5c94072160 2023-11-26T07:21:22.598 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:21:22.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.598+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2514297607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5c7406b3e0 msgr2=0x7f5c7406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.598+0000 7f5c98d1d640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5c7406b3e0 0x7f5c7406d8a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5c940ac0a0 tx=0x7f5c84001690 comp rx=0 tx=0).stop 2023-11-26T07:21:22.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.598+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2514297607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c94072160 msgr2=0x7f5c94159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.598+0000 7f5c98d1d640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c94072160 0x7f5c94159a00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00b4a0 tx=0x7f5c7c00b960 comp rx=0 tx=0).stop 2023-11-26T07:21:22.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.598+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2514297607 shutdown_connections 2023-11-26T07:21:22.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.598+0000 7f5c98d1d640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5c7406b3e0 0x7f5c7406d8a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.598+0000 7f5c98d1d640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c940c49f0 0x7f5c94151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.598+0000 7f5c98d1d640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c94072160 0x7f5c94159a00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.598+0000 7f5c98d1d640 1 --2- 172.21.15.77:0/2514297607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c9406de10 0x7f5c94153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.598+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2514297607 >> 172.21.15.77:0/2514297607 conn(0x7f5c940b0c50 msgr2=0x7f5c940b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:22.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.598+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2514297607 shutdown_connections 2023-11-26T07:21:22.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.599+0000 7f5c98d1d640 1 -- 172.21.15.77:0/2514297607 wait complete. 2023-11-26T07:21:22.619 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:22.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.834+0000 7f34ab59e640 1 Processor -- start 2023-11-26T07:21:22.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.834+0000 7f34ab59e640 1 -- start start 2023-11-26T07:21:22.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.836+0000 7f34ab59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac15d4e0 0x7f34ac0d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.836+0000 7f34ab59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f34ac0d38e0 0x7f34ac0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.836+0000 7f34ab59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac0ce990 con 0x7f34ac0d0070 2023-11-26T07:21:22.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.836+0000 7f34ab59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac0d4110 con 0x7f34ac0d38e0 2023-11-26T07:21:22.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.836+0000 7f34ab59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0d04e0 con 0x7f34ac15d4e0 2023-11-26T07:21:22.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.836+0000 7f34aa59c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac15d4e0 0x7f34ac0d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:22.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.837+0000 7f34aa59c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac15d4e0 0x7f34ac0d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:52762/0 (socket says 172.21.15.77:52762) 2023-11-26T07:21:22.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.837+0000 7f34aa59c640 1 -- 172.21.15.77:0/1774732097 learned_addr learned my addr 172.21.15.77:0/1774732097 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:22.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.837+0000 7f34a3fff640 1 --2- 172.21.15.77:0/1774732097 >> v2:172.21.15.159:3300/0 conn(0x7f34ac0d38e0 0x7f34ac0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:22.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.837+0000 7f34aa59c640 1 -- 172.21.15.77:0/1774732097 >> v2:172.21.15.159:3300/0 conn(0x7f34ac0d38e0 msgr2=0x7f34ac0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:22.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.837+0000 7f34aa59c640 1 --2- 172.21.15.77:0/1774732097 >> v2:172.21.15.159:3300/0 conn(0x7f34ac0d38e0 0x7f34ac0cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.837+0000 7f34aa59c640 1 -- 172.21.15.77:0/1774732097 >> v1:172.21.15.159:6789/0 conn(0x7f34ac0d0070 legacy=0x7f34ac0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.837+0000 7f34aa59c640 1 -- 172.21.15.77:0/1774732097 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac0cec70 con 0x7f34ac15d4e0 2023-11-26T07:21:22.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.837+0000 7f34a9d9b640 1 -- 172.21.15.77:0/1774732097 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986520878 0 0) 0x7f34ac0ce990 con 0x7f34ac0d0070 2023-11-26T07:21:22.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.839+0000 7f34aa59c640 1 --2- 172.21.15.77:0/1774732097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac15d4e0 0x7f34ac0d1e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f349c009870 tx=0x7f349c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a17dd1c210b8a19 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:22.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.839+0000 7f34a9d9b640 1 -- 172.21.15.77:0/1774732097 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c030840 con 0x7f34ac15d4e0 2023-11-26T07:21:22.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.839+0000 7f34a9d9b640 1 -- 172.21.15.77:0/1774732097 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c0309a0 con 0x7f34ac15d4e0 2023-11-26T07:21:22.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.839+0000 7f34a9d9b640 1 -- 172.21.15.77:0/1774732097 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c030d30 con 0x7f34ac15d4e0 2023-11-26T07:21:22.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.840+0000 7f34ab59e640 1 -- 172.21.15.77:0/1774732097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac15d4e0 msgr2=0x7f34ac0d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.840+0000 7f34ab59e640 1 --2- 172.21.15.77:0/1774732097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac15d4e0 0x7f34ac0d1e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f349c009870 tx=0x7f349c02b980 comp rx=0 tx=0).stop 2023-11-26T07:21:22.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.840+0000 7f34ab59e640 1 -- 172.21.15.77:0/1774732097 shutdown_connections 2023-11-26T07:21:22.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.840+0000 7f34ab59e640 1 --2- 172.21.15.77:0/1774732097 >> v2:172.21.15.159:3300/0 conn(0x7f34ac0d38e0 0x7f34ac0cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.840+0000 7f34ab59e640 1 --2- 172.21.15.77:0/1774732097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac15d4e0 0x7f34ac0d1e20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.840+0000 7f34ab59e640 1 -- 172.21.15.77:0/1774732097 >> 172.21.15.77:0/1774732097 conn(0x7f34ac09c510 msgr2=0x7f34ac0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:22.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.840+0000 7f34ab59e640 1 -- 172.21.15.77:0/1774732097 shutdown_connections 2023-11-26T07:21:22.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.840+0000 7f34ab59e640 1 -- 172.21.15.77:0/1774732097 wait complete. 2023-11-26T07:21:22.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.842+0000 7f34ab59e640 1 Processor -- start 2023-11-26T07:21:22.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.842+0000 7f34ab59e640 1 -- start start 2023-11-26T07:21:22.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.843+0000 7f34ab59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac0d0070 0x7f34ac15b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.843+0000 7f34ab59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac0d38e0 0x7f34ac0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.843+0000 7f34ab59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34ac15d4e0 0x7f34ac15dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34ab59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0cbe90 con 0x7f34ac0d0070 2023-11-26T07:21:22.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34ab59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac15b650 con 0x7f34ac15d4e0 2023-11-26T07:21:22.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34ab59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0b61d0 con 0x7f34ac0d38e0 2023-11-26T07:21:22.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34aa59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac0d0070 0x7f34ac15b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34aa59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac0d0070 0x7f34ac15b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43174/0 (socket says 172.21.15.77:43174) 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34aa59c640 1 -- 172.21.15.77:0/826947543 learned_addr learned my addr 172.21.15.77:0/826947543 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34a3fff640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac0d38e0 0x7f34ac0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34aad9d640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34ac15d4e0 0x7f34ac15dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34aa59c640 1 -- 172.21.15.77:0/826947543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac0d38e0 msgr2=0x7f34ac0cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34aa59c640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac0d38e0 0x7f34ac0cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34aa59c640 1 -- 172.21.15.77:0/826947543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34ac15d4e0 msgr2=0x7f34ac15dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34aa59c640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34ac15d4e0 0x7f34ac15dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.844+0000 7f34aa59c640 1 -- 172.21.15.77:0/826947543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0094d0 con 0x7f34ac0d0070 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.845+0000 7f34aa59c640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac0d0070 0x7f34ac15b110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f349c02b9c0 tx=0x7f349c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.845+0000 7f34a2ffd640 1 -- 172.21.15.77:0/826947543 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c03e070 con 0x7f34ac0d0070 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.845+0000 7f34a2ffd640 1 -- 172.21.15.77:0/826947543 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c039990 con 0x7f34ac0d0070 2023-11-26T07:21:22.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.845+0000 7f34ab59e640 1 -- 172.21.15.77:0/826947543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac0b64b0 con 0x7f34ac0d0070 2023-11-26T07:21:22.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.845+0000 7f34a2ffd640 1 -- 172.21.15.77:0/826947543 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c039d20 con 0x7f34ac0d0070 2023-11-26T07:21:22.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.845+0000 7f34ab59e640 1 -- 172.21.15.77:0/826947543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac0b6a70 con 0x7f34ac0d0070 2023-11-26T07:21:22.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.846+0000 7f34ab59e640 1 -- 172.21.15.77:0/826947543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac067680 con 0x7f34ac0d0070 2023-11-26T07:21:22.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.847+0000 7f34a2ffd640 1 -- 172.21.15.77:0/826947543 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f349c04b400 con 0x7f34ac0d0070 2023-11-26T07:21:22.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.848+0000 7f34a2ffd640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f348c06b3e0 0x7f348c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:22.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.848+0000 7f34a2ffd640 1 -- 172.21.15.77:0/826947543 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f349c0ac6a0 con 0x7f34ac0d0070 2023-11-26T07:21:22.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.848+0000 7f34a3fff640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f348c06b3e0 0x7f348c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:22.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.849+0000 7f34a3fff640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f348c06b3e0 0x7f348c06d8a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0c9810 tx=0x7f3494008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:22.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:22.853+0000 7f34a2ffd640 1 -- 172.21.15.77:0/826947543 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f349c076e80 con 0x7f34ac0d0070 2023-11-26T07:21:23.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.080+0000 7f34ab59e640 1 -- 172.21.15.77:0/826947543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34ac0b25c0 con 0x7f34ac0d0070 2023-11-26T07:21:23.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.082+0000 7f34a2ffd640 1 -- 172.21.15.77:0/826947543 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f349c034090 con 0x7f34ac0d0070 2023-11-26T07:21:23.083 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:23.084 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/486079893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":486079893},{"type":"v1","addr":"172.21.15.159:6833","nonce":486079893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4951,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2056565249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2056565249},{"type":"v1","addr":"172.21.15.77:6837","nonce":2056565249}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/779604697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":779604697},{"type":"v1","addr":"172.21.15.159:6835","nonce":779604697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:16.411919+0000","modified":"2023-11-26T07:20:19.475778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5664":{"gid":5664,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2496806662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2496806662},{"type":"v1","addr":"172.21.15.77:6835","nonce":2496806662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:21:23.084 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 26 2023-11-26T07:21:23.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.084+0000 7f34ab59e640 1 -- 172.21.15.77:0/826947543 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f348c06b3e0 msgr2=0x7f348c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:23.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.084+0000 7f34ab59e640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f348c06b3e0 0x7f348c06d8a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0c9810 tx=0x7f3494008040 comp rx=0 tx=0).stop 2023-11-26T07:21:23.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.084+0000 7f34ab59e640 1 -- 172.21.15.77:0/826947543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac0d0070 msgr2=0x7f34ac15b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:23.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.084+0000 7f34ab59e640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac0d0070 0x7f34ac15b110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f349c02b9c0 tx=0x7f349c0046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.085+0000 7f34ab59e640 1 -- 172.21.15.77:0/826947543 shutdown_connections 2023-11-26T07:21:23.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.085+0000 7f34ab59e640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f348c06b3e0 0x7f348c06d8a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.085+0000 7f34ab59e640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34ac15d4e0 0x7f34ac15dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.085+0000 7f34ab59e640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34ac0d38e0 0x7f34ac0cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.085+0000 7f34ab59e640 1 --2- 172.21.15.77:0/826947543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac0d0070 0x7f34ac15b110 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.085+0000 7f34ab59e640 1 -- 172.21.15.77:0/826947543 >> 172.21.15.77:0/826947543 conn(0x7f34ac09c510 msgr2=0x7f34ac0b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:23.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.085+0000 7f34ab59e640 1 -- 172.21.15.77:0/826947543 shutdown_connections 2023-11-26T07:21:23.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.085+0000 7f34ab59e640 1 -- 172.21.15.77:0/826947543 wait complete. 2023-11-26T07:21:23.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:23.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.311+0000 7f3b651dc640 1 Processor -- start 2023-11-26T07:21:23.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.312+0000 7f3b651dc640 1 -- start start 2023-11-26T07:21:23.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.313+0000 7f3b651dc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b600b2250 0x7f3b6015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.313+0000 7f3b651dc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3b600b2a70 0x7f3b6015b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.313+0000 7f3b651dc640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6015ab80 con 0x7f3b600b2630 2023-11-26T07:21:23.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.313+0000 7f3b651dc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6015a990 con 0x7f3b600b2a70 2023-11-26T07:21:23.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.313+0000 7f3b651dc640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6015e680 con 0x7f3b600b2250 2023-11-26T07:21:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.314+0000 7f3b5f59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3b600b2a70 0x7f3b6015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.314+0000 7f3b5f59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3b600b2a70 0x7f3b6015b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43188/0 (socket says 172.21.15.77:43188) 2023-11-26T07:21:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.314+0000 7f3b5f59e640 1 -- 172.21.15.77:0/2867358599 learned_addr learned my addr 172.21.15.77:0/2867358599 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.314+0000 7f3b5ed9d640 1 --2- 172.21.15.77:0/2867358599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b600b2250 0x7f3b6015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.314+0000 7f3b5f59e640 1 -- 172.21.15.77:0/2867358599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b600b2250 msgr2=0x7f3b6015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.314+0000 7f3b5f59e640 1 --2- 172.21.15.77:0/2867358599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b600b2250 0x7f3b6015df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.314+0000 7f3b5f59e640 1 -- 172.21.15.77:0/2867358599 >> v1:172.21.15.159:6789/0 conn(0x7f3b600b2630 legacy=0x7f3b600ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.314+0000 7f3b5f59e640 1 -- 172.21.15.77:0/2867358599 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6015e960 con 0x7f3b600b2a70 2023-11-26T07:21:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.314+0000 7f3b5ed9d640 1 --2- 172.21.15.77:0/2867358599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b600b2250 0x7f3b6015df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:23.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.315+0000 7f3b5f59e640 1 --2- 172.21.15.77:0/2867358599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b600b2a70 0x7f3b6015b080 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009e50 tx=0x7f3b5802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9bb09aee6092be2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:23.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.316+0000 7f3b5e59c640 1 -- 172.21.15.77:0/2867358599 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5802ca80 con 0x7f3b600b2a70 2023-11-26T07:21:23.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.316+0000 7f3b5e59c640 1 -- 172.21.15.77:0/2867358599 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5802cbe0 con 0x7f3b600b2a70 2023-11-26T07:21:23.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.316+0000 7f3b5e59c640 1 -- 172.21.15.77:0/2867358599 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b580343f0 con 0x7f3b600b2a70 2023-11-26T07:21:23.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.316+0000 7f3b651dc640 1 -- 172.21.15.77:0/2867358599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b600b2a70 msgr2=0x7f3b6015b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:23.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.316+0000 7f3b651dc640 1 --2- 172.21.15.77:0/2867358599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b600b2a70 0x7f3b6015b080 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009e50 tx=0x7f3b5802bee0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.316+0000 7f3b651dc640 1 -- 172.21.15.77:0/2867358599 shutdown_connections 2023-11-26T07:21:23.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.316+0000 7f3b651dc640 1 --2- 172.21.15.77:0/2867358599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b600b2a70 0x7f3b6015b080 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.316+0000 7f3b651dc640 1 --2- 172.21.15.77:0/2867358599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b600b2250 0x7f3b6015df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.316+0000 7f3b651dc640 1 -- 172.21.15.77:0/2867358599 >> 172.21.15.77:0/2867358599 conn(0x7f3b6006a920 msgr2=0x7f3b6006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:23.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.316+0000 7f3b651dc640 1 -- 172.21.15.77:0/2867358599 shutdown_connections 2023-11-26T07:21:23.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.317+0000 7f3b651dc640 1 -- 172.21.15.77:0/2867358599 wait complete. 2023-11-26T07:21:23.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.318+0000 7f3b651dc640 1 Processor -- start 2023-11-26T07:21:23.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.318+0000 7f3b651dc640 1 -- start start 2023-11-26T07:21:23.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.319+0000 7f3b651dc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b600b2250 0x7f3b60153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.319+0000 7f3b651dc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b600b2630 0x7f3b60150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.319+0000 7f3b651dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b600b2a70 0x7f3b600b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.319+0000 7f3b651dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b601532f0 con 0x7f3b600b2a70 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.319+0000 7f3b651dc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b601529e0 con 0x7f3b600b2630 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.319+0000 7f3b651dc640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b601510e0 con 0x7f3b600b2250 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.320+0000 7f3b5f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b600b2a70 0x7f3b600b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.320+0000 7f3b5f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b600b2a70 0x7f3b600b0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43194/0 (socket says 172.21.15.77:43194) 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.320+0000 7f3b5f59e640 1 -- 172.21.15.77:0/3433436180 learned_addr learned my addr 172.21.15.77:0/3433436180 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.320+0000 7f3b5f59e640 1 -- 172.21.15.77:0/3433436180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b600b2250 msgr2=0x7f3b60153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.320+0000 7f3b5f59e640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b600b2250 0x7f3b60153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.320+0000 7f3b57fff640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b600b2630 0x7f3b60150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.320+0000 7f3b5f59e640 1 -- 172.21.15.77:0/3433436180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b600b2630 msgr2=0x7f3b60150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.320+0000 7f3b5f59e640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b600b2630 0x7f3b60150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.320+0000 7f3b5f59e640 1 -- 172.21.15.77:0/3433436180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b58009b30 con 0x7f3b600b2a70 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.320+0000 7f3b57fff640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b600b2630 0x7f3b60150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.320+0000 7f3b5f59e640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b600b2a70 0x7f3b600b0e40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3b58036040 tx=0x7f3b58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.321+0000 7f3b577fe640 1 -- 172.21.15.77:0/3433436180 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b58009510 con 0x7f3b600b2a70 2023-11-26T07:21:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.321+0000 7f3b577fe640 1 -- 172.21.15.77:0/3433436180 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5803e450 con 0x7f3b600b2a70 2023-11-26T07:21:23.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.321+0000 7f3b577fe640 1 -- 172.21.15.77:0/3433436180 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5803e800 con 0x7f3b600b2a70 2023-11-26T07:21:23.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.321+0000 7f3b651dc640 1 -- 172.21.15.77:0/3433436180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b600cd7c0 con 0x7f3b600b2a70 2023-11-26T07:21:23.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.321+0000 7f3b651dc640 1 -- 172.21.15.77:0/3433436180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b60152c30 con 0x7f3b600b2a70 2023-11-26T07:21:23.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.322+0000 7f3b651dc640 1 -- 172.21.15.77:0/3433436180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b60067470 con 0x7f3b600b2a70 2023-11-26T07:21:23.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.323+0000 7f3b577fe640 1 -- 172.21.15.77:0/3433436180 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f3b5802cd50 con 0x7f3b600b2a70 2023-11-26T07:21:23.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.324+0000 7f3b577fe640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3b4006b3e0 0x7f3b4006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.324+0000 7f3b577fe640 1 -- 172.21.15.77:0/3433436180 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3b580acc50 con 0x7f3b600b2a70 2023-11-26T07:21:23.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.324+0000 7f3b5ed9d640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3b4006b3e0 0x7f3b4006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.325+0000 7f3b5ed9d640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3b4006b3e0 0x7f3b4006d8a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3b50006fd0 tx=0x7f3b50008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:23.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.328+0000 7f3b577fe640 1 -- 172.21.15.77:0/3433436180 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b580773f0 con 0x7f3b600b2a70 2023-11-26T07:21:23.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.520+0000 7f3b651dc640 1 -- 172.21.15.77:0/3433436180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b600cea00 con 0x7f3b600b2a70 2023-11-26T07:21:23.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.522+0000 7f3b577fe640 1 -- 172.21.15.77:0/3433436180 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16706 (secure 0 0 0) 0x7f3b5807aa10 con 0x7f3b600b2a70 2023-11-26T07:21:23.524 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:23.525 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":51,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:21:20.690555+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:14.223705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:15.435670+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:23.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 -- 172.21.15.77:0/3433436180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3b4006b3e0 msgr2=0x7f3b4006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:23.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3b4006b3e0 0x7f3b4006d8a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3b50006fd0 tx=0x7f3b50008040 comp rx=0 tx=0).stop 2023-11-26T07:21:23.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 -- 172.21.15.77:0/3433436180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b600b2a70 msgr2=0x7f3b600b0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:23.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b600b2a70 0x7f3b600b0e40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3b58036040 tx=0x7f3b58004a40 comp rx=0 tx=0).stop 2023-11-26T07:21:23.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 -- 172.21.15.77:0/3433436180 shutdown_connections 2023-11-26T07:21:23.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3b4006b3e0 0x7f3b4006d8a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b600b2a70 0x7f3b600b0e40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b600b2630 0x7f3b60150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 --2- 172.21.15.77:0/3433436180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b600b2250 0x7f3b60153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 -- 172.21.15.77:0/3433436180 >> 172.21.15.77:0/3433436180 conn(0x7f3b6006a920 msgr2=0x7f3b60159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:23.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 -- 172.21.15.77:0/3433436180 shutdown_connections 2023-11-26T07:21:23.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.525+0000 7f3b651dc640 1 -- 172.21.15.77:0/3433436180 wait complete. 2023-11-26T07:21:23.546 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:21:23.546 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:23.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.763+0000 7f89e59d5640 1 Processor -- start 2023-11-26T07:21:23.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.763+0000 7f89e59d5640 1 -- start start 2023-11-26T07:21:23.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.765+0000 7f89e59d5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89e00cc470 0x7f89e00abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.765+0000 7f89e59d5640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f89e00ce640 0x7f89e00b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.765+0000 7f89e59d5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e00ce270 con 0x7f89e00cf450 2023-11-26T07:21:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.765+0000 7f89e59d5640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e006c560 con 0x7f89e00ce640 2023-11-26T07:21:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.765+0000 7f89e59d5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e006d0a0 con 0x7f89e00cc470 2023-11-26T07:21:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.765+0000 7f89df7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f89e00cf450 0x7f89e006d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41274/0 (socket says 172.21.15.77:41274) 2023-11-26T07:21:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.765+0000 7f89df7fe640 1 -- 172.21.15.77:0/241682030 learned_addr learned my addr 172.21.15.77:0/241682030 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.765+0000 7f89d67fc640 1 --2- 172.21.15.77:0/241682030 >> v2:172.21.15.159:3300/0 conn(0x7f89e00ce640 0x7f89e00b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89deffd640 1 --2- 172.21.15.77:0/241682030 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89e00cc470 0x7f89e00abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094366661 0 0) 0x7f89e00ce270 con 0x7f89e00cf450 2023-11-26T07:21:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89cc003520 con 0x7f89e00cf450 2023-11-26T07:21:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1979361487 0 0) 0x7f89cc003520 con 0x7f89e00cf450 2023-11-26T07:21:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89e00cc470 msgr2=0x7f89e00abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 --2- 172.21.15.77:0/241682030 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89e00cc470 0x7f89e00abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 >> v2:172.21.15.159:3300/0 conn(0x7f89e00ce640 msgr2=0x7f89e00b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 --2- 172.21.15.77:0/241682030 >> v2:172.21.15.159:3300/0 conn(0x7f89e00ce640 0x7f89e00b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e00b4200 con 0x7f89e00cf450 2023-11-26T07:21:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f89d8001670 con 0x7f89e00cf450 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 >> v1:172.21.15.77:6789/0 conn(0x7f89e00cf450 legacy=0x7f89e006d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 --2- 172.21.15.77:0/241682030 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89e00cc470 0x7f89cc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 --2- 172.21.15.77:0/241682030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89cc003ef0 0x7f89cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 --2- 172.21.15.77:0/241682030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89cc004d00 0x7f89cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e006c560 con 0x7f89cc004d00 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e006d0a0 con 0x7f89cc003ef0 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc00b980 con 0x7f89e00cc470 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.766+0000 7f89df7fe640 1 --2- 172.21.15.77:0/241682030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89cc004d00 0x7f89cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.767+0000 7f89deffd640 1 --2- 172.21.15.77:0/241682030 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89e00cc470 0x7f89cc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.767+0000 7f89df7fe640 1 -- 172.21.15.77:0/241682030 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89e00cc470 msgr2=0x7f89cc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.767+0000 7f89df7fe640 1 --2- 172.21.15.77:0/241682030 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89e00cc470 0x7f89cc003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.767+0000 7f89df7fe640 1 -- 172.21.15.77:0/241682030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89cc003ef0 msgr2=0x7f89cc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:23.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.767+0000 7f89df7fe640 1 --2- 172.21.15.77:0/241682030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89cc003ef0 0x7f89cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.767+0000 7f89df7fe640 1 -- 172.21.15.77:0/241682030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc003520 con 0x7f89cc004d00 2023-11-26T07:21:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.768+0000 7f89df7fe640 1 --2- 172.21.15.77:0/241682030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89cc004d00 0x7f89cc005180 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f89d800c210 tx=0x7f89cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21ce3d644f36365 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.768+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8005ad0 con 0x7f89cc004d00 2023-11-26T07:21:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.768+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d8005c30 con 0x7f89cc004d00 2023-11-26T07:21:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.768+0000 7f89de7fc640 1 -- 172.21.15.77:0/241682030 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d802caf0 con 0x7f89cc004d00 2023-11-26T07:21:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.769+0000 7f89e59d5640 1 -- 172.21.15.77:0/241682030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89cc004d00 msgr2=0x7f89cc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.769+0000 7f89e59d5640 1 --2- 172.21.15.77:0/241682030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89cc004d00 0x7f89cc005180 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f89d800c210 tx=0x7f89cc0057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.769+0000 7f89df7fe640 1 -- 172.21.15.77:0/241682030 reap_dead start 2023-11-26T07:21:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.769+0000 7f89e59d5640 1 -- 172.21.15.77:0/241682030 shutdown_connections 2023-11-26T07:21:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.769+0000 7f89e59d5640 1 -- 172.21.15.77:0/241682030 >> 172.21.15.77:0/241682030 conn(0x7f89e006a920 msgr2=0x7f89e006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.769+0000 7f89e59d5640 1 -- 172.21.15.77:0/241682030 shutdown_connections 2023-11-26T07:21:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.769+0000 7f89e59d5640 1 -- 172.21.15.77:0/241682030 wait complete. 2023-11-26T07:21:23.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.771+0000 7f89e59d5640 1 Processor -- start 2023-11-26T07:21:23.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.771+0000 7f89e59d5640 1 -- start start 2023-11-26T07:21:23.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.772+0000 7f89e59d5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89cc004d00 0x7f89e015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.772+0000 7f89e59d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e014e510 0x7f89e0164750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.772+0000 7f89e59d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e006d430 0x7f89e006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.772+0000 7f89e59d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e006de20 con 0x7f89e006d430 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.772+0000 7f89e59d5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e01631c0 con 0x7f89e014e510 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.772+0000 7f89e59d5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e01634a0 con 0x7f89cc004d00 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.772+0000 7f89df7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e006d430 0x7f89e006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.772+0000 7f89df7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e006d430 0x7f89e006d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43216/0 (socket says 172.21.15.77:43216) 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.772+0000 7f89df7fe640 1 -- 172.21.15.77:0/1365131825 learned_addr learned my addr 172.21.15.77:0/1365131825 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.772+0000 7f89d67fc640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e014e510 0x7f89e0164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89deffd640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89cc004d00 0x7f89e015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89df7fe640 1 -- 172.21.15.77:0/1365131825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89cc004d00 msgr2=0x7f89e015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89df7fe640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89cc004d00 0x7f89e015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89df7fe640 1 -- 172.21.15.77:0/1365131825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e014e510 msgr2=0x7f89e0164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89df7fe640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e014e510 0x7f89e0164750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89df7fe640 1 -- 172.21.15.77:0/1365131825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e0163780 con 0x7f89e006d430 2023-11-26T07:21:23.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89deffd640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89cc004d00 0x7f89e015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:23.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89df7fe640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e006d430 0x7f89e006d8e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f89d8001930 tx=0x7f89d8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:23.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89dcff9640 1 -- 172.21.15.77:0/1365131825 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d803c040 con 0x7f89e006d430 2023-11-26T07:21:23.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89dcff9640 1 -- 172.21.15.77:0/1365131825 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d802cce0 con 0x7f89e006d430 2023-11-26T07:21:23.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89e59d5640 1 -- 172.21.15.77:0/1365131825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e0163a60 con 0x7f89e006d430 2023-11-26T07:21:23.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.773+0000 7f89dcff9640 1 -- 172.21.15.77:0/1365131825 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8007270 con 0x7f89e006d430 2023-11-26T07:21:23.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.774+0000 7f89e59d5640 1 -- 172.21.15.77:0/1365131825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e014e990 con 0x7f89e006d430 2023-11-26T07:21:23.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.775+0000 7f89e59d5640 1 -- 172.21.15.77:0/1365131825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e0163f80 con 0x7f89e006d430 2023-11-26T07:21:23.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.775+0000 7f89dcff9640 1 -- 172.21.15.77:0/1365131825 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f89d8032070 con 0x7f89e006d430 2023-11-26T07:21:23.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.776+0000 7f89dcff9640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89c006b3e0 0x7f89c006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:23.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.776+0000 7f89dcff9640 1 -- 172.21.15.77:0/1365131825 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f89d80ab3c0 con 0x7f89e006d430 2023-11-26T07:21:23.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.777+0000 7f89deffd640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89c006b3e0 0x7f89c006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:23.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.777+0000 7f89deffd640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89c006b3e0 0x7f89c006d8a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f89d0007460 tx=0x7f89d000d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:23.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:23.781+0000 7f89dcff9640 1 -- 172.21.15.77:0/1365131825 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89e0163f80 con 0x7f89e006d430 2023-11-26T07:21:24.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.014+0000 7f89e59d5640 1 -- 172.21.15.77:0/1365131825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89e0163f80 con 0x7f89e006d430 2023-11-26T07:21:24.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.015+0000 7f89dcff9640 1 -- 172.21.15.77:0/1365131825 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f89e0163f80 con 0x7f89e006d430 2023-11-26T07:21:24.017 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:24.017 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/486079893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":486079893},{"type":"v1","addr":"172.21.15.159:6833","nonce":486079893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4951,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2056565249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2056565249},{"type":"v1","addr":"172.21.15.77:6837","nonce":2056565249}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/779604697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":779604697},{"type":"v1","addr":"172.21.15.159:6835","nonce":779604697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:16.411919+0000","modified":"2023-11-26T07:20:19.475778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5664":{"gid":5664,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2496806662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2496806662},{"type":"v1","addr":"172.21.15.77:6835","nonce":2496806662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:21:24.017 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 26 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 -- 172.21.15.77:0/1365131825 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89c006b3e0 msgr2=0x7f89c006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89c006b3e0 0x7f89c006d8a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f89d0007460 tx=0x7f89d000d040 comp rx=0 tx=0).stop 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 -- 172.21.15.77:0/1365131825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e006d430 msgr2=0x7f89e006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e006d430 0x7f89e006d8e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f89d8001930 tx=0x7f89d8001a00 comp rx=0 tx=0).stop 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 -- 172.21.15.77:0/1365131825 shutdown_connections 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f89c006b3e0 0x7f89c006d8a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e006d430 0x7f89e006d8e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e014e510 0x7f89e0164750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 --2- 172.21.15.77:0/1365131825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89cc004d00 0x7f89e015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 -- 172.21.15.77:0/1365131825 >> 172.21.15.77:0/1365131825 conn(0x7f89e006a920 msgr2=0x7f89e00b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 -- 172.21.15.77:0/1365131825 shutdown_connections 2023-11-26T07:21:24.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.018+0000 7f89e59d5640 1 -- 172.21.15.77:0/1365131825 wait complete. 2023-11-26T07:21:24.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:24.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.257+0000 7fcd136b4640 1 Processor -- start 2023-11-26T07:21:27.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.257+0000 7fcd136b4640 1 -- start start 2023-11-26T07:21:27.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:21:27.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd136b4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd0c0b2250 0x7fcd0c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd136b4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd0c0b2630 0x7fcd0c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd136b4640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcd0c0cd470 0x7fcd0c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd136b4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c15a990 con 0x7fcd0c0b2250 2023-11-26T07:21:27.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd136b4640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c15ab80 con 0x7fcd0c0cd470 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd136b4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c15e680 con 0x7fcd0c0b2630 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd11450640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd0c0b2250 0x7fcd0c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd11450640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd0c0b2250 0x7fcd0c15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43220/0 (socket says 172.21.15.77:43220) 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd11450640 1 -- 172.21.15.77:0/943834930 learned_addr learned my addr 172.21.15.77:0/943834930 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd11450640 1 -- 172.21.15.77:0/943834930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd0c0b2630 msgr2=0x7fcd0c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd11450640 1 --2- 172.21.15.77:0/943834930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd0c0b2630 0x7fcd0c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd11450640 1 -- 172.21.15.77:0/943834930 >> v2:172.21.15.159:3300/0 conn(0x7fcd0c0cd470 msgr2=0x7fcd0c15b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.259+0000 7fcd11450640 1 --2- 172.21.15.77:0/943834930 >> v2:172.21.15.159:3300/0 conn(0x7fcd0c0cd470 0x7fcd0c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.260+0000 7fcd11450640 1 -- 172.21.15.77:0/943834930 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c15e960 con 0x7fcd0c0b2250 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.261+0000 7fcd11450640 1 --2- 172.21.15.77:0/943834930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd0c0b2250 0x7fcd0c15df80 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c158560 tx=0x7fcd0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6630fe1e9f3696 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.261+0000 7fcd03fff640 1 -- 172.21.15.77:0/943834930 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08031870 con 0x7fcd0c0b2250 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.261+0000 7fcd03fff640 1 -- 172.21.15.77:0/943834930 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd080319d0 con 0x7fcd0c0b2250 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.261+0000 7fcd03fff640 1 -- 172.21.15.77:0/943834930 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08031d60 con 0x7fcd0c0b2250 2023-11-26T07:21:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.261+0000 7fcd136b4640 1 -- 172.21.15.77:0/943834930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd0c0b2250 msgr2=0x7fcd0c15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.261+0000 7fcd136b4640 1 --2- 172.21.15.77:0/943834930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd0c0b2250 0x7fcd0c15df80 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c158560 tx=0x7fcd0802b910 comp rx=0 tx=0).stop 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.262+0000 7fcd136b4640 1 -- 172.21.15.77:0/943834930 shutdown_connections 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.262+0000 7fcd136b4640 1 --2- 172.21.15.77:0/943834930 >> v2:172.21.15.159:3300/0 conn(0x7fcd0c0cd470 0x7fcd0c15b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.262+0000 7fcd136b4640 1 --2- 172.21.15.77:0/943834930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd0c0b2630 0x7fcd0c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.262+0000 7fcd136b4640 1 --2- 172.21.15.77:0/943834930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd0c0b2250 0x7fcd0c15df80 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.262+0000 7fcd136b4640 1 -- 172.21.15.77:0/943834930 >> 172.21.15.77:0/943834930 conn(0x7fcd0c06a920 msgr2=0x7fcd0c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.262+0000 7fcd136b4640 1 -- 172.21.15.77:0/943834930 shutdown_connections 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.262+0000 7fcd136b4640 1 -- 172.21.15.77:0/943834930 wait complete. 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.264+0000 7fcd136b4640 1 Processor -- start 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.264+0000 7fcd136b4640 1 -- start start 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.265+0000 7fcd136b4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd0c0b2250 0x7fcd0c157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.265+0000 7fcd136b4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd0c0b2630 0x7fcd0c099140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.265+0000 7fcd136b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd0c0cd470 0x7fcd0c1f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.265+0000 7fcd136b4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0b12d0 con 0x7fcd0c0b2250 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.265+0000 7fcd136b4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0b0650 con 0x7fcd0c0cd470 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.265+0000 7fcd136b4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0b0930 con 0x7fcd0c0b2630 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.265+0000 7fcd11450640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd0c0b2250 0x7fcd0c157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.265+0000 7fcd11450640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd0c0b2250 0x7fcd0c157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43232/0 (socket says 172.21.15.77:43232) 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.265+0000 7fcd11450640 1 -- 172.21.15.77:0/1724648683 learned_addr learned my addr 172.21.15.77:0/1724648683 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.265+0000 7fcd11450640 1 -- 172.21.15.77:0/1724648683 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd0c0b2630 msgr2=0x7fcd0c099140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.266+0000 7fcd11450640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd0c0b2630 0x7fcd0c099140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.266+0000 7fcd11450640 1 -- 172.21.15.77:0/1724648683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd0c0cd470 msgr2=0x7fcd0c1f3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.266+0000 7fcd11450640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd0c0cd470 0x7fcd0c1f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.266+0000 7fcd11450640 1 -- 172.21.15.77:0/1724648683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080094d0 con 0x7fcd0c0b2250 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.266+0000 7fcd11450640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd0c0b2250 0x7fcd0c157ca0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcd08000c00 tx=0x7fcd080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.266+0000 7fcd01ffb640 1 -- 172.21.15.77:0/1724648683 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0803ad10 con 0x7fcd0c0b2250 2023-11-26T07:21:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.266+0000 7fcd01ffb640 1 -- 172.21.15.77:0/1724648683 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0803ae70 con 0x7fcd0c0b2250 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.266+0000 7fcd01ffb640 1 -- 172.21.15.77:0/1724648683 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08044610 con 0x7fcd0c0b2250 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.266+0000 7fcd136b4640 1 -- 172.21.15.77:0/1724648683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c0b0c10 con 0x7fcd0c0b2250 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.266+0000 7fcd136b4640 1 -- 172.21.15.77:0/1724648683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0c1f4150 con 0x7fcd0c0b2250 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.267+0000 7fcd136b4640 1 -- 172.21.15.77:0/1724648683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0c0b1410 con 0x7fcd0c0b2250 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.268+0000 7fcd01ffb640 1 -- 172.21.15.77:0/1724648683 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fcd0804d450 con 0x7fcd0c0b2250 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.269+0000 7fcd01ffb640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccf006b3e0 0x7fccf006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.269+0000 7fcd01ffb640 1 -- 172.21.15.77:0/1724648683 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fcd0802d040 con 0x7fcd0c0b2250 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.269+0000 7fcd10c4f640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccf006b3e0 0x7fccf006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.270+0000 7fcd10c4f640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccf006b3e0 0x7fccf006d8a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c157b30 tx=0x7fccfc006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.273+0000 7fcd01ffb640 1 -- 172.21.15.77:0/1724648683 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd0c0b1410 con 0x7fcd0c0b2250 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.502+0000 7fcd136b4640 1 -- 172.21.15.77:0/1724648683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd0c0b1410 con 0x7fcd0c0b2250 2023-11-26T07:21:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.503+0000 7fcd01ffb640 1 -- 172.21.15.77:0/1724648683 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fcd0c0b1410 con 0x7fcd0c0b2250 2023-11-26T07:21:27.504 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:27.504 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/486079893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":486079893},{"type":"v1","addr":"172.21.15.159:6833","nonce":486079893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4951,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2056565249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2056565249},{"type":"v1","addr":"172.21.15.77:6837","nonce":2056565249}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/779604697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":779604697},{"type":"v1","addr":"172.21.15.159:6835","nonce":779604697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:16.411919+0000","modified":"2023-11-26T07:20:19.475778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5664":{"gid":5664,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2496806662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2496806662},{"type":"v1","addr":"172.21.15.77:6835","nonce":2496806662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:21:27.505 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 26 2023-11-26T07:21:27.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.505+0000 7fcd136b4640 1 -- 172.21.15.77:0/1724648683 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccf006b3e0 msgr2=0x7fccf006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.505+0000 7fcd136b4640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccf006b3e0 0x7fccf006d8a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c157b30 tx=0x7fccfc006c90 comp rx=0 tx=0).stop 2023-11-26T07:21:27.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.505+0000 7fcd136b4640 1 -- 172.21.15.77:0/1724648683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd0c0b2250 msgr2=0x7fcd0c157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.505+0000 7fcd136b4640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd0c0b2250 0x7fcd0c157ca0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcd08000c00 tx=0x7fcd080046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.506+0000 7fcd136b4640 1 -- 172.21.15.77:0/1724648683 shutdown_connections 2023-11-26T07:21:27.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.506+0000 7fcd136b4640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccf006b3e0 0x7fccf006d8a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.506+0000 7fcd136b4640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd0c0cd470 0x7fcd0c1f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.506+0000 7fcd136b4640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcd0c0b2630 0x7fcd0c099140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.506+0000 7fcd136b4640 1 --2- 172.21.15.77:0/1724648683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd0c0b2250 0x7fcd0c157ca0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.506+0000 7fcd136b4640 1 -- 172.21.15.77:0/1724648683 >> 172.21.15.77:0/1724648683 conn(0x7fcd0c06a920 msgr2=0x7fcd0c159b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:27.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.506+0000 7fcd136b4640 1 -- 172.21.15.77:0/1724648683 shutdown_connections 2023-11-26T07:21:27.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:24.506+0000 7fcd136b4640 1 -- 172.21.15.77:0/1724648683 wait complete. 2023-11-26T07:21:27.506 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:27.553 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:21:27.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.755+0000 7f9f95b47640 1 Processor -- start 2023-11-26T07:21:27.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.756+0000 7f9f95b47640 1 -- start start 2023-11-26T07:21:27.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.757+0000 7f9f95b47640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9f9015c410 0x7f9f9015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.757+0000 7f9f95b47640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9015bf80 con 0x7f9f90144b30 2023-11-26T07:21:27.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.757+0000 7f9f95b47640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f900b1560 con 0x7f9f900b1de0 2023-11-26T07:21:27.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.757+0000 7f9f95b47640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f900b1280 con 0x7f9f9015c410 2023-11-26T07:21:27.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.757+0000 7f9f94b45640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9f90144b30 0x7f9f900b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33372/0 (socket says 172.21.15.77:33372) 2023-11-26T07:21:27.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.758+0000 7f9f94b45640 1 -- 172.21.15.77:0/3177868557 learned_addr learned my addr 172.21.15.77:0/3177868557 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:27.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.758+0000 7f9f8ffff640 1 --2- 172.21.15.77:0/3177868557 >> v2:172.21.15.77:3300/0 conn(0x7f9f9015c410 0x7f9f9015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.758+0000 7f9f8ffff640 1 -- 172.21.15.77:0/3177868557 >> v1:172.21.15.159:6789/0 conn(0x7f9f900b1de0 legacy=0x7f9f900b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:27.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.758+0000 7f9f8ffff640 1 -- 172.21.15.77:0/3177868557 >> v1:172.21.15.77:6789/0 conn(0x7f9f90144b30 legacy=0x7f9f900b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.758+0000 7f9f8ffff640 1 -- 172.21.15.77:0/3177868557 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9015b930 con 0x7f9f9015c410 2023-11-26T07:21:27.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.758+0000 7f9f8f7fe640 1 -- 172.21.15.77:0/3177868557 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535446033 0 0) 0x7f9f9015bf80 con 0x7f9f90144b30 2023-11-26T07:21:27.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.759+0000 7f9f8ffff640 1 --2- 172.21.15.77:0/3177868557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9015c410 0x7f9f9015f920 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0097a0 tx=0x7f9f7c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ede1b48f455625 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:27.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.760+0000 7f9f8f7fe640 1 -- 172.21.15.77:0/3177868557 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c031830 con 0x7f9f9015c410 2023-11-26T07:21:27.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.760+0000 7f9f8f7fe640 1 -- 172.21.15.77:0/3177868557 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c031990 con 0x7f9f9015c410 2023-11-26T07:21:27.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.760+0000 7f9f8f7fe640 1 -- 172.21.15.77:0/3177868557 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c031d20 con 0x7f9f9015c410 2023-11-26T07:21:27.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.760+0000 7f9f95b47640 1 -- 172.21.15.77:0/3177868557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9015c410 msgr2=0x7f9f9015f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.760+0000 7f9f95b47640 1 --2- 172.21.15.77:0/3177868557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9015c410 0x7f9f9015f920 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0097a0 tx=0x7f9f7c02b8d0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.760+0000 7f9f95b47640 1 -- 172.21.15.77:0/3177868557 shutdown_connections 2023-11-26T07:21:27.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.760+0000 7f9f95b47640 1 --2- 172.21.15.77:0/3177868557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f9015c410 0x7f9f9015f920 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.760+0000 7f9f95b47640 1 -- 172.21.15.77:0/3177868557 >> 172.21.15.77:0/3177868557 conn(0x7f9f900cb830 msgr2=0x7f9f900cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:27.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.760+0000 7f9f95b47640 1 -- 172.21.15.77:0/3177868557 shutdown_connections 2023-11-26T07:21:27.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.760+0000 7f9f95b47640 1 -- 172.21.15.77:0/3177868557 wait complete. 2023-11-26T07:21:27.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.762+0000 7f9f95b47640 1 Processor -- start 2023-11-26T07:21:27.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.762+0000 7f9f95b47640 1 -- start start 2023-11-26T07:21:27.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.763+0000 7f9f95b47640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900b1de0 0x7f9f9015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.763+0000 7f9f95b47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f90144b30 0x7f9f9013f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.763+0000 7f9f95b47640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f9015c410 0x7f9f9013fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.763+0000 7f9f95b47640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9012e040 con 0x7f9f90144b30 2023-11-26T07:21:27.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.763+0000 7f9f95b47640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f901f2d40 con 0x7f9f900b1de0 2023-11-26T07:21:27.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.763+0000 7f9f95b47640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f901f3020 con 0x7f9f9015c410 2023-11-26T07:21:27.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.763+0000 7f9f8ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f90144b30 0x7f9f9013f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.764+0000 7f9f8ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f90144b30 0x7f9f9013f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54808/0 (socket says 172.21.15.77:54808) 2023-11-26T07:21:27.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.764+0000 7f9f8ffff640 1 -- 172.21.15.77:0/1323307469 learned_addr learned my addr 172.21.15.77:0/1323307469 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.764+0000 7f9f8ffff640 1 -- 172.21.15.77:0/1323307469 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f9015c410 msgr2=0x7f9f9013fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.764+0000 7f9f8ffff640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f9015c410 0x7f9f9013fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.764+0000 7f9f8ffff640 1 -- 172.21.15.77:0/1323307469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900b1de0 msgr2=0x7f9f9015a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.764+0000 7f9f94b45640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900b1de0 0x7f9f9015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.764+0000 7f9f8ffff640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900b1de0 0x7f9f9015a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.764+0000 7f9f8ffff640 1 -- 172.21.15.77:0/1323307469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009400 con 0x7f9f90144b30 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.764+0000 7f9f8ffff640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f90144b30 0x7f9f9013f8d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0098c0 tx=0x7f9f7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.765+0000 7f9f8d7fa640 1 -- 172.21.15.77:0/1323307469 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c03ba70 con 0x7f9f90144b30 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.765+0000 7f9f8d7fa640 1 -- 172.21.15.77:0/1323307469 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c03bbf0 con 0x7f9f90144b30 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.765+0000 7f9f8d7fa640 1 -- 172.21.15.77:0/1323307469 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0453f0 con 0x7f9f90144b30 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.765+0000 7f9f95b47640 1 -- 172.21.15.77:0/1323307469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f901f3300 con 0x7f9f90144b30 2023-11-26T07:21:27.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.765+0000 7f9f95b47640 1 -- 172.21.15.77:0/1323307469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f901f3b00 con 0x7f9f90144b30 2023-11-26T07:21:27.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.766+0000 7f9f95b47640 1 -- 172.21.15.77:0/1323307469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f901f3820 con 0x7f9f90144b30 2023-11-26T07:21:27.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.767+0000 7f9f8d7fa640 1 -- 172.21.15.77:0/1323307469 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f9f7c04e450 con 0x7f9f90144b30 2023-11-26T07:21:27.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.768+0000 7f9f8d7fa640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f7406b3e0 0x7f9f7406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.768+0000 7f9f8d7fa640 1 -- 172.21.15.77:0/1323307469 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9f7c0ac490 con 0x7f9f90144b30 2023-11-26T07:21:27.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.768+0000 7f9f94b45640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f7406b3e0 0x7f9f7406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.769+0000 7f9f94b45640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f7406b3e0 0x7f9f7406d8a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000f60 tx=0x7f9f84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:27.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.773+0000 7f9f8d7fa640 1 -- 172.21.15.77:0/1323307469 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f901f3820 con 0x7f9f90144b30 2023-11-26T07:21:27.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.966+0000 7f9f95b47640 1 -- 172.21.15.77:0/1323307469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f901f3820 con 0x7f9f90144b30 2023-11-26T07:21:27.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.968+0000 7f9f8d7fa640 1 -- 172.21.15.77:0/1323307469 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16706 (secure 0 0 0) 0x7f9f901f3820 con 0x7f9f90144b30 2023-11-26T07:21:27.970 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:27.970 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":51,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:21:20.690555+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:14.223705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:15.435670+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:27.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.971+0000 7f9f95b47640 1 -- 172.21.15.77:0/1323307469 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f7406b3e0 msgr2=0x7f9f7406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.971+0000 7f9f95b47640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f7406b3e0 0x7f9f7406d8a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000f60 tx=0x7f9f84009040 comp rx=0 tx=0).stop 2023-11-26T07:21:27.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.971+0000 7f9f95b47640 1 -- 172.21.15.77:0/1323307469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f90144b30 msgr2=0x7f9f9013f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.971+0000 7f9f95b47640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f90144b30 0x7f9f9013f8d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0098c0 tx=0x7f9f7c0046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.971+0000 7f9f95b47640 1 -- 172.21.15.77:0/1323307469 shutdown_connections 2023-11-26T07:21:27.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.971+0000 7f9f95b47640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9f7406b3e0 0x7f9f7406d8a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.971+0000 7f9f95b47640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f9015c410 0x7f9f9013fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.971+0000 7f9f95b47640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f90144b30 0x7f9f9013f8d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.971+0000 7f9f95b47640 1 --2- 172.21.15.77:0/1323307469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900b1de0 0x7f9f9015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.971+0000 7f9f95b47640 1 -- 172.21.15.77:0/1323307469 >> 172.21.15.77:0/1323307469 conn(0x7f9f900cb830 msgr2=0x7f9f900722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:27.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.972+0000 7f9f95b47640 1 -- 172.21.15.77:0/1323307469 shutdown_connections 2023-11-26T07:21:27.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:27.972+0000 7f9f95b47640 1 -- 172.21.15.77:0/1323307469 wait complete. 2023-11-26T07:21:27.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:21:28.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.202+0000 7f855b82d640 1 Processor -- start 2023-11-26T07:21:28.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.202+0000 7f855b82d640 1 -- start start 2023-11-26T07:21:28.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.204+0000 7f855b82d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85540ccbd0 0x7f85541660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.204+0000 7f855b82d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85541655f0 con 0x7f85540ccfb0 2023-11-26T07:21:28.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.204+0000 7f855b82d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540cc380 con 0x7f85540c9650 2023-11-26T07:21:28.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.204+0000 7f855b82d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8554162b30 con 0x7f85540ccbd0 2023-11-26T07:21:28.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.204+0000 7f8558dc8640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f85540ccfb0 0x7f8554162000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33380/0 (socket says 172.21.15.77:33380) 2023-11-26T07:21:28.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.204+0000 7f8558dc8640 1 -- 172.21.15.77:0/2800075282 learned_addr learned my addr 172.21.15.77:0/2800075282 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:28.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f85595c9640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85540ccbd0 0x7f85541660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983554574 0 0) 0x7f85541655f0 con 0x7f85540ccfb0 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8540003520 con 0x7f85540ccfb0 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 537058888 0 0) 0x7f8540003520 con 0x7f85540ccfb0 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85540ccbd0 msgr2=0x7f85541660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85540ccbd0 0x7f85541660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 >> v1:172.21.15.159:6789/0 conn(0x7f85540c9650 legacy=0x7f85540c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554162e10 con 0x7f85540ccfb0 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f8544001670 con 0x7f85540ccfb0 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 >> v1:172.21.15.77:6789/0 conn(0x7f85540ccfb0 legacy=0x7f8554162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85540ccbd0 0x7f85400039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8540003f20 0x7f85400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8540004d00 0x7f8540005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554162b30 con 0x7f8540004d00 2023-11-26T07:21:28.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854000ba60 con 0x7f8540003f20 2023-11-26T07:21:28.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.205+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854000bc20 con 0x7f85540ccbd0 2023-11-26T07:21:28.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.206+0000 7f8559dca640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8540004d00 0x7f8540005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.206+0000 7f85595c9640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85540ccbd0 0x7f85400039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.206+0000 7f8558dc8640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8540003f20 0x7f85400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.206+0000 7f8559dca640 1 -- 172.21.15.77:0/2800075282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85540ccbd0 msgr2=0x7f85400039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:28.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.206+0000 7f8559dca640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85540ccbd0 0x7f85400039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.206+0000 7f8559dca640 1 -- 172.21.15.77:0/2800075282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8540003f20 msgr2=0x7f85400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:28.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.206+0000 7f8559dca640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8540003f20 0x7f85400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.206+0000 7f8559dca640 1 -- 172.21.15.77:0/2800075282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8540003520 con 0x7f8540004d00 2023-11-26T07:21:28.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.208+0000 7f8559dca640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8540004d00 0x7f8540005180 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f854c001e50 tx=0x7f85400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe92dc2a3d5d7e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.208+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c003b70 con 0x7f8540004d00 2023-11-26T07:21:28.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.208+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c003cd0 con 0x7f8540004d00 2023-11-26T07:21:28.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.208+0000 7f854bfff640 1 -- 172.21.15.77:0/2800075282 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c005310 con 0x7f8540004d00 2023-11-26T07:21:28.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.208+0000 7f855b82d640 1 -- 172.21.15.77:0/2800075282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8540004d00 msgr2=0x7f8540005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.208+0000 7f855b82d640 1 --2- 172.21.15.77:0/2800075282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8540004d00 0x7f8540005180 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f854c001e50 tx=0x7f85400057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.208+0000 7f8559dca640 1 -- 172.21.15.77:0/2800075282 reap_dead start 2023-11-26T07:21:28.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.209+0000 7f855b82d640 1 -- 172.21.15.77:0/2800075282 shutdown_connections 2023-11-26T07:21:28.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.209+0000 7f855b82d640 1 -- 172.21.15.77:0/2800075282 >> 172.21.15.77:0/2800075282 conn(0x7f85540b0c50 msgr2=0x7f85540b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:28.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.209+0000 7f855b82d640 1 -- 172.21.15.77:0/2800075282 shutdown_connections 2023-11-26T07:21:28.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.209+0000 7f855b82d640 1 -- 172.21.15.77:0/2800075282 wait complete. 2023-11-26T07:21:28.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.210+0000 7f855b82d640 1 Processor -- start 2023-11-26T07:21:28.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.211+0000 7f855b82d640 1 -- start start 2023-11-26T07:21:28.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.211+0000 7f855b82d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8554158080 0x7f8554165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f855b82d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540c6e00 0x7f85540ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f855b82d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85540c7800 0x7f85540c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f855b82d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540c8cd0 con 0x7f85540c6e00 2023-11-26T07:21:28.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f855b82d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540c81c0 con 0x7f85540c7800 2023-11-26T07:21:28.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f855b82d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540c60d0 con 0x7f8554158080 2023-11-26T07:21:28.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f8558dc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540c6e00 0x7f85540ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f8558dc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540c6e00 0x7f85540ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54818/0 (socket says 172.21.15.77:54818) 2023-11-26T07:21:28.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f8558dc8640 1 -- 172.21.15.77:0/3443570001 learned_addr learned my addr 172.21.15.77:0/3443570001 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:28.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f8558dc8640 1 -- 172.21.15.77:0/3443570001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8554158080 msgr2=0x7f8554165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f8558dc8640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8554158080 0x7f8554165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f8558dc8640 1 -- 172.21.15.77:0/3443570001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85540c7800 msgr2=0x7f85540c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f8558dc8640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85540c7800 0x7f85540c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.212+0000 7f8558dc8640 1 -- 172.21.15.77:0/3443570001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540adea0 con 0x7f85540c6e00 2023-11-26T07:21:28.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.213+0000 7f8558dc8640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540c6e00 0x7f85540ad650 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f854400eaf0 tx=0x7f8544001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.213+0000 7f8549ffb640 1 -- 172.21.15.77:0/3443570001 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400c8b0 con 0x7f85540c6e00 2023-11-26T07:21:28.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.213+0000 7f8549ffb640 1 -- 172.21.15.77:0/3443570001 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854400ca10 con 0x7f85540c6e00 2023-11-26T07:21:28.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.213+0000 7f855b82d640 1 -- 172.21.15.77:0/3443570001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85540c6320 con 0x7f85540c6e00 2023-11-26T07:21:28.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.213+0000 7f8549ffb640 1 -- 172.21.15.77:0/3443570001 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400cdc0 con 0x7f85540c6e00 2023-11-26T07:21:28.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.213+0000 7f855b82d640 1 -- 172.21.15.77:0/3443570001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85540c68e0 con 0x7f85540c6e00 2023-11-26T07:21:28.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.214+0000 7f855b82d640 1 -- 172.21.15.77:0/3443570001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855404e8b0 con 0x7f85540c6e00 2023-11-26T07:21:28.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.215+0000 7f8549ffb640 1 -- 172.21.15.77:0/3443570001 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f854401d460 con 0x7f85540c6e00 2023-11-26T07:21:28.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.216+0000 7f8549ffb640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f853806b410 0x7f853806d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.216+0000 7f8549ffb640 1 -- 172.21.15.77:0/3443570001 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f854408a100 con 0x7f85540c6e00 2023-11-26T07:21:28.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.216+0000 7f85595c9640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f853806b410 0x7f853806d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.217+0000 7f85595c9640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f853806b410 0x7f853806d8d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8550009910 tx=0x7f8550008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.220+0000 7f8549ffb640 1 -- 172.21.15.77:0/3443570001 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85440bce90 con 0x7f85540c6e00 2023-11-26T07:21:28.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.447+0000 7f855b82d640 1 -- 172.21.15.77:0/3443570001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f855412c1b0 con 0x7f85540c6e00 2023-11-26T07:21:28.450 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-26T07:21:28.448+0000 7f36d32f9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:21:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.452+0000 7f8549ffb640 1 -- 172.21.15.77:0/3443570001 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7f85440548a0 con 0x7f85540c6e00 2023-11-26T07:21:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:21:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.455+0000 7f855b82d640 1 -- 172.21.15.77:0/3443570001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f853806b410 msgr2=0x7f853806d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.455+0000 7f855b82d640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f853806b410 0x7f853806d8d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8550009910 tx=0x7f8550008040 comp rx=0 tx=0).stop 2023-11-26T07:21:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.455+0000 7f855b82d640 1 -- 172.21.15.77:0/3443570001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540c6e00 msgr2=0x7f85540ad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.455+0000 7f855b82d640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540c6e00 0x7f85540ad650 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f854400eaf0 tx=0x7f8544001700 comp rx=0 tx=0).stop 2023-11-26T07:21:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.455+0000 7f855b82d640 1 -- 172.21.15.77:0/3443570001 shutdown_connections 2023-11-26T07:21:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.455+0000 7f855b82d640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f853806b410 0x7f853806d8d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.456+0000 7f855b82d640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85540c7800 0x7f85540c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.456+0000 7f855b82d640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540c6e00 0x7f85540ad650 secure :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f854400eaf0 tx=0x7f8544001700 comp rx=0 tx=0).stop 2023-11-26T07:21:28.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.456+0000 7f855b82d640 1 --2- 172.21.15.77:0/3443570001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8554158080 0x7f8554165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.456+0000 7f855b82d640 1 -- 172.21.15.77:0/3443570001 >> 172.21.15.77:0/3443570001 conn(0x7f85540b0c50 msgr2=0x7f85540704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:28.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.457+0000 7f855b82d640 1 -- 172.21.15.77:0/3443570001 shutdown_connections 2023-11-26T07:21:28.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.457+0000 7f855b82d640 1 -- 172.21.15.77:0/3443570001 wait complete. 2023-11-26T07:21:28.477 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:21:28.570 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-26T07:21:28.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.680+0000 7f7447333640 1 Processor -- start 2023-11-26T07:21:28.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.680+0000 7f7447333640 1 -- start start 2023-11-26T07:21:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.682+0000 7f7447333640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7440072160 0x7f744015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.682+0000 7f7447333640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74400c49f0 0x7f744006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.682+0000 7f7447333640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744015ec90 con 0x7f744006dc40 2023-11-26T07:21:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.682+0000 7f7447333640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744006e0f0 con 0x7f74400c49f0 2023-11-26T07:21:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.682+0000 7f7447333640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74400cd530 con 0x7f7440072160 2023-11-26T07:21:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.682+0000 7f74448ce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74400c49f0 0x7f744006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.682+0000 7f74448ce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74400c49f0 0x7f744006d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54834/0 (socket says 172.21.15.77:54834) 2023-11-26T07:21:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.682+0000 7f74448ce640 1 -- 172.21.15.77:0/3017448441 learned_addr learned my addr 172.21.15.77:0/3017448441 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.682+0000 7f74450cf640 1 --2- 172.21.15.77:0/3017448441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7440072160 0x7f744015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.682+0000 7f74448ce640 1 -- 172.21.15.77:0/3017448441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7440072160 msgr2=0x7f744015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.683+0000 7f74448ce640 1 --2- 172.21.15.77:0/3017448441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7440072160 0x7f744015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.683+0000 7f74448ce640 1 -- 172.21.15.77:0/3017448441 >> v1:172.21.15.77:6789/0 conn(0x7f744006dc40 legacy=0x7f74400cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.683+0000 7f74448ce640 1 -- 172.21.15.77:0/3017448441 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74400c4ed0 con 0x7f74400c49f0 2023-11-26T07:21:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.683+0000 7f7437fff640 1 -- 172.21.15.77:0/3017448441 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619954792 0 0) 0x7f7438001490 con 0x7f744006dc40 2023-11-26T07:21:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.684+0000 7f74448ce640 1 --2- 172.21.15.77:0/3017448441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400c49f0 0x7f744006d700 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f743000bb10 tx=0x7f743002e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea72fd1c9cc9963 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.684+0000 7f7437fff640 1 -- 172.21.15.77:0/3017448441 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430036440 con 0x7f74400c49f0 2023-11-26T07:21:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.684+0000 7f7437fff640 1 -- 172.21.15.77:0/3017448441 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74300365a0 con 0x7f74400c49f0 2023-11-26T07:21:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.684+0000 7f7437fff640 1 -- 172.21.15.77:0/3017448441 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430036930 con 0x7f74400c49f0 2023-11-26T07:21:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.684+0000 7f7447333640 1 -- 172.21.15.77:0/3017448441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400c49f0 msgr2=0x7f744006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.684+0000 7f7447333640 1 --2- 172.21.15.77:0/3017448441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400c49f0 0x7f744006d700 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f743000bb10 tx=0x7f743002e150 comp rx=0 tx=0).stop 2023-11-26T07:21:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.685+0000 7f7447333640 1 -- 172.21.15.77:0/3017448441 shutdown_connections 2023-11-26T07:21:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.685+0000 7f7447333640 1 --2- 172.21.15.77:0/3017448441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400c49f0 0x7f744006d700 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.685+0000 7f7447333640 1 --2- 172.21.15.77:0/3017448441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7440072160 0x7f744015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.685+0000 7f7447333640 1 -- 172.21.15.77:0/3017448441 >> 172.21.15.77:0/3017448441 conn(0x7f74400b0c50 msgr2=0x7f74400b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.685+0000 7f7447333640 1 -- 172.21.15.77:0/3017448441 shutdown_connections 2023-11-26T07:21:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.685+0000 7f7447333640 1 -- 172.21.15.77:0/3017448441 wait complete. 2023-11-26T07:21:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.686+0000 7f7447333640 1 Processor -- start 2023-11-26T07:21:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.686+0000 7f7447333640 1 -- start start 2023-11-26T07:21:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.687+0000 7f7447333640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f744006dc40 0x7f74401e6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.687+0000 7f7447333640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7440072160 0x7f74400cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.687+0000 7f7447333640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74400c49f0 0x7f74400cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.687+0000 7f7447333640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74401e65d0 con 0x7f744006dc40 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.687+0000 7f7447333640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744009a530 con 0x7f7440072160 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.687+0000 7f7447333640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744015cd60 con 0x7f74400c49f0 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.688+0000 7f74450cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f744006dc40 0x7f74401e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.688+0000 7f74450cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f744006dc40 0x7f74401e6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54840/0 (socket says 172.21.15.77:54840) 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.688+0000 7f74450cf640 1 -- 172.21.15.77:0/4107389955 learned_addr learned my addr 172.21.15.77:0/4107389955 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.688+0000 7f74450cf640 1 -- 172.21.15.77:0/4107389955 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74400c49f0 msgr2=0x7f74400cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.688+0000 7f74450cf640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74400c49f0 0x7f74400cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.688+0000 7f74450cf640 1 -- 172.21.15.77:0/4107389955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7440072160 msgr2=0x7f74400cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.688+0000 7f74450cf640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7440072160 0x7f74400cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.688+0000 7f74450cf640 1 -- 172.21.15.77:0/4107389955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743000b770 con 0x7f744006dc40 2023-11-26T07:21:28.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.688+0000 7f74450cf640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f744006dc40 0x7f74401e6090 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f743c00d800 tx=0x7f743c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.689+0000 7f7435ffb640 1 -- 172.21.15.77:0/4107389955 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c00b6c0 con 0x7f744006dc40 2023-11-26T07:21:28.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.689+0000 7f7435ffb640 1 -- 172.21.15.77:0/4107389955 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c00b820 con 0x7f744006dc40 2023-11-26T07:21:28.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.689+0000 7f7447333640 1 -- 172.21.15.77:0/4107389955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74401e4f90 con 0x7f744006dc40 2023-11-26T07:21:28.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.689+0000 7f7435ffb640 1 -- 172.21.15.77:0/4107389955 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c00bbb0 con 0x7f744006dc40 2023-11-26T07:21:28.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.689+0000 7f7447333640 1 -- 172.21.15.77:0/4107389955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74401e5550 con 0x7f744006dc40 2023-11-26T07:21:28.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.690+0000 7f7447333640 1 -- 172.21.15.77:0/4107389955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744004e8b0 con 0x7f744006dc40 2023-11-26T07:21:28.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.691+0000 7f7435ffb640 1 -- 172.21.15.77:0/4107389955 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f743c00bd10 con 0x7f744006dc40 2023-11-26T07:21:28.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.692+0000 7f7435ffb640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b410 0x7f742406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.692+0000 7f7435ffb640 1 -- 172.21.15.77:0/4107389955 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f743c08a630 con 0x7f744006dc40 2023-11-26T07:21:28.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.692+0000 7f74448ce640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b410 0x7f742406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.693+0000 7f74448ce640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b410 0x7f742406d8d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7430038000 tx=0x7f7430030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.696+0000 7f7435ffb640 1 -- 172.21.15.77:0/4107389955 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f743c054de0 con 0x7f744006dc40 2023-11-26T07:21:28.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:28.925+0000 7f7447333640 1 -- 172.21.15.77:0/4107389955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f74401e6750 con 0x7f744006dc40 2023-11-26T07:21:29.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.456+0000 7f7435ffb640 1 -- 172.21.15.77:0/4107389955 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f743c058400 con 0x7f744006dc40 2023-11-26T07:21:29.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.459+0000 7f7447333640 1 -- 172.21.15.77:0/4107389955 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b410 msgr2=0x7f742406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.459+0000 7f7447333640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b410 0x7f742406d8d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7430038000 tx=0x7f7430030000 comp rx=0 tx=0).stop 2023-11-26T07:21:29.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.459+0000 7f7447333640 1 -- 172.21.15.77:0/4107389955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f744006dc40 msgr2=0x7f74401e6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.459+0000 7f7447333640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f744006dc40 0x7f74401e6090 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f743c00d800 tx=0x7f743c00dcc0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.459+0000 7f7447333640 1 -- 172.21.15.77:0/4107389955 shutdown_connections 2023-11-26T07:21:29.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.459+0000 7f7447333640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b410 0x7f742406d8d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.459+0000 7f7447333640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74400c49f0 0x7f74400cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.459+0000 7f7447333640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7440072160 0x7f74400cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.459+0000 7f7447333640 1 --2- 172.21.15.77:0/4107389955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f744006dc40 0x7f74401e6090 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.459+0000 7f7447333640 1 -- 172.21.15.77:0/4107389955 >> 172.21.15.77:0/4107389955 conn(0x7f74400b0c50 msgr2=0x7f74400cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:29.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.460+0000 7f7447333640 1 -- 172.21.15.77:0/4107389955 shutdown_connections 2023-11-26T07:21:29.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.460+0000 7f7447333640 1 -- 172.21.15.77:0/4107389955 wait complete. 2023-11-26T07:21:29.481 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:21:29.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.687+0000 7f9c09541640 1 Processor -- start 2023-11-26T07:21:29.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.687+0000 7f9c09541640 1 -- start start 2023-11-26T07:21:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c09541640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c040b2250 0x7f9c0415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c09541640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c040b2aa0 0x7f9c0415b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c09541640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0415ab80 con 0x7f9c040b2630 2023-11-26T07:21:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c09541640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0415a990 con 0x7f9c040b2250 2023-11-26T07:21:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c09541640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0415e680 con 0x7f9c040b2aa0 2023-11-26T07:21:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c02ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c040b2250 0x7f9c0415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c02ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c040b2250 0x7f9c0415df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54844/0 (socket says 172.21.15.77:54844) 2023-11-26T07:21:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c02ffd640 1 -- 172.21.15.77:0/2603680940 learned_addr learned my addr 172.21.15.77:0/2603680940 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c02ffd640 1 -- 172.21.15.77:0/2603680940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c040b2aa0 msgr2=0x7f9c0415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c037fe640 1 --2- 172.21.15.77:0/2603680940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c040b2aa0 0x7f9c0415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c02ffd640 1 --2- 172.21.15.77:0/2603680940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c040b2aa0 0x7f9c0415b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.689+0000 7f9c02ffd640 1 -- 172.21.15.77:0/2603680940 >> v1:172.21.15.159:6789/0 conn(0x7f9c040b2630 legacy=0x7f9c040ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:29.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.690+0000 7f9c02ffd640 1 -- 172.21.15.77:0/2603680940 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0415e960 con 0x7f9c040b2250 2023-11-26T07:21:29.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.691+0000 7f9c02ffd640 1 --2- 172.21.15.77:0/2603680940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c040b2250 0x7f9c0415df80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009870 tx=0x7f9bf402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779be44a58e3dff8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:29.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.691+0000 7f9c01ffb640 1 -- 172.21.15.77:0/2603680940 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4031640 con 0x7f9c040b2250 2023-11-26T07:21:29.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.691+0000 7f9c01ffb640 1 -- 172.21.15.77:0/2603680940 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf40317a0 con 0x7f9c040b2250 2023-11-26T07:21:29.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.691+0000 7f9c01ffb640 1 -- 172.21.15.77:0/2603680940 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4031b30 con 0x7f9c040b2250 2023-11-26T07:21:29.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.691+0000 7f9c09541640 1 -- 172.21.15.77:0/2603680940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c040b2250 msgr2=0x7f9c0415df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.691+0000 7f9c09541640 1 --2- 172.21.15.77:0/2603680940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c040b2250 0x7f9c0415df80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009870 tx=0x7f9bf402b8f0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.692+0000 7f9c09541640 1 -- 172.21.15.77:0/2603680940 shutdown_connections 2023-11-26T07:21:29.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.692+0000 7f9c09541640 1 --2- 172.21.15.77:0/2603680940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c040b2aa0 0x7f9c0415b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.692+0000 7f9c09541640 1 --2- 172.21.15.77:0/2603680940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c040b2250 0x7f9c0415df80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.692+0000 7f9c09541640 1 -- 172.21.15.77:0/2603680940 >> 172.21.15.77:0/2603680940 conn(0x7f9c0406a920 msgr2=0x7f9c0406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:29.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.692+0000 7f9c09541640 1 -- 172.21.15.77:0/2603680940 shutdown_connections 2023-11-26T07:21:29.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.692+0000 7f9c09541640 1 -- 172.21.15.77:0/2603680940 wait complete. 2023-11-26T07:21:29.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.693+0000 7f9c09541640 1 Processor -- start 2023-11-26T07:21:29.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.694+0000 7f9c09541640 1 -- start start 2023-11-26T07:21:29.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.694+0000 7f9c09541640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c040b2250 0x7f9c04147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.694+0000 7f9c09541640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c040b2630 0x7f9c040c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c09541640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c040b2aa0 0x7f9c040c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c09541640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04071730 con 0x7f9c040b2250 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c09541640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04071a10 con 0x7f9c040b2630 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c09541640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04071cf0 con 0x7f9c040b2aa0 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c02ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c040b2250 0x7f9c04147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c02ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c040b2250 0x7f9c04147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54852/0 (socket says 172.21.15.77:54852) 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c02ffd640 1 -- 172.21.15.77:0/12270199 learned_addr learned my addr 172.21.15.77:0/12270199 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c027fc640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c040b2630 0x7f9c040c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c02ffd640 1 -- 172.21.15.77:0/12270199 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c040b2aa0 msgr2=0x7f9c040c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c02ffd640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c040b2aa0 0x7f9c040c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c02ffd640 1 -- 172.21.15.77:0/12270199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c040b2630 msgr2=0x7f9c040c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c02ffd640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c040b2630 0x7f9c040c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c02ffd640 1 -- 172.21.15.77:0/12270199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40094d0 con 0x7f9c040b2250 2023-11-26T07:21:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.695+0000 7f9c027fc640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c040b2630 0x7f9c040c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.696+0000 7f9c02ffd640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c040b2250 0x7f9c04147320 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009870 tx=0x7f9bf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.696+0000 7f9beb7fe640 1 -- 172.21.15.77:0/12270199 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf403ac60 con 0x7f9c040b2250 2023-11-26T07:21:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.696+0000 7f9beb7fe640 1 -- 172.21.15.77:0/12270199 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf403ade0 con 0x7f9c040b2250 2023-11-26T07:21:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.696+0000 7f9beb7fe640 1 -- 172.21.15.77:0/12270199 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4044630 con 0x7f9c040b2250 2023-11-26T07:21:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.696+0000 7f9c09541640 1 -- 172.21.15.77:0/12270199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c040cd7c0 con 0x7f9c040b2250 2023-11-26T07:21:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.696+0000 7f9c09541640 1 -- 172.21.15.77:0/12270199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c040722b0 con 0x7f9c040b2250 2023-11-26T07:21:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.697+0000 7f9c09541640 1 -- 172.21.15.77:0/12270199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c040af180 con 0x7f9c040b2250 2023-11-26T07:21:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.698+0000 7f9beb7fe640 1 -- 172.21.15.77:0/12270199 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f9bf402f050 con 0x7f9c040b2250 2023-11-26T07:21:29.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.699+0000 7f9beb7fe640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bf006b3e0 0x7f9bf006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.699+0000 7f9beb7fe640 1 -- 172.21.15.77:0/12270199 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9bf40ac3e0 con 0x7f9c040b2250 2023-11-26T07:21:29.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.699+0000 7f9c027fc640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bf006b3e0 0x7f9bf006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.700+0000 7f9c027fc640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bf006b3e0 0x7f9bf006d8a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9c040b3220 tx=0x7f9bf8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:29.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.703+0000 7f9beb7fe640 1 -- 172.21.15.77:0/12270199 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9bf4076a40 con 0x7f9c040b2250 2023-11-26T07:21:29.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:29.895+0000 7f9c09541640 1 -- 172.21.15.77:0/12270199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9c04067470 con 0x7f9c040b2250 2023-11-26T07:21:30.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.716+0000 7f9beb7fe640 1 -- 172.21.15.77:0/12270199 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9bf407a060 con 0x7f9c040b2250 2023-11-26T07:21:30.719 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:21:30.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.721+0000 7f9c09541640 1 -- 172.21.15.77:0/12270199 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bf006b3e0 msgr2=0x7f9bf006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.721+0000 7f9c09541640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bf006b3e0 0x7f9bf006d8a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9c040b3220 tx=0x7f9bf8009040 comp rx=0 tx=0).stop 2023-11-26T07:21:30.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.721+0000 7f9c09541640 1 -- 172.21.15.77:0/12270199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c040b2250 msgr2=0x7f9c04147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.721+0000 7f9c09541640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c040b2250 0x7f9c04147320 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009870 tx=0x7f9bf40046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.721+0000 7f9c09541640 1 -- 172.21.15.77:0/12270199 shutdown_connections 2023-11-26T07:21:30.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.721+0000 7f9c09541640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9bf006b3e0 0x7f9bf006d8a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.721+0000 7f9c09541640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c040b2aa0 0x7f9c040c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.721+0000 7f9c09541640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c040b2630 0x7f9c040c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.721+0000 7f9c09541640 1 --2- 172.21.15.77:0/12270199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c040b2250 0x7f9c04147320 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.721+0000 7f9c09541640 1 -- 172.21.15.77:0/12270199 >> 172.21.15.77:0/12270199 conn(0x7f9c0406a920 msgr2=0x7f9c040ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:30.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.722+0000 7f9c09541640 1 -- 172.21.15.77:0/12270199 shutdown_connections 2023-11-26T07:21:30.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.722+0000 7f9c09541640 1 -- 172.21.15.77:0/12270199 wait complete. 2023-11-26T07:21:30.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:21:30.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.962+0000 7fc7cefc9640 1 Processor -- start 2023-11-26T07:21:30.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.963+0000 7fc7cefc9640 1 -- start start 2023-11-26T07:21:30.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.964+0000 7fc7cefc9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8160b00 0x7fc7c80d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.964+0000 7fc7cefc9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc7c80d02f0 0x7fc7c815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.964+0000 7fc7cefc9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c815ea30 con 0x7fc7c80d12e0 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.964+0000 7fc7cefc9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c815de20 con 0x7fc7c80d02f0 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.964+0000 7fc7cefc9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c815e100 con 0x7fc7c8160b00 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.964+0000 7fc7cd7c6640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc7c80d12e0 0x7fc7c80cfbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33418/0 (socket says 172.21.15.77:33418) 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.964+0000 7fc7cd7c6640 1 -- 172.21.15.77:0/2269475632 learned_addr learned my addr 172.21.15.77:0/2269475632 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7cdfc7640 1 --2- 172.21.15.77:0/2269475632 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8160b00 0x7fc7c80d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ce7c8640 1 --2- 172.21.15.77:0/2269475632 >> v2:172.21.15.159:3300/0 conn(0x7fc7c80d02f0 0x7fc7c815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9632740 0 0) 0x7fc7c815ea30 con 0x7fc7c80d12e0 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b4003520 con 0x7fc7c80d12e0 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2592873242 0 0) 0x7fc7b4003520 con 0x7fc7c80d12e0 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8160b00 msgr2=0x7fc7c80d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 --2- 172.21.15.77:0/2269475632 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8160b00 0x7fc7c80d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 >> v2:172.21.15.159:3300/0 conn(0x7fc7c80d02f0 msgr2=0x7fc7c815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 --2- 172.21.15.77:0/2269475632 >> v2:172.21.15.159:3300/0 conn(0x7fc7c80d02f0 0x7fc7c815ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c815e3e0 con 0x7fc7c80d12e0 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fc7bc001670 con 0x7fc7c80d12e0 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 >> v1:172.21.15.77:6789/0 conn(0x7fc7c80d12e0 legacy=0x7fc7c80cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 --2- 172.21.15.77:0/2269475632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4003970 0x7fc7b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 --2- 172.21.15.77:0/2269475632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7b40047c0 0x7fc7b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 --2- 172.21.15.77:0/2269475632 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8160b00 0x7fc7b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c815de20 con 0x7fc7b4003970 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c815e100 con 0x7fc7b40047c0 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.965+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b400b980 con 0x7fc7c8160b00 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.966+0000 7fc7cdfc7640 1 --2- 172.21.15.77:0/2269475632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4003970 0x7fc7b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.966+0000 7fc7cdfc7640 1 -- 172.21.15.77:0/2269475632 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8160b00 msgr2=0x7fc7b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:30.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.966+0000 7fc7cdfc7640 1 --2- 172.21.15.77:0/2269475632 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8160b00 0x7fc7b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.966+0000 7fc7cdfc7640 1 -- 172.21.15.77:0/2269475632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7b40047c0 msgr2=0x7fc7b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:30.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.966+0000 7fc7cdfc7640 1 --2- 172.21.15.77:0/2269475632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7b40047c0 0x7fc7b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.966+0000 7fc7cdfc7640 1 -- 172.21.15.77:0/2269475632 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4003520 con 0x7fc7b4003970 2023-11-26T07:21:30.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.967+0000 7fc7cdfc7640 1 --2- 172.21.15.77:0/2269475632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4003970 0x7fc7b4003d90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009ac0 tx=0x7fc7b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd6b8ae7696836d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.967+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c402c710 con 0x7fc7b4003970 2023-11-26T07:21:30.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.967+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c402c870 con 0x7fc7b4003970 2023-11-26T07:21:30.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.967+0000 7fc7ccfc5640 1 -- 172.21.15.77:0/2269475632 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c402cc00 con 0x7fc7b4003970 2023-11-26T07:21:30.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.968+0000 7fc7cefc9640 1 -- 172.21.15.77:0/2269475632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4003970 msgr2=0x7fc7b4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.968+0000 7fc7cefc9640 1 --2- 172.21.15.77:0/2269475632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4003970 0x7fc7b4003d90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009ac0 tx=0x7fc7b40057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.968+0000 7fc7ce7c8640 1 -- 172.21.15.77:0/2269475632 reap_dead start 2023-11-26T07:21:30.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.968+0000 7fc7cefc9640 1 -- 172.21.15.77:0/2269475632 shutdown_connections 2023-11-26T07:21:30.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.968+0000 7fc7cefc9640 1 -- 172.21.15.77:0/2269475632 >> 172.21.15.77:0/2269475632 conn(0x7fc7c809c510 msgr2=0x7fc7c80d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:30.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.968+0000 7fc7cefc9640 1 -- 172.21.15.77:0/2269475632 shutdown_connections 2023-11-26T07:21:30.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.968+0000 7fc7cefc9640 1 -- 172.21.15.77:0/2269475632 wait complete. 2023-11-26T07:21:30.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.970+0000 7fc7cefc9640 1 Processor -- start 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.970+0000 7fc7cefc9640 1 -- start start 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.971+0000 7fc7cefc9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8156f10 0x7fc7c80c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.971+0000 7fc7cefc9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c81572f0 0x7fc7c80cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.971+0000 7fc7cefc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7c80cce90 0x7fc7c80b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.971+0000 7fc7cefc9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c80cc530 con 0x7fc7c80cce90 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.971+0000 7fc7cefc9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c80cb660 con 0x7fc7c81572f0 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.971+0000 7fc7cefc9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c80cb8b0 con 0x7fc7c8156f10 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.971+0000 7fc7ce7c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7c80cce90 0x7fc7c80b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.971+0000 7fc7ce7c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7c80cce90 0x7fc7c80b7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54876/0 (socket says 172.21.15.77:54876) 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.971+0000 7fc7ce7c8640 1 -- 172.21.15.77:0/1234982286 learned_addr learned my addr 172.21.15.77:0/1234982286 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.971+0000 7fc7cdfc7640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8156f10 0x7fc7c80c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.972+0000 7fc7ce7c8640 1 -- 172.21.15.77:0/1234982286 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8156f10 msgr2=0x7fc7c80c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.972+0000 7fc7ce7c8640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8156f10 0x7fc7c80c6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.972+0000 7fc7ce7c8640 1 -- 172.21.15.77:0/1234982286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c81572f0 msgr2=0x7fc7c80cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.972+0000 7fc7ce7c8640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c81572f0 0x7fc7c80cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.972+0000 7fc7ce7c8640 1 -- 172.21.15.77:0/1234982286 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c80cbb90 con 0x7fc7c80cce90 2023-11-26T07:21:30.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.972+0000 7fc7ce7c8640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7c80cce90 0x7fc7c80b7fc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc7c808c520 tx=0x7fc7c000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.972+0000 7fc7ba7fc640 1 -- 172.21.15.77:0/1234982286 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0010040 con 0x7fc7c80cce90 2023-11-26T07:21:30.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.972+0000 7fc7ba7fc640 1 -- 172.21.15.77:0/1234982286 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c000bb10 con 0x7fc7c80cce90 2023-11-26T07:21:30.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.972+0000 7fc7cefc9640 1 -- 172.21.15.77:0/1234982286 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c80cbe70 con 0x7fc7c80cce90 2023-11-26T07:21:30.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.972+0000 7fc7ba7fc640 1 -- 172.21.15.77:0/1234982286 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000bea0 con 0x7fc7c80cce90 2023-11-26T07:21:30.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.972+0000 7fc7cefc9640 1 -- 172.21.15.77:0/1234982286 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c81577d0 con 0x7fc7c80cce90 2023-11-26T07:21:30.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.973+0000 7fc7cefc9640 1 -- 172.21.15.77:0/1234982286 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c80cc670 con 0x7fc7c80cce90 2023-11-26T07:21:30.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.974+0000 7fc7ba7fc640 1 -- 172.21.15.77:0/1234982286 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fc7c001d400 con 0x7fc7c80cce90 2023-11-26T07:21:30.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.976+0000 7fc7ba7fc640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc7ac06b3e0 0x7fc7ac06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.976+0000 7fc7ba7fc640 1 -- 172.21.15.77:0/1234982286 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fc7c008a580 con 0x7fc7c80cce90 2023-11-26T07:21:30.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.976+0000 7fc7cdfc7640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc7ac06b3e0 0x7fc7ac06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.977+0000 7fc7cdfc7640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc7ac06b3e0 0x7fc7ac06d8a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4036000 tx=0x7fc7c4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:30.980+0000 7fc7ba7fc640 1 -- 172.21.15.77:0/1234982286 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7c80cc670 con 0x7fc7c80cce90 2023-11-26T07:21:31.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.171+0000 7fc7cefc9640 1 -- 172.21.15.77:0/1234982286 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7c80cc670 con 0x7fc7c80cce90 2023-11-26T07:21:31.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.726+0000 7fc7ba7fc640 1 -- 172.21.15.77:0/1234982286 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc7c80cc670 con 0x7fc7c80cce90 2023-11-26T07:21:31.729 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.731+0000 7fc7cefc9640 1 -- 172.21.15.77:0/1234982286 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc7ac06b3e0 msgr2=0x7fc7ac06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.731+0000 7fc7cefc9640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc7ac06b3e0 0x7fc7ac06d8a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4036000 tx=0x7fc7c4030000 comp rx=0 tx=0).stop 2023-11-26T07:21:31.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.731+0000 7fc7cefc9640 1 -- 172.21.15.77:0/1234982286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7c80cce90 msgr2=0x7fc7c80b7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.731+0000 7fc7cefc9640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7c80cce90 0x7fc7c80b7fc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc7c808c520 tx=0x7fc7c000b480 comp rx=0 tx=0).stop 2023-11-26T07:21:31.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.732+0000 7fc7cefc9640 1 -- 172.21.15.77:0/1234982286 shutdown_connections 2023-11-26T07:21:31.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.732+0000 7fc7cefc9640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc7ac06b3e0 0x7fc7ac06d8a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.732+0000 7fc7cefc9640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7c80cce90 0x7fc7c80b7fc0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.732+0000 7fc7cefc9640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c81572f0 0x7fc7c80cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.732+0000 7fc7cefc9640 1 --2- 172.21.15.77:0/1234982286 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c8156f10 0x7fc7c80c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.732+0000 7fc7cefc9640 1 -- 172.21.15.77:0/1234982286 >> 172.21.15.77:0/1234982286 conn(0x7fc7c809c510 msgr2=0x7fc7c80d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:31.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.732+0000 7fc7cefc9640 1 -- 172.21.15.77:0/1234982286 shutdown_connections 2023-11-26T07:21:31.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.732+0000 7fc7cefc9640 1 -- 172.21.15.77:0/1234982286 wait complete. 2023-11-26T07:21:31.758 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:21:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.960+0000 7f974ce9b640 1 Processor -- start 2023-11-26T07:21:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.960+0000 7f974ce9b640 1 -- start start 2023-11-26T07:21:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.961+0000 7f974ce9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f974806f360 0x7f97480cb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.961+0000 7f974ce9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97480ce2c0 0x7f974806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.961+0000 7f974ce9b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974806d670 con 0x7f974815d380 2023-11-26T07:21:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.961+0000 7f974ce9b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974806b980 con 0x7f974806f360 2023-11-26T07:21:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.961+0000 7f974ce9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974806bb90 con 0x7f97480ce2c0 2023-11-26T07:21:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.962+0000 7f9745d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f974806f360 0x7f97480cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.962+0000 7f9745d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f974806f360 0x7f97480cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54884/0 (socket says 172.21.15.77:54884) 2023-11-26T07:21:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.962+0000 7f9745d9b640 1 -- 172.21.15.77:0/2124719152 learned_addr learned my addr 172.21.15.77:0/2124719152 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.962+0000 7f9745d9b640 1 -- 172.21.15.77:0/2124719152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97480ce2c0 msgr2=0x7f974806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.962+0000 7f9745d9b640 1 --2- 172.21.15.77:0/2124719152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97480ce2c0 0x7f974806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.962+0000 7f9745d9b640 1 -- 172.21.15.77:0/2124719152 >> v1:172.21.15.159:6789/0 conn(0x7f974815d380 legacy=0x7f97480cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.962+0000 7f9745d9b640 1 -- 172.21.15.77:0/2124719152 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974806be70 con 0x7f974806f360 2023-11-26T07:21:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.963+0000 7f9745d9b640 1 --2- 172.21.15.77:0/2124719152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974806f360 0x7f97480cb850 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f9730009870 tx=0x7f973002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d847987d27bdbb1e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.964+0000 7f974559a640 1 -- 172.21.15.77:0/2124719152 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730031640 con 0x7f974806f360 2023-11-26T07:21:31.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.964+0000 7f974559a640 1 -- 172.21.15.77:0/2124719152 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97300317a0 con 0x7f974806f360 2023-11-26T07:21:31.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.964+0000 7f974559a640 1 -- 172.21.15.77:0/2124719152 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730031b30 con 0x7f974806f360 2023-11-26T07:21:31.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.964+0000 7f974ce9b640 1 -- 172.21.15.77:0/2124719152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974806f360 msgr2=0x7f97480cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.964+0000 7f974ce9b640 1 --2- 172.21.15.77:0/2124719152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974806f360 0x7f97480cb850 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f9730009870 tx=0x7f973002b8f0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.964+0000 7f974ce9b640 1 -- 172.21.15.77:0/2124719152 shutdown_connections 2023-11-26T07:21:31.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.964+0000 7f974ce9b640 1 --2- 172.21.15.77:0/2124719152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97480ce2c0 0x7f974806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.964+0000 7f974ce9b640 1 --2- 172.21.15.77:0/2124719152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974806f360 0x7f97480cb850 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.964+0000 7f974ce9b640 1 -- 172.21.15.77:0/2124719152 >> 172.21.15.77:0/2124719152 conn(0x7f974806e7d0 msgr2=0x7f974806ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:31.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.965+0000 7f974ce9b640 1 -- 172.21.15.77:0/2124719152 shutdown_connections 2023-11-26T07:21:31.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.965+0000 7f974ce9b640 1 -- 172.21.15.77:0/2124719152 wait complete. 2023-11-26T07:21:31.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.966+0000 7f974ce9b640 1 Processor -- start 2023-11-26T07:21:31.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.967+0000 7f974ce9b640 1 -- start start 2023-11-26T07:21:31.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.967+0000 7f974ce9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f974806f360 0x7f97480c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.967+0000 7f974ce9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97480ce2c0 0x7f97480c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f974ce9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815d380 0x7f97481f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f974ce9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97481606b0 con 0x7f974815d380 2023-11-26T07:21:31.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f974ce9b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97481600f0 con 0x7f974806f360 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f974ce9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97481603d0 con 0x7f97480ce2c0 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f9746d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815d380 0x7f97481f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f9746d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815d380 0x7f97481f36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54892/0 (socket says 172.21.15.77:54892) 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f9746d9d640 1 -- 172.21.15.77:0/1905431854 learned_addr learned my addr 172.21.15.77:0/1905431854 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f9745d9b640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97480ce2c0 0x7f97480c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f974659c640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f974806f360 0x7f97480c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f9746d9d640 1 -- 172.21.15.77:0/1905431854 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97480ce2c0 msgr2=0x7f97480c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f9746d9d640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97480ce2c0 0x7f97480c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f9746d9d640 1 -- 172.21.15.77:0/1905431854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f974806f360 msgr2=0x7f97480c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f9746d9d640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f974806f360 0x7f97480c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f9746d9d640 1 -- 172.21.15.77:0/1905431854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300094d0 con 0x7f974815d380 2023-11-26T07:21:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.968+0000 7f974659c640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f974806f360 0x7f97480c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:31.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.969+0000 7f9746d9d640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815d380 0x7f97481f36d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f974000b3f0 tx=0x7f974000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:31.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.969+0000 7f973effd640 1 -- 172.21.15.77:0/1905431854 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740011830 con 0x7f974815d380 2023-11-26T07:21:31.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.969+0000 7f973effd640 1 -- 172.21.15.77:0/1905431854 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740011990 con 0x7f974815d380 2023-11-26T07:21:31.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.969+0000 7f973effd640 1 -- 172.21.15.77:0/1905431854 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740011d40 con 0x7f974815d380 2023-11-26T07:21:31.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.969+0000 7f974ce9b640 1 -- 172.21.15.77:0/1905431854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97481f4cb0 con 0x7f974815d380 2023-11-26T07:21:31.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.969+0000 7f974ce9b640 1 -- 172.21.15.77:0/1905431854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97480c6cb0 con 0x7f974815d380 2023-11-26T07:21:31.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.970+0000 7f974ce9b640 1 -- 172.21.15.77:0/1905431854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97481f51d0 con 0x7f974815d380 2023-11-26T07:21:31.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.971+0000 7f973effd640 1 -- 172.21.15.77:0/1905431854 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f974001a400 con 0x7f974815d380 2023-11-26T07:21:31.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.972+0000 7f973effd640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f972806b3e0 0x7f972806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.973+0000 7f973effd640 1 -- 172.21.15.77:0/1905431854 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9740089e90 con 0x7f974815d380 2023-11-26T07:21:31.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.973+0000 7f974659c640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f972806b3e0 0x7f972806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.973+0000 7f974659c640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f972806b3e0 0x7f972806d8a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9738007eb0 tx=0x7f97380073c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:31.977+0000 7f973effd640 1 -- 172.21.15.77:0/1905431854 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f97481f51d0 con 0x7f974815d380 2023-11-26T07:21:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.167+0000 7f974ce9b640 1 -- 172.21.15.77:0/1905431854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f97481f51d0 con 0x7f974815d380 2023-11-26T07:21:32.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.174+0000 7f973effd640 1 -- 172.21.15.77:0/1905431854 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v16) v1 ==== 115+0+0 (secure 0 0 0) 0x7f97481f51d0 con 0x7f974815d380 2023-11-26T07:21:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 -- 172.21.15.77:0/1905431854 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f972806b3e0 msgr2=0x7f972806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f972806b3e0 0x7f972806d8a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9738007eb0 tx=0x7f97380073c0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 -- 172.21.15.77:0/1905431854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815d380 msgr2=0x7f97481f36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815d380 0x7f97481f36d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f974000b3f0 tx=0x7f974000b8b0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 -- 172.21.15.77:0/1905431854 shutdown_connections 2023-11-26T07:21:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f972806b3e0 0x7f972806d8a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815d380 0x7f97481f36d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97480ce2c0 0x7f97480c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 --2- 172.21.15.77:0/1905431854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f974806f360 0x7f97480c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 -- 172.21.15.77:0/1905431854 >> 172.21.15.77:0/1905431854 conn(0x7f974806e7d0 msgr2=0x7f974806ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 -- 172.21.15.77:0/1905431854 shutdown_connections 2023-11-26T07:21:32.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.177+0000 7f974ce9b640 1 -- 172.21.15.77:0/1905431854 wait complete. 2023-11-26T07:21:32.199 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:21:32.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.406+0000 7fa434189640 1 Processor -- start 2023-11-26T07:21:32.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.406+0000 7fa434189640 1 -- start start 2023-11-26T07:21:32.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.408+0000 7fa434189640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa42c06e160 0x7fa42c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.408+0000 7fa434189640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa42c0cd110 0x7fa42c070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.408+0000 7fa434189640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0cd510 con 0x7fa42c146eb0 2023-11-26T07:21:32.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.408+0000 7fa434189640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c161a10 con 0x7fa42c0cd110 2023-11-26T07:21:32.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.408+0000 7fa434189640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c161cf0 con 0x7fa42c06e160 2023-11-26T07:21:32.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.408+0000 7fa432726640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa42c0cd110 0x7fa42c070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.408+0000 7fa431f25640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa42c146eb0 0x7fa42c161150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33434/0 (socket says 172.21.15.77:33434) 2023-11-26T07:21:32.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.408+0000 7fa431f25640 1 -- 172.21.15.77:0/560623422 learned_addr learned my addr 172.21.15.77:0/560623422 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:32.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.409+0000 7fa431724640 1 --2- 172.21.15.77:0/560623422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa42c06e160 0x7fa42c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.409+0000 7fa432726640 1 -- 172.21.15.77:0/560623422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa42c06e160 msgr2=0x7fa42c0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:32.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.409+0000 7fa432726640 1 --2- 172.21.15.77:0/560623422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa42c06e160 0x7fa42c0ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.409+0000 7fa432726640 1 -- 172.21.15.77:0/560623422 >> v1:172.21.15.77:6789/0 conn(0x7fa42c146eb0 legacy=0x7fa42c161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.409+0000 7fa432726640 1 -- 172.21.15.77:0/560623422 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c161fd0 con 0x7fa42c0cd110 2023-11-26T07:21:32.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.410+0000 7fa432726640 1 --2- 172.21.15.77:0/560623422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c0cd110 0x7fa42c070e40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa424009d90 tx=0x7fa42402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e1eb3d2cb08e95 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.411+0000 7fa430f23640 1 -- 172.21.15.77:0/560623422 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42402cc50 con 0x7fa42c0cd110 2023-11-26T07:21:32.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.411+0000 7fa430f23640 1 -- 172.21.15.77:0/560623422 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42402cdb0 con 0x7fa42c0cd110 2023-11-26T07:21:32.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.411+0000 7fa430f23640 1 -- 172.21.15.77:0/560623422 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424034660 con 0x7fa42c0cd110 2023-11-26T07:21:32.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.411+0000 7fa434189640 1 -- 172.21.15.77:0/560623422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c0cd110 msgr2=0x7fa42c070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.411+0000 7fa434189640 1 --2- 172.21.15.77:0/560623422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c0cd110 0x7fa42c070e40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa424009d90 tx=0x7fa42402bea0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.412+0000 7fa434189640 1 -- 172.21.15.77:0/560623422 shutdown_connections 2023-11-26T07:21:32.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.412+0000 7fa434189640 1 --2- 172.21.15.77:0/560623422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c0cd110 0x7fa42c070e40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.412+0000 7fa434189640 1 --2- 172.21.15.77:0/560623422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa42c06e160 0x7fa42c0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.412+0000 7fa434189640 1 -- 172.21.15.77:0/560623422 >> 172.21.15.77:0/560623422 conn(0x7fa42c0b0c50 msgr2=0x7fa42c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:32.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.412+0000 7fa434189640 1 -- 172.21.15.77:0/560623422 shutdown_connections 2023-11-26T07:21:32.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.412+0000 7fa434189640 1 -- 172.21.15.77:0/560623422 wait complete. 2023-11-26T07:21:32.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.413+0000 7fa434189640 1 Processor -- start 2023-11-26T07:21:32.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.414+0000 7fa434189640 1 -- start start 2023-11-26T07:21:32.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.414+0000 7fa434189640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa42c06e160 0x7fa42c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.414+0000 7fa434189640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c0cd110 0x7fa42c13df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.414+0000 7fa434189640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa42c146eb0 0x7fa42c141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.414+0000 7fa434189640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c1e75a0 con 0x7fa42c0cd110 2023-11-26T07:21:32.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.414+0000 7fa434189640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0b4f90 con 0x7fa42c146eb0 2023-11-26T07:21:32.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.414+0000 7fa434189640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0b49d0 con 0x7fa42c06e160 2023-11-26T07:21:32.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.415+0000 7fa431724640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c0cd110 0x7fa42c13df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.415+0000 7fa431724640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c0cd110 0x7fa42c13df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54920/0 (socket says 172.21.15.77:54920) 2023-11-26T07:21:32.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.415+0000 7fa431724640 1 -- 172.21.15.77:0/1786529381 learned_addr learned my addr 172.21.15.77:0/1786529381 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:32.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.415+0000 7fa431724640 1 -- 172.21.15.77:0/1786529381 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa42c06e160 msgr2=0x7fa42c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.415+0000 7fa431724640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa42c06e160 0x7fa42c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.415+0000 7fa431724640 1 -- 172.21.15.77:0/1786529381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa42c146eb0 msgr2=0x7fa42c141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.415+0000 7fa431724640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa42c146eb0 0x7fa42c141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.415+0000 7fa431724640 1 -- 172.21.15.77:0/1786529381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424009a70 con 0x7fa42c0cd110 2023-11-26T07:21:32.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.415+0000 7fa431724640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c0cd110 0x7fa42c13df60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00d800 tx=0x7fa41c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.416+0000 7fa4227fc640 1 -- 172.21.15.77:0/1786529381 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c00b640 con 0x7fa42c0cd110 2023-11-26T07:21:32.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.416+0000 7fa4227fc640 1 -- 172.21.15.77:0/1786529381 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c00b7a0 con 0x7fa42c0cd110 2023-11-26T07:21:32.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.416+0000 7fa4227fc640 1 -- 172.21.15.77:0/1786529381 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c00bb30 con 0x7fa42c0cd110 2023-11-26T07:21:32.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.416+0000 7fa434189640 1 -- 172.21.15.77:0/1786529381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c0b4cb0 con 0x7fa42c0cd110 2023-11-26T07:21:32.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.416+0000 7fa434189640 1 -- 172.21.15.77:0/1786529381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c13e4a0 con 0x7fa42c0cd110 2023-11-26T07:21:32.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.417+0000 7fa434189640 1 -- 172.21.15.77:0/1786529381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c04e8b0 con 0x7fa42c0cd110 2023-11-26T07:21:32.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.418+0000 7fa4227fc640 1 -- 172.21.15.77:0/1786529381 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fa41c00bc90 con 0x7fa42c0cd110 2023-11-26T07:21:32.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.419+0000 7fa4227fc640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa41006b3e0 0x7fa41006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.419+0000 7fa4227fc640 1 -- 172.21.15.77:0/1786529381 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa41c08a210 con 0x7fa42c0cd110 2023-11-26T07:21:32.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.419+0000 7fa431f25640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa41006b3e0 0x7fa41006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.420+0000 7fa431f25640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa41006b3e0 0x7fa41006d8a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa428000f60 tx=0x7fa428007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.423+0000 7fa4227fc640 1 -- 172.21.15.77:0/1786529381 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa41c054da0 con 0x7fa42c0cd110 2023-11-26T07:21:32.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.615+0000 7fa434189640 1 -- 172.21.15.77:0/1786529381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa42c1e76e0 con 0x7fa42c0cd110 2023-11-26T07:21:32.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.620+0000 7fa4227fc640 1 -- 172.21.15.77:0/1786529381 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa42c1e76e0 con 0x7fa42c0cd110 2023-11-26T07:21:32.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.623+0000 7fa434189640 1 -- 172.21.15.77:0/1786529381 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa41006b3e0 msgr2=0x7fa41006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.623+0000 7fa434189640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa41006b3e0 0x7fa41006d8a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa428000f60 tx=0x7fa428007a80 comp rx=0 tx=0).stop 2023-11-26T07:21:32.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.623+0000 7fa434189640 1 -- 172.21.15.77:0/1786529381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c0cd110 msgr2=0x7fa42c13df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.623+0000 7fa434189640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c0cd110 0x7fa42c13df60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00d800 tx=0x7fa41c00dcc0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.624+0000 7fa434189640 1 -- 172.21.15.77:0/1786529381 shutdown_connections 2023-11-26T07:21:32.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.624+0000 7fa434189640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa41006b3e0 0x7fa41006d8a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.624+0000 7fa434189640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa42c146eb0 0x7fa42c141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.624+0000 7fa434189640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c0cd110 0x7fa42c13df60 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.624+0000 7fa434189640 1 --2- 172.21.15.77:0/1786529381 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa42c06e160 0x7fa42c0b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.624+0000 7fa434189640 1 -- 172.21.15.77:0/1786529381 >> 172.21.15.77:0/1786529381 conn(0x7fa42c0b0c50 msgr2=0x7fa42c0af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:32.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.624+0000 7fa434189640 1 -- 172.21.15.77:0/1786529381 shutdown_connections 2023-11-26T07:21:32.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.624+0000 7fa434189640 1 -- 172.21.15.77:0/1786529381 wait complete. 2023-11-26T07:21:32.646 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2023-11-26T07:21:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.858+0000 7f9706061640 1 Processor -- start 2023-11-26T07:21:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.858+0000 7f9706061640 1 -- start start 2023-11-26T07:21:32.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.860+0000 7f9706061640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b39d0 0x7f970013dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.860+0000 7f9706061640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970013e8c0 con 0x7f97000b35f0 2023-11-26T07:21:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.860+0000 7f9706061640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970013e5f0 con 0x7f970013e180 2023-11-26T07:21:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.860+0000 7f9706061640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97001413d0 con 0x7f97000b39d0 2023-11-26T07:21:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.860+0000 7f96ff7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f97000b35f0 0x7f9700140950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33438/0 (socket says 172.21.15.77:33438) 2023-11-26T07:21:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.860+0000 7f96ff7fe640 1 -- 172.21.15.77:0/246419996 learned_addr learned my addr 172.21.15.77:0/246419996 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60832523 0 0) 0x7f970013e8c0 con 0x7f97000b35f0 2023-11-26T07:21:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96ec003520 con 0x7f97000b35f0 2023-11-26T07:21:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96feffd640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b39d0 0x7f970013dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2381312489 0 0) 0x7f96ec003520 con 0x7f97000b35f0 2023-11-26T07:21:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b39d0 msgr2=0x7f970013dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b39d0 0x7f970013dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 >> v1:172.21.15.159:6789/0 conn(0x7f970013e180 legacy=0x7f970013f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97001416b0 con 0x7f97000b35f0 2023-11-26T07:21:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f96f00019f0 con 0x7f97000b35f0 2023-11-26T07:21:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 >> v1:172.21.15.77:6789/0 conn(0x7f97000b35f0 legacy=0x7f9700140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b39d0 0x7f96ec0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96ec004000 0x7f96ec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96ec004d00 0x7f96ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97001413d0 con 0x7f96ec004d00 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec00bbe0 con 0x7f96ec004000 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.861+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec00bda0 con 0x7f97000b39d0 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.862+0000 7f96fffff640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96ec004d00 0x7f96ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.862+0000 7f96ff7fe640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b39d0 0x7f96ec0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.862+0000 7f96fffff640 1 -- 172.21.15.77:0/246419996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b39d0 msgr2=0x7f96ec0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.862+0000 7f96feffd640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96ec004000 0x7f96ec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.862+0000 7f96fffff640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b39d0 0x7f96ec0039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.862+0000 7f96fffff640 1 -- 172.21.15.77:0/246419996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96ec004000 msgr2=0x7f96ec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.862+0000 7f96fffff640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96ec004000 0x7f96ec0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.862+0000 7f96fffff640 1 -- 172.21.15.77:0/246419996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec003520 con 0x7f96ec004d00 2023-11-26T07:21:32.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.863+0000 7f96fffff640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96ec004d00 0x7f96ec005180 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f96f8003db0 tx=0x7f96ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a306ce9d9bb50671 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.863+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8032600 con 0x7f96ec004d00 2023-11-26T07:21:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.863+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f802e050 con 0x7f96ec004d00 2023-11-26T07:21:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.863+0000 7f96fe7fc640 1 -- 172.21.15.77:0/246419996 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f80329e0 con 0x7f96ec004d00 2023-11-26T07:21:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.864+0000 7f9706061640 1 -- 172.21.15.77:0/246419996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96ec004d00 msgr2=0x7f96ec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.864+0000 7f9706061640 1 --2- 172.21.15.77:0/246419996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96ec004d00 0x7f96ec005180 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f96f8003db0 tx=0x7f96ec0057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.864+0000 7f96fffff640 1 -- 172.21.15.77:0/246419996 reap_dead start 2023-11-26T07:21:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.864+0000 7f9706061640 1 -- 172.21.15.77:0/246419996 shutdown_connections 2023-11-26T07:21:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.864+0000 7f9706061640 1 -- 172.21.15.77:0/246419996 >> 172.21.15.77:0/246419996 conn(0x7f9700061340 msgr2=0x7f9700061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.864+0000 7f9706061640 1 -- 172.21.15.77:0/246419996 shutdown_connections 2023-11-26T07:21:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.864+0000 7f9706061640 1 -- 172.21.15.77:0/246419996 wait complete. 2023-11-26T07:21:32.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.866+0000 7f9706061640 1 Processor -- start 2023-11-26T07:21:32.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.866+0000 7f9706061640 1 -- start start 2023-11-26T07:21:32.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.867+0000 7f9706061640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96ec004d00 0x7f97000b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.867+0000 7f9706061640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97001f3bd0 0x7f97001f0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.867+0000 7f9706061640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b45d0 0x7f97000d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.867+0000 7f9706061640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97000b0d70 con 0x7f97001f3bd0 2023-11-26T07:21:32.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.867+0000 7f9706061640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97000b4f80 con 0x7f96ec004d00 2023-11-26T07:21:32.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.867+0000 7f9706061640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97000b0fc0 con 0x7f97000b45d0 2023-11-26T07:21:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.867+0000 7f96feffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97001f3bd0 0x7f97001f0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.867+0000 7f96feffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97001f3bd0 0x7f97001f0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54948/0 (socket says 172.21.15.77:54948) 2023-11-26T07:21:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.867+0000 7f96feffd640 1 -- 172.21.15.77:0/1395885011 learned_addr learned my addr 172.21.15.77:0/1395885011 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f96ff7fe640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96ec004d00 0x7f97000b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f96feffd640 1 -- 172.21.15.77:0/1395885011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b45d0 msgr2=0x7f97000d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f96feffd640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b45d0 0x7f97000d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f96feffd640 1 -- 172.21.15.77:0/1395885011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96ec004d00 msgr2=0x7f97000b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f96feffd640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96ec004d00 0x7f97000b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f96feffd640 1 -- 172.21.15.77:0/1395885011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97000b12a0 con 0x7f97001f3bd0 2023-11-26T07:21:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f96feffd640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97001f3bd0 0x7f97001f0180 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f96e800e760 tx=0x7f96e800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f96f7fff640 1 -- 172.21.15.77:0/1395885011 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800c6d0 con 0x7f97001f3bd0 2023-11-26T07:21:32.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f96f7fff640 1 -- 172.21.15.77:0/1395885011 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e800c830 con 0x7f97001f3bd0 2023-11-26T07:21:32.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f9706061640 1 -- 172.21.15.77:0/1395885011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97000b1580 con 0x7f97001f3bd0 2023-11-26T07:21:32.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f96f7fff640 1 -- 172.21.15.77:0/1395885011 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800cbe0 con 0x7f97001f3bd0 2023-11-26T07:21:32.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.868+0000 7f9706061640 1 -- 172.21.15.77:0/1395885011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97001f08a0 con 0x7f97001f3bd0 2023-11-26T07:21:32.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.870+0000 7f9706061640 1 -- 172.21.15.77:0/1395885011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9700067470 con 0x7f97001f3bd0 2023-11-26T07:21:32.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.871+0000 7f96f7fff640 1 -- 172.21.15.77:0/1395885011 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f96e800cd40 con 0x7f97001f3bd0 2023-11-26T07:21:32.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.871+0000 7f96f7fff640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f96e006b3e0 0x7f96e006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.872+0000 7f96f7fff640 1 -- 172.21.15.77:0/1395885011 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f96e8089bf0 con 0x7f97001f3bd0 2023-11-26T07:21:32.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.872+0000 7f96ff7fe640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f96e006b3e0 0x7f96e006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.872+0000 7f96ff7fe640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f96e006b3e0 0x7f96e006d8a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f96f0007c40 tx=0x7f96f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:32.875+0000 7f96f7fff640 1 -- 172.21.15.77:0/1395885011 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96e8054670 con 0x7f97001f3bd0 2023-11-26T07:21:33.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.122+0000 7f9706061640 1 -- 172.21.15.77:0/1395885011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) v1 -- 0x7f970013d4c0 con 0x7f97001f3bd0 2023-11-26T07:21:33.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.732+0000 7f96f7fff640 1 -- 172.21.15.77:0/1395885011 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v215) v1 ==== 180+0+0 (secure 0 0 0) 0x7f96e8009380 con 0x7f97001f3bd0 2023-11-26T07:21:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.736+0000 7f9706061640 1 -- 172.21.15.77:0/1395885011 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f96e006b3e0 msgr2=0x7f96e006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.736+0000 7f9706061640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f96e006b3e0 0x7f96e006d8a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f96f0007c40 tx=0x7f96f0009040 comp rx=0 tx=0).stop 2023-11-26T07:21:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.736+0000 7f9706061640 1 -- 172.21.15.77:0/1395885011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97001f3bd0 msgr2=0x7f97001f0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.736+0000 7f9706061640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97001f3bd0 0x7f97001f0180 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f96e800e760 tx=0x7f96e800ec20 comp rx=0 tx=0).stop 2023-11-26T07:21:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.736+0000 7f9706061640 1 -- 172.21.15.77:0/1395885011 shutdown_connections 2023-11-26T07:21:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.736+0000 7f9706061640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f96e006b3e0 0x7f96e006d8a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.736+0000 7f9706061640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97000b45d0 0x7f97000d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.736+0000 7f9706061640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97001f3bd0 0x7f97001f0180 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.736+0000 7f9706061640 1 --2- 172.21.15.77:0/1395885011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96ec004d00 0x7f97000b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.736+0000 7f9706061640 1 -- 172.21.15.77:0/1395885011 >> 172.21.15.77:0/1395885011 conn(0x7f9700061340 msgr2=0x7f970015c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:33.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.737+0000 7f9706061640 1 -- 172.21.15.77:0/1395885011 shutdown_connections 2023-11-26T07:21:33.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.737+0000 7f9706061640 1 -- 172.21.15.77:0/1395885011 wait complete. 2023-11-26T07:21:33.758 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during in-progress state and validate the reason ... ok 2023-11-26T07:21:33.759 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is cancelled during pending state and validate the reason 2023-11-26T07:21:33.759 INFO:tasks.cephfs_test_runner:test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:21:33.759 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:33.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.965+0000 7f07bb58a640 1 Processor -- start 2023-11-26T07:21:33.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.966+0000 7f07bb58a640 1 -- start start 2023-11-26T07:21:33.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.967+0000 7f07bb58a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07b415c7f0 0x7f07b406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.967+0000 7f07bb58a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f07b40cf450 0x7f07b40cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.967+0000 7f07bb58a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b40cdfb0 0x7f07b40ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.967+0000 7f07bb58a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b40cfe40 con 0x7f07b415c7f0 2023-11-26T07:21:33.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.967+0000 7f07bb58a640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b4156010 con 0x7f07b40cf450 2023-11-26T07:21:33.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.967+0000 7f07bb58a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b406ce30 con 0x7f07b40cdfb0 2023-11-26T07:21:33.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.968+0000 7f07b9326640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07b415c7f0 0x7f07b406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.968+0000 7f07b9326640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07b415c7f0 0x7f07b406db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54964/0 (socket says 172.21.15.77:54964) 2023-11-26T07:21:33.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.968+0000 7f07b9326640 1 -- 172.21.15.77:0/2281483119 learned_addr learned my addr 172.21.15.77:0/2281483119 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:33.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.968+0000 7f07b8b25640 1 --2- 172.21.15.77:0/2281483119 >> v2:172.21.15.159:3300/0 conn(0x7f07b40cf450 0x7f07b40cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.968+0000 7f07b9b27640 1 --2- 172.21.15.77:0/2281483119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b40cdfb0 0x7f07b40ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.968+0000 7f07b9326640 1 -- 172.21.15.77:0/2281483119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b40cdfb0 msgr2=0x7f07b40ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:33.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.968+0000 7f07b9326640 1 --2- 172.21.15.77:0/2281483119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b40cdfb0 0x7f07b40ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.968+0000 7f07b9326640 1 -- 172.21.15.77:0/2281483119 >> v2:172.21.15.159:3300/0 conn(0x7f07b40cf450 msgr2=0x7f07b40cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:33.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.968+0000 7f07b9326640 1 --2- 172.21.15.77:0/2281483119 >> v2:172.21.15.159:3300/0 conn(0x7f07b40cf450 0x7f07b40cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.968+0000 7f07b9326640 1 -- 172.21.15.77:0/2281483119 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b40cece0 con 0x7f07b415c7f0 2023-11-26T07:21:33.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.970+0000 7f07b9326640 1 --2- 172.21.15.77:0/2281483119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b415c7f0 0x7f07b406db20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f07b4070410 tx=0x7f07b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98566cac429a172b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.970+0000 7f07a7fff640 1 -- 172.21.15.77:0/2281483119 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0031870 con 0x7f07b415c7f0 2023-11-26T07:21:33.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.970+0000 7f07a7fff640 1 -- 172.21.15.77:0/2281483119 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b00319d0 con 0x7f07b415c7f0 2023-11-26T07:21:33.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.970+0000 7f07a7fff640 1 -- 172.21.15.77:0/2281483119 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0031d60 con 0x7f07b415c7f0 2023-11-26T07:21:33.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.971+0000 7f07bb58a640 1 -- 172.21.15.77:0/2281483119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b415c7f0 msgr2=0x7f07b406db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.971+0000 7f07bb58a640 1 --2- 172.21.15.77:0/2281483119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b415c7f0 0x7f07b406db20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f07b4070410 tx=0x7f07b002b910 comp rx=0 tx=0).stop 2023-11-26T07:21:33.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.971+0000 7f07bb58a640 1 -- 172.21.15.77:0/2281483119 shutdown_connections 2023-11-26T07:21:33.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.971+0000 7f07bb58a640 1 --2- 172.21.15.77:0/2281483119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b40cdfb0 0x7f07b40ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.971+0000 7f07bb58a640 1 --2- 172.21.15.77:0/2281483119 >> v2:172.21.15.159:3300/0 conn(0x7f07b40cf450 0x7f07b40cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.971+0000 7f07bb58a640 1 --2- 172.21.15.77:0/2281483119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b415c7f0 0x7f07b406db20 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.971+0000 7f07bb58a640 1 -- 172.21.15.77:0/2281483119 >> 172.21.15.77:0/2281483119 conn(0x7f07b406a920 msgr2=0x7f07b406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:33.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.971+0000 7f07bb58a640 1 -- 172.21.15.77:0/2281483119 shutdown_connections 2023-11-26T07:21:33.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.971+0000 7f07bb58a640 1 -- 172.21.15.77:0/2281483119 wait complete. 2023-11-26T07:21:33.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.973+0000 7f07bb58a640 1 Processor -- start 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.973+0000 7f07bb58a640 1 -- start start 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07bb58a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b40cdfb0 0x7f07b40adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07bb58a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b40cf450 0x7f07b40b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07bb58a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b415c7f0 0x7f07b4154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07bb58a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40c8990 con 0x7f07b40cdfb0 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07bb58a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b41562d0 con 0x7f07b40cf450 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07bb58a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b41565b0 con 0x7f07b415c7f0 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07b9326640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b40cdfb0 0x7f07b40adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07b9326640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b40cdfb0 0x7f07b40adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54966/0 (socket says 172.21.15.77:54966) 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07b9326640 1 -- 172.21.15.77:0/2825070363 learned_addr learned my addr 172.21.15.77:0/2825070363 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07b9326640 1 -- 172.21.15.77:0/2825070363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b415c7f0 msgr2=0x7f07b4154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07b9326640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b415c7f0 0x7f07b4154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07b9326640 1 -- 172.21.15.77:0/2825070363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b40cf450 msgr2=0x7f07b40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07b9326640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b40cf450 0x7f07b40b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.975+0000 7f07b9326640 1 -- 172.21.15.77:0/2825070363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00094d0 con 0x7f07b40cdfb0 2023-11-26T07:21:33.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.976+0000 7f07b9326640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b40cdfb0 0x7f07b40adf30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f07b002b950 tx=0x7f07b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.976+0000 7f07a5ffb640 1 -- 172.21.15.77:0/2825070363 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b003ad30 con 0x7f07b40cdfb0 2023-11-26T07:21:33.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.976+0000 7f07a5ffb640 1 -- 172.21.15.77:0/2825070363 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b00443f0 con 0x7f07b40cdfb0 2023-11-26T07:21:33.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.976+0000 7f07a5ffb640 1 -- 172.21.15.77:0/2825070363 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00447a0 con 0x7f07b40cdfb0 2023-11-26T07:21:33.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.976+0000 7f07bb58a640 1 -- 172.21.15.77:0/2825070363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b4156890 con 0x7f07b40cdfb0 2023-11-26T07:21:33.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.976+0000 7f07bb58a640 1 -- 172.21.15.77:0/2825070363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b40ae470 con 0x7f07b40cdfb0 2023-11-26T07:21:33.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.977+0000 7f07bb58a640 1 -- 172.21.15.77:0/2825070363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b40ae660 con 0x7f07b40cdfb0 2023-11-26T07:21:33.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.978+0000 7f07a5ffb640 1 -- 172.21.15.77:0/2825070363 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f07b004d450 con 0x7f07b40cdfb0 2023-11-26T07:21:33.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.979+0000 7f07a5ffb640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f079806b3e0 0x7f079806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.979+0000 7f07a5ffb640 1 -- 172.21.15.77:0/2825070363 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f07b002d040 con 0x7f07b40cdfb0 2023-11-26T07:21:33.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.979+0000 7f07b8b25640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f079806b3e0 0x7f079806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.980+0000 7f07b8b25640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f079806b3e0 0x7f079806d8a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f07b406dd50 tx=0x7f07a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:33.983+0000 7f07a5ffb640 1 -- 172.21.15.77:0/2825070363 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07b0076e30 con 0x7f07b40cdfb0 2023-11-26T07:21:34.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.161+0000 7f07bb58a640 1 -- 172.21.15.77:0/2825070363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07b406d5e0 con 0x7f07b40cdfb0 2023-11-26T07:21:34.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.162+0000 7f07a5ffb640 1 -- 172.21.15.77:0/2825070363 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+12962 (secure 0 0 0) 0x7f07b406d5e0 con 0x7f07b40cdfb0 2023-11-26T07:21:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:34.165 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":54,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:21:31.717987+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6835/2496806662":"2023-11-27T07:21:28.448759+0000","172.21.15.77:6834/2496806662":"2023-11-27T07:21:28.448759+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:34.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.164+0000 7f07bb58a640 1 -- 172.21.15.77:0/2825070363 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f079806b3e0 msgr2=0x7f079806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.164+0000 7f07bb58a640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f079806b3e0 0x7f079806d8a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f07b406dd50 tx=0x7f07a8008040 comp rx=0 tx=0).stop 2023-11-26T07:21:34.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.164+0000 7f07bb58a640 1 -- 172.21.15.77:0/2825070363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b40cdfb0 msgr2=0x7f07b40adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.164+0000 7f07bb58a640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b40cdfb0 0x7f07b40adf30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f07b002b950 tx=0x7f07b00046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.165+0000 7f07bb58a640 1 -- 172.21.15.77:0/2825070363 shutdown_connections 2023-11-26T07:21:34.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.165+0000 7f07bb58a640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f079806b3e0 0x7f079806d8a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.165+0000 7f07bb58a640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b415c7f0 0x7f07b4154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.165+0000 7f07bb58a640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b40cf450 0x7f07b40b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.165+0000 7f07bb58a640 1 --2- 172.21.15.77:0/2825070363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b40cdfb0 0x7f07b40adf30 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.165+0000 7f07bb58a640 1 -- 172.21.15.77:0/2825070363 >> 172.21.15.77:0/2825070363 conn(0x7f07b406a920 msgr2=0x7f07b415eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:34.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.165+0000 7f07bb58a640 1 -- 172.21.15.77:0/2825070363 shutdown_connections 2023-11-26T07:21:34.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.165+0000 7f07bb58a640 1 -- 172.21.15.77:0/2825070363 wait complete. 2023-11-26T07:21:34.185 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:21:34.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:21:34.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.385+0000 7f96acc59640 1 Processor -- start 2023-11-26T07:21:34.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.385+0000 7f96acc59640 1 -- start start 2023-11-26T07:21:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.386+0000 7f96acc59640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f96a815b260 0x7f96a806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.386+0000 7f96acc59640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96a806e580 0x7f96a80b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.386+0000 7f96acc59640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a80b1080 0x7f96a80ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.386+0000 7f96acc59640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a815b640 con 0x7f96a806e580 2023-11-26T07:21:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.387+0000 7f96acc59640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a80b1510 con 0x7f96a815b260 2023-11-26T07:21:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.387+0000 7f96acc59640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a815ed20 con 0x7f96a80b1080 2023-11-26T07:21:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.387+0000 7f969ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96a806e580 0x7f96a80b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.387+0000 7f969ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96a806e580 0x7f96a80b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54982/0 (socket says 172.21.15.77:54982) 2023-11-26T07:21:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.387+0000 7f969ffff640 1 -- 172.21.15.77:0/3868620424 learned_addr learned my addr 172.21.15.77:0/3868620424 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.387+0000 7f96a77fe640 1 --2- 172.21.15.77:0/3868620424 >> v2:172.21.15.159:3300/0 conn(0x7f96a815b260 0x7f96a806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.387+0000 7f96a7fff640 1 --2- 172.21.15.77:0/3868620424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a80b1080 0x7f96a80ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.388+0000 7f969ffff640 1 -- 172.21.15.77:0/3868620424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a80b1080 msgr2=0x7f96a80ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.388+0000 7f969ffff640 1 --2- 172.21.15.77:0/3868620424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a80b1080 0x7f96a80ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.388+0000 7f969ffff640 1 -- 172.21.15.77:0/3868620424 >> v2:172.21.15.159:3300/0 conn(0x7f96a815b260 msgr2=0x7f96a806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:34.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.388+0000 7f969ffff640 1 --2- 172.21.15.77:0/3868620424 >> v2:172.21.15.159:3300/0 conn(0x7f96a815b260 0x7f96a806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.388+0000 7f969ffff640 1 -- 172.21.15.77:0/3868620424 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a815f8a0 con 0x7f96a806e580 2023-11-26T07:21:34.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.388+0000 7f96a77fe640 1 --2- 172.21.15.77:0/3868620424 >> v2:172.21.15.159:3300/0 conn(0x7f96a815b260 0x7f96a806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:34.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.389+0000 7f969ffff640 1 --2- 172.21.15.77:0/3868620424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a806e580 0x7f96a80b0b40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f96a80d0160 tx=0x7f969002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbaa0a4e62708797 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.389+0000 7f96a6ffd640 1 -- 172.21.15.77:0/3868620424 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690031740 con 0x7f96a806e580 2023-11-26T07:21:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.389+0000 7f96a6ffd640 1 -- 172.21.15.77:0/3868620424 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96900318a0 con 0x7f96a806e580 2023-11-26T07:21:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.389+0000 7f96a6ffd640 1 -- 172.21.15.77:0/3868620424 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690031c30 con 0x7f96a806e580 2023-11-26T07:21:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.390+0000 7f96acc59640 1 -- 172.21.15.77:0/3868620424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a806e580 msgr2=0x7f96a80b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.390+0000 7f96acc59640 1 --2- 172.21.15.77:0/3868620424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a806e580 0x7f96a80b0b40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f96a80d0160 tx=0x7f969002b7e0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.390+0000 7f96acc59640 1 -- 172.21.15.77:0/3868620424 shutdown_connections 2023-11-26T07:21:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.390+0000 7f96acc59640 1 --2- 172.21.15.77:0/3868620424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a80b1080 0x7f96a80ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.390+0000 7f96acc59640 1 --2- 172.21.15.77:0/3868620424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a806e580 0x7f96a80b0b40 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.390+0000 7f96acc59640 1 --2- 172.21.15.77:0/3868620424 >> v2:172.21.15.159:3300/0 conn(0x7f96a815b260 0x7f96a806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.390+0000 7f96acc59640 1 -- 172.21.15.77:0/3868620424 >> 172.21.15.77:0/3868620424 conn(0x7f96a80cbb40 msgr2=0x7f96a80cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.390+0000 7f96acc59640 1 -- 172.21.15.77:0/3868620424 shutdown_connections 2023-11-26T07:21:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.390+0000 7f96acc59640 1 -- 172.21.15.77:0/3868620424 wait complete. 2023-11-26T07:21:34.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.392+0000 7f96acc59640 1 Processor -- start 2023-11-26T07:21:34.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.392+0000 7f96acc59640 1 -- start start 2023-11-26T07:21:34.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96acc59640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a806e580 0x7f96a80c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96acc59640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96a80b1080 0x7f96a815cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96acc59640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a815b260 0x7f96a80c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96acc59640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a815df90 con 0x7f96a806e580 2023-11-26T07:21:34.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96acc59640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80c9390 con 0x7f96a80b1080 2023-11-26T07:21:34.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96acc59640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a815d380 con 0x7f96a815b260 2023-11-26T07:21:34.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96a77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a806e580 0x7f96a80c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96a77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a806e580 0x7f96a80c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54990/0 (socket says 172.21.15.77:54990) 2023-11-26T07:21:34.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96a77fe640 1 -- 172.21.15.77:0/1942151504 learned_addr learned my addr 172.21.15.77:0/1942151504 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:34.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96a77fe640 1 -- 172.21.15.77:0/1942151504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a815b260 msgr2=0x7f96a80c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96a77fe640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a815b260 0x7f96a80c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96a77fe640 1 -- 172.21.15.77:0/1942151504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96a80b1080 msgr2=0x7f96a815cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96a77fe640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96a80b1080 0x7f96a815cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.393+0000 7f96a77fe640 1 -- 172.21.15.77:0/1942151504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900094d0 con 0x7f96a806e580 2023-11-26T07:21:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.394+0000 7f96a77fe640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a806e580 0x7f96a80c8e50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f969800d800 tx=0x7f969800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.394+0000 7f96a4ff9640 1 -- 172.21.15.77:0/1942151504 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698004030 con 0x7f96a806e580 2023-11-26T07:21:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.394+0000 7f96a4ff9640 1 -- 172.21.15.77:0/1942151504 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9698004190 con 0x7f96a806e580 2023-11-26T07:21:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.394+0000 7f96a4ff9640 1 -- 172.21.15.77:0/1942151504 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698004520 con 0x7f96a806e580 2023-11-26T07:21:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.394+0000 7f96acc59640 1 -- 172.21.15.77:0/1942151504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a815d660 con 0x7f96a806e580 2023-11-26T07:21:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.394+0000 7f96acc59640 1 -- 172.21.15.77:0/1942151504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a815dc20 con 0x7f96a806e580 2023-11-26T07:21:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.395+0000 7f96acc59640 1 -- 172.21.15.77:0/1942151504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a804e840 con 0x7f96a806e580 2023-11-26T07:21:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.396+0000 7f96a4ff9640 1 -- 172.21.15.77:0/1942151504 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f969800b6c0 con 0x7f96a806e580 2023-11-26T07:21:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.397+0000 7f96a4ff9640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f968806b3e0 0x7f968806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.397+0000 7f96a4ff9640 1 -- 172.21.15.77:0/1942151504 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9698089ff0 con 0x7f96a806e580 2023-11-26T07:21:34.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.397+0000 7f969ffff640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f968806b3e0 0x7f968806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.398+0000 7f969ffff640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f968806b3e0 0x7f968806d8a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9690035000 tx=0x7f9690030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.401+0000 7f96a4ff9640 1 -- 172.21.15.77:0/1942151504 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9698054aa0 con 0x7f96a806e580 2023-11-26T07:21:34.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.590+0000 7f96acc59640 1 -- 172.21.15.77:0/1942151504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96a80ce640 con 0x7f96a806e580 2023-11-26T07:21:34.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.591+0000 7f96a4ff9640 1 -- 172.21.15.77:0/1942151504 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96980580c0 con 0x7f96a806e580 2023-11-26T07:21:34.593 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:21:34.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.593+0000 7f96acc59640 1 -- 172.21.15.77:0/1942151504 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f968806b3e0 msgr2=0x7f968806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.593+0000 7f96acc59640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f968806b3e0 0x7f968806d8a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9690035000 tx=0x7f9690030000 comp rx=0 tx=0).stop 2023-11-26T07:21:34.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.593+0000 7f96acc59640 1 -- 172.21.15.77:0/1942151504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a806e580 msgr2=0x7f96a80c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.593+0000 7f96acc59640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a806e580 0x7f96a80c8e50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f969800d800 tx=0x7f969800dcc0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.593+0000 7f96acc59640 1 -- 172.21.15.77:0/1942151504 shutdown_connections 2023-11-26T07:21:34.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.594+0000 7f96acc59640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f968806b3e0 0x7f968806d8a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.594+0000 7f96acc59640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a815b260 0x7f96a80c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.594+0000 7f96acc59640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96a80b1080 0x7f96a815cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.594+0000 7f96acc59640 1 --2- 172.21.15.77:0/1942151504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a806e580 0x7f96a80c8e50 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.594+0000 7f96acc59640 1 -- 172.21.15.77:0/1942151504 >> 172.21.15.77:0/1942151504 conn(0x7f96a80cbb40 msgr2=0x7f96a80ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:34.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.594+0000 7f96acc59640 1 -- 172.21.15.77:0/1942151504 shutdown_connections 2023-11-26T07:21:34.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.594+0000 7f96acc59640 1 -- 172.21.15.77:0/1942151504 wait complete. 2023-11-26T07:21:34.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled' 2023-11-26T07:21:34.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.818+0000 7fc0bbf68640 1 Processor -- start 2023-11-26T07:21:34.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.819+0000 7fc0bbf68640 1 -- start start 2023-11-26T07:21:34.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.820+0000 7fc0bbf68640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0b4160d40 0x7fc0b40b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.820+0000 7fc0bbf68640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b40cdf90 con 0x7fc0b40d04f0 2023-11-26T07:21:34.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.820+0000 7fc0bbf68640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b40ce230 con 0x7fc0b40b2740 2023-11-26T07:21:34.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.820+0000 7fc0bbf68640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40d2430 con 0x7fc0b4160d40 2023-11-26T07:21:34.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.820+0000 7fc0ba505640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc0b40d04f0 0x7fc0b40ce710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33444/0 (socket says 172.21.15.77:33444) 2023-11-26T07:21:34.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.820+0000 7fc0ba505640 1 -- 172.21.15.77:0/3446586080 learned_addr learned my addr 172.21.15.77:0/3446586080 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.821+0000 7fc0b9d04640 1 --2- 172.21.15.77:0/3446586080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0b4160d40 0x7fc0b40b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.821+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534171637 0 0) 0x7fc0b40cdf90 con 0x7fc0b40d04f0 2023-11-26T07:21:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.821+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a0003520 con 0x7fc0b40d04f0 2023-11-26T07:21:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.821+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 343114365 0 0) 0x7fc0a0003520 con 0x7fc0b40d04f0 2023-11-26T07:21:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.821+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0b4160d40 msgr2=0x7fc0b40b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.821+0000 7fc0b8d02640 1 --2- 172.21.15.77:0/3446586080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0b4160d40 0x7fc0b40b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.821+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 >> v1:172.21.15.159:6789/0 conn(0x7fc0b40b2740 legacy=0x7fc0b40cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.821+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b40d1b90 con 0x7fc0b40d04f0 2023-11-26T07:21:34.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.821+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fc0ac001670 con 0x7fc0b40d04f0 2023-11-26T07:21:34.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 >> v1:172.21.15.77:6789/0 conn(0x7fc0b40d04f0 legacy=0x7fc0b40ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b8d02640 1 --2- 172.21.15.77:0/3446586080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 0x7fc0a0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b8d02640 1 --2- 172.21.15.77:0/3446586080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0b4160d40 0x7fc0a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b8d02640 1 --2- 172.21.15.77:0/3446586080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0a0004d00 0x7fc0a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40d2430 con 0x7fc0a00039a0 2023-11-26T07:21:34.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a000ba30 con 0x7fc0a0004d00 2023-11-26T07:21:34.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a000bbf0 con 0x7fc0b4160d40 2023-11-26T07:21:34.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b9d04640 1 --2- 172.21.15.77:0/3446586080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 0x7fc0a0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b9d04640 1 -- 172.21.15.77:0/3446586080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0b4160d40 msgr2=0x7fc0a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:34.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b9d04640 1 --2- 172.21.15.77:0/3446586080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0b4160d40 0x7fc0a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b9d04640 1 -- 172.21.15.77:0/3446586080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0a0004d00 msgr2=0x7fc0a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:34.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b9d04640 1 --2- 172.21.15.77:0/3446586080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0a0004d00 0x7fc0a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.822+0000 7fc0b9d04640 1 -- 172.21.15.77:0/3446586080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a0003520 con 0x7fc0a00039a0 2023-11-26T07:21:34.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.823+0000 7fc0b9d04640 1 --2- 172.21.15.77:0/3446586080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 0x7fc0a0003dc0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009f90 tx=0x7fc0a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593df45c7ff55a60 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.823+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b002cc20 con 0x7fc0a00039a0 2023-11-26T07:21:34.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.823+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b000f040 con 0x7fc0a00039a0 2023-11-26T07:21:34.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.823+0000 7fc0b8d02640 1 -- 172.21.15.77:0/3446586080 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0034440 con 0x7fc0a00039a0 2023-11-26T07:21:34.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.824+0000 7fc0bbf68640 1 -- 172.21.15.77:0/3446586080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 msgr2=0x7fc0a0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.824+0000 7fc0bbf68640 1 --2- 172.21.15.77:0/3446586080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 0x7fc0a0003dc0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009f90 tx=0x7fc0a00057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.824+0000 7fc0ba505640 1 -- 172.21.15.77:0/3446586080 reap_dead start 2023-11-26T07:21:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.824+0000 7fc0bbf68640 1 -- 172.21.15.77:0/3446586080 shutdown_connections 2023-11-26T07:21:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.824+0000 7fc0bbf68640 1 -- 172.21.15.77:0/3446586080 >> 172.21.15.77:0/3446586080 conn(0x7fc0b408af60 msgr2=0x7fc0b40d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.824+0000 7fc0bbf68640 1 -- 172.21.15.77:0/3446586080 shutdown_connections 2023-11-26T07:21:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.824+0000 7fc0bbf68640 1 -- 172.21.15.77:0/3446586080 wait complete. 2023-11-26T07:21:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.826+0000 7fc0bbf68640 1 Processor -- start 2023-11-26T07:21:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.826+0000 7fc0bbf68640 1 -- start start 2023-11-26T07:21:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.827+0000 7fc0bbf68640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 0x7fc0b40b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.827+0000 7fc0bbf68640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0b40b6050 0x7fc0b41f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.827+0000 7fc0bbf68640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0b41f3ac0 0x7fc0b415e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.827+0000 7fc0bbf68640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4158600 con 0x7fc0a00039a0 2023-11-26T07:21:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.827+0000 7fc0bbf68640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40b44b0 con 0x7fc0b41f3ac0 2023-11-26T07:21:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.827+0000 7fc0bbf68640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40b2e90 con 0x7fc0b40b6050 2023-11-26T07:21:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.827+0000 7fc0b9d04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 0x7fc0b40b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.827+0000 7fc0b9d04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 0x7fc0b40b7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55016/0 (socket says 172.21.15.77:55016) 2023-11-26T07:21:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.827+0000 7fc0b9d04640 1 -- 172.21.15.77:0/1922563406 learned_addr learned my addr 172.21.15.77:0/1922563406 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.828+0000 7fc0b9d04640 1 -- 172.21.15.77:0/1922563406 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0b40b6050 msgr2=0x7fc0b41f0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.828+0000 7fc0b9d04640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0b40b6050 0x7fc0b41f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.828+0000 7fc0b9d04640 1 -- 172.21.15.77:0/1922563406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0b41f3ac0 msgr2=0x7fc0b415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.828+0000 7fc0b9d04640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0b41f3ac0 0x7fc0b415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.828+0000 7fc0b9d04640 1 -- 172.21.15.77:0/1922563406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b41f3f40 con 0x7fc0a00039a0 2023-11-26T07:21:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.828+0000 7fc0b9d04640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 0x7fc0b40b7930 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc0b002c5c0 tx=0x7fc0b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.828+0000 7fc0aa7fc640 1 -- 172.21.15.77:0/1922563406 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b003e400 con 0x7fc0a00039a0 2023-11-26T07:21:34.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.828+0000 7fc0aa7fc640 1 -- 172.21.15.77:0/1922563406 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b003e580 con 0x7fc0a00039a0 2023-11-26T07:21:34.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.829+0000 7fc0aa7fc640 1 -- 172.21.15.77:0/1922563406 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b003e930 con 0x7fc0a00039a0 2023-11-26T07:21:34.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.829+0000 7fc0bbf68640 1 -- 172.21.15.77:0/1922563406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b40b6610 con 0x7fc0a00039a0 2023-11-26T07:21:34.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.829+0000 7fc0bbf68640 1 -- 172.21.15.77:0/1922563406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b40b6bd0 con 0x7fc0a00039a0 2023-11-26T07:21:34.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.830+0000 7fc0bbf68640 1 -- 172.21.15.77:0/1922563406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b4067470 con 0x7fc0a00039a0 2023-11-26T07:21:34.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.831+0000 7fc0aa7fc640 1 -- 172.21.15.77:0/1922563406 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fc0b003ea90 con 0x7fc0a00039a0 2023-11-26T07:21:34.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.832+0000 7fc0aa7fc640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc09806b410 0x7fc09806d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.832+0000 7fc0aa7fc640 1 -- 172.21.15.77:0/1922563406 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc0b00ac270 con 0x7fc0a00039a0 2023-11-26T07:21:34.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.832+0000 7fc0b9503640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc09806b410 0x7fc09806d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.832+0000 7fc0b9503640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc09806b410 0x7fc09806d8d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40d4010 tx=0x7fc0a4007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:34.836+0000 7fc0aa7fc640 1 -- 172.21.15.77:0/1922563406 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc0b0076f80 con 0x7fc0a00039a0 2023-11-26T07:21:35.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.094+0000 7fc0bbf68640 1 -- 172.21.15.77:0/1922563406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]} v 0) v1 -- 0x7fc0b408b400 con 0x7fc0a00039a0 2023-11-26T07:21:35.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.746+0000 7fc0aa7fc640 1 -- 172.21.15.77:0/1922563406 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]}]=0 v217) v1 ==== 179+0+0 (secure 0 0 0) 0x7fc0b003ed40 con 0x7fc0a00039a0 2023-11-26T07:21:35.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 -- 172.21.15.77:0/1922563406 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc09806b410 msgr2=0x7fc09806d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc09806b410 0x7fc09806d8d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40d4010 tx=0x7fc0a4007990 comp rx=0 tx=0).stop 2023-11-26T07:21:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 -- 172.21.15.77:0/1922563406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 msgr2=0x7fc0b40b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 0x7fc0b40b7930 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc0b002c5c0 tx=0x7fc0b0009750 comp rx=0 tx=0).stop 2023-11-26T07:21:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 -- 172.21.15.77:0/1922563406 shutdown_connections 2023-11-26T07:21:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc09806b410 0x7fc09806d8d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0b41f3ac0 0x7fc0b415e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0b40b6050 0x7fc0b41f0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 --2- 172.21.15.77:0/1922563406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00039a0 0x7fc0b40b7930 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 -- 172.21.15.77:0/1922563406 >> 172.21.15.77:0/1922563406 conn(0x7fc0b408af60 msgr2=0x7fc0b40d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 -- 172.21.15.77:0/1922563406 shutdown_connections 2023-11-26T07:21:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.750+0000 7fc0bbf68640 1 -- 172.21.15.77:0/1922563406 wait complete. 2023-11-26T07:21:35.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:21:35.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.983+0000 7f183287c640 1 Processor -- start 2023-11-26T07:21:35.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.983+0000 7f183287c640 1 -- start start 2023-11-26T07:21:35.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.984+0000 7f183287c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f182c0cfc80 0x7f182c0d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.984+0000 7f183287c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182c0d05a0 con 0x7f182c15d580 2023-11-26T07:21:35.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.984+0000 7f183287c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182c0cf300 con 0x7f182c0d4010 2023-11-26T07:21:35.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.984+0000 7f183287c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0d1090 con 0x7f182c0cfc80 2023-11-26T07:21:35.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.985+0000 7f182bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f182c15d580 0x7f182c0d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53532/0 (socket says 172.21.15.77:53532) 2023-11-26T07:21:35.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.985+0000 7f182bfff640 1 -- 172.21.15.77:0/4273147215 learned_addr learned my addr 172.21.15.77:0/4273147215 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:35.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.985+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595937472 0 0) 0x7f182c0d05a0 con 0x7f182c15d580 2023-11-26T07:21:35.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.985+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1818003520 con 0x7f182c15d580 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.985+0000 7f1830e19640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f182c0cfc80 0x7f182c0d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2696796501 0 0) 0x7f1818003520 con 0x7f182c15d580 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f182c0cfc80 msgr2=0x7f182c0d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f182c0cfc80 0x7f182c0d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 >> v1:172.21.15.159:6789/0 conn(0x7f182c0d4010 legacy=0x7f182c0cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c0d1370 con 0x7f182c15d580 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f181c001690 con 0x7f182c15d580 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 >> v1:172.21.15.77:6789/0 conn(0x7f182c15d580 legacy=0x7f182c0d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f182c0cfc80 0x7f18180039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1818003f70 0x7f18180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1818004d00 0x7f1818005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0d1090 con 0x7f1818004d00 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181800bac0 con 0x7f1818003f70 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181800bc80 con 0x7f182c0cfc80 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f1830e19640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1818004d00 0x7f1818005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.987+0000 7f182bfff640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f182c0cfc80 0x7f18180039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.986+0000 7f182b7fe640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1818003f70 0x7f18180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.987+0000 7f1830e19640 1 -- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f182c0cfc80 msgr2=0x7f18180039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.987+0000 7f1830e19640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f182c0cfc80 0x7f18180039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.987+0000 7f1830e19640 1 -- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1818003f70 msgr2=0x7f18180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.987+0000 7f1830e19640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1818003f70 0x7f18180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.987+0000 7f1830e19640 1 -- 172.21.15.77:0/4273147215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818003520 con 0x7f1818004d00 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.987+0000 7f182bfff640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f182c0cfc80 0x7f18180039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:35.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.987+0000 7f182b7fe640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1818003f70 0x7f18180047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:35.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.988+0000 7f1830e19640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1818004d00 0x7f1818005180 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1824009fc0 tx=0x7f18180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcb49db6392826a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:35.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.988+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182402cc20 con 0x7f1818004d00 2023-11-26T07:21:35.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.988+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182400f040 con 0x7f1818004d00 2023-11-26T07:21:35.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.988+0000 7f182affd640 1 -- 172.21.15.77:0/4273147215 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824034440 con 0x7f1818004d00 2023-11-26T07:21:35.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.989+0000 7f183287c640 1 -- 172.21.15.77:0/4273147215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1818004d00 msgr2=0x7f1818005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.989+0000 7f183287c640 1 --2- 172.21.15.77:0/4273147215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1818004d00 0x7f1818005180 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1824009fc0 tx=0x7f18180057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.989+0000 7f1830e19640 1 -- 172.21.15.77:0/4273147215 reap_dead start 2023-11-26T07:21:35.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.989+0000 7f183287c640 1 -- 172.21.15.77:0/4273147215 shutdown_connections 2023-11-26T07:21:35.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.989+0000 7f183287c640 1 -- 172.21.15.77:0/4273147215 >> 172.21.15.77:0/4273147215 conn(0x7f182c09c770 msgr2=0x7f182c0d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:35.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.989+0000 7f183287c640 1 -- 172.21.15.77:0/4273147215 shutdown_connections 2023-11-26T07:21:35.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.989+0000 7f183287c640 1 -- 172.21.15.77:0/4273147215 wait complete. 2023-11-26T07:21:35.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.991+0000 7f183287c640 1 Processor -- start 2023-11-26T07:21:35.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.991+0000 7f183287c640 1 -- start start 2023-11-26T07:21:35.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.992+0000 7f183287c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1818004d00 0x7f182c1f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.992+0000 7f183287c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f182c14a8e0 0x7f182c09e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.992+0000 7f183287c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f182c0c8d90 0x7f182c0c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.992+0000 7f183287c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0c9750 con 0x7f182c0c8d90 2023-11-26T07:21:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.992+0000 7f183287c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c1f6ae0 con 0x7f182c14a8e0 2023-11-26T07:21:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.992+0000 7f183287c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c1481c0 con 0x7f1818004d00 2023-11-26T07:21:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.993+0000 7f1830e19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f182c0c8d90 0x7f182c0c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.993+0000 7f1830e19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f182c0c8d90 0x7f182c0c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52670/0 (socket says 172.21.15.77:52670) 2023-11-26T07:21:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.993+0000 7f1830e19640 1 -- 172.21.15.77:0/283556628 learned_addr learned my addr 172.21.15.77:0/283556628 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.993+0000 7f182bfff640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1818004d00 0x7f182c1f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.993+0000 7f182b7fe640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f182c14a8e0 0x7f182c09e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.993+0000 7f1830e19640 1 -- 172.21.15.77:0/283556628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1818004d00 msgr2=0x7f182c1f65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.993+0000 7f1830e19640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1818004d00 0x7f182c1f65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.993+0000 7f1830e19640 1 -- 172.21.15.77:0/283556628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f182c14a8e0 msgr2=0x7f182c09e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.993+0000 7f1830e19640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f182c14a8e0 0x7f182c09e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.993+0000 7f1830e19640 1 -- 172.21.15.77:0/283556628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c1484a0 con 0x7f182c0c8d90 2023-11-26T07:21:35.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.994+0000 7f1830e19640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f182c0c8d90 0x7f182c0c9210 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f182400e230 tx=0x7f1824009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:35.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.994+0000 7f1828ff9640 1 -- 172.21.15.77:0/283556628 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824034d50 con 0x7f182c0c8d90 2023-11-26T07:21:35.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.994+0000 7f1828ff9640 1 -- 172.21.15.77:0/283556628 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182402de20 con 0x7f182c0c8d90 2023-11-26T07:21:35.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.994+0000 7f1828ff9640 1 -- 172.21.15.77:0/283556628 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824003bd0 con 0x7f182c0c8d90 2023-11-26T07:21:35.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.994+0000 7f183287c640 1 -- 172.21.15.77:0/283556628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c148780 con 0x7f182c0c8d90 2023-11-26T07:21:35.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.994+0000 7f183287c640 1 -- 172.21.15.77:0/283556628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c148d40 con 0x7f182c0c8d90 2023-11-26T07:21:35.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.995+0000 7f183287c640 1 -- 172.21.15.77:0/283556628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182c04e8b0 con 0x7f182c0c8d90 2023-11-26T07:21:35.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.996+0000 7f1828ff9640 1 -- 172.21.15.77:0/283556628 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f1824003d30 con 0x7f182c0c8d90 2023-11-26T07:21:36.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.997+0000 7f1828ff9640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f180c06b3e0 0x7f180c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.998+0000 7f1828ff9640 1 -- 172.21.15.77:0/283556628 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f18240ab740 con 0x7f182c0c8d90 2023-11-26T07:21:36.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.998+0000 7f182bfff640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f180c06b3e0 0x7f180c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:36.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:35.998+0000 7f182bfff640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f180c06b3e0 0x7f180c06d8a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f181c000fd0 tx=0x7f181c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:36.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.002+0000 7f1828ff9640 1 -- 172.21.15.77:0/283556628 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1824076330 con 0x7f182c0c8d90 2023-11-26T07:21:36.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.192+0000 7f183287c640 1 -- 172.21.15.77:0/283556628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f182c0d0ce0 con 0x7f182c0c8d90 2023-11-26T07:21:36.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.199+0000 7f1828ff9640 1 -- 172.21.15.77:0/283556628 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1824079950 con 0x7f182c0c8d90 2023-11-26T07:21:36.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 -- 172.21.15.77:0/283556628 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f180c06b3e0 msgr2=0x7f180c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f180c06b3e0 0x7f180c06d8a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f181c000fd0 tx=0x7f181c009040 comp rx=0 tx=0).stop 2023-11-26T07:21:36.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 -- 172.21.15.77:0/283556628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f182c0c8d90 msgr2=0x7f182c0c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f182c0c8d90 0x7f182c0c9210 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f182400e230 tx=0x7f1824009750 comp rx=0 tx=0).stop 2023-11-26T07:21:36.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 -- 172.21.15.77:0/283556628 shutdown_connections 2023-11-26T07:21:36.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f180c06b3e0 0x7f180c06d8a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f182c0c8d90 0x7f182c0c9210 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f182c14a8e0 0x7f182c09e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 --2- 172.21.15.77:0/283556628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1818004d00 0x7f182c1f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 -- 172.21.15.77:0/283556628 >> 172.21.15.77:0/283556628 conn(0x7f182c09c770 msgr2=0x7f182c0d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:36.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 -- 172.21.15.77:0/283556628 shutdown_connections 2023-11-26T07:21:36.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.202+0000 7f183287c640 1 -- 172.21.15.77:0/283556628 wait complete. 2023-11-26T07:21:36.224 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:21:36.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:21:36.333 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:21:36.456 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:21:36.456 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:36.456 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:36.516 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:21:36.516 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:21:36.516 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:36.577 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:21:36.577 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:36.577 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:36.639 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:21:36.639 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:21:36.639 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:36.698 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:21:36.698 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:21:36.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.916+0000 7f57748c8640 1 Processor -- start 2023-11-26T07:21:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.916+0000 7f57748c8640 1 -- start start 2023-11-26T07:21:36.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.917+0000 7f57748c8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5770144b30 0x7f577015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.917+0000 7f57748c8640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f577015c410 0x7f57700b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.917+0000 7f57748c8640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f57700b1de0 0x7f57700b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.917+0000 7f57748c8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700b27b0 con 0x7f5770144b30 2023-11-26T07:21:36.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.917+0000 7f57748c8640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577015bf80 con 0x7f57700b1de0 2023-11-26T07:21:36.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.917+0000 7f57748c8640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700b1560 con 0x7f577015c410 2023-11-26T07:21:36.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.918+0000 7f576ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5770144b30 0x7f577015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:36.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.918+0000 7f576ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5770144b30 0x7f577015f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52686/0 (socket says 172.21.15.77:52686) 2023-11-26T07:21:36.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.918+0000 7f576ed9d640 1 -- 172.21.15.77:0/567960972 learned_addr learned my addr 172.21.15.77:0/567960972 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.918+0000 7f576ed9d640 1 -- 172.21.15.77:0/567960972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f577015c410 msgr2=0x7f57700b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.918+0000 7f576ed9d640 1 --2- 172.21.15.77:0/567960972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f577015c410 0x7f57700b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.918+0000 7f576ed9d640 1 -- 172.21.15.77:0/567960972 >> v2:172.21.15.159:3300/0 conn(0x7f57700b1de0 msgr2=0x7f57700b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.918+0000 7f576f59e640 1 --2- 172.21.15.77:0/567960972 >> v2:172.21.15.159:3300/0 conn(0x7f57700b1de0 0x7f57700b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.918+0000 7f576ed9d640 1 --2- 172.21.15.77:0/567960972 >> v2:172.21.15.159:3300/0 conn(0x7f57700b1de0 0x7f57700b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.918+0000 7f576ed9d640 1 -- 172.21.15.77:0/567960972 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700b0fb0 con 0x7f5770144b30 2023-11-26T07:21:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.918+0000 7f576f59e640 1 --2- 172.21.15.77:0/567960972 >> v2:172.21.15.159:3300/0 conn(0x7f57700b1de0 0x7f57700b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.919+0000 7f576ed9d640 1 --2- 172.21.15.77:0/567960972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5770144b30 0x7f577015f920 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f577006dec0 tx=0x7f576002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df737287aafe2902 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:36.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.920+0000 7f576dd9b640 1 -- 172.21.15.77:0/567960972 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576002ca80 con 0x7f5770144b30 2023-11-26T07:21:36.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.920+0000 7f576dd9b640 1 -- 172.21.15.77:0/567960972 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576002cbe0 con 0x7f5770144b30 2023-11-26T07:21:36.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.920+0000 7f576dd9b640 1 -- 172.21.15.77:0/567960972 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57600343f0 con 0x7f5770144b30 2023-11-26T07:21:36.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.920+0000 7f57748c8640 1 -- 172.21.15.77:0/567960972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5770144b30 msgr2=0x7f577015f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.920+0000 7f57748c8640 1 --2- 172.21.15.77:0/567960972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5770144b30 0x7f577015f920 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f577006dec0 tx=0x7f576002bee0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.920+0000 7f57748c8640 1 -- 172.21.15.77:0/567960972 shutdown_connections 2023-11-26T07:21:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.920+0000 7f57748c8640 1 --2- 172.21.15.77:0/567960972 >> v2:172.21.15.159:3300/0 conn(0x7f57700b1de0 0x7f57700b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.920+0000 7f57748c8640 1 --2- 172.21.15.77:0/567960972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f577015c410 0x7f57700b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.920+0000 7f57748c8640 1 --2- 172.21.15.77:0/567960972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5770144b30 0x7f577015f920 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.920+0000 7f57748c8640 1 -- 172.21.15.77:0/567960972 >> 172.21.15.77:0/567960972 conn(0x7f57700cb830 msgr2=0x7f57700cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.921+0000 7f57748c8640 1 -- 172.21.15.77:0/567960972 shutdown_connections 2023-11-26T07:21:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.921+0000 7f57748c8640 1 -- 172.21.15.77:0/567960972 wait complete. 2023-11-26T07:21:36.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.922+0000 7f57748c8640 1 Processor -- start 2023-11-26T07:21:36.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.922+0000 7f57748c8640 1 -- start start 2023-11-26T07:21:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.923+0000 7f57748c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57700b1de0 0x7f577015ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.923+0000 7f57748c8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5770144b30 0x7f577015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.923+0000 7f57748c8640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f577015c410 0x7f577015d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.923+0000 7f57748c8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577015b290 con 0x7f57700b1de0 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.923+0000 7f57748c8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57701371f0 con 0x7f5770144b30 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.923+0000 7f57748c8640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57701398a0 con 0x7f577015c410 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.924+0000 7f576ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57700b1de0 0x7f577015ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.924+0000 7f576ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57700b1de0 0x7f577015ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52700/0 (socket says 172.21.15.77:52700) 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.924+0000 7f576ed9d640 1 -- 172.21.15.77:0/3621110605 learned_addr learned my addr 172.21.15.77:0/3621110605 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.924+0000 7f576ed9d640 1 -- 172.21.15.77:0/3621110605 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f577015c410 msgr2=0x7f577015d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.924+0000 7f576ed9d640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f577015c410 0x7f577015d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.924+0000 7f576ed9d640 1 -- 172.21.15.77:0/3621110605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5770144b30 msgr2=0x7f577015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.924+0000 7f576e59c640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5770144b30 0x7f577015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.924+0000 7f576ed9d640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5770144b30 0x7f577015ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.924+0000 7f576ed9d640 1 -- 172.21.15.77:0/3621110605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5760009b30 con 0x7f57700b1de0 2023-11-26T07:21:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.924+0000 7f576e59c640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5770144b30 0x7f577015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.924+0000 7f576ed9d640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57700b1de0 0x7f577015ad50 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5760000f80 tx=0x7f5760004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.925+0000 7f57577fe640 1 -- 172.21.15.77:0/3621110605 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576003e450 con 0x7f57700b1de0 2023-11-26T07:21:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.925+0000 7f57577fe640 1 -- 172.21.15.77:0/3621110605 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576003e5f0 con 0x7f57700b1de0 2023-11-26T07:21:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.925+0000 7f57577fe640 1 -- 172.21.15.77:0/3621110605 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576003e9a0 con 0x7f57700b1de0 2023-11-26T07:21:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.925+0000 7f57748c8640 1 -- 172.21.15.77:0/3621110605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5770139b80 con 0x7f57700b1de0 2023-11-26T07:21:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.925+0000 7f57748c8640 1 -- 172.21.15.77:0/3621110605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577013a140 con 0x7f57700b1de0 2023-11-26T07:21:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.926+0000 7f57748c8640 1 -- 172.21.15.77:0/3621110605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577013a360 con 0x7f57700b1de0 2023-11-26T07:21:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.927+0000 7f57577fe640 1 -- 172.21.15.77:0/3621110605 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f576002cd50 con 0x7f57700b1de0 2023-11-26T07:21:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.928+0000 7f57577fe640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f575c06b3e0 0x7f575c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.928+0000 7f57577fe640 1 -- 172.21.15.77:0/3621110605 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f57600aca10 con 0x7f57700b1de0 2023-11-26T07:21:36.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.928+0000 7f576e59c640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f575c06b3e0 0x7f575c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:36.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.929+0000 7f576e59c640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f575c06b3e0 0x7f575c06d8a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f57700cde60 tx=0x7f5764008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:36.932+0000 7f57577fe640 1 -- 172.21.15.77:0/3621110605 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5760077510 con 0x7f57700b1de0 2023-11-26T07:21:37.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.160+0000 7f57748c8640 1 -- 172.21.15.77:0/3621110605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57700b3610 con 0x7f57700b1de0 2023-11-26T07:21:37.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.162+0000 7f57577fe640 1 -- 172.21.15.77:0/3621110605 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f57700b3610 con 0x7f57700b1de0 2023-11-26T07:21:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:37.164 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/486079893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":486079893},{"type":"v1","addr":"172.21.15.159:6833","nonce":486079893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4951,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2056565249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2056565249},{"type":"v1","addr":"172.21.15.77:6837","nonce":2056565249}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/779604697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":779604697},{"type":"v1","addr":"172.21.15.159:6835","nonce":779604697}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":6123,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2761403311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2761403311},{"type":"v1","addr":"172.21.15.77:6835","nonce":2761403311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[]} 2023-11-26T07:21:37.165 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2023-11-26T07:21:37.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.164+0000 7f57748c8640 1 -- 172.21.15.77:0/3621110605 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f575c06b3e0 msgr2=0x7f575c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.165+0000 7f57748c8640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f575c06b3e0 0x7f575c06d8a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f57700cde60 tx=0x7f5764008040 comp rx=0 tx=0).stop 2023-11-26T07:21:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.165+0000 7f57748c8640 1 -- 172.21.15.77:0/3621110605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57700b1de0 msgr2=0x7f577015ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.165+0000 7f57748c8640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57700b1de0 0x7f577015ad50 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5760000f80 tx=0x7f5760004a40 comp rx=0 tx=0).stop 2023-11-26T07:21:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.165+0000 7f57748c8640 1 -- 172.21.15.77:0/3621110605 shutdown_connections 2023-11-26T07:21:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.165+0000 7f57748c8640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f575c06b3e0 0x7f575c06d8a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.165+0000 7f57748c8640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f577015c410 0x7f577015d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.165+0000 7f57748c8640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5770144b30 0x7f577015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.165+0000 7f57748c8640 1 --2- 172.21.15.77:0/3621110605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57700b1de0 0x7f577015ad50 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.165+0000 7f57748c8640 1 -- 172.21.15.77:0/3621110605 >> 172.21.15.77:0/3621110605 conn(0x7f57700cb830 msgr2=0x7f577015f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.165+0000 7f57748c8640 1 -- 172.21.15.77:0/3621110605 shutdown_connections 2023-11-26T07:21:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.165+0000 7f57748c8640 1 -- 172.21.15.77:0/3621110605 wait complete. 2023-11-26T07:21:37.185 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:21:37.185 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:21:37.185 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:21:37.186 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:21:37.186 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:21:37.186 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:21:37.186 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:21:37.186 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:21:37.186 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:21:37.187 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:21:37.187 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:21:37.187 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:21:37.187 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:21:37.187 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:21:37.187 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:21:37.188 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:21:37.203 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:21:37.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:21:37.206 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:21:37.206 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:21:37.210 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:21:37.210 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:21:37.212 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:21:37.212 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:21:37.254 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:21:37.254 DEBUG:teuthology.parallel:result is None 2023-11-26T07:21:37.260 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:21:37.261 DEBUG:teuthology.parallel:result is None 2023-11-26T07:21:37.261 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:21:37.261 DEBUG:teuthology.parallel:result is None 2023-11-26T07:21:37.268 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:21:37.268 DEBUG:teuthology.parallel:result is None 2023-11-26T07:21:37.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:21:37.416 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-26T07:21:37.416 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-26T07:21:37.428 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-11-26T07:21:37.429 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-11-26T07:21:37.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.453+0000 7f058d0e7640 1 Processor -- start 2023-11-26T07:21:37.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.454+0000 7f058d0e7640 1 -- start start 2023-11-26T07:21:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.455+0000 7f058d0e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05880ccbd0 0x7f05881660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.455+0000 7f058d0e7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880c9650 0x7f05880c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.455+0000 7f058d0e7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05881655f0 con 0x7f05880ccfb0 2023-11-26T07:21:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.455+0000 7f058d0e7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05880cc380 con 0x7f05880ccbd0 2023-11-26T07:21:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.455+0000 7f058d0e7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0588162b30 con 0x7f05880c9650 2023-11-26T07:21:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.455+0000 7f0586d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05880ccbd0 0x7f05881660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.455+0000 7f057ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f05880ccfb0 0x7f0588162000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53554/0 (socket says 172.21.15.77:53554) 2023-11-26T07:21:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.455+0000 7f057ffff640 1 -- 172.21.15.77:0/3034472542 learned_addr learned my addr 172.21.15.77:0/3034472542 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:37.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.455+0000 7f058759e640 1 --2- 172.21.15.77:0/3034472542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880c9650 0x7f05880c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.456+0000 7f0586d9d640 1 -- 172.21.15.77:0/3034472542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880c9650 msgr2=0x7f05880c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.456+0000 7f0586d9d640 1 --2- 172.21.15.77:0/3034472542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880c9650 0x7f05880c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.456+0000 7f0586d9d640 1 -- 172.21.15.77:0/3034472542 >> v1:172.21.15.77:6789/0 conn(0x7f05880ccfb0 legacy=0x7f0588162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.456+0000 7f058659c640 1 -- 172.21.15.77:0/3034472542 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805857527 0 0) 0x7f05881655f0 con 0x7f05880ccfb0 2023-11-26T07:21:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.456+0000 7f0586d9d640 1 -- 172.21.15.77:0/3034472542 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0588162e10 con 0x7f05880ccbd0 2023-11-26T07:21:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.456+0000 7f058759e640 1 --2- 172.21.15.77:0/3034472542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880c9650 0x7f05880c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.457+0000 7f0586d9d640 1 --2- 172.21.15.77:0/3034472542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880ccbd0 0x7f05881660b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f05780097a0 tx=0x7f057802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8620cf5b8fd0f8e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.457+0000 7f058659c640 1 -- 172.21.15.77:0/3034472542 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057802d040 con 0x7f05880ccbd0 2023-11-26T07:21:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.457+0000 7f058659c640 1 -- 172.21.15.77:0/3034472542 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0578031810 con 0x7f05880ccbd0 2023-11-26T07:21:37.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.457+0000 7f058659c640 1 -- 172.21.15.77:0/3034472542 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578031ba0 con 0x7f05880ccbd0 2023-11-26T07:21:37.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.458+0000 7f058d0e7640 1 -- 172.21.15.77:0/3034472542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880ccbd0 msgr2=0x7f05881660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.458+0000 7f058d0e7640 1 --2- 172.21.15.77:0/3034472542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880ccbd0 0x7f05881660b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f05780097a0 tx=0x7f057802b8b0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.458+0000 7f058d0e7640 1 -- 172.21.15.77:0/3034472542 shutdown_connections 2023-11-26T07:21:37.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.458+0000 7f058d0e7640 1 --2- 172.21.15.77:0/3034472542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880c9650 0x7f05880c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.458+0000 7f058d0e7640 1 --2- 172.21.15.77:0/3034472542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880ccbd0 0x7f05881660b0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.458+0000 7f058d0e7640 1 -- 172.21.15.77:0/3034472542 >> 172.21.15.77:0/3034472542 conn(0x7f05880b0c50 msgr2=0x7f05880b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:37.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.458+0000 7f058d0e7640 1 -- 172.21.15.77:0/3034472542 shutdown_connections 2023-11-26T07:21:37.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.458+0000 7f058d0e7640 1 -- 172.21.15.77:0/3034472542 wait complete. 2023-11-26T07:21:37.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.460+0000 7f058d0e7640 1 Processor -- start 2023-11-26T07:21:37.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.460+0000 7f058d0e7640 1 -- start start 2023-11-26T07:21:37.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058d0e7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880c9650 0x7f0588071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058d0e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05880ccbd0 0x7f0588164a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058d0e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880ccfb0 0x7f05880aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058d0e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058815c630 con 0x7f05880ccfb0 2023-11-26T07:21:37.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058d0e7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058815cb60 con 0x7f05880ccbd0 2023-11-26T07:21:37.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058d0e7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0588163ee0 con 0x7f05880c9650 2023-11-26T07:21:37.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880ccfb0 0x7f05880aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880ccfb0 0x7f05880aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52750/0 (socket says 172.21.15.77:52750) 2023-11-26T07:21:37.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058759e640 1 -- 172.21.15.77:0/1075146811 learned_addr learned my addr 172.21.15.77:0/1075146811 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:37.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f0586d9d640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880c9650 0x7f0588071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f057ffff640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05880ccbd0 0x7f0588164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058759e640 1 -- 172.21.15.77:0/1075146811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880c9650 msgr2=0x7f0588071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058759e640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880c9650 0x7f0588071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058759e640 1 -- 172.21.15.77:0/1075146811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05880ccbd0 msgr2=0x7f0588164a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058759e640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05880ccbd0 0x7f0588164a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.461+0000 7f058759e640 1 -- 172.21.15.77:0/1075146811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0578009400 con 0x7f05880ccfb0 2023-11-26T07:21:37.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.462+0000 7f058759e640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880ccfb0 0x7f05880aff60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0580007df0 tx=0x7f058000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:37.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.462+0000 7f057f7fe640 1 -- 172.21.15.77:0/1075146811 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0580003990 con 0x7f05880ccfb0 2023-11-26T07:21:37.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.462+0000 7f057f7fe640 1 -- 172.21.15.77:0/1075146811 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058000f040 con 0x7f05880ccfb0 2023-11-26T07:21:37.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.462+0000 7f058d0e7640 1 -- 172.21.15.77:0/1075146811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05880724d0 con 0x7f05880ccfb0 2023-11-26T07:21:37.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.462+0000 7f057f7fe640 1 -- 172.21.15.77:0/1075146811 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0580003d30 con 0x7f05880ccfb0 2023-11-26T07:21:37.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.462+0000 7f058d0e7640 1 -- 172.21.15.77:0/1075146811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0588163c00 con 0x7f05880ccfb0 2023-11-26T07:21:37.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.463+0000 7f058d0e7640 1 -- 172.21.15.77:0/1075146811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0588163a60 con 0x7f05880ccfb0 2023-11-26T07:21:37.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.464+0000 7f057f7fe640 1 -- 172.21.15.77:0/1075146811 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f0580004030 con 0x7f05880ccfb0 2023-11-26T07:21:37.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.465+0000 7f057f7fe640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f056806b3e0 0x7f056806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.465+0000 7f057f7fe640 1 -- 172.21.15.77:0/1075146811 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f058008a060 con 0x7f05880ccfb0 2023-11-26T07:21:37.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.465+0000 7f0586d9d640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f056806b3e0 0x7f056806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.466+0000 7f0586d9d640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f056806b3e0 0x7f056806d8a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0578036000 tx=0x7f057803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:37.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.470+0000 7f057f7fe640 1 -- 172.21.15.77:0/1075146811 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0588163a60 con 0x7f05880ccfb0 2023-11-26T07:21:37.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.676+0000 7f058d0e7640 1 -- 172.21.15.77:0/1075146811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0588163a60 con 0x7f05880ccfb0 2023-11-26T07:21:37.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.773+0000 7f057f7fe640 1 -- 172.21.15.77:0/1075146811 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0588163a60 con 0x7f05880ccfb0 2023-11-26T07:21:37.775 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2023-11-26T07:21:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 -- 172.21.15.77:0/1075146811 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f056806b3e0 msgr2=0x7f056806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f056806b3e0 0x7f056806d8a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0578036000 tx=0x7f057803c040 comp rx=0 tx=0).stop 2023-11-26T07:21:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 -- 172.21.15.77:0/1075146811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880ccfb0 msgr2=0x7f05880aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880ccfb0 0x7f05880aff60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0580007df0 tx=0x7f058000d4a0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 -- 172.21.15.77:0/1075146811 shutdown_connections 2023-11-26T07:21:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f056806b3e0 0x7f056806d8a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880ccfb0 0x7f05880aff60 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05880ccbd0 0x7f0588164a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 --2- 172.21.15.77:0/1075146811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880c9650 0x7f0588071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 -- 172.21.15.77:0/1075146811 >> 172.21.15.77:0/1075146811 conn(0x7f05880b0c50 msgr2=0x7f058806c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 -- 172.21.15.77:0/1075146811 shutdown_connections 2023-11-26T07:21:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.776+0000 7f058d0e7640 1 -- 172.21.15.77:0/1075146811 wait complete. 2023-11-26T07:21:37.800 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:21:38.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.999+0000 7f1ff6168640 1 Processor -- start 2023-11-26T07:21:38.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:37.999+0000 7f1ff6168640 1 -- start start 2023-11-26T07:21:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.001+0000 7f1ff6168640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1ff015a4f0 0x7f1ff00b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.001+0000 7f1ff6168640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff00b2c00 con 0x7f1ff00cdfb0 2023-11-26T07:21:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.001+0000 7f1ff6168640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff00b3a40 con 0x7f1ff00b27d0 2023-11-26T07:21:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.001+0000 7f1ff6168640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff00b2e30 con 0x7f1ff015a4f0 2023-11-26T07:21:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.001+0000 7f1fef7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1ff015a4f0 0x7f1ff00b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.001+0000 7f1feeffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1ff00cdfb0 0x7f1ff00b20c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53564/0 (socket says 172.21.15.77:53564) 2023-11-26T07:21:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.001+0000 7f1feeffd640 1 -- 172.21.15.77:0/2627873494 learned_addr learned my addr 172.21.15.77:0/2627873494 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.002+0000 7f1fef7fe640 1 -- 172.21.15.77:0/2627873494 >> v1:172.21.15.159:6789/0 conn(0x7f1ff00b27d0 legacy=0x7f1ff00abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.002+0000 7f1fef7fe640 1 -- 172.21.15.77:0/2627873494 >> v1:172.21.15.77:6789/0 conn(0x7f1ff00cdfb0 legacy=0x7f1ff00b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.002+0000 7f1fef7fe640 1 -- 172.21.15.77:0/2627873494 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00b3110 con 0x7f1ff015a4f0 2023-11-26T07:21:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.002+0000 7f1fee7fc640 1 -- 172.21.15.77:0/2627873494 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851402451 0 0) 0x7f1ff00b2c00 con 0x7f1ff00cdfb0 2023-11-26T07:21:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.003+0000 7f1fef7fe640 1 --2- 172.21.15.77:0/2627873494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff015a4f0 0x7f1ff00b3ed0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00097a0 tx=0x7f1fe002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760f3af46b93e985 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.003+0000 7f1fee7fc640 1 -- 172.21.15.77:0/2627873494 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0031830 con 0x7f1ff015a4f0 2023-11-26T07:21:38.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.003+0000 7f1fee7fc640 1 -- 172.21.15.77:0/2627873494 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe0031990 con 0x7f1ff015a4f0 2023-11-26T07:21:38.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.003+0000 7f1fee7fc640 1 -- 172.21.15.77:0/2627873494 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0031d20 con 0x7f1ff015a4f0 2023-11-26T07:21:38.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.004+0000 7f1ff6168640 1 -- 172.21.15.77:0/2627873494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff015a4f0 msgr2=0x7f1ff00b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.004+0000 7f1ff6168640 1 --2- 172.21.15.77:0/2627873494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff015a4f0 0x7f1ff00b3ed0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00097a0 tx=0x7f1fe002b8d0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.004+0000 7f1ff6168640 1 -- 172.21.15.77:0/2627873494 shutdown_connections 2023-11-26T07:21:38.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.004+0000 7f1ff6168640 1 --2- 172.21.15.77:0/2627873494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff015a4f0 0x7f1ff00b3ed0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.004+0000 7f1ff6168640 1 -- 172.21.15.77:0/2627873494 >> 172.21.15.77:0/2627873494 conn(0x7f1ff00b0c70 msgr2=0x7f1ff00b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:38.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.004+0000 7f1ff6168640 1 -- 172.21.15.77:0/2627873494 shutdown_connections 2023-11-26T07:21:38.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.004+0000 7f1ff6168640 1 -- 172.21.15.77:0/2627873494 wait complete. 2023-11-26T07:21:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.006+0000 7f1ff6168640 1 Processor -- start 2023-11-26T07:21:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.006+0000 7f1ff6168640 1 -- start start 2023-11-26T07:21:38.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.007+0000 7f1ff6168640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00b27d0 0x7f1ff00af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.007+0000 7f1ff6168640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ff00cdfb0 0x7f1ff014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.007+0000 7f1ff6168640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1ff015a4f0 0x7f1ff014b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.007+0000 7f1ff6168640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff014b590 con 0x7f1ff00b27d0 2023-11-26T07:21:38.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.007+0000 7f1ff6168640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00ca400 con 0x7f1ff00cdfb0 2023-11-26T07:21:38.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.007+0000 7f1ff6168640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff014cf10 con 0x7f1ff015a4f0 2023-11-26T07:21:38.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.008+0000 7f1fef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00b27d0 0x7f1ff00af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.008+0000 7f1fef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00b27d0 0x7f1ff00af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52778/0 (socket says 172.21.15.77:52778) 2023-11-26T07:21:38.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.008+0000 7f1fef7fe640 1 -- 172.21.15.77:0/1739459991 learned_addr learned my addr 172.21.15.77:0/1739459991 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:38.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.008+0000 7f1fef7fe640 1 -- 172.21.15.77:0/1739459991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1ff015a4f0 msgr2=0x7f1ff014b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.008+0000 7f1fef7fe640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1ff015a4f0 0x7f1ff014b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.008+0000 7f1fef7fe640 1 -- 172.21.15.77:0/1739459991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ff00cdfb0 msgr2=0x7f1ff014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.008+0000 7f1fef7fe640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ff00cdfb0 0x7f1ff014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.008+0000 7f1fef7fe640 1 -- 172.21.15.77:0/1739459991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe0009400 con 0x7f1ff00b27d0 2023-11-26T07:21:38.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.008+0000 7f1fef7fe640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00b27d0 0x7f1ff00af220 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00098c0 tx=0x7f1fe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.009+0000 7f1fd7fff640 1 -- 172.21.15.77:0/1739459991 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe003aa60 con 0x7f1ff00b27d0 2023-11-26T07:21:38.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.009+0000 7f1fd7fff640 1 -- 172.21.15.77:0/1739459991 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe003abc0 con 0x7f1ff00b27d0 2023-11-26T07:21:38.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.009+0000 7f1fd7fff640 1 -- 172.21.15.77:0/1739459991 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00443f0 con 0x7f1ff00b27d0 2023-11-26T07:21:38.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.009+0000 7f1ff6168640 1 -- 172.21.15.77:0/1739459991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff014d1f0 con 0x7f1ff00b27d0 2023-11-26T07:21:38.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.009+0000 7f1ff6168640 1 -- 172.21.15.77:0/1739459991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff00cc8a0 con 0x7f1ff00b27d0 2023-11-26T07:21:38.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.010+0000 7f1ff6168640 1 -- 172.21.15.77:0/1739459991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff004e8b0 con 0x7f1ff00b27d0 2023-11-26T07:21:38.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.011+0000 7f1fd7fff640 1 -- 172.21.15.77:0/1739459991 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f1fe004d450 con 0x7f1ff00b27d0 2023-11-26T07:21:38.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.012+0000 7f1fd7fff640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1fdc06b3e0 0x7f1fdc06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.012+0000 7f1fd7fff640 1 -- 172.21.15.77:0/1739459991 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1fe00ac0b0 con 0x7f1ff00b27d0 2023-11-26T07:21:38.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.012+0000 7f1feeffd640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1fdc06b3e0 0x7f1fdc06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.013+0000 7f1feeffd640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1fdc06b3e0 0x7f1fdc06d8a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4007fd0 tx=0x7f1fe4007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.016+0000 7f1fd7fff640 1 -- 172.21.15.77:0/1739459991 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1fe0076af0 con 0x7f1ff00b27d0 2023-11-26T07:21:38.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.270+0000 7f1ff6168640 1 -- 172.21.15.77:0/1739459991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1ff0067900 con 0x7f1ff00b27d0 2023-11-26T07:21:38.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.272+0000 7f1fd7fff640 1 -- 172.21.15.77:0/1739459991 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1fe007a110 con 0x7f1ff00b27d0 2023-11-26T07:21:38.274 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:38.275 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:21:38.275 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2023-11-26T07:21:38.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.275 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2023-11-26T07:21:38.275 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJls/H7KhAAJS2XRN0c7/K+7oskAg2PWQ==", 2023-11-26T07:21:38.275 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.275 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:21:38.275 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:21:38.275 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJljSp5DRAAOH30kXLDMsVQpQomhskVow==", 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.276 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJlejOkOBAAdCCERoTPpw8Fk1PciaPtag==", 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJl5HpoHhAAaW2/GvlUZsizM1A5Gd3U7A==", 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2023-11-26T07:21:38.278 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDS8GJlaI6nFxAARyjS0s1azVjAfqdNZIT4BA==", 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDV8GJl+YY9IhAAPh7GuZ2EhEZBybZJJL16gA==", 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:21:38.279 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDY8GJlWjPxOhAApethgteKlUOMhor55mJc9A==", 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDc8GJl9OCqFxAAJeYH2CcWuQG8iILjc/PmTw==", 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDj8GJlVXaWGxAAfxXHfo561p+2qKX1+9C7+A==", 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.281 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDm8GJlrAsENhAALSWl4bAiy33+ZxX95xvcIw==", 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.282 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDq8GJlUm5MEhAAVlkzzyqBJP1qdcuCfwhZmw==", 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.283 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDt8GJlhvw+KxAAfn+Rklyv9MbMoGvi64A3eQ==", 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJlhqOIKxAAiafAbVhNu4B+yTd/1i7+1A==", 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.284 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow r", 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDO8GJlTnRuBhAA00v94pDxY21mhcK5h8b5ag==", 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:21:38.285 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJlCgKpNhAAX0HSBMyXxclLtvXwdw4gBQ==", 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDO8GJlFP2HERAA02DfbslNoErl7daZAir6yw==", 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2023-11-26T07:21:38.287 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDL8GJlGorHHhAAWxHMjiSUuG8u/Jl0dYqSBg==", 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJlYYTeIBAATi/P7CpbfWNxuKAyi2DChA==", 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.288 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJl07f3FBAAL3JjjVDVa3eQe+Phdo0agw==", 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.289 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:38.290 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2023-11-26T07:21:38.290 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:21:38.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 -- 172.21.15.77:0/1739459991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1fdc06b3e0 msgr2=0x7f1fdc06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1fdc06b3e0 0x7f1fdc06d8a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4007fd0 tx=0x7f1fe4007920 comp rx=0 tx=0).stop 2023-11-26T07:21:38.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 -- 172.21.15.77:0/1739459991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00b27d0 msgr2=0x7f1ff00af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00b27d0 0x7f1ff00af220 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00098c0 tx=0x7f1fe00046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 -- 172.21.15.77:0/1739459991 shutdown_connections 2023-11-26T07:21:38.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1fdc06b3e0 0x7f1fdc06d8a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1ff015a4f0 0x7f1ff014b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ff00cdfb0 0x7f1ff014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 --2- 172.21.15.77:0/1739459991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00b27d0 0x7f1ff00af220 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 -- 172.21.15.77:0/1739459991 >> 172.21.15.77:0/1739459991 conn(0x7f1ff00b0c70 msgr2=0x7f1ff00ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:38.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 -- 172.21.15.77:0/1739459991 shutdown_connections 2023-11-26T07:21:38.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.274+0000 7f1ff6168640 1 -- 172.21.15.77:0/1739459991 wait complete. 2023-11-26T07:21:38.295 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:38.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.497+0000 7f678fe94640 1 Processor -- start 2023-11-26T07:21:38.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.497+0000 7f678fe94640 1 -- start start 2023-11-26T07:21:38.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.499+0000 7f678fe94640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6788157c70 0x7f6788161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.499+0000 7f678fe94640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f67880cf450 0x7f67880cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.499+0000 7f678fe94640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67880ce0b0 con 0x7f678815dc80 2023-11-26T07:21:38.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.499+0000 7f678fe94640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67880cfe40 con 0x7f67880cf450 2023-11-26T07:21:38.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.499+0000 7f678fe94640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6788161960 con 0x7f6788157c70 2023-11-26T07:21:38.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.499+0000 7f678d42f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f67880cf450 0x7f67880cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.499+0000 7f678d42f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f67880cf450 0x7f67880cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52790/0 (socket says 172.21.15.77:52790) 2023-11-26T07:21:38.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.499+0000 7f678d42f640 1 -- 172.21.15.77:0/331935922 learned_addr learned my addr 172.21.15.77:0/331935922 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:38.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.500+0000 7f678d42f640 1 -- 172.21.15.77:0/331935922 >> v2:172.21.15.159:3300/0 conn(0x7f6788157c70 msgr2=0x7f6788161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:38.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.500+0000 7f678dc30640 1 --2- 172.21.15.77:0/331935922 >> v2:172.21.15.159:3300/0 conn(0x7f6788157c70 0x7f6788161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.500+0000 7f678d42f640 1 --2- 172.21.15.77:0/331935922 >> v2:172.21.15.159:3300/0 conn(0x7f6788157c70 0x7f6788161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.500+0000 7f678d42f640 1 -- 172.21.15.77:0/331935922 >> v1:172.21.15.159:6789/0 conn(0x7f678815dc80 legacy=0x7f678815e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:38.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.500+0000 7f678d42f640 1 -- 172.21.15.77:0/331935922 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678815e8d0 con 0x7f67880cf450 2023-11-26T07:21:38.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.500+0000 7f678dc30640 1 --2- 172.21.15.77:0/331935922 >> v2:172.21.15.159:3300/0 conn(0x7f6788157c70 0x7f6788161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:38.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.501+0000 7f678d42f640 1 --2- 172.21.15.77:0/331935922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67880cf450 0x7f67880cf900 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f678806d5e0 tx=0x7f677802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6ab3d5a4e254f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.501+0000 7f678cc2e640 1 -- 172.21.15.77:0/331935922 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780317e0 con 0x7f67880cf450 2023-11-26T07:21:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.501+0000 7f678cc2e640 1 -- 172.21.15.77:0/331935922 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778031940 con 0x7f67880cf450 2023-11-26T07:21:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.501+0000 7f678cc2e640 1 -- 172.21.15.77:0/331935922 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778031cd0 con 0x7f67880cf450 2023-11-26T07:21:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.502+0000 7f678fe94640 1 -- 172.21.15.77:0/331935922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67880cf450 msgr2=0x7f67880cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.502+0000 7f678fe94640 1 --2- 172.21.15.77:0/331935922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67880cf450 0x7f67880cf900 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f678806d5e0 tx=0x7f677802b880 comp rx=0 tx=0).stop 2023-11-26T07:21:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.502+0000 7f678fe94640 1 -- 172.21.15.77:0/331935922 shutdown_connections 2023-11-26T07:21:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.502+0000 7f678fe94640 1 --2- 172.21.15.77:0/331935922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67880cf450 0x7f67880cf900 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.502+0000 7f678fe94640 1 --2- 172.21.15.77:0/331935922 >> v2:172.21.15.159:3300/0 conn(0x7f6788157c70 0x7f6788161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.502+0000 7f678fe94640 1 -- 172.21.15.77:0/331935922 >> 172.21.15.77:0/331935922 conn(0x7f678806a920 msgr2=0x7f678806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.502+0000 7f678fe94640 1 -- 172.21.15.77:0/331935922 shutdown_connections 2023-11-26T07:21:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.502+0000 7f678fe94640 1 -- 172.21.15.77:0/331935922 wait complete. 2023-11-26T07:21:38.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.503+0000 7f678fe94640 1 Processor -- start 2023-11-26T07:21:38.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.503+0000 7f678fe94640 1 -- start start 2023-11-26T07:21:38.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.504+0000 7f678fe94640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67880cf450 0x7f67880af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.504+0000 7f678fe94640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6788157c70 0x7f6788154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.504+0000 7f678fe94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678815dc80 0x7f67880ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.504+0000 7f678fe94640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67880c9690 con 0x7f678815dc80 2023-11-26T07:21:38.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.504+0000 7f678fe94640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67880ade00 con 0x7f67880cf450 2023-11-26T07:21:38.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.504+0000 7f678fe94640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67880ae0e0 con 0x7f6788157c70 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.505+0000 7f678e431640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678815dc80 0x7f67880ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.505+0000 7f678e431640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678815dc80 0x7f67880ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52798/0 (socket says 172.21.15.77:52798) 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.505+0000 7f678e431640 1 -- 172.21.15.77:0/1578104555 learned_addr learned my addr 172.21.15.77:0/1578104555 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.505+0000 7f678e431640 1 -- 172.21.15.77:0/1578104555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6788157c70 msgr2=0x7f6788154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.505+0000 7f678e431640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6788157c70 0x7f6788154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.505+0000 7f678e431640 1 -- 172.21.15.77:0/1578104555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67880cf450 msgr2=0x7f67880af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.505+0000 7f678e431640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67880cf450 0x7f67880af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.505+0000 7f678e431640 1 -- 172.21.15.77:0/1578104555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67780094d0 con 0x7f678815dc80 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.505+0000 7f678e431640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678815dc80 0x7f67880ca3a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f678000c780 tx=0x7f678000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.506+0000 7f677e7fc640 1 -- 172.21.15.77:0/1578104555 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780004b10 con 0x7f678815dc80 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.506+0000 7f677e7fc640 1 -- 172.21.15.77:0/1578104555 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6780004c70 con 0x7f678815dc80 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.506+0000 7f677e7fc640 1 -- 172.21.15.77:0/1578104555 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000aa90 con 0x7f678815dc80 2023-11-26T07:21:38.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.506+0000 7f678fe94640 1 -- 172.21.15.77:0/1578104555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67880ae3c0 con 0x7f678815dc80 2023-11-26T07:21:38.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.506+0000 7f678fe94640 1 -- 172.21.15.77:0/1578104555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67880ae980 con 0x7f678815dc80 2023-11-26T07:21:38.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.507+0000 7f678fe94640 1 -- 172.21.15.77:0/1578104555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67881f3950 con 0x7f678815dc80 2023-11-26T07:21:38.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.508+0000 7f677e7fc640 1 -- 172.21.15.77:0/1578104555 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f678000abf0 con 0x7f678815dc80 2023-11-26T07:21:38.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.509+0000 7f677e7fc640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f676c06b3e0 0x7f676c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.509+0000 7f677e7fc640 1 -- 172.21.15.77:0/1578104555 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f678008a0e0 con 0x7f678815dc80 2023-11-26T07:21:38.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.509+0000 7f678dc30640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f676c06b3e0 0x7f676c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.509+0000 7f678dc30640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f676c06b3e0 0x7f676c06d8a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6784006fd0 tx=0x7f6784008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.513+0000 7f677e7fc640 1 -- 172.21.15.77:0/1578104555 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f67800bce90 con 0x7f678815dc80 2023-11-26T07:21:38.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.690+0000 7f678fe94640 1 -- 172.21.15.77:0/1578104555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6788067470 con 0x7f678815dc80 2023-11-26T07:21:38.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.691+0000 7f677e7fc640 1 -- 172.21.15.77:0/1578104555 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+12833 (secure 0 0 0) 0x7f67881f3950 con 0x7f678815dc80 2023-11-26T07:21:38.694 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":58,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:21:37.788170+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:38.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.693+0000 7f678fe94640 1 -- 172.21.15.77:0/1578104555 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f676c06b3e0 msgr2=0x7f676c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.693+0000 7f678fe94640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f676c06b3e0 0x7f676c06d8a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6784006fd0 tx=0x7f6784008040 comp rx=0 tx=0).stop 2023-11-26T07:21:38.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.693+0000 7f678fe94640 1 -- 172.21.15.77:0/1578104555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678815dc80 msgr2=0x7f67880ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.693+0000 7f678fe94640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678815dc80 0x7f67880ca3a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f678000c780 tx=0x7f678000cc40 comp rx=0 tx=0).stop 2023-11-26T07:21:38.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.694+0000 7f678fe94640 1 -- 172.21.15.77:0/1578104555 shutdown_connections 2023-11-26T07:21:38.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.694+0000 7f678fe94640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f676c06b3e0 0x7f676c06d8a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.694+0000 7f678fe94640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678815dc80 0x7f67880ca3a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.694+0000 7f678fe94640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6788157c70 0x7f6788154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.694+0000 7f678fe94640 1 --2- 172.21.15.77:0/1578104555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67880cf450 0x7f67880af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.694+0000 7f678fe94640 1 -- 172.21.15.77:0/1578104555 >> 172.21.15.77:0/1578104555 conn(0x7f678806a920 msgr2=0x7f678806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:38.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.694+0000 7f678fe94640 1 -- 172.21.15.77:0/1578104555 shutdown_connections 2023-11-26T07:21:38.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.694+0000 7f678fe94640 1 -- 172.21.15.77:0/1578104555 wait complete. 2023-11-26T07:21:38.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:21:38.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:21:38.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.924+0000 7f1f53ae7640 1 Processor -- start 2023-11-26T07:21:38.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.924+0000 7f1f53ae7640 1 -- start start 2023-11-26T07:21:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.926+0000 7f1f53ae7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f4c15b440 0x7f1f4c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.926+0000 7f1f53ae7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c0cc3a0 con 0x7f1f4c0cbf20 2023-11-26T07:21:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.926+0000 7f1f53ae7640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c15eea0 con 0x7f1f4c0c59b0 2023-11-26T07:21:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.926+0000 7f1f53ae7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c15b820 con 0x7f1f4c15b440 2023-11-26T07:21:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.926+0000 7f1f51082640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1f4c0cbf20 0x7f1f4c0c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53570/0 (socket says 172.21.15.77:53570) 2023-11-26T07:21:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.926+0000 7f1f51082640 1 -- 172.21.15.77:0/2973751098 learned_addr learned my addr 172.21.15.77:0/2973751098 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589421320 0 0) 0x7f1f3c001110 con 0x7f1f4c0cbf20 2023-11-26T07:21:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f51883640 1 --2- 172.21.15.77:0/2973751098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f4c15b440 0x7f1f4c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f38003520 con 0x7f1f4c0cbf20 2023-11-26T07:21:38.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1377781703 0 0) 0x7f1f38003520 con 0x7f1f4c0cbf20 2023-11-26T07:21:38.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f4c15b440 msgr2=0x7f1f4c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 --2- 172.21.15.77:0/2973751098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f4c15b440 0x7f1f4c0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 >> v1:172.21.15.159:6789/0 conn(0x7f1f4c0c59b0 legacy=0x7f1f4c06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0abf30 con 0x7f1f4c0cbf20 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f1f3c001800 con 0x7f1f4c0cbf20 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 >> v1:172.21.15.77:6789/0 conn(0x7f1f4c0cbf20 legacy=0x7f1f4c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 --2- 172.21.15.77:0/2973751098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f380039a0 0x7f1f38003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 --2- 172.21.15.77:0/2973751098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f4c15b440 0x7f1f380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 --2- 172.21.15.77:0/2973751098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f38004d00 0x7f1f38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c15b820 con 0x7f1f380039a0 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3800bb40 con 0x7f1f38004d00 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3800bd00 con 0x7f1f4c15b440 2023-11-26T07:21:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.927+0000 7f1f51883640 1 --2- 172.21.15.77:0/2973751098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f380039a0 0x7f1f38003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.928+0000 7f1f51883640 1 -- 172.21.15.77:0/2973751098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f4c15b440 msgr2=0x7f1f380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:38.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.928+0000 7f1f51883640 1 --2- 172.21.15.77:0/2973751098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f4c15b440 0x7f1f380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.928+0000 7f1f51883640 1 -- 172.21.15.77:0/2973751098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f38004d00 msgr2=0x7f1f38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:38.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.928+0000 7f1f51883640 1 --2- 172.21.15.77:0/2973751098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f38004d00 0x7f1f38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.928+0000 7f1f51883640 1 -- 172.21.15.77:0/2973751098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38003520 con 0x7f1f380039a0 2023-11-26T07:21:38.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.929+0000 7f1f51883640 1 --2- 172.21.15.77:0/2973751098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f380039a0 0x7f1f38003da0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800ba00 tx=0x7f1f380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237a767c6c085b88 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.929+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48032640 con 0x7f1f380039a0 2023-11-26T07:21:38.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.929+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f480327a0 con 0x7f1f380039a0 2023-11-26T07:21:38.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.929+0000 7f1f50881640 1 -- 172.21.15.77:0/2973751098 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48032b30 con 0x7f1f380039a0 2023-11-26T07:21:38.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.929+0000 7f1f53ae7640 1 -- 172.21.15.77:0/2973751098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f380039a0 msgr2=0x7f1f38003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.929+0000 7f1f53ae7640 1 --2- 172.21.15.77:0/2973751098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f380039a0 0x7f1f38003da0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800ba00 tx=0x7f1f380057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.930+0000 7f1f52084640 1 -- 172.21.15.77:0/2973751098 reap_dead start 2023-11-26T07:21:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.930+0000 7f1f53ae7640 1 -- 172.21.15.77:0/2973751098 shutdown_connections 2023-11-26T07:21:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.930+0000 7f1f53ae7640 1 -- 172.21.15.77:0/2973751098 >> 172.21.15.77:0/2973751098 conn(0x7f1f4c0b0c50 msgr2=0x7f1f4c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.930+0000 7f1f53ae7640 1 -- 172.21.15.77:0/2973751098 shutdown_connections 2023-11-26T07:21:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.930+0000 7f1f53ae7640 1 -- 172.21.15.77:0/2973751098 wait complete. 2023-11-26T07:21:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.931+0000 7f1f53ae7640 1 Processor -- start 2023-11-26T07:21:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.931+0000 7f1f53ae7640 1 -- start start 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.932+0000 7f1f53ae7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f380039a0 0x7f1f4c15d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.932+0000 7f1f53ae7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f4c0b4b40 0x7f1f4c15dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.932+0000 7f1f53ae7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f4c0c7120 0x7f1f4c0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.932+0000 7f1f53ae7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0c7e10 con 0x7f1f4c0c7120 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.932+0000 7f1f53ae7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0c80f0 con 0x7f1f380039a0 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.932+0000 7f1f53ae7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0c83d0 con 0x7f1f4c0b4b40 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.933+0000 7f1f52084640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f4c0c7120 0x7f1f4c0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.933+0000 7f1f52084640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f4c0c7120 0x7f1f4c0c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52812/0 (socket says 172.21.15.77:52812) 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.933+0000 7f1f52084640 1 -- 172.21.15.77:0/44910733 learned_addr learned my addr 172.21.15.77:0/44910733 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.933+0000 7f1f51883640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f380039a0 0x7f1f4c15d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.933+0000 7f1f52084640 1 -- 172.21.15.77:0/44910733 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f4c0b4b40 msgr2=0x7f1f4c15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.933+0000 7f1f52084640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f4c0b4b40 0x7f1f4c15dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.933+0000 7f1f52084640 1 -- 172.21.15.77:0/44910733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f380039a0 msgr2=0x7f1f4c15d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.933+0000 7f1f52084640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f380039a0 0x7f1f4c15d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.933+0000 7f1f52084640 1 -- 172.21.15.77:0/44910733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0c86b0 con 0x7f1f4c0c7120 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.933+0000 7f1f51883640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f380039a0 0x7f1f4c15d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.933+0000 7f1f52084640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f4c0c7120 0x7f1f4c0c75a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c06e770 tx=0x7f1f4400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.934+0000 7f1f427fc640 1 -- 172.21.15.77:0/44910733 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44007070 con 0x7f1f4c0c7120 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.934+0000 7f1f427fc640 1 -- 172.21.15.77:0/44910733 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f440071f0 con 0x7f1f4c0c7120 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.934+0000 7f1f427fc640 1 -- 172.21.15.77:0/44910733 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440075a0 con 0x7f1f4c0c7120 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.934+0000 7f1f53ae7640 1 -- 172.21.15.77:0/44910733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c0c8990 con 0x7f1f4c0c7120 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.934+0000 7f1f53ae7640 1 -- 172.21.15.77:0/44910733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c15b960 con 0x7f1f4c0c7120 2023-11-26T07:21:38.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.935+0000 7f1f53ae7640 1 -- 172.21.15.77:0/44910733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c0c8b50 con 0x7f1f4c0c7120 2023-11-26T07:21:38.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.936+0000 7f1f427fc640 1 -- 172.21.15.77:0/44910733 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f1f44007700 con 0x7f1f4c0c7120 2023-11-26T07:21:38.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.936+0000 7f1f427fc640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f3006b410 0x7f1f3006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.937+0000 7f1f427fc640 1 -- 172.21.15.77:0/44910733 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1f44089220 con 0x7f1f4c0c7120 2023-11-26T07:21:38.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.937+0000 7f1f51883640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f3006b410 0x7f1f3006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.937+0000 7f1f51883640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f3006b410 0x7f1f3006d8d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1f38004740 tx=0x7f1f4803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:38.941+0000 7f1f427fc640 1 -- 172.21.15.77:0/44910733 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f44053d20 con 0x7f1f4c0c7120 2023-11-26T07:21:39.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.117+0000 7f1f53ae7640 1 -- 172.21.15.77:0/44910733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f4c0b2a10 con 0x7f1f4c0c7120 2023-11-26T07:21:39.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.118+0000 7f1f427fc640 1 -- 172.21.15.77:0/44910733 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f440170a0 con 0x7f1f4c0c7120 2023-11-26T07:21:39.121 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:21:39.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.120+0000 7f1f53ae7640 1 -- 172.21.15.77:0/44910733 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f3006b410 msgr2=0x7f1f3006d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.120+0000 7f1f53ae7640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f3006b410 0x7f1f3006d8d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1f38004740 tx=0x7f1f4803d040 comp rx=0 tx=0).stop 2023-11-26T07:21:39.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.120+0000 7f1f53ae7640 1 -- 172.21.15.77:0/44910733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f4c0c7120 msgr2=0x7f1f4c0c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.120+0000 7f1f53ae7640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f4c0c7120 0x7f1f4c0c75a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c06e770 tx=0x7f1f4400c980 comp rx=0 tx=0).stop 2023-11-26T07:21:39.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.121+0000 7f1f53ae7640 1 -- 172.21.15.77:0/44910733 shutdown_connections 2023-11-26T07:21:39.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.121+0000 7f1f53ae7640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1f3006b410 0x7f1f3006d8d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.121+0000 7f1f53ae7640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f4c0c7120 0x7f1f4c0c75a0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.121+0000 7f1f53ae7640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f4c0b4b40 0x7f1f4c15dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.121+0000 7f1f53ae7640 1 --2- 172.21.15.77:0/44910733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f380039a0 0x7f1f4c15d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.121+0000 7f1f53ae7640 1 -- 172.21.15.77:0/44910733 >> 172.21.15.77:0/44910733 conn(0x7f1f4c0b0c50 msgr2=0x7f1f4c0c4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:39.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.121+0000 7f1f53ae7640 1 -- 172.21.15.77:0/44910733 shutdown_connections 2023-11-26T07:21:39.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.121+0000 7f1f53ae7640 1 -- 172.21.15.77:0/44910733 wait complete. 2023-11-26T07:21:39.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:21:39.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.346+0000 7f671aa61640 1 Processor -- start 2023-11-26T07:21:39.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.346+0000 7f671aa61640 1 -- start start 2023-11-26T07:21:39.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.347+0000 7f671aa61640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67140cfb60 0x7f6714161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.347+0000 7f671aa61640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f671415dc80 0x7f671415e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.347+0000 7f671aa61640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67140ce0b0 con 0x7f6714157c70 2023-11-26T07:21:39.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.347+0000 7f671aa61640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6714161960 con 0x7f671415dc80 2023-11-26T07:21:39.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.347+0000 7f671aa61640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671415e670 con 0x7f67140cfb60 2023-11-26T07:21:39.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.348+0000 7f6718ffe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f671415dc80 0x7f671415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.348+0000 7f670bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67140cfb60 0x7f6714161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.348+0000 7f6713fff640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f6714157c70 0x7f67140cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:35396/0 (socket says 172.21.15.77:35396) 2023-11-26T07:21:39.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.348+0000 7f6713fff640 1 -- 172.21.15.77:0/3119218306 learned_addr learned my addr 172.21.15.77:0/3119218306 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:39.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.350+0000 7f6718ffe640 1 -- 172.21.15.77:0/3119218306 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67140cfb60 msgr2=0x7f6714161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:39.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.350+0000 7f6718ffe640 1 --2- 172.21.15.77:0/3119218306 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67140cfb60 0x7f6714161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.349+0000 7f67137fe640 1 -- 172.21.15.77:0/3119218306 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078465302 0 0) 0x7f67140ce0b0 con 0x7f6714157c70 2023-11-26T07:21:39.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.350+0000 7f6718ffe640 1 -- 172.21.15.77:0/3119218306 >> v1:172.21.15.159:6789/0 conn(0x7f6714157c70 legacy=0x7f67140cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.350+0000 7f6718ffe640 1 -- 172.21.15.77:0/3119218306 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671415e8d0 con 0x7f671415dc80 2023-11-26T07:21:39.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.350+0000 7f670bfff640 1 --2- 172.21.15.77:0/3119218306 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67140cfb60 0x7f6714161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:39.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.351+0000 7f6718ffe640 1 --2- 172.21.15.77:0/3119218306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f671415dc80 0x7f671415e130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f670c009d90 tx=0x7f670c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e193a12bc02f36e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:39.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.351+0000 7f67137fe640 1 -- 172.21.15.77:0/3119218306 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c02cbd0 con 0x7f671415dc80 2023-11-26T07:21:39.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.351+0000 7f67137fe640 1 -- 172.21.15.77:0/3119218306 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c02cd30 con 0x7f671415dc80 2023-11-26T07:21:39.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.351+0000 7f67137fe640 1 -- 172.21.15.77:0/3119218306 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c02cea0 con 0x7f671415dc80 2023-11-26T07:21:39.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.352+0000 7f671aa61640 1 -- 172.21.15.77:0/3119218306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f671415dc80 msgr2=0x7f671415e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.352+0000 7f671aa61640 1 --2- 172.21.15.77:0/3119218306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f671415dc80 0x7f671415e130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f670c009d90 tx=0x7f670c02be20 comp rx=0 tx=0).stop 2023-11-26T07:21:39.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.352+0000 7f671aa61640 1 -- 172.21.15.77:0/3119218306 shutdown_connections 2023-11-26T07:21:39.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.352+0000 7f671aa61640 1 --2- 172.21.15.77:0/3119218306 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67140cfb60 0x7f6714161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.352+0000 7f671aa61640 1 --2- 172.21.15.77:0/3119218306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f671415dc80 0x7f671415e130 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.352+0000 7f671aa61640 1 -- 172.21.15.77:0/3119218306 >> 172.21.15.77:0/3119218306 conn(0x7f671406a920 msgr2=0x7f671406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:39.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.352+0000 7f671aa61640 1 -- 172.21.15.77:0/3119218306 shutdown_connections 2023-11-26T07:21:39.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.352+0000 7f671aa61640 1 -- 172.21.15.77:0/3119218306 wait complete. 2023-11-26T07:21:39.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.354+0000 7f671aa61640 1 Processor -- start 2023-11-26T07:21:39.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.355+0000 7f671aa61640 1 -- start start 2023-11-26T07:21:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.356+0000 7f671aa61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140cfb60 0x7f67141f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.356+0000 7f671aa61640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6714157c70 0x7f67140aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.356+0000 7f671aa61640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f671415dc80 0x7f67140b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.356+0000 7f671aa61640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67141f2df0 con 0x7f67140cfb60 2023-11-26T07:21:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.356+0000 7f671aa61640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67141f6560 con 0x7f671415dc80 2023-11-26T07:21:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.356+0000 7f671aa61640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67141f6840 con 0x7f6714157c70 2023-11-26T07:21:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.356+0000 7f6713fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140cfb60 0x7f67141f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.356+0000 7f6713fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140cfb60 0x7f67141f28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52824/0 (socket says 172.21.15.77:52824) 2023-11-26T07:21:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.356+0000 7f6713fff640 1 -- 172.21.15.77:0/3271264493 learned_addr learned my addr 172.21.15.77:0/3271264493 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.356+0000 7f670bfff640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6714157c70 0x7f67140aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f6718ffe640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f671415dc80 0x7f67140b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f6713fff640 1 -- 172.21.15.77:0/3271264493 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6714157c70 msgr2=0x7f67140aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f6713fff640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6714157c70 0x7f67140aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f6713fff640 1 -- 172.21.15.77:0/3271264493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f671415dc80 msgr2=0x7f67140b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f6713fff640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f671415dc80 0x7f67140b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f6713fff640 1 -- 172.21.15.77:0/3271264493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc009400 con 0x7f67140cfb60 2023-11-26T07:21:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f6713fff640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140cfb60 0x7f67141f28b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f670400c4d0 tx=0x7f670400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f67117fa640 1 -- 172.21.15.77:0/3271264493 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040074e0 con 0x7f67140cfb60 2023-11-26T07:21:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f67117fa640 1 -- 172.21.15.77:0/3271264493 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6704007660 con 0x7f67140cfb60 2023-11-26T07:21:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f67117fa640 1 -- 172.21.15.77:0/3271264493 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704004a20 con 0x7f67140cfb60 2023-11-26T07:21:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f671aa61640 1 -- 172.21.15.77:0/3271264493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670c009a70 con 0x7f67140cfb60 2023-11-26T07:21:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.357+0000 7f671aa61640 1 -- 172.21.15.77:0/3271264493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67141f6e00 con 0x7f67140cfb60 2023-11-26T07:21:39.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.359+0000 7f671aa61640 1 -- 172.21.15.77:0/3271264493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67141f7020 con 0x7f67140cfb60 2023-11-26T07:21:39.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.360+0000 7f67117fa640 1 -- 172.21.15.77:0/3271264493 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f6704004b80 con 0x7f67140cfb60 2023-11-26T07:21:39.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.360+0000 7f67117fa640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f66f406b3e0 0x7f66f406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.361+0000 7f67117fa640 1 -- 172.21.15.77:0/3271264493 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6704088f20 con 0x7f67140cfb60 2023-11-26T07:21:39.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.361+0000 7f670bfff640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f66f406b3e0 0x7f66f406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.361+0000 7f670bfff640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f66f406b3e0 0x7f66f406d8a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f67140ad640 tx=0x7f66fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:39.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.365+0000 7f67117fa640 1 -- 172.21.15.77:0/3271264493 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6704053ab0 con 0x7f67140cfb60 2023-11-26T07:21:39.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.558+0000 7f671aa61640 1 -- 172.21.15.77:0/3271264493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6714067470 con 0x7f67140cfb60 2023-11-26T07:21:39.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.559+0000 7f67117fa640 1 -- 172.21.15.77:0/3271264493 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6704018020 con 0x7f67140cfb60 2023-11-26T07:21:39.562 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:39.562 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-26T07:21:39.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:39.563 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-11-26T07:21:39.563 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-11-26T07:21:39.563 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:39.563 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-26T07:21:39.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.561+0000 7f671aa61640 1 -- 172.21.15.77:0/3271264493 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f66f406b3e0 msgr2=0x7f66f406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.561+0000 7f671aa61640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f66f406b3e0 0x7f66f406d8a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f67140ad640 tx=0x7f66fc008040 comp rx=0 tx=0).stop 2023-11-26T07:21:39.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.561+0000 7f671aa61640 1 -- 172.21.15.77:0/3271264493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140cfb60 msgr2=0x7f67141f28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.561+0000 7f671aa61640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140cfb60 0x7f67141f28b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f670400c4d0 tx=0x7f670400c990 comp rx=0 tx=0).stop 2023-11-26T07:21:39.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.562+0000 7f671aa61640 1 -- 172.21.15.77:0/3271264493 shutdown_connections 2023-11-26T07:21:39.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.562+0000 7f671aa61640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f66f406b3e0 0x7f66f406d8a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.562+0000 7f671aa61640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f671415dc80 0x7f67140b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.562+0000 7f671aa61640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6714157c70 0x7f67140aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.562+0000 7f671aa61640 1 --2- 172.21.15.77:0/3271264493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140cfb60 0x7f67141f28b0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.562+0000 7f671aa61640 1 -- 172.21.15.77:0/3271264493 >> 172.21.15.77:0/3271264493 conn(0x7f671406a920 msgr2=0x7f67140cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:39.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.562+0000 7f671aa61640 1 -- 172.21.15.77:0/3271264493 shutdown_connections 2023-11-26T07:21:39.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.562+0000 7f671aa61640 1 -- 172.21.15.77:0/3271264493 wait complete. 2023-11-26T07:21:39.582 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:21:39.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:21:39.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.800+0000 7fb154961640 1 Processor -- start 2023-11-26T07:21:39.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.801+0000 7fb154961640 1 -- start start 2023-11-26T07:21:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.802+0000 7fb154961640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb1500d0a50 0x7fb1500d30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.802+0000 7fb154961640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1500d3630 0x7fb1500d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.802+0000 7fb154961640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500cdf30 con 0x7fb15015d4f0 2023-11-26T07:21:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.802+0000 7fb154961640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1500d3e30 con 0x7fb1500d3630 2023-11-26T07:21:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.802+0000 7fb154961640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1500cf3c0 con 0x7fb1500d0a50 2023-11-26T07:21:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.802+0000 7fb14e59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb15015d4f0 0x7fb1500cecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53586/0 (socket says 172.21.15.77:53586) 2023-11-26T07:21:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.802+0000 7fb14e59c640 1 -- 172.21.15.77:0/1379524101 learned_addr learned my addr 172.21.15.77:0/1379524101 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.802+0000 7fb14ed9d640 1 --2- 172.21.15.77:0/1379524101 >> v2:172.21.15.77:3300/0 conn(0x7fb1500d3630 0x7fb1500d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.803+0000 7fb14dd9b640 1 --2- 172.21.15.77:0/1379524101 >> v2:172.21.15.159:3300/0 conn(0x7fb1500d0a50 0x7fb1500d30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.803+0000 7fb14ed9d640 1 -- 172.21.15.77:0/1379524101 >> v2:172.21.15.159:3300/0 conn(0x7fb1500d0a50 msgr2=0x7fb1500d30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.803+0000 7fb14d59a640 1 -- 172.21.15.77:0/1379524101 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897621809 0 0) 0x7fb1500cdf30 con 0x7fb15015d4f0 2023-11-26T07:21:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.803+0000 7fb14ed9d640 1 --2- 172.21.15.77:0/1379524101 >> v2:172.21.15.159:3300/0 conn(0x7fb1500d0a50 0x7fb1500d30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.803+0000 7fb14ed9d640 1 -- 172.21.15.77:0/1379524101 >> v1:172.21.15.77:6789/0 conn(0x7fb15015d4f0 legacy=0x7fb1500cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.803+0000 7fb14ed9d640 1 -- 172.21.15.77:0/1379524101 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500d3b50 con 0x7fb1500d3630 2023-11-26T07:21:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.803+0000 7fb14dd9b640 1 --2- 172.21.15.77:0/1379524101 >> v2:172.21.15.159:3300/0 conn(0x7fb1500d0a50 0x7fb1500d30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.804+0000 7fb14ed9d640 1 --2- 172.21.15.77:0/1379524101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1500d3630 0x7fb1500d17d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb15008bc60 tx=0x7fb14802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f880742d90b1d04 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.804+0000 7fb14d59a640 1 -- 172.21.15.77:0/1379524101 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148031830 con 0x7fb1500d3630 2023-11-26T07:21:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.804+0000 7fb14d59a640 1 -- 172.21.15.77:0/1379524101 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb148031990 con 0x7fb1500d3630 2023-11-26T07:21:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.805+0000 7fb14d59a640 1 -- 172.21.15.77:0/1379524101 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148031d20 con 0x7fb1500d3630 2023-11-26T07:21:39.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.805+0000 7fb154961640 1 -- 172.21.15.77:0/1379524101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1500d3630 msgr2=0x7fb1500d17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.805+0000 7fb154961640 1 --2- 172.21.15.77:0/1379524101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1500d3630 0x7fb1500d17d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb15008bc60 tx=0x7fb14802b8d0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.805+0000 7fb154961640 1 -- 172.21.15.77:0/1379524101 shutdown_connections 2023-11-26T07:21:39.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.805+0000 7fb154961640 1 --2- 172.21.15.77:0/1379524101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1500d3630 0x7fb1500d17d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.805+0000 7fb154961640 1 --2- 172.21.15.77:0/1379524101 >> v2:172.21.15.159:3300/0 conn(0x7fb1500d0a50 0x7fb1500d30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.805+0000 7fb154961640 1 -- 172.21.15.77:0/1379524101 >> 172.21.15.77:0/1379524101 conn(0x7fb150061950 msgr2=0x7fb15008af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:39.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.805+0000 7fb154961640 1 -- 172.21.15.77:0/1379524101 shutdown_connections 2023-11-26T07:21:39.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.805+0000 7fb154961640 1 -- 172.21.15.77:0/1379524101 wait complete. 2023-11-26T07:21:39.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.807+0000 7fb154961640 1 Processor -- start 2023-11-26T07:21:39.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.807+0000 7fb154961640 1 -- start start 2023-11-26T07:21:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.808+0000 7fb154961640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1500d0a50 0x7fb1500b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.808+0000 7fb154961640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1500d3630 0x7fb1500b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.808+0000 7fb154961640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb15015d4f0 0x7fb1501efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.808+0000 7fb154961640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500b8280 con 0x7fb15015d4f0 2023-11-26T07:21:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.808+0000 7fb154961640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500b8560 con 0x7fb1500d0a50 2023-11-26T07:21:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.808+0000 7fb154961640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500b8840 con 0x7fb1500d3630 2023-11-26T07:21:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.808+0000 7fb14ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb15015d4f0 0x7fb1501efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.808+0000 7fb14ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb15015d4f0 0x7fb1501efff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52844/0 (socket says 172.21.15.77:52844) 2023-11-26T07:21:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.808+0000 7fb14ed9d640 1 -- 172.21.15.77:0/2648800926 learned_addr learned my addr 172.21.15.77:0/2648800926 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:39.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.809+0000 7fb14ed9d640 1 -- 172.21.15.77:0/2648800926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1500d3630 msgr2=0x7fb1500b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.809+0000 7fb14ed9d640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1500d3630 0x7fb1500b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.809+0000 7fb14ed9d640 1 -- 172.21.15.77:0/2648800926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1500d0a50 msgr2=0x7fb1500b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.809+0000 7fb14ed9d640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1500d0a50 0x7fb1500b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.809+0000 7fb14ed9d640 1 -- 172.21.15.77:0/2648800926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb148009400 con 0x7fb15015d4f0 2023-11-26T07:21:39.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.809+0000 7fb14ed9d640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb15015d4f0 0x7fb1501efff0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb148009890 tx=0x7fb1480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:39.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.809+0000 7fb146ffd640 1 -- 172.21.15.77:0/2648800926 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148004230 con 0x7fb15015d4f0 2023-11-26T07:21:39.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.809+0000 7fb146ffd640 1 -- 172.21.15.77:0/2648800926 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb148004390 con 0x7fb15015d4f0 2023-11-26T07:21:39.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.809+0000 7fb146ffd640 1 -- 172.21.15.77:0/2648800926 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14803a920 con 0x7fb15015d4f0 2023-11-26T07:21:39.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.809+0000 7fb154961640 1 -- 172.21.15.77:0/2648800926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1500b8b20 con 0x7fb15015d4f0 2023-11-26T07:21:39.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.810+0000 7fb154961640 1 -- 172.21.15.77:0/2648800926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1500b9040 con 0x7fb15015d4f0 2023-11-26T07:21:39.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.810+0000 7fb154961640 1 -- 172.21.15.77:0/2648800926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1500b9320 con 0x7fb15015d4f0 2023-11-26T07:21:39.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.812+0000 7fb146ffd640 1 -- 172.21.15.77:0/2648800926 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fb14803aa80 con 0x7fb15015d4f0 2023-11-26T07:21:39.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.812+0000 7fb146ffd640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb13006b3e0 0x7fb13006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.812+0000 7fb146ffd640 1 -- 172.21.15.77:0/2648800926 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb1480ac500 con 0x7fb15015d4f0 2023-11-26T07:21:39.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.813+0000 7fb14e59c640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb13006b3e0 0x7fb13006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.813+0000 7fb14e59c640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb13006b3e0 0x7fb13006d8a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb140007fd0 tx=0x7fb140007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:39.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:39.817+0000 7fb146ffd640 1 -- 172.21.15.77:0/2648800926 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb148076fd0 con 0x7fb15015d4f0 2023-11-26T07:21:40.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.007+0000 7fb154961640 1 -- 172.21.15.77:0/2648800926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb1500b83c0 con 0x7fb15015d4f0 2023-11-26T07:21:40.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.792+0000 7fb146ffd640 1 -- 172.21.15.77:0/2648800926 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb1500b83c0 con 0x7fb15015d4f0 2023-11-26T07:21:40.795 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-11-26T07:21:40.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.797+0000 7fb154961640 1 -- 172.21.15.77:0/2648800926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb13006b3e0 msgr2=0x7fb13006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.797+0000 7fb154961640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb13006b3e0 0x7fb13006d8a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb140007fd0 tx=0x7fb140007ce0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.797+0000 7fb154961640 1 -- 172.21.15.77:0/2648800926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb15015d4f0 msgr2=0x7fb1501efff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.797+0000 7fb154961640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb15015d4f0 0x7fb1501efff0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb148009890 tx=0x7fb1480046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.797+0000 7fb154961640 1 -- 172.21.15.77:0/2648800926 shutdown_connections 2023-11-26T07:21:40.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.797+0000 7fb154961640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb13006b3e0 0x7fb13006d8a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.797+0000 7fb154961640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb15015d4f0 0x7fb1501efff0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.797+0000 7fb154961640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1500d3630 0x7fb1500b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.797+0000 7fb154961640 1 --2- 172.21.15.77:0/2648800926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1500d0a50 0x7fb1500b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.797+0000 7fb154961640 1 -- 172.21.15.77:0/2648800926 >> 172.21.15.77:0/2648800926 conn(0x7fb150061950 msgr2=0x7fb1500cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:40.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.798+0000 7fb154961640 1 -- 172.21.15.77:0/2648800926 shutdown_connections 2023-11-26T07:21:40.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:40.798+0000 7fb154961640 1 -- 172.21.15.77:0/2648800926 wait complete. 2023-11-26T07:21:40.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:21:41.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.029+0000 7fe81f46d640 1 Processor -- start 2023-11-26T07:21:41.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.030+0000 7fe81f46d640 1 -- start start 2023-11-26T07:21:41.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.031+0000 7fe81f46d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8180b63d0 0x7fe8180d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:41.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.031+0000 7fe81f46d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8180cea30 con 0x7fe8180ce270 2023-11-26T07:21:41.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.031+0000 7fe81f46d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8180ce750 con 0x7fe81815d490 2023-11-26T07:21:41.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.031+0000 7fe81f46d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8180d0450 con 0x7fe8180b63d0 2023-11-26T07:21:41.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.031+0000 7fe81dc6a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8180b63d0 0x7fe8180d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:41.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.031+0000 7fe81dc6a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8180b63d0 0x7fe8180d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52852/0 (socket says 172.21.15.77:52852) 2023-11-26T07:21:41.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.031+0000 7fe81dc6a640 1 -- 172.21.15.77:0/1565791113 learned_addr learned my addr 172.21.15.77:0/1565791113 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:41.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.032+0000 7fe81dc6a640 1 -- 172.21.15.77:0/1565791113 >> v1:172.21.15.159:6789/0 conn(0x7fe81815d490 legacy=0x7fe8180cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:41.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.032+0000 7fe81dc6a640 1 -- 172.21.15.77:0/1565791113 >> v1:172.21.15.77:6789/0 conn(0x7fe8180ce270 legacy=0x7fe8180d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.032+0000 7fe81dc6a640 1 -- 172.21.15.77:0/1565791113 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180d0630 con 0x7fe8180b63d0 2023-11-26T07:21:41.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.032+0000 7fe81d469640 1 -- 172.21.15.77:0/1565791113 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395830578 0 0) 0x7fe8180cea30 con 0x7fe8180ce270 2023-11-26T07:21:41.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.033+0000 7fe81dc6a640 1 --2- 172.21.15.77:0/1565791113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8180b63d0 0x7fe8180d3230 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009870 tx=0x7fe80c02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6adf19ec8ec339bb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:41.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.033+0000 7fe81d469640 1 -- 172.21.15.77:0/1565791113 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c030850 con 0x7fe8180b63d0 2023-11-26T07:21:41.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.033+0000 7fe81d469640 1 -- 172.21.15.77:0/1565791113 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c0309b0 con 0x7fe8180b63d0 2023-11-26T07:21:41.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.033+0000 7fe81d469640 1 -- 172.21.15.77:0/1565791113 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c030d40 con 0x7fe8180b63d0 2023-11-26T07:21:41.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.034+0000 7fe81f46d640 1 -- 172.21.15.77:0/1565791113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8180b63d0 msgr2=0x7fe8180d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.034+0000 7fe81f46d640 1 --2- 172.21.15.77:0/1565791113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8180b63d0 0x7fe8180d3230 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009870 tx=0x7fe80c02b990 comp rx=0 tx=0).stop 2023-11-26T07:21:41.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.034+0000 7fe81f46d640 1 -- 172.21.15.77:0/1565791113 shutdown_connections 2023-11-26T07:21:41.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.034+0000 7fe81f46d640 1 --2- 172.21.15.77:0/1565791113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8180b63d0 0x7fe8180d3230 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.034+0000 7fe81f46d640 1 -- 172.21.15.77:0/1565791113 >> 172.21.15.77:0/1565791113 conn(0x7fe818061340 msgr2=0x7fe818061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:41.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.034+0000 7fe81f46d640 1 -- 172.21.15.77:0/1565791113 shutdown_connections 2023-11-26T07:21:41.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.034+0000 7fe81f46d640 1 -- 172.21.15.77:0/1565791113 wait complete. 2023-11-26T07:21:41.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.036+0000 7fe81f46d640 1 Processor -- start 2023-11-26T07:21:41.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.036+0000 7fe81f46d640 1 -- start start 2023-11-26T07:21:41.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.036+0000 7fe81f46d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8180ce270 0x7fe81815e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:41.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81f46d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe81815d490 0x7fe8180cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:41.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81f46d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8180ca370 0x7fe81814e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:41.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81f46d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180d0bf0 con 0x7fe81815d490 2023-11-26T07:21:41.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81f46d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180ca8e0 con 0x7fe8180ca370 2023-11-26T07:21:41.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81f46d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180cabc0 con 0x7fe8180ce270 2023-11-26T07:21:41.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81dc6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe81815d490 0x7fe8180cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:41.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81dc6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe81815d490 0x7fe8180cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52858/0 (socket says 172.21.15.77:52858) 2023-11-26T07:21:41.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81dc6a640 1 -- 172.21.15.77:0/1825382952 learned_addr learned my addr 172.21.15.77:0/1825382952 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:41.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81dc6a640 1 -- 172.21.15.77:0/1825382952 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8180ce270 msgr2=0x7fe81815e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81dc6a640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8180ce270 0x7fe81815e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81dc6a640 1 -- 172.21.15.77:0/1825382952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8180ca370 msgr2=0x7fe81814e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81dc6a640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8180ca370 0x7fe81814e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.037+0000 7fe81dc6a640 1 -- 172.21.15.77:0/1825382952 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0094d0 con 0x7fe81815d490 2023-11-26T07:21:41.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.038+0000 7fe81dc6a640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe81815d490 0x7fe8180cc810 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0097c0 tx=0x7fe80c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:41.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.038+0000 7fe80affd640 1 -- 172.21.15.77:0/1825382952 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c039e20 con 0x7fe81815d490 2023-11-26T07:21:41.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.038+0000 7fe80affd640 1 -- 172.21.15.77:0/1825382952 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c043400 con 0x7fe81815d490 2023-11-26T07:21:41.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.038+0000 7fe80affd640 1 -- 172.21.15.77:0/1825382952 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0437b0 con 0x7fe81815d490 2023-11-26T07:21:41.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.038+0000 7fe81f46d640 1 -- 172.21.15.77:0/1825382952 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8180caea0 con 0x7fe81815d490 2023-11-26T07:21:41.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.038+0000 7fe81f46d640 1 -- 172.21.15.77:0/1825382952 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8180cb460 con 0x7fe81815d490 2023-11-26T07:21:41.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.039+0000 7fe81f46d640 1 -- 172.21.15.77:0/1825382952 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8180b9060 con 0x7fe81815d490 2023-11-26T07:21:41.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.040+0000 7fe80affd640 1 -- 172.21.15.77:0/1825382952 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fe80c02e070 con 0x7fe81815d490 2023-11-26T07:21:41.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.041+0000 7fe80affd640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7fc06b3e0 0x7fe7fc06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:41.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.042+0000 7fe80affd640 1 -- 172.21.15.77:0/1825382952 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe80c03e070 con 0x7fe81815d490 2023-11-26T07:21:41.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.042+0000 7fe81e46b640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7fc06b3e0 0x7fe7fc06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:41.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.042+0000 7fe81e46b640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7fc06b3e0 0x7fe7fc06d8a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe814006fd0 tx=0x7fe814006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:41.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.047+0000 7fe80affd640 1 -- 172.21.15.77:0/1825382952 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe80c0b3080 con 0x7fe81815d490 2023-11-26T07:21:41.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.237+0000 7fe81f46d640 1 -- 172.21.15.77:0/1825382952 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe8180cad00 con 0x7fe81815d490 2023-11-26T07:21:41.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.799+0000 7fe80affd640 1 -- 172.21.15.77:0/1825382952 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe8180cad00 con 0x7fe81815d490 2023-11-26T07:21:41.801 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-11-26T07:21:41.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.803+0000 7fe81f46d640 1 -- 172.21.15.77:0/1825382952 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7fc06b3e0 msgr2=0x7fe7fc06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.803+0000 7fe81f46d640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7fc06b3e0 0x7fe7fc06d8a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe814006fd0 tx=0x7fe814006bc0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.803+0000 7fe81f46d640 1 -- 172.21.15.77:0/1825382952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe81815d490 msgr2=0x7fe8180cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.803+0000 7fe81f46d640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe81815d490 0x7fe8180cc810 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0097c0 tx=0x7fe80c004730 comp rx=0 tx=0).stop 2023-11-26T07:21:41.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.804+0000 7fe81f46d640 1 -- 172.21.15.77:0/1825382952 shutdown_connections 2023-11-26T07:21:41.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.804+0000 7fe81f46d640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7fc06b3e0 0x7fe7fc06d8a0 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe814006fd0 tx=0x7fe814006bc0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.804+0000 7fe81f46d640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8180ca370 0x7fe81814e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.804+0000 7fe81f46d640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe81815d490 0x7fe8180cc810 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.804+0000 7fe81f46d640 1 --2- 172.21.15.77:0/1825382952 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8180ce270 0x7fe81815e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.804+0000 7fe81f46d640 1 -- 172.21.15.77:0/1825382952 >> 172.21.15.77:0/1825382952 conn(0x7fe818061340 msgr2=0x7fe8180b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:41.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.805+0000 7fe81f46d640 1 -- 172.21.15.77:0/1825382952 shutdown_connections 2023-11-26T07:21:41.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:41.808+0000 7fe81f46d640 1 -- 172.21.15.77:0/1825382952 wait complete. 2023-11-26T07:21:41.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:21:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.019+0000 7ffb8812c640 1 Processor -- start 2023-11-26T07:21:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.019+0000 7ffb8812c640 1 -- start start 2023-11-26T07:21:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.021+0000 7ffb8812c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffb800cc0f0 0x7ffb800c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.021+0000 7ffb8812c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb800c57e0 0x7ffb8006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.021+0000 7ffb8812c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8015eea0 con 0x7ffb8015b440 2023-11-26T07:21:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.021+0000 7ffb8812c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8015b820 con 0x7ffb800c57e0 2023-11-26T07:21:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.021+0000 7ffb8812c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800abf30 con 0x7ffb800cc0f0 2023-11-26T07:21:42.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.021+0000 7ffb866c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb800c57e0 0x7ffb8006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:42.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.021+0000 7ffb866c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb800c57e0 0x7ffb8006c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52860/0 (socket says 172.21.15.77:52860) 2023-11-26T07:21:42.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.021+0000 7ffb866c9640 1 -- 172.21.15.77:0/2940930886 learned_addr learned my addr 172.21.15.77:0/2940930886 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:42.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.022+0000 7ffb856c7640 1 --2- 172.21.15.77:0/2940930886 >> v2:172.21.15.159:3300/0 conn(0x7ffb800cc0f0 0x7ffb800c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:42.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.022+0000 7ffb866c9640 1 -- 172.21.15.77:0/2940930886 >> v2:172.21.15.159:3300/0 conn(0x7ffb800cc0f0 msgr2=0x7ffb800c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:42.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.022+0000 7ffb866c9640 1 --2- 172.21.15.77:0/2940930886 >> v2:172.21.15.159:3300/0 conn(0x7ffb800cc0f0 0x7ffb800c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.022+0000 7ffb866c9640 1 -- 172.21.15.77:0/2940930886 >> v1:172.21.15.77:6789/0 conn(0x7ffb8015b440 legacy=0x7ffb800cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.022+0000 7ffb866c9640 1 -- 172.21.15.77:0/2940930886 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8015f0f0 con 0x7ffb800c57e0 2023-11-26T07:21:42.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.022+0000 7ffb84ec6640 1 -- 172.21.15.77:0/2940930886 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737356749 0 0) 0x7ffb8015eea0 con 0x7ffb8015b440 2023-11-26T07:21:42.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.022+0000 7ffb856c7640 1 --2- 172.21.15.77:0/2940930886 >> v2:172.21.15.159:3300/0 conn(0x7ffb800cc0f0 0x7ffb800c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.023+0000 7ffb866c9640 1 --2- 172.21.15.77:0/2940930886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb800c57e0 0x7ffb8006c5f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ffb8006e720 tx=0x7ffb7802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd848ff71e011a3a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.023+0000 7ffb84ec6640 1 -- 172.21.15.77:0/2940930886 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7802ca80 con 0x7ffb800c57e0 2023-11-26T07:21:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.023+0000 7ffb84ec6640 1 -- 172.21.15.77:0/2940930886 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7802cbe0 con 0x7ffb800c57e0 2023-11-26T07:21:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.023+0000 7ffb84ec6640 1 -- 172.21.15.77:0/2940930886 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb780343f0 con 0x7ffb800c57e0 2023-11-26T07:21:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.024+0000 7ffb8812c640 1 -- 172.21.15.77:0/2940930886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb800c57e0 msgr2=0x7ffb8006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.024+0000 7ffb8812c640 1 --2- 172.21.15.77:0/2940930886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb800c57e0 0x7ffb8006c5f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ffb8006e720 tx=0x7ffb7802bee0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.024+0000 7ffb8812c640 1 -- 172.21.15.77:0/2940930886 shutdown_connections 2023-11-26T07:21:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.024+0000 7ffb8812c640 1 --2- 172.21.15.77:0/2940930886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb800c57e0 0x7ffb8006c5f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.024+0000 7ffb8812c640 1 --2- 172.21.15.77:0/2940930886 >> v2:172.21.15.159:3300/0 conn(0x7ffb800cc0f0 0x7ffb800c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.024+0000 7ffb8812c640 1 -- 172.21.15.77:0/2940930886 >> 172.21.15.77:0/2940930886 conn(0x7ffb800b0c50 msgr2=0x7ffb800b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.024+0000 7ffb8812c640 1 -- 172.21.15.77:0/2940930886 shutdown_connections 2023-11-26T07:21:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.024+0000 7ffb8812c640 1 -- 172.21.15.77:0/2940930886 wait complete. 2023-11-26T07:21:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.025+0000 7ffb8812c640 1 Processor -- start 2023-11-26T07:21:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.026+0000 7ffb8812c640 1 -- start start 2023-11-26T07:21:42.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.026+0000 7ffb8812c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb800c57e0 0x7ffb800ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.026+0000 7ffb8812c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb800cc0f0 0x7ffb80153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.026+0000 7ffb8812c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8015b440 0x7ffb80154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.026+0000 7ffb8812c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80156d10 con 0x7ffb8015b440 2023-11-26T07:21:42.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.026+0000 7ffb8812c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800c60d0 con 0x7ffb800cc0f0 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.026+0000 7ffb8812c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800c63b0 con 0x7ffb800c57e0 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.027+0000 7ffb866c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8015b440 0x7ffb80154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.027+0000 7ffb866c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8015b440 0x7ffb80154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52874/0 (socket says 172.21.15.77:52874) 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.027+0000 7ffb866c9640 1 -- 172.21.15.77:0/195163369 learned_addr learned my addr 172.21.15.77:0/195163369 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.027+0000 7ffb866c9640 1 -- 172.21.15.77:0/195163369 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb800c57e0 msgr2=0x7ffb800ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.027+0000 7ffb866c9640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb800c57e0 0x7ffb800ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.027+0000 7ffb866c9640 1 -- 172.21.15.77:0/195163369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb800cc0f0 msgr2=0x7ffb80153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.027+0000 7ffb866c9640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb800cc0f0 0x7ffb80153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.027+0000 7ffb866c9640 1 -- 172.21.15.77:0/195163369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb78009b30 con 0x7ffb8015b440 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.027+0000 7ffb866c9640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8015b440 0x7ffb80154440 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ffb78036040 tx=0x7ffb78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.028+0000 7ffb767fc640 1 -- 172.21.15.77:0/195163369 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78009510 con 0x7ffb8015b440 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.028+0000 7ffb767fc640 1 -- 172.21.15.77:0/195163369 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7803e450 con 0x7ffb8015b440 2023-11-26T07:21:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.028+0000 7ffb8812c640 1 -- 172.21.15.77:0/195163369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb800c6690 con 0x7ffb8015b440 2023-11-26T07:21:42.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.028+0000 7ffb767fc640 1 -- 172.21.15.77:0/195163369 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7803e800 con 0x7ffb8015b440 2023-11-26T07:21:42.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.028+0000 7ffb8812c640 1 -- 172.21.15.77:0/195163369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb800ad3b0 con 0x7ffb8015b440 2023-11-26T07:21:42.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.029+0000 7ffb8812c640 1 -- 172.21.15.77:0/195163369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb800c6bb0 con 0x7ffb8015b440 2023-11-26T07:21:42.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.030+0000 7ffb767fc640 1 -- 172.21.15.77:0/195163369 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7ffb7802cd50 con 0x7ffb8015b440 2023-11-26T07:21:42.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.031+0000 7ffb767fc640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffb6406b3e0 0x7ffb6406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.031+0000 7ffb767fc640 1 -- 172.21.15.77:0/195163369 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ffb780acbf0 con 0x7ffb8015b440 2023-11-26T07:21:42.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.031+0000 7ffb85ec8640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffb6406b3e0 0x7ffb6406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:42.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.032+0000 7ffb85ec8640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffb6406b3e0 0x7ffb6406d8a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c001560 tx=0x7ffb7c007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:42.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.036+0000 7ffb767fc640 1 -- 172.21.15.77:0/195163369 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffb800c6bb0 con 0x7ffb8015b440 2023-11-26T07:21:42.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.257+0000 7ffb8812c640 1 -- 172.21.15.77:0/195163369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ffb800c6bb0 con 0x7ffb8015b440 2023-11-26T07:21:42.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.820+0000 7ffb767fc640 1 -- 172.21.15.77:0/195163369 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v31) v1 ==== 172+0+0 (secure 0 0 0) 0x7ffb800c6bb0 con 0x7ffb8015b440 2023-11-26T07:21:42.822 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 8 and data pool 9 2023-11-26T07:21:42.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.824+0000 7ffb8812c640 1 -- 172.21.15.77:0/195163369 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffb6406b3e0 msgr2=0x7ffb6406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.824+0000 7ffb8812c640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffb6406b3e0 0x7ffb6406d8a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c001560 tx=0x7ffb7c007930 comp rx=0 tx=0).stop 2023-11-26T07:21:42.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.824+0000 7ffb8812c640 1 -- 172.21.15.77:0/195163369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8015b440 msgr2=0x7ffb80154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.824+0000 7ffb8812c640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8015b440 0x7ffb80154440 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ffb78036040 tx=0x7ffb78004a40 comp rx=0 tx=0).stop 2023-11-26T07:21:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.825+0000 7ffb8812c640 1 -- 172.21.15.77:0/195163369 shutdown_connections 2023-11-26T07:21:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.825+0000 7ffb8812c640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffb6406b3e0 0x7ffb6406d8a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.825+0000 7ffb8812c640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8015b440 0x7ffb80154440 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.825+0000 7ffb8812c640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb800cc0f0 0x7ffb80153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.825+0000 7ffb8812c640 1 --2- 172.21.15.77:0/195163369 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb800c57e0 0x7ffb800ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.825+0000 7ffb8812c640 1 -- 172.21.15.77:0/195163369 >> 172.21.15.77:0/195163369 conn(0x7ffb800b0c50 msgr2=0x7ffb80071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.825+0000 7ffb8812c640 1 -- 172.21.15.77:0/195163369 shutdown_connections 2023-11-26T07:21:42.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:42.827+0000 7ffb8812c640 1 -- 172.21.15.77:0/195163369 wait complete. 2023-11-26T07:21:42.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:43.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.048+0000 7f156a4ad640 1 Processor -- start 2023-11-26T07:21:43.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.048+0000 7f156a4ad640 1 -- start start 2023-11-26T07:21:43.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.050+0000 7f156a4ad640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f156415b450 0x7f15640cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.050+0000 7f156a4ad640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f15640cffb0 0x7f15640cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.050+0000 7f156a4ad640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15640cda70 con 0x7f15640d0b10 2023-11-26T07:21:43.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.050+0000 7f156a4ad640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1564070180 con 0x7f156415b450 2023-11-26T07:21:43.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.050+0000 7f156a4ad640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1564070460 con 0x7f15640cffb0 2023-11-26T07:21:43.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.050+0000 7f1563fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f156415b450 0x7f15640cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.050+0000 7f1563fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f156415b450 0x7f15640cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52888/0 (socket says 172.21.15.77:52888) 2023-11-26T07:21:43.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.050+0000 7f15637fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f15640d0b10 0x7f156415f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53602/0 (socket says 172.21.15.77:53602) 2023-11-26T07:21:43.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.050+0000 7f1563fff640 1 -- 172.21.15.77:0/191178354 learned_addr learned my addr 172.21.15.77:0/191178354 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:43.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.051+0000 7f1568a4a640 1 --2- 172.21.15.77:0/191178354 >> v2:172.21.15.159:3300/0 conn(0x7f15640cffb0 0x7f15640cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.051+0000 7f1563fff640 1 -- 172.21.15.77:0/191178354 >> v2:172.21.15.159:3300/0 conn(0x7f15640cffb0 msgr2=0x7f15640cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:43.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.051+0000 7f1563fff640 1 --2- 172.21.15.77:0/191178354 >> v2:172.21.15.159:3300/0 conn(0x7f15640cffb0 0x7f15640cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.051+0000 7f1563fff640 1 -- 172.21.15.77:0/191178354 >> v1:172.21.15.77:6789/0 conn(0x7f15640d0b10 legacy=0x7f156415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.051+0000 7f1563fff640 1 -- 172.21.15.77:0/191178354 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564070740 con 0x7f156415b450 2023-11-26T07:21:43.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.051+0000 7f1562ffd640 1 -- 172.21.15.77:0/191178354 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700928946 0 0) 0x7f15640cda70 con 0x7f15640d0b10 2023-11-26T07:21:43.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.051+0000 7f1568a4a640 1 --2- 172.21.15.77:0/191178354 >> v2:172.21.15.159:3300/0 conn(0x7f15640cffb0 0x7f15640cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:43.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.052+0000 7f1563fff640 1 --2- 172.21.15.77:0/191178354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f156415b450 0x7f15640cb940 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f15640cea90 tx=0x7f155402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a91a88bd75b0b6f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.052+0000 7f1562ffd640 1 -- 172.21.15.77:0/191178354 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155402cb10 con 0x7f156415b450 2023-11-26T07:21:43.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.052+0000 7f1562ffd640 1 -- 172.21.15.77:0/191178354 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155402cc70 con 0x7f156415b450 2023-11-26T07:21:43.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.052+0000 7f1562ffd640 1 -- 172.21.15.77:0/191178354 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15540343f0 con 0x7f156415b450 2023-11-26T07:21:43.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.053+0000 7f156a4ad640 1 -- 172.21.15.77:0/191178354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f156415b450 msgr2=0x7f15640cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.053+0000 7f156a4ad640 1 --2- 172.21.15.77:0/191178354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f156415b450 0x7f15640cb940 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f15640cea90 tx=0x7f155402bf70 comp rx=0 tx=0).stop 2023-11-26T07:21:43.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.053+0000 7f156a4ad640 1 -- 172.21.15.77:0/191178354 shutdown_connections 2023-11-26T07:21:43.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.053+0000 7f156a4ad640 1 --2- 172.21.15.77:0/191178354 >> v2:172.21.15.159:3300/0 conn(0x7f15640cffb0 0x7f15640cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.053+0000 7f156a4ad640 1 --2- 172.21.15.77:0/191178354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f156415b450 0x7f15640cb940 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.053+0000 7f156a4ad640 1 -- 172.21.15.77:0/191178354 >> 172.21.15.77:0/191178354 conn(0x7f156406e7f0 msgr2=0x7f156406ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:43.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.053+0000 7f156a4ad640 1 -- 172.21.15.77:0/191178354 shutdown_connections 2023-11-26T07:21:43.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.053+0000 7f156a4ad640 1 -- 172.21.15.77:0/191178354 wait complete. 2023-11-26T07:21:43.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.055+0000 7f156a4ad640 1 Processor -- start 2023-11-26T07:21:43.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.055+0000 7f156a4ad640 1 -- start start 2023-11-26T07:21:43.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f156a4ad640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15640cffb0 0x7f156415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f156a4ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15640d0b10 0x7f15641506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f156a4ad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f156415b450 0x7f15640c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f156a4ad640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15640b51b0 con 0x7f15640d0b10 2023-11-26T07:21:43.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f156a4ad640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156415c9c0 con 0x7f156415b450 2023-11-26T07:21:43.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f156a4ad640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15640b4ed0 con 0x7f15640cffb0 2023-11-26T07:21:43.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f15637fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15640d0b10 0x7f15641506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f15637fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15640d0b10 0x7f15641506f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52896/0 (socket says 172.21.15.77:52896) 2023-11-26T07:21:43.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f15637fe640 1 -- 172.21.15.77:0/2705132499 learned_addr learned my addr 172.21.15.77:0/2705132499 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:43.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f1563fff640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15640cffb0 0x7f156415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f15637fe640 1 -- 172.21.15.77:0/2705132499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15640cffb0 msgr2=0x7f156415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f15637fe640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15640cffb0 0x7f156415c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f15637fe640 1 -- 172.21.15.77:0/2705132499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f156415b450 msgr2=0x7f15640c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f15637fe640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f156415b450 0x7f15640c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.056+0000 7f15637fe640 1 -- 172.21.15.77:0/2705132499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1554009b30 con 0x7f15640d0b10 2023-11-26T07:21:43.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.057+0000 7f15637fe640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15640d0b10 0x7f15641506f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f154c00c4b0 tx=0x7f154c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.057+0000 7f1560ff9640 1 -- 172.21.15.77:0/2705132499 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c0074e0 con 0x7f15640d0b10 2023-11-26T07:21:43.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.057+0000 7f1560ff9640 1 -- 172.21.15.77:0/2705132499 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c007660 con 0x7f15640d0b10 2023-11-26T07:21:43.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.057+0000 7f156a4ad640 1 -- 172.21.15.77:0/2705132499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15640c4fc0 con 0x7f15640d0b10 2023-11-26T07:21:43.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.057+0000 7f1560ff9640 1 -- 172.21.15.77:0/2705132499 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c004a20 con 0x7f15640d0b10 2023-11-26T07:21:43.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.057+0000 7f156a4ad640 1 -- 172.21.15.77:0/2705132499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15640c5580 con 0x7f15640d0b10 2023-11-26T07:21:43.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.058+0000 7f156a4ad640 1 -- 172.21.15.77:0/2705132499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15640c4e20 con 0x7f15640d0b10 2023-11-26T07:21:43.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.059+0000 7f1560ff9640 1 -- 172.21.15.77:0/2705132499 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f154c004b80 con 0x7f15640d0b10 2023-11-26T07:21:43.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.060+0000 7f1560ff9640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f154406b3e0 0x7f154406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.061+0000 7f1560ff9640 1 -- 172.21.15.77:0/2705132499 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f154c0895e0 con 0x7f15640d0b10 2023-11-26T07:21:43.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.061+0000 7f1563fff640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f154406b3e0 0x7f154406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.061+0000 7f1563fff640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f154406b3e0 0x7f154406d8a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1554035000 tx=0x7f1554030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.065+0000 7f1560ff9640 1 -- 172.21.15.77:0/2705132499 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15640c4e20 con 0x7f15640d0b10 2023-11-26T07:21:43.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.245+0000 7f156a4ad640 1 -- 172.21.15.77:0/2705132499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15640c4e20 con 0x7f15640d0b10 2023-11-26T07:21:43.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.248+0000 7f1560ff9640 1 -- 172.21.15.77:0/2705132499 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16554 (secure 0 0 0) 0x7f15640c4e20 con 0x7f15640d0b10 2023-11-26T07:21:43.251 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:43.251 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":61,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:21:42.259537+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:40.058564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:41.292572+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.250+0000 7f156a4ad640 1 -- 172.21.15.77:0/2705132499 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f154406b3e0 msgr2=0x7f154406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.250+0000 7f156a4ad640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f154406b3e0 0x7f154406d8a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1554035000 tx=0x7f1554030000 comp rx=0 tx=0).stop 2023-11-26T07:21:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.250+0000 7f156a4ad640 1 -- 172.21.15.77:0/2705132499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15640d0b10 msgr2=0x7f15641506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.250+0000 7f156a4ad640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15640d0b10 0x7f15641506f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f154c00c4b0 tx=0x7f154c00c970 comp rx=0 tx=0).stop 2023-11-26T07:21:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.251+0000 7f156a4ad640 1 -- 172.21.15.77:0/2705132499 shutdown_connections 2023-11-26T07:21:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.251+0000 7f156a4ad640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f154406b3e0 0x7f154406d8a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.251+0000 7f156a4ad640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f156415b450 0x7f15640c7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.251+0000 7f156a4ad640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15640d0b10 0x7f15641506f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.251+0000 7f156a4ad640 1 --2- 172.21.15.77:0/2705132499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15640cffb0 0x7f156415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.251+0000 7f156a4ad640 1 -- 172.21.15.77:0/2705132499 >> 172.21.15.77:0/2705132499 conn(0x7f156406e7f0 msgr2=0x7f15640b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.251+0000 7f156a4ad640 1 -- 172.21.15.77:0/2705132499 shutdown_connections 2023-11-26T07:21:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.251+0000 7f156a4ad640 1 -- 172.21.15.77:0/2705132499 wait complete. 2023-11-26T07:21:43.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:43.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.479+0000 7fddef2b4640 1 Processor -- start 2023-11-26T07:21:43.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.479+0000 7fddef2b4640 1 -- start start 2023-11-26T07:21:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.480+0000 7fddef2b4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde815df80 0x7fdde80ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.480+0000 7fddef2b4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdde80cd470 0x7fdde815b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.480+0000 7fddef2b4640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde815ab80 con 0x7fdde80b2250 2023-11-26T07:21:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.480+0000 7fddef2b4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde815a990 con 0x7fdde80cd470 2023-11-26T07:21:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.480+0000 7fddef2b4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde815e3c0 con 0x7fdde815df80 2023-11-26T07:21:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.480+0000 7fdded851640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdde80cd470 0x7fdde815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.480+0000 7fdded851640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdde80cd470 0x7fdde815b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52910/0 (socket says 172.21.15.77:52910) 2023-11-26T07:21:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.480+0000 7fdded851640 1 -- 172.21.15.77:0/4104174400 learned_addr learned my addr 172.21.15.77:0/4104174400 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.481+0000 7fddec84f640 1 --2- 172.21.15.77:0/4104174400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde815df80 0x7fdde80ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.481+0000 7fdded851640 1 -- 172.21.15.77:0/4104174400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde815df80 msgr2=0x7fdde80ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.481+0000 7fdded851640 1 --2- 172.21.15.77:0/4104174400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde815df80 0x7fdde80ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.481+0000 7fdded851640 1 -- 172.21.15.77:0/4104174400 >> v1:172.21.15.159:6789/0 conn(0x7fdde80b2250 legacy=0x7fdde80b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.481+0000 7fdded851640 1 -- 172.21.15.77:0/4104174400 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde80b2d40 con 0x7fdde80cd470 2023-11-26T07:21:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.482+0000 7fdded851640 1 --2- 172.21.15.77:0/4104174400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80cd470 0x7fdde815b080 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdde000d150 tx=0x7fdde002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3baaf2bbbc928a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.482+0000 7fdddffff640 1 -- 172.21.15.77:0/4104174400 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde002ea80 con 0x7fdde80cd470 2023-11-26T07:21:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.482+0000 7fdddffff640 1 -- 172.21.15.77:0/4104174400 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde002ebe0 con 0x7fdde80cd470 2023-11-26T07:21:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.482+0000 7fdddffff640 1 -- 172.21.15.77:0/4104174400 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0009600 con 0x7fdde80cd470 2023-11-26T07:21:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.483+0000 7fddef2b4640 1 -- 172.21.15.77:0/4104174400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80cd470 msgr2=0x7fdde815b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.483+0000 7fddef2b4640 1 --2- 172.21.15.77:0/4104174400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80cd470 0x7fdde815b080 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdde000d150 tx=0x7fdde002e0e0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.483+0000 7fddef2b4640 1 -- 172.21.15.77:0/4104174400 shutdown_connections 2023-11-26T07:21:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.483+0000 7fddef2b4640 1 --2- 172.21.15.77:0/4104174400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80cd470 0x7fdde815b080 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.483+0000 7fddef2b4640 1 --2- 172.21.15.77:0/4104174400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde815df80 0x7fdde80ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.483+0000 7fddef2b4640 1 -- 172.21.15.77:0/4104174400 >> 172.21.15.77:0/4104174400 conn(0x7fdde806a920 msgr2=0x7fdde806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.483+0000 7fddef2b4640 1 -- 172.21.15.77:0/4104174400 shutdown_connections 2023-11-26T07:21:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.483+0000 7fddef2b4640 1 -- 172.21.15.77:0/4104174400 wait complete. 2023-11-26T07:21:43.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.485+0000 7fddef2b4640 1 Processor -- start 2023-11-26T07:21:43.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.485+0000 7fddef2b4640 1 -- start start 2023-11-26T07:21:43.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.486+0000 7fddef2b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde80b2250 0x7fdde81f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.486+0000 7fddef2b4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80cd470 0x7fdde81533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.486+0000 7fddef2b4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde815df80 0x7fdde8153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.486+0000 7fddef2b4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde8154000 con 0x7fdde80cd470 2023-11-26T07:21:43.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.486+0000 7fddef2b4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde8152820 con 0x7fdde80b2250 2023-11-26T07:21:43.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.486+0000 7fddef2b4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde80aec80 con 0x7fdde815df80 2023-11-26T07:21:43.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.486+0000 7fddec84f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80cd470 0x7fdde81533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.486+0000 7fddec84f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80cd470 0x7fdde81533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52912/0 (socket says 172.21.15.77:52912) 2023-11-26T07:21:43.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.486+0000 7fddec84f640 1 -- 172.21.15.77:0/3890734868 learned_addr learned my addr 172.21.15.77:0/3890734868 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:43.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.486+0000 7fdded851640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde815df80 0x7fdde8153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fdded050640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde80b2250 0x7fdde81f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fddec84f640 1 -- 172.21.15.77:0/3890734868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde815df80 msgr2=0x7fdde8153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fddec84f640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde815df80 0x7fdde8153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fddec84f640 1 -- 172.21.15.77:0/3890734868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde80b2250 msgr2=0x7fdde81f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fddec84f640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde80b2250 0x7fdde81f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fddec84f640 1 -- 172.21.15.77:0/3890734868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde000bd40 con 0x7fdde80cd470 2023-11-26T07:21:43.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fdded050640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde80b2250 0x7fdde81f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:43.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fddec84f640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80cd470 0x7fdde81533f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fddd800d5f0 tx=0x7fddd800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fddddffb640 1 -- 172.21.15.77:0/3890734868 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80125f0 con 0x7fdde80cd470 2023-11-26T07:21:43.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fddddffb640 1 -- 172.21.15.77:0/3890734868 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd8012750 con 0x7fdde80cd470 2023-11-26T07:21:43.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fddddffb640 1 -- 172.21.15.77:0/3890734868 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8012b00 con 0x7fdde80cd470 2023-11-26T07:21:43.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fddef2b4640 1 -- 172.21.15.77:0/3890734868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde80aef60 con 0x7fdde80cd470 2023-11-26T07:21:43.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.487+0000 7fddef2b4640 1 -- 172.21.15.77:0/3890734868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde80af520 con 0x7fdde80cd470 2023-11-26T07:21:43.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.488+0000 7fddef2b4640 1 -- 172.21.15.77:0/3890734868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde80af6e0 con 0x7fdde80cd470 2023-11-26T07:21:43.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.489+0000 7fddddffb640 1 -- 172.21.15.77:0/3890734868 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fddd8012c60 con 0x7fdde80cd470 2023-11-26T07:21:43.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.490+0000 7fddddffb640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fddcc06b3e0 0x7fddcc06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.490+0000 7fddddffb640 1 -- 172.21.15.77:0/3890734868 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddd808a570 con 0x7fdde80cd470 2023-11-26T07:21:43.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.490+0000 7fdded050640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fddcc06b3e0 0x7fddcc06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.491+0000 7fdded050640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fddcc06b3e0 0x7fddcc06d8a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdde4003eb0 tx=0x7fdde4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.494+0000 7fddddffb640 1 -- 172.21.15.77:0/3890734868 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fddd8054db0 con 0x7fdde80cd470 2023-11-26T07:21:43.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.671+0000 7fddef2b4640 1 -- 172.21.15.77:0/3890734868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdde8067470 con 0x7fdde80cd470 2023-11-26T07:21:43.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.673+0000 7fddddffb640 1 -- 172.21.15.77:0/3890734868 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16554 (secure 0 0 0) 0x7fddd80583d0 con 0x7fdde80cd470 2023-11-26T07:21:43.676 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:43.676 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":61,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:21:42.259537+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:40.058564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:41.292572+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:43.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 -- 172.21.15.77:0/3890734868 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fddcc06b3e0 msgr2=0x7fddcc06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fddcc06b3e0 0x7fddcc06d8a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdde4003eb0 tx=0x7fdde4009040 comp rx=0 tx=0).stop 2023-11-26T07:21:43.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 -- 172.21.15.77:0/3890734868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80cd470 msgr2=0x7fdde81533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80cd470 0x7fdde81533f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fddd800d5f0 tx=0x7fddd800dab0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 -- 172.21.15.77:0/3890734868 shutdown_connections 2023-11-26T07:21:43.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fddcc06b3e0 0x7fddcc06d8a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde815df80 0x7fdde8153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80cd470 0x7fdde81533f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 --2- 172.21.15.77:0/3890734868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde80b2250 0x7fdde81f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 -- 172.21.15.77:0/3890734868 >> 172.21.15.77:0/3890734868 conn(0x7fdde806a920 msgr2=0x7fdde80cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:43.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 -- 172.21.15.77:0/3890734868 shutdown_connections 2023-11-26T07:21:43.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.676+0000 7fddef2b4640 1 -- 172.21.15.77:0/3890734868 wait complete. 2023-11-26T07:21:43.697 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:21:43.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.906+0000 7f78df409640 1 Processor -- start 2023-11-26T07:21:43.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.907+0000 7f78df409640 1 -- start start 2023-11-26T07:21:43.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.908+0000 7f78df409640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78d8072160 0x7f78d815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.908+0000 7f78df409640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f78d80c49f0 0x7f78d806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.908+0000 7f78df409640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f78d806dc40 0x7f78d80cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.908+0000 7f78df409640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d806e0f0 con 0x7f78d80c49f0 2023-11-26T07:21:43.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.908+0000 7f78df409640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d815ec90 con 0x7f78d806dc40 2023-11-26T07:21:43.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.908+0000 7f78df409640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80cd530 con 0x7f78d8072160 2023-11-26T07:21:43.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.908+0000 7f78dc9a4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f78d80c49f0 0x7f78d806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.909+0000 7f78dc9a4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f78d80c49f0 0x7f78d806d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52920/0 (socket says 172.21.15.77:52920) 2023-11-26T07:21:43.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.909+0000 7f78dc9a4640 1 -- 172.21.15.77:0/1392856450 learned_addr learned my addr 172.21.15.77:0/1392856450 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:43.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.909+0000 7f78dd9a6640 1 --2- 172.21.15.77:0/1392856450 >> v2:172.21.15.159:3300/0 conn(0x7f78d806dc40 0x7f78d80cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.909+0000 7f78dc9a4640 1 -- 172.21.15.77:0/1392856450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78d8072160 msgr2=0x7f78d815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:43.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.909+0000 7f78dc9a4640 1 --2- 172.21.15.77:0/1392856450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78d8072160 0x7f78d815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.909+0000 7f78dc9a4640 1 -- 172.21.15.77:0/1392856450 >> v2:172.21.15.159:3300/0 conn(0x7f78d806dc40 msgr2=0x7f78d80cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:43.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.909+0000 7f78dc9a4640 1 --2- 172.21.15.77:0/1392856450 >> v2:172.21.15.159:3300/0 conn(0x7f78d806dc40 0x7f78d80cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.909+0000 7f78dc9a4640 1 -- 172.21.15.77:0/1392856450 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80c4ed0 con 0x7f78d80c49f0 2023-11-26T07:21:43.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.910+0000 7f78dc9a4640 1 --2- 172.21.15.77:0/1392856450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78d80c49f0 0x7f78d806d700 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f78d8072a30 tx=0x7f78cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2aa188f4fe3855 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.910+0000 7f78cbfff640 1 -- 172.21.15.77:0/1392856450 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc031870 con 0x7f78d80c49f0 2023-11-26T07:21:43.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.911+0000 7f78cbfff640 1 -- 172.21.15.77:0/1392856450 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc0319d0 con 0x7f78d80c49f0 2023-11-26T07:21:43.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.911+0000 7f78cbfff640 1 -- 172.21.15.77:0/1392856450 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc031d60 con 0x7f78d80c49f0 2023-11-26T07:21:43.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.911+0000 7f78df409640 1 -- 172.21.15.77:0/1392856450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78d80c49f0 msgr2=0x7f78d806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.911+0000 7f78df409640 1 --2- 172.21.15.77:0/1392856450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78d80c49f0 0x7f78d806d700 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f78d8072a30 tx=0x7f78cc02b910 comp rx=0 tx=0).stop 2023-11-26T07:21:43.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.911+0000 7f78df409640 1 -- 172.21.15.77:0/1392856450 shutdown_connections 2023-11-26T07:21:43.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.911+0000 7f78df409640 1 --2- 172.21.15.77:0/1392856450 >> v2:172.21.15.159:3300/0 conn(0x7f78d806dc40 0x7f78d80cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.911+0000 7f78df409640 1 --2- 172.21.15.77:0/1392856450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78d80c49f0 0x7f78d806d700 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.911+0000 7f78df409640 1 --2- 172.21.15.77:0/1392856450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78d8072160 0x7f78d815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.911+0000 7f78df409640 1 -- 172.21.15.77:0/1392856450 >> 172.21.15.77:0/1392856450 conn(0x7f78d80b0c50 msgr2=0x7f78d80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:43.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.911+0000 7f78df409640 1 -- 172.21.15.77:0/1392856450 shutdown_connections 2023-11-26T07:21:43.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.911+0000 7f78df409640 1 -- 172.21.15.77:0/1392856450 wait complete. 2023-11-26T07:21:43.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.913+0000 7f78df409640 1 Processor -- start 2023-11-26T07:21:43.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.913+0000 7f78df409640 1 -- start start 2023-11-26T07:21:43.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.914+0000 7f78df409640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78d806dc40 0x7f78d8158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.914+0000 7f78df409640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78d8072160 0x7f78d8165e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.914+0000 7f78df409640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78d80c49f0 0x7f78d8163700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.914+0000 7f78df409640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8157ff0 con 0x7f78d8072160 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.914+0000 7f78df409640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d81582d0 con 0x7f78d806dc40 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.914+0000 7f78df409640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d81585b0 con 0x7f78d80c49f0 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.914+0000 7f78dc9a4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78d8072160 0x7f78d8165e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.915+0000 7f78dc9a4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78d8072160 0x7f78d8165e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52928/0 (socket says 172.21.15.77:52928) 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.915+0000 7f78dc9a4640 1 -- 172.21.15.77:0/252602001 learned_addr learned my addr 172.21.15.77:0/252602001 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.915+0000 7f78dd9a6640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78d80c49f0 0x7f78d8163700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.915+0000 7f78dc9a4640 1 -- 172.21.15.77:0/252602001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78d80c49f0 msgr2=0x7f78d8163700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.915+0000 7f78dd1a5640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78d806dc40 0x7f78d8158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.915+0000 7f78dc9a4640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78d80c49f0 0x7f78d8163700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.915+0000 7f78dc9a4640 1 -- 172.21.15.77:0/252602001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78d806dc40 msgr2=0x7f78d8158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.915+0000 7f78dc9a4640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78d806dc40 0x7f78d8158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.915+0000 7f78dc9a4640 1 -- 172.21.15.77:0/252602001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc0094d0 con 0x7f78d8072160 2023-11-26T07:21:43.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.915+0000 7f78dc9a4640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78d8072160 0x7f78d8165e70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f78cc02b950 tx=0x7f78cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.916+0000 7f78c9ffb640 1 -- 172.21.15.77:0/252602001 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc03ad30 con 0x7f78d8072160 2023-11-26T07:21:43.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.916+0000 7f78c9ffb640 1 -- 172.21.15.77:0/252602001 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc0443f0 con 0x7f78d8072160 2023-11-26T07:21:43.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.916+0000 7f78c9ffb640 1 -- 172.21.15.77:0/252602001 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0447a0 con 0x7f78d8072160 2023-11-26T07:21:43.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.916+0000 7f78df409640 1 -- 172.21.15.77:0/252602001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d8158890 con 0x7f78d8072160 2023-11-26T07:21:43.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.916+0000 7f78df409640 1 -- 172.21.15.77:0/252602001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d81593a0 con 0x7f78d8072160 2023-11-26T07:21:43.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.917+0000 7f78df409640 1 -- 172.21.15.77:0/252602001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d8159590 con 0x7f78d8072160 2023-11-26T07:21:43.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.918+0000 7f78c9ffb640 1 -- 172.21.15.77:0/252602001 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f78cc04d450 con 0x7f78d8072160 2023-11-26T07:21:43.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.919+0000 7f78c9ffb640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78bc06b3e0 0x7f78bc06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.919+0000 7f78c9ffb640 1 -- 172.21.15.77:0/252602001 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78cc02d040 con 0x7f78d8072160 2023-11-26T07:21:43.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.919+0000 7f78dd1a5640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78bc06b3e0 0x7f78bc06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.920+0000 7f78dd1a5640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78bc06b3e0 0x7f78bc06d8a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f78d400a810 tx=0x7f78d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:43.924+0000 7f78c9ffb640 1 -- 172.21.15.77:0/252602001 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f78cc076e30 con 0x7f78d8072160 2023-11-26T07:21:44.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.159+0000 7f78df409640 1 -- 172.21.15.77:0/252602001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f78d8163420 con 0x7f78d8072160 2023-11-26T07:21:44.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.865+0000 7f78c9ffb640 1 -- 172.21.15.77:0/252602001 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7f78d8163420 con 0x7f78d8072160 2023-11-26T07:21:44.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.869+0000 7f78df409640 1 -- 172.21.15.77:0/252602001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78bc06b3e0 msgr2=0x7f78bc06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:44.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.869+0000 7f78df409640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78bc06b3e0 0x7f78bc06d8a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f78d400a810 tx=0x7f78d4008040 comp rx=0 tx=0).stop 2023-11-26T07:21:44.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.869+0000 7f78df409640 1 -- 172.21.15.77:0/252602001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78d8072160 msgr2=0x7f78d8165e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:44.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.869+0000 7f78df409640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78d8072160 0x7f78d8165e70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f78cc02b950 tx=0x7f78cc0046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:44.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.870+0000 7f78df409640 1 -- 172.21.15.77:0/252602001 shutdown_connections 2023-11-26T07:21:44.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.870+0000 7f78df409640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f78bc06b3e0 0x7f78bc06d8a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:44.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.870+0000 7f78df409640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78d80c49f0 0x7f78d8163700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:44.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.870+0000 7f78df409640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78d8072160 0x7f78d8165e70 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:44.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.870+0000 7f78df409640 1 --2- 172.21.15.77:0/252602001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78d806dc40 0x7f78d8158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:44.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.870+0000 7f78df409640 1 -- 172.21.15.77:0/252602001 >> 172.21.15.77:0/252602001 conn(0x7f78d80b0c50 msgr2=0x7f78d80704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:44.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.870+0000 7f78df409640 1 -- 172.21.15.77:0/252602001 shutdown_connections 2023-11-26T07:21:44.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:44.870+0000 7f78df409640 1 -- 172.21.15.77:0/252602001 wait complete. 2023-11-26T07:21:44.892 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:21:44.892 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:21:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.102+0000 7fef872bb640 1 Processor -- start 2023-11-26T07:21:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.103+0000 7fef872bb640 1 -- start start 2023-11-26T07:21:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.104+0000 7fef872bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef800b0b40 0x7fef800b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.104+0000 7fef872bb640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fef8006c5b0 0x7fef8006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.104+0000 7fef872bb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8015ed20 con 0x7fef8015b260 2023-11-26T07:21:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.104+0000 7fef872bb640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8015b640 con 0x7fef8006c5b0 2023-11-26T07:21:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.104+0000 7fef872bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8015f8a0 con 0x7fef800b0b40 2023-11-26T07:21:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.105+0000 7fef862b9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fef8015b260 0x7fef8006e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53610/0 (socket says 172.21.15.77:53610) 2023-11-26T07:21:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.105+0000 7fef862b9640 1 -- 172.21.15.77:0/1358728195 learned_addr learned my addr 172.21.15.77:0/1358728195 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.105+0000 7fef86aba640 1 --2- 172.21.15.77:0/1358728195 >> v2:172.21.15.77:3300/0 conn(0x7fef8006c5b0 0x7fef8006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.105+0000 7fef85ab8640 1 --2- 172.21.15.77:0/1358728195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef800b0b40 0x7fef800b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.105+0000 7fef86aba640 1 -- 172.21.15.77:0/1358728195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef800b0b40 msgr2=0x7fef800b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.105+0000 7fef86aba640 1 --2- 172.21.15.77:0/1358728195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef800b0b40 0x7fef800b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.105+0000 7fef852b7640 1 -- 172.21.15.77:0/1358728195 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180225254 0 0) 0x7fef8015ed20 con 0x7fef8015b260 2023-11-26T07:21:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.105+0000 7fef86aba640 1 -- 172.21.15.77:0/1358728195 >> v1:172.21.15.77:6789/0 conn(0x7fef8015b260 legacy=0x7fef8006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.105+0000 7fef86aba640 1 -- 172.21.15.77:0/1358728195 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800b14c0 con 0x7fef8006c5b0 2023-11-26T07:21:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.105+0000 7fef85ab8640 1 --2- 172.21.15.77:0/1358728195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef800b0b40 0x7fef800b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.106+0000 7fef86aba640 1 --2- 172.21.15.77:0/1358728195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8006c5b0 0x7fef8006ca40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fef78009d90 tx=0x7fef7802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4d69e8d595a7b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.106+0000 7fef852b7640 1 -- 172.21.15.77:0/1358728195 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7802cb30 con 0x7fef8006c5b0 2023-11-26T07:21:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.106+0000 7fef852b7640 1 -- 172.21.15.77:0/1358728195 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7802cc90 con 0x7fef8006c5b0 2023-11-26T07:21:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.107+0000 7fef852b7640 1 -- 172.21.15.77:0/1358728195 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78034440 con 0x7fef8006c5b0 2023-11-26T07:21:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.107+0000 7fef872bb640 1 -- 172.21.15.77:0/1358728195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8006c5b0 msgr2=0x7fef8006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.107+0000 7fef872bb640 1 --2- 172.21.15.77:0/1358728195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8006c5b0 0x7fef8006ca40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fef78009d90 tx=0x7fef7802bd80 comp rx=0 tx=0).stop 2023-11-26T07:21:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.107+0000 7fef872bb640 1 -- 172.21.15.77:0/1358728195 shutdown_connections 2023-11-26T07:21:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.107+0000 7fef872bb640 1 --2- 172.21.15.77:0/1358728195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8006c5b0 0x7fef8006ca40 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.107+0000 7fef872bb640 1 --2- 172.21.15.77:0/1358728195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef800b0b40 0x7fef800b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.107+0000 7fef872bb640 1 -- 172.21.15.77:0/1358728195 >> 172.21.15.77:0/1358728195 conn(0x7fef800cbb40 msgr2=0x7fef800cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.107+0000 7fef872bb640 1 -- 172.21.15.77:0/1358728195 shutdown_connections 2023-11-26T07:21:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.107+0000 7fef872bb640 1 -- 172.21.15.77:0/1358728195 wait complete. 2023-11-26T07:21:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.109+0000 7fef872bb640 1 Processor -- start 2023-11-26T07:21:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.109+0000 7fef872bb640 1 -- start start 2023-11-26T07:21:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.110+0000 7fef872bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef8006c5b0 0x7fef80159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.110+0000 7fef872bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef800b0b40 0x7fef800b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.110+0000 7fef872bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8015b260 0x7fef801f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.110+0000 7fef872bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b3080 con 0x7fef8015b260 2023-11-26T07:21:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.110+0000 7fef872bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b1fe0 con 0x7fef8006c5b0 2023-11-26T07:21:45.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.110+0000 7fef872bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b22c0 con 0x7fef800b0b40 2023-11-26T07:21:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.111+0000 7fef86aba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8015b260 0x7fef801f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.111+0000 7fef86aba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8015b260 0x7fef801f0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52946/0 (socket says 172.21.15.77:52946) 2023-11-26T07:21:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.111+0000 7fef86aba640 1 -- 172.21.15.77:0/3538129063 learned_addr learned my addr 172.21.15.77:0/3538129063 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.111+0000 7fef86aba640 1 -- 172.21.15.77:0/3538129063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef800b0b40 msgr2=0x7fef800b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.111+0000 7fef86aba640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef800b0b40 0x7fef800b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.111+0000 7fef86aba640 1 -- 172.21.15.77:0/3538129063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef8006c5b0 msgr2=0x7fef80159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.111+0000 7fef86aba640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef8006c5b0 0x7fef80159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:45.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.111+0000 7fef86aba640 1 -- 172.21.15.77:0/3538129063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78009a70 con 0x7fef8015b260 2023-11-26T07:21:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.111+0000 7fef86aba640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8015b260 0x7fef801f0c70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fef78009d90 tx=0x7fef78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.111+0000 7fef76ffd640 1 -- 172.21.15.77:0/3538129063 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7803e410 con 0x7fef8015b260 2023-11-26T07:21:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.112+0000 7fef76ffd640 1 -- 172.21.15.77:0/3538129063 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7803e590 con 0x7fef8015b260 2023-11-26T07:21:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.112+0000 7fef76ffd640 1 -- 172.21.15.77:0/3538129063 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7803e940 con 0x7fef8015b260 2023-11-26T07:21:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.112+0000 7fef872bb640 1 -- 172.21.15.77:0/3538129063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef800b25a0 con 0x7fef8015b260 2023-11-26T07:21:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.112+0000 7fef872bb640 1 -- 172.21.15.77:0/3538129063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef800b2b60 con 0x7fef8015b260 2023-11-26T07:21:45.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.113+0000 7fef872bb640 1 -- 172.21.15.77:0/3538129063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8004e840 con 0x7fef8015b260 2023-11-26T07:21:45.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.114+0000 7fef76ffd640 1 -- 172.21.15.77:0/3538129063 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fef7803b050 con 0x7fef8015b260 2023-11-26T07:21:45.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.115+0000 7fef76ffd640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6406b3e0 0x7fef6406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:45.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.115+0000 7fef76ffd640 1 -- 172.21.15.77:0/3538129063 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef780ac240 con 0x7fef8015b260 2023-11-26T07:21:45.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.115+0000 7fef862b9640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6406b3e0 0x7fef6406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:45.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.116+0000 7fef862b9640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6406b3e0 0x7fef6406d8a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fef7c007fd0 tx=0x7fef7c007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.119+0000 7fef76ffd640 1 -- 172.21.15.77:0/3538129063 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef78076a40 con 0x7fef8015b260 2023-11-26T07:21:45.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.348+0000 7fef872bb640 1 -- 172.21.15.77:0/3538129063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fef800b4d20 con 0x7fef8015b260 2023-11-26T07:21:45.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.868+0000 7fef76ffd640 1 -- 172.21.15.77:0/3538129063 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7fef7807a060 con 0x7fef8015b260 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 -- 172.21.15.77:0/3538129063 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6406b3e0 msgr2=0x7fef6406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6406b3e0 0x7fef6406d8a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fef7c007fd0 tx=0x7fef7c007960 comp rx=0 tx=0).stop 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 -- 172.21.15.77:0/3538129063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8015b260 msgr2=0x7fef801f0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8015b260 0x7fef801f0c70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fef78009d90 tx=0x7fef78004a40 comp rx=0 tx=0).stop 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 -- 172.21.15.77:0/3538129063 shutdown_connections 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fef6406b3e0 0x7fef6406d8a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef8015b260 0x7fef801f0c70 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef800b0b40 0x7fef800b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 --2- 172.21.15.77:0/3538129063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef8006c5b0 0x7fef80159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 -- 172.21.15.77:0/3538129063 >> 172.21.15.77:0/3538129063 conn(0x7fef800cbb40 msgr2=0x7fef8006e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 -- 172.21.15.77:0/3538129063 shutdown_connections 2023-11-26T07:21:45.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:45.872+0000 7fef872bb640 1 -- 172.21.15.77:0/3538129063 wait complete. 2023-11-26T07:21:45.895 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:21:45.896 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:46.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.099+0000 7eff87023640 1 Processor -- start 2023-11-26T07:21:46.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.099+0000 7eff87023640 1 -- start start 2023-11-26T07:21:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.101+0000 7eff87023640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff8015c7f0 0x7eff8006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.101+0000 7eff87023640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7eff800cf450 0x7eff800cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.101+0000 7eff87023640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff800cece0 con 0x7eff800cdfb0 2023-11-26T07:21:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.101+0000 7eff87023640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff800cfe40 con 0x7eff8015c7f0 2023-11-26T07:21:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.101+0000 7eff87023640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff800ceaf0 con 0x7eff800cf450 2023-11-26T07:21:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.101+0000 7eff84dbf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff8015c7f0 0x7eff8006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.101+0000 7eff855c0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7eff800cdfb0 0x7eff800ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58016/0 (socket says 172.21.15.77:58016) 2023-11-26T07:21:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.101+0000 7eff855c0640 1 -- 172.21.15.77:0/3796940125 learned_addr learned my addr 172.21.15.77:0/3796940125 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:46.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.102+0000 7eff7ffff640 1 --2- 172.21.15.77:0/3796940125 >> v2:172.21.15.159:3300/0 conn(0x7eff800cf450 0x7eff800cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.102+0000 7eff7f7fe640 1 -- 172.21.15.77:0/3796940125 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189867665 0 0) 0x7eff800cece0 con 0x7eff800cdfb0 2023-11-26T07:21:46.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.102+0000 7eff84dbf640 1 -- 172.21.15.77:0/3796940125 >> v2:172.21.15.159:3300/0 conn(0x7eff800cf450 msgr2=0x7eff800cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:46.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.102+0000 7eff84dbf640 1 --2- 172.21.15.77:0/3796940125 >> v2:172.21.15.159:3300/0 conn(0x7eff800cf450 0x7eff800cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.102+0000 7eff84dbf640 1 -- 172.21.15.77:0/3796940125 >> v1:172.21.15.77:6789/0 conn(0x7eff800cdfb0 legacy=0x7eff800ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.102+0000 7eff84dbf640 1 -- 172.21.15.77:0/3796940125 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8006d040 con 0x7eff8015c7f0 2023-11-26T07:21:46.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.102+0000 7eff7ffff640 1 --2- 172.21.15.77:0/3796940125 >> v2:172.21.15.159:3300/0 conn(0x7eff800cf450 0x7eff800cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:46.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.104+0000 7eff84dbf640 1 --2- 172.21.15.77:0/3796940125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff8015c7f0 0x7eff8006db20 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7eff80070410 tx=0x7eff7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c23cac7934358c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:46.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.104+0000 7eff7f7fe640 1 -- 172.21.15.77:0/3796940125 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74031830 con 0x7eff8015c7f0 2023-11-26T07:21:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.104+0000 7eff7f7fe640 1 -- 172.21.15.77:0/3796940125 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff74031990 con 0x7eff8015c7f0 2023-11-26T07:21:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.104+0000 7eff7f7fe640 1 -- 172.21.15.77:0/3796940125 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74031d20 con 0x7eff8015c7f0 2023-11-26T07:21:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.105+0000 7eff87023640 1 -- 172.21.15.77:0/3796940125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff8015c7f0 msgr2=0x7eff8006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.105+0000 7eff87023640 1 --2- 172.21.15.77:0/3796940125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff8015c7f0 0x7eff8006db20 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7eff80070410 tx=0x7eff7402b8d0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.105+0000 7eff87023640 1 -- 172.21.15.77:0/3796940125 shutdown_connections 2023-11-26T07:21:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.105+0000 7eff87023640 1 --2- 172.21.15.77:0/3796940125 >> v2:172.21.15.159:3300/0 conn(0x7eff800cf450 0x7eff800cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.105+0000 7eff87023640 1 --2- 172.21.15.77:0/3796940125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff8015c7f0 0x7eff8006db20 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.105+0000 7eff87023640 1 -- 172.21.15.77:0/3796940125 >> 172.21.15.77:0/3796940125 conn(0x7eff8006a920 msgr2=0x7eff8006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.105+0000 7eff87023640 1 -- 172.21.15.77:0/3796940125 shutdown_connections 2023-11-26T07:21:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.105+0000 7eff87023640 1 -- 172.21.15.77:0/3796940125 wait complete. 2023-11-26T07:21:46.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.107+0000 7eff87023640 1 Processor -- start 2023-11-26T07:21:46.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.107+0000 7eff87023640 1 -- start start 2023-11-26T07:21:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.108+0000 7eff87023640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff800cdfb0 0x7eff801566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.108+0000 7eff87023640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff800cf450 0x7eff8014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.108+0000 7eff87023640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff8015c7f0 0x7eff8014c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.108+0000 7eff87023640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800acaf0 con 0x7eff8015c7f0 2023-11-26T07:21:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.108+0000 7eff87023640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8015b590 con 0x7eff800cf450 2023-11-26T07:21:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.108+0000 7eff87023640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8015b2b0 con 0x7eff800cdfb0 2023-11-26T07:21:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.108+0000 7eff855c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff8015c7f0 0x7eff8014c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.108+0000 7eff855c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff8015c7f0 0x7eff8014c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35762/0 (socket says 172.21.15.77:35762) 2023-11-26T07:21:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.108+0000 7eff855c0640 1 -- 172.21.15.77:0/2516410394 learned_addr learned my addr 172.21.15.77:0/2516410394 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.108+0000 7eff7ffff640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff800cf450 0x7eff8014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.108+0000 7eff84dbf640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff800cdfb0 0x7eff801566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff855c0640 1 -- 172.21.15.77:0/2516410394 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff800cdfb0 msgr2=0x7eff801566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff855c0640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff800cdfb0 0x7eff801566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff855c0640 1 -- 172.21.15.77:0/2516410394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff800cf450 msgr2=0x7eff8014c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff855c0640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff800cf450 0x7eff8014c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff855c0640 1 -- 172.21.15.77:0/2516410394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff74009400 con 0x7eff8015c7f0 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff7ffff640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff800cf450 0x7eff8014c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff855c0640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff8015c7f0 0x7eff8014c590 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7eff78002230 tx=0x7eff7800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff7d7fa640 1 -- 172.21.15.77:0/2516410394 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800ce30 con 0x7eff8015c7f0 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff7d7fa640 1 -- 172.21.15.77:0/2516410394 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7800a640 con 0x7eff8015c7f0 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff87023640 1 -- 172.21.15.77:0/2516410394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff800ac430 con 0x7eff8015c7f0 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff7d7fa640 1 -- 172.21.15.77:0/2516410394 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800a9f0 con 0x7eff8015c7f0 2023-11-26T07:21:46.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.109+0000 7eff87023640 1 -- 172.21.15.77:0/2516410394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff80156c10 con 0x7eff8015c7f0 2023-11-26T07:21:46.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.110+0000 7eff87023640 1 -- 172.21.15.77:0/2516410394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff800acc30 con 0x7eff8015c7f0 2023-11-26T07:21:46.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.111+0000 7eff7d7fa640 1 -- 172.21.15.77:0/2516410394 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7eff7800ab50 con 0x7eff8015c7f0 2023-11-26T07:21:46.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.112+0000 7eff7d7fa640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7eff6406b3e0 0x7eff6406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.112+0000 7eff7d7fa640 1 -- 172.21.15.77:0/2516410394 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff78089800 con 0x7eff8015c7f0 2023-11-26T07:21:46.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.112+0000 7eff84dbf640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7eff6406b3e0 0x7eff6406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.113+0000 7eff84dbf640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7eff6406b3e0 0x7eff6406d8a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7eff74036000 tx=0x7eff7403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.117+0000 7eff7d7fa640 1 -- 172.21.15.77:0/2516410394 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff78054090 con 0x7eff8015c7f0 2023-11-26T07:21:46.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.338+0000 7eff87023640 1 -- 172.21.15.77:0/2516410394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff80067470 con 0x7eff8015c7f0 2023-11-26T07:21:46.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.339+0000 7eff7d7fa640 1 -- 172.21.15.77:0/2516410394 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4919 (secure 0 0 0) 0x7eff780576b0 con 0x7eff8015c7f0 2023-11-26T07:21:46.342 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:46.342 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1822281363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1822281363},{"type":"v1","addr":"172.21.15.159:6834","nonce":1822281363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":4901,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2261329569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2261329569},{"type":"v1","addr":"172.21.15.159:6835","nonce":2261329569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3602997657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3602997657},{"type":"v1","addr":"172.21.15.77:6837","nonce":3602997657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:42.260010+0000","modified":"2023-11-26T07:21:45.350069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/3771669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3771669807},{"type":"v1","addr":"172.21.15.77:6836","nonce":3771669807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:21:46.342 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 35 2023-11-26T07:21:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.341+0000 7eff87023640 1 -- 172.21.15.77:0/2516410394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7eff6406b3e0 msgr2=0x7eff6406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.341+0000 7eff87023640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7eff6406b3e0 0x7eff6406d8a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7eff74036000 tx=0x7eff7403c040 comp rx=0 tx=0).stop 2023-11-26T07:21:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.341+0000 7eff87023640 1 -- 172.21.15.77:0/2516410394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff8015c7f0 msgr2=0x7eff8014c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.341+0000 7eff87023640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff8015c7f0 0x7eff8014c590 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7eff78002230 tx=0x7eff7800cbe0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.342+0000 7eff87023640 1 -- 172.21.15.77:0/2516410394 shutdown_connections 2023-11-26T07:21:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.342+0000 7eff87023640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7eff6406b3e0 0x7eff6406d8a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.342+0000 7eff87023640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff8015c7f0 0x7eff8014c590 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.342+0000 7eff87023640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff800cf450 0x7eff8014c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.342+0000 7eff87023640 1 --2- 172.21.15.77:0/2516410394 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff800cdfb0 0x7eff801566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.342+0000 7eff87023640 1 -- 172.21.15.77:0/2516410394 >> 172.21.15.77:0/2516410394 conn(0x7eff8006a920 msgr2=0x7eff800aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.342+0000 7eff87023640 1 -- 172.21.15.77:0/2516410394 shutdown_connections 2023-11-26T07:21:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.342+0000 7eff87023640 1 -- 172.21.15.77:0/2516410394 wait complete. 2023-11-26T07:21:46.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.560+0000 7f56e2bb0640 1 Processor -- start 2023-11-26T07:21:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.560+0000 7f56e2bb0640 1 -- start start 2023-11-26T07:21:46.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.561+0000 7f56e2bb0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc0ce6c0 0x7f56dc0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.562+0000 7f56e2bb0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc0cece0 con 0x7f56dc15c7f0 2023-11-26T07:21:46.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.562+0000 7f56e2bb0640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc06d040 con 0x7f56dc0cf450 2023-11-26T07:21:46.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.562+0000 7f56e2bb0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0cfe40 con 0x7f56dc0ce6c0 2023-11-26T07:21:46.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.562+0000 7f56e094c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f56dc15c7f0 0x7f56dc06db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58030/0 (socket says 172.21.15.77:58030) 2023-11-26T07:21:46.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.562+0000 7f56e094c640 1 -- 172.21.15.77:0/60172133 learned_addr learned my addr 172.21.15.77:0/60172133 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:46.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.562+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576778766 0 0) 0x7f56dc0cece0 con 0x7f56dc15c7f0 2023-11-26T07:21:46.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.562+0000 7f56e114d640 1 --2- 172.21.15.77:0/60172133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc0ce6c0 0x7f56dc0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.562+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c4003520 con 0x7f56dc15c7f0 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 197183812 0 0) 0x7f56c4003520 con 0x7f56dc15c7f0 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc0ce6c0 msgr2=0x7f56dc0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 --2- 172.21.15.77:0/60172133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc0ce6c0 0x7f56dc0cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 >> v1:172.21.15.159:6789/0 conn(0x7f56dc0cf450 legacy=0x7f56dc0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc06d320 con 0x7f56dc15c7f0 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f56d8001670 con 0x7f56dc15c7f0 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 >> v1:172.21.15.77:6789/0 conn(0x7f56dc15c7f0 legacy=0x7f56dc06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 --2- 172.21.15.77:0/60172133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56c40039a0 0x7f56c4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 --2- 172.21.15.77:0/60172133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc0ce6c0 0x7f56c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 --2- 172.21.15.77:0/60172133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c4004d00 0x7f56c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0cfe40 con 0x7f56c40039a0 2023-11-26T07:21:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c400bb10 con 0x7f56c4004d00 2023-11-26T07:21:46.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c400bca0 con 0x7f56dc0ce6c0 2023-11-26T07:21:46.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56e094c640 1 --2- 172.21.15.77:0/60172133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56c40039a0 0x7f56c4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56e094c640 1 -- 172.21.15.77:0/60172133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc0ce6c0 msgr2=0x7f56c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:46.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56e094c640 1 --2- 172.21.15.77:0/60172133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc0ce6c0 0x7f56c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56e094c640 1 -- 172.21.15.77:0/60172133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c4004d00 msgr2=0x7f56c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:46.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56e114d640 1 --2- 172.21.15.77:0/60172133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c4004d00 0x7f56c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56e094c640 1 --2- 172.21.15.77:0/60172133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c4004d00 0x7f56c4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.563+0000 7f56e094c640 1 -- 172.21.15.77:0/60172133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c4003520 con 0x7f56c40039a0 2023-11-26T07:21:46.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.564+0000 7f56e094c640 1 --2- 172.21.15.77:0/60172133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56c40039a0 0x7f56c4003dc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c270 tx=0x7f56c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cee6160d8f1fc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:46.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.565+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8005ad0 con 0x7f56c40039a0 2023-11-26T07:21:46.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.565+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d8005c30 con 0x7f56c40039a0 2023-11-26T07:21:46.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.565+0000 7f56d37fe640 1 -- 172.21.15.77:0/60172133 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d802c8a0 con 0x7f56c40039a0 2023-11-26T07:21:46.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.565+0000 7f56e2bb0640 1 -- 172.21.15.77:0/60172133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56c40039a0 msgr2=0x7f56c4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.565+0000 7f56e2bb0640 1 --2- 172.21.15.77:0/60172133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56c40039a0 0x7f56c4003dc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c270 tx=0x7f56c40057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.565+0000 7f56e114d640 1 -- 172.21.15.77:0/60172133 reap_dead start 2023-11-26T07:21:46.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.565+0000 7f56e2bb0640 1 -- 172.21.15.77:0/60172133 shutdown_connections 2023-11-26T07:21:46.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.565+0000 7f56e2bb0640 1 -- 172.21.15.77:0/60172133 >> 172.21.15.77:0/60172133 conn(0x7f56dc06a920 msgr2=0x7f56dc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:46.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.565+0000 7f56e2bb0640 1 -- 172.21.15.77:0/60172133 shutdown_connections 2023-11-26T07:21:46.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.565+0000 7f56e2bb0640 1 -- 172.21.15.77:0/60172133 wait complete. 2023-11-26T07:21:46.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.567+0000 7f56e2bb0640 1 Processor -- start 2023-11-26T07:21:46.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.567+0000 7f56e2bb0640 1 -- start start 2023-11-26T07:21:46.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.568+0000 7f56e2bb0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c40039a0 0x7f56dc0c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.568+0000 7f56e2bb0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc151bd0 0x7f56dc15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.568+0000 7f56e2bb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56dc15ac60 0x7f56dc0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.568+0000 7f56e2bb0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0cb240 con 0x7f56dc15ac60 2023-11-26T07:21:46.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.568+0000 7f56e2bb0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc15b0e0 con 0x7f56c40039a0 2023-11-26T07:21:46.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.568+0000 7f56e2bb0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0b0650 con 0x7f56dc151bd0 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.568+0000 7f56e114d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56dc15ac60 0x7f56dc0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.568+0000 7f56e114d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56dc15ac60 0x7f56dc0c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35782/0 (socket says 172.21.15.77:35782) 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.568+0000 7f56e114d640 1 -- 172.21.15.77:0/305328135 learned_addr learned my addr 172.21.15.77:0/305328135 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56d3fff640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc151bd0 0x7f56dc15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56e114d640 1 -- 172.21.15.77:0/305328135 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc151bd0 msgr2=0x7f56dc15a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56e114d640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc151bd0 0x7f56dc15a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56e114d640 1 -- 172.21.15.77:0/305328135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c40039a0 msgr2=0x7f56dc0c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56e114d640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c40039a0 0x7f56dc0c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56e114d640 1 -- 172.21.15.77:0/305328135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0afa40 con 0x7f56dc15ac60 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56e114d640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56dc15ac60 0x7f56dc0c8360 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0ccd80 tx=0x7f56d4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56d17fa640 1 -- 172.21.15.77:0/305328135 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4007cc0 con 0x7f56dc15ac60 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56d17fa640 1 -- 172.21.15.77:0/305328135 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d4007e40 con 0x7f56dc15ac60 2023-11-26T07:21:46.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56e2bb0640 1 -- 172.21.15.77:0/305328135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc0afd20 con 0x7f56dc15ac60 2023-11-26T07:21:46.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56d17fa640 1 -- 172.21.15.77:0/305328135 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4014640 con 0x7f56dc15ac60 2023-11-26T07:21:46.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.569+0000 7f56e2bb0640 1 -- 172.21.15.77:0/305328135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc0b02e0 con 0x7f56dc15ac60 2023-11-26T07:21:46.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.571+0000 7f56e2bb0640 1 -- 172.21.15.77:0/305328135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc067470 con 0x7f56dc15ac60 2023-11-26T07:21:46.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.571+0000 7f56d17fa640 1 -- 172.21.15.77:0/305328135 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f56d401d3b0 con 0x7f56dc15ac60 2023-11-26T07:21:46.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.572+0000 7f56d17fa640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56c806b410 0x7f56c806d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:46.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.572+0000 7f56d17fa640 1 -- 172.21.15.77:0/305328135 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56d4089c00 con 0x7f56dc15ac60 2023-11-26T07:21:46.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.573+0000 7f56e094c640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56c806b410 0x7f56c806d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:46.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.573+0000 7f56e094c640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56c806b410 0x7f56c806d8d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f56d8034000 tx=0x7f56d8007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:46.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.577+0000 7f56d17fa640 1 -- 172.21.15.77:0/305328135 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f56d4054440 con 0x7f56dc15ac60 2023-11-26T07:21:46.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.768+0000 7f56e2bb0640 1 -- 172.21.15.77:0/305328135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56dc06cd80 con 0x7f56dc15ac60 2023-11-26T07:21:46.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.771+0000 7f56d17fa640 1 -- 172.21.15.77:0/305328135 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f56d4057a60 con 0x7f56dc15ac60 2023-11-26T07:21:46.774 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:46.774 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":62,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:21:43.840385+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:40.058564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:41.292572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.773+0000 7f56e2bb0640 1 -- 172.21.15.77:0/305328135 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56c806b410 msgr2=0x7f56c806d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.773+0000 7f56e2bb0640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56c806b410 0x7f56c806d8d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f56d8034000 tx=0x7f56d8007000 comp rx=0 tx=0).stop 2023-11-26T07:21:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.773+0000 7f56e2bb0640 1 -- 172.21.15.77:0/305328135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56dc15ac60 msgr2=0x7f56dc0c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.773+0000 7f56e2bb0640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56dc15ac60 0x7f56dc0c8360 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0ccd80 tx=0x7f56d4009cd0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.774+0000 7f56e2bb0640 1 -- 172.21.15.77:0/305328135 shutdown_connections 2023-11-26T07:21:46.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.774+0000 7f56e2bb0640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f56c806b410 0x7f56c806d8d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.774+0000 7f56e2bb0640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56dc15ac60 0x7f56dc0c8360 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.774+0000 7f56e2bb0640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56dc151bd0 0x7f56dc15a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.774+0000 7f56e2bb0640 1 --2- 172.21.15.77:0/305328135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56c40039a0 0x7f56dc0c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:46.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.774+0000 7f56e2bb0640 1 -- 172.21.15.77:0/305328135 >> 172.21.15.77:0/305328135 conn(0x7f56dc06a920 msgr2=0x7f56dc071490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:46.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.774+0000 7f56e2bb0640 1 -- 172.21.15.77:0/305328135 shutdown_connections 2023-11-26T07:21:46.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:46.774+0000 7f56e2bb0640 1 -- 172.21.15.77:0/305328135 wait complete. 2023-11-26T07:21:46.795 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:21:46.795 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:21:47.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.001+0000 7ff736b8a640 1 Processor -- start 2023-11-26T07:21:47.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.001+0000 7ff736b8a640 1 -- start start 2023-11-26T07:21:47.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.003+0000 7ff736b8a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff7300cc470 0x7ff7300abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.003+0000 7ff736b8a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7300ce640 0x7ff7300b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.003+0000 7ff736b8a640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7300ce270 con 0x7ff7300cf450 2023-11-26T07:21:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.003+0000 7ff736b8a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73006c560 con 0x7ff7300ce640 2023-11-26T07:21:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.003+0000 7ff736b8a640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73006d0a0 con 0x7ff7300cc470 2023-11-26T07:21:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.003+0000 7ff72ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7300ce640 0x7ff7300b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.003+0000 7ff72ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7300ce640 0x7ff7300b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35790/0 (socket says 172.21.15.77:35790) 2023-11-26T07:21:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.003+0000 7ff72ffff640 1 -- 172.21.15.77:0/196920170 learned_addr learned my addr 172.21.15.77:0/196920170 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.004+0000 7ff734926640 1 --2- 172.21.15.77:0/196920170 >> v2:172.21.15.159:3300/0 conn(0x7ff7300cc470 0x7ff7300abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.004+0000 7ff72ffff640 1 -- 172.21.15.77:0/196920170 >> v2:172.21.15.159:3300/0 conn(0x7ff7300cc470 msgr2=0x7ff7300abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.004+0000 7ff72ffff640 1 --2- 172.21.15.77:0/196920170 >> v2:172.21.15.159:3300/0 conn(0x7ff7300cc470 0x7ff7300abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.004+0000 7ff72ffff640 1 -- 172.21.15.77:0/196920170 >> v1:172.21.15.159:6789/0 conn(0x7ff7300cf450 legacy=0x7ff73006d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.004+0000 7ff72ffff640 1 -- 172.21.15.77:0/196920170 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7300b4200 con 0x7ff7300ce640 2023-11-26T07:21:47.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.005+0000 7ff72ffff640 1 --2- 172.21.15.77:0/196920170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7300ce640 0x7ff7300b3cc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff7300b51d0 tx=0x7ff71c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e23a50353c0dadb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.005+0000 7ff72f7fe640 1 -- 172.21.15.77:0/196920170 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c031870 con 0x7ff7300ce640 2023-11-26T07:21:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.005+0000 7ff72f7fe640 1 -- 172.21.15.77:0/196920170 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c0319d0 con 0x7ff7300ce640 2023-11-26T07:21:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.005+0000 7ff72f7fe640 1 -- 172.21.15.77:0/196920170 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c031d60 con 0x7ff7300ce640 2023-11-26T07:21:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.006+0000 7ff736b8a640 1 -- 172.21.15.77:0/196920170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7300ce640 msgr2=0x7ff7300b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.006+0000 7ff736b8a640 1 --2- 172.21.15.77:0/196920170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7300ce640 0x7ff7300b3cc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff7300b51d0 tx=0x7ff71c02b910 comp rx=0 tx=0).stop 2023-11-26T07:21:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.006+0000 7ff736b8a640 1 -- 172.21.15.77:0/196920170 shutdown_connections 2023-11-26T07:21:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.006+0000 7ff736b8a640 1 --2- 172.21.15.77:0/196920170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7300ce640 0x7ff7300b3cc0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.006+0000 7ff736b8a640 1 --2- 172.21.15.77:0/196920170 >> v2:172.21.15.159:3300/0 conn(0x7ff7300cc470 0x7ff7300abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.006+0000 7ff736b8a640 1 -- 172.21.15.77:0/196920170 >> 172.21.15.77:0/196920170 conn(0x7ff73006a920 msgr2=0x7ff73006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.006+0000 7ff736b8a640 1 -- 172.21.15.77:0/196920170 shutdown_connections 2023-11-26T07:21:47.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.006+0000 7ff736b8a640 1 -- 172.21.15.77:0/196920170 wait complete. 2023-11-26T07:21:47.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.008+0000 7ff736b8a640 1 Processor -- start 2023-11-26T07:21:47.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.008+0000 7ff736b8a640 1 -- start start 2023-11-26T07:21:47.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.009+0000 7ff736b8a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7300cc470 0x7ff73015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.009+0000 7ff736b8a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7300ce640 0x7ff73014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.009+0000 7ff736b8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7300cf450 0x7ff730159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.009+0000 7ff736b8a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff730158ac0 con 0x7ff7300cf450 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.009+0000 7ff736b8a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73015ad00 con 0x7ff7300cc470 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.009+0000 7ff736b8a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73014c9e0 con 0x7ff7300ce640 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.009+0000 7ff735127640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7300cf450 0x7ff730159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.009+0000 7ff735127640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7300cf450 0x7ff730159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35796/0 (socket says 172.21.15.77:35796) 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.009+0000 7ff735127640 1 -- 172.21.15.77:0/1642892210 learned_addr learned my addr 172.21.15.77:0/1642892210 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff734926640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7300cc470 0x7ff73015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff72ffff640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7300ce640 0x7ff73014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff735127640 1 -- 172.21.15.77:0/1642892210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7300ce640 msgr2=0x7ff73014c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff735127640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7300ce640 0x7ff73014c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff735127640 1 -- 172.21.15.77:0/1642892210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7300cc470 msgr2=0x7ff73015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff735127640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7300cc470 0x7ff73015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff735127640 1 -- 172.21.15.77:0/1642892210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c0094d0 con 0x7ff7300cf450 2023-11-26T07:21:47.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff735127640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7300cf450 0x7ff730159db0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff72800c780 tx=0x7ff72800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:47.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff72d7fa640 1 -- 172.21.15.77:0/1642892210 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728004b10 con 0x7ff7300cf450 2023-11-26T07:21:47.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff72d7fa640 1 -- 172.21.15.77:0/1642892210 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff728004c70 con 0x7ff7300cf450 2023-11-26T07:21:47.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff736b8a640 1 -- 172.21.15.77:0/1642892210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff730158d10 con 0x7ff7300cf450 2023-11-26T07:21:47.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.010+0000 7ff72d7fa640 1 -- 172.21.15.77:0/1642892210 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72800aa90 con 0x7ff7300cf450 2023-11-26T07:21:47.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.011+0000 7ff736b8a640 1 -- 172.21.15.77:0/1642892210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7301592d0 con 0x7ff7300cf450 2023-11-26T07:21:47.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.011+0000 7ff736b8a640 1 -- 172.21.15.77:0/1642892210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff730067470 con 0x7ff7300cf450 2023-11-26T07:21:47.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.012+0000 7ff72d7fa640 1 -- 172.21.15.77:0/1642892210 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7ff72800abf0 con 0x7ff7300cf450 2023-11-26T07:21:47.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.013+0000 7ff72d7fa640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff71406b410 0x7ff71406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.013+0000 7ff72d7fa640 1 -- 172.21.15.77:0/1642892210 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff72808a1e0 con 0x7ff7300cf450 2023-11-26T07:21:47.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.014+0000 7ff734926640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff71406b410 0x7ff71406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.014+0000 7ff734926640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff71406b410 0x7ff71406d8d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff724006fd0 tx=0x7ff724008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:47.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.018+0000 7ff72d7fa640 1 -- 172.21.15.77:0/1642892210 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff728054950 con 0x7ff7300cf450 2023-11-26T07:21:47.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.190+0000 7ff736b8a640 1 -- 172.21.15.77:0/1642892210 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff73006cd30 con 0x7ff71406b410 2023-11-26T07:21:47.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.198+0000 7ff72d7fa640 1 -- 172.21.15.77:0/1642892210 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287062 (secure 0 0 0) 0x7ff72400f860 con 0x7ff71406b410 2023-11-26T07:21:47.204 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:47.206 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:21:47.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 -- 172.21.15.77:0/1642892210 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff71406b410 msgr2=0x7ff71406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff71406b410 0x7ff71406d8d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff724006fd0 tx=0x7ff724008040 comp rx=0 tx=0).stop 2023-11-26T07:21:47.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 -- 172.21.15.77:0/1642892210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7300cf450 msgr2=0x7ff730159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7300cf450 0x7ff730159db0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff72800c780 tx=0x7ff72800cc40 comp rx=0 tx=0).stop 2023-11-26T07:21:47.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 -- 172.21.15.77:0/1642892210 shutdown_connections 2023-11-26T07:21:47.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff71406b410 0x7ff71406d8d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7300cf450 0x7ff730159db0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7300ce640 0x7ff73014c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 --2- 172.21.15.77:0/1642892210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7300cc470 0x7ff73015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 -- 172.21.15.77:0/1642892210 >> 172.21.15.77:0/1642892210 conn(0x7ff73006a920 msgr2=0x7ff7300aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:47.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 -- 172.21.15.77:0/1642892210 shutdown_connections 2023-11-26T07:21:47.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.203+0000 7ff736b8a640 1 -- 172.21.15.77:0/1642892210 wait complete. 2023-11-26T07:21:47.223 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-11-26T07:21:45.682271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256404,"kb_used_data":6940,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718316,"statfs":{"total":773094113280,"available":772831555584,"internally_reserved":0,"allocated":7106560,"data_stored":3655504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.886850"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.849829+0000","last_change":"2023-11-26T07:21:42.842031+0000","last_active":"2023-11-26T07:21:42.849829+0000","last_peered":"2023-11-26T07:21:42.849829+0000","last_clean":"2023-11-26T07:21:42.849829+0000","last_became_active":"2023-11-26T07:21:42.841761+0000","last_became_peered":"2023-11-26T07:21:42.841761+0000","last_unstale":"2023-11-26T07:21:42.849829+0000","last_undegraded":"2023-11-26T07:21:42.849829+0000","last_fullsized":"2023-11-26T07:21:42.849829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:41:56.646698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861558+0000","last_change":"2023-11-26T07:21:42.847586+0000","last_active":"2023-11-26T07:21:42.861558+0000","last_peered":"2023-11-26T07:21:42.861558+0000","last_clean":"2023-11-26T07:21:42.861558+0000","last_became_active":"2023-11-26T07:21:42.847299+0000","last_became_peered":"2023-11-26T07:21:42.847299+0000","last_unstale":"2023-11-26T07:21:42.861558+0000","last_undegraded":"2023-11-26T07:21:42.861558+0000","last_fullsized":"2023-11-26T07:21:42.861558+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:39:20.542129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879648+0000","last_change":"2023-11-26T07:21:42.869292+0000","last_active":"2023-11-26T07:21:42.879648+0000","last_peered":"2023-11-26T07:21:42.879648+0000","last_clean":"2023-11-26T07:21:42.879648+0000","last_became_active":"2023-11-26T07:21:42.868917+0000","last_became_peered":"2023-11-26T07:21:42.868917+0000","last_unstale":"2023-11-26T07:21:42.879648+0000","last_undegraded":"2023-11-26T07:21:42.879648+0000","last_fullsized":"2023-11-26T07:21:42.879648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:33:17.104115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.852786+0000","last_change":"2023-11-26T07:21:42.846410+0000","last_active":"2023-11-26T07:21:42.852786+0000","last_peered":"2023-11-26T07:21:42.852786+0000","last_clean":"2023-11-26T07:21:42.852786+0000","last_became_active":"2023-11-26T07:21:42.845931+0000","last_became_peered":"2023-11-26T07:21:42.845931+0000","last_unstale":"2023-11-26T07:21:42.852786+0000","last_undegraded":"2023-11-26T07:21:42.852786+0000","last_fullsized":"2023-11-26T07:21:42.852786+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:05:36.084405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.855646+0000","last_change":"2023-11-26T07:21:42.853737+0000","last_active":"2023-11-26T07:21:42.855646+0000","last_peered":"2023-11-26T07:21:42.855646+0000","last_clean":"2023-11-26T07:21:42.855646+0000","last_became_active":"2023-11-26T07:21:42.853478+0000","last_became_peered":"2023-11-26T07:21:42.853478+0000","last_unstale":"2023-11-26T07:21:42.855646+0000","last_undegraded":"2023-11-26T07:21:42.855646+0000","last_fullsized":"2023-11-26T07:21:42.855646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:28:38.686338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.845894+0000","last_change":"2023-11-26T07:21:42.838879+0000","last_active":"2023-11-26T07:21:42.845894+0000","last_peered":"2023-11-26T07:21:42.845894+0000","last_clean":"2023-11-26T07:21:42.845894+0000","last_became_active":"2023-11-26T07:21:42.838603+0000","last_became_peered":"2023-11-26T07:21:42.838603+0000","last_unstale":"2023-11-26T07:21:42.845894+0000","last_undegraded":"2023-11-26T07:21:42.845894+0000","last_fullsized":"2023-11-26T07:21:42.845894+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:55:07.606916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.857720+0000","last_change":"2023-11-26T07:21:42.855286+0000","last_active":"2023-11-26T07:21:42.857720+0000","last_peered":"2023-11-26T07:21:42.857720+0000","last_clean":"2023-11-26T07:21:42.857720+0000","last_became_active":"2023-11-26T07:21:42.854215+0000","last_became_peered":"2023-11-26T07:21:42.854215+0000","last_unstale":"2023-11-26T07:21:42.857720+0000","last_undegraded":"2023-11-26T07:21:42.857720+0000","last_fullsized":"2023-11-26T07:21:42.857720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:31:47.404971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861701+0000","last_change":"2023-11-26T07:21:42.852928+0000","last_active":"2023-11-26T07:21:42.861701+0000","last_peered":"2023-11-26T07:21:42.861701+0000","last_clean":"2023-11-26T07:21:42.861701+0000","last_became_active":"2023-11-26T07:21:42.848984+0000","last_became_peered":"2023-11-26T07:21:42.848984+0000","last_unstale":"2023-11-26T07:21:42.861701+0000","last_undegraded":"2023-11-26T07:21:42.861701+0000","last_fullsized":"2023-11-26T07:21:42.861701+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:44:14.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.864740+0000","last_change":"2023-11-26T07:21:42.860047+0000","last_active":"2023-11-26T07:21:42.864740+0000","last_peered":"2023-11-26T07:21:42.864740+0000","last_clean":"2023-11-26T07:21:42.864740+0000","last_became_active":"2023-11-26T07:21:42.859598+0000","last_became_peered":"2023-11-26T07:21:42.859598+0000","last_unstale":"2023-11-26T07:21:42.864740+0000","last_undegraded":"2023-11-26T07:21:42.864740+0000","last_fullsized":"2023-11-26T07:21:42.864740+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:54:00.540700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.863440+0000","last_change":"2023-11-26T07:21:42.857682+0000","last_active":"2023-11-26T07:21:42.863440+0000","last_peered":"2023-11-26T07:21:42.863440+0000","last_clean":"2023-11-26T07:21:42.863440+0000","last_became_active":"2023-11-26T07:21:42.854407+0000","last_became_peered":"2023-11-26T07:21:42.854407+0000","last_unstale":"2023-11-26T07:21:42.863440+0000","last_undegraded":"2023-11-26T07:21:42.863440+0000","last_fullsized":"2023-11-26T07:21:42.863440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:50.591863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.863674+0000","last_change":"2023-11-26T07:21:42.858633+0000","last_active":"2023-11-26T07:21:42.863674+0000","last_peered":"2023-11-26T07:21:42.863674+0000","last_clean":"2023-11-26T07:21:42.863674+0000","last_became_active":"2023-11-26T07:21:42.854210+0000","last_became_peered":"2023-11-26T07:21:42.854210+0000","last_unstale":"2023-11-26T07:21:42.863674+0000","last_undegraded":"2023-11-26T07:21:42.863674+0000","last_fullsized":"2023-11-26T07:21:42.863674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:33.600063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.874463+0000","last_change":"2023-11-26T07:21:42.866361+0000","last_active":"2023-11-26T07:21:42.874463+0000","last_peered":"2023-11-26T07:21:42.874463+0000","last_clean":"2023-11-26T07:21:42.874463+0000","last_became_active":"2023-11-26T07:21:42.865395+0000","last_became_peered":"2023-11-26T07:21:42.865395+0000","last_unstale":"2023-11-26T07:21:42.874463+0000","last_undegraded":"2023-11-26T07:21:42.874463+0000","last_fullsized":"2023-11-26T07:21:42.874463+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:10:43.421835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.868340+0000","last_change":"2023-11-26T07:21:42.862938+0000","last_active":"2023-11-26T07:21:42.868340+0000","last_peered":"2023-11-26T07:21:42.868340+0000","last_clean":"2023-11-26T07:21:42.868340+0000","last_became_active":"2023-11-26T07:21:42.862627+0000","last_became_peered":"2023-11-26T07:21:42.862627+0000","last_unstale":"2023-11-26T07:21:42.868340+0000","last_undegraded":"2023-11-26T07:21:42.868340+0000","last_fullsized":"2023-11-26T07:21:42.868340+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:37:17.608463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862447+0000","last_change":"2023-11-26T07:21:42.857219+0000","last_active":"2023-11-26T07:21:42.862447+0000","last_peered":"2023-11-26T07:21:42.862447+0000","last_clean":"2023-11-26T07:21:42.862447+0000","last_became_active":"2023-11-26T07:21:42.856879+0000","last_became_peered":"2023-11-26T07:21:42.856879+0000","last_unstale":"2023-11-26T07:21:42.862447+0000","last_undegraded":"2023-11-26T07:21:42.862447+0000","last_fullsized":"2023-11-26T07:21:42.862447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:23:14.927284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.852339+0000","last_change":"2023-11-26T07:21:42.849401+0000","last_active":"2023-11-26T07:21:42.852339+0000","last_peered":"2023-11-26T07:21:42.852339+0000","last_clean":"2023-11-26T07:21:42.852339+0000","last_became_active":"2023-11-26T07:21:42.849046+0000","last_became_peered":"2023-11-26T07:21:42.849046+0000","last_unstale":"2023-11-26T07:21:42.852339+0000","last_undegraded":"2023-11-26T07:21:42.852339+0000","last_fullsized":"2023-11-26T07:21:42.852339+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:14:37.239032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861646+0000","last_change":"2023-11-26T07:21:42.851979+0000","last_active":"2023-11-26T07:21:42.861646+0000","last_peered":"2023-11-26T07:21:42.861646+0000","last_clean":"2023-11-26T07:21:42.861646+0000","last_became_active":"2023-11-26T07:21:42.851732+0000","last_became_peered":"2023-11-26T07:21:42.851732+0000","last_unstale":"2023-11-26T07:21:42.861646+0000","last_undegraded":"2023-11-26T07:21:42.861646+0000","last_fullsized":"2023-11-26T07:21:42.861646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:45:11.939133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862516+0000","last_change":"2023-11-26T07:21:42.855541+0000","last_active":"2023-11-26T07:21:42.862516+0000","last_peered":"2023-11-26T07:21:42.862516+0000","last_clean":"2023-11-26T07:21:42.862516+0000","last_became_active":"2023-11-26T07:21:42.855149+0000","last_became_peered":"2023-11-26T07:21:42.855149+0000","last_unstale":"2023-11-26T07:21:42.862516+0000","last_undegraded":"2023-11-26T07:21:42.862516+0000","last_fullsized":"2023-11-26T07:21:42.862516+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:52:53.785827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879828+0000","last_change":"2023-11-26T07:21:42.872310+0000","last_active":"2023-11-26T07:21:42.879828+0000","last_peered":"2023-11-26T07:21:42.879828+0000","last_clean":"2023-11-26T07:21:42.879828+0000","last_became_active":"2023-11-26T07:21:42.872029+0000","last_became_peered":"2023-11-26T07:21:42.872029+0000","last_unstale":"2023-11-26T07:21:42.879828+0000","last_undegraded":"2023-11-26T07:21:42.879828+0000","last_fullsized":"2023-11-26T07:21:42.879828+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:28:25.295294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.863127+0000","last_change":"2023-11-26T07:21:42.858279+0000","last_active":"2023-11-26T07:21:42.863127+0000","last_peered":"2023-11-26T07:21:42.863127+0000","last_clean":"2023-11-26T07:21:42.863127+0000","last_became_active":"2023-11-26T07:21:42.858030+0000","last_became_peered":"2023-11-26T07:21:42.858030+0000","last_unstale":"2023-11-26T07:21:42.863127+0000","last_undegraded":"2023-11-26T07:21:42.863127+0000","last_fullsized":"2023-11-26T07:21:42.863127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:58:13.415006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.847198+0000","last_change":"2023-11-26T07:21:42.839386+0000","last_active":"2023-11-26T07:21:42.847198+0000","last_peered":"2023-11-26T07:21:42.847198+0000","last_clean":"2023-11-26T07:21:42.847198+0000","last_became_active":"2023-11-26T07:21:42.839041+0000","last_became_peered":"2023-11-26T07:21:42.839041+0000","last_unstale":"2023-11-26T07:21:42.847198+0000","last_undegraded":"2023-11-26T07:21:42.847198+0000","last_fullsized":"2023-11-26T07:21:42.847198+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:42:48.174400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879867+0000","last_change":"2023-11-26T07:21:42.872622+0000","last_active":"2023-11-26T07:21:42.879867+0000","last_peered":"2023-11-26T07:21:42.879867+0000","last_clean":"2023-11-26T07:21:42.879867+0000","last_became_active":"2023-11-26T07:21:42.870383+0000","last_became_peered":"2023-11-26T07:21:42.870383+0000","last_unstale":"2023-11-26T07:21:42.879867+0000","last_undegraded":"2023-11-26T07:21:42.879867+0000","last_fullsized":"2023-11-26T07:21:42.879867+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:51.981889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861593+0000","last_change":"2023-11-26T07:21:42.847674+0000","last_active":"2023-11-26T07:21:42.861593+0000","last_peered":"2023-11-26T07:21:42.861593+0000","last_clean":"2023-11-26T07:21:42.861593+0000","last_became_active":"2023-11-26T07:21:42.847376+0000","last_became_peered":"2023-11-26T07:21:42.847376+0000","last_unstale":"2023-11-26T07:21:42.861593+0000","last_undegraded":"2023-11-26T07:21:42.861593+0000","last_fullsized":"2023-11-26T07:21:42.861593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:38:38.415989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879910+0000","last_change":"2023-11-26T07:21:42.873118+0000","last_active":"2023-11-26T07:21:42.879910+0000","last_peered":"2023-11-26T07:21:42.879910+0000","last_clean":"2023-11-26T07:21:42.879910+0000","last_became_active":"2023-11-26T07:21:42.872712+0000","last_became_peered":"2023-11-26T07:21:42.872712+0000","last_unstale":"2023-11-26T07:21:42.879910+0000","last_undegraded":"2023-11-26T07:21:42.879910+0000","last_fullsized":"2023-11-26T07:21:42.879910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:35.228374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.853774+0000","last_change":"2023-11-26T07:21:42.850938+0000","last_active":"2023-11-26T07:21:42.853774+0000","last_peered":"2023-11-26T07:21:42.853774+0000","last_clean":"2023-11-26T07:21:42.853774+0000","last_became_active":"2023-11-26T07:21:42.850625+0000","last_became_peered":"2023-11-26T07:21:42.850625+0000","last_unstale":"2023-11-26T07:21:42.853774+0000","last_undegraded":"2023-11-26T07:21:42.853774+0000","last_fullsized":"2023-11-26T07:21:42.853774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:25:51.194056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.849849+0000","last_change":"2023-11-26T07:21:42.844899+0000","last_active":"2023-11-26T07:21:42.849849+0000","last_peered":"2023-11-26T07:21:42.849849+0000","last_clean":"2023-11-26T07:21:42.849849+0000","last_became_active":"2023-11-26T07:21:42.844601+0000","last_became_peered":"2023-11-26T07:21:42.844601+0000","last_unstale":"2023-11-26T07:21:42.849849+0000","last_undegraded":"2023-11-26T07:21:42.849849+0000","last_fullsized":"2023-11-26T07:21:42.849849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:37:15.444028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854699+0000","last_change":"2023-11-26T07:21:42.849029+0000","last_active":"2023-11-26T07:21:42.854699+0000","last_peered":"2023-11-26T07:21:42.854699+0000","last_clean":"2023-11-26T07:21:42.854699+0000","last_became_active":"2023-11-26T07:21:42.848762+0000","last_became_peered":"2023-11-26T07:21:42.848762+0000","last_unstale":"2023-11-26T07:21:42.854699+0000","last_undegraded":"2023-11-26T07:21:42.854699+0000","last_fullsized":"2023-11-26T07:21:42.854699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:45:11.939133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862843+0000","last_change":"2023-11-26T07:21:42.855182+0000","last_active":"2023-11-26T07:21:42.862843+0000","last_peered":"2023-11-26T07:21:42.862843+0000","last_clean":"2023-11-26T07:21:42.862843+0000","last_became_active":"2023-11-26T07:21:42.854850+0000","last_became_peered":"2023-11-26T07:21:42.854850+0000","last_unstale":"2023-11-26T07:21:42.862843+0000","last_undegraded":"2023-11-26T07:21:42.862843+0000","last_fullsized":"2023-11-26T07:21:42.862843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:05:36.084405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854089+0000","last_change":"2023-11-26T07:21:42.850429+0000","last_active":"2023-11-26T07:21:42.854089+0000","last_peered":"2023-11-26T07:21:42.854089+0000","last_clean":"2023-11-26T07:21:42.854089+0000","last_became_active":"2023-11-26T07:21:42.850146+0000","last_became_peered":"2023-11-26T07:21:42.850146+0000","last_unstale":"2023-11-26T07:21:42.854089+0000","last_undegraded":"2023-11-26T07:21:42.854089+0000","last_fullsized":"2023-11-26T07:21:42.854089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:15:47.679562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.864147+0000","last_change":"2023-11-26T07:21:42.858609+0000","last_active":"2023-11-26T07:21:42.864147+0000","last_peered":"2023-11-26T07:21:42.864147+0000","last_clean":"2023-11-26T07:21:42.864147+0000","last_became_active":"2023-11-26T07:21:42.858303+0000","last_became_peered":"2023-11-26T07:21:42.858303+0000","last_unstale":"2023-11-26T07:21:42.864147+0000","last_undegraded":"2023-11-26T07:21:42.864147+0000","last_fullsized":"2023-11-26T07:21:42.864147+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:18:35.133581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879883+0000","last_change":"2023-11-26T07:21:42.872759+0000","last_active":"2023-11-26T07:21:42.879883+0000","last_peered":"2023-11-26T07:21:42.879883+0000","last_clean":"2023-11-26T07:21:42.879883+0000","last_became_active":"2023-11-26T07:21:42.872372+0000","last_became_peered":"2023-11-26T07:21:42.872372+0000","last_unstale":"2023-11-26T07:21:42.879883+0000","last_undegraded":"2023-11-26T07:21:42.879883+0000","last_fullsized":"2023-11-26T07:21:42.879883+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:08:08.549806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.849312+0000","last_change":"2023-11-26T07:21:42.844589+0000","last_active":"2023-11-26T07:21:42.849312+0000","last_peered":"2023-11-26T07:21:42.849312+0000","last_clean":"2023-11-26T07:21:42.849312+0000","last_became_active":"2023-11-26T07:21:42.843253+0000","last_became_peered":"2023-11-26T07:21:42.843253+0000","last_unstale":"2023-11-26T07:21:42.849312+0000","last_undegraded":"2023-11-26T07:21:42.849312+0000","last_fullsized":"2023-11-26T07:21:42.849312+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:54:24.018827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.849564+0000","last_change":"2023-11-26T07:21:42.842772+0000","last_active":"2023-11-26T07:21:42.849564+0000","last_peered":"2023-11-26T07:21:42.849564+0000","last_clean":"2023-11-26T07:21:42.849564+0000","last_became_active":"2023-11-26T07:21:42.842494+0000","last_became_peered":"2023-11-26T07:21:42.842494+0000","last_unstale":"2023-11-26T07:21:42.849564+0000","last_undegraded":"2023-11-26T07:21:42.849564+0000","last_fullsized":"2023-11-26T07:21:42.849564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:35.228374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.874463+0000","last_change":"2023-11-26T07:21:42.873704+0000","last_active":"2023-11-26T07:21:42.874463+0000","last_peered":"2023-11-26T07:21:42.874463+0000","last_clean":"2023-11-26T07:21:42.874463+0000","last_became_active":"2023-11-26T07:21:42.873063+0000","last_became_peered":"2023-11-26T07:21:42.873063+0000","last_unstale":"2023-11-26T07:21:42.874463+0000","last_undegraded":"2023-11-26T07:21:42.874463+0000","last_fullsized":"2023-11-26T07:21:42.874463+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:43:14.397209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862972+0000","last_change":"2023-11-26T07:21:41.831678+0000","last_active":"2023-11-26T07:21:42.862972+0000","last_peered":"2023-11-26T07:21:42.862972+0000","last_clean":"2023-11-26T07:21:42.862972+0000","last_became_active":"2023-11-26T07:21:41.831400+0000","last_became_peered":"2023-11-26T07:21:41.831400+0000","last_unstale":"2023-11-26T07:21:42.862972+0000","last_undegraded":"2023-11-26T07:21:42.862972+0000","last_fullsized":"2023-11-26T07:21:42.862972+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:39:33.083235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.868289+0000","last_change":"2023-11-26T07:21:42.866825+0000","last_active":"2023-11-26T07:21:42.868289+0000","last_peered":"2023-11-26T07:21:42.868289+0000","last_clean":"2023-11-26T07:21:42.868289+0000","last_became_active":"2023-11-26T07:21:42.866568+0000","last_became_peered":"2023-11-26T07:21:42.866568+0000","last_unstale":"2023-11-26T07:21:42.868289+0000","last_undegraded":"2023-11-26T07:21:42.868289+0000","last_fullsized":"2023-11-26T07:21:42.868289+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:56:16.229026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.871508+0000","last_change":"2023-11-26T07:21:41.834417+0000","last_active":"2023-11-26T07:21:42.871508+0000","last_peered":"2023-11-26T07:21:42.871508+0000","last_clean":"2023-11-26T07:21:42.871508+0000","last_became_active":"2023-11-26T07:21:41.833905+0000","last_became_peered":"2023-11-26T07:21:41.833905+0000","last_unstale":"2023-11-26T07:21:42.871508+0000","last_undegraded":"2023-11-26T07:21:42.871508+0000","last_fullsized":"2023-11-26T07:21:42.871508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:10:56.152788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.852418+0000","last_change":"2023-11-26T07:21:42.841126+0000","last_active":"2023-11-26T07:21:42.852418+0000","last_peered":"2023-11-26T07:21:42.852418+0000","last_clean":"2023-11-26T07:21:42.852418+0000","last_became_active":"2023-11-26T07:21:42.840539+0000","last_became_peered":"2023-11-26T07:21:42.840539+0000","last_unstale":"2023-11-26T07:21:42.852418+0000","last_undegraded":"2023-11-26T07:21:42.852418+0000","last_fullsized":"2023-11-26T07:21:42.852418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:18:35.133581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.864299+0000","last_change":"2023-11-26T07:21:41.821874+0000","last_active":"2023-11-26T07:21:42.864299+0000","last_peered":"2023-11-26T07:21:42.864299+0000","last_clean":"2023-11-26T07:21:42.864299+0000","last_became_active":"2023-11-26T07:21:41.821609+0000","last_became_peered":"2023-11-26T07:21:41.821609+0000","last_unstale":"2023-11-26T07:21:42.864299+0000","last_undegraded":"2023-11-26T07:21:42.864299+0000","last_fullsized":"2023-11-26T07:21:42.864299+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:10:56.734748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854774+0000","last_change":"2023-11-26T07:21:42.846302+0000","last_active":"2023-11-26T07:21:42.854774+0000","last_peered":"2023-11-26T07:21:42.854774+0000","last_clean":"2023-11-26T07:21:42.854774+0000","last_became_active":"2023-11-26T07:21:42.845992+0000","last_became_peered":"2023-11-26T07:21:42.845992+0000","last_unstale":"2023-11-26T07:21:42.854774+0000","last_undegraded":"2023-11-26T07:21:42.854774+0000","last_fullsized":"2023-11-26T07:21:42.854774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:57:26.318998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.871165+0000","last_change":"2023-11-26T07:21:41.838159+0000","last_active":"2023-11-26T07:21:42.871165+0000","last_peered":"2023-11-26T07:21:42.871165+0000","last_clean":"2023-11-26T07:21:42.871165+0000","last_became_active":"2023-11-26T07:21:41.837642+0000","last_became_peered":"2023-11-26T07:21:41.837642+0000","last_unstale":"2023-11-26T07:21:42.871165+0000","last_undegraded":"2023-11-26T07:21:42.871165+0000","last_fullsized":"2023-11-26T07:21:42.871165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:43:13.386831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862417+0000","last_change":"2023-11-26T07:21:42.855445+0000","last_active":"2023-11-26T07:21:42.862417+0000","last_peered":"2023-11-26T07:21:42.862417+0000","last_clean":"2023-11-26T07:21:42.862417+0000","last_became_active":"2023-11-26T07:21:42.855181+0000","last_became_peered":"2023-11-26T07:21:42.855181+0000","last_unstale":"2023-11-26T07:21:42.862417+0000","last_undegraded":"2023-11-26T07:21:42.862417+0000","last_fullsized":"2023-11-26T07:21:42.862417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:05.282229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.866152+0000","last_change":"2023-11-26T07:21:41.827246+0000","last_active":"2023-11-26T07:21:42.866152+0000","last_peered":"2023-11-26T07:21:42.866152+0000","last_clean":"2023-11-26T07:21:42.866152+0000","last_became_active":"2023-11-26T07:21:41.826968+0000","last_became_peered":"2023-11-26T07:21:41.826968+0000","last_unstale":"2023-11-26T07:21:42.866152+0000","last_undegraded":"2023-11-26T07:21:42.866152+0000","last_fullsized":"2023-11-26T07:21:42.866152+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:30:28.259076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.859312+0000","last_change":"2023-11-26T07:21:42.846101+0000","last_active":"2023-11-26T07:21:42.859312+0000","last_peered":"2023-11-26T07:21:42.859312+0000","last_clean":"2023-11-26T07:21:42.859312+0000","last_became_active":"2023-11-26T07:21:42.843542+0000","last_became_peered":"2023-11-26T07:21:42.843542+0000","last_unstale":"2023-11-26T07:21:42.859312+0000","last_undegraded":"2023-11-26T07:21:42.859312+0000","last_fullsized":"2023-11-26T07:21:42.859312+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:08.018038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.856318+0000","last_change":"2023-11-26T07:21:41.835411+0000","last_active":"2023-11-26T07:21:42.856318+0000","last_peered":"2023-11-26T07:21:42.856318+0000","last_clean":"2023-11-26T07:21:42.856318+0000","last_became_active":"2023-11-26T07:21:41.835012+0000","last_became_peered":"2023-11-26T07:21:41.835012+0000","last_unstale":"2023-11-26T07:21:42.856318+0000","last_undegraded":"2023-11-26T07:21:42.856318+0000","last_fullsized":"2023-11-26T07:21:42.856318+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:37.258248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.877024+0000","last_change":"2023-11-26T07:21:42.870409+0000","last_active":"2023-11-26T07:21:42.877024+0000","last_peered":"2023-11-26T07:21:42.877024+0000","last_clean":"2023-11-26T07:21:42.877024+0000","last_became_active":"2023-11-26T07:21:42.869736+0000","last_became_peered":"2023-11-26T07:21:42.869736+0000","last_unstale":"2023-11-26T07:21:42.877024+0000","last_undegraded":"2023-11-26T07:21:42.877024+0000","last_fullsized":"2023-11-26T07:21:42.877024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:47:15.747841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.829804+0000","last_change":"2023-11-26T07:21:41.833169+0000","last_active":"2023-11-26T07:21:42.829804+0000","last_peered":"2023-11-26T07:21:42.829804+0000","last_clean":"2023-11-26T07:21:42.829804+0000","last_became_active":"2023-11-26T07:21:41.832835+0000","last_became_peered":"2023-11-26T07:21:41.832835+0000","last_unstale":"2023-11-26T07:21:42.829804+0000","last_undegraded":"2023-11-26T07:21:42.829804+0000","last_fullsized":"2023-11-26T07:21:42.829804+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:33:16.093737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862431+0000","last_change":"2023-11-26T07:21:42.857077+0000","last_active":"2023-11-26T07:21:42.862431+0000","last_peered":"2023-11-26T07:21:42.862431+0000","last_clean":"2023-11-26T07:21:42.862431+0000","last_became_active":"2023-11-26T07:21:42.856183+0000","last_became_peered":"2023-11-26T07:21:42.856183+0000","last_unstale":"2023-11-26T07:21:42.862431+0000","last_undegraded":"2023-11-26T07:21:42.862431+0000","last_fullsized":"2023-11-26T07:21:42.862431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:36:27.282658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.841754+0000","last_change":"2023-11-26T07:21:41.825293+0000","last_active":"2023-11-26T07:21:42.841754+0000","last_peered":"2023-11-26T07:21:42.841754+0000","last_clean":"2023-11-26T07:21:42.841754+0000","last_became_active":"2023-11-26T07:21:41.824899+0000","last_became_peered":"2023-11-26T07:21:41.824899+0000","last_unstale":"2023-11-26T07:21:42.841754+0000","last_undegraded":"2023-11-26T07:21:42.841754+0000","last_fullsized":"2023-11-26T07:21:42.841754+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:31:36.588912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862473+0000","last_change":"2023-11-26T07:21:42.858193+0000","last_active":"2023-11-26T07:21:42.862473+0000","last_peered":"2023-11-26T07:21:42.862473+0000","last_clean":"2023-11-26T07:21:42.862473+0000","last_became_active":"2023-11-26T07:21:42.857856+0000","last_became_peered":"2023-11-26T07:21:42.857856+0000","last_unstale":"2023-11-26T07:21:42.862473+0000","last_undegraded":"2023-11-26T07:21:42.862473+0000","last_fullsized":"2023-11-26T07:21:42.862473+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:33:17.104115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861418+0000","last_change":"2023-11-26T07:21:41.842257+0000","last_active":"2023-11-26T07:21:42.861418+0000","last_peered":"2023-11-26T07:21:42.861418+0000","last_clean":"2023-11-26T07:21:42.861418+0000","last_became_active":"2023-11-26T07:21:41.841887+0000","last_became_peered":"2023-11-26T07:21:41.841887+0000","last_unstale":"2023-11-26T07:21:42.861418+0000","last_undegraded":"2023-11-26T07:21:42.861418+0000","last_fullsized":"2023-11-26T07:21:42.861418+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:37.258248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879791+0000","last_change":"2023-11-26T07:21:42.871866+0000","last_active":"2023-11-26T07:21:42.879791+0000","last_peered":"2023-11-26T07:21:42.879791+0000","last_clean":"2023-11-26T07:21:42.879791+0000","last_became_active":"2023-11-26T07:21:42.869072+0000","last_became_peered":"2023-11-26T07:21:42.869072+0000","last_unstale":"2023-11-26T07:21:42.879791+0000","last_undegraded":"2023-11-26T07:21:42.879791+0000","last_fullsized":"2023-11-26T07:21:42.879791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:01:26.683873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.833605+0000","last_change":"2023-11-26T07:21:41.823941+0000","last_active":"2023-11-26T07:21:42.833605+0000","last_peered":"2023-11-26T07:21:42.833605+0000","last_clean":"2023-11-26T07:21:42.833605+0000","last_became_active":"2023-11-26T07:21:41.823666+0000","last_became_peered":"2023-11-26T07:21:41.823666+0000","last_unstale":"2023-11-26T07:21:42.833605+0000","last_undegraded":"2023-11-26T07:21:42.833605+0000","last_fullsized":"2023-11-26T07:21:42.833605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:16:11.266436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.860496+0000","last_change":"2023-11-26T07:21:42.857157+0000","last_active":"2023-11-26T07:21:42.860496+0000","last_peered":"2023-11-26T07:21:42.860496+0000","last_clean":"2023-11-26T07:21:42.860496+0000","last_became_active":"2023-11-26T07:21:42.856808+0000","last_became_peered":"2023-11-26T07:21:42.856808+0000","last_unstale":"2023-11-26T07:21:42.860496+0000","last_undegraded":"2023-11-26T07:21:42.860496+0000","last_fullsized":"2023-11-26T07:21:42.860496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:11:28.820172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.869605+0000","last_change":"2023-11-26T07:21:41.839677+0000","last_active":"2023-11-26T07:21:42.869605+0000","last_peered":"2023-11-26T07:21:42.869605+0000","last_clean":"2023-11-26T07:21:42.869605+0000","last_became_active":"2023-11-26T07:21:41.839304+0000","last_became_peered":"2023-11-26T07:21:41.839304+0000","last_unstale":"2023-11-26T07:21:42.869605+0000","last_undegraded":"2023-11-26T07:21:42.869605+0000","last_fullsized":"2023-11-26T07:21:42.869605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:03.303930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879623+0000","last_change":"2023-11-26T07:21:42.869100+0000","last_active":"2023-11-26T07:21:42.879623+0000","last_peered":"2023-11-26T07:21:42.879623+0000","last_clean":"2023-11-26T07:21:42.879623+0000","last_became_active":"2023-11-26T07:21:42.868786+0000","last_became_peered":"2023-11-26T07:21:42.868786+0000","last_unstale":"2023-11-26T07:21:42.879623+0000","last_undegraded":"2023-11-26T07:21:42.879623+0000","last_fullsized":"2023-11-26T07:21:42.879623+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:30:29.269453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.874341+0000","last_change":"2023-11-26T07:21:41.828514+0000","last_active":"2023-11-26T07:21:42.874341+0000","last_peered":"2023-11-26T07:21:42.874341+0000","last_clean":"2023-11-26T07:21:42.874341+0000","last_became_active":"2023-11-26T07:21:41.828208+0000","last_became_peered":"2023-11-26T07:21:41.828208+0000","last_unstale":"2023-11-26T07:21:42.874341+0000","last_undegraded":"2023-11-26T07:21:42.874341+0000","last_fullsized":"2023-11-26T07:21:42.874341+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:50.971511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854742+0000","last_change":"2023-11-26T07:21:42.847305+0000","last_active":"2023-11-26T07:21:42.854742+0000","last_peered":"2023-11-26T07:21:42.854742+0000","last_clean":"2023-11-26T07:21:42.854742+0000","last_became_active":"2023-11-26T07:21:42.844905+0000","last_became_peered":"2023-11-26T07:21:42.844905+0000","last_unstale":"2023-11-26T07:21:42.854742+0000","last_undegraded":"2023-11-26T07:21:42.854742+0000","last_fullsized":"2023-11-26T07:21:42.854742+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:30:29.269453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.866088+0000","last_change":"2023-11-26T07:21:41.824310+0000","last_active":"2023-11-26T07:21:42.866088+0000","last_peered":"2023-11-26T07:21:42.866088+0000","last_clean":"2023-11-26T07:21:42.866088+0000","last_became_active":"2023-11-26T07:21:41.823992+0000","last_became_peered":"2023-11-26T07:21:41.823992+0000","last_unstale":"2023-11-26T07:21:42.866088+0000","last_undegraded":"2023-11-26T07:21:42.866088+0000","last_fullsized":"2023-11-26T07:21:42.866088+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:39:41.412045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879761+0000","last_change":"2023-11-26T07:21:42.870659+0000","last_active":"2023-11-26T07:21:42.879761+0000","last_peered":"2023-11-26T07:21:42.879761+0000","last_clean":"2023-11-26T07:21:42.879761+0000","last_became_active":"2023-11-26T07:21:42.870006+0000","last_became_peered":"2023-11-26T07:21:42.870006+0000","last_unstale":"2023-11-26T07:21:42.879761+0000","last_undegraded":"2023-11-26T07:21:42.879761+0000","last_fullsized":"2023-11-26T07:21:42.879761+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:54:00.540700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.846393+0000","last_change":"2023-11-26T07:21:41.832022+0000","last_active":"2023-11-26T07:21:42.846393+0000","last_peered":"2023-11-26T07:21:42.846393+0000","last_clean":"2023-11-26T07:21:42.846393+0000","last_became_active":"2023-11-26T07:21:41.830518+0000","last_became_peered":"2023-11-26T07:21:41.830518+0000","last_unstale":"2023-11-26T07:21:42.846393+0000","last_undegraded":"2023-11-26T07:21:42.846393+0000","last_fullsized":"2023-11-26T07:21:42.846393+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:32.589685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.868868+0000","last_change":"2023-11-26T07:21:42.865479+0000","last_active":"2023-11-26T07:21:42.868868+0000","last_peered":"2023-11-26T07:21:42.868868+0000","last_clean":"2023-11-26T07:21:42.868868+0000","last_became_active":"2023-11-26T07:21:42.865022+0000","last_became_peered":"2023-11-26T07:21:42.865022+0000","last_unstale":"2023-11-26T07:21:42.868868+0000","last_undegraded":"2023-11-26T07:21:42.868868+0000","last_fullsized":"2023-11-26T07:21:42.868868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:03:29.477105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.830168+0000","last_change":"2023-11-26T07:21:41.832917+0000","last_active":"2023-11-26T07:21:42.830168+0000","last_peered":"2023-11-26T07:21:42.830168+0000","last_clean":"2023-11-26T07:21:42.830168+0000","last_became_active":"2023-11-26T07:21:41.831429+0000","last_became_peered":"2023-11-26T07:21:41.831429+0000","last_unstale":"2023-11-26T07:21:42.830168+0000","last_undegraded":"2023-11-26T07:21:42.830168+0000","last_fullsized":"2023-11-26T07:21:42.830168+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:03.303930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879771+0000","last_change":"2023-11-26T07:21:42.870804+0000","last_active":"2023-11-26T07:21:42.879771+0000","last_peered":"2023-11-26T07:21:42.879771+0000","last_clean":"2023-11-26T07:21:42.879771+0000","last_became_active":"2023-11-26T07:21:42.870484+0000","last_became_peered":"2023-11-26T07:21:42.870484+0000","last_unstale":"2023-11-26T07:21:42.879771+0000","last_undegraded":"2023-11-26T07:21:42.879771+0000","last_fullsized":"2023-11-26T07:21:42.879771+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:10:43.421835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.874054+0000","last_change":"2023-11-26T07:21:41.841465+0000","last_active":"2023-11-26T07:21:42.874054+0000","last_peered":"2023-11-26T07:21:42.874054+0000","last_clean":"2023-11-26T07:21:42.874054+0000","last_became_active":"2023-11-26T07:21:41.841167+0000","last_became_peered":"2023-11-26T07:21:41.841167+0000","last_unstale":"2023-11-26T07:21:42.874054+0000","last_undegraded":"2023-11-26T07:21:42.874054+0000","last_fullsized":"2023-11-26T07:21:42.874054+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:55:06.596538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879851+0000","last_change":"2023-11-26T07:21:42.872378+0000","last_active":"2023-11-26T07:21:42.879851+0000","last_peered":"2023-11-26T07:21:42.879851+0000","last_clean":"2023-11-26T07:21:42.879851+0000","last_became_active":"2023-11-26T07:21:42.872088+0000","last_became_peered":"2023-11-26T07:21:42.872088+0000","last_unstale":"2023-11-26T07:21:42.879851+0000","last_undegraded":"2023-11-26T07:21:42.879851+0000","last_fullsized":"2023-11-26T07:21:42.879851+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:43:14.397209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.866000+0000","last_change":"2023-11-26T07:21:41.814943+0000","last_active":"2023-11-26T07:21:42.866000+0000","last_peered":"2023-11-26T07:21:42.866000+0000","last_clean":"2023-11-26T07:21:42.866000+0000","last_became_active":"2023-11-26T07:21:41.814663+0000","last_became_peered":"2023-11-26T07:21:41.814663+0000","last_unstale":"2023-11-26T07:21:42.866000+0000","last_undegraded":"2023-11-26T07:21:42.866000+0000","last_fullsized":"2023-11-26T07:21:42.866000+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:35.955866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854769+0000","last_change":"2023-11-26T07:21:42.847972+0000","last_active":"2023-11-26T07:21:42.854769+0000","last_peered":"2023-11-26T07:21:42.854769+0000","last_clean":"2023-11-26T07:21:42.854769+0000","last_became_active":"2023-11-26T07:21:42.847671+0000","last_became_peered":"2023-11-26T07:21:42.847671+0000","last_unstale":"2023-11-26T07:21:42.854769+0000","last_undegraded":"2023-11-26T07:21:42.854769+0000","last_fullsized":"2023-11-26T07:21:42.854769+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:28:25.295294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.857615+0000","last_change":"2023-11-26T07:21:41.832654+0000","last_active":"2023-11-26T07:21:42.857615+0000","last_peered":"2023-11-26T07:21:42.857615+0000","last_clean":"2023-11-26T07:21:42.857615+0000","last_became_active":"2023-11-26T07:21:41.831984+0000","last_became_peered":"2023-11-26T07:21:41.831984+0000","last_unstale":"2023-11-26T07:21:42.857615+0000","last_undegraded":"2023-11-26T07:21:42.857615+0000","last_fullsized":"2023-11-26T07:21:42.857615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:10:42.411457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861923+0000","last_change":"2023-11-26T07:21:42.852551+0000","last_active":"2023-11-26T07:21:42.861923+0000","last_peered":"2023-11-26T07:21:42.861923+0000","last_clean":"2023-11-26T07:21:42.861923+0000","last_became_active":"2023-11-26T07:21:42.852275+0000","last_became_peered":"2023-11-26T07:21:42.852275+0000","last_unstale":"2023-11-26T07:21:42.861923+0000","last_undegraded":"2023-11-26T07:21:42.861923+0000","last_fullsized":"2023-11-26T07:21:42.861923+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:55:17.598668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.868894+0000","last_change":"2023-11-26T07:21:41.832300+0000","last_active":"2023-11-26T07:21:42.868894+0000","last_peered":"2023-11-26T07:21:42.868894+0000","last_clean":"2023-11-26T07:21:42.868894+0000","last_became_active":"2023-11-26T07:21:41.832008+0000","last_became_peered":"2023-11-26T07:21:41.832008+0000","last_unstale":"2023-11-26T07:21:42.868894+0000","last_undegraded":"2023-11-26T07:21:42.868894+0000","last_fullsized":"2023-11-26T07:21:42.868894+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:50.971511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879668+0000","last_change":"2023-11-26T07:21:42.870240+0000","last_active":"2023-11-26T07:21:42.879668+0000","last_peered":"2023-11-26T07:21:42.879668+0000","last_clean":"2023-11-26T07:21:42.879668+0000","last_became_active":"2023-11-26T07:21:42.869948+0000","last_became_peered":"2023-11-26T07:21:42.869948+0000","last_unstale":"2023-11-26T07:21:42.879668+0000","last_undegraded":"2023-11-26T07:21:42.879668+0000","last_fullsized":"2023-11-26T07:21:42.879668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:45:11.939133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.829226+0000","last_change":"2023-11-26T07:21:41.829637+0000","last_active":"2023-11-26T07:21:42.829226+0000","last_peered":"2023-11-26T07:21:42.829226+0000","last_clean":"2023-11-26T07:21:42.829226+0000","last_became_active":"2023-11-26T07:21:41.829278+0000","last_became_peered":"2023-11-26T07:21:41.829278+0000","last_unstale":"2023-11-26T07:21:42.829226+0000","last_undegraded":"2023-11-26T07:21:42.829226+0000","last_fullsized":"2023-11-26T07:21:42.829226+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:53:08.653498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.850578+0000","last_change":"2023-11-26T07:21:42.843950+0000","last_active":"2023-11-26T07:21:42.850578+0000","last_peered":"2023-11-26T07:21:42.850578+0000","last_clean":"2023-11-26T07:21:42.850578+0000","last_became_active":"2023-11-26T07:21:42.843660+0000","last_became_peered":"2023-11-26T07:21:42.843660+0000","last_unstale":"2023-11-26T07:21:42.850578+0000","last_undegraded":"2023-11-26T07:21:42.850578+0000","last_fullsized":"2023-11-26T07:21:42.850578+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:54:00.540700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.864094+0000","last_change":"2023-11-26T07:21:41.827003+0000","last_active":"2023-11-26T07:21:42.864094+0000","last_peered":"2023-11-26T07:21:42.864094+0000","last_clean":"2023-11-26T07:21:42.864094+0000","last_became_active":"2023-11-26T07:21:41.826717+0000","last_became_peered":"2023-11-26T07:21:41.826717+0000","last_unstale":"2023-11-26T07:21:42.864094+0000","last_undegraded":"2023-11-26T07:21:42.864094+0000","last_fullsized":"2023-11-26T07:21:42.864094+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:34:06.341153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.863033+0000","last_change":"2023-11-26T07:21:42.859687+0000","last_active":"2023-11-26T07:21:42.863033+0000","last_peered":"2023-11-26T07:21:42.863033+0000","last_clean":"2023-11-26T07:21:42.863033+0000","last_became_active":"2023-11-26T07:21:42.855015+0000","last_became_peered":"2023-11-26T07:21:42.855015+0000","last_unstale":"2023-11-26T07:21:42.863033+0000","last_undegraded":"2023-11-26T07:21:42.863033+0000","last_fullsized":"2023-11-26T07:21:42.863033+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:01:26.683873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.829990+0000","last_change":"2023-11-26T07:21:41.823392+0000","last_active":"2023-11-26T07:21:42.829990+0000","last_peered":"2023-11-26T07:21:42.829990+0000","last_clean":"2023-11-26T07:21:42.829990+0000","last_became_active":"2023-11-26T07:21:41.823086+0000","last_became_peered":"2023-11-26T07:21:41.823086+0000","last_unstale":"2023-11-26T07:21:42.829990+0000","last_undegraded":"2023-11-26T07:21:42.829990+0000","last_fullsized":"2023-11-26T07:21:42.829990+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:55.527886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.871022+0000","last_change":"2023-11-26T07:21:42.870100+0000","last_active":"2023-11-26T07:21:42.871022+0000","last_peered":"2023-11-26T07:21:42.871022+0000","last_clean":"2023-11-26T07:21:42.871022+0000","last_became_active":"2023-11-26T07:21:42.869640+0000","last_became_peered":"2023-11-26T07:21:42.869640+0000","last_unstale":"2023-11-26T07:21:42.871022+0000","last_undegraded":"2023-11-26T07:21:42.871022+0000","last_fullsized":"2023-11-26T07:21:42.871022+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:04.314308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.830449+0000","last_change":"2023-11-26T07:21:41.823483+0000","last_active":"2023-11-26T07:21:42.830449+0000","last_peered":"2023-11-26T07:21:42.830449+0000","last_clean":"2023-11-26T07:21:42.830449+0000","last_became_active":"2023-11-26T07:21:41.823114+0000","last_became_peered":"2023-11-26T07:21:41.823114+0000","last_unstale":"2023-11-26T07:21:42.830449+0000","last_undegraded":"2023-11-26T07:21:42.830449+0000","last_fullsized":"2023-11-26T07:21:42.830449+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:55:06.596538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.850429+0000","last_change":"2023-11-26T07:21:42.841163+0000","last_active":"2023-11-26T07:21:42.850429+0000","last_peered":"2023-11-26T07:21:42.850429+0000","last_clean":"2023-11-26T07:21:42.850429+0000","last_became_active":"2023-11-26T07:21:42.840319+0000","last_became_peered":"2023-11-26T07:21:42.840319+0000","last_unstale":"2023-11-26T07:21:42.850429+0000","last_undegraded":"2023-11-26T07:21:42.850429+0000","last_fullsized":"2023-11-26T07:21:42.850429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:38.268625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.863461+0000","last_change":"2023-11-26T07:21:41.824849+0000","last_active":"2023-11-26T07:21:42.863461+0000","last_peered":"2023-11-26T07:21:42.863461+0000","last_clean":"2023-11-26T07:21:42.863461+0000","last_became_active":"2023-11-26T07:21:41.824558+0000","last_became_peered":"2023-11-26T07:21:41.824558+0000","last_unstale":"2023-11-26T07:21:42.863461+0000","last_undegraded":"2023-11-26T07:21:42.863461+0000","last_fullsized":"2023-11-26T07:21:42.863461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:52.704936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.874341+0000","last_change":"2023-11-26T07:21:42.866069+0000","last_active":"2023-11-26T07:21:42.874341+0000","last_peered":"2023-11-26T07:21:42.874341+0000","last_clean":"2023-11-26T07:21:42.874341+0000","last_became_active":"2023-11-26T07:21:42.865771+0000","last_became_peered":"2023-11-26T07:21:42.865771+0000","last_unstale":"2023-11-26T07:21:42.874341+0000","last_undegraded":"2023-11-26T07:21:42.874341+0000","last_fullsized":"2023-11-26T07:21:42.874341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:01:26.683873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.828402+0000","last_change":"2023-11-26T07:21:41.835139+0000","last_active":"2023-11-26T07:21:42.828402+0000","last_peered":"2023-11-26T07:21:42.828402+0000","last_clean":"2023-11-26T07:21:42.828402+0000","last_became_active":"2023-11-26T07:21:41.834926+0000","last_became_peered":"2023-11-26T07:21:41.834926+0000","last_unstale":"2023-11-26T07:21:42.828402+0000","last_undegraded":"2023-11-26T07:21:42.828402+0000","last_fullsized":"2023-11-26T07:21:42.828402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:28:24.284916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.857049+0000","last_change":"2023-11-26T07:21:42.850327+0000","last_active":"2023-11-26T07:21:42.857049+0000","last_peered":"2023-11-26T07:21:42.857049+0000","last_clean":"2023-11-26T07:21:42.857049+0000","last_became_active":"2023-11-26T07:21:42.850059+0000","last_became_peered":"2023-11-26T07:21:42.850059+0000","last_unstale":"2023-11-26T07:21:42.857049+0000","last_undegraded":"2023-11-26T07:21:42.857049+0000","last_fullsized":"2023-11-26T07:21:42.857049+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:20.106348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.846774+0000","last_change":"2023-11-26T07:21:41.835430+0000","last_active":"2023-11-26T07:21:42.846774+0000","last_peered":"2023-11-26T07:21:42.846774+0000","last_clean":"2023-11-26T07:21:42.846774+0000","last_became_active":"2023-11-26T07:21:41.835023+0000","last_became_peered":"2023-11-26T07:21:41.835023+0000","last_unstale":"2023-11-26T07:21:42.846774+0000","last_undegraded":"2023-11-26T07:21:42.846774+0000","last_fullsized":"2023-11-26T07:21:42.846774+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:19.095970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854756+0000","last_change":"2023-11-26T07:21:42.843016+0000","last_active":"2023-11-26T07:21:42.854756+0000","last_peered":"2023-11-26T07:21:42.854756+0000","last_clean":"2023-11-26T07:21:42.854756+0000","last_became_active":"2023-11-26T07:21:42.842754+0000","last_became_peered":"2023-11-26T07:21:42.842754+0000","last_unstale":"2023-11-26T07:21:42.854756+0000","last_undegraded":"2023-11-26T07:21:42.854756+0000","last_fullsized":"2023-11-26T07:21:42.854756+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:00:26.324681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.832725+0000","last_change":"2023-11-26T07:21:41.830771+0000","last_active":"2023-11-26T07:21:42.832725+0000","last_peered":"2023-11-26T07:21:42.832725+0000","last_clean":"2023-11-26T07:21:42.832725+0000","last_became_active":"2023-11-26T07:21:41.828792+0000","last_became_peered":"2023-11-26T07:21:41.828792+0000","last_unstale":"2023-11-26T07:21:42.832725+0000","last_undegraded":"2023-11-26T07:21:42.832725+0000","last_fullsized":"2023-11-26T07:21:42.832725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:34.217996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.858882+0000","last_change":"2023-11-26T07:21:42.844361+0000","last_active":"2023-11-26T07:21:42.858882+0000","last_peered":"2023-11-26T07:21:42.858882+0000","last_clean":"2023-11-26T07:21:42.858882+0000","last_became_active":"2023-11-26T07:21:42.844029+0000","last_became_peered":"2023-11-26T07:21:42.844029+0000","last_unstale":"2023-11-26T07:21:42.858882+0000","last_undegraded":"2023-11-26T07:21:42.858882+0000","last_fullsized":"2023-11-26T07:21:42.858882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:01:45.714969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.830023+0000","last_change":"2023-11-26T07:21:41.831016+0000","last_active":"2023-11-26T07:21:42.830023+0000","last_peered":"2023-11-26T07:21:42.830023+0000","last_clean":"2023-11-26T07:21:42.830023+0000","last_became_active":"2023-11-26T07:21:41.830708+0000","last_became_peered":"2023-11-26T07:21:41.830708+0000","last_unstale":"2023-11-26T07:21:42.830023+0000","last_undegraded":"2023-11-26T07:21:42.830023+0000","last_fullsized":"2023-11-26T07:21:42.830023+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:47:14.737463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879790+0000","last_change":"2023-11-26T07:21:42.870837+0000","last_active":"2023-11-26T07:21:42.879790+0000","last_peered":"2023-11-26T07:21:42.879790+0000","last_clean":"2023-11-26T07:21:42.879790+0000","last_became_active":"2023-11-26T07:21:42.870310+0000","last_became_peered":"2023-11-26T07:21:42.870310+0000","last_unstale":"2023-11-26T07:21:42.879790+0000","last_undegraded":"2023-11-26T07:21:42.879790+0000","last_fullsized":"2023-11-26T07:21:42.879790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:05:36.084405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.842083+0000","last_change":"2023-11-26T07:21:41.832658+0000","last_active":"2023-11-26T07:21:42.842083+0000","last_peered":"2023-11-26T07:21:42.842083+0000","last_clean":"2023-11-26T07:21:42.842083+0000","last_became_active":"2023-11-26T07:21:41.832339+0000","last_became_peered":"2023-11-26T07:21:41.832339+0000","last_unstale":"2023-11-26T07:21:42.842083+0000","last_undegraded":"2023-11-26T07:21:42.842083+0000","last_fullsized":"2023-11-26T07:21:42.842083+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:08:07.539428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.857951+0000","last_change":"2023-11-26T07:21:42.854893+0000","last_active":"2023-11-26T07:21:42.857951+0000","last_peered":"2023-11-26T07:21:42.857951+0000","last_clean":"2023-11-26T07:21:42.857951+0000","last_became_active":"2023-11-26T07:21:42.854633+0000","last_became_peered":"2023-11-26T07:21:42.854633+0000","last_unstale":"2023-11-26T07:21:42.857951+0000","last_undegraded":"2023-11-26T07:21:42.857951+0000","last_fullsized":"2023-11-26T07:21:42.857951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:37:17.608463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.830446+0000","last_change":"2023-11-26T07:21:41.826533+0000","last_active":"2023-11-26T07:21:42.830446+0000","last_peered":"2023-11-26T07:21:42.830446+0000","last_clean":"2023-11-26T07:21:42.830446+0000","last_became_active":"2023-11-26T07:21:41.825848+0000","last_became_peered":"2023-11-26T07:21:41.825848+0000","last_unstale":"2023-11-26T07:21:42.830446+0000","last_undegraded":"2023-11-26T07:21:42.830446+0000","last_fullsized":"2023-11-26T07:21:42.830446+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:25:50.183678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862398+0000","last_change":"2023-11-26T07:21:42.856935+0000","last_active":"2023-11-26T07:21:42.862398+0000","last_peered":"2023-11-26T07:21:42.862398+0000","last_clean":"2023-11-26T07:21:42.862398+0000","last_became_active":"2023-11-26T07:21:42.855857+0000","last_became_peered":"2023-11-26T07:21:42.855857+0000","last_unstale":"2023-11-26T07:21:42.862398+0000","last_undegraded":"2023-11-26T07:21:42.862398+0000","last_fullsized":"2023-11-26T07:21:42.862398+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:00:26.324681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.830920+0000","last_change":"2023-11-26T07:21:41.816053+0000","last_active":"2023-11-26T07:21:42.830920+0000","last_peered":"2023-11-26T07:21:42.830920+0000","last_clean":"2023-11-26T07:21:42.830920+0000","last_became_active":"2023-11-26T07:21:41.815631+0000","last_became_peered":"2023-11-26T07:21:41.815631+0000","last_unstale":"2023-11-26T07:21:42.830920+0000","last_undegraded":"2023-11-26T07:21:42.830920+0000","last_fullsized":"2023-11-26T07:21:42.830920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:54:40.150080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.857247+0000","last_change":"2023-11-26T07:21:42.842814+0000","last_active":"2023-11-26T07:21:42.857247+0000","last_peered":"2023-11-26T07:21:42.857247+0000","last_clean":"2023-11-26T07:21:42.857247+0000","last_became_active":"2023-11-26T07:21:42.842553+0000","last_became_peered":"2023-11-26T07:21:42.842553+0000","last_unstale":"2023-11-26T07:21:42.857247+0000","last_undegraded":"2023-11-26T07:21:42.857247+0000","last_fullsized":"2023-11-26T07:21:42.857247+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:10:57.745126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.845847+0000","last_change":"2023-11-26T07:21:41.832035+0000","last_active":"2023-11-26T07:21:42.845847+0000","last_peered":"2023-11-26T07:21:42.845847+0000","last_clean":"2023-11-26T07:21:42.845847+0000","last_became_active":"2023-11-26T07:21:41.831745+0000","last_became_peered":"2023-11-26T07:21:41.831745+0000","last_unstale":"2023-11-26T07:21:42.845847+0000","last_undegraded":"2023-11-26T07:21:42.845847+0000","last_fullsized":"2023-11-26T07:21:42.845847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:11:27.809794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:21:41.831019+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:21:41.831019+0000","last_peered":"2023-11-26T07:21:41.831019+0000","last_clean":"2023-11-26T07:21:41.831019+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:21:41.831019+0000","last_undegraded":"2023-11-26T07:21:41.831019+0000","last_fullsized":"2023-11-26T07:21:41.831019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1335296,"data_stored":899473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0609999999999999,"15min":1.0369999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6100000000000001,"5min":1.768,"15min":1.768},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.075,"15min":1.069},"min":{"1min":0.63400000000000001,"5min":0.627,"15min":0.627},"max":{"1min":1.5029999999999999,"5min":2.298,"15min":2.298},"last":0.79500000000000004}]},{"osd":1,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0660000000000001,"15min":1.052},"min":{"1min":0.70099999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.373},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1870000000000001,"15min":1.214},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5740000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.95499999999999996}]},{"osd":2,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.206,"15min":1.1699999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.552,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.214,"15min":1.276},"min":{"1min":0.83899999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.464,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.1850000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.214,"15min":1.2350000000000001},"min":{"1min":0.93200000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5049999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.042},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3560000000000001,"15min":1.363},"min":{"1min":1.02,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6579999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.87}]},{"osd":4,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.321,"15min":1.349},"min":{"1min":0.80000000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5189999999999999,"5min":2.774,"15min":2.774},"last":1.302},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.454,"15min":1.462},"min":{"1min":0.91800000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.8380000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.472}]},{"osd":5,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.466,"15min":1.4930000000000001},"min":{"1min":0.97499999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.7010000000000001,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.425},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.429,"15min":1.468},"min":{"1min":0.91700000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6830000000000001,"5min":2.149,"15min":2.149},"last":1.2589999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.6120000000000001,"15min":1.6679999999999999},"min":{"1min":1.1950000000000001,"5min":0.75,"15min":0.75},"max":{"1min":1.796,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.522},{"interface":"front","average":{"1min":1.488,"5min":1.6020000000000001,"15min":1.6359999999999999},"min":{"1min":1.125,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.8919999999999999,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.5389999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":308945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0960000000000001,"15min":1.115},"min":{"1min":0.61799999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4419999999999999,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":1.663},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.198,"15min":1.2649999999999999},"min":{"1min":0.69499999999999995,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.4279999999999999,"5min":3.169,"15min":3.169},"last":1.306}]},{"osd":1,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.173,"15min":1.1819999999999999},"min":{"1min":0.73799999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.841,"5min":1.929,"15min":1.929},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.175,"15min":1.139},"min":{"1min":0.79500000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.754}]},{"osd":2,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.117,"15min":1.1200000000000001},"min":{"1min":0.79100000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.71},{"interface":"front","average":{"1min":1.274,"5min":1.298,"15min":1.3660000000000001},"min":{"1min":0.84499999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6850000000000001,"5min":3.1110000000000002,"15min":3.1110000000000002},"last":1.518}]},{"osd":3,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.292,"15min":1.276},"min":{"1min":0.89500000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":4.0970000000000004,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.242,"15min":1.254},"min":{"1min":0.90900000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.367}]},{"osd":4,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.369,"15min":1.369},"min":{"1min":0.69799999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":4.6539999999999999,"5min":4.6539999999999999,"15min":4.6539999999999999},"last":1.8380000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.395,"15min":1.3759999999999999},"min":{"1min":0.86399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.2990000000000004,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":1.8839999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.3899999999999999,"15min":1.403},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8779999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.615},{"interface":"front","average":{"1min":1.675,"5min":1.5329999999999999,"15min":1.536},"min":{"1min":0.80300000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":1.984}]},{"osd":7,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.5429999999999999,"15min":1.5449999999999999},"min":{"1min":1.0449999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.202,"5min":4.202,"15min":4.202},"last":1.95},{"interface":"front","average":{"1min":1.587,"5min":1.5549999999999999,"15min":1.5660000000000001},"min":{"1min":0.77800000000000002,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.7989999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":309597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.0660000000000001,"15min":1.028},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.109,"15min":1.032},"min":{"1min":0.76100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.8799999999999999,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.1220000000000001,"15min":1.073},"min":{"1min":0.79100000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.6989999999999998,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.417,"5min":1.204,"15min":1.179},"min":{"1min":0.93300000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":4.7859999999999996,"5min":4.7859999999999996,"15min":4.7859999999999996},"last":0.56699999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.087,"15min":1.0509999999999999},"min":{"1min":0.77800000000000002,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.385,"5min":1.2869999999999999,"15min":1.2989999999999999},"min":{"1min":0.88900000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.77,"5min":3.77,"15min":3.77},"last":0.46200000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.3169999999999999,"15min":1.3149999999999999},"min":{"1min":0.97199999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.8360000000000003,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.248,"15min":1.2110000000000001},"min":{"1min":0.84899999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":0.63100000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.431,"15min":1.4610000000000001},"min":{"1min":0.89500000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":3.835,"5min":3.835,"15min":3.835},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.4550000000000001,"15min":1.4690000000000001},"min":{"1min":1.014,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":4.9219999999999997,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":0.64600000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.5429999999999999,"15min":1.5529999999999999},"min":{"1min":1.0880000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.8980000000000001,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.4610000000000001,"15min":1.4670000000000001},"min":{"1min":0.96199999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.42899999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":1.601,"15min":1.613},"min":{"1min":1.1819999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.675,"5min":1.5980000000000001,"15min":1.6100000000000001},"min":{"1min":1.1879999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":4.1970000000000001,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":308945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0680000000000001,"15min":1.129},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.502,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.0660000000000001,"15min":1.018},"min":{"1min":0.69899999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1970000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.1779999999999999,"15min":1.177},"min":{"1min":0.81000000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7509999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.375},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.2589999999999999,"15min":1.246},"min":{"1min":0.85199999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.97599999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.264,"15min":1.286},"min":{"1min":0.79400000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.964,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.244,"15min":1.282},"min":{"1min":0.83099999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5269999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1439999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.331,"15min":1.3260000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.2010000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.506},{"interface":"front","average":{"1min":1.383,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.94599999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5429999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.90200000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.095},{"interface":"front","average":{"1min":1.532,"5min":1.506,"15min":1.5129999999999999},"min":{"1min":1.0089999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.3319999999999999,"5min":2.899,"15min":2.899},"last":1.24}]},{"osd":6,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.4890000000000001,"15min":1.5069999999999999},"min":{"1min":0.996,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.0110000000000001,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.649},{"interface":"front","average":{"1min":1.623,"5min":1.6279999999999999,"15min":1.645},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":2.4239999999999999,"5min":3.008,"15min":3.008},"last":1.595}]},{"osd":7,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.7110000000000001,"15min":1.7529999999999999},"min":{"1min":1.3640000000000001,"5min":1.214,"15min":1.214},"max":{"1min":2.4460000000000002,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.734},{"interface":"front","average":{"1min":1.627,"5min":1.6839999999999999,"15min":1.712},"min":{"1min":1.256,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":2.2290000000000001,"5min":3.085,"15min":3.085},"last":1.304}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":741376,"data_stored":309001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.82499999999999996,"15min":0.86099999999999999},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":1.097,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.90700000000000003,"15min":0.90900000000000003},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.238,"5min":1.764,"15min":1.764},"last":1.0600000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80900000000000005,"15min":0.84799999999999998},"min":{"1min":0.39500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":1.036,"5min":1.784,"15min":1.784},"last":1.145},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.92600000000000005,"15min":0.999},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2809999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.1100000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0409999999999999,"15min":1.077},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3640000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.627},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0940000000000001,"15min":1.119},"min":{"1min":0.622,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.492,"5min":2.379,"15min":2.379},"last":1.526}]},{"osd":4,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.121,"15min":1.1339999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.526,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.206},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.262,"15min":1.343},"min":{"1min":0.77500000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.766,"5min":2.859,"15min":2.859},"last":1.4890000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.288,"15min":1.357},"min":{"1min":0.80500000000000005,"5min":0.752,"15min":0.752},"max":{"1min":1.9350000000000001,"5min":2.504,"15min":2.504},"last":1.419},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2210000000000001,"15min":1.2529999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.577,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4550000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.3440000000000001,"15min":1.4379999999999999},"min":{"1min":0.81699999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.899,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.27},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3580000000000001,"15min":1.4339999999999999},"min":{"1min":0.80200000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.877,"5min":3.226,"15min":3.226},"last":1.5860000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2709999999999999,"15min":1.2929999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.129,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.393},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4279999999999999,"15min":1.506},"min":{"1min":0.85899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.089,"5min":3.956,"15min":3.956},"last":1.996}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":309001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.874,"15min":0.96399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.244,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":1.071},"min":{"1min":0.54200000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.504,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.89200000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.86699999999999999,"15min":0.96299999999999997},"min":{"1min":0.41299999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0880000000000001,"5min":1.645,"15min":1.645},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.96499999999999997,"15min":1.0309999999999999},"min":{"1min":0.51900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.383,"5min":1.901,"15min":1.901},"last":1.042}]},{"osd":3,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.97299999999999998,"15min":1.0600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4399999999999999,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.1519999999999999,"15min":1.24},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6200000000000001,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.0940000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2290000000000001,"15min":1.278},"min":{"1min":0.86499999999999999,"5min":0.754,"15min":0.754},"max":{"1min":1.474,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2410000000000001,"15min":1.292},"min":{"1min":0.81399999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7809999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.1439999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1890000000000001,"15min":1.2450000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3120000000000001,"5min":1.901,"15min":1.901},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.29,"15min":1.3819999999999999},"min":{"1min":0.84099999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.546,"5min":2.395,"15min":2.395},"last":1.23}]},{"osd":6,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3999999999999999,"15min":1.4550000000000001},"min":{"1min":0.879,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9330000000000001,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.268},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.3069999999999999,"15min":1.3440000000000001},"min":{"1min":0.76700000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8009999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.95399999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4259999999999999,"15min":1.492},"min":{"1min":0.81200000000000006,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.069,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.365},{"interface":"front","average":{"1min":1.262,"5min":1.3899999999999999,"15min":1.431},"min":{"1min":0.95399999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.694,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.86599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":737280,"data_stored":309035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.77300000000000002,"15min":0.81299999999999994},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90200000000000002,"5min":1.589,"15min":1.589},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.91600000000000004,"15min":0.96099999999999997},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4359999999999999,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.95399999999999996}]},{"osd":2,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85699999999999998,"15min":0.871},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.96099999999999997,"15min":0.995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2230000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.0109999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":1.077},"min":{"1min":0.51500000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3859999999999999,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":1.0109999999999999,"15min":1.0569999999999999},"min":{"1min":0.51400000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":2.319,"15min":2.319},"last":1.083}]},{"osd":4,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.2050000000000001,"15min":1.2410000000000001},"min":{"1min":0.80500000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.7210000000000001,"5min":2.294,"15min":2.294},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.2030000000000001,"15min":1.2569999999999999},"min":{"1min":0.70899999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3520000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.871}]},{"osd":5,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2969999999999999,"15min":1.369},"min":{"1min":0.82099999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.569,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3640000000000001,"15min":1.3819999999999999},"min":{"1min":1.042,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.607,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.2170000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.327,"15min":1.381},"min":{"1min":0.83599999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5900000000000001,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.3029999999999999,"15min":1.355},"min":{"1min":0.79500000000000004,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4450000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.1870000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.3460000000000001,"15min":1.3720000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.5720000000000001,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.417,"15min":1.4970000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.657,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.5660000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1343488,"data_stored":901507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0880000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":2.3079999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.82999999999999996,"15min":0.88200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2989999999999999,"5min":1.448,"15min":1.448},"last":1.593}]},{"osd":2,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.88,"15min":0.94399999999999995},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2769999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":2.3620000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.94499999999999995,"15min":1.0049999999999999},"min":{"1min":0.5,"5min":0.432,"15min":0.432},"max":{"1min":1.3620000000000001,"5min":1.641,"15min":1.641},"last":1.472}]},{"osd":3,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.97199999999999998,"15min":0.94299999999999995},"min":{"1min":0.52100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.698,"5min":9.4939999999999998,"15min":9.4939999999999998},"last":3.2360000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.0640000000000001,"15min":1.1339999999999999},"min":{"1min":0.67400000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.55,"5min":2.137,"15min":2.137},"last":2.7290000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":0.78500000000000003,"5min":0.753,"15min":0.753},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":4.9290000000000003},{"interface":"front","average":{"1min":1.169,"5min":1.3029999999999999,"15min":1.2549999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5960000000000001,"5min":9.7240000000000002,"15min":9.7240000000000002},"last":2.5649999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.2989999999999999,"15min":1.282},"min":{"1min":0.70699999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.532,"5min":9.6039999999999992,"15min":9.6039999999999992},"last":1.8260000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.343,"15min":1.3759999999999999},"min":{"1min":0.91400000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.7450000000000001,"5min":2.202,"15min":2.202},"last":2.5310000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.3460000000000001,"15min":1.3939999999999999},"min":{"1min":0.79700000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.8069999999999999,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":2.4390000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.282,"15min":1.3500000000000001},"min":{"1min":0.82099999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.766,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.974}]},{"osd":7,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3400000000000001,"15min":1.415},"min":{"1min":0.84399999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.859,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":4.9870000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.3540000000000001,"15min":1.3460000000000001},"min":{"1min":0.753,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.71,"5min":9.9320000000000004,"15min":9.9320000000000004},"last":1.7190000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:21:47.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:21:47.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.476+0000 7f84981ec640 1 Processor -- start 2023-11-26T07:21:47.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.476+0000 7f84981ec640 1 -- start start 2023-11-26T07:21:47.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.477+0000 7f84981ec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f849015c7f0 0x7f849006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.477+0000 7f84981ec640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84900ce6c0 0x7f84900cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.477+0000 7f84981ec640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84900cece0 con 0x7f84900cf450 2023-11-26T07:21:47.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.477+0000 7f84981ec640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84900cfe40 con 0x7f849015c7f0 2023-11-26T07:21:47.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.477+0000 7f84981ec640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8490156010 con 0x7f84900ce6c0 2023-11-26T07:21:47.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.478+0000 7f8495f88640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f849015c7f0 0x7f849006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.478+0000 7f8495f88640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f849015c7f0 0x7f849006db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35800/0 (socket says 172.21.15.77:35800) 2023-11-26T07:21:47.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.478+0000 7f8495f88640 1 -- 172.21.15.77:0/2711414124 learned_addr learned my addr 172.21.15.77:0/2711414124 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:47.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.478+0000 7f8495f88640 1 -- 172.21.15.77:0/2711414124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84900ce6c0 msgr2=0x7f84900cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:47.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.478+0000 7f8495f88640 1 --2- 172.21.15.77:0/2711414124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84900ce6c0 0x7f84900cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.478+0000 7f8495f88640 1 -- 172.21.15.77:0/2711414124 >> v1:172.21.15.77:6789/0 conn(0x7f84900cf450 legacy=0x7f84900cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.478+0000 7f8495f88640 1 -- 172.21.15.77:0/2711414124 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849006d040 con 0x7f849015c7f0 2023-11-26T07:21:47.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.478+0000 7f8494f86640 1 -- 172.21.15.77:0/2711414124 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792312654 0 0) 0x7f84900cece0 con 0x7f84900cf450 2023-11-26T07:21:47.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.479+0000 7f8495f88640 1 --2- 172.21.15.77:0/2711414124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f849015c7f0 0x7f849006db20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f848c009870 tx=0x7f848c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea470a0612e1459 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:47.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.480+0000 7f8494f86640 1 -- 172.21.15.77:0/2711414124 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c030840 con 0x7f849015c7f0 2023-11-26T07:21:47.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.480+0000 7f8494f86640 1 -- 172.21.15.77:0/2711414124 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c0309a0 con 0x7f849015c7f0 2023-11-26T07:21:47.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.480+0000 7f8494f86640 1 -- 172.21.15.77:0/2711414124 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c030d30 con 0x7f849015c7f0 2023-11-26T07:21:47.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.480+0000 7f84981ec640 1 -- 172.21.15.77:0/2711414124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f849015c7f0 msgr2=0x7f849006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.480+0000 7f84981ec640 1 --2- 172.21.15.77:0/2711414124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f849015c7f0 0x7f849006db20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f848c009870 tx=0x7f848c02b980 comp rx=0 tx=0).stop 2023-11-26T07:21:47.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.480+0000 7f84981ec640 1 -- 172.21.15.77:0/2711414124 shutdown_connections 2023-11-26T07:21:47.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.480+0000 7f84981ec640 1 --2- 172.21.15.77:0/2711414124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84900ce6c0 0x7f84900cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.480+0000 7f84981ec640 1 --2- 172.21.15.77:0/2711414124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f849015c7f0 0x7f849006db20 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.480+0000 7f84981ec640 1 -- 172.21.15.77:0/2711414124 >> 172.21.15.77:0/2711414124 conn(0x7f849006a920 msgr2=0x7f849006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:47.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.480+0000 7f84981ec640 1 -- 172.21.15.77:0/2711414124 shutdown_connections 2023-11-26T07:21:47.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.480+0000 7f84981ec640 1 -- 172.21.15.77:0/2711414124 wait complete. 2023-11-26T07:21:47.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.482+0000 7f84981ec640 1 Processor -- start 2023-11-26T07:21:47.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.482+0000 7f84981ec640 1 -- start start 2023-11-26T07:21:47.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.483+0000 7f84981ec640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84900ce6c0 0x7f8490152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.483+0000 7f84981ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84900cf450 0x7f8490156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.483+0000 7f84981ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f849015c7f0 0x7f84900cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.483+0000 7f84981ec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8490153090 con 0x7f84900cf450 2023-11-26T07:21:47.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.483+0000 7f84981ec640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900ac4e0 con 0x7f849015c7f0 2023-11-26T07:21:47.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.483+0000 7f84981ec640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84900b33d0 con 0x7f84900ce6c0 2023-11-26T07:21:47.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.483+0000 7f8495787640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84900cf450 0x7f8490156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.483+0000 7f8495787640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84900cf450 0x7f8490156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35804/0 (socket says 172.21.15.77:35804) 2023-11-26T07:21:47.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.484+0000 7f8495787640 1 -- 172.21.15.77:0/505843734 learned_addr learned my addr 172.21.15.77:0/505843734 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:47.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.484+0000 7f8496789640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f849015c7f0 0x7f84900cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.484+0000 7f8495787640 1 -- 172.21.15.77:0/505843734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84900ce6c0 msgr2=0x7f8490152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.484+0000 7f8495787640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84900ce6c0 0x7f8490152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.484+0000 7f8495787640 1 -- 172.21.15.77:0/505843734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f849015c7f0 msgr2=0x7f84900cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.484+0000 7f8495787640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f849015c7f0 0x7f84900cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.484+0000 7f8495787640 1 -- 172.21.15.77:0/505843734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c0094d0 con 0x7f84900cf450 2023-11-26T07:21:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.484+0000 7f8495787640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84900cf450 0x7f8490156940 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f848000c4b0 tx=0x7f848000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.484+0000 7f84867fc640 1 -- 172.21.15.77:0/505843734 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480005480 con 0x7f84900cf450 2023-11-26T07:21:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.484+0000 7f84867fc640 1 -- 172.21.15.77:0/505843734 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84800035f0 con 0x7f84900cf450 2023-11-26T07:21:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.484+0000 7f84981ec640 1 -- 172.21.15.77:0/505843734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84900b36b0 con 0x7f84900cf450 2023-11-26T07:21:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.485+0000 7f84867fc640 1 -- 172.21.15.77:0/505843734 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84800039a0 con 0x7f84900cf450 2023-11-26T07:21:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.485+0000 7f84981ec640 1 -- 172.21.15.77:0/505843734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84901538a0 con 0x7f84900cf450 2023-11-26T07:21:47.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.486+0000 7f84981ec640 1 -- 172.21.15.77:0/505843734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84900af5f0 con 0x7f84900cf450 2023-11-26T07:21:47.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.487+0000 7f84867fc640 1 -- 172.21.15.77:0/505843734 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f8480003b00 con 0x7f84900cf450 2023-11-26T07:21:47.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.488+0000 7f84867fc640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f847406b3e0 0x7f847406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.488+0000 7f84867fc640 1 -- 172.21.15.77:0/505843734 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8480089670 con 0x7f84900cf450 2023-11-26T07:21:47.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.488+0000 7f8495f88640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f847406b3e0 0x7f847406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.489+0000 7f8495f88640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f847406b3e0 0x7f847406d8a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f848c036000 tx=0x7f848c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:47.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.492+0000 7f84867fc640 1 -- 172.21.15.77:0/505843734 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8480053eb0 con 0x7f84900cf450 2023-11-26T07:21:47.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.678+0000 7f84981ec640 1 -- 172.21.15.77:0/505843734 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f849006e060 con 0x7f847406b3e0 2023-11-26T07:21:47.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.686+0000 7f84867fc640 1 -- 172.21.15.77:0/505843734 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287062 (secure 0 0 0) 0x7f848c030c10 con 0x7f847406b3e0 2023-11-26T07:21:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:21:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.692+0000 7f84981ec640 1 -- 172.21.15.77:0/505843734 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f847406b3e0 msgr2=0x7f847406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.692+0000 7f84981ec640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f847406b3e0 0x7f847406d8a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f848c036000 tx=0x7f848c03b040 comp rx=0 tx=0).stop 2023-11-26T07:21:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.692+0000 7f84981ec640 1 -- 172.21.15.77:0/505843734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84900cf450 msgr2=0x7f8490156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.692+0000 7f84981ec640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84900cf450 0x7f8490156940 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f848000c4b0 tx=0x7f848000c970 comp rx=0 tx=0).stop 2023-11-26T07:21:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.692+0000 7f84981ec640 1 -- 172.21.15.77:0/505843734 shutdown_connections 2023-11-26T07:21:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.692+0000 7f84981ec640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f847406b3e0 0x7f847406d8a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.692+0000 7f84981ec640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f849015c7f0 0x7f84900cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.692+0000 7f84981ec640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84900cf450 0x7f8490156940 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.692+0000 7f84981ec640 1 --2- 172.21.15.77:0/505843734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84900ce6c0 0x7f8490152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.692+0000 7f84981ec640 1 -- 172.21.15.77:0/505843734 >> 172.21.15.77:0/505843734 conn(0x7f849006a920 msgr2=0x7f849006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.693+0000 7f84981ec640 1 -- 172.21.15.77:0/505843734 shutdown_connections 2023-11-26T07:21:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.693+0000 7f84981ec640 1 -- 172.21.15.77:0/505843734 wait complete. 2023-11-26T07:21:47.730 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-11-26T07:21:45.682271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256404,"kb_used_data":6940,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718316,"statfs":{"total":773094113280,"available":772831555584,"internally_reserved":0,"allocated":7106560,"data_stored":3655504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.886850"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.849829+0000","last_change":"2023-11-26T07:21:42.842031+0000","last_active":"2023-11-26T07:21:42.849829+0000","last_peered":"2023-11-26T07:21:42.849829+0000","last_clean":"2023-11-26T07:21:42.849829+0000","last_became_active":"2023-11-26T07:21:42.841761+0000","last_became_peered":"2023-11-26T07:21:42.841761+0000","last_unstale":"2023-11-26T07:21:42.849829+0000","last_undegraded":"2023-11-26T07:21:42.849829+0000","last_fullsized":"2023-11-26T07:21:42.849829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:41:56.646698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861558+0000","last_change":"2023-11-26T07:21:42.847586+0000","last_active":"2023-11-26T07:21:42.861558+0000","last_peered":"2023-11-26T07:21:42.861558+0000","last_clean":"2023-11-26T07:21:42.861558+0000","last_became_active":"2023-11-26T07:21:42.847299+0000","last_became_peered":"2023-11-26T07:21:42.847299+0000","last_unstale":"2023-11-26T07:21:42.861558+0000","last_undegraded":"2023-11-26T07:21:42.861558+0000","last_fullsized":"2023-11-26T07:21:42.861558+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:39:20.542129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879648+0000","last_change":"2023-11-26T07:21:42.869292+0000","last_active":"2023-11-26T07:21:42.879648+0000","last_peered":"2023-11-26T07:21:42.879648+0000","last_clean":"2023-11-26T07:21:42.879648+0000","last_became_active":"2023-11-26T07:21:42.868917+0000","last_became_peered":"2023-11-26T07:21:42.868917+0000","last_unstale":"2023-11-26T07:21:42.879648+0000","last_undegraded":"2023-11-26T07:21:42.879648+0000","last_fullsized":"2023-11-26T07:21:42.879648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:33:17.104115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.852786+0000","last_change":"2023-11-26T07:21:42.846410+0000","last_active":"2023-11-26T07:21:42.852786+0000","last_peered":"2023-11-26T07:21:42.852786+0000","last_clean":"2023-11-26T07:21:42.852786+0000","last_became_active":"2023-11-26T07:21:42.845931+0000","last_became_peered":"2023-11-26T07:21:42.845931+0000","last_unstale":"2023-11-26T07:21:42.852786+0000","last_undegraded":"2023-11-26T07:21:42.852786+0000","last_fullsized":"2023-11-26T07:21:42.852786+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:05:36.084405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.855646+0000","last_change":"2023-11-26T07:21:42.853737+0000","last_active":"2023-11-26T07:21:42.855646+0000","last_peered":"2023-11-26T07:21:42.855646+0000","last_clean":"2023-11-26T07:21:42.855646+0000","last_became_active":"2023-11-26T07:21:42.853478+0000","last_became_peered":"2023-11-26T07:21:42.853478+0000","last_unstale":"2023-11-26T07:21:42.855646+0000","last_undegraded":"2023-11-26T07:21:42.855646+0000","last_fullsized":"2023-11-26T07:21:42.855646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:28:38.686338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.845894+0000","last_change":"2023-11-26T07:21:42.838879+0000","last_active":"2023-11-26T07:21:42.845894+0000","last_peered":"2023-11-26T07:21:42.845894+0000","last_clean":"2023-11-26T07:21:42.845894+0000","last_became_active":"2023-11-26T07:21:42.838603+0000","last_became_peered":"2023-11-26T07:21:42.838603+0000","last_unstale":"2023-11-26T07:21:42.845894+0000","last_undegraded":"2023-11-26T07:21:42.845894+0000","last_fullsized":"2023-11-26T07:21:42.845894+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:55:07.606916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.857720+0000","last_change":"2023-11-26T07:21:42.855286+0000","last_active":"2023-11-26T07:21:42.857720+0000","last_peered":"2023-11-26T07:21:42.857720+0000","last_clean":"2023-11-26T07:21:42.857720+0000","last_became_active":"2023-11-26T07:21:42.854215+0000","last_became_peered":"2023-11-26T07:21:42.854215+0000","last_unstale":"2023-11-26T07:21:42.857720+0000","last_undegraded":"2023-11-26T07:21:42.857720+0000","last_fullsized":"2023-11-26T07:21:42.857720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:31:47.404971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861701+0000","last_change":"2023-11-26T07:21:42.852928+0000","last_active":"2023-11-26T07:21:42.861701+0000","last_peered":"2023-11-26T07:21:42.861701+0000","last_clean":"2023-11-26T07:21:42.861701+0000","last_became_active":"2023-11-26T07:21:42.848984+0000","last_became_peered":"2023-11-26T07:21:42.848984+0000","last_unstale":"2023-11-26T07:21:42.861701+0000","last_undegraded":"2023-11-26T07:21:42.861701+0000","last_fullsized":"2023-11-26T07:21:42.861701+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:44:14.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.864740+0000","last_change":"2023-11-26T07:21:42.860047+0000","last_active":"2023-11-26T07:21:42.864740+0000","last_peered":"2023-11-26T07:21:42.864740+0000","last_clean":"2023-11-26T07:21:42.864740+0000","last_became_active":"2023-11-26T07:21:42.859598+0000","last_became_peered":"2023-11-26T07:21:42.859598+0000","last_unstale":"2023-11-26T07:21:42.864740+0000","last_undegraded":"2023-11-26T07:21:42.864740+0000","last_fullsized":"2023-11-26T07:21:42.864740+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:54:00.540700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.863440+0000","last_change":"2023-11-26T07:21:42.857682+0000","last_active":"2023-11-26T07:21:42.863440+0000","last_peered":"2023-11-26T07:21:42.863440+0000","last_clean":"2023-11-26T07:21:42.863440+0000","last_became_active":"2023-11-26T07:21:42.854407+0000","last_became_peered":"2023-11-26T07:21:42.854407+0000","last_unstale":"2023-11-26T07:21:42.863440+0000","last_undegraded":"2023-11-26T07:21:42.863440+0000","last_fullsized":"2023-11-26T07:21:42.863440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:50.591863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.863674+0000","last_change":"2023-11-26T07:21:42.858633+0000","last_active":"2023-11-26T07:21:42.863674+0000","last_peered":"2023-11-26T07:21:42.863674+0000","last_clean":"2023-11-26T07:21:42.863674+0000","last_became_active":"2023-11-26T07:21:42.854210+0000","last_became_peered":"2023-11-26T07:21:42.854210+0000","last_unstale":"2023-11-26T07:21:42.863674+0000","last_undegraded":"2023-11-26T07:21:42.863674+0000","last_fullsized":"2023-11-26T07:21:42.863674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:33.600063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.874463+0000","last_change":"2023-11-26T07:21:42.866361+0000","last_active":"2023-11-26T07:21:42.874463+0000","last_peered":"2023-11-26T07:21:42.874463+0000","last_clean":"2023-11-26T07:21:42.874463+0000","last_became_active":"2023-11-26T07:21:42.865395+0000","last_became_peered":"2023-11-26T07:21:42.865395+0000","last_unstale":"2023-11-26T07:21:42.874463+0000","last_undegraded":"2023-11-26T07:21:42.874463+0000","last_fullsized":"2023-11-26T07:21:42.874463+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:10:43.421835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.868340+0000","last_change":"2023-11-26T07:21:42.862938+0000","last_active":"2023-11-26T07:21:42.868340+0000","last_peered":"2023-11-26T07:21:42.868340+0000","last_clean":"2023-11-26T07:21:42.868340+0000","last_became_active":"2023-11-26T07:21:42.862627+0000","last_became_peered":"2023-11-26T07:21:42.862627+0000","last_unstale":"2023-11-26T07:21:42.868340+0000","last_undegraded":"2023-11-26T07:21:42.868340+0000","last_fullsized":"2023-11-26T07:21:42.868340+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:37:17.608463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862447+0000","last_change":"2023-11-26T07:21:42.857219+0000","last_active":"2023-11-26T07:21:42.862447+0000","last_peered":"2023-11-26T07:21:42.862447+0000","last_clean":"2023-11-26T07:21:42.862447+0000","last_became_active":"2023-11-26T07:21:42.856879+0000","last_became_peered":"2023-11-26T07:21:42.856879+0000","last_unstale":"2023-11-26T07:21:42.862447+0000","last_undegraded":"2023-11-26T07:21:42.862447+0000","last_fullsized":"2023-11-26T07:21:42.862447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:23:14.927284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.852339+0000","last_change":"2023-11-26T07:21:42.849401+0000","last_active":"2023-11-26T07:21:42.852339+0000","last_peered":"2023-11-26T07:21:42.852339+0000","last_clean":"2023-11-26T07:21:42.852339+0000","last_became_active":"2023-11-26T07:21:42.849046+0000","last_became_peered":"2023-11-26T07:21:42.849046+0000","last_unstale":"2023-11-26T07:21:42.852339+0000","last_undegraded":"2023-11-26T07:21:42.852339+0000","last_fullsized":"2023-11-26T07:21:42.852339+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:14:37.239032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861646+0000","last_change":"2023-11-26T07:21:42.851979+0000","last_active":"2023-11-26T07:21:42.861646+0000","last_peered":"2023-11-26T07:21:42.861646+0000","last_clean":"2023-11-26T07:21:42.861646+0000","last_became_active":"2023-11-26T07:21:42.851732+0000","last_became_peered":"2023-11-26T07:21:42.851732+0000","last_unstale":"2023-11-26T07:21:42.861646+0000","last_undegraded":"2023-11-26T07:21:42.861646+0000","last_fullsized":"2023-11-26T07:21:42.861646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:45:11.939133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862516+0000","last_change":"2023-11-26T07:21:42.855541+0000","last_active":"2023-11-26T07:21:42.862516+0000","last_peered":"2023-11-26T07:21:42.862516+0000","last_clean":"2023-11-26T07:21:42.862516+0000","last_became_active":"2023-11-26T07:21:42.855149+0000","last_became_peered":"2023-11-26T07:21:42.855149+0000","last_unstale":"2023-11-26T07:21:42.862516+0000","last_undegraded":"2023-11-26T07:21:42.862516+0000","last_fullsized":"2023-11-26T07:21:42.862516+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:52:53.785827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879828+0000","last_change":"2023-11-26T07:21:42.872310+0000","last_active":"2023-11-26T07:21:42.879828+0000","last_peered":"2023-11-26T07:21:42.879828+0000","last_clean":"2023-11-26T07:21:42.879828+0000","last_became_active":"2023-11-26T07:21:42.872029+0000","last_became_peered":"2023-11-26T07:21:42.872029+0000","last_unstale":"2023-11-26T07:21:42.879828+0000","last_undegraded":"2023-11-26T07:21:42.879828+0000","last_fullsized":"2023-11-26T07:21:42.879828+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:28:25.295294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.863127+0000","last_change":"2023-11-26T07:21:42.858279+0000","last_active":"2023-11-26T07:21:42.863127+0000","last_peered":"2023-11-26T07:21:42.863127+0000","last_clean":"2023-11-26T07:21:42.863127+0000","last_became_active":"2023-11-26T07:21:42.858030+0000","last_became_peered":"2023-11-26T07:21:42.858030+0000","last_unstale":"2023-11-26T07:21:42.863127+0000","last_undegraded":"2023-11-26T07:21:42.863127+0000","last_fullsized":"2023-11-26T07:21:42.863127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:58:13.415006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.847198+0000","last_change":"2023-11-26T07:21:42.839386+0000","last_active":"2023-11-26T07:21:42.847198+0000","last_peered":"2023-11-26T07:21:42.847198+0000","last_clean":"2023-11-26T07:21:42.847198+0000","last_became_active":"2023-11-26T07:21:42.839041+0000","last_became_peered":"2023-11-26T07:21:42.839041+0000","last_unstale":"2023-11-26T07:21:42.847198+0000","last_undegraded":"2023-11-26T07:21:42.847198+0000","last_fullsized":"2023-11-26T07:21:42.847198+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:42:48.174400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879867+0000","last_change":"2023-11-26T07:21:42.872622+0000","last_active":"2023-11-26T07:21:42.879867+0000","last_peered":"2023-11-26T07:21:42.879867+0000","last_clean":"2023-11-26T07:21:42.879867+0000","last_became_active":"2023-11-26T07:21:42.870383+0000","last_became_peered":"2023-11-26T07:21:42.870383+0000","last_unstale":"2023-11-26T07:21:42.879867+0000","last_undegraded":"2023-11-26T07:21:42.879867+0000","last_fullsized":"2023-11-26T07:21:42.879867+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:51.981889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861593+0000","last_change":"2023-11-26T07:21:42.847674+0000","last_active":"2023-11-26T07:21:42.861593+0000","last_peered":"2023-11-26T07:21:42.861593+0000","last_clean":"2023-11-26T07:21:42.861593+0000","last_became_active":"2023-11-26T07:21:42.847376+0000","last_became_peered":"2023-11-26T07:21:42.847376+0000","last_unstale":"2023-11-26T07:21:42.861593+0000","last_undegraded":"2023-11-26T07:21:42.861593+0000","last_fullsized":"2023-11-26T07:21:42.861593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:38:38.415989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879910+0000","last_change":"2023-11-26T07:21:42.873118+0000","last_active":"2023-11-26T07:21:42.879910+0000","last_peered":"2023-11-26T07:21:42.879910+0000","last_clean":"2023-11-26T07:21:42.879910+0000","last_became_active":"2023-11-26T07:21:42.872712+0000","last_became_peered":"2023-11-26T07:21:42.872712+0000","last_unstale":"2023-11-26T07:21:42.879910+0000","last_undegraded":"2023-11-26T07:21:42.879910+0000","last_fullsized":"2023-11-26T07:21:42.879910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:35.228374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.853774+0000","last_change":"2023-11-26T07:21:42.850938+0000","last_active":"2023-11-26T07:21:42.853774+0000","last_peered":"2023-11-26T07:21:42.853774+0000","last_clean":"2023-11-26T07:21:42.853774+0000","last_became_active":"2023-11-26T07:21:42.850625+0000","last_became_peered":"2023-11-26T07:21:42.850625+0000","last_unstale":"2023-11-26T07:21:42.853774+0000","last_undegraded":"2023-11-26T07:21:42.853774+0000","last_fullsized":"2023-11-26T07:21:42.853774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:25:51.194056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.849849+0000","last_change":"2023-11-26T07:21:42.844899+0000","last_active":"2023-11-26T07:21:42.849849+0000","last_peered":"2023-11-26T07:21:42.849849+0000","last_clean":"2023-11-26T07:21:42.849849+0000","last_became_active":"2023-11-26T07:21:42.844601+0000","last_became_peered":"2023-11-26T07:21:42.844601+0000","last_unstale":"2023-11-26T07:21:42.849849+0000","last_undegraded":"2023-11-26T07:21:42.849849+0000","last_fullsized":"2023-11-26T07:21:42.849849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:37:15.444028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854699+0000","last_change":"2023-11-26T07:21:42.849029+0000","last_active":"2023-11-26T07:21:42.854699+0000","last_peered":"2023-11-26T07:21:42.854699+0000","last_clean":"2023-11-26T07:21:42.854699+0000","last_became_active":"2023-11-26T07:21:42.848762+0000","last_became_peered":"2023-11-26T07:21:42.848762+0000","last_unstale":"2023-11-26T07:21:42.854699+0000","last_undegraded":"2023-11-26T07:21:42.854699+0000","last_fullsized":"2023-11-26T07:21:42.854699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:45:11.939133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862843+0000","last_change":"2023-11-26T07:21:42.855182+0000","last_active":"2023-11-26T07:21:42.862843+0000","last_peered":"2023-11-26T07:21:42.862843+0000","last_clean":"2023-11-26T07:21:42.862843+0000","last_became_active":"2023-11-26T07:21:42.854850+0000","last_became_peered":"2023-11-26T07:21:42.854850+0000","last_unstale":"2023-11-26T07:21:42.862843+0000","last_undegraded":"2023-11-26T07:21:42.862843+0000","last_fullsized":"2023-11-26T07:21:42.862843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:05:36.084405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854089+0000","last_change":"2023-11-26T07:21:42.850429+0000","last_active":"2023-11-26T07:21:42.854089+0000","last_peered":"2023-11-26T07:21:42.854089+0000","last_clean":"2023-11-26T07:21:42.854089+0000","last_became_active":"2023-11-26T07:21:42.850146+0000","last_became_peered":"2023-11-26T07:21:42.850146+0000","last_unstale":"2023-11-26T07:21:42.854089+0000","last_undegraded":"2023-11-26T07:21:42.854089+0000","last_fullsized":"2023-11-26T07:21:42.854089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:15:47.679562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.864147+0000","last_change":"2023-11-26T07:21:42.858609+0000","last_active":"2023-11-26T07:21:42.864147+0000","last_peered":"2023-11-26T07:21:42.864147+0000","last_clean":"2023-11-26T07:21:42.864147+0000","last_became_active":"2023-11-26T07:21:42.858303+0000","last_became_peered":"2023-11-26T07:21:42.858303+0000","last_unstale":"2023-11-26T07:21:42.864147+0000","last_undegraded":"2023-11-26T07:21:42.864147+0000","last_fullsized":"2023-11-26T07:21:42.864147+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:18:35.133581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879883+0000","last_change":"2023-11-26T07:21:42.872759+0000","last_active":"2023-11-26T07:21:42.879883+0000","last_peered":"2023-11-26T07:21:42.879883+0000","last_clean":"2023-11-26T07:21:42.879883+0000","last_became_active":"2023-11-26T07:21:42.872372+0000","last_became_peered":"2023-11-26T07:21:42.872372+0000","last_unstale":"2023-11-26T07:21:42.879883+0000","last_undegraded":"2023-11-26T07:21:42.879883+0000","last_fullsized":"2023-11-26T07:21:42.879883+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:08:08.549806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.849312+0000","last_change":"2023-11-26T07:21:42.844589+0000","last_active":"2023-11-26T07:21:42.849312+0000","last_peered":"2023-11-26T07:21:42.849312+0000","last_clean":"2023-11-26T07:21:42.849312+0000","last_became_active":"2023-11-26T07:21:42.843253+0000","last_became_peered":"2023-11-26T07:21:42.843253+0000","last_unstale":"2023-11-26T07:21:42.849312+0000","last_undegraded":"2023-11-26T07:21:42.849312+0000","last_fullsized":"2023-11-26T07:21:42.849312+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:54:24.018827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.849564+0000","last_change":"2023-11-26T07:21:42.842772+0000","last_active":"2023-11-26T07:21:42.849564+0000","last_peered":"2023-11-26T07:21:42.849564+0000","last_clean":"2023-11-26T07:21:42.849564+0000","last_became_active":"2023-11-26T07:21:42.842494+0000","last_became_peered":"2023-11-26T07:21:42.842494+0000","last_unstale":"2023-11-26T07:21:42.849564+0000","last_undegraded":"2023-11-26T07:21:42.849564+0000","last_fullsized":"2023-11-26T07:21:42.849564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:35.228374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.874463+0000","last_change":"2023-11-26T07:21:42.873704+0000","last_active":"2023-11-26T07:21:42.874463+0000","last_peered":"2023-11-26T07:21:42.874463+0000","last_clean":"2023-11-26T07:21:42.874463+0000","last_became_active":"2023-11-26T07:21:42.873063+0000","last_became_peered":"2023-11-26T07:21:42.873063+0000","last_unstale":"2023-11-26T07:21:42.874463+0000","last_undegraded":"2023-11-26T07:21:42.874463+0000","last_fullsized":"2023-11-26T07:21:42.874463+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:43:14.397209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862972+0000","last_change":"2023-11-26T07:21:41.831678+0000","last_active":"2023-11-26T07:21:42.862972+0000","last_peered":"2023-11-26T07:21:42.862972+0000","last_clean":"2023-11-26T07:21:42.862972+0000","last_became_active":"2023-11-26T07:21:41.831400+0000","last_became_peered":"2023-11-26T07:21:41.831400+0000","last_unstale":"2023-11-26T07:21:42.862972+0000","last_undegraded":"2023-11-26T07:21:42.862972+0000","last_fullsized":"2023-11-26T07:21:42.862972+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:39:33.083235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.868289+0000","last_change":"2023-11-26T07:21:42.866825+0000","last_active":"2023-11-26T07:21:42.868289+0000","last_peered":"2023-11-26T07:21:42.868289+0000","last_clean":"2023-11-26T07:21:42.868289+0000","last_became_active":"2023-11-26T07:21:42.866568+0000","last_became_peered":"2023-11-26T07:21:42.866568+0000","last_unstale":"2023-11-26T07:21:42.868289+0000","last_undegraded":"2023-11-26T07:21:42.868289+0000","last_fullsized":"2023-11-26T07:21:42.868289+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:56:16.229026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.871508+0000","last_change":"2023-11-26T07:21:41.834417+0000","last_active":"2023-11-26T07:21:42.871508+0000","last_peered":"2023-11-26T07:21:42.871508+0000","last_clean":"2023-11-26T07:21:42.871508+0000","last_became_active":"2023-11-26T07:21:41.833905+0000","last_became_peered":"2023-11-26T07:21:41.833905+0000","last_unstale":"2023-11-26T07:21:42.871508+0000","last_undegraded":"2023-11-26T07:21:42.871508+0000","last_fullsized":"2023-11-26T07:21:42.871508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:10:56.152788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.852418+0000","last_change":"2023-11-26T07:21:42.841126+0000","last_active":"2023-11-26T07:21:42.852418+0000","last_peered":"2023-11-26T07:21:42.852418+0000","last_clean":"2023-11-26T07:21:42.852418+0000","last_became_active":"2023-11-26T07:21:42.840539+0000","last_became_peered":"2023-11-26T07:21:42.840539+0000","last_unstale":"2023-11-26T07:21:42.852418+0000","last_undegraded":"2023-11-26T07:21:42.852418+0000","last_fullsized":"2023-11-26T07:21:42.852418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:18:35.133581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.864299+0000","last_change":"2023-11-26T07:21:41.821874+0000","last_active":"2023-11-26T07:21:42.864299+0000","last_peered":"2023-11-26T07:21:42.864299+0000","last_clean":"2023-11-26T07:21:42.864299+0000","last_became_active":"2023-11-26T07:21:41.821609+0000","last_became_peered":"2023-11-26T07:21:41.821609+0000","last_unstale":"2023-11-26T07:21:42.864299+0000","last_undegraded":"2023-11-26T07:21:42.864299+0000","last_fullsized":"2023-11-26T07:21:42.864299+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:10:56.734748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854774+0000","last_change":"2023-11-26T07:21:42.846302+0000","last_active":"2023-11-26T07:21:42.854774+0000","last_peered":"2023-11-26T07:21:42.854774+0000","last_clean":"2023-11-26T07:21:42.854774+0000","last_became_active":"2023-11-26T07:21:42.845992+0000","last_became_peered":"2023-11-26T07:21:42.845992+0000","last_unstale":"2023-11-26T07:21:42.854774+0000","last_undegraded":"2023-11-26T07:21:42.854774+0000","last_fullsized":"2023-11-26T07:21:42.854774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:57:26.318998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.871165+0000","last_change":"2023-11-26T07:21:41.838159+0000","last_active":"2023-11-26T07:21:42.871165+0000","last_peered":"2023-11-26T07:21:42.871165+0000","last_clean":"2023-11-26T07:21:42.871165+0000","last_became_active":"2023-11-26T07:21:41.837642+0000","last_became_peered":"2023-11-26T07:21:41.837642+0000","last_unstale":"2023-11-26T07:21:42.871165+0000","last_undegraded":"2023-11-26T07:21:42.871165+0000","last_fullsized":"2023-11-26T07:21:42.871165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:43:13.386831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862417+0000","last_change":"2023-11-26T07:21:42.855445+0000","last_active":"2023-11-26T07:21:42.862417+0000","last_peered":"2023-11-26T07:21:42.862417+0000","last_clean":"2023-11-26T07:21:42.862417+0000","last_became_active":"2023-11-26T07:21:42.855181+0000","last_became_peered":"2023-11-26T07:21:42.855181+0000","last_unstale":"2023-11-26T07:21:42.862417+0000","last_undegraded":"2023-11-26T07:21:42.862417+0000","last_fullsized":"2023-11-26T07:21:42.862417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:05.282229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.866152+0000","last_change":"2023-11-26T07:21:41.827246+0000","last_active":"2023-11-26T07:21:42.866152+0000","last_peered":"2023-11-26T07:21:42.866152+0000","last_clean":"2023-11-26T07:21:42.866152+0000","last_became_active":"2023-11-26T07:21:41.826968+0000","last_became_peered":"2023-11-26T07:21:41.826968+0000","last_unstale":"2023-11-26T07:21:42.866152+0000","last_undegraded":"2023-11-26T07:21:42.866152+0000","last_fullsized":"2023-11-26T07:21:42.866152+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:30:28.259076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.859312+0000","last_change":"2023-11-26T07:21:42.846101+0000","last_active":"2023-11-26T07:21:42.859312+0000","last_peered":"2023-11-26T07:21:42.859312+0000","last_clean":"2023-11-26T07:21:42.859312+0000","last_became_active":"2023-11-26T07:21:42.843542+0000","last_became_peered":"2023-11-26T07:21:42.843542+0000","last_unstale":"2023-11-26T07:21:42.859312+0000","last_undegraded":"2023-11-26T07:21:42.859312+0000","last_fullsized":"2023-11-26T07:21:42.859312+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:08.018038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.856318+0000","last_change":"2023-11-26T07:21:41.835411+0000","last_active":"2023-11-26T07:21:42.856318+0000","last_peered":"2023-11-26T07:21:42.856318+0000","last_clean":"2023-11-26T07:21:42.856318+0000","last_became_active":"2023-11-26T07:21:41.835012+0000","last_became_peered":"2023-11-26T07:21:41.835012+0000","last_unstale":"2023-11-26T07:21:42.856318+0000","last_undegraded":"2023-11-26T07:21:42.856318+0000","last_fullsized":"2023-11-26T07:21:42.856318+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:37.258248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.877024+0000","last_change":"2023-11-26T07:21:42.870409+0000","last_active":"2023-11-26T07:21:42.877024+0000","last_peered":"2023-11-26T07:21:42.877024+0000","last_clean":"2023-11-26T07:21:42.877024+0000","last_became_active":"2023-11-26T07:21:42.869736+0000","last_became_peered":"2023-11-26T07:21:42.869736+0000","last_unstale":"2023-11-26T07:21:42.877024+0000","last_undegraded":"2023-11-26T07:21:42.877024+0000","last_fullsized":"2023-11-26T07:21:42.877024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:47:15.747841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.829804+0000","last_change":"2023-11-26T07:21:41.833169+0000","last_active":"2023-11-26T07:21:42.829804+0000","last_peered":"2023-11-26T07:21:42.829804+0000","last_clean":"2023-11-26T07:21:42.829804+0000","last_became_active":"2023-11-26T07:21:41.832835+0000","last_became_peered":"2023-11-26T07:21:41.832835+0000","last_unstale":"2023-11-26T07:21:42.829804+0000","last_undegraded":"2023-11-26T07:21:42.829804+0000","last_fullsized":"2023-11-26T07:21:42.829804+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:33:16.093737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862431+0000","last_change":"2023-11-26T07:21:42.857077+0000","last_active":"2023-11-26T07:21:42.862431+0000","last_peered":"2023-11-26T07:21:42.862431+0000","last_clean":"2023-11-26T07:21:42.862431+0000","last_became_active":"2023-11-26T07:21:42.856183+0000","last_became_peered":"2023-11-26T07:21:42.856183+0000","last_unstale":"2023-11-26T07:21:42.862431+0000","last_undegraded":"2023-11-26T07:21:42.862431+0000","last_fullsized":"2023-11-26T07:21:42.862431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:36:27.282658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.841754+0000","last_change":"2023-11-26T07:21:41.825293+0000","last_active":"2023-11-26T07:21:42.841754+0000","last_peered":"2023-11-26T07:21:42.841754+0000","last_clean":"2023-11-26T07:21:42.841754+0000","last_became_active":"2023-11-26T07:21:41.824899+0000","last_became_peered":"2023-11-26T07:21:41.824899+0000","last_unstale":"2023-11-26T07:21:42.841754+0000","last_undegraded":"2023-11-26T07:21:42.841754+0000","last_fullsized":"2023-11-26T07:21:42.841754+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:31:36.588912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862473+0000","last_change":"2023-11-26T07:21:42.858193+0000","last_active":"2023-11-26T07:21:42.862473+0000","last_peered":"2023-11-26T07:21:42.862473+0000","last_clean":"2023-11-26T07:21:42.862473+0000","last_became_active":"2023-11-26T07:21:42.857856+0000","last_became_peered":"2023-11-26T07:21:42.857856+0000","last_unstale":"2023-11-26T07:21:42.862473+0000","last_undegraded":"2023-11-26T07:21:42.862473+0000","last_fullsized":"2023-11-26T07:21:42.862473+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:33:17.104115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861418+0000","last_change":"2023-11-26T07:21:41.842257+0000","last_active":"2023-11-26T07:21:42.861418+0000","last_peered":"2023-11-26T07:21:42.861418+0000","last_clean":"2023-11-26T07:21:42.861418+0000","last_became_active":"2023-11-26T07:21:41.841887+0000","last_became_peered":"2023-11-26T07:21:41.841887+0000","last_unstale":"2023-11-26T07:21:42.861418+0000","last_undegraded":"2023-11-26T07:21:42.861418+0000","last_fullsized":"2023-11-26T07:21:42.861418+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:37.258248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879791+0000","last_change":"2023-11-26T07:21:42.871866+0000","last_active":"2023-11-26T07:21:42.879791+0000","last_peered":"2023-11-26T07:21:42.879791+0000","last_clean":"2023-11-26T07:21:42.879791+0000","last_became_active":"2023-11-26T07:21:42.869072+0000","last_became_peered":"2023-11-26T07:21:42.869072+0000","last_unstale":"2023-11-26T07:21:42.879791+0000","last_undegraded":"2023-11-26T07:21:42.879791+0000","last_fullsized":"2023-11-26T07:21:42.879791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:01:26.683873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.833605+0000","last_change":"2023-11-26T07:21:41.823941+0000","last_active":"2023-11-26T07:21:42.833605+0000","last_peered":"2023-11-26T07:21:42.833605+0000","last_clean":"2023-11-26T07:21:42.833605+0000","last_became_active":"2023-11-26T07:21:41.823666+0000","last_became_peered":"2023-11-26T07:21:41.823666+0000","last_unstale":"2023-11-26T07:21:42.833605+0000","last_undegraded":"2023-11-26T07:21:42.833605+0000","last_fullsized":"2023-11-26T07:21:42.833605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:16:11.266436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.860496+0000","last_change":"2023-11-26T07:21:42.857157+0000","last_active":"2023-11-26T07:21:42.860496+0000","last_peered":"2023-11-26T07:21:42.860496+0000","last_clean":"2023-11-26T07:21:42.860496+0000","last_became_active":"2023-11-26T07:21:42.856808+0000","last_became_peered":"2023-11-26T07:21:42.856808+0000","last_unstale":"2023-11-26T07:21:42.860496+0000","last_undegraded":"2023-11-26T07:21:42.860496+0000","last_fullsized":"2023-11-26T07:21:42.860496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:11:28.820172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.869605+0000","last_change":"2023-11-26T07:21:41.839677+0000","last_active":"2023-11-26T07:21:42.869605+0000","last_peered":"2023-11-26T07:21:42.869605+0000","last_clean":"2023-11-26T07:21:42.869605+0000","last_became_active":"2023-11-26T07:21:41.839304+0000","last_became_peered":"2023-11-26T07:21:41.839304+0000","last_unstale":"2023-11-26T07:21:42.869605+0000","last_undegraded":"2023-11-26T07:21:42.869605+0000","last_fullsized":"2023-11-26T07:21:42.869605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:03.303930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879623+0000","last_change":"2023-11-26T07:21:42.869100+0000","last_active":"2023-11-26T07:21:42.879623+0000","last_peered":"2023-11-26T07:21:42.879623+0000","last_clean":"2023-11-26T07:21:42.879623+0000","last_became_active":"2023-11-26T07:21:42.868786+0000","last_became_peered":"2023-11-26T07:21:42.868786+0000","last_unstale":"2023-11-26T07:21:42.879623+0000","last_undegraded":"2023-11-26T07:21:42.879623+0000","last_fullsized":"2023-11-26T07:21:42.879623+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:30:29.269453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.874341+0000","last_change":"2023-11-26T07:21:41.828514+0000","last_active":"2023-11-26T07:21:42.874341+0000","last_peered":"2023-11-26T07:21:42.874341+0000","last_clean":"2023-11-26T07:21:42.874341+0000","last_became_active":"2023-11-26T07:21:41.828208+0000","last_became_peered":"2023-11-26T07:21:41.828208+0000","last_unstale":"2023-11-26T07:21:42.874341+0000","last_undegraded":"2023-11-26T07:21:42.874341+0000","last_fullsized":"2023-11-26T07:21:42.874341+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:50.971511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854742+0000","last_change":"2023-11-26T07:21:42.847305+0000","last_active":"2023-11-26T07:21:42.854742+0000","last_peered":"2023-11-26T07:21:42.854742+0000","last_clean":"2023-11-26T07:21:42.854742+0000","last_became_active":"2023-11-26T07:21:42.844905+0000","last_became_peered":"2023-11-26T07:21:42.844905+0000","last_unstale":"2023-11-26T07:21:42.854742+0000","last_undegraded":"2023-11-26T07:21:42.854742+0000","last_fullsized":"2023-11-26T07:21:42.854742+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:30:29.269453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.866088+0000","last_change":"2023-11-26T07:21:41.824310+0000","last_active":"2023-11-26T07:21:42.866088+0000","last_peered":"2023-11-26T07:21:42.866088+0000","last_clean":"2023-11-26T07:21:42.866088+0000","last_became_active":"2023-11-26T07:21:41.823992+0000","last_became_peered":"2023-11-26T07:21:41.823992+0000","last_unstale":"2023-11-26T07:21:42.866088+0000","last_undegraded":"2023-11-26T07:21:42.866088+0000","last_fullsized":"2023-11-26T07:21:42.866088+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:39:41.412045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879761+0000","last_change":"2023-11-26T07:21:42.870659+0000","last_active":"2023-11-26T07:21:42.879761+0000","last_peered":"2023-11-26T07:21:42.879761+0000","last_clean":"2023-11-26T07:21:42.879761+0000","last_became_active":"2023-11-26T07:21:42.870006+0000","last_became_peered":"2023-11-26T07:21:42.870006+0000","last_unstale":"2023-11-26T07:21:42.879761+0000","last_undegraded":"2023-11-26T07:21:42.879761+0000","last_fullsized":"2023-11-26T07:21:42.879761+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:54:00.540700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.846393+0000","last_change":"2023-11-26T07:21:41.832022+0000","last_active":"2023-11-26T07:21:42.846393+0000","last_peered":"2023-11-26T07:21:42.846393+0000","last_clean":"2023-11-26T07:21:42.846393+0000","last_became_active":"2023-11-26T07:21:41.830518+0000","last_became_peered":"2023-11-26T07:21:41.830518+0000","last_unstale":"2023-11-26T07:21:42.846393+0000","last_undegraded":"2023-11-26T07:21:42.846393+0000","last_fullsized":"2023-11-26T07:21:42.846393+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:32.589685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.868868+0000","last_change":"2023-11-26T07:21:42.865479+0000","last_active":"2023-11-26T07:21:42.868868+0000","last_peered":"2023-11-26T07:21:42.868868+0000","last_clean":"2023-11-26T07:21:42.868868+0000","last_became_active":"2023-11-26T07:21:42.865022+0000","last_became_peered":"2023-11-26T07:21:42.865022+0000","last_unstale":"2023-11-26T07:21:42.868868+0000","last_undegraded":"2023-11-26T07:21:42.868868+0000","last_fullsized":"2023-11-26T07:21:42.868868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:03:29.477105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.830168+0000","last_change":"2023-11-26T07:21:41.832917+0000","last_active":"2023-11-26T07:21:42.830168+0000","last_peered":"2023-11-26T07:21:42.830168+0000","last_clean":"2023-11-26T07:21:42.830168+0000","last_became_active":"2023-11-26T07:21:41.831429+0000","last_became_peered":"2023-11-26T07:21:41.831429+0000","last_unstale":"2023-11-26T07:21:42.830168+0000","last_undegraded":"2023-11-26T07:21:42.830168+0000","last_fullsized":"2023-11-26T07:21:42.830168+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:03.303930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879771+0000","last_change":"2023-11-26T07:21:42.870804+0000","last_active":"2023-11-26T07:21:42.879771+0000","last_peered":"2023-11-26T07:21:42.879771+0000","last_clean":"2023-11-26T07:21:42.879771+0000","last_became_active":"2023-11-26T07:21:42.870484+0000","last_became_peered":"2023-11-26T07:21:42.870484+0000","last_unstale":"2023-11-26T07:21:42.879771+0000","last_undegraded":"2023-11-26T07:21:42.879771+0000","last_fullsized":"2023-11-26T07:21:42.879771+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:10:43.421835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.874054+0000","last_change":"2023-11-26T07:21:41.841465+0000","last_active":"2023-11-26T07:21:42.874054+0000","last_peered":"2023-11-26T07:21:42.874054+0000","last_clean":"2023-11-26T07:21:42.874054+0000","last_became_active":"2023-11-26T07:21:41.841167+0000","last_became_peered":"2023-11-26T07:21:41.841167+0000","last_unstale":"2023-11-26T07:21:42.874054+0000","last_undegraded":"2023-11-26T07:21:42.874054+0000","last_fullsized":"2023-11-26T07:21:42.874054+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:55:06.596538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879851+0000","last_change":"2023-11-26T07:21:42.872378+0000","last_active":"2023-11-26T07:21:42.879851+0000","last_peered":"2023-11-26T07:21:42.879851+0000","last_clean":"2023-11-26T07:21:42.879851+0000","last_became_active":"2023-11-26T07:21:42.872088+0000","last_became_peered":"2023-11-26T07:21:42.872088+0000","last_unstale":"2023-11-26T07:21:42.879851+0000","last_undegraded":"2023-11-26T07:21:42.879851+0000","last_fullsized":"2023-11-26T07:21:42.879851+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:43:14.397209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.866000+0000","last_change":"2023-11-26T07:21:41.814943+0000","last_active":"2023-11-26T07:21:42.866000+0000","last_peered":"2023-11-26T07:21:42.866000+0000","last_clean":"2023-11-26T07:21:42.866000+0000","last_became_active":"2023-11-26T07:21:41.814663+0000","last_became_peered":"2023-11-26T07:21:41.814663+0000","last_unstale":"2023-11-26T07:21:42.866000+0000","last_undegraded":"2023-11-26T07:21:42.866000+0000","last_fullsized":"2023-11-26T07:21:42.866000+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:35.955866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854769+0000","last_change":"2023-11-26T07:21:42.847972+0000","last_active":"2023-11-26T07:21:42.854769+0000","last_peered":"2023-11-26T07:21:42.854769+0000","last_clean":"2023-11-26T07:21:42.854769+0000","last_became_active":"2023-11-26T07:21:42.847671+0000","last_became_peered":"2023-11-26T07:21:42.847671+0000","last_unstale":"2023-11-26T07:21:42.854769+0000","last_undegraded":"2023-11-26T07:21:42.854769+0000","last_fullsized":"2023-11-26T07:21:42.854769+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:28:25.295294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.857615+0000","last_change":"2023-11-26T07:21:41.832654+0000","last_active":"2023-11-26T07:21:42.857615+0000","last_peered":"2023-11-26T07:21:42.857615+0000","last_clean":"2023-11-26T07:21:42.857615+0000","last_became_active":"2023-11-26T07:21:41.831984+0000","last_became_peered":"2023-11-26T07:21:41.831984+0000","last_unstale":"2023-11-26T07:21:42.857615+0000","last_undegraded":"2023-11-26T07:21:42.857615+0000","last_fullsized":"2023-11-26T07:21:42.857615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:10:42.411457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.861923+0000","last_change":"2023-11-26T07:21:42.852551+0000","last_active":"2023-11-26T07:21:42.861923+0000","last_peered":"2023-11-26T07:21:42.861923+0000","last_clean":"2023-11-26T07:21:42.861923+0000","last_became_active":"2023-11-26T07:21:42.852275+0000","last_became_peered":"2023-11-26T07:21:42.852275+0000","last_unstale":"2023-11-26T07:21:42.861923+0000","last_undegraded":"2023-11-26T07:21:42.861923+0000","last_fullsized":"2023-11-26T07:21:42.861923+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:55:17.598668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.868894+0000","last_change":"2023-11-26T07:21:41.832300+0000","last_active":"2023-11-26T07:21:42.868894+0000","last_peered":"2023-11-26T07:21:42.868894+0000","last_clean":"2023-11-26T07:21:42.868894+0000","last_became_active":"2023-11-26T07:21:41.832008+0000","last_became_peered":"2023-11-26T07:21:41.832008+0000","last_unstale":"2023-11-26T07:21:42.868894+0000","last_undegraded":"2023-11-26T07:21:42.868894+0000","last_fullsized":"2023-11-26T07:21:42.868894+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:50.971511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879668+0000","last_change":"2023-11-26T07:21:42.870240+0000","last_active":"2023-11-26T07:21:42.879668+0000","last_peered":"2023-11-26T07:21:42.879668+0000","last_clean":"2023-11-26T07:21:42.879668+0000","last_became_active":"2023-11-26T07:21:42.869948+0000","last_became_peered":"2023-11-26T07:21:42.869948+0000","last_unstale":"2023-11-26T07:21:42.879668+0000","last_undegraded":"2023-11-26T07:21:42.879668+0000","last_fullsized":"2023-11-26T07:21:42.879668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:45:11.939133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.829226+0000","last_change":"2023-11-26T07:21:41.829637+0000","last_active":"2023-11-26T07:21:42.829226+0000","last_peered":"2023-11-26T07:21:42.829226+0000","last_clean":"2023-11-26T07:21:42.829226+0000","last_became_active":"2023-11-26T07:21:41.829278+0000","last_became_peered":"2023-11-26T07:21:41.829278+0000","last_unstale":"2023-11-26T07:21:42.829226+0000","last_undegraded":"2023-11-26T07:21:42.829226+0000","last_fullsized":"2023-11-26T07:21:42.829226+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:53:08.653498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.850578+0000","last_change":"2023-11-26T07:21:42.843950+0000","last_active":"2023-11-26T07:21:42.850578+0000","last_peered":"2023-11-26T07:21:42.850578+0000","last_clean":"2023-11-26T07:21:42.850578+0000","last_became_active":"2023-11-26T07:21:42.843660+0000","last_became_peered":"2023-11-26T07:21:42.843660+0000","last_unstale":"2023-11-26T07:21:42.850578+0000","last_undegraded":"2023-11-26T07:21:42.850578+0000","last_fullsized":"2023-11-26T07:21:42.850578+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:54:00.540700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.864094+0000","last_change":"2023-11-26T07:21:41.827003+0000","last_active":"2023-11-26T07:21:42.864094+0000","last_peered":"2023-11-26T07:21:42.864094+0000","last_clean":"2023-11-26T07:21:42.864094+0000","last_became_active":"2023-11-26T07:21:41.826717+0000","last_became_peered":"2023-11-26T07:21:41.826717+0000","last_unstale":"2023-11-26T07:21:42.864094+0000","last_undegraded":"2023-11-26T07:21:42.864094+0000","last_fullsized":"2023-11-26T07:21:42.864094+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:34:06.341153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.863033+0000","last_change":"2023-11-26T07:21:42.859687+0000","last_active":"2023-11-26T07:21:42.863033+0000","last_peered":"2023-11-26T07:21:42.863033+0000","last_clean":"2023-11-26T07:21:42.863033+0000","last_became_active":"2023-11-26T07:21:42.855015+0000","last_became_peered":"2023-11-26T07:21:42.855015+0000","last_unstale":"2023-11-26T07:21:42.863033+0000","last_undegraded":"2023-11-26T07:21:42.863033+0000","last_fullsized":"2023-11-26T07:21:42.863033+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:01:26.683873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.829990+0000","last_change":"2023-11-26T07:21:41.823392+0000","last_active":"2023-11-26T07:21:42.829990+0000","last_peered":"2023-11-26T07:21:42.829990+0000","last_clean":"2023-11-26T07:21:42.829990+0000","last_became_active":"2023-11-26T07:21:41.823086+0000","last_became_peered":"2023-11-26T07:21:41.823086+0000","last_unstale":"2023-11-26T07:21:42.829990+0000","last_undegraded":"2023-11-26T07:21:42.829990+0000","last_fullsized":"2023-11-26T07:21:42.829990+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:55.527886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.871022+0000","last_change":"2023-11-26T07:21:42.870100+0000","last_active":"2023-11-26T07:21:42.871022+0000","last_peered":"2023-11-26T07:21:42.871022+0000","last_clean":"2023-11-26T07:21:42.871022+0000","last_became_active":"2023-11-26T07:21:42.869640+0000","last_became_peered":"2023-11-26T07:21:42.869640+0000","last_unstale":"2023-11-26T07:21:42.871022+0000","last_undegraded":"2023-11-26T07:21:42.871022+0000","last_fullsized":"2023-11-26T07:21:42.871022+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:04.314308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.830449+0000","last_change":"2023-11-26T07:21:41.823483+0000","last_active":"2023-11-26T07:21:42.830449+0000","last_peered":"2023-11-26T07:21:42.830449+0000","last_clean":"2023-11-26T07:21:42.830449+0000","last_became_active":"2023-11-26T07:21:41.823114+0000","last_became_peered":"2023-11-26T07:21:41.823114+0000","last_unstale":"2023-11-26T07:21:42.830449+0000","last_undegraded":"2023-11-26T07:21:42.830449+0000","last_fullsized":"2023-11-26T07:21:42.830449+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:55:06.596538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.850429+0000","last_change":"2023-11-26T07:21:42.841163+0000","last_active":"2023-11-26T07:21:42.850429+0000","last_peered":"2023-11-26T07:21:42.850429+0000","last_clean":"2023-11-26T07:21:42.850429+0000","last_became_active":"2023-11-26T07:21:42.840319+0000","last_became_peered":"2023-11-26T07:21:42.840319+0000","last_unstale":"2023-11-26T07:21:42.850429+0000","last_undegraded":"2023-11-26T07:21:42.850429+0000","last_fullsized":"2023-11-26T07:21:42.850429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:38.268625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.863461+0000","last_change":"2023-11-26T07:21:41.824849+0000","last_active":"2023-11-26T07:21:42.863461+0000","last_peered":"2023-11-26T07:21:42.863461+0000","last_clean":"2023-11-26T07:21:42.863461+0000","last_became_active":"2023-11-26T07:21:41.824558+0000","last_became_peered":"2023-11-26T07:21:41.824558+0000","last_unstale":"2023-11-26T07:21:42.863461+0000","last_undegraded":"2023-11-26T07:21:42.863461+0000","last_fullsized":"2023-11-26T07:21:42.863461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:52.704936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.874341+0000","last_change":"2023-11-26T07:21:42.866069+0000","last_active":"2023-11-26T07:21:42.874341+0000","last_peered":"2023-11-26T07:21:42.874341+0000","last_clean":"2023-11-26T07:21:42.874341+0000","last_became_active":"2023-11-26T07:21:42.865771+0000","last_became_peered":"2023-11-26T07:21:42.865771+0000","last_unstale":"2023-11-26T07:21:42.874341+0000","last_undegraded":"2023-11-26T07:21:42.874341+0000","last_fullsized":"2023-11-26T07:21:42.874341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:01:26.683873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.828402+0000","last_change":"2023-11-26T07:21:41.835139+0000","last_active":"2023-11-26T07:21:42.828402+0000","last_peered":"2023-11-26T07:21:42.828402+0000","last_clean":"2023-11-26T07:21:42.828402+0000","last_became_active":"2023-11-26T07:21:41.834926+0000","last_became_peered":"2023-11-26T07:21:41.834926+0000","last_unstale":"2023-11-26T07:21:42.828402+0000","last_undegraded":"2023-11-26T07:21:42.828402+0000","last_fullsized":"2023-11-26T07:21:42.828402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:28:24.284916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.857049+0000","last_change":"2023-11-26T07:21:42.850327+0000","last_active":"2023-11-26T07:21:42.857049+0000","last_peered":"2023-11-26T07:21:42.857049+0000","last_clean":"2023-11-26T07:21:42.857049+0000","last_became_active":"2023-11-26T07:21:42.850059+0000","last_became_peered":"2023-11-26T07:21:42.850059+0000","last_unstale":"2023-11-26T07:21:42.857049+0000","last_undegraded":"2023-11-26T07:21:42.857049+0000","last_fullsized":"2023-11-26T07:21:42.857049+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:20.106348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.846774+0000","last_change":"2023-11-26T07:21:41.835430+0000","last_active":"2023-11-26T07:21:42.846774+0000","last_peered":"2023-11-26T07:21:42.846774+0000","last_clean":"2023-11-26T07:21:42.846774+0000","last_became_active":"2023-11-26T07:21:41.835023+0000","last_became_peered":"2023-11-26T07:21:41.835023+0000","last_unstale":"2023-11-26T07:21:42.846774+0000","last_undegraded":"2023-11-26T07:21:42.846774+0000","last_fullsized":"2023-11-26T07:21:42.846774+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:59:19.095970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.854756+0000","last_change":"2023-11-26T07:21:42.843016+0000","last_active":"2023-11-26T07:21:42.854756+0000","last_peered":"2023-11-26T07:21:42.854756+0000","last_clean":"2023-11-26T07:21:42.854756+0000","last_became_active":"2023-11-26T07:21:42.842754+0000","last_became_peered":"2023-11-26T07:21:42.842754+0000","last_unstale":"2023-11-26T07:21:42.854756+0000","last_undegraded":"2023-11-26T07:21:42.854756+0000","last_fullsized":"2023-11-26T07:21:42.854756+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:00:26.324681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.832725+0000","last_change":"2023-11-26T07:21:41.830771+0000","last_active":"2023-11-26T07:21:42.832725+0000","last_peered":"2023-11-26T07:21:42.832725+0000","last_clean":"2023-11-26T07:21:42.832725+0000","last_became_active":"2023-11-26T07:21:41.828792+0000","last_became_peered":"2023-11-26T07:21:41.828792+0000","last_unstale":"2023-11-26T07:21:42.832725+0000","last_undegraded":"2023-11-26T07:21:42.832725+0000","last_fullsized":"2023-11-26T07:21:42.832725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:34.217996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.858882+0000","last_change":"2023-11-26T07:21:42.844361+0000","last_active":"2023-11-26T07:21:42.858882+0000","last_peered":"2023-11-26T07:21:42.858882+0000","last_clean":"2023-11-26T07:21:42.858882+0000","last_became_active":"2023-11-26T07:21:42.844029+0000","last_became_peered":"2023-11-26T07:21:42.844029+0000","last_unstale":"2023-11-26T07:21:42.858882+0000","last_undegraded":"2023-11-26T07:21:42.858882+0000","last_fullsized":"2023-11-26T07:21:42.858882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:01:45.714969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.830023+0000","last_change":"2023-11-26T07:21:41.831016+0000","last_active":"2023-11-26T07:21:42.830023+0000","last_peered":"2023-11-26T07:21:42.830023+0000","last_clean":"2023-11-26T07:21:42.830023+0000","last_became_active":"2023-11-26T07:21:41.830708+0000","last_became_peered":"2023-11-26T07:21:41.830708+0000","last_unstale":"2023-11-26T07:21:42.830023+0000","last_undegraded":"2023-11-26T07:21:42.830023+0000","last_fullsized":"2023-11-26T07:21:42.830023+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:47:14.737463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.879790+0000","last_change":"2023-11-26T07:21:42.870837+0000","last_active":"2023-11-26T07:21:42.879790+0000","last_peered":"2023-11-26T07:21:42.879790+0000","last_clean":"2023-11-26T07:21:42.879790+0000","last_became_active":"2023-11-26T07:21:42.870310+0000","last_became_peered":"2023-11-26T07:21:42.870310+0000","last_unstale":"2023-11-26T07:21:42.879790+0000","last_undegraded":"2023-11-26T07:21:42.879790+0000","last_fullsized":"2023-11-26T07:21:42.879790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:05:36.084405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.842083+0000","last_change":"2023-11-26T07:21:41.832658+0000","last_active":"2023-11-26T07:21:42.842083+0000","last_peered":"2023-11-26T07:21:42.842083+0000","last_clean":"2023-11-26T07:21:42.842083+0000","last_became_active":"2023-11-26T07:21:41.832339+0000","last_became_peered":"2023-11-26T07:21:41.832339+0000","last_unstale":"2023-11-26T07:21:42.842083+0000","last_undegraded":"2023-11-26T07:21:42.842083+0000","last_fullsized":"2023-11-26T07:21:42.842083+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:08:07.539428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.857951+0000","last_change":"2023-11-26T07:21:42.854893+0000","last_active":"2023-11-26T07:21:42.857951+0000","last_peered":"2023-11-26T07:21:42.857951+0000","last_clean":"2023-11-26T07:21:42.857951+0000","last_became_active":"2023-11-26T07:21:42.854633+0000","last_became_peered":"2023-11-26T07:21:42.854633+0000","last_unstale":"2023-11-26T07:21:42.857951+0000","last_undegraded":"2023-11-26T07:21:42.857951+0000","last_fullsized":"2023-11-26T07:21:42.857951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:37:17.608463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.830446+0000","last_change":"2023-11-26T07:21:41.826533+0000","last_active":"2023-11-26T07:21:42.830446+0000","last_peered":"2023-11-26T07:21:42.830446+0000","last_clean":"2023-11-26T07:21:42.830446+0000","last_became_active":"2023-11-26T07:21:41.825848+0000","last_became_peered":"2023-11-26T07:21:41.825848+0000","last_unstale":"2023-11-26T07:21:42.830446+0000","last_undegraded":"2023-11-26T07:21:42.830446+0000","last_fullsized":"2023-11-26T07:21:42.830446+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:25:50.183678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.862398+0000","last_change":"2023-11-26T07:21:42.856935+0000","last_active":"2023-11-26T07:21:42.862398+0000","last_peered":"2023-11-26T07:21:42.862398+0000","last_clean":"2023-11-26T07:21:42.862398+0000","last_became_active":"2023-11-26T07:21:42.855857+0000","last_became_peered":"2023-11-26T07:21:42.855857+0000","last_unstale":"2023-11-26T07:21:42.862398+0000","last_undegraded":"2023-11-26T07:21:42.862398+0000","last_fullsized":"2023-11-26T07:21:42.862398+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:00:26.324681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.830920+0000","last_change":"2023-11-26T07:21:41.816053+0000","last_active":"2023-11-26T07:21:42.830920+0000","last_peered":"2023-11-26T07:21:42.830920+0000","last_clean":"2023-11-26T07:21:42.830920+0000","last_became_active":"2023-11-26T07:21:41.815631+0000","last_became_peered":"2023-11-26T07:21:41.815631+0000","last_unstale":"2023-11-26T07:21:42.830920+0000","last_undegraded":"2023-11-26T07:21:42.830920+0000","last_fullsized":"2023-11-26T07:21:42.830920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:54:40.150080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.857247+0000","last_change":"2023-11-26T07:21:42.842814+0000","last_active":"2023-11-26T07:21:42.857247+0000","last_peered":"2023-11-26T07:21:42.857247+0000","last_clean":"2023-11-26T07:21:42.857247+0000","last_became_active":"2023-11-26T07:21:42.842553+0000","last_became_peered":"2023-11-26T07:21:42.842553+0000","last_unstale":"2023-11-26T07:21:42.857247+0000","last_undegraded":"2023-11-26T07:21:42.857247+0000","last_fullsized":"2023-11-26T07:21:42.857247+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:41.793524+0000","last_clean_scrub_stamp":"2023-11-26T07:21:41.793524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:10:57.745126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-26T07:21:42.845847+0000","last_change":"2023-11-26T07:21:41.832035+0000","last_active":"2023-11-26T07:21:42.845847+0000","last_peered":"2023-11-26T07:21:42.845847+0000","last_clean":"2023-11-26T07:21:42.845847+0000","last_became_active":"2023-11-26T07:21:41.831745+0000","last_became_peered":"2023-11-26T07:21:41.831745+0000","last_unstale":"2023-11-26T07:21:42.845847+0000","last_undegraded":"2023-11-26T07:21:42.845847+0000","last_fullsized":"2023-11-26T07:21:42.845847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:40.783146+0000","last_clean_scrub_stamp":"2023-11-26T07:21:40.783146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:11:27.809794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:21:41.831019+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:21:41.831019+0000","last_peered":"2023-11-26T07:21:41.831019+0000","last_clean":"2023-11-26T07:21:41.831019+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:21:41.831019+0000","last_undegraded":"2023-11-26T07:21:41.831019+0000","last_fullsized":"2023-11-26T07:21:41.831019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1335296,"data_stored":899473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0609999999999999,"15min":1.0369999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6100000000000001,"5min":1.768,"15min":1.768},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.075,"15min":1.069},"min":{"1min":0.63400000000000001,"5min":0.627,"15min":0.627},"max":{"1min":1.5029999999999999,"5min":2.298,"15min":2.298},"last":0.79500000000000004}]},{"osd":1,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0660000000000001,"15min":1.052},"min":{"1min":0.70099999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.373},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1870000000000001,"15min":1.214},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5740000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.95499999999999996}]},{"osd":2,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.206,"15min":1.1699999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.552,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.214,"15min":1.276},"min":{"1min":0.83899999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.464,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.1850000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.214,"15min":1.2350000000000001},"min":{"1min":0.93200000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5049999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.042},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3560000000000001,"15min":1.363},"min":{"1min":1.02,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6579999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.87}]},{"osd":4,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.321,"15min":1.349},"min":{"1min":0.80000000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5189999999999999,"5min":2.774,"15min":2.774},"last":1.302},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.454,"15min":1.462},"min":{"1min":0.91800000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.8380000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.472}]},{"osd":5,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.466,"15min":1.4930000000000001},"min":{"1min":0.97499999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.7010000000000001,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.425},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.429,"15min":1.468},"min":{"1min":0.91700000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6830000000000001,"5min":2.149,"15min":2.149},"last":1.2589999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:21:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.6120000000000001,"15min":1.6679999999999999},"min":{"1min":1.1950000000000001,"5min":0.75,"15min":0.75},"max":{"1min":1.796,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.522},{"interface":"front","average":{"1min":1.488,"5min":1.6020000000000001,"15min":1.6359999999999999},"min":{"1min":1.125,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.8919999999999999,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.5389999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":308945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0960000000000001,"15min":1.115},"min":{"1min":0.61799999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4419999999999999,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":1.663},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.198,"15min":1.2649999999999999},"min":{"1min":0.69499999999999995,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.4279999999999999,"5min":3.169,"15min":3.169},"last":1.306}]},{"osd":1,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.173,"15min":1.1819999999999999},"min":{"1min":0.73799999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.841,"5min":1.929,"15min":1.929},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.175,"15min":1.139},"min":{"1min":0.79500000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.754}]},{"osd":2,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.117,"15min":1.1200000000000001},"min":{"1min":0.79100000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.71},{"interface":"front","average":{"1min":1.274,"5min":1.298,"15min":1.3660000000000001},"min":{"1min":0.84499999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6850000000000001,"5min":3.1110000000000002,"15min":3.1110000000000002},"last":1.518}]},{"osd":3,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.292,"15min":1.276},"min":{"1min":0.89500000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":4.0970000000000004,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.242,"15min":1.254},"min":{"1min":0.90900000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.367}]},{"osd":4,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.369,"15min":1.369},"min":{"1min":0.69799999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":4.6539999999999999,"5min":4.6539999999999999,"15min":4.6539999999999999},"last":1.8380000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.395,"15min":1.3759999999999999},"min":{"1min":0.86399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.2990000000000004,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":1.8839999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.3899999999999999,"15min":1.403},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8779999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.615},{"interface":"front","average":{"1min":1.675,"5min":1.5329999999999999,"15min":1.536},"min":{"1min":0.80300000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":1.984}]},{"osd":7,"last update":"Sun Nov 26 07:21:30 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.5429999999999999,"15min":1.5449999999999999},"min":{"1min":1.0449999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.202,"5min":4.202,"15min":4.202},"last":1.95},{"interface":"front","average":{"1min":1.587,"5min":1.5549999999999999,"15min":1.5660000000000001},"min":{"1min":0.77800000000000002,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.7989999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":309597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.0660000000000001,"15min":1.028},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.109,"15min":1.032},"min":{"1min":0.76100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.8799999999999999,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.1220000000000001,"15min":1.073},"min":{"1min":0.79100000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.6989999999999998,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.417,"5min":1.204,"15min":1.179},"min":{"1min":0.93300000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":4.7859999999999996,"5min":4.7859999999999996,"15min":4.7859999999999996},"last":0.56699999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.087,"15min":1.0509999999999999},"min":{"1min":0.77800000000000002,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.385,"5min":1.2869999999999999,"15min":1.2989999999999999},"min":{"1min":0.88900000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.77,"5min":3.77,"15min":3.77},"last":0.46200000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.3169999999999999,"15min":1.3149999999999999},"min":{"1min":0.97199999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.8360000000000003,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.248,"15min":1.2110000000000001},"min":{"1min":0.84899999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":0.63100000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.431,"15min":1.4610000000000001},"min":{"1min":0.89500000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":3.835,"5min":3.835,"15min":3.835},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.4550000000000001,"15min":1.4690000000000001},"min":{"1min":1.014,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":4.9219999999999997,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":0.64600000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.5429999999999999,"15min":1.5529999999999999},"min":{"1min":1.0880000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.8980000000000001,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.4610000000000001,"15min":1.4670000000000001},"min":{"1min":0.96199999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.42899999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":1.601,"15min":1.613},"min":{"1min":1.1819999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.675,"5min":1.5980000000000001,"15min":1.6100000000000001},"min":{"1min":1.1879999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":4.1970000000000001,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":308945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0680000000000001,"15min":1.129},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.502,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.0660000000000001,"15min":1.018},"min":{"1min":0.69899999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1970000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.1779999999999999,"15min":1.177},"min":{"1min":0.81000000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7509999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.375},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.2589999999999999,"15min":1.246},"min":{"1min":0.85199999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.97599999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.264,"15min":1.286},"min":{"1min":0.79400000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.964,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.244,"15min":1.282},"min":{"1min":0.83099999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5269999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1439999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.331,"15min":1.3260000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.2010000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.506},{"interface":"front","average":{"1min":1.383,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.94599999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5429999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.90200000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.095},{"interface":"front","average":{"1min":1.532,"5min":1.506,"15min":1.5129999999999999},"min":{"1min":1.0089999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.3319999999999999,"5min":2.899,"15min":2.899},"last":1.24}]},{"osd":6,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.4890000000000001,"15min":1.5069999999999999},"min":{"1min":0.996,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.0110000000000001,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.649},{"interface":"front","average":{"1min":1.623,"5min":1.6279999999999999,"15min":1.645},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":2.4239999999999999,"5min":3.008,"15min":3.008},"last":1.595}]},{"osd":7,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.7110000000000001,"15min":1.7529999999999999},"min":{"1min":1.3640000000000001,"5min":1.214,"15min":1.214},"max":{"1min":2.4460000000000002,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.734},{"interface":"front","average":{"1min":1.627,"5min":1.6839999999999999,"15min":1.712},"min":{"1min":1.256,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":2.2290000000000001,"5min":3.085,"15min":3.085},"last":1.304}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":741376,"data_stored":309001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.82499999999999996,"15min":0.86099999999999999},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":1.097,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.90700000000000003,"15min":0.90900000000000003},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.238,"5min":1.764,"15min":1.764},"last":1.0600000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80900000000000005,"15min":0.84799999999999998},"min":{"1min":0.39500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":1.036,"5min":1.784,"15min":1.784},"last":1.145},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.92600000000000005,"15min":0.999},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2809999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.1100000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0409999999999999,"15min":1.077},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3640000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.627},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0940000000000001,"15min":1.119},"min":{"1min":0.622,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.492,"5min":2.379,"15min":2.379},"last":1.526}]},{"osd":4,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.121,"15min":1.1339999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.526,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.206},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.262,"15min":1.343},"min":{"1min":0.77500000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.766,"5min":2.859,"15min":2.859},"last":1.4890000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.288,"15min":1.357},"min":{"1min":0.80500000000000005,"5min":0.752,"15min":0.752},"max":{"1min":1.9350000000000001,"5min":2.504,"15min":2.504},"last":1.419},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2210000000000001,"15min":1.2529999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.577,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.4550000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.3440000000000001,"15min":1.4379999999999999},"min":{"1min":0.81699999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.899,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.27},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3580000000000001,"15min":1.4339999999999999},"min":{"1min":0.80200000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.877,"5min":3.226,"15min":3.226},"last":1.5860000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2709999999999999,"15min":1.2929999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.129,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.393},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4279999999999999,"15min":1.506},"min":{"1min":0.85899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.089,"5min":3.956,"15min":3.956},"last":1.996}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":309001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.874,"15min":0.96399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.244,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":1.071},"min":{"1min":0.54200000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.504,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.89200000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.86699999999999999,"15min":0.96299999999999997},"min":{"1min":0.41299999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0880000000000001,"5min":1.645,"15min":1.645},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.96499999999999997,"15min":1.0309999999999999},"min":{"1min":0.51900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.383,"5min":1.901,"15min":1.901},"last":1.042}]},{"osd":3,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.97299999999999998,"15min":1.0600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4399999999999999,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.1519999999999999,"15min":1.24},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6200000000000001,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.0940000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2290000000000001,"15min":1.278},"min":{"1min":0.86499999999999999,"5min":0.754,"15min":0.754},"max":{"1min":1.474,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2410000000000001,"15min":1.292},"min":{"1min":0.81399999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7809999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.1439999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1890000000000001,"15min":1.2450000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3120000000000001,"5min":1.901,"15min":1.901},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.29,"15min":1.3819999999999999},"min":{"1min":0.84099999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.546,"5min":2.395,"15min":2.395},"last":1.23}]},{"osd":6,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3999999999999999,"15min":1.4550000000000001},"min":{"1min":0.879,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9330000000000001,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.268},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.3069999999999999,"15min":1.3440000000000001},"min":{"1min":0.76700000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8009999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.95399999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:21:32 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4259999999999999,"15min":1.492},"min":{"1min":0.81200000000000006,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.069,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.365},{"interface":"front","average":{"1min":1.262,"5min":1.3899999999999999,"15min":1.431},"min":{"1min":0.95399999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.694,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.86599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":737280,"data_stored":309035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.77300000000000002,"15min":0.81299999999999994},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90200000000000002,"5min":1.589,"15min":1.589},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.91600000000000004,"15min":0.96099999999999997},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4359999999999999,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.95399999999999996}]},{"osd":2,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85699999999999998,"15min":0.871},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.96099999999999997,"15min":0.995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2230000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.0109999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":1.077},"min":{"1min":0.51500000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3859999999999999,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":1.0109999999999999,"15min":1.0569999999999999},"min":{"1min":0.51400000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":2.319,"15min":2.319},"last":1.083}]},{"osd":4,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.2050000000000001,"15min":1.2410000000000001},"min":{"1min":0.80500000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.7210000000000001,"5min":2.294,"15min":2.294},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.2030000000000001,"15min":1.2569999999999999},"min":{"1min":0.70899999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3520000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.871}]},{"osd":5,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2969999999999999,"15min":1.369},"min":{"1min":0.82099999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.569,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3640000000000001,"15min":1.3819999999999999},"min":{"1min":1.042,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.607,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.2170000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.327,"15min":1.381},"min":{"1min":0.83599999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5900000000000001,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.3029999999999999,"15min":1.355},"min":{"1min":0.79500000000000004,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4450000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.1870000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.3460000000000001,"15min":1.3720000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.5720000000000001,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.417,"15min":1.4970000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.657,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.5660000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1343488,"data_stored":901507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0880000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":2.3079999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.82999999999999996,"15min":0.88200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2989999999999999,"5min":1.448,"15min":1.448},"last":1.593}]},{"osd":2,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.88,"15min":0.94399999999999995},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2769999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":2.3620000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.94499999999999995,"15min":1.0049999999999999},"min":{"1min":0.5,"5min":0.432,"15min":0.432},"max":{"1min":1.3620000000000001,"5min":1.641,"15min":1.641},"last":1.472}]},{"osd":3,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.97199999999999998,"15min":0.94299999999999995},"min":{"1min":0.52100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.698,"5min":9.4939999999999998,"15min":9.4939999999999998},"last":3.2360000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.0640000000000001,"15min":1.1339999999999999},"min":{"1min":0.67400000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.55,"5min":2.137,"15min":2.137},"last":2.7290000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":0.78500000000000003,"5min":0.753,"15min":0.753},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":4.9290000000000003},{"interface":"front","average":{"1min":1.169,"5min":1.3029999999999999,"15min":1.2549999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5960000000000001,"5min":9.7240000000000002,"15min":9.7240000000000002},"last":2.5649999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.2989999999999999,"15min":1.282},"min":{"1min":0.70699999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.532,"5min":9.6039999999999992,"15min":9.6039999999999992},"last":1.8260000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.343,"15min":1.3759999999999999},"min":{"1min":0.91400000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.7450000000000001,"5min":2.202,"15min":2.202},"last":2.5310000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.3460000000000001,"15min":1.3939999999999999},"min":{"1min":0.79700000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.8069999999999999,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":2.4390000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.282,"15min":1.3500000000000001},"min":{"1min":0.82099999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.766,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.974}]},{"osd":7,"last update":"Sun Nov 26 07:21:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3400000000000001,"15min":1.415},"min":{"1min":0.84399999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.859,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":4.9870000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.3540000000000001,"15min":1.3460000000000001},"min":{"1min":0.753,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.71,"5min":9.9320000000000004,"15min":9.9320000000000004},"last":1.7190000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:21:47.735 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:21:47.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:21:47.775 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-26T07:21:47.772+0000 7fe53d2b8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:21:47.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.953+0000 7f79d96c9640 1 Processor -- start 2023-11-26T07:21:47.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.953+0000 7f79d96c9640 1 -- start start 2023-11-26T07:21:47.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.955+0000 7f79d96c9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f79d4072160 0x7f79d415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.955+0000 7f79d96c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f79d40c49f0 0x7f79d406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.955+0000 7f79d96c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79d406dc40 0x7f79d40cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.955+0000 7f79d96c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d406e0d0 con 0x7f79d40c49f0 2023-11-26T07:21:47.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.955+0000 7f79d96c9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d415ec90 con 0x7f79d4072160 2023-11-26T07:21:47.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.955+0000 7f79d96c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d40cd530 con 0x7f79d406dc40 2023-11-26T07:21:47.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.955+0000 7f79ca7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f79d40c49f0 0x7f79d406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.955+0000 7f79ca7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f79d40c49f0 0x7f79d406d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35818/0 (socket says 172.21.15.77:35818) 2023-11-26T07:21:47.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.955+0000 7f79ca7fc640 1 -- 172.21.15.77:0/1568665066 learned_addr learned my addr 172.21.15.77:0/1568665066 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:47.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.956+0000 7f79d37fe640 1 --2- 172.21.15.77:0/1568665066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79d406dc40 0x7f79d40cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.956+0000 7f79d2ffd640 1 --2- 172.21.15.77:0/1568665066 >> v2:172.21.15.159:3300/0 conn(0x7f79d4072160 0x7f79d415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.956+0000 7f79ca7fc640 1 -- 172.21.15.77:0/1568665066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79d406dc40 msgr2=0x7f79d40cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.956+0000 7f79ca7fc640 1 --2- 172.21.15.77:0/1568665066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79d406dc40 0x7f79d40cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.956+0000 7f79ca7fc640 1 -- 172.21.15.77:0/1568665066 >> v2:172.21.15.159:3300/0 conn(0x7f79d4072160 msgr2=0x7f79d415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.956+0000 7f79ca7fc640 1 --2- 172.21.15.77:0/1568665066 >> v2:172.21.15.159:3300/0 conn(0x7f79d4072160 0x7f79d415e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.956+0000 7f79ca7fc640 1 -- 172.21.15.77:0/1568665066 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d40c4ed0 con 0x7f79d40c49f0 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.956+0000 7f79d37fe640 1 --2- 172.21.15.77:0/1568665066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79d406dc40 0x7f79d40cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.956+0000 7f79d2ffd640 1 --2- 172.21.15.77:0/1568665066 >> v2:172.21.15.159:3300/0 conn(0x7f79d4072160 0x7f79d415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.957+0000 7f79ca7fc640 1 --2- 172.21.15.77:0/1568665066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40c49f0 0x7f79d406d700 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f79d40ccae0 tx=0x7f79bc02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab7c37ec229e35d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.957+0000 7f79d27fc640 1 -- 172.21.15.77:0/1568665066 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc031880 con 0x7f79d40c49f0 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.957+0000 7f79d27fc640 1 -- 172.21.15.77:0/1568665066 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc0319e0 con 0x7f79d40c49f0 2023-11-26T07:21:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.957+0000 7f79d27fc640 1 -- 172.21.15.77:0/1568665066 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc031d70 con 0x7f79d40c49f0 2023-11-26T07:21:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.958+0000 7f79d96c9640 1 -- 172.21.15.77:0/1568665066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40c49f0 msgr2=0x7f79d406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.958+0000 7f79d96c9640 1 --2- 172.21.15.77:0/1568665066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40c49f0 0x7f79d406d700 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f79d40ccae0 tx=0x7f79bc02b920 comp rx=0 tx=0).stop 2023-11-26T07:21:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.958+0000 7f79d96c9640 1 -- 172.21.15.77:0/1568665066 shutdown_connections 2023-11-26T07:21:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.958+0000 7f79d96c9640 1 --2- 172.21.15.77:0/1568665066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79d406dc40 0x7f79d40cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.958+0000 7f79d96c9640 1 --2- 172.21.15.77:0/1568665066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40c49f0 0x7f79d406d700 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.958+0000 7f79d96c9640 1 --2- 172.21.15.77:0/1568665066 >> v2:172.21.15.159:3300/0 conn(0x7f79d4072160 0x7f79d415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.958+0000 7f79d96c9640 1 -- 172.21.15.77:0/1568665066 >> 172.21.15.77:0/1568665066 conn(0x7f79d40b0c50 msgr2=0x7f79d40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.958+0000 7f79d96c9640 1 -- 172.21.15.77:0/1568665066 shutdown_connections 2023-11-26T07:21:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.958+0000 7f79d96c9640 1 -- 172.21.15.77:0/1568665066 wait complete. 2023-11-26T07:21:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.959+0000 7f79d96c9640 1 Processor -- start 2023-11-26T07:21:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.960+0000 7f79d96c9640 1 -- start start 2023-11-26T07:21:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.960+0000 7f79d96c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79d406dc40 0x7f79d40999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.960+0000 7f79d96c9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d4072160 0x7f79d40af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d96c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40c49f0 0x7f79d40b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d96c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d40af1e0 con 0x7f79d40c49f0 2023-11-26T07:21:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d96c9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d409a900 con 0x7f79d4072160 2023-11-26T07:21:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d96c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d409a060 con 0x7f79d406dc40 2023-11-26T07:21:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40c49f0 0x7f79d40b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40c49f0 0x7f79d40b47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35826/0 (socket says 172.21.15.77:35826) 2023-11-26T07:21:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d37fe640 1 -- 172.21.15.77:0/2813473575 learned_addr learned my addr 172.21.15.77:0/2813473575 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:47.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d37fe640 1 -- 172.21.15.77:0/2813473575 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79d406dc40 msgr2=0x7f79d40999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d37fe640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79d406dc40 0x7f79d40999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d37fe640 1 -- 172.21.15.77:0/2813473575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d4072160 msgr2=0x7f79d40af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:47.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d37fe640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d4072160 0x7f79d40af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:47.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.961+0000 7f79d37fe640 1 -- 172.21.15.77:0/2813473575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc0094d0 con 0x7f79d40c49f0 2023-11-26T07:21:47.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.962+0000 7f79d37fe640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40c49f0 0x7f79d40b47f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00c7f0 tx=0x7f79cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:47.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.962+0000 7f79cbfff640 1 -- 172.21.15.77:0/2813473575 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc007820 con 0x7f79d40c49f0 2023-11-26T07:21:47.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.962+0000 7f79cbfff640 1 -- 172.21.15.77:0/2813473575 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc007980 con 0x7f79d40c49f0 2023-11-26T07:21:47.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.962+0000 7f79cbfff640 1 -- 172.21.15.77:0/2813473575 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc007d30 con 0x7f79d40c49f0 2023-11-26T07:21:47.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.962+0000 7f79d96c9640 1 -- 172.21.15.77:0/2813473575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d409a340 con 0x7f79d40c49f0 2023-11-26T07:21:47.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.962+0000 7f79d96c9640 1 -- 172.21.15.77:0/2813473575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d415af30 con 0x7f79d40c49f0 2023-11-26T07:21:47.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.963+0000 7f79d96c9640 1 -- 172.21.15.77:0/2813473575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d404e8b0 con 0x7f79d40c49f0 2023-11-26T07:21:47.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.964+0000 7f79cbfff640 1 -- 172.21.15.77:0/2813473575 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f79cc0113f0 con 0x7f79d40c49f0 2023-11-26T07:21:47.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.965+0000 7f79cbfff640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79b406b3e0 0x7f79b406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:47.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.965+0000 7f79cbfff640 1 -- 172.21.15.77:0/2813473575 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79cc08a500 con 0x7f79d40c49f0 2023-11-26T07:21:47.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.965+0000 7f79d2ffd640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79b406b3e0 0x7f79b406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:47.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.966+0000 7f79d2ffd640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79b406b3e0 0x7f79b406d8a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f79c4008ea0 tx=0x7f79c40083d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:47.969+0000 7f79cbfff640 1 -- 172.21.15.77:0/2813473575 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79cc054cb0 con 0x7f79d40c49f0 2023-11-26T07:21:48.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.227+0000 7f79d96c9640 1 -- 172.21.15.77:0/2813473575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f79d415b120 con 0x7f79d40c49f0 2023-11-26T07:21:48.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.232+0000 7f79cbfff640 1 -- 172.21.15.77:0/2813473575 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f79cc0582d0 con 0x7f79d40c49f0 2023-11-26T07:21:48.235 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-11-26T07:21:48.235 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDN8GJlhqOIKxAAiafAbVhNu4B+yTd/1i7+1A== 2023-11-26T07:21:48.235 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2023-11-26T07:21:48.235 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2023-11-26T07:21:48.235 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:21:48.235 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2023-11-26T07:21:48.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 -- 172.21.15.77:0/2813473575 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79b406b3e0 msgr2=0x7f79b406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79b406b3e0 0x7f79b406d8a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f79c4008ea0 tx=0x7f79c40083d0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 -- 172.21.15.77:0/2813473575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40c49f0 msgr2=0x7f79d40b47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40c49f0 0x7f79d40b47f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00c7f0 tx=0x7f79cc00ccb0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 -- 172.21.15.77:0/2813473575 shutdown_connections 2023-11-26T07:21:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79b406b3e0 0x7f79b406d8a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40c49f0 0x7f79d40b47f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d4072160 0x7f79d40af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 --2- 172.21.15.77:0/2813473575 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79d406dc40 0x7f79d40999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 -- 172.21.15.77:0/2813473575 >> 172.21.15.77:0/2813473575 conn(0x7f79d40b0c50 msgr2=0x7f79d40cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 -- 172.21.15.77:0/2813473575 shutdown_connections 2023-11-26T07:21:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.235+0000 7f79d96c9640 1 -- 172.21.15.77:0/2813473575 wait complete. 2023-11-26T07:21:48.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.513+0000 7fda3ec94640 1 Processor -- start 2023-11-26T07:21:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.513+0000 7fda3ec94640 1 -- start start 2023-11-26T07:21:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.515+0000 7fda3ec94640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda3815e390 0x7fda38161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.515+0000 7fda3ec94640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda380ce0b0 con 0x7fda38157c70 2023-11-26T07:21:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.515+0000 7fda3ec94640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda38161960 con 0x7fda380cfb60 2023-11-26T07:21:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.515+0000 7fda3ec94640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3815e8d0 con 0x7fda3815e390 2023-11-26T07:21:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.515+0000 7fda3ca30640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fda38157c70 0x7fda380cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58062/0 (socket says 172.21.15.77:58062) 2023-11-26T07:21:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.515+0000 7fda3ca30640 1 -- 172.21.15.77:0/3891229509 learned_addr learned my addr 172.21.15.77:0/3891229509 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:48.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.515+0000 7fda3d231640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda3815e390 0x7fda38161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:48.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.515+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683655954 0 0) 0x7fda380ce0b0 con 0x7fda38157c70 2023-11-26T07:21:48.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda28003520 con 0x7fda38157c70 2023-11-26T07:21:48.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2394903776 0 0) 0x7fda28003520 con 0x7fda38157c70 2023-11-26T07:21:48.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda3815e390 msgr2=0x7fda38161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda3815e390 0x7fda38161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 >> v1:172.21.15.159:6789/0 conn(0x7fda380cfb60 legacy=0x7fda3815dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3815ebb0 con 0x7fda38157c70 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fda2c001670 con 0x7fda38157c70 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 >> v1:172.21.15.77:6789/0 conn(0x7fda38157c70 legacy=0x7fda380cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda3815e390 0x7fda280039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda28003f20 0x7fda280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda28004d00 0x7fda28005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3815e8d0 con 0x7fda28003f20 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2800bb10 con 0x7fda28004d00 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2800bcd0 con 0x7fda3815e390 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.516+0000 7fda37fff640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda28003f20 0x7fda280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:48.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.517+0000 7fda3ca30640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda3815e390 0x7fda280039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:48.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.517+0000 7fda37fff640 1 -- 172.21.15.77:0/3891229509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda3815e390 msgr2=0x7fda280039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:48.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.517+0000 7fda37fff640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda3815e390 0x7fda280039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.517+0000 7fda37fff640 1 -- 172.21.15.77:0/3891229509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda28004d00 msgr2=0x7fda28005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:48.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.517+0000 7fda37fff640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda28004d00 0x7fda28005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.517+0000 7fda37fff640 1 -- 172.21.15.77:0/3891229509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28003520 con 0x7fda28003f20 2023-11-26T07:21:48.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.517+0000 7fda3ca30640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda3815e390 0x7fda280039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:48.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.518+0000 7fda37fff640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda28003f20 0x7fda280047c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fda24001750 tx=0x7fda280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f364d555f45478a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:48.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.518+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda240052d0 con 0x7fda28003f20 2023-11-26T07:21:48.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.518+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2402e050 con 0x7fda28003f20 2023-11-26T07:21:48.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.518+0000 7fda377fe640 1 -- 172.21.15.77:0/3891229509 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda240035f0 con 0x7fda28003f20 2023-11-26T07:21:48.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.519+0000 7fda3ec94640 1 -- 172.21.15.77:0/3891229509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda28003f20 msgr2=0x7fda280047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:48.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.519+0000 7fda3ec94640 1 --2- 172.21.15.77:0/3891229509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda28003f20 0x7fda280047c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fda24001750 tx=0x7fda280057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.519+0000 7fda3d231640 1 -- 172.21.15.77:0/3891229509 reap_dead start 2023-11-26T07:21:48.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.519+0000 7fda3ec94640 1 -- 172.21.15.77:0/3891229509 shutdown_connections 2023-11-26T07:21:48.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.519+0000 7fda3ec94640 1 -- 172.21.15.77:0/3891229509 >> 172.21.15.77:0/3891229509 conn(0x7fda3806a920 msgr2=0x7fda3806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:48.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.519+0000 7fda3ec94640 1 -- 172.21.15.77:0/3891229509 shutdown_connections 2023-11-26T07:21:48.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.519+0000 7fda3ec94640 1 -- 172.21.15.77:0/3891229509 wait complete. 2023-11-26T07:21:48.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.521+0000 7fda3ec94640 1 Processor -- start 2023-11-26T07:21:48.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.521+0000 7fda3ec94640 1 -- start start 2023-11-26T07:21:48.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3ec94640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda28003f20 0x7fda381f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:48.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3ec94640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda381f40c0 0x7fda380cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:48.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3ec94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda3806c560 0x7fda3806c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:48.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3ec94640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3806cf30 con 0x7fda3806c560 2023-11-26T07:21:48.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3ec94640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda381f1030 con 0x7fda28003f20 2023-11-26T07:21:48.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3ec94640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda381f4650 con 0x7fda381f40c0 2023-11-26T07:21:48.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3d231640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda3806c560 0x7fda3806c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:48.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3d231640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda3806c560 0x7fda3806c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35832/0 (socket says 172.21.15.77:35832) 2023-11-26T07:21:48.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3d231640 1 -- 172.21.15.77:0/3373927471 learned_addr learned my addr 172.21.15.77:0/3373927471 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:48.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3d231640 1 -- 172.21.15.77:0/3373927471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda381f40c0 msgr2=0x7fda380cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:48.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3d231640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda381f40c0 0x7fda380cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3d231640 1 -- 172.21.15.77:0/3373927471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda28003f20 msgr2=0x7fda381f07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:48.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3d231640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda28003f20 0x7fda381f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.522+0000 7fda3d231640 1 -- 172.21.15.77:0/3373927471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda381f4930 con 0x7fda3806c560 2023-11-26T07:21:48.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.523+0000 7fda3d231640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda3806c560 0x7fda3806c9f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fda3815e800 tx=0x7fda3000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:48.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.523+0000 7fda357fa640 1 -- 172.21.15.77:0/3373927471 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30010040 con 0x7fda3806c560 2023-11-26T07:21:48.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.523+0000 7fda357fa640 1 -- 172.21.15.77:0/3373927471 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3000bab0 con 0x7fda3806c560 2023-11-26T07:21:48.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.523+0000 7fda3ec94640 1 -- 172.21.15.77:0/3373927471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda381f4c10 con 0x7fda3806c560 2023-11-26T07:21:48.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.523+0000 7fda357fa640 1 -- 172.21.15.77:0/3373927471 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000be60 con 0x7fda3806c560 2023-11-26T07:21:48.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.523+0000 7fda3ec94640 1 -- 172.21.15.77:0/3373927471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda381f51d0 con 0x7fda3806c560 2023-11-26T07:21:48.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.524+0000 7fda3ec94640 1 -- 172.21.15.77:0/3373927471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda381f53c0 con 0x7fda3806c560 2023-11-26T07:21:48.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.525+0000 7fda357fa640 1 -- 172.21.15.77:0/3373927471 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fda3001d400 con 0x7fda3806c560 2023-11-26T07:21:48.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.526+0000 7fda357fa640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fda1c06b3e0 0x7fda1c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:48.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.526+0000 7fda357fa640 1 -- 172.21.15.77:0/3373927471 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda3008a6f0 con 0x7fda3806c560 2023-11-26T07:21:48.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.526+0000 7fda3ca30640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fda1c06b3e0 0x7fda1c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:48.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.527+0000 7fda3ca30640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fda1c06b3e0 0x7fda1c06d8a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0017a0 tx=0x7fda2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:48.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.530+0000 7fda357fa640 1 -- 172.21.15.77:0/3373927471 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda30054ec0 con 0x7fda3806c560 2023-11-26T07:21:48.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.758+0000 7fda3ec94640 1 -- 172.21.15.77:0/3373927471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda38067470 con 0x7fda3806c560 2023-11-26T07:21:48.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.759+0000 7fda357fa640 1 -- 172.21.15.77:0/3373927471 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fda300584e0 con 0x7fda3806c560 2023-11-26T07:21:48.761 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:21:48.762 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1822281363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1822281363},{"type":"v1","addr":"172.21.15.159:6834","nonce":1822281363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":4901,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2261329569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2261329569},{"type":"v1","addr":"172.21.15.159:6835","nonce":2261329569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3602997657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3602997657},{"type":"v1","addr":"172.21.15.77:6837","nonce":3602997657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:42.260010+0000","modified":"2023-11-26T07:21:45.350069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/3771669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3771669807},{"type":"v1","addr":"172.21.15.77:6836","nonce":3771669807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:21:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 35 2023-11-26T07:21:48.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 -- 172.21.15.77:0/3373927471 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fda1c06b3e0 msgr2=0x7fda1c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:48.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fda1c06b3e0 0x7fda1c06d8a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0017a0 tx=0x7fda2c009040 comp rx=0 tx=0).stop 2023-11-26T07:21:48.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 -- 172.21.15.77:0/3373927471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda3806c560 msgr2=0x7fda3806c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda3806c560 0x7fda3806c9f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fda3815e800 tx=0x7fda3000eea0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 -- 172.21.15.77:0/3373927471 shutdown_connections 2023-11-26T07:21:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fda1c06b3e0 0x7fda1c06d8a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda3806c560 0x7fda3806c9f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda381f40c0 0x7fda380cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 --2- 172.21.15.77:0/3373927471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda28003f20 0x7fda381f07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 -- 172.21.15.77:0/3373927471 >> 172.21.15.77:0/3373927471 conn(0x7fda3806a920 msgr2=0x7fda3809b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 -- 172.21.15.77:0/3373927471 shutdown_connections 2023-11-26T07:21:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:48.762+0000 7fda3ec94640 1 -- 172.21.15.77:0/3373927471 wait complete. 2023-11-26T07:21:49.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:21:42.260010+0000', 'modified': '2023-11-26T07:21:45.350069+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6207': {'gid': 6207, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6836/3771669807', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 3771669807}, {'type': 'v1', 'addr': '172.21.15.77:6836', 'nonce': 3771669807}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:21:49.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:21:49.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-26T07:21:49.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.406+0000 7fd119c75640 1 Processor -- start 2023-11-26T07:21:49.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.407+0000 7fd119c75640 1 -- start start 2023-11-26T07:21:49.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.408+0000 7fd119c75640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd11415b440 0x7fd1140cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.408+0000 7fd119c75640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1140cbf20 0x7fd1140c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.408+0000 7fd119c75640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1140cc3a0 con 0x7fd1140c57e0 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.408+0000 7fd119c75640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11415b820 con 0x7fd1140cbf20 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.408+0000 7fd119c75640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11415eea0 con 0x7fd11415b440 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.409+0000 7fd112ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1140cbf20 0x7fd1140c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.409+0000 7fd112ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1140cbf20 0x7fd1140c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35834/0 (socket says 172.21.15.77:35834) 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.409+0000 7fd112ffd640 1 -- 172.21.15.77:0/524191322 learned_addr learned my addr 172.21.15.77:0/524191322 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.409+0000 7fd113fff640 1 --1- 172.21.15.77:0/524191322 >> v1:172.21.15.77:6789/0 conn(0x7fd1140c57e0 0x7fd1140c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58070/0 (socket says 172.21.15.77:58070) 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.409+0000 7fd1137fe640 1 --2- 172.21.15.77:0/524191322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd11415b440 0x7fd1140cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.409+0000 7fd112ffd640 1 -- 172.21.15.77:0/524191322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd11415b440 msgr2=0x7fd1140cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.409+0000 7fd112ffd640 1 --2- 172.21.15.77:0/524191322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd11415b440 0x7fd1140cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.409+0000 7fd112ffd640 1 -- 172.21.15.77:0/524191322 >> v1:172.21.15.77:6789/0 conn(0x7fd1140c57e0 legacy=0x7fd1140c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.409+0000 7fd112ffd640 1 -- 172.21.15.77:0/524191322 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11406d600 con 0x7fd1140cbf20 2023-11-26T07:21:49.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.409+0000 7fd1137fe640 1 --2- 172.21.15.77:0/524191322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd11415b440 0x7fd1140cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:49.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.410+0000 7fd112ffd640 1 --2- 172.21.15.77:0/524191322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1140cbf20 0x7fd1140c52a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd104009e50 tx=0x7fd10402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31ed8d96fe46e3c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.410+0000 7fd1127fc640 1 -- 172.21.15.77:0/524191322 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10402ca80 con 0x7fd1140cbf20 2023-11-26T07:21:49.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.411+0000 7fd1127fc640 1 -- 172.21.15.77:0/524191322 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10402cbe0 con 0x7fd1140cbf20 2023-11-26T07:21:49.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.411+0000 7fd1127fc640 1 -- 172.21.15.77:0/524191322 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040343f0 con 0x7fd1140cbf20 2023-11-26T07:21:49.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.411+0000 7fd119c75640 1 -- 172.21.15.77:0/524191322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1140cbf20 msgr2=0x7fd1140c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.411+0000 7fd119c75640 1 --2- 172.21.15.77:0/524191322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1140cbf20 0x7fd1140c52a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd104009e50 tx=0x7fd10402bee0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.411+0000 7fd119c75640 1 -- 172.21.15.77:0/524191322 shutdown_connections 2023-11-26T07:21:49.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.411+0000 7fd119c75640 1 --2- 172.21.15.77:0/524191322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1140cbf20 0x7fd1140c52a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.411+0000 7fd119c75640 1 --2- 172.21.15.77:0/524191322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd11415b440 0x7fd1140cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.411+0000 7fd119c75640 1 -- 172.21.15.77:0/524191322 >> 172.21.15.77:0/524191322 conn(0x7fd1140b0c50 msgr2=0x7fd1140b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:49.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.411+0000 7fd119c75640 1 -- 172.21.15.77:0/524191322 shutdown_connections 2023-11-26T07:21:49.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.411+0000 7fd119c75640 1 -- 172.21.15.77:0/524191322 wait complete. 2023-11-26T07:21:49.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.413+0000 7fd119c75640 1 Processor -- start 2023-11-26T07:21:49.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.413+0000 7fd119c75640 1 -- start start 2023-11-26T07:21:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.414+0000 7fd119c75640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1140c57e0 0x7fd1141540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.414+0000 7fd119c75640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1140cbf20 0x7fd1140cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.414+0000 7fd119c75640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd11415b440 0x7fd1140cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.414+0000 7fd119c75640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140c66d0 con 0x7fd1140cbf20 2023-11-26T07:21:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.414+0000 7fd119c75640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140c69b0 con 0x7fd1140c57e0 2023-11-26T07:21:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.414+0000 7fd119c75640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140c6c90 con 0x7fd11415b440 2023-11-26T07:21:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.414+0000 7fd112ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1140cbf20 0x7fd1140cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.414+0000 7fd112ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1140cbf20 0x7fd1140cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35842/0 (socket says 172.21.15.77:35842) 2023-11-26T07:21:49.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.415+0000 7fd112ffd640 1 -- 172.21.15.77:0/3515287347 learned_addr learned my addr 172.21.15.77:0/3515287347 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:49.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.415+0000 7fd112ffd640 1 -- 172.21.15.77:0/3515287347 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd11415b440 msgr2=0x7fd1140cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.415+0000 7fd112ffd640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd11415b440 0x7fd1140cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.415+0000 7fd112ffd640 1 -- 172.21.15.77:0/3515287347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1140c57e0 msgr2=0x7fd1141540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.415+0000 7fd112ffd640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1140c57e0 0x7fd1141540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.415+0000 7fd112ffd640 1 -- 172.21.15.77:0/3515287347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104009b30 con 0x7fd1140cbf20 2023-11-26T07:21:49.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.415+0000 7fd112ffd640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1140cbf20 0x7fd1140cd8c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd104036040 tx=0x7fd104004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.415+0000 7fd10bfff640 1 -- 172.21.15.77:0/3515287347 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10403e450 con 0x7fd1140cbf20 2023-11-26T07:21:49.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.416+0000 7fd10bfff640 1 -- 172.21.15.77:0/3515287347 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10403e5f0 con 0x7fd1140cbf20 2023-11-26T07:21:49.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.416+0000 7fd10bfff640 1 -- 172.21.15.77:0/3515287347 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10403e9a0 con 0x7fd1140cbf20 2023-11-26T07:21:49.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.416+0000 7fd119c75640 1 -- 172.21.15.77:0/3515287347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1140c6f70 con 0x7fd1140cbf20 2023-11-26T07:21:49.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.416+0000 7fd119c75640 1 -- 172.21.15.77:0/3515287347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11409b920 con 0x7fd1140cbf20 2023-11-26T07:21:49.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.418+0000 7fd10bfff640 1 -- 172.21.15.77:0/3515287347 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fd10402cd50 con 0x7fd1140cbf20 2023-11-26T07:21:49.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.419+0000 7fd10bfff640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0f406b3e0 0x7fd0f406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.419+0000 7fd10bfff640 1 -- 172.21.15.77:0/3515287347 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1040acd90 con 0x7fd1140cbf20 2023-11-26T07:21:49.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.420+0000 7fd1137fe640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0f406b3e0 0x7fd0f406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.420+0000 7fd11c809740 1 Processor -- start 2023-11-26T07:21:49.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.420+0000 7fd11c809740 1 -- start start 2023-11-26T07:21:49.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.420+0000 7fd1137fe640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0f406b3e0 0x7fd0f406d8a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc006fd0 tx=0x7fd0fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.421+0000 7fd11c809740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c5ea0 0x55a0247c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.421+0000 7fd11c809740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0247c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.421+0000 7fd11c809740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c55e0 0x55a024809560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.421+0000 7fd11c809740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a024724880 con 0x55a0247c0ba0 2023-11-26T07:21:49.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.421+0000 7fd11c809740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a024733ae0 con 0x55a0247c55e0 2023-11-26T07:21:49.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.421+0000 7fd11c809740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0247311d0 con 0x55a0247c5ea0 2023-11-26T07:21:49.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.421+0000 7fd112ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0247c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.421+0000 7fd112ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0247c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35846/0 (socket says 172.21.15.77:35846) 2023-11-26T07:21:49.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.421+0000 7fd112ffd640 1 -- 172.21.15.77:0/2138940021 learned_addr learned my addr 172.21.15.77:0/2138940021 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:49.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.422+0000 7fd112ffd640 1 -- 172.21.15.77:0/2138940021 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c5ea0 msgr2=0x55a0247c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:49.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.422+0000 7fd112ffd640 1 --2- 172.21.15.77:0/2138940021 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c5ea0 0x55a0247c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.422+0000 7fd112ffd640 1 -- 172.21.15.77:0/2138940021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c55e0 msgr2=0x55a024809560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:49.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.422+0000 7fd112ffd640 1 --2- 172.21.15.77:0/2138940021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c55e0 0x55a024809560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.422+0000 7fd112ffd640 1 -- 172.21.15.77:0/2138940021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0246f4860 con 0x55a0247c0ba0 2023-11-26T07:21:49.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.422+0000 7fd112ffd640 1 --2- 172.21.15.77:0/2138940021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0247c50a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd10402c4f0 tx=0x7fd104009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a09600152db7f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.422+0000 7fd1097fa640 1 -- 172.21.15.77:0/2138940021 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104092070 con 0x55a0247c0ba0 2023-11-26T07:21:49.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.422+0000 7fd1097fa640 1 -- 172.21.15.77:0/2138940021 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10407f430 con 0x55a0247c0ba0 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.422+0000 7fd1097fa640 1 -- 172.21.15.77:0/2138940021 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040aa970 con 0x55a0247c0ba0 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.423+0000 7fd11c809740 1 -- 172.21.15.77:0/2138940021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 msgr2=0x55a0247c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.423+0000 7fd11c809740 1 --2- 172.21.15.77:0/2138940021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0247c50a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd10402c4f0 tx=0x7fd104009810 comp rx=0 tx=0).stop 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.423+0000 7fd11c809740 1 -- 172.21.15.77:0/2138940021 shutdown_connections 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.423+0000 7fd11c809740 1 --2- 172.21.15.77:0/2138940021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c55e0 0x55a024809560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.423+0000 7fd11c809740 1 --2- 172.21.15.77:0/2138940021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0247c50a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.423+0000 7fd11c809740 1 --2- 172.21.15.77:0/2138940021 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c5ea0 0x55a0247c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.423+0000 7fd11c809740 1 -- 172.21.15.77:0/2138940021 >> 172.21.15.77:0/2138940021 conn(0x55a024787c70 msgr2=0x55a02480b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.423+0000 7fd11c809740 1 -- 172.21.15.77:0/2138940021 shutdown_connections 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.423+0000 7fd11c809740 1 -- 172.21.15.77:0/2138940021 wait complete. 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.424+0000 7fd11c809740 1 -- start start 2023-11-26T07:21:49.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.424+0000 7fd11c809740 1 Processor -- start 2023-11-26T07:21:49.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.425+0000 7fd11c809740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0248128b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.425+0000 7fd11c809740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c55e0 0x55a0247ef310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.425+0000 7fd11c809740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c5ea0 0x55a0247ef850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.425+0000 7fd11c809740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02472cac0 con 0x55a0247c0ba0 2023-11-26T07:21:49.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.425+0000 7fd11c809740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0246c92f0 con 0x55a0247c5ea0 2023-11-26T07:21:49.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.425+0000 7fd11c809740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0246e6c70 con 0x55a0247c55e0 2023-11-26T07:21:49.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.425+0000 7fd11c809740 10 client.0 _ll_register_callbacks cb 0x55a0246eb3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.425+0000 7fd1137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0248128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.425+0000 7fd1137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0248128b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35852/0 (socket says 172.21.15.77:35852) 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.425+0000 7fd1137fe640 1 -- 172.21.15.77:0/2555342775 learned_addr learned my addr 172.21.15.77:0/2555342775 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.425+0000 7fd112ffd640 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c55e0 0x55a0247ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd1137fe640 1 -- 172.21.15.77:0/2555342775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c55e0 msgr2=0x55a0247ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd1137fe640 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c55e0 0x55a0247ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd1137fe640 1 -- 172.21.15.77:0/2555342775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c5ea0 msgr2=0x55a0247ef850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd1137fe640 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c5ea0 0x55a0247ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd1137fe640 1 -- 172.21.15.77:0/2555342775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11409b920 con 0x55a0247c0ba0 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd112ffd640 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c55e0 0x55a0247ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd1137fe640 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0248128b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00ce40 tx=0x7fd0fc0137f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1177c21cd4f346f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd0f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-26T07:21:49.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd0f27fc640 1 -- 172.21.15.77:0/2555342775 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0117e0 con 0x55a0247c0ba0 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd0f27fc640 1 -- 172.21.15.77:0/2555342775 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0fc013e20 con 0x55a0247c0ba0 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd11c809740 1 -- 172.21.15.77:0/2555342775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a024725aa0 con 0x55a0247c0ba0 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd0f27fc640 1 -- 172.21.15.77:0/2555342775 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0fc011940 con 0x55a0247c0ba0 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.426+0000 7fd11c809740 10 client.6372 fetch_fsmap learned FSMap version 35 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.427+0000 7fd11c809740 1 -- 172.21.15.77:0/2555342775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55a02472b140 con 0x55a0247c0ba0 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.427+0000 7fd0f27fc640 1 -- 172.21.15.77:0/2555342775 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a024725aa0 con 0x55a0247c0ba0 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.427+0000 7fd0f27fc640 1 -- 172.21.15.77:0/2555342775 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd0fc011aa0 con 0x55a0247c0ba0 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.427+0000 7fd11c809740 10 client.6372 fetch_fsmap finished waiting for FSMap version 35 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.427+0000 7fd11c809740 10 client.6372 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.427+0000 7fd11c809740 20 client.6372 populate_metadata read hostname 'smithi077' 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.427+0000 7fd11c809740 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.77:6834/3771669807,v1:172.21.15.77:6836/3771669807] conn(0x55a0247ee2d0 0x55a024828e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.427+0000 7fd11c809740 4 client.6372 mds_command: new command op to 6207 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:21:49.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.427+0000 7fd11c809740 1 -- 172.21.15.77:0/2555342775 --> [v2:172.21.15.77:6834/3771669807,v1:172.21.15.77:6836/3771669807] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0247257c0 con 0x55a0247ee2d0 2023-11-26T07:21:49.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.427+0000 7fd112ffd640 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.77:6834/3771669807,v1:172.21.15.77:6836/3771669807] conn(0x55a0247ee2d0 0x55a024828e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.428+0000 7fd112ffd640 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.77:6834/3771669807,v1:172.21.15.77:6836/3771669807] conn(0x55a0247ee2d0 0x55a024828e20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dba03317f6777eb5 server_cookie=d00a55fced00b805 in_seq=0 out_seq=0 2023-11-26T07:21:49.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.428+0000 7fd0f27fc640 10 client.6372 ms_handle_connect on v2:172.21.15.77:6834/3771669807 2023-11-26T07:21:49.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.428+0000 7fd0f27fc640 1 -- 172.21.15.77:0/2555342775 <== mds.0 v2:172.21.15.77:6834/3771669807 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a0247257c0 con 0x55a0247ee2d0 2023-11-26T07:21:49.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.428+0000 7fd0f27fc640 10 client.6372 handle_command_reply: tid=0 2023-11-26T07:21:49.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 1 client.6372 shutdown 2023-11-26T07:21:49.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 1 -- 172.21.15.77:0/2555342775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 msgr2=0x55a0248128b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0248128b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00ce40 tx=0x7fd0fc0137f0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 1 -- 172.21.15.77:0/2555342775 shutdown_connections 2023-11-26T07:21:49.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.77:6834/3771669807,v1:172.21.15.77:6836/3771669807] conn(0x55a0247ee2d0 0x55a024828e20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c5ea0 0x55a0247ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c55e0 0x55a0247ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd0f27fc640 0 client.6372 ms_handle_reset on v2:172.21.15.77:6834/3771669807 2023-11-26T07:21:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 1 --2- 172.21.15.77:0/2555342775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c0ba0 0x55a0248128b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 1 -- 172.21.15.77:0/2555342775 >> 172.21.15.77:0/2555342775 conn(0x55a024787c70 msgr2=0x55a0247bfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 1 -- 172.21.15.77:0/2555342775 shutdown_connections 2023-11-26T07:21:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 1 -- 172.21.15.77:0/2555342775 wait complete. 2023-11-26T07:21:49.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.429+0000 7fd11c809740 20 client.6372 trim_cache size 0 max 16384 2023-11-26T07:21:49.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.445+0000 7fd11c809740 1 Processor -- start 2023-11-26T07:21:49.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.445+0000 7fd11c809740 1 -- start start 2023-11-26T07:21:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.446+0000 7fd11c809740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c0ba0 0x55a02480bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.446+0000 7fd11c809740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c55e0 0x55a02481d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.446+0000 7fd11c809740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c5ea0 0x55a02481dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.446+0000 7fd11c809740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02448ff20 con 0x55a0247c55e0 2023-11-26T07:21:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.446+0000 7fd11c809740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02480acf0 con 0x55a0247c0ba0 2023-11-26T07:21:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.446+0000 7fd11c809740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0247d8dd0 con 0x55a0247c5ea0 2023-11-26T07:21:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.446+0000 7fd112ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c55e0 0x55a02481d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.447+0000 7fd112ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c55e0 0x55a02481d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35862/0 (socket says 172.21.15.77:35862) 2023-11-26T07:21:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.447+0000 7fd112ffd640 1 -- 172.21.15.77:0/620608536 learned_addr learned my addr 172.21.15.77:0/620608536 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:49.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.447+0000 7fd112ffd640 1 -- 172.21.15.77:0/620608536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c5ea0 msgr2=0x55a02481dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:49.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.447+0000 7fd112ffd640 1 --2- 172.21.15.77:0/620608536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c5ea0 0x55a02481dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.447+0000 7fd112ffd640 1 -- 172.21.15.77:0/620608536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c0ba0 msgr2=0x55a02480bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:49.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.447+0000 7fd112ffd640 1 --2- 172.21.15.77:0/620608536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c0ba0 0x55a02480bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.447+0000 7fd112ffd640 1 -- 172.21.15.77:0/620608536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0246c8b80 con 0x55a0247c55e0 2023-11-26T07:21:49.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.447+0000 7fd112ffd640 1 --2- 172.21.15.77:0/620608536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c55e0 0x55a02481d760 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd104079630 tx=0x7fd104092000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c85bda9cedc2de server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.447+0000 7fd109ffb640 1 -- 172.21.15.77:0/620608536 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10407f170 con 0x55a0247c55e0 2023-11-26T07:21:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.447+0000 7fd109ffb640 1 -- 172.21.15.77:0/620608536 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104098070 con 0x55a0247c55e0 2023-11-26T07:21:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.447+0000 7fd109ffb640 1 -- 172.21.15.77:0/620608536 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040779f0 con 0x55a0247c55e0 2023-11-26T07:21:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.448+0000 7fd11c809740 1 -- 172.21.15.77:0/620608536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c55e0 msgr2=0x55a02481d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.448+0000 7fd11c809740 1 --2- 172.21.15.77:0/620608536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c55e0 0x55a02481d760 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd104079630 tx=0x7fd104092000 comp rx=0 tx=0).stop 2023-11-26T07:21:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.448+0000 7fd11c809740 1 -- 172.21.15.77:0/620608536 shutdown_connections 2023-11-26T07:21:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.448+0000 7fd11c809740 1 --2- 172.21.15.77:0/620608536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c5ea0 0x55a02481dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.448+0000 7fd11c809740 1 --2- 172.21.15.77:0/620608536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c55e0 0x55a02481d760 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.448+0000 7fd11c809740 1 --2- 172.21.15.77:0/620608536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c0ba0 0x55a02480bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.448+0000 7fd11c809740 1 -- 172.21.15.77:0/620608536 >> 172.21.15.77:0/620608536 conn(0x55a024787c70 msgr2=0x55a0247ed560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.448+0000 7fd11c809740 1 -- 172.21.15.77:0/620608536 shutdown_connections 2023-11-26T07:21:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.448+0000 7fd11c809740 1 -- 172.21.15.77:0/620608536 wait complete. 2023-11-26T07:21:49.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.449+0000 7fd11c809740 1 -- start start 2023-11-26T07:21:49.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.449+0000 7fd11c809740 1 Processor -- start 2023-11-26T07:21:49.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd11c809740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c0ba0 0x55a0248756d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd11c809740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c55e0 0x55a02480bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd11c809740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c5ea0 0x55a02481a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd11c809740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0247d83c0 con 0x55a0247c5ea0 2023-11-26T07:21:49.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd11c809740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0247d86a0 con 0x55a0247c55e0 2023-11-26T07:21:49.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd11c809740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0247c69a0 con 0x55a0247c0ba0 2023-11-26T07:21:49.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd11c809740 10 client.0 _ll_register_callbacks cb 0x7fd0fc00ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:21:49.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd113fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c5ea0 0x55a02481a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd113fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c5ea0 0x55a02481a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35872/0 (socket says 172.21.15.77:35872) 2023-11-26T07:21:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd113fff640 1 -- 172.21.15.77:0/3198911690 learned_addr learned my addr 172.21.15.77:0/3198911690 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd112ffd640 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c55e0 0x55a02480bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.450+0000 7fd1137fe640 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c0ba0 0x55a0248756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd113fff640 1 -- 172.21.15.77:0/3198911690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c0ba0 msgr2=0x55a0248756d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd113fff640 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c0ba0 0x55a0248756d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd113fff640 1 -- 172.21.15.77:0/3198911690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c55e0 msgr2=0x55a02480bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd113fff640 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c55e0 0x55a02480bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd113fff640 1 -- 172.21.15.77:0/3198911690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0246f4860 con 0x55a0247c5ea0 2023-11-26T07:21:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd1137fe640 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c0ba0 0x55a0248756d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd112ffd640 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c55e0 0x55a02480bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd113fff640 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c5ea0 0x55a02481a240 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x55a0247c8200 tx=0x7fd10c00c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd57921c0b17a126 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd0f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd0f27fc640 1 -- 172.21.15.77:0/3198911690 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c001d20 con 0x55a0247c5ea0 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd0f27fc640 1 -- 172.21.15.77:0/3198911690 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd10c015ad0 con 0x55a0247c5ea0 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd11c809740 1 -- 172.21.15.77:0/3198911690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd10407f430 con 0x55a0247c5ea0 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd0f27fc640 1 -- 172.21.15.77:0/3198911690 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd10c015cf0 con 0x55a0247c5ea0 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd11c809740 10 client.6378 fetch_fsmap learned FSMap version 35 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.451+0000 7fd11c809740 1 -- 172.21.15.77:0/3198911690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55a0246ee170 con 0x55a0247c5ea0 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.452+0000 7fd0f27fc640 1 -- 172.21.15.77:0/3198911690 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10407f430 con 0x55a0247c5ea0 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.452+0000 7fd0f27fc640 1 -- 172.21.15.77:0/3198911690 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd10c0070d0 con 0x55a0247c5ea0 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.452+0000 7fd11c809740 10 client.6378 fetch_fsmap finished waiting for FSMap version 35 2023-11-26T07:21:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.452+0000 7fd11c809740 10 client.6378 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:21:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.452+0000 7fd11c809740 20 client.6378 populate_metadata read hostname 'smithi077' 2023-11-26T07:21:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.452+0000 7fd11c809740 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.77:6834/3771669807,v1:172.21.15.77:6836/3771669807] conn(0x55a02480f280 0x55a0247f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.452+0000 7fd11c809740 4 client.6378 mds_command: new command op to 6207 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:21:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.452+0000 7fd11c809740 1 -- 172.21.15.77:0/3198911690 --> [v2:172.21.15.77:6834/3771669807,v1:172.21.15.77:6836/3771669807] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a02442d6c0 con 0x55a02480f280 2023-11-26T07:21:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.452+0000 7fd1137fe640 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.77:6834/3771669807,v1:172.21.15.77:6836/3771669807] conn(0x55a02480f280 0x55a0247f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd1137fe640 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.77:6834/3771669807,v1:172.21.15.77:6836/3771669807] conn(0x55a02480f280 0x55a0247f32b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e538bf5ecc586a13 server_cookie=632c87e6f46c2bbf in_seq=0 out_seq=0 2023-11-26T07:21:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd0f27fc640 10 client.6378 ms_handle_connect on v2:172.21.15.77:6834/3771669807 2023-11-26T07:21:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd0f27fc640 1 -- 172.21.15.77:0/3198911690 <== mds.0 v2:172.21.15.77:6834/3771669807 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a02442d6c0 con 0x55a02480f280 2023-11-26T07:21:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd0f27fc640 10 client.6378 handle_command_reply: tid=0 2023-11-26T07:21:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 1 client.6378 shutdown 2023-11-26T07:21:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 1 -- 172.21.15.77:0/3198911690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c5ea0 msgr2=0x55a02481a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c5ea0 0x55a02481a240 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x55a0247c8200 tx=0x7fd10c00c4b0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 1 -- 172.21.15.77:0/3198911690 shutdown_connections 2023-11-26T07:21:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.77:6834/3771669807,v1:172.21.15.77:6836/3771669807] conn(0x55a02480f280 0x55a0247f32b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0247c5ea0 0x55a02481a240 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0247c55e0 0x55a02480bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 1 --2- 172.21.15.77:0/3198911690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55a0247c0ba0 0x55a0248756d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd0f27fc640 0 client.6378 ms_handle_reset on v2:172.21.15.77:6834/3771669807 2023-11-26T07:21:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 1 -- 172.21.15.77:0/3198911690 >> 172.21.15.77:0/3198911690 conn(0x55a024787c70 msgr2=0x55a0247f4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 1 -- 172.21.15.77:0/3198911690 shutdown_connections 2023-11-26T07:21:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 1 -- 172.21.15.77:0/3198911690 wait complete. 2023-11-26T07:21:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.453+0000 7fd11c809740 20 client.6378 trim_cache size 0 max 16384 2023-11-26T07:21:49.461 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:21:49.461 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "957368bd-e942-499b-9938-86266ae9bafb", 2023-11-26T07:21:49.461 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-26T07:21:49.461 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 6207, 2023-11-26T07:21:49.461 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-26T07:21:49.461 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-26T07:21:49.461 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-26T07:21:49.461 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 6.6317483470000003, 2023-11-26T07:21:49.461 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 35, 2023-11-26T07:21:49.462 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 62, 2023-11-26T07:21:49.462 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 62, 2023-11-26T07:21:49.462 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 12.035503454000001 2023-11-26T07:21:49.462 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:21:49.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 -- 172.21.15.77:0/3515287347 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0f406b3e0 msgr2=0x7fd0f406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0f406b3e0 0x7fd0f406d8a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc006fd0 tx=0x7fd0fc008040 comp rx=0 tx=0).stop 2023-11-26T07:21:49.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 -- 172.21.15.77:0/3515287347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1140cbf20 msgr2=0x7fd1140cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1140cbf20 0x7fd1140cd8c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd104036040 tx=0x7fd104004a40 comp rx=0 tx=0).stop 2023-11-26T07:21:49.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 -- 172.21.15.77:0/3515287347 shutdown_connections 2023-11-26T07:21:49.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd0f406b3e0 0x7fd0f406d8a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd11415b440 0x7fd1140cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1140cbf20 0x7fd1140cd8c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 --2- 172.21.15.77:0/3515287347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1140c57e0 0x7fd1141540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 -- 172.21.15.77:0/3515287347 >> 172.21.15.77:0/3515287347 conn(0x7fd1140b0c50 msgr2=0x7fd1140c44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:49.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 -- 172.21.15.77:0/3515287347 shutdown_connections 2023-11-26T07:21:49.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.454+0000 7fd119c75640 1 -- 172.21.15.77:0/3515287347 wait complete. 2023-11-26T07:21:49.472 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:21:49.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.671+0000 7f0fa9551640 1 Processor -- start 2023-11-26T07:21:49.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.671+0000 7f0fa9551640 1 -- start start 2023-11-26T07:21:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.672+0000 7f0fa9551640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0fa40cf450 0x7f0fa40cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa9551640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0fa40cdfb0 0x7f0fa40ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa9551640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa40cece0 con 0x7f0fa415c7f0 2023-11-26T07:21:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa9551640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa40cfe40 con 0x7f0fa40cf450 2023-11-26T07:21:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa9551640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa4156010 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa27fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0fa40cf450 0x7f0fa40cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa27fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0fa40cf450 0x7f0fa40cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35880/0 (socket says 172.21.15.77:35880) 2023-11-26T07:21:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa27fc640 1 -- 172.21.15.77:0/3093663342 learned_addr learned my addr 172.21.15.77:0/3093663342 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa2ffd640 1 --1- 172.21.15.77:0/3093663342 >> v1:172.21.15.77:6789/0 conn(0x7f0fa415c7f0 0x7f0fa406db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58076/0 (socket says 172.21.15.77:58076) 2023-11-26T07:21:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa27fc640 1 -- 172.21.15.77:0/3093663342 >> v2:172.21.15.159:3300/0 conn(0x7f0fa40cdfb0 msgr2=0x7f0fa40ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa37fe640 1 --2- 172.21.15.77:0/3093663342 >> v2:172.21.15.159:3300/0 conn(0x7f0fa40cdfb0 0x7f0fa40ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa27fc640 1 --2- 172.21.15.77:0/3093663342 >> v2:172.21.15.159:3300/0 conn(0x7f0fa40cdfb0 0x7f0fa40ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa27fc640 1 -- 172.21.15.77:0/3093663342 >> v1:172.21.15.77:6789/0 conn(0x7f0fa415c7f0 legacy=0x7f0fa406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa27fc640 1 -- 172.21.15.77:0/3093663342 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa406d040 con 0x7f0fa40cf450 2023-11-26T07:21:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.673+0000 7f0fa37fe640 1 --2- 172.21.15.77:0/3093663342 >> v2:172.21.15.159:3300/0 conn(0x7f0fa40cdfb0 0x7f0fa40ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.674+0000 7f0fa27fc640 1 --2- 172.21.15.77:0/3093663342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa40cf450 0x7f0fa40cf900 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40d00e0 tx=0x7f0f9802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dca375156c374bd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.675+0000 7f0fa1ffb640 1 -- 172.21.15.77:0/3093663342 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98004230 con 0x7f0fa40cf450 2023-11-26T07:21:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.675+0000 7f0fa1ffb640 1 -- 172.21.15.77:0/3093663342 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9802e050 con 0x7f0fa40cf450 2023-11-26T07:21:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.675+0000 7f0fa1ffb640 1 -- 172.21.15.77:0/3093663342 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98003610 con 0x7f0fa40cf450 2023-11-26T07:21:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.675+0000 7f0fa9551640 1 -- 172.21.15.77:0/3093663342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa40cf450 msgr2=0x7f0fa40cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.675+0000 7f0fa9551640 1 --2- 172.21.15.77:0/3093663342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa40cf450 0x7f0fa40cf900 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40d00e0 tx=0x7f0f9802b7e0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.675+0000 7f0fa9551640 1 -- 172.21.15.77:0/3093663342 shutdown_connections 2023-11-26T07:21:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.675+0000 7f0fa9551640 1 --2- 172.21.15.77:0/3093663342 >> v2:172.21.15.159:3300/0 conn(0x7f0fa40cdfb0 0x7f0fa40ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.675+0000 7f0fa9551640 1 --2- 172.21.15.77:0/3093663342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa40cf450 0x7f0fa40cf900 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.675+0000 7f0fa9551640 1 -- 172.21.15.77:0/3093663342 >> 172.21.15.77:0/3093663342 conn(0x7f0fa406a920 msgr2=0x7f0fa406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.676+0000 7f0fa9551640 1 -- 172.21.15.77:0/3093663342 shutdown_connections 2023-11-26T07:21:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.676+0000 7f0fa9551640 1 -- 172.21.15.77:0/3093663342 wait complete. 2023-11-26T07:21:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.677+0000 7f0fa9551640 1 Processor -- start 2023-11-26T07:21:49.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.677+0000 7f0fa9551640 1 -- start start 2023-11-26T07:21:49.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.678+0000 7f0fa9551640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa40cdfb0 0x7f0fa41555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.678+0000 7f0fa9551640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fa40cf450 0x7f0fa40b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.678+0000 7f0fa9551640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fa415c7f0 0x7f0fa40ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.678+0000 7f0fa9551640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40b3ee0 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.678+0000 7f0fa9551640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4155ae0 con 0x7f0fa40cf450 2023-11-26T07:21:49.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.678+0000 7f0fa9551640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40c87f0 con 0x7f0fa415c7f0 2023-11-26T07:21:49.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.679+0000 7f0fa2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa40cdfb0 0x7f0fa41555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.679+0000 7f0fa2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa40cdfb0 0x7f0fa41555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35886/0 (socket says 172.21.15.77:35886) 2023-11-26T07:21:49.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.679+0000 7f0fa2ffd640 1 -- 172.21.15.77:0/60252609 learned_addr learned my addr 172.21.15.77:0/60252609 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:49.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.679+0000 7f0fa2ffd640 1 -- 172.21.15.77:0/60252609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fa415c7f0 msgr2=0x7f0fa40ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.679+0000 7f0fa2ffd640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fa415c7f0 0x7f0fa40ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.679+0000 7f0fa2ffd640 1 -- 172.21.15.77:0/60252609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fa40cf450 msgr2=0x7f0fa40b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.679+0000 7f0fa2ffd640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fa40cf450 0x7f0fa40b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.679+0000 7f0fa2ffd640 1 -- 172.21.15.77:0/60252609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f980094d0 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.679+0000 7f0fa2ffd640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa40cdfb0 0x7f0fa41555a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c5f0 tx=0x7f0f9400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.680+0000 7f0f8b7fe640 1 -- 172.21.15.77:0/60252609 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f940074e0 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.680+0000 7f0f8b7fe640 1 -- 172.21.15.77:0/60252609 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f94007640 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.680+0000 7f0f8b7fe640 1 -- 172.21.15.77:0/60252609 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94004a00 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.680+0000 7f0fa9551640 1 -- 172.21.15.77:0/60252609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa40c8ad0 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.680+0000 7f0fa9551640 1 -- 172.21.15.77:0/60252609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa40c9090 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.681+0000 7f0fa9551640 1 -- 172.21.15.77:0/60252609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa4067470 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.682+0000 7f0f8b7fe640 1 -- 172.21.15.77:0/60252609 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f0f94004b60 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.683+0000 7f0f8b7fe640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f9006b430 0x7f0f9006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.683+0000 7f0f8b7fe640 1 -- 172.21.15.77:0/60252609 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f94089750 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.683+0000 7f0fa27fc640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f9006b430 0x7f0f9006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.684+0000 7f0fa27fc640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f9006b430 0x7f0f9006d8f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0f98034000 tx=0x7f0f9802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.687+0000 7f0f8b7fe640 1 -- 172.21.15.77:0/60252609 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f94054090 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.920+0000 7f0fa9551640 1 -- 172.21.15.77:0/60252609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0fa4073b10 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.921+0000 7f0f8b7fe640 1 -- 172.21.15.77:0/60252609 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0f940576b0 con 0x7f0fa40cdfb0 2023-11-26T07:21:49.923 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:21:49.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 -- 172.21.15.77:0/60252609 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f9006b430 msgr2=0x7f0f9006d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f9006b430 0x7f0f9006d8f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0f98034000 tx=0x7f0f9802f000 comp rx=0 tx=0).stop 2023-11-26T07:21:49.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 -- 172.21.15.77:0/60252609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa40cdfb0 msgr2=0x7f0fa41555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa40cdfb0 0x7f0fa41555a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c5f0 tx=0x7f0f9400cab0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 -- 172.21.15.77:0/60252609 shutdown_connections 2023-11-26T07:21:49.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0f9006b430 0x7f0f9006d8f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fa415c7f0 0x7f0fa40ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fa40cf450 0x7f0fa40b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 --2- 172.21.15.77:0/60252609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fa40cdfb0 0x7f0fa41555a0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 -- 172.21.15.77:0/60252609 >> 172.21.15.77:0/60252609 conn(0x7f0fa406a920 msgr2=0x7f0fa40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:49.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 -- 172.21.15.77:0/60252609 shutdown_connections 2023-11-26T07:21:49.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:49.924+0000 7f0fa9551640 1 -- 172.21.15.77:0/60252609 wait complete. 2023-11-26T07:21:49.944 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:21:49.945 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:21:49.945 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-26T07:21:49.945 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:21:49.945 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:21:49.945 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:21:49.945 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:21:49.945 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:21:49.945 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:21:49.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:49.945 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-26T07:21:49.993 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:21:49.993 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:21:49.994 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42139sec preferred_lft 42139sec 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 36:2c:fb:c0:b0:85 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::609f:3dff:fe4d:944c/64 scope link 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:49.995 INFO:teuthology.orchestra.run.smithi077.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:21:49.996 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether ba:55:90:99:11:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:21:49.996 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::b855:90ff:fe99:11fe/64 scope link 2023-11-26T07:21:49.996 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:49.996 INFO:teuthology.orchestra.run.smithi077.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:21:49.996 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 36:2c:fb:c0:b0:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:21:49.996 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::342c:fbff:fec0:b085/64 scope link 2023-11-26T07:21:49.996 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:49.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:49.997 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:21:50.090 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-26T07:21:50.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:50.094 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-26T07:21:50.150 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-26T07:21:50.150 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:21:50.150 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:21:50.150 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:21:50.150 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:21:50.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:50.151 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:21:50.151 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:21:50.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:21:50.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:21:50.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:21:50.151 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:21:50.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:50.335 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-26T07:21:50.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:21:50.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:21:50.386 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:21:50.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:50.387 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-26T07:21:50.479 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:21:50.480 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:21:50.534 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:21:50.534 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:21:50.534 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:21:50.587 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:21:50.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:50.588 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:21:50.724 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:21:50.725 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:21:50.725 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:21:50.746 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:21:50.746 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:21:50.746 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:21:50.747 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:21:50.747 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:21:50.772 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:21:50.772 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:21:50.772 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:21:50.772 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:21:50.773 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:21:50.773 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:21:50.773 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:21:50.773 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:21:50.774 INFO:teuthology.orchestra.run.smithi077.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-26T07:21:50.775 INFO:teuthology.orchestra.run.smithi077.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:21:50.775 INFO:teuthology.orchestra.run.smithi077.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:21:50.775 INFO:teuthology.orchestra.run.smithi077.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:21:50.775 INFO:teuthology.orchestra.run.smithi077.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:21:50.779 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:21:50.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:50.779 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:21:50.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:50.863 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:21:50.920 INFO:teuthology.orchestra.run.smithi077.stdout:client5197 2023-11-26T07:21:50.920 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:50.920 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:50.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:21:51.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.216+0000 7f2378ce0640 1 Processor -- start 2023-11-26T07:21:51.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.216+0000 7f2378ce0640 1 -- start start 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.217+0000 7f2378ce0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f237415c7f0 0x7f237406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.218+0000 7f2378ce0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23740ce6c0 0x7f23740cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.218+0000 7f2378ce0640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23740cece0 con 0x7f23740cf450 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.218+0000 7f2378ce0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23740cfe40 con 0x7f237415c7f0 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.218+0000 7f2378ce0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2374156010 con 0x7f23740ce6c0 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.218+0000 7f237259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f237415c7f0 0x7f237406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.218+0000 7f237259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f237415c7f0 0x7f237406db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35890/0 (socket says 172.21.15.77:35890) 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.218+0000 7f237259c640 1 -- 172.21.15.77:0/3354819823 learned_addr learned my addr 172.21.15.77:0/3354819823 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.218+0000 7f237259c640 1 -- 172.21.15.77:0/3354819823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23740ce6c0 msgr2=0x7f23740cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.218+0000 7f237259c640 1 --2- 172.21.15.77:0/3354819823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23740ce6c0 0x7f23740cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.218+0000 7f237259c640 1 -- 172.21.15.77:0/3354819823 >> v1:172.21.15.159:6789/0 conn(0x7f23740cf450 legacy=0x7f23740cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.218+0000 7f237259c640 1 -- 172.21.15.77:0/3354819823 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237406d040 con 0x7f237415c7f0 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.219+0000 7f237259c640 1 --2- 172.21.15.77:0/3354819823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f237415c7f0 0x7f237406db20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2364009870 tx=0x7f236402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b13d6ac5ab3dc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.220+0000 7f2371d9b640 1 -- 172.21.15.77:0/3354819823 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364031640 con 0x7f237415c7f0 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.220+0000 7f2371d9b640 1 -- 172.21.15.77:0/3354819823 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23640317a0 con 0x7f237415c7f0 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.220+0000 7f2371d9b640 1 -- 172.21.15.77:0/3354819823 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364031b30 con 0x7f237415c7f0 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.220+0000 7f2378ce0640 1 -- 172.21.15.77:0/3354819823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f237415c7f0 msgr2=0x7f237406db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.220+0000 7f2378ce0640 1 --2- 172.21.15.77:0/3354819823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f237415c7f0 0x7f237406db20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2364009870 tx=0x7f236402b8f0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.220+0000 7f2378ce0640 1 -- 172.21.15.77:0/3354819823 shutdown_connections 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.220+0000 7f2378ce0640 1 --2- 172.21.15.77:0/3354819823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23740ce6c0 0x7f23740cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.220+0000 7f2378ce0640 1 --2- 172.21.15.77:0/3354819823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f237415c7f0 0x7f237406db20 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.220+0000 7f2378ce0640 1 -- 172.21.15.77:0/3354819823 >> 172.21.15.77:0/3354819823 conn(0x7f237406a920 msgr2=0x7f237406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.221+0000 7f2378ce0640 1 -- 172.21.15.77:0/3354819823 shutdown_connections 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.221+0000 7f2378ce0640 1 -- 172.21.15.77:0/3354819823 wait complete. 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.222+0000 7f2378ce0640 1 Processor -- start 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.222+0000 7f2378ce0640 1 -- start start 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.223+0000 7f2378ce0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23740ce6c0 0x7f23740ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.223+0000 7f2378ce0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23740cf450 0x7f2374156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.223+0000 7f2378ce0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f237415c7f0 0x7f237415a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.223+0000 7f2378ce0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23740acf10 con 0x7f237415c7f0 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.223+0000 7f2378ce0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23740c93a0 con 0x7f23740ce6c0 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.223+0000 7f2378ce0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2374156a90 con 0x7f23740cf450 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.224+0000 7f2372d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f237415c7f0 0x7f237415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.224+0000 7f2372d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f237415c7f0 0x7f237415a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35902/0 (socket says 172.21.15.77:35902) 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.224+0000 7f2372d9d640 1 -- 172.21.15.77:0/4261087686 learned_addr learned my addr 172.21.15.77:0/4261087686 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.224+0000 7f2372d9d640 1 -- 172.21.15.77:0/4261087686 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23740cf450 msgr2=0x7f2374156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.224+0000 7f2372d9d640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23740cf450 0x7f2374156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.224+0000 7f2372d9d640 1 -- 172.21.15.77:0/4261087686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23740ce6c0 msgr2=0x7f23740ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.224+0000 7f2372d9d640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23740ce6c0 0x7f23740ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.224+0000 7f2372d9d640 1 -- 172.21.15.77:0/4261087686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640094d0 con 0x7f237415c7f0 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.224+0000 7f2372d9d640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f237415c7f0 0x7f237415a990 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f236c00b9e0 tx=0x7f236c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.225+0000 7f236affd640 1 -- 172.21.15.77:0/4261087686 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00caa0 con 0x7f237415c7f0 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.225+0000 7f236affd640 1 -- 172.21.15.77:0/4261087686 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c00cc20 con 0x7f237415c7f0 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.225+0000 7f236affd640 1 -- 172.21.15.77:0/4261087686 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c014440 con 0x7f237415c7f0 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.225+0000 7f2378ce0640 1 -- 172.21.15.77:0/4261087686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23740c8790 con 0x7f237415c7f0 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.225+0000 7f2378ce0640 1 -- 172.21.15.77:0/4261087686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23740c8d50 con 0x7f237415c7f0 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.226+0000 7f2378ce0640 1 -- 172.21.15.77:0/4261087686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2374067470 con 0x7f237415c7f0 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.227+0000 7f236affd640 1 -- 172.21.15.77:0/4261087686 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f236c01d3b0 con 0x7f237415c7f0 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.228+0000 7f236affd640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f235406b3e0 0x7f235406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.228+0000 7f236affd640 1 -- 172.21.15.77:0/4261087686 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f236c089f50 con 0x7f237415c7f0 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.228+0000 7f237259c640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f235406b3e0 0x7f235406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.229+0000 7f237259c640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f235406b3e0 0x7f235406d8a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2364036000 tx=0x7f2364030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.232+0000 7f236affd640 1 -- 172.21.15.77:0/4261087686 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f236c0547e0 con 0x7f237415c7f0 2023-11-26T07:21:51.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.462+0000 7f2378ce0640 1 -- 172.21.15.77:0/4261087686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f23740c94e0 con 0x7f237415c7f0 2023-11-26T07:21:51.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.462+0000 7f236affd640 1 -- 172.21.15.77:0/4261087686 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f236c019020 con 0x7f237415c7f0 2023-11-26T07:21:51.465 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:21:51.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 -- 172.21.15.77:0/4261087686 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f235406b3e0 msgr2=0x7f235406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f235406b3e0 0x7f235406d8a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2364036000 tx=0x7f2364030000 comp rx=0 tx=0).stop 2023-11-26T07:21:51.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 -- 172.21.15.77:0/4261087686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f237415c7f0 msgr2=0x7f237415a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f237415c7f0 0x7f237415a990 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f236c00b9e0 tx=0x7f236c00bea0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 -- 172.21.15.77:0/4261087686 shutdown_connections 2023-11-26T07:21:51.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f235406b3e0 0x7f235406d8a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f237415c7f0 0x7f237415a990 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23740cf450 0x7f2374156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 --2- 172.21.15.77:0/4261087686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23740ce6c0 0x7f23740ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 -- 172.21.15.77:0/4261087686 >> 172.21.15.77:0/4261087686 conn(0x7f237406a920 msgr2=0x7f237415cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:51.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 -- 172.21.15.77:0/4261087686 shutdown_connections 2023-11-26T07:21:51.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:51.465+0000 7f2378ce0640 1 -- 172.21.15.77:0/4261087686 wait complete. 2023-11-26T07:21:51.486 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:21:51.487 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:21:51.487 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-11-26T07:21:51.487 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:21:51.487 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:21:51.487 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:21:51.487 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:21:51.487 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:21:51.487 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:21:51.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:51.488 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-11-26T07:21:51.547 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:21:51.548 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:21:51.548 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:21:51.548 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:51.548 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-11-26T07:21:51.548 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:51.548 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:21:51.548 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:21:51.549 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-11-26T07:21:51.549 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:21:51.549 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:21:51.549 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-11-26T07:21:51.549 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:21:51.549 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:21:51.549 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:21:51.550 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:21:51.550 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:21:51.550 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42096sec preferred_lft 42096sec 2023-11-26T07:21:51.550 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-11-26T07:21:51.550 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:51.550 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:21:51.550 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 5a:27:d9:14:0a:5b brd ff:ff:ff:ff:ff:ff 2023-11-26T07:21:51.551 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:21:51.551 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:51.551 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::5429:19ff:fe3d:266e/64 scope link 2023-11-26T07:21:51.551 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:51.551 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:21:51.551 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether be:e0:26:a8:90:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:21:51.551 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::bce0:26ff:fea8:90e7/64 scope link 2023-11-26T07:21:51.552 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:51.552 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:21:51.552 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 5a:27:d9:14:0a:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:21:51.552 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::5827:d9ff:fe14:a5b/64 scope link 2023-11-26T07:21:51.552 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:21:51.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:51.553 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:21:51.644 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-11-26T07:21:51.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:51.648 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-11-26T07:21:51.701 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-11-26T07:21:51.701 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:21:51.701 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:21:51.701 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:21:51.701 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:21:51.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:51.703 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:21:51.703 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:21:51.703 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:21:51.704 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:21:51.704 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:21:51.704 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:21:51.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:51.892 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-11-26T07:21:51.942 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:21:51.942 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:21:51.942 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:21:51.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:51.943 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-11-26T07:21:52.035 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:21:52.035 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:21:52.091 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:21:52.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:21:52.092 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:21:52.143 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:21:52.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:52.143 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:21:52.283 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:21:52.283 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:21:52.283 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:21:52.304 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:21:52.304 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:21:52.304 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:21:52.304 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:21:52.305 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:21:52.333 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:21:52.333 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:21:52.333 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:21:52.333 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:21:52.333 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:21:52.333 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:21:52.333 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:21:52.333 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:21:52.336 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-26T07:21:52.336 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:21:52.336 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:21:52.336 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:21:52.336 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:21:52.339 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:21:52.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:52.339 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:21:52.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:52.423 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:21:52.482 INFO:teuthology.orchestra.run.smithi159.stdout:client6396 2023-11-26T07:21:52.483 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:21:52.483 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:52.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:21:52.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.758+0000 7f67469a9640 1 Processor -- start 2023-11-26T07:21:52.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.759+0000 7f67469a9640 1 -- start start 2023-11-26T07:21:52.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.760+0000 7f67469a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f67400ce6c0 0x7f67400cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.760+0000 7f67469a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67400cece0 con 0x7f674015c7f0 2023-11-26T07:21:52.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.760+0000 7f67469a9640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674006d040 con 0x7f67400cf450 2023-11-26T07:21:52.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.760+0000 7f67469a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67400cfe40 con 0x7f67400ce6c0 2023-11-26T07:21:52.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.760+0000 7f6744f46640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f67400ce6c0 0x7f67400cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.760+0000 7f673ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f674015c7f0 0x7f674006db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58078/0 (socket says 172.21.15.77:58078) 2023-11-26T07:21:52.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.760+0000 7f673ffff640 1 -- 172.21.15.77:0/1674677434 learned_addr learned my addr 172.21.15.77:0/1674677434 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:52.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.761+0000 7f673f7fe640 1 -- 172.21.15.77:0/1674677434 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897774811 0 0) 0x7f67400cece0 con 0x7f674015c7f0 2023-11-26T07:21:52.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.761+0000 7f6744f46640 1 -- 172.21.15.77:0/1674677434 >> v1:172.21.15.159:6789/0 conn(0x7f67400cf450 legacy=0x7f67400cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:52.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.761+0000 7f6744f46640 1 -- 172.21.15.77:0/1674677434 >> v1:172.21.15.77:6789/0 conn(0x7f674015c7f0 legacy=0x7f674006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.761+0000 7f6744f46640 1 -- 172.21.15.77:0/1674677434 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674006d320 con 0x7f67400ce6c0 2023-11-26T07:21:52.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.762+0000 7f6744f46640 1 --2- 172.21.15.77:0/1674677434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400ce6c0 0x7f67400cf900 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f67380097a0 tx=0x7f673802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6115ef364dbccc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:52.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.763+0000 7f673f7fe640 1 -- 172.21.15.77:0/1674677434 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738031830 con 0x7f67400ce6c0 2023-11-26T07:21:52.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.763+0000 7f673f7fe640 1 -- 172.21.15.77:0/1674677434 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6738031990 con 0x7f67400ce6c0 2023-11-26T07:21:52.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.763+0000 7f673f7fe640 1 -- 172.21.15.77:0/1674677434 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738031d20 con 0x7f67400ce6c0 2023-11-26T07:21:52.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.763+0000 7f67469a9640 1 -- 172.21.15.77:0/1674677434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400ce6c0 msgr2=0x7f67400cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.763+0000 7f67469a9640 1 --2- 172.21.15.77:0/1674677434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400ce6c0 0x7f67400cf900 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f67380097a0 tx=0x7f673802b8d0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.763+0000 7f67469a9640 1 -- 172.21.15.77:0/1674677434 shutdown_connections 2023-11-26T07:21:52.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.763+0000 7f67469a9640 1 --2- 172.21.15.77:0/1674677434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400ce6c0 0x7f67400cf900 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.763+0000 7f67469a9640 1 -- 172.21.15.77:0/1674677434 >> 172.21.15.77:0/1674677434 conn(0x7f674006a920 msgr2=0x7f674006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:52.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.763+0000 7f67469a9640 1 -- 172.21.15.77:0/1674677434 shutdown_connections 2023-11-26T07:21:52.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.764+0000 7f67469a9640 1 -- 172.21.15.77:0/1674677434 wait complete. 2023-11-26T07:21:52.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.765+0000 7f67469a9640 1 Processor -- start 2023-11-26T07:21:52.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.765+0000 7f67469a9640 1 -- start start 2023-11-26T07:21:52.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.766+0000 7f67469a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67400ce6c0 0x7f67401f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.766+0000 7f67469a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400cf450 0x7f6740152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.766+0000 7f67469a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f674015c7f0 0x7f6740152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.766+0000 7f67469a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67401f4350 con 0x7f67400cf450 2023-11-26T07:21:52.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.766+0000 7f67469a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674015aed0 con 0x7f674015c7f0 2023-11-26T07:21:52.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.766+0000 7f67469a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6740153280 con 0x7f67400ce6c0 2023-11-26T07:21:52.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.766+0000 7f67377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400cf450 0x7f6740152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f67377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400cf450 0x7f6740152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35922/0 (socket says 172.21.15.77:35922) 2023-11-26T07:21:52.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f67377fe640 1 -- 172.21.15.77:0/2769982453 learned_addr learned my addr 172.21.15.77:0/2769982453 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:52.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f67377fe640 1 -- 172.21.15.77:0/2769982453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67400ce6c0 msgr2=0x7f67401f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f67377fe640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67400ce6c0 0x7f67401f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f6744f46640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f674015c7f0 0x7f6740152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f67377fe640 1 -- 172.21.15.77:0/2769982453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f674015c7f0 msgr2=0x7f6740152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f67377fe640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f674015c7f0 0x7f6740152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f67377fe640 1 -- 172.21.15.77:0/2769982453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738009400 con 0x7f67400cf450 2023-11-26T07:21:52.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f67377fe640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400cf450 0x7f6740152670 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f672800c430 tx=0x7f672800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:52.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f673d7fa640 1 -- 172.21.15.77:0/2769982453 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728011790 con 0x7f67400cf450 2023-11-26T07:21:52.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f673d7fa640 1 -- 172.21.15.77:0/2769982453 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67280118f0 con 0x7f67400cf450 2023-11-26T07:21:52.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.767+0000 7f67469a9640 1 -- 172.21.15.77:0/2769982453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67401f45a0 con 0x7f67400cf450 2023-11-26T07:21:52.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.768+0000 7f673d7fa640 1 -- 172.21.15.77:0/2769982453 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728011ce0 con 0x7f67400cf450 2023-11-26T07:21:52.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.768+0000 7f67469a9640 1 -- 172.21.15.77:0/2769982453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67401f4b60 con 0x7f67400cf450 2023-11-26T07:21:52.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.769+0000 7f67469a9640 1 -- 172.21.15.77:0/2769982453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6740067470 con 0x7f67400cf450 2023-11-26T07:21:52.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.770+0000 7f673d7fa640 1 -- 172.21.15.77:0/2769982453 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f672801c460 con 0x7f67400cf450 2023-11-26T07:21:52.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.771+0000 7f673d7fa640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f672006b3e0 0x7f672006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.771+0000 7f673d7fa640 1 -- 172.21.15.77:0/2769982453 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6728089f90 con 0x7f67400cf450 2023-11-26T07:21:52.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.771+0000 7f673ffff640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f672006b3e0 0x7f672006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.771+0000 7f673ffff640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f672006b3e0 0x7f672006d8a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6730007fd0 tx=0x7f6730007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:52.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.775+0000 7f673d7fa640 1 -- 172.21.15.77:0/2769982453 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6728054820 con 0x7f67400cf450 2023-11-26T07:21:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:52.997+0000 7f67469a9640 1 -- 172.21.15.77:0/2769982453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f67400cd730 con 0x7f67400cf450 2023-11-26T07:21:53.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.051+0000 7f673d7fa640 1 -- 172.21.15.77:0/2769982453 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 136+0+0 (secure 0 0 0) 0x7f6728057e40 con 0x7f67400cf450 2023-11-26T07:21:53.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 -- 172.21.15.77:0/2769982453 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f672006b3e0 msgr2=0x7f672006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f672006b3e0 0x7f672006d8a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6730007fd0 tx=0x7f6730007ce0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 -- 172.21.15.77:0/2769982453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400cf450 msgr2=0x7f6740152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400cf450 0x7f6740152670 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f672800c430 tx=0x7f672800c8f0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 -- 172.21.15.77:0/2769982453 shutdown_connections 2023-11-26T07:21:53.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f672006b3e0 0x7f672006d8a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f674015c7f0 0x7f6740152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400cf450 0x7f6740152670 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 --2- 172.21.15.77:0/2769982453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67400ce6c0 0x7f67401f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 -- 172.21.15.77:0/2769982453 >> 172.21.15.77:0/2769982453 conn(0x7f674006a920 msgr2=0x7f67400b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:53.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 -- 172.21.15.77:0/2769982453 shutdown_connections 2023-11-26T07:21:53.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.054+0000 7f67469a9640 1 -- 172.21.15.77:0/2769982453 wait complete. 2023-11-26T07:21:53.077 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:21:53.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.274+0000 7f010ded3640 1 Processor -- start 2023-11-26T07:21:53.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.275+0000 7f010ded3640 1 -- start start 2023-11-26T07:21:53.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.276+0000 7f010ded3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01080c9650 0x7f01080c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.276+0000 7f010ded3640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0108166510 con 0x7f01080ccbd0 2023-11-26T07:21:53.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.276+0000 7f010ded3640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01081655f0 con 0x7f01081660b0 2023-11-26T07:21:53.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.276+0000 7f010ded3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01080cc380 con 0x7f01080c9650 2023-11-26T07:21:53.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.276+0000 7f01077fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f01080ccbd0 0x7f01080ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58082/0 (socket says 172.21.15.77:58082) 2023-11-26T07:21:53.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.276+0000 7f01077fe640 1 -- 172.21.15.77:0/3586244054 learned_addr learned my addr 172.21.15.77:0/3586244054 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:53.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311930659 0 0) 0x7f00f8001110 con 0x7f01080ccbd0 2023-11-26T07:21:53.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f4003520 con 0x7f01080ccbd0 2023-11-26T07:21:53.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0107fff640 1 --2- 172.21.15.77:0/3586244054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01080c9650 0x7f01080c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 167642840 0 0) 0x7f00f4003520 con 0x7f01080ccbd0 2023-11-26T07:21:53.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01080c9650 msgr2=0x7f01080c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:53.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 --2- 172.21.15.77:0/3586244054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01080c9650 0x7f01080c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 >> v1:172.21.15.159:6789/0 conn(0x7f01081660b0 legacy=0x7f0108162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:53.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0108162b30 con 0x7f01080ccbd0 2023-11-26T07:21:53.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f00f8001800 con 0x7f01080ccbd0 2023-11-26T07:21:53.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 >> v1:172.21.15.77:6789/0 conn(0x7f01080ccbd0 legacy=0x7f01080ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 --2- 172.21.15.77:0/3586244054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01080c9650 0x7f00f40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 --2- 172.21.15.77:0/3586244054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f4003fb0 0x7f00f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 --2- 172.21.15.77:0/3586244054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4004d00 0x7f00f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01080cc380 con 0x7f00f4003fb0 2023-11-26T07:21:53.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f400bb10 con 0x7f00f4004d00 2023-11-26T07:21:53.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.277+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f400bcd0 con 0x7f01080c9650 2023-11-26T07:21:53.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.278+0000 7f00fffff640 1 --2- 172.21.15.77:0/3586244054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f4003fb0 0x7f00f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.278+0000 7f01077fe640 1 --2- 172.21.15.77:0/3586244054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01080c9650 0x7f00f40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.278+0000 7f00fffff640 1 -- 172.21.15.77:0/3586244054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01080c9650 msgr2=0x7f00f40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:53.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.278+0000 7f00fffff640 1 --2- 172.21.15.77:0/3586244054 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01080c9650 0x7f00f40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.278+0000 7f00fffff640 1 -- 172.21.15.77:0/3586244054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4004d00 msgr2=0x7f00f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:53.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.278+0000 7f00fffff640 1 --2- 172.21.15.77:0/3586244054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4004d00 0x7f00f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.278+0000 7f00fffff640 1 -- 172.21.15.77:0/3586244054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f4003520 con 0x7f00f4003fb0 2023-11-26T07:21:53.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.279+0000 7f00fffff640 1 --2- 172.21.15.77:0/3586244054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f4003fb0 0x7f00f40047c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f00f0003d80 tx=0x7f00f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52551ffb5c4a91 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:53.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.279+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0032600 con 0x7f00f4003fb0 2023-11-26T07:21:53.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.279+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f002e050 con 0x7f00f4003fb0 2023-11-26T07:21:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.279+0000 7f0106ffd640 1 -- 172.21.15.77:0/3586244054 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f00329a0 con 0x7f00f4003fb0 2023-11-26T07:21:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.280+0000 7f010ded3640 1 -- 172.21.15.77:0/3586244054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f4003fb0 msgr2=0x7f00f40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.280+0000 7f010ded3640 1 --2- 172.21.15.77:0/3586244054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f4003fb0 0x7f00f40047c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f00f0003d80 tx=0x7f00f40057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.280+0000 7f0107fff640 1 -- 172.21.15.77:0/3586244054 reap_dead start 2023-11-26T07:21:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.280+0000 7f010ded3640 1 -- 172.21.15.77:0/3586244054 shutdown_connections 2023-11-26T07:21:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.280+0000 7f010ded3640 1 -- 172.21.15.77:0/3586244054 >> 172.21.15.77:0/3586244054 conn(0x7f01080b0c50 msgr2=0x7f01080b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.280+0000 7f010ded3640 1 -- 172.21.15.77:0/3586244054 shutdown_connections 2023-11-26T07:21:53.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.280+0000 7f010ded3640 1 -- 172.21.15.77:0/3586244054 wait complete. 2023-11-26T07:21:53.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.282+0000 7f010ded3640 1 Processor -- start 2023-11-26T07:21:53.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.282+0000 7f010ded3640 1 -- start start 2023-11-26T07:21:53.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f010ded3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f4003fb0 0x7f01081fb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f010ded3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01080ae1e0 0x7f0108163c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f010ded3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0108160c30 0x7f01081610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f010ded3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108161620 con 0x7f01080ae1e0 2023-11-26T07:21:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f010ded3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108164ed0 con 0x7f0108160c30 2023-11-26T07:21:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f010ded3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0108163190 con 0x7f00f4003fb0 2023-11-26T07:21:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f00fffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01080ae1e0 0x7f0108163c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f00fffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01080ae1e0 0x7f0108163c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35944/0 (socket says 172.21.15.77:35944) 2023-11-26T07:21:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f00fffff640 1 -- 172.21.15.77:0/1582902696 learned_addr learned my addr 172.21.15.77:0/1582902696 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f01077fe640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f4003fb0 0x7f01081fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f00fffff640 1 -- 172.21.15.77:0/1582902696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f4003fb0 msgr2=0x7f01081fb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f00fffff640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f4003fb0 0x7f01081fb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f00fffff640 1 -- 172.21.15.77:0/1582902696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0108160c30 msgr2=0x7f01081610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f00fffff640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0108160c30 0x7f01081610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.283+0000 7f00fffff640 1 -- 172.21.15.77:0/1582902696 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01081fbb40 con 0x7f01080ae1e0 2023-11-26T07:21:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.284+0000 7f00fffff640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01080ae1e0 0x7f0108163c00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f00f002bbe0 tx=0x7f00f00036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.284+0000 7f0104ff9640 1 -- 172.21.15.77:0/1582902696 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0007680 con 0x7f01080ae1e0 2023-11-26T07:21:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.284+0000 7f0104ff9640 1 -- 172.21.15.77:0/1582902696 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f003d420 con 0x7f01080ae1e0 2023-11-26T07:21:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.284+0000 7f010ded3640 1 -- 172.21.15.77:0/1582902696 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01081650d0 con 0x7f01080ae1e0 2023-11-26T07:21:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.284+0000 7f0104ff9640 1 -- 172.21.15.77:0/1582902696 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f003d7b0 con 0x7f01080ae1e0 2023-11-26T07:21:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.284+0000 7f010ded3640 1 -- 172.21.15.77:0/1582902696 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01081636e0 con 0x7f01080ae1e0 2023-11-26T07:21:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.285+0000 7f010ded3640 1 -- 172.21.15.77:0/1582902696 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010804e8b0 con 0x7f01080ae1e0 2023-11-26T07:21:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.286+0000 7f0104ff9640 1 -- 172.21.15.77:0/1582902696 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f00f003d910 con 0x7f01080ae1e0 2023-11-26T07:21:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.287+0000 7f0104ff9640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00e806b410 0x7f00e806d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.287+0000 7f0104ff9640 1 -- 172.21.15.77:0/1582902696 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00f00aba20 con 0x7f01080ae1e0 2023-11-26T07:21:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.287+0000 7f01077fe640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00e806b410 0x7f00e806d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.288+0000 7f01077fe640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00e806b410 0x7f00e806d8d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f00f8001eb0 tx=0x7f00f8001600 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:53.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.291+0000 7f0104ff9640 1 -- 172.21.15.77:0/1582902696 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f00f0076370 con 0x7f01080ae1e0 2023-11-26T07:21:53.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.492+0000 7f010ded3640 1 -- 172.21.15.77:0/1582902696 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0108162530 con 0x7f00e806b410 2023-11-26T07:21:53.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.495+0000 7f0104ff9640 1 -- 172.21.15.77:0/1582902696 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0108162530 con 0x7f00e806b410 2023-11-26T07:21:53.499 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-26T07:21:53.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:21:53.500 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cephfs" 2023-11-26T07:21:53.500 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:21:53.500 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-26T07:21:53.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 -- 172.21.15.77:0/1582902696 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00e806b410 msgr2=0x7f00e806d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00e806b410 0x7f00e806d8d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f00f8001eb0 tx=0x7f00f8001600 comp rx=0 tx=0).stop 2023-11-26T07:21:53.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 -- 172.21.15.77:0/1582902696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01080ae1e0 msgr2=0x7f0108163c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01080ae1e0 0x7f0108163c00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f00f002bbe0 tx=0x7f00f00036f0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 -- 172.21.15.77:0/1582902696 shutdown_connections 2023-11-26T07:21:53.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f00e806b410 0x7f00e806d8d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0108160c30 0x7f01081610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01080ae1e0 0x7f0108163c00 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 --2- 172.21.15.77:0/1582902696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f4003fb0 0x7f01081fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 -- 172.21.15.77:0/1582902696 >> 172.21.15.77:0/1582902696 conn(0x7f01080b0c50 msgr2=0x7f01080c9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:53.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 -- 172.21.15.77:0/1582902696 shutdown_connections 2023-11-26T07:21:53.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.498+0000 7f010ded3640 1 -- 172.21.15.77:0/1582902696 wait complete. 2023-11-26T07:21:53.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:21:53.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.724+0000 7f4fad8ea640 1 Processor -- start 2023-11-26T07:21:53.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.725+0000 7f4fad8ea640 1 -- start start 2023-11-26T07:21:53.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.727+0000 7f4fad8ea640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4fa8141b30 0x7f4fa806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.727+0000 7f4fad8ea640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4fa80cede0 0x7f4fa80cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.727+0000 7f4fad8ea640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa80cf770 con 0x7f4fa815ef00 2023-11-26T07:21:53.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.727+0000 7f4fad8ea640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa80ccdf0 con 0x7f4fa8141b30 2023-11-26T07:21:53.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.727+0000 7f4fad8ea640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa815f470 con 0x7f4fa80cede0 2023-11-26T07:21:53.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.727+0000 7f4fac8e8640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4fa8141b30 0x7f4fa806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.727+0000 7f4fad0e9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4fa80cede0 0x7f4fa80cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.727+0000 7f4fa7fff640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f4fa815ef00 0x7f4fa8071700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:44308/0 (socket says 172.21.15.77:44308) 2023-11-26T07:21:53.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.727+0000 7f4fa7fff640 1 -- 172.21.15.77:0/3705820088 learned_addr learned my addr 172.21.15.77:0/3705820088 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:53.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.728+0000 7f4fac8e8640 1 -- 172.21.15.77:0/3705820088 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4fa80cede0 msgr2=0x7f4fa80cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:53.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.728+0000 7f4fac8e8640 1 --2- 172.21.15.77:0/3705820088 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4fa80cede0 0x7f4fa80cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.728+0000 7f4fac8e8640 1 -- 172.21.15.77:0/3705820088 >> v1:172.21.15.159:6789/0 conn(0x7f4fa815ef00 legacy=0x7f4fa8071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.728+0000 7f4fac8e8640 1 -- 172.21.15.77:0/3705820088 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa815f750 con 0x7f4fa8141b30 2023-11-26T07:21:53.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.729+0000 7f4fac8e8640 1 --2- 172.21.15.77:0/3705820088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fa8141b30 0x7f4fa806c770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0097a0 tx=0x7f4f9c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47fabd211d43def8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:53.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.730+0000 7f4fa77fe640 1 -- 172.21.15.77:0/3705820088 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c0316f0 con 0x7f4fa8141b30 2023-11-26T07:21:53.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.730+0000 7f4fa77fe640 1 -- 172.21.15.77:0/3705820088 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c031850 con 0x7f4fa8141b30 2023-11-26T07:21:53.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.730+0000 7f4fa77fe640 1 -- 172.21.15.77:0/3705820088 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c031be0 con 0x7f4fa8141b30 2023-11-26T07:21:53.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.730+0000 7f4fad8ea640 1 -- 172.21.15.77:0/3705820088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fa8141b30 msgr2=0x7f4fa806c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.730+0000 7f4fad8ea640 1 --2- 172.21.15.77:0/3705820088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fa8141b30 0x7f4fa806c770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0097a0 tx=0x7f4f9c02b790 comp rx=0 tx=0).stop 2023-11-26T07:21:53.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.730+0000 7f4fad8ea640 1 -- 172.21.15.77:0/3705820088 shutdown_connections 2023-11-26T07:21:53.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.730+0000 7f4fad8ea640 1 --2- 172.21.15.77:0/3705820088 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4fa80cede0 0x7f4fa80cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.730+0000 7f4fad8ea640 1 --2- 172.21.15.77:0/3705820088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fa8141b30 0x7f4fa806c770 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.730+0000 7f4fad8ea640 1 -- 172.21.15.77:0/3705820088 >> 172.21.15.77:0/3705820088 conn(0x7f4fa806a500 msgr2=0x7f4fa806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:53.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.731+0000 7f4fad8ea640 1 -- 172.21.15.77:0/3705820088 shutdown_connections 2023-11-26T07:21:53.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.731+0000 7f4fad8ea640 1 -- 172.21.15.77:0/3705820088 wait complete. 2023-11-26T07:21:53.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.733+0000 7f4fad8ea640 1 Processor -- start 2023-11-26T07:21:53.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.733+0000 7f4fad8ea640 1 -- start start 2023-11-26T07:21:53.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.734+0000 7f4fad8ea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cede0 0x7f4fa8156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.734+0000 7f4fad8ea640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fa8141b30 0x7f4fa81f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.734+0000 7f4fad8ea640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4fa815ef00 0x7f4fa81f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.734+0000 7f4fad8ea640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa813bc60 con 0x7f4fa80cede0 2023-11-26T07:21:53.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.734+0000 7f4fad8ea640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81f4970 con 0x7f4fa8141b30 2023-11-26T07:21:53.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.734+0000 7f4fad8ea640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81f4c10 con 0x7f4fa815ef00 2023-11-26T07:21:53.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.734+0000 7f4fac8e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cede0 0x7f4fa8156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.734+0000 7f4fac8e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cede0 0x7f4fa8156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35948/0 (socket says 172.21.15.77:35948) 2023-11-26T07:21:53.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.734+0000 7f4fac8e8640 1 -- 172.21.15.77:0/597876304 learned_addr learned my addr 172.21.15.77:0/597876304 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.734+0000 7f4fa7fff640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fa8141b30 0x7f4fa81f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fac8e8640 1 -- 172.21.15.77:0/597876304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4fa815ef00 msgr2=0x7f4fa81f0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fad0e9640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4fa815ef00 0x7f4fa81f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fac8e8640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4fa815ef00 0x7f4fa81f0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fac8e8640 1 -- 172.21.15.77:0/597876304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fa8141b30 msgr2=0x7f4fa81f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fac8e8640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fa8141b30 0x7f4fa81f4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fac8e8640 1 -- 172.21.15.77:0/597876304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c009400 con 0x7f4fa80cede0 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fac8e8640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cede0 0x7f4fa8156ad0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c000c00 tx=0x7f4f9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fa57fa640 1 -- 172.21.15.77:0/597876304 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c034680 con 0x7f4fa80cede0 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fa57fa640 1 -- 172.21.15.77:0/597876304 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c0347e0 con 0x7f4fa80cede0 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fad8ea640 1 -- 172.21.15.77:0/597876304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa81f4ef0 con 0x7f4fa80cede0 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fa57fa640 1 -- 172.21.15.77:0/597876304 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c034b90 con 0x7f4fa80cede0 2023-11-26T07:21:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.735+0000 7f4fad8ea640 1 -- 172.21.15.77:0/597876304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa813b7e0 con 0x7f4fa80cede0 2023-11-26T07:21:53.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.736+0000 7f4fad8ea640 1 -- 172.21.15.77:0/597876304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa813bda0 con 0x7f4fa80cede0 2023-11-26T07:21:53.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.737+0000 7f4fa57fa640 1 -- 172.21.15.77:0/597876304 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f4f9c03b040 con 0x7f4fa80cede0 2023-11-26T07:21:53.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.738+0000 7f4fa57fa640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4f8c06b3e0 0x7f4f8c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.738+0000 7f4fa57fa640 1 -- 172.21.15.77:0/597876304 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f9c0abd30 con 0x7f4fa80cede0 2023-11-26T07:21:53.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.738+0000 7f4fa7fff640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4f8c06b3e0 0x7f4f8c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.739+0000 7f4fa7fff640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4f8c06b3e0 0x7f4f8c06d8a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4fa806c9b0 tx=0x7f4f94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:53.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.742+0000 7f4fa57fa640 1 -- 172.21.15.77:0/597876304 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4fa813bda0 con 0x7f4fa80cede0 2023-11-26T07:21:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.935+0000 7f4fad8ea640 1 -- 172.21.15.77:0/597876304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4fa813b970 con 0x7f4fa80cede0 2023-11-26T07:21:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.935+0000 7f4fa57fa640 1 -- 172.21.15.77:0/597876304 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4f9c04e0c0 con 0x7f4fa80cede0 2023-11-26T07:21:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 -- 172.21.15.77:0/597876304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4f8c06b3e0 msgr2=0x7f4f8c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4f8c06b3e0 0x7f4f8c06d8a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4fa806c9b0 tx=0x7f4f94009040 comp rx=0 tx=0).stop 2023-11-26T07:21:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 -- 172.21.15.77:0/597876304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cede0 msgr2=0x7f4fa8156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cede0 0x7f4fa8156ad0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c000c00 tx=0x7f4f9c0046c0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 -- 172.21.15.77:0/597876304 shutdown_connections 2023-11-26T07:21:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4f8c06b3e0 0x7f4f8c06d8a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4fa815ef00 0x7f4fa81f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fa8141b30 0x7f4fa81f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 --2- 172.21.15.77:0/597876304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cede0 0x7f4fa8156ad0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 -- 172.21.15.77:0/597876304 >> 172.21.15.77:0/597876304 conn(0x7f4fa806a500 msgr2=0x7f4fa806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:53.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 -- 172.21.15.77:0/597876304 shutdown_connections 2023-11-26T07:21:53.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:53.938+0000 7f4fad8ea640 1 -- 172.21.15.77:0/597876304 wait complete. 2023-11-26T07:21:53.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol4780 --mode=777 2023-11-26T07:21:54.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.176+0000 7f8cf6d68640 1 Processor -- start 2023-11-26T07:21:54.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.177+0000 7f8cf6d68640 1 -- start start 2023-11-26T07:21:54.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.178+0000 7f8cf6d68640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf00d19f0 0x7f8cf00d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.178+0000 7f8cf6d68640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8cf00b2700 0x7f8cf00cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.178+0000 7f8cf6d68640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf00b1010 con 0x7f8cf00d0680 2023-11-26T07:21:54.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.178+0000 7f8cf6d68640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00d1230 con 0x7f8cf00b2700 2023-11-26T07:21:54.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.178+0000 7f8cf6d68640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00d2310 con 0x7f8cf00d19f0 2023-11-26T07:21:54.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cf5305640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8cf00d0680 0x7f8cf00ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58092/0 (socket says 172.21.15.77:58092) 2023-11-26T07:21:54.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cf5305640 1 -- 172.21.15.77:0/1010835228 learned_addr learned my addr 172.21.15.77:0/1010835228 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:21:54.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cf4b04640 1 --2- 172.21.15.77:0/1010835228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf00d19f0 0x7f8cf00d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8ceffff640 1 --2- 172.21.15.77:0/1010835228 >> v2:172.21.15.159:3300/0 conn(0x7f8cf00b2700 0x7f8cf00cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111909513 0 0) 0x7f8cf00b1010 con 0x7f8cf00d0680 2023-11-26T07:21:54.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd8003520 con 0x7f8cf00d0680 2023-11-26T07:21:54.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4016928780 0 0) 0x7f8cd8003520 con 0x7f8cf00d0680 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf00d19f0 msgr2=0x7f8cf00d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cef7fe640 1 --2- 172.21.15.77:0/1010835228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf00d19f0 0x7f8cf00d1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 >> v2:172.21.15.159:3300/0 conn(0x7f8cf00b2700 msgr2=0x7f8cf00cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cef7fe640 1 --2- 172.21.15.77:0/1010835228 >> v2:172.21.15.159:3300/0 conn(0x7f8cf00b2700 0x7f8cf00cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00d3b40 con 0x7f8cf00d0680 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f8ce8001670 con 0x7f8cf00d0680 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.179+0000 7f8ceffff640 1 --2- 172.21.15.77:0/1010835228 >> v2:172.21.15.159:3300/0 conn(0x7f8cf00b2700 0x7f8cf00cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 >> v1:172.21.15.77:6789/0 conn(0x7f8cf00d0680 legacy=0x7f8cf00ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8cef7fe640 1 --2- 172.21.15.77:0/1010835228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf00d19f0 0x7f8cd8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8cef7fe640 1 --2- 172.21.15.77:0/1010835228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 0x7f8cd80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8cef7fe640 1 --2- 172.21.15.77:0/1010835228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd8004d00 0x7f8cd8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00d1230 con 0x7f8cd8003f40 2023-11-26T07:21:54.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00d2310 con 0x7f8cd8004d00 2023-11-26T07:21:54.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd800ba30 con 0x7f8cf00d19f0 2023-11-26T07:21:54.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8ceffff640 1 --2- 172.21.15.77:0/1010835228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 0x7f8cd80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8cf4b04640 1 --2- 172.21.15.77:0/1010835228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf00d19f0 0x7f8cd8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8ceffff640 1 -- 172.21.15.77:0/1010835228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf00d19f0 msgr2=0x7f8cd8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:54.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8ceffff640 1 --2- 172.21.15.77:0/1010835228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf00d19f0 0x7f8cd8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8ceffff640 1 -- 172.21.15.77:0/1010835228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd8004d00 msgr2=0x7f8cd8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:54.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8ceffff640 1 --2- 172.21.15.77:0/1010835228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cd8004d00 0x7f8cd8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.180+0000 7f8ceffff640 1 -- 172.21.15.77:0/1010835228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8003520 con 0x7f8cd8003f40 2023-11-26T07:21:54.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.181+0000 7f8ceffff640 1 --2- 172.21.15.77:0/1010835228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 0x7f8cd80047c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40098a0 tx=0x7f8cd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60578388a19c8a06 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.182+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4004230 con 0x7f8cd8003f40 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.182+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce4004390 con 0x7f8cd8003f40 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.182+0000 7f8cef7fe640 1 -- 172.21.15.77:0/1010835228 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4003830 con 0x7f8cd8003f40 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.182+0000 7f8cf6d68640 1 -- 172.21.15.77:0/1010835228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 msgr2=0x7f8cd80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.182+0000 7f8cf6d68640 1 --2- 172.21.15.77:0/1010835228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 0x7f8cd80047c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40098a0 tx=0x7f8cd80057f0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.182+0000 7f8cf5305640 1 -- 172.21.15.77:0/1010835228 reap_dead start 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.182+0000 7f8cf6d68640 1 -- 172.21.15.77:0/1010835228 shutdown_connections 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.182+0000 7f8cf6d68640 1 -- 172.21.15.77:0/1010835228 >> 172.21.15.77:0/1010835228 conn(0x7f8cf008af60 msgr2=0x7f8cf00d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.182+0000 7f8cf6d68640 1 -- 172.21.15.77:0/1010835228 shutdown_connections 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.182+0000 7f8cf6d68640 1 -- 172.21.15.77:0/1010835228 wait complete. 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.184+0000 7f8cf6d68640 1 Processor -- start 2023-11-26T07:21:54.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.184+0000 7f8cf6d68640 1 -- start start 2023-11-26T07:21:54.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.185+0000 7f8cf6d68640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 0x7f8cf00b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.185+0000 7f8cf6d68640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cf01f37b0 0x7f8cf00c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.185+0000 7f8cf6d68640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf01f3c30 0x7f8cf00c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.185+0000 7f8cf6d68640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00b0960 con 0x7f8cd8003f40 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.185+0000 7f8cf6d68640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00b00a0 con 0x7f8cf01f37b0 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.185+0000 7f8cf6d68640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00b0310 con 0x7f8cf01f3c30 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.186+0000 7f8cf4b04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 0x7f8cf00b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.186+0000 7f8cf4b04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 0x7f8cf00b6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35958/0 (socket says 172.21.15.77:35958) 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.186+0000 7f8cf4b04640 1 -- 172.21.15.77:0/3495715175 learned_addr learned my addr 172.21.15.77:0/3495715175 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.186+0000 7f8cf4b04640 1 -- 172.21.15.77:0/3495715175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf01f3c30 msgr2=0x7f8cf00c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.186+0000 7f8cf5305640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf01f3c30 0x7f8cf00c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.186+0000 7f8ceffff640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cf01f37b0 0x7f8cf00c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.186+0000 7f8cf4b04640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf01f3c30 0x7f8cf00c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.186+0000 7f8cf4b04640 1 -- 172.21.15.77:0/3495715175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cf01f37b0 msgr2=0x7f8cf00c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.186+0000 7f8cf4b04640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cf01f37b0 0x7f8cf00c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.186+0000 7f8cf4b04640 1 -- 172.21.15.77:0/3495715175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00b05f0 con 0x7f8cd8003f40 2023-11-26T07:21:54.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.186+0000 7f8cf5305640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf01f3c30 0x7f8cf00c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:54.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.187+0000 7f8cf4b04640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 0x7f8cf00b6900 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0007f60 tx=0x7f8ce0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:54.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.187+0000 7f8ced7fa640 1 -- 172.21.15.77:0/3495715175 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000e030 con 0x7f8cd8003f40 2023-11-26T07:21:54.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.187+0000 7f8ced7fa640 1 -- 172.21.15.77:0/3495715175 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce0016470 con 0x7f8cd8003f40 2023-11-26T07:21:54.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.187+0000 7f8ced7fa640 1 -- 172.21.15.77:0/3495715175 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0016820 con 0x7f8cd8003f40 2023-11-26T07:21:54.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.187+0000 7f8cf6d68640 1 -- 172.21.15.77:0/3495715175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf00b6e40 con 0x7f8cd8003f40 2023-11-26T07:21:54.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.187+0000 7f8cf6d68640 1 -- 172.21.15.77:0/3495715175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf00c8ed0 con 0x7f8cd8003f40 2023-11-26T07:21:54.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.188+0000 7f8cf6d68640 1 -- 172.21.15.77:0/3495715175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf0067470 con 0x7f8cd8003f40 2023-11-26T07:21:54.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.189+0000 7f8ced7fa640 1 -- 172.21.15.77:0/3495715175 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f8ce0016b90 con 0x7f8cd8003f40 2023-11-26T07:21:54.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.190+0000 7f8ced7fa640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8cdc06b410 0x7f8cdc06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.190+0000 7f8ced7fa640 1 -- 172.21.15.77:0/3495715175 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ce000f070 con 0x7f8cd8003f40 2023-11-26T07:21:54.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.191+0000 7f8ceffff640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8cdc06b410 0x7f8cdc06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.191+0000 7f8ceffff640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8cdc06b410 0x7f8cdc06d8d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4035000 tx=0x7f8ce4039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:54.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.195+0000 7f8ced7fa640 1 -- 172.21.15.77:0/3495715175 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8ce0055980 con 0x7f8cd8003f40 2023-11-26T07:21:54.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.410+0000 7f8cf6d68640 1 -- 172.21.15.77:0/3495715175 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol4780", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cf00c7ae0 con 0x7f8cdc06b410 2023-11-26T07:21:54.423 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:21:54.421+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:54.424 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:21:54.421+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:54.424 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:21:54.421+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:54.424 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:21:54.421+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:54.424 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:21:54.421+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:54.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.484+0000 7f8ced7fa640 1 -- 172.21.15.77:0/3495715175 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8cf00c7ae0 con 0x7f8cdc06b410 2023-11-26T07:21:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.486+0000 7f8cf6d68640 1 -- 172.21.15.77:0/3495715175 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8cdc06b410 msgr2=0x7f8cdc06d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.486+0000 7f8cf6d68640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8cdc06b410 0x7f8cdc06d8d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4035000 tx=0x7f8ce4039040 comp rx=0 tx=0).stop 2023-11-26T07:21:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.487+0000 7f8cf6d68640 1 -- 172.21.15.77:0/3495715175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 msgr2=0x7f8cf00b6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.487+0000 7f8cf6d68640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 0x7f8cf00b6900 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0007f60 tx=0x7f8ce0007f90 comp rx=0 tx=0).stop 2023-11-26T07:21:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.487+0000 7f8cf6d68640 1 -- 172.21.15.77:0/3495715175 shutdown_connections 2023-11-26T07:21:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.487+0000 7f8cf6d68640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8cdc06b410 0x7f8cdc06d8d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.487+0000 7f8cf6d68640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8cf01f3c30 0x7f8cf00c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.487+0000 7f8cf6d68640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cf01f37b0 0x7f8cf00c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.487+0000 7f8cf6d68640 1 --2- 172.21.15.77:0/3495715175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cd8003f40 0x7f8cf00b6900 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.487+0000 7f8cf6d68640 1 -- 172.21.15.77:0/3495715175 >> 172.21.15.77:0/3495715175 conn(0x7f8cf008af60 msgr2=0x7f8cf00b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.487+0000 7f8cf6d68640 1 -- 172.21.15.77:0/3495715175 shutdown_connections 2023-11-26T07:21:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.487+0000 7f8cf6d68640 1 -- 172.21.15.77:0/3495715175 wait complete. 2023-11-26T07:21:54.509 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol4780 2023-11-26T07:21:54.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.710+0000 7fccee54c640 1 Processor -- start 2023-11-26T07:21:54.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.710+0000 7fccee54c640 1 -- start start 2023-11-26T07:21:54.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.712+0000 7fccee54c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcce80af000 0x7fcce80b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.712+0000 7fccee54c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce806dca0 con 0x7fcce8161060 2023-11-26T07:21:54.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.712+0000 7fccee54c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce806df40 con 0x7fcce806b680 2023-11-26T07:21:54.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.712+0000 7fccee54c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce80af3e0 con 0x7fcce80af000 2023-11-26T07:21:54.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.712+0000 7fcce7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcce80af000 0x7fcce80b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.713+0000 7fcce7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcce80af000 0x7fcce80b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35996/0 (socket says 172.21.15.77:35996) 2023-11-26T07:21:54.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.713+0000 7fcce7fff640 1 -- 172.21.15.77:0/3571150591 learned_addr learned my addr 172.21.15.77:0/3571150591 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:54.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.713+0000 7fcce77fe640 1 --1- 172.21.15.77:0/3571150591 >> v1:172.21.15.77:6789/0 conn(0x7fcce8161060 0x7fcce815da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58096/0 (socket says 172.21.15.77:58096) 2023-11-26T07:21:54.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.713+0000 7fcce7fff640 1 -- 172.21.15.77:0/3571150591 >> v1:172.21.15.159:6789/0 conn(0x7fcce806b680 legacy=0x7fcce815e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:54.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.713+0000 7fcce7fff640 1 -- 172.21.15.77:0/3571150591 >> v1:172.21.15.77:6789/0 conn(0x7fcce8161060 legacy=0x7fcce815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.713+0000 7fcce6ffd640 1 -- 172.21.15.77:0/3571150591 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155665403 0 0) 0x7fcce806dca0 con 0x7fcce8161060 2023-11-26T07:21:54.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.713+0000 7fcce7fff640 1 -- 172.21.15.77:0/3571150591 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce806e220 con 0x7fcce80af000 2023-11-26T07:21:54.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.714+0000 7fcce7fff640 1 --2- 172.21.15.77:0/3571150591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce80af000 0x7fcce80b3330 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fccd80098a0 tx=0x7fccd802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5988924fc45a9d90 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:54.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.715+0000 7fcce6ffd640 1 -- 172.21.15.77:0/3571150591 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8030840 con 0x7fcce80af000 2023-11-26T07:21:54.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.715+0000 7fcce6ffd640 1 -- 172.21.15.77:0/3571150591 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd80309a0 con 0x7fcce80af000 2023-11-26T07:21:54.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.715+0000 7fcce6ffd640 1 -- 172.21.15.77:0/3571150591 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8030d30 con 0x7fcce80af000 2023-11-26T07:21:54.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.715+0000 7fccee54c640 1 -- 172.21.15.77:0/3571150591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce80af000 msgr2=0x7fcce80b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.715+0000 7fccee54c640 1 --2- 172.21.15.77:0/3571150591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce80af000 0x7fcce80b3330 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fccd80098a0 tx=0x7fccd802b980 comp rx=0 tx=0).stop 2023-11-26T07:21:54.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.715+0000 7fccee54c640 1 -- 172.21.15.77:0/3571150591 shutdown_connections 2023-11-26T07:21:54.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.715+0000 7fccee54c640 1 --2- 172.21.15.77:0/3571150591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce80af000 0x7fcce80b3330 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.715+0000 7fccee54c640 1 -- 172.21.15.77:0/3571150591 >> 172.21.15.77:0/3571150591 conn(0x7fcce80cf900 msgr2=0x7fcce80cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:54.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.715+0000 7fccee54c640 1 -- 172.21.15.77:0/3571150591 shutdown_connections 2023-11-26T07:21:54.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.715+0000 7fccee54c640 1 -- 172.21.15.77:0/3571150591 wait complete. 2023-11-26T07:21:54.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.717+0000 7fccee54c640 1 Processor -- start 2023-11-26T07:21:54.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.717+0000 7fccee54c640 1 -- start start 2023-11-26T07:21:54.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.718+0000 7fccee54c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce806b680 0x7fcce81e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.718+0000 7fccee54c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcce80af000 0x7fcce81e7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.718+0000 7fccee54c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce8161060 0x7fcce815de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.718+0000 7fccee54c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8153020 con 0x7fcce8161060 2023-11-26T07:21:54.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.718+0000 7fccee54c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8152e20 con 0x7fcce806b680 2023-11-26T07:21:54.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.718+0000 7fccee54c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce81e8520 con 0x7fcce80af000 2023-11-26T07:21:54.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fccecae9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce8161060 0x7fcce815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fccecae9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce8161060 0x7fcce815de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36000/0 (socket says 172.21.15.77:36000) 2023-11-26T07:21:54.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fccecae9640 1 -- 172.21.15.77:0/1257262547 learned_addr learned my addr 172.21.15.77:0/1257262547 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:21:54.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fccecae9640 1 -- 172.21.15.77:0/1257262547 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcce80af000 msgr2=0x7fcce81e7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fccecae9640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcce80af000 0x7fcce81e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fccecae9640 1 -- 172.21.15.77:0/1257262547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce806b680 msgr2=0x7fcce81e7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fccecae9640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce806b680 0x7fcce81e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fccecae9640 1 -- 172.21.15.77:0/1257262547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd80094d0 con 0x7fcce8161060 2023-11-26T07:21:54.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fccecae9640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce8161060 0x7fcce815de30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c700 tx=0x7fcce000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:54.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fcce4ff9640 1 -- 172.21.15.77:0/1257262547 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce000aa50 con 0x7fcce8161060 2023-11-26T07:21:54.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fcce4ff9640 1 -- 172.21.15.77:0/1257262547 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce000abb0 con 0x7fcce8161060 2023-11-26T07:21:54.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.719+0000 7fcce4ff9640 1 -- 172.21.15.77:0/1257262547 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce000ce10 con 0x7fcce8161060 2023-11-26T07:21:54.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.720+0000 7fccee54c640 1 -- 172.21.15.77:0/1257262547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce81f71c0 con 0x7fcce8161060 2023-11-26T07:21:54.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.720+0000 7fccee54c640 1 -- 172.21.15.77:0/1257262547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce81f7780 con 0x7fcce8161060 2023-11-26T07:21:54.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.721+0000 7fccee54c640 1 -- 172.21.15.77:0/1257262547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce8153160 con 0x7fcce8161060 2023-11-26T07:21:54.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.722+0000 7fcce4ff9640 1 -- 172.21.15.77:0/1257262547 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fcce0012420 con 0x7fcce8161060 2023-11-26T07:21:54.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.722+0000 7fcce4ff9640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccd406b3e0 0x7fccd406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.723+0000 7fcce4ff9640 1 -- 172.21.15.77:0/1257262547 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcce008a570 con 0x7fcce8161060 2023-11-26T07:21:54.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.723+0000 7fcce7fff640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccd406b3e0 0x7fccd406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.724+0000 7fcce7fff640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccd406b3e0 0x7fccd406d8a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fccd8036000 tx=0x7fccd803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:54.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.727+0000 7fcce4ff9640 1 -- 172.21.15.77:0/1257262547 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcce0054d70 con 0x7fcce8161060 2023-11-26T07:21:54.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.945+0000 7fccee54c640 1 -- 172.21.15.77:0/1257262547 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol4780", "target": ["mon-mgr", ""]}) v1 -- 0x7fcce806eac0 con 0x7fccd406b3e0 2023-11-26T07:21:54.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.952+0000 7fcce4ff9640 1 -- 172.21.15.77:0/1257262547 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7fccd8030b10 con 0x7fccd406b3e0 2023-11-26T07:21:54.954 INFO:teuthology.orchestra.run.smithi077.stdout:/volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9 2023-11-26T07:21:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.954+0000 7fccee54c640 1 -- 172.21.15.77:0/1257262547 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccd406b3e0 msgr2=0x7fccd406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.954+0000 7fccee54c640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccd406b3e0 0x7fccd406d8a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fccd8036000 tx=0x7fccd803b040 comp rx=0 tx=0).stop 2023-11-26T07:21:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.954+0000 7fccee54c640 1 -- 172.21.15.77:0/1257262547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce8161060 msgr2=0x7fcce815de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.954+0000 7fccee54c640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce8161060 0x7fcce815de30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c700 tx=0x7fcce000cbc0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.954+0000 7fccee54c640 1 -- 172.21.15.77:0/1257262547 shutdown_connections 2023-11-26T07:21:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.954+0000 7fccee54c640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fccd406b3e0 0x7fccd406d8a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.954+0000 7fccee54c640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce8161060 0x7fcce815de30 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.954+0000 7fccee54c640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcce80af000 0x7fcce81e7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.954+0000 7fccee54c640 1 --2- 172.21.15.77:0/1257262547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce806b680 0x7fcce81e7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.954+0000 7fccee54c640 1 -- 172.21.15.77:0/1257262547 >> 172.21.15.77:0/1257262547 conn(0x7fcce80cf900 msgr2=0x7fcce80cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.955+0000 7fccee54c640 1 -- 172.21.15.77:0/1257262547 shutdown_connections 2023-11-26T07:21:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:21:54.955+0000 7fccee54c640 1 -- 172.21.15.77:0/1257262547 wait complete. 2023-11-26T07:21:54.975 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol4780 with 200 files each 1MB size under directory volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9 2023-11-26T07:21:54.975 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:54.975 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:55.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:55.023 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303629 s, 34.5 MB/s 2023-11-26T07:21:55.167 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:55.168 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:55.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:55.226 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:55.320 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:55.320 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:55.320 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0407636 s, 25.7 MB/s 2023-11-26T07:21:55.322 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:55.322 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:55.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:55.379 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305364 s, 34.3 MB/s 2023-11-26T07:21:55.465 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:55.466 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:55.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:55.524 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:55.619 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:55.619 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:55.619 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0398977 s, 26.3 MB/s 2023-11-26T07:21:55.621 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:55.621 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:55.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:55.676 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:55.767 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:55.767 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:55.767 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0404377 s, 25.9 MB/s 2023-11-26T07:21:55.769 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:55.769 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:55.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:55.822 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:55.903 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:55.903 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:55.903 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252099 s, 41.6 MB/s 2023-11-26T07:21:55.904 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:55.904 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:55.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:55.956 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:56.034 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:56.034 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:56.034 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267993 s, 39.1 MB/s 2023-11-26T07:21:56.035 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:56.036 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:56.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:56.091 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0580208 s, 18.1 MB/s 2023-11-26T07:21:56.203 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:56.204 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:56.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:56.257 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:56.330 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:56.330 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:56.330 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217799 s, 48.1 MB/s 2023-11-26T07:21:56.331 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:56.331 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:56.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:56.390 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:56.470 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241545 s, 43.4 MB/s 2023-11-26T07:21:56.472 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:56.472 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:56.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:56.528 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:56.602 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:56.602 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:56.602 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207029 s, 50.6 MB/s 2023-11-26T07:21:56.604 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:56.604 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:56.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:56.659 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:56.740 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:56.740 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:56.740 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263595 s, 39.8 MB/s 2023-11-26T07:21:56.742 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:56.742 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:56.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:56.796 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:56.873 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:56.873 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:56.873 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234562 s, 44.7 MB/s 2023-11-26T07:21:56.874 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:56.874 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:56.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:56.931 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:57.010 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:57.010 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:57.010 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231291 s, 45.3 MB/s 2023-11-26T07:21:57.012 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:57.012 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:57.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:57.067 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:57.147 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:57.147 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:57.147 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219751 s, 47.7 MB/s 2023-11-26T07:21:57.149 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:57.149 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:57.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:57.202 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:57.271 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:57.271 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:57.271 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212615 s, 49.3 MB/s 2023-11-26T07:21:57.273 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:57.273 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:57.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:57.329 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:57.405 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:57.405 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:57.405 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257967 s, 40.6 MB/s 2023-11-26T07:21:57.407 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:57.407 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:57.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:57.460 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:57.594 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:57.594 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:57.595 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322118 s, 32.6 MB/s 2023-11-26T07:21:57.596 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:57.596 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:57.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:57.654 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:57.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:21:57.708 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:21:57.729 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:57.730 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:57.730 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223912 s, 46.8 MB/s 2023-11-26T07:21:57.731 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:57.731 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:57.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:57.821 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:57.949 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:57.949 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:57.949 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265116 s, 39.6 MB/s 2023-11-26T07:21:57.951 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:57.951 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:58.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:58.011 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:58.089 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:58.089 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:58.089 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240066 s, 43.7 MB/s 2023-11-26T07:21:58.090 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:58.090 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:58.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:58.140 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:58.273 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:58.273 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:58.273 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310744 s, 33.7 MB/s 2023-11-26T07:21:58.274 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:58.274 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:58.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:58.325 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:58.397 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:58.397 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:58.397 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234122 s, 44.8 MB/s 2023-11-26T07:21:58.399 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:58.399 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:58.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:58.451 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229652 s, 45.7 MB/s 2023-11-26T07:21:58.531 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:58.531 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:58.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:58.591 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:58.666 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:58.666 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:58.667 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227104 s, 46.2 MB/s 2023-11-26T07:21:58.669 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:58.669 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:58.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:58.728 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:58.798 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:58.798 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:58.798 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165642 s, 63.3 MB/s 2023-11-26T07:21:58.800 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:58.800 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:58.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:58.854 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:58.929 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:58.929 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:58.930 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233883 s, 44.8 MB/s 2023-11-26T07:21:58.931 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:58.931 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:58.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:58.987 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:59.062 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:59.062 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:59.062 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238148 s, 44.0 MB/s 2023-11-26T07:21:59.063 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:59.064 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:59.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:59.115 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:59.195 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:59.195 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:59.195 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295783 s, 35.5 MB/s 2023-11-26T07:21:59.196 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:59.196 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:59.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:59.247 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:59.380 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:59.381 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:59.381 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300205 s, 34.9 MB/s 2023-11-26T07:21:59.382 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:59.382 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:59.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:59.439 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186839 s, 56.1 MB/s 2023-11-26T07:21:59.510 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:59.510 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:59.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:59.563 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:59.636 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:59.636 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:59.637 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223943 s, 46.8 MB/s 2023-11-26T07:21:59.638 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:59.638 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:59.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:59.690 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:59.779 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:59.779 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:59.779 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0370918 s, 28.3 MB/s 2023-11-26T07:21:59.781 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:59.781 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:59.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:59.839 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:59.910 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:21:59.910 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:21:59.910 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017674 s, 59.3 MB/s 2023-11-26T07:21:59.911 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:21:59.912 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:59.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:59.962 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:00.088 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:00.088 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:00.088 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025398 s, 41.3 MB/s 2023-11-26T07:22:00.089 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:00.089 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:00.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:00.143 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:00.226 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:00.227 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:00.227 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292326 s, 35.9 MB/s 2023-11-26T07:22:00.228 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:00.228 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:00.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:00.284 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:00.359 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:00.359 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:00.359 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205821 s, 50.9 MB/s 2023-11-26T07:22:00.361 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:00.361 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:00.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:00.418 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203007 s, 51.7 MB/s 2023-11-26T07:22:00.492 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:00.493 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:00.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:00.546 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:00.624 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:00.624 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:00.624 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231603 s, 45.3 MB/s 2023-11-26T07:22:00.625 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:00.625 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:00.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:00.679 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227557 s, 46.1 MB/s 2023-11-26T07:22:00.755 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:00.755 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:00.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:00.808 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:00.886 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:00.887 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:00.887 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258613 s, 40.5 MB/s 2023-11-26T07:22:00.888 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:00.888 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:00.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:00.946 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:01.027 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:01.027 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:01.027 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293043 s, 35.8 MB/s 2023-11-26T07:22:01.029 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:01.029 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:01.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.082 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:01.159 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:01.159 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:01.159 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197786 s, 53.0 MB/s 2023-11-26T07:22:01.160 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:01.161 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:01.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.218 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:01.297 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:01.297 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:01.298 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260278 s, 40.3 MB/s 2023-11-26T07:22:01.299 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:01.299 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:01.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.353 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:01.435 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:01.435 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:01.435 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281885 s, 37.2 MB/s 2023-11-26T07:22:01.436 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:01.436 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:01.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.486 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:01.557 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:01.557 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:01.557 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189918 s, 55.2 MB/s 2023-11-26T07:22:01.559 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:01.559 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:01.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.615 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:01.689 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:01.689 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:01.689 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217397 s, 48.2 MB/s 2023-11-26T07:22:01.691 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:01.691 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:01.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.749 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:01.829 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:01.829 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:01.830 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278083 s, 37.7 MB/s 2023-11-26T07:22:01.831 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:01.831 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:01.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.890 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:01.964 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:01.964 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:01.964 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210921 s, 49.7 MB/s 2023-11-26T07:22:01.965 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:01.965 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:02.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.019 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:02.098 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:02.098 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:02.098 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246637 s, 42.5 MB/s 2023-11-26T07:22:02.099 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:02.100 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:02.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.157 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:02.237 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:02.237 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:02.237 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271942 s, 38.6 MB/s 2023-11-26T07:22:02.238 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:02.239 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:02.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.292 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246537 s, 42.5 MB/s 2023-11-26T07:22:02.373 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:02.373 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:02.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.431 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:02.513 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:02.513 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:02.513 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238793 s, 43.9 MB/s 2023-11-26T07:22:02.515 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:02.515 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:02.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.569 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:02.647 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:02.647 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:02.647 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253723 s, 41.3 MB/s 2023-11-26T07:22:02.648 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:02.648 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:02.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.707 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:02.798 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:02.798 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:02.798 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327196 s, 32.0 MB/s 2023-11-26T07:22:02.800 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:02.800 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:02.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.858 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:02.936 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:02.937 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:02.937 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263179 s, 39.8 MB/s 2023-11-26T07:22:02.938 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:02.938 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:02.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.996 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290592 s, 36.1 MB/s 2023-11-26T07:22:03.080 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:03.080 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:03.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.138 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:03.213 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:03.214 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:03.214 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259742 s, 40.4 MB/s 2023-11-26T07:22:03.215 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:03.215 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:03.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.273 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:03.353 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:03.353 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:03.353 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268558 s, 39.0 MB/s 2023-11-26T07:22:03.354 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:03.354 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:03.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.411 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:03.488 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:03.489 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256583 s, 40.9 MB/s 2023-11-26T07:22:03.490 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:03.490 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:03.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.548 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:03.627 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:03.628 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:03.628 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209545 s, 50.0 MB/s 2023-11-26T07:22:03.629 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:03.629 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:03.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.683 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225889 s, 46.4 MB/s 2023-11-26T07:22:03.757 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:03.757 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:03.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.812 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:03.894 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:03.894 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:03.894 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302212 s, 34.7 MB/s 2023-11-26T07:22:03.895 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:03.895 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:03.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.953 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:04.040 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:04.040 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:04.041 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033576 s, 31.2 MB/s 2023-11-26T07:22:04.042 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:04.043 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:04.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:04.101 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:04.182 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:04.182 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:04.182 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263394 s, 39.8 MB/s 2023-11-26T07:22:04.184 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:04.184 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:04.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:04.242 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:04.314 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:04.315 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:04.315 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202682 s, 51.7 MB/s 2023-11-26T07:22:04.316 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:04.317 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:04.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:04.373 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:04.449 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:04.449 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:04.449 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220571 s, 47.5 MB/s 2023-11-26T07:22:04.451 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:04.451 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:04.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:04.507 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:04.586 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:04.586 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236514 s, 44.3 MB/s 2023-11-26T07:22:04.587 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:04.588 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:04.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:04.645 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:04.723 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:04.723 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:04.723 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243637 s, 43.0 MB/s 2023-11-26T07:22:04.725 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:04.725 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:04.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:04.780 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:04.857 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:04.857 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:04.857 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265039 s, 39.6 MB/s 2023-11-26T07:22:04.859 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:04.859 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:04.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:04.916 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:04.995 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:04.995 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:04.995 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246907 s, 42.5 MB/s 2023-11-26T07:22:04.997 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:04.997 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:05.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:05.052 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209375 s, 50.1 MB/s 2023-11-26T07:22:05.129 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:05.129 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:05.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:05.183 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256555 s, 40.9 MB/s 2023-11-26T07:22:05.264 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:05.264 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:05.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:05.322 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:05.399 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:05.399 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:05.399 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216261 s, 48.5 MB/s 2023-11-26T07:22:05.400 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:05.400 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:05.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:05.453 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:05.527 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:05.527 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:05.527 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201154 s, 52.1 MB/s 2023-11-26T07:22:05.529 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:05.529 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:05.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:05.585 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029858 s, 35.1 MB/s 2023-11-26T07:22:05.670 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:05.671 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:05.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:05.728 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:05.801 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:05.801 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:05.801 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209241 s, 50.1 MB/s 2023-11-26T07:22:05.802 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:05.802 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:05.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:05.859 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281613 s, 37.2 MB/s 2023-11-26T07:22:05.943 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:05.943 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:05.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:05.999 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287905 s, 36.4 MB/s 2023-11-26T07:22:06.083 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:06.083 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.139 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.217 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:06.217 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:06.217 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253322 s, 41.4 MB/s 2023-11-26T07:22:06.219 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:06.219 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.278 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.353 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:06.354 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:06.354 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235498 s, 44.5 MB/s 2023-11-26T07:22:06.355 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:06.355 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.411 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.492 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:06.493 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:06.493 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274973 s, 38.1 MB/s 2023-11-26T07:22:06.494 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:06.494 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.553 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.630 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:06.631 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:06.631 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238979 s, 43.9 MB/s 2023-11-26T07:22:06.632 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:06.633 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.687 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.759 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:06.759 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:06.759 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192626 s, 54.4 MB/s 2023-11-26T07:22:06.761 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:06.761 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.819 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.894 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:06.894 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:06.894 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209472 s, 50.1 MB/s 2023-11-26T07:22:06.895 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:06.895 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.948 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.024 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:07.024 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:07.024 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256531 s, 40.9 MB/s 2023-11-26T07:22:07.026 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:07.026 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.080 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.154 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:07.154 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:07.154 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236192 s, 44.4 MB/s 2023-11-26T07:22:07.156 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:07.156 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.213 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321166 s, 32.6 MB/s 2023-11-26T07:22:07.300 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:07.301 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.355 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.428 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:07.428 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:07.428 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216782 s, 48.4 MB/s 2023-11-26T07:22:07.429 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:07.430 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.480 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220265 s, 47.6 MB/s 2023-11-26T07:22:07.603 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:07.603 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.659 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.739 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:07.740 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:07.740 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025792 s, 40.7 MB/s 2023-11-26T07:22:07.741 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:07.741 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.800 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.877 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:07.878 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:07.878 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233829 s, 44.8 MB/s 2023-11-26T07:22:07.879 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:07.879 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.936 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.017 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:08.017 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:08.017 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280456 s, 37.4 MB/s 2023-11-26T07:22:08.019 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:08.019 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.076 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226295 s, 46.3 MB/s 2023-11-26T07:22:08.155 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:08.155 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.209 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285466 s, 36.7 MB/s 2023-11-26T07:22:08.291 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:08.291 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.349 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.424 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:08.425 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:08.425 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214437 s, 48.9 MB/s 2023-11-26T07:22:08.426 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:08.426 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.478 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.558 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291096 s, 36.0 MB/s 2023-11-26T07:22:08.560 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:08.560 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.616 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.687 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:08.687 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:08.687 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018789 s, 55.8 MB/s 2023-11-26T07:22:08.688 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:08.689 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.746 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.822 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:08.822 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:08.822 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219364 s, 47.8 MB/s 2023-11-26T07:22:08.824 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:08.824 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.877 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.951 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:08.952 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:08.952 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246779 s, 42.5 MB/s 2023-11-26T07:22:08.953 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:08.953 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.010 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.083 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:09.083 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:09.084 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180049 s, 58.2 MB/s 2023-11-26T07:22:09.085 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:09.085 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.143 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.224 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:09.224 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:09.225 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276609 s, 37.9 MB/s 2023-11-26T07:22:09.226 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:09.226 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.283 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.360 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:09.360 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:09.361 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246324 s, 42.6 MB/s 2023-11-26T07:22:09.362 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:09.362 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.420 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:09.502 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:09.502 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270041 s, 38.8 MB/s 2023-11-26T07:22:09.503 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:09.504 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.559 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.637 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:09.637 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:09.637 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242924 s, 43.2 MB/s 2023-11-26T07:22:09.639 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:09.639 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.694 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.767 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:09.767 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:09.767 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208897 s, 50.2 MB/s 2023-11-26T07:22:09.769 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:09.769 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.825 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.899 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:09.899 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:09.900 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230022 s, 45.6 MB/s 2023-11-26T07:22:09.901 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:09.901 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.956 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.034 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:10.034 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:10.034 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264587 s, 39.6 MB/s 2023-11-26T07:22:10.036 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:10.036 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.095 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.174 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:10.174 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:10.174 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245782 s, 42.7 MB/s 2023-11-26T07:22:10.176 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:10.176 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.230 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.303 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222014 s, 47.2 MB/s 2023-11-26T07:22:10.306 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:10.306 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.362 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253436 s, 41.4 MB/s 2023-11-26T07:22:10.445 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:10.445 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.501 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212658 s, 49.3 MB/s 2023-11-26T07:22:10.577 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:10.577 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.633 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.705 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:10.705 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:10.705 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215535 s, 48.6 MB/s 2023-11-26T07:22:10.707 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:10.707 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.765 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.845 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:10.845 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:10.845 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268916 s, 39.0 MB/s 2023-11-26T07:22:10.847 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:10.847 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.902 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.975 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:10.976 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:10.976 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222007 s, 47.2 MB/s 2023-11-26T07:22:10.977 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:10.977 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.030 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.104 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:11.105 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:11.105 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211243 s, 49.6 MB/s 2023-11-26T07:22:11.106 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:11.106 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.161 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197717 s, 53.0 MB/s 2023-11-26T07:22:11.235 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:11.235 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.285 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.406 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:11.406 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:11.406 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210292 s, 49.9 MB/s 2023-11-26T07:22:11.408 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:11.408 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.462 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.538 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:11.538 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:11.538 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275112 s, 38.1 MB/s 2023-11-26T07:22:11.540 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:11.540 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.595 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.675 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:11.675 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:11.675 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296782 s, 35.3 MB/s 2023-11-26T07:22:11.676 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:11.677 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.734 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.809 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:11.809 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:11.809 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239524 s, 43.8 MB/s 2023-11-26T07:22:11.810 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:11.810 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.863 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264872 s, 39.6 MB/s 2023-11-26T07:22:11.993 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:11.993 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.051 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.127 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:12.128 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:12.128 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216103 s, 48.5 MB/s 2023-11-26T07:22:12.129 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:12.130 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.187 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.271 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:12.271 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:12.271 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303602 s, 34.5 MB/s 2023-11-26T07:22:12.273 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:12.273 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.332 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203883 s, 51.4 MB/s 2023-11-26T07:22:12.409 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:12.409 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.462 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.534 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:12.534 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:12.535 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255213 s, 41.1 MB/s 2023-11-26T07:22:12.536 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:12.536 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.591 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:12.661 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:12.661 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203812 s, 51.4 MB/s 2023-11-26T07:22:12.662 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:12.662 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.720 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205102 s, 51.1 MB/s 2023-11-26T07:22:12.794 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:12.794 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.847 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.924 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:12.924 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:12.924 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026682 s, 39.3 MB/s 2023-11-26T07:22:12.926 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:12.926 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.980 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.050 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:13.050 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:13.050 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161483 s, 64.9 MB/s 2023-11-26T07:22:13.052 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:13.052 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.104 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250374 s, 41.9 MB/s 2023-11-26T07:22:13.183 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:13.183 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.241 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.315 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:13.315 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:13.315 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227361 s, 46.1 MB/s 2023-11-26T07:22:13.316 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:13.317 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.372 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.453 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:13.453 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:13.453 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244663 s, 42.9 MB/s 2023-11-26T07:22:13.455 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:13.455 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.511 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.583 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:13.583 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:13.583 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221031 s, 47.4 MB/s 2023-11-26T07:22:13.585 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:13.585 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.644 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.720 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:13.720 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:13.720 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237225 s, 44.2 MB/s 2023-11-26T07:22:13.722 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:13.722 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.777 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225226 s, 46.6 MB/s 2023-11-26T07:22:13.858 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:13.858 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.913 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.983 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:13.984 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:13.984 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176203 s, 59.5 MB/s 2023-11-26T07:22:13.985 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:13.985 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.041 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.109 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:14.109 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:14.109 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180338 s, 58.1 MB/s 2023-11-26T07:22:14.111 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:14.111 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.166 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.246 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:14.246 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:14.246 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256677 s, 40.9 MB/s 2023-11-26T07:22:14.247 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:14.248 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.306 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222497 s, 47.1 MB/s 2023-11-26T07:22:14.383 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:14.383 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.439 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.514 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:14.514 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:14.514 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236729 s, 44.3 MB/s 2023-11-26T07:22:14.516 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:14.516 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.572 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.653 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:14.654 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:14.654 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261969 s, 40.0 MB/s 2023-11-26T07:22:14.655 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:14.655 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.711 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.792 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:14.792 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:14.792 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262367 s, 40.0 MB/s 2023-11-26T07:22:14.794 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:14.794 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.852 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.925 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:14.925 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:14.926 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236727 s, 44.3 MB/s 2023-11-26T07:22:14.927 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:14.927 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.981 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.106 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:15.106 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:15.106 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239412 s, 43.8 MB/s 2023-11-26T07:22:15.108 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:15.108 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.166 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.246 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:15.246 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:15.246 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255351 s, 41.1 MB/s 2023-11-26T07:22:15.248 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:15.248 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.301 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.428 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:15.428 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:15.428 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248845 s, 42.1 MB/s 2023-11-26T07:22:15.429 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:15.429 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.482 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.564 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:15.564 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:15.564 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251415 s, 41.7 MB/s 2023-11-26T07:22:15.565 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:15.566 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.622 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.703 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:15.703 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:15.703 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311774 s, 33.6 MB/s 2023-11-26T07:22:15.705 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:15.705 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.757 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.827 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:15.827 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:15.827 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217717 s, 48.2 MB/s 2023-11-26T07:22:15.829 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:15.829 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.882 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.958 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:15.958 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:15.958 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222681 s, 47.1 MB/s 2023-11-26T07:22:15.959 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:15.960 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.014 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.137 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:16.138 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:16.138 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242587 s, 43.2 MB/s 2023-11-26T07:22:16.139 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:16.139 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.195 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.281 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:16.281 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:16.281 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0363294 s, 28.9 MB/s 2023-11-26T07:22:16.283 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:16.283 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.340 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.422 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:16.422 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:16.422 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267972 s, 39.1 MB/s 2023-11-26T07:22:16.423 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:16.424 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.484 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.559 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:16.559 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:16.559 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206042 s, 50.9 MB/s 2023-11-26T07:22:16.561 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:16.561 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.615 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.693 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:16.693 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:16.693 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232382 s, 45.1 MB/s 2023-11-26T07:22:16.695 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:16.695 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.753 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.829 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:16.829 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:16.829 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230814 s, 45.4 MB/s 2023-11-26T07:22:16.831 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:16.831 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.889 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.964 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:16.964 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:16.964 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216753 s, 48.4 MB/s 2023-11-26T07:22:16.966 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:16.966 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.025 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.104 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:17.104 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:17.104 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250272 s, 41.9 MB/s 2023-11-26T07:22:17.106 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:17.106 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.161 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.238 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:17.239 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:17.239 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250125 s, 41.9 MB/s 2023-11-26T07:22:17.240 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:17.240 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.296 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.373 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:17.373 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:17.373 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223011 s, 47.0 MB/s 2023-11-26T07:22:17.375 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:17.375 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.432 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.498 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:17.498 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:17.498 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018947 s, 55.3 MB/s 2023-11-26T07:22:17.499 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:17.499 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.545 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.669 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:17.669 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:17.669 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242864 s, 43.2 MB/s 2023-11-26T07:22:17.671 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:17.671 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.729 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.807 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:17.807 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243682 s, 43.0 MB/s 2023-11-26T07:22:17.809 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:17.809 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.862 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.934 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:17.935 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:17.935 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229008 s, 45.8 MB/s 2023-11-26T07:22:17.936 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:17.936 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.992 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.070 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:18.070 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:18.070 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267285 s, 39.2 MB/s 2023-11-26T07:22:18.072 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:18.072 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.130 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.210 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:18.211 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:18.211 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266962 s, 39.3 MB/s 2023-11-26T07:22:18.212 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:18.212 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.268 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.339 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:18.339 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:18.339 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203288 s, 51.6 MB/s 2023-11-26T07:22:18.341 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:18.341 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.395 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210785 s, 49.7 MB/s 2023-11-26T07:22:18.470 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:18.470 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.526 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.599 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022837 s, 45.9 MB/s 2023-11-26T07:22:18.657 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:18.658 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.718 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.790 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:18.790 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:18.790 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169614 s, 61.8 MB/s 2023-11-26T07:22:18.792 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:18.792 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.849 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.928 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:18.928 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:18.928 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266286 s, 39.4 MB/s 2023-11-26T07:22:18.930 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:18.930 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.985 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.061 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:19.061 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:19.062 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245998 s, 42.6 MB/s 2023-11-26T07:22:19.063 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:19.063 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.120 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163363 s, 64.2 MB/s 2023-11-26T07:22:19.189 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:19.189 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.246 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:19.327 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268328 s, 39.1 MB/s 2023-11-26T07:22:19.328 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:19.328 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.385 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.458 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:19.458 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:19.458 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217859 s, 48.1 MB/s 2023-11-26T07:22:19.459 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:19.459 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.517 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.598 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:19.598 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:19.598 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027151 s, 38.6 MB/s 2023-11-26T07:22:19.600 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:19.600 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.657 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.734 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:19.735 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:19.735 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249139 s, 42.1 MB/s 2023-11-26T07:22:19.736 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:19.736 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.793 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.861 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:19.862 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:19.862 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161434 s, 65.0 MB/s 2023-11-26T07:22:19.863 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:19.863 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.917 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.996 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:19.996 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:19.997 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023605 s, 44.4 MB/s 2023-11-26T07:22:19.998 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:19.998 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.056 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:20.130 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228808 s, 45.8 MB/s 2023-11-26T07:22:20.132 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:20.132 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.191 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.266 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:20.266 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:20.266 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236371 s, 44.4 MB/s 2023-11-26T07:22:20.267 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:20.268 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.325 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.399 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:20.399 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:20.399 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218734 s, 47.9 MB/s 2023-11-26T07:22:20.401 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:20.401 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.458 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.540 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:20.540 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:20.540 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269562 s, 38.9 MB/s 2023-11-26T07:22:20.542 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:20.542 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.597 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.679 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:20.680 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:20.680 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027928 s, 37.5 MB/s 2023-11-26T07:22:20.681 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:20.682 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.740 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.823 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:20.823 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:20.824 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029128 s, 36.0 MB/s 2023-11-26T07:22:20.825 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:20.825 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.880 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.950 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:20.950 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:20.950 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176761 s, 59.3 MB/s 2023-11-26T07:22:20.951 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:20.952 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.005 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.068 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147805 s, 70.9 MB/s 2023-11-26T07:22:21.070 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:21.070 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.119 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.244 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:21.244 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:21.244 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247597 s, 42.4 MB/s 2023-11-26T07:22:21.246 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:21.246 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.305 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.387 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:21.388 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:21.388 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250341 s, 41.9 MB/s 2023-11-26T07:22:21.389 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:21.389 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.446 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.518 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:21.519 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:21.519 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202147 s, 51.9 MB/s 2023-11-26T07:22:21.520 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:21.521 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.578 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.660 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:21.661 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:21.661 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285398 s, 36.7 MB/s 2023-11-26T07:22:21.663 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:21.663 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.723 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.803 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:21.803 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:21.803 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249554 s, 42.0 MB/s 2023-11-26T07:22:21.805 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:21.805 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.862 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.934 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216295 s, 48.5 MB/s 2023-11-26T07:22:21.936 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:21.936 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.988 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.062 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:22.062 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:22.062 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218188 s, 48.1 MB/s 2023-11-26T07:22:22.063 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:22.064 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.120 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.199 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:22.199 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:22.199 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281159 s, 37.3 MB/s 2023-11-26T07:22:22.200 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:22.201 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.256 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.330 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:22.330 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:22.330 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199756 s, 52.5 MB/s 2023-11-26T07:22:22.332 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:22.332 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.390 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.471 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:22.471 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:22.471 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208061 s, 50.4 MB/s 2023-11-26T07:22:22.472 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:22.472 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.517 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.634 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:22.635 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:22.635 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232822 s, 45.0 MB/s 2023-11-26T07:22:22.636 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:22.636 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.690 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol4780/e7f7602f-a265-4a88-9905-86da5baff3e9/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:22:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:22:22.771 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246986 s, 42.5 MB/s 2023-11-26T07:22:22.772 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol4780 subvol_snap93340 2023-11-26T07:22:23.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:22.998+0000 7f8b49b0f640 1 Processor -- start 2023-11-26T07:22:23.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:22.999+0000 7f8b49b0f640 1 -- start start 2023-11-26T07:22:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.000+0000 7f8b49b0f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b4415eaf0 0x7f8b440b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.000+0000 7f8b49b0f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b440b3890 0x7f8b44167110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.000+0000 7f8b49b0f640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4406d180 con 0x7f8b441461d0 2023-11-26T07:22:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.000+0000 7f8b49b0f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b440b3d20 con 0x7f8b4415eaf0 2023-11-26T07:22:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.000+0000 7f8b49b0f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4406ba70 con 0x7f8b440b3890 2023-11-26T07:22:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.000+0000 7f8b42ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b4415eaf0 0x7f8b440b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.001+0000 7f8b42ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b4415eaf0 0x7f8b440b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40474/0 (socket says 172.21.15.77:40474) 2023-11-26T07:22:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.001+0000 7f8b42ffd640 1 -- 172.21.15.77:0/2873023322 learned_addr learned my addr 172.21.15.77:0/2873023322 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.001+0000 7f8b42ffd640 1 -- 172.21.15.77:0/2873023322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b440b3890 msgr2=0x7f8b44167110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:23.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.001+0000 7f8b43fff640 1 --2- 172.21.15.77:0/2873023322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b440b3890 0x7f8b44167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.001+0000 7f8b42ffd640 1 --2- 172.21.15.77:0/2873023322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b440b3890 0x7f8b44167110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.001+0000 7f8b42ffd640 1 -- 172.21.15.77:0/2873023322 >> v1:172.21.15.159:6789/0 conn(0x7f8b441461d0 legacy=0x7f8b440b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:23.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.001+0000 7f8b42ffd640 1 -- 172.21.15.77:0/2873023322 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4406bd50 con 0x7f8b4415eaf0 2023-11-26T07:22:23.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.002+0000 7f8b42ffd640 1 --2- 172.21.15.77:0/2873023322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4415eaf0 0x7f8b440b3350 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009870 tx=0x7f8b2c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e515e0776a338484 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.002+0000 7f8b427fc640 1 -- 172.21.15.77:0/2873023322 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c031640 con 0x7f8b4415eaf0 2023-11-26T07:22:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.003+0000 7f8b427fc640 1 -- 172.21.15.77:0/2873023322 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c0317a0 con 0x7f8b4415eaf0 2023-11-26T07:22:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.003+0000 7f8b427fc640 1 -- 172.21.15.77:0/2873023322 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c031b30 con 0x7f8b4415eaf0 2023-11-26T07:22:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.003+0000 7f8b49b0f640 1 -- 172.21.15.77:0/2873023322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4415eaf0 msgr2=0x7f8b440b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.003+0000 7f8b49b0f640 1 --2- 172.21.15.77:0/2873023322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4415eaf0 0x7f8b440b3350 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009870 tx=0x7f8b2c02b8f0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.003+0000 7f8b49b0f640 1 -- 172.21.15.77:0/2873023322 shutdown_connections 2023-11-26T07:22:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.003+0000 7f8b49b0f640 1 --2- 172.21.15.77:0/2873023322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b440b3890 0x7f8b44167110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.003+0000 7f8b49b0f640 1 --2- 172.21.15.77:0/2873023322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4415eaf0 0x7f8b440b3350 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.003+0000 7f8b49b0f640 1 -- 172.21.15.77:0/2873023322 >> 172.21.15.77:0/2873023322 conn(0x7f8b44061340 msgr2=0x7f8b44061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:23.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.003+0000 7f8b49b0f640 1 -- 172.21.15.77:0/2873023322 shutdown_connections 2023-11-26T07:22:23.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.003+0000 7f8b49b0f640 1 -- 172.21.15.77:0/2873023322 wait complete. 2023-11-26T07:22:23.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.005+0000 7f8b49b0f640 1 Processor -- start 2023-11-26T07:22:23.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.005+0000 7f8b49b0f640 1 -- start start 2023-11-26T07:22:23.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.006+0000 7f8b49b0f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b440b3890 0x7f8b4415c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.006+0000 7f8b49b0f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b441461d0 0x7f8b440cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.006+0000 7f8b49b0f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4415eaf0 0x7f8b440d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.006+0000 7f8b49b0f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440d0750 con 0x7f8b4415eaf0 2023-11-26T07:22:23.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.006+0000 7f8b49b0f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440cfe20 con 0x7f8b440b3890 2023-11-26T07:22:23.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.006+0000 7f8b49b0f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440d0090 con 0x7f8b441461d0 2023-11-26T07:22:23.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.006+0000 7f8b43fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4415eaf0 0x7f8b440d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.006+0000 7f8b43fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4415eaf0 0x7f8b440d0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40476/0 (socket says 172.21.15.77:40476) 2023-11-26T07:22:23.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.006+0000 7f8b43fff640 1 -- 172.21.15.77:0/773142994 learned_addr learned my addr 172.21.15.77:0/773142994 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:23.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.007+0000 7f8b42ffd640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b441461d0 0x7f8b440cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.007+0000 7f8b437fe640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b440b3890 0x7f8b4415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.007+0000 7f8b43fff640 1 -- 172.21.15.77:0/773142994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b441461d0 msgr2=0x7f8b440cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.007+0000 7f8b43fff640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b441461d0 0x7f8b440cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.007+0000 7f8b43fff640 1 -- 172.21.15.77:0/773142994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b440b3890 msgr2=0x7f8b4415c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.007+0000 7f8b43fff640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b440b3890 0x7f8b4415c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.007+0000 7f8b43fff640 1 -- 172.21.15.77:0/773142994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0094d0 con 0x7f8b4415eaf0 2023-11-26T07:22:23.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.007+0000 7f8b43fff640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4415eaf0 0x7f8b440d0b70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00c820 tx=0x7f8b3c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:23.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.007+0000 7f8b3bfff640 1 -- 172.21.15.77:0/773142994 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c004020 con 0x7f8b4415eaf0 2023-11-26T07:22:23.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.008+0000 7f8b3bfff640 1 -- 172.21.15.77:0/773142994 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c004180 con 0x7f8b4415eaf0 2023-11-26T07:22:23.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.008+0000 7f8b3bfff640 1 -- 172.21.15.77:0/773142994 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c007830 con 0x7f8b4415eaf0 2023-11-26T07:22:23.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.008+0000 7f8b49b0f640 1 -- 172.21.15.77:0/773142994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b440d0370 con 0x7f8b4415eaf0 2023-11-26T07:22:23.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.008+0000 7f8b49b0f640 1 -- 172.21.15.77:0/773142994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b440ce6b0 con 0x7f8b4415eaf0 2023-11-26T07:22:23.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.009+0000 7f8b49b0f640 1 -- 172.21.15.77:0/773142994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b440d0890 con 0x7f8b4415eaf0 2023-11-26T07:22:23.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.010+0000 7f8b3bfff640 1 -- 172.21.15.77:0/773142994 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) v1 ==== 89792+0+0 (secure 0 0 0) 0x7f8b3c007990 con 0x7f8b4415eaf0 2023-11-26T07:22:23.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.011+0000 7f8b3bfff640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b2406b470 0x7f8b2406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.011+0000 7f8b3bfff640 1 -- 172.21.15.77:0/773142994 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b3c089f60 con 0x7f8b4415eaf0 2023-11-26T07:22:23.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.011+0000 7f8b437fe640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b2406b470 0x7f8b2406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.012+0000 7f8b437fe640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b2406b470 0x7f8b2406d930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8b34005520 tx=0x7f8b34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:23.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.016+0000 7f8b3bfff640 1 -- 172.21.15.77:0/773142994 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b440d0890 con 0x7f8b4415eaf0 2023-11-26T07:22:23.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.235+0000 7f8b49b0f640 1 -- 172.21.15.77:0/773142994 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol4780", "snap_name": "subvol_snap93340", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b4406c5f0 con 0x7f8b2406b470 2023-11-26T07:22:23.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.270+0000 7f8b3bfff640 1 -- 172.21.15.77:0/773142994 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8b34005110 con 0x7f8b2406b470 2023-11-26T07:22:23.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.272+0000 7f8b49b0f640 1 -- 172.21.15.77:0/773142994 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b2406b470 msgr2=0x7f8b2406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.272+0000 7f8b49b0f640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b2406b470 0x7f8b2406d930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8b34005520 tx=0x7f8b34009040 comp rx=0 tx=0).stop 2023-11-26T07:22:23.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.272+0000 7f8b49b0f640 1 -- 172.21.15.77:0/773142994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4415eaf0 msgr2=0x7f8b440d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.272+0000 7f8b49b0f640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4415eaf0 0x7f8b440d0b70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00c820 tx=0x7f8b3c00cce0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.273+0000 7f8b49b0f640 1 -- 172.21.15.77:0/773142994 shutdown_connections 2023-11-26T07:22:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.273+0000 7f8b49b0f640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8b2406b470 0x7f8b2406d930 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.273+0000 7f8b49b0f640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4415eaf0 0x7f8b440d0b70 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.273+0000 7f8b49b0f640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b441461d0 0x7f8b440cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.273+0000 7f8b49b0f640 1 --2- 172.21.15.77:0/773142994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b440b3890 0x7f8b4415c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.273+0000 7f8b49b0f640 1 -- 172.21.15.77:0/773142994 >> 172.21.15.77:0/773142994 conn(0x7f8b44061340 msgr2=0x7f8b441453c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.273+0000 7f8b49b0f640 1 -- 172.21.15.77:0/773142994 shutdown_connections 2023-11-26T07:22:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.273+0000 7f8b49b0f640 1 -- 172.21.15.77:0/773142994 wait complete. 2023-11-26T07:22:23.295 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:22:23.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.493+0000 7f9d79941640 1 Processor -- start 2023-11-26T07:22:23.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.493+0000 7f9d79941640 1 -- start start 2023-11-26T07:22:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.495+0000 7f9d79941640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9d74072160 0x7f9d7415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.495+0000 7f9d79941640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7415ec90 con 0x7f9d740c49f0 2023-11-26T07:22:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.495+0000 7f9d79941640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d740cd530 con 0x7f9d7406de10 2023-11-26T07:22:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.495+0000 7f9d79941640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d740c4ed0 con 0x7f9d74072160 2023-11-26T07:22:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.495+0000 7f9d72ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9d74072160 0x7f9d7415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.495+0000 7f9d72ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9d74072160 0x7f9d7415e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40478/0 (socket says 172.21.15.77:40478) 2023-11-26T07:22:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.495+0000 7f9d72ffd640 1 -- 172.21.15.77:0/3602574603 learned_addr learned my addr 172.21.15.77:0/3602574603 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:23.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.495+0000 7f9d6bfff640 1 --1- 172.21.15.77:0/3602574603 >> v1:172.21.15.77:6789/0 conn(0x7f9d740c49f0 0x7f9d7406d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:39536/0 (socket says 172.21.15.77:39536) 2023-11-26T07:22:23.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.496+0000 7f9d72ffd640 1 -- 172.21.15.77:0/3602574603 >> v1:172.21.15.159:6789/0 conn(0x7f9d7406de10 legacy=0x7f9d740705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:23.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.496+0000 7f9d72ffd640 1 -- 172.21.15.77:0/3602574603 >> v1:172.21.15.77:6789/0 conn(0x7f9d740c49f0 legacy=0x7f9d7406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.496+0000 7f9d72ffd640 1 -- 172.21.15.77:0/3602574603 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d740c51b0 con 0x7f9d74072160 2023-11-26T07:22:23.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.496+0000 7f9d727fc640 1 -- 172.21.15.77:0/3602574603 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064784354 0 0) 0x7f9d5c001110 con 0x7f9d740c49f0 2023-11-26T07:22:23.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.497+0000 7f9d72ffd640 1 --2- 172.21.15.77:0/3602574603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d74072160 0x7f9d7415e750 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009870 tx=0x7f9d6402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5aa6ae757fc844 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:23.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.497+0000 7f9d727fc640 1 -- 172.21.15.77:0/3602574603 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64030860 con 0x7f9d74072160 2023-11-26T07:22:23.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.497+0000 7f9d727fc640 1 -- 172.21.15.77:0/3602574603 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d640309c0 con 0x7f9d74072160 2023-11-26T07:22:23.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.497+0000 7f9d727fc640 1 -- 172.21.15.77:0/3602574603 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64030d50 con 0x7f9d74072160 2023-11-26T07:22:23.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.498+0000 7f9d79941640 1 -- 172.21.15.77:0/3602574603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d74072160 msgr2=0x7f9d7415e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.498+0000 7f9d79941640 1 --2- 172.21.15.77:0/3602574603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d74072160 0x7f9d7415e750 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009870 tx=0x7f9d6402b9a0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.498+0000 7f9d79941640 1 -- 172.21.15.77:0/3602574603 shutdown_connections 2023-11-26T07:22:23.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.498+0000 7f9d79941640 1 --2- 172.21.15.77:0/3602574603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d74072160 0x7f9d7415e750 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.498+0000 7f9d79941640 1 -- 172.21.15.77:0/3602574603 >> 172.21.15.77:0/3602574603 conn(0x7f9d740b0c50 msgr2=0x7f9d740b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:23.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.498+0000 7f9d79941640 1 -- 172.21.15.77:0/3602574603 shutdown_connections 2023-11-26T07:22:23.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.498+0000 7f9d79941640 1 -- 172.21.15.77:0/3602574603 wait complete. 2023-11-26T07:22:23.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.500+0000 7f9d79941640 1 Processor -- start 2023-11-26T07:22:23.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.500+0000 7f9d79941640 1 -- start start 2023-11-26T07:22:23.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.501+0000 7f9d79941640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d7406de10 0x7f9d740999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.501+0000 7f9d79941640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d74072160 0x7f9d74156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.501+0000 7f9d79941640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9d740c49f0 0x7f9d74145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.501+0000 7f9d79941640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74158fd0 con 0x7f9d74072160 2023-11-26T07:22:23.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.501+0000 7f9d79941640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74158350 con 0x7f9d7406de10 2023-11-26T07:22:23.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.501+0000 7f9d79941640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74158630 con 0x7f9d740c49f0 2023-11-26T07:22:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.501+0000 7f9d6bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d74072160 0x7f9d74156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.501+0000 7f9d6bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d74072160 0x7f9d74156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40488/0 (socket says 172.21.15.77:40488) 2023-11-26T07:22:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.501+0000 7f9d6bfff640 1 -- 172.21.15.77:0/2605435751 learned_addr learned my addr 172.21.15.77:0/2605435751 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d72ffd640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d7406de10 0x7f9d740999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d737fe640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9d740c49f0 0x7f9d74145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d6bfff640 1 -- 172.21.15.77:0/2605435751 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9d740c49f0 msgr2=0x7f9d74145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d6bfff640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9d740c49f0 0x7f9d74145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d6bfff640 1 -- 172.21.15.77:0/2605435751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d7406de10 msgr2=0x7f9d740999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d6bfff640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d7406de10 0x7f9d740999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d6bfff640 1 -- 172.21.15.77:0/2605435751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d640094d0 con 0x7f9d74072160 2023-11-26T07:22:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d72ffd640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d7406de10 0x7f9d740999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d737fe640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9d740c49f0 0x7f9d74145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d6bfff640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d74072160 0x7f9d74156830 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00c4d0 tx=0x7f9d5c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d70ff9640 1 -- 172.21.15.77:0/2605435751 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c006480 con 0x7f9d74072160 2023-11-26T07:22:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d70ff9640 1 -- 172.21.15.77:0/2605435751 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c006600 con 0x7f9d74072160 2023-11-26T07:22:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d70ff9640 1 -- 172.21.15.77:0/2605435751 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c004a00 con 0x7f9d74072160 2023-11-26T07:22:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.502+0000 7f9d79941640 1 -- 172.21.15.77:0/2605435751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d74158910 con 0x7f9d74072160 2023-11-26T07:22:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.503+0000 7f9d79941640 1 -- 172.21.15.77:0/2605435751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d74099f10 con 0x7f9d74072160 2023-11-26T07:22:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.504+0000 7f9d79941640 1 -- 172.21.15.77:0/2605435751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7409a130 con 0x7f9d74072160 2023-11-26T07:22:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.505+0000 7f9d70ff9640 1 -- 172.21.15.77:0/2605435751 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) v1 ==== 89792+0+0 (secure 0 0 0) 0x7f9d5c004b60 con 0x7f9d74072160 2023-11-26T07:22:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.506+0000 7f9d70ff9640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9d5406b470 0x7f9d5406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.506+0000 7f9d70ff9640 1 -- 172.21.15.77:0/2605435751 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d5c089520 con 0x7f9d74072160 2023-11-26T07:22:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.506+0000 7f9d72ffd640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9d5406b470 0x7f9d5406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.506+0000 7f9d72ffd640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9d5406b470 0x7f9d5406d930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9d64036000 tx=0x7f9d6403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:23.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.510+0000 7f9d70ff9640 1 -- 172.21.15.77:0/2605435751 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d7409a130 con 0x7f9d74072160 2023-11-26T07:22:23.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.699+0000 7f9d79941640 1 -- 172.21.15.77:0/2605435751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f9d74159110 con 0x7f9d74072160 2023-11-26T07:22:23.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.704+0000 7f9d70ff9640 1 -- 172.21.15.77:0/2605435751 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v19)=0 v19) v1 ==== 130+0+0 (secure 0 0 0) 0x7f9d74159110 con 0x7f9d74072160 2023-11-26T07:22:23.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 -- 172.21.15.77:0/2605435751 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9d5406b470 msgr2=0x7f9d5406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9d5406b470 0x7f9d5406d930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9d64036000 tx=0x7f9d6403b040 comp rx=0 tx=0).stop 2023-11-26T07:22:23.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 -- 172.21.15.77:0/2605435751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d74072160 msgr2=0x7f9d74156830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d74072160 0x7f9d74156830 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00c4d0 tx=0x7f9d5c00c990 comp rx=0 tx=0).stop 2023-11-26T07:22:23.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 -- 172.21.15.77:0/2605435751 shutdown_connections 2023-11-26T07:22:23.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f9d5406b470 0x7f9d5406d930 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9d740c49f0 0x7f9d74145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d74072160 0x7f9d74156830 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 --2- 172.21.15.77:0/2605435751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d7406de10 0x7f9d740999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 -- 172.21.15.77:0/2605435751 >> 172.21.15.77:0/2605435751 conn(0x7f9d740b0c50 msgr2=0x7f9d7415de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:23.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 -- 172.21.15.77:0/2605435751 shutdown_connections 2023-11-26T07:22:23.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.707+0000 7f9d79941640 1 -- 172.21.15.77:0/2605435751 wait complete. 2023-11-26T07:22:23.727 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:23.725+0000 7f59b5dfe640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:23.727 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:23.725+0000 7f59b5dfe640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:23.727 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:23.725+0000 7f59b5dfe640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:23.728 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:23.725+0000 7f59b5dfe640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:23.728 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:23.725+0000 7f59b5dfe640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:23.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol4780 subvol_snap93340 subvol_clone63530 2023-11-26T07:22:23.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.925+0000 7f03d759e640 1 Processor -- start 2023-11-26T07:22:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.925+0000 7f03d759e640 1 -- start start 2023-11-26T07:22:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.927+0000 7f03d759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03d80b63d0 0x7f03d80d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.927+0000 7f03d759e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d80cea30 con 0x7f03d80ce270 2023-11-26T07:22:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.927+0000 7f03d759e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d80ce750 con 0x7f03d815d490 2023-11-26T07:22:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.927+0000 7f03d759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80d0450 con 0x7f03d80b63d0 2023-11-26T07:22:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.927+0000 7f03d6d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f03d80ce270 0x7f03d80d1250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:39546/0 (socket says 172.21.15.77:39546) 2023-11-26T07:22:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.927+0000 7f03d6d9d640 1 -- 172.21.15.77:0/1823642169 learned_addr learned my addr 172.21.15.77:0/1823642169 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.927+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523060199 0 0) 0x7f03d80cea30 con 0x7f03d80ce270 2023-11-26T07:22:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.927+0000 7f03cdd9b640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03d80b63d0 0x7f03d80d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.927+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c4003520 con 0x7f03d80ce270 2023-11-26T07:22:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4273698773 0 0) 0x7f03c4003520 con 0x7f03d80ce270 2023-11-26T07:22:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03d80b63d0 msgr2=0x7f03d80d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:23.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03d80b63d0 0x7f03d80d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 >> v1:172.21.15.159:6789/0 conn(0x7f03d815d490 legacy=0x7f03d80cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d80d0630 con 0x7f03d80ce270 2023-11-26T07:22:23.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f03d00019f0 con 0x7f03d80ce270 2023-11-26T07:22:23.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 >> v1:172.21.15.77:6789/0 conn(0x7f03d80ce270 legacy=0x7f03d80d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03c40039a0 0x7f03c4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03c40047c0 0x7f03c4004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03c4005140 0x7f03c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80d0450 con 0x7f03c40039a0 2023-11-26T07:22:23.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c400bec0 con 0x7f03c4005140 2023-11-26T07:22:23.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c400c000 con 0x7f03c40047c0 2023-11-26T07:22:23.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.928+0000 7f03d659c640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03c40039a0 0x7f03c4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.929+0000 7f03cdd9b640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03c40047c0 0x7f03c4004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.929+0000 7f03d6d9d640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03c4005140 0x7f03c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.929+0000 7f03d659c640 1 -- 172.21.15.77:0/1823642169 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03c40047c0 msgr2=0x7f03c4004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:23.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.929+0000 7f03d659c640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03c40047c0 0x7f03c4004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.929+0000 7f03d659c640 1 -- 172.21.15.77:0/1823642169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03c4005140 msgr2=0x7f03c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:23.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.929+0000 7f03d659c640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03c4005140 0x7f03c400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.929+0000 7f03d659c640 1 -- 172.21.15.77:0/1823642169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4003520 con 0x7f03c40039a0 2023-11-26T07:22:23.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.930+0000 7f03d659c640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03c40039a0 0x7f03c4003dc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f03c8001750 tx=0x7f03c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833c710ddd54655 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:23.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.930+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80052d0 con 0x7f03c40039a0 2023-11-26T07:22:23.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.930+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c802e050 con 0x7f03c40039a0 2023-11-26T07:22:23.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.930+0000 7f03d5d9b640 1 -- 172.21.15.77:0/1823642169 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80035f0 con 0x7f03c40039a0 2023-11-26T07:22:23.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.931+0000 7f03d759e640 1 -- 172.21.15.77:0/1823642169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03c40039a0 msgr2=0x7f03c4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.931+0000 7f03d759e640 1 --2- 172.21.15.77:0/1823642169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03c40039a0 0x7f03c4003dc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f03c8001750 tx=0x7f03c40057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.931+0000 7f03d6d9d640 1 -- 172.21.15.77:0/1823642169 reap_dead start 2023-11-26T07:22:23.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.931+0000 7f03d759e640 1 -- 172.21.15.77:0/1823642169 shutdown_connections 2023-11-26T07:22:23.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.931+0000 7f03d759e640 1 -- 172.21.15.77:0/1823642169 >> 172.21.15.77:0/1823642169 conn(0x7f03d8061340 msgr2=0x7f03d8061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:23.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.931+0000 7f03d759e640 1 -- 172.21.15.77:0/1823642169 shutdown_connections 2023-11-26T07:22:23.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.931+0000 7f03d759e640 1 -- 172.21.15.77:0/1823642169 wait complete. 2023-11-26T07:22:23.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.933+0000 7f03d759e640 1 Processor -- start 2023-11-26T07:22:23.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.933+0000 7f03d759e640 1 -- start start 2023-11-26T07:22:23.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.934+0000 7f03d759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03c40039a0 0x7f03d80c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.934+0000 7f03d759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03d814f080 0x7f03d80c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.934+0000 7f03d759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03d80c8d40 0x7f03d80c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.934+0000 7f03d759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80d0bf0 con 0x7f03d80c8d40 2023-11-26T07:22:23.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.934+0000 7f03d759e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d815ff00 con 0x7f03c40039a0 2023-11-26T07:22:23.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.934+0000 7f03d759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d815f5a0 con 0x7f03d814f080 2023-11-26T07:22:23.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.934+0000 7f03d6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03d80c8d40 0x7f03d80c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.934+0000 7f03d6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03d80c8d40 0x7f03d80c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40502/0 (socket says 172.21.15.77:40502) 2023-11-26T07:22:23.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.934+0000 7f03d6d9d640 1 -- 172.21.15.77:0/2977393703 learned_addr learned my addr 172.21.15.77:0/2977393703 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:23.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.934+0000 7f03cdd9b640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03d814f080 0x7f03d80c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.934+0000 7f03d659c640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03c40039a0 0x7f03d80c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.935+0000 7f03d6d9d640 1 -- 172.21.15.77:0/2977393703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03d814f080 msgr2=0x7f03d80c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.935+0000 7f03d6d9d640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03d814f080 0x7f03d80c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.935+0000 7f03d6d9d640 1 -- 172.21.15.77:0/2977393703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03c40039a0 msgr2=0x7f03d80c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:23.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.935+0000 7f03d6d9d640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03c40039a0 0x7f03d80c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:23.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.935+0000 7f03d6d9d640 1 -- 172.21.15.77:0/2977393703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d80b9200 con 0x7f03d80c8d40 2023-11-26T07:22:23.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.935+0000 7f03d6d9d640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03d80c8d40 0x7f03d80c91c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f03d0007c40 tx=0x7f03d000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:23.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.935+0000 7f03cf7fe640 1 -- 172.21.15.77:0/2977393703 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0004d60 con 0x7f03d80c8d40 2023-11-26T07:22:23.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.935+0000 7f03cf7fe640 1 -- 172.21.15.77:0/2977393703 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d000bb80 con 0x7f03d80c8d40 2023-11-26T07:22:23.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.935+0000 7f03cf7fe640 1 -- 172.21.15.77:0/2977393703 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0007070 con 0x7f03d80c8d40 2023-11-26T07:22:23.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.935+0000 7f03d759e640 1 -- 172.21.15.77:0/2977393703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d80c9700 con 0x7f03d80c8d40 2023-11-26T07:22:23.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.935+0000 7f03d759e640 1 -- 172.21.15.77:0/2977393703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d815f840 con 0x7f03d80c8d40 2023-11-26T07:22:23.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.937+0000 7f03d759e640 1 -- 172.21.15.77:0/2977393703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d8160040 con 0x7f03d80c8d40 2023-11-26T07:22:23.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.937+0000 7f03cf7fe640 1 -- 172.21.15.77:0/2977393703 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) v1 ==== 89792+0+0 (secure 0 0 0) 0x7f03d00071d0 con 0x7f03d80c8d40 2023-11-26T07:22:23.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.938+0000 7f03cf7fe640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f03b806b470 0x7f03b806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:23.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.938+0000 7f03cf7fe640 1 -- 172.21.15.77:0/2977393703 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03d008a460 con 0x7f03d80c8d40 2023-11-26T07:22:23.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.939+0000 7f03d659c640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f03b806b470 0x7f03b806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:23.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.939+0000 7f03d659c640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f03b806b470 0x7f03b806d930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f03c8033000 tx=0x7f03c8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:23.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:23.943+0000 7f03cf7fe640 1 -- 172.21.15.77:0/2977393703 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03d8160040 con 0x7f03d80c8d40 2023-11-26T07:22:24.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.170+0000 7f03d759e640 1 -- 172.21.15.77:0/2977393703 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol4780", "snap_name": "subvol_snap93340", "target_sub_name": "subvol_clone63530", "target": ["mon-mgr", ""]}) v1 -- 0x7f03d8160040 con 0x7f03b806b470 2023-11-26T07:22:24.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.316+0000 7f03cf7fe640 1 -- 172.21.15.77:0/2977393703 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f03d8160040 con 0x7f03b806b470 2023-11-26T07:22:24.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.319+0000 7f03d759e640 1 -- 172.21.15.77:0/2977393703 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f03b806b470 msgr2=0x7f03b806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:24.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.319+0000 7f03d759e640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f03b806b470 0x7f03b806d930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f03c8033000 tx=0x7f03c8009030 comp rx=0 tx=0).stop 2023-11-26T07:22:24.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.319+0000 7f03d759e640 1 -- 172.21.15.77:0/2977393703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03d80c8d40 msgr2=0x7f03d80c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:24.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.319+0000 7f03d759e640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03d80c8d40 0x7f03d80c91c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f03d0007c40 tx=0x7f03d000b4a0 comp rx=0 tx=0).stop 2023-11-26T07:22:24.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.319+0000 7f03d759e640 1 -- 172.21.15.77:0/2977393703 shutdown_connections 2023-11-26T07:22:24.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.319+0000 7f03d759e640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f03b806b470 0x7f03b806d930 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:24.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.319+0000 7f03d759e640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03d80c8d40 0x7f03d80c91c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:24.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.319+0000 7f03d759e640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03d814f080 0x7f03d80c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:24.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.319+0000 7f03d759e640 1 --2- 172.21.15.77:0/2977393703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03c40039a0 0x7f03d80c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:24.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.319+0000 7f03d759e640 1 -- 172.21.15.77:0/2977393703 >> 172.21.15.77:0/2977393703 conn(0x7f03d8061340 msgr2=0x7f03d815c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:24.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.320+0000 7f03d759e640 1 -- 172.21.15.77:0/2977393703 shutdown_connections 2023-11-26T07:22:24.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.320+0000 7f03d759e640 1 -- 172.21.15.77:0/2977393703 wait complete. 2023-11-26T07:22:24.327 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:24.324+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:24.327 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:24.324+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:24.327 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:24.324+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:24.328 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:24.324+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:24.328 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:24.324+0000 7f59b8603640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:24.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone63530 2023-11-26T07:22:24.353 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:24.346+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:24.353 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:24.346+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:24.353 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:24.346+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:24.353 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:24.346+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:24.354 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:24.346+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:24.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.537+0000 7fdbd2823640 1 Processor -- start 2023-11-26T07:22:24.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.537+0000 7fdbd2823640 1 -- start start 2023-11-26T07:22:24.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.539+0000 7fdbd2823640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdbcc1660b0 0x7fdbcc162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:24.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.539+0000 7fdbd2823640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdbcc162540 0x7fdbcc0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:24.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.539+0000 7fdbd2823640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc166510 con 0x7fdbcc0ccbd0 2023-11-26T07:22:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.539+0000 7fdbd2823640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbcc1655f0 con 0x7fdbcc1660b0 2023-11-26T07:22:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.539+0000 7fdbd2823640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc0cc380 con 0x7fdbcc162540 2023-11-26T07:22:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.539+0000 7fdbc3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdbcc1660b0 0x7fdbcc162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.539+0000 7fdbc3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdbcc1660b0 0x7fdbcc162000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40550/0 (socket says 172.21.15.77:40550) 2023-11-26T07:22:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.539+0000 7fdbc3fff640 1 -- 172.21.15.77:0/646578919 learned_addr learned my addr 172.21.15.77:0/646578919 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.540+0000 7fdbd0dc0640 1 --2- 172.21.15.77:0/646578919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdbcc162540 0x7fdbcc0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.540+0000 7fdbc3fff640 1 -- 172.21.15.77:0/646578919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdbcc162540 msgr2=0x7fdbcc0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.540+0000 7fdbc3fff640 1 --2- 172.21.15.77:0/646578919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdbcc162540 0x7fdbcc0c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.540+0000 7fdbc3fff640 1 -- 172.21.15.77:0/646578919 >> v1:172.21.15.159:6789/0 conn(0x7fdbcc0ccbd0 legacy=0x7fdbcc0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.540+0000 7fdbc3fff640 1 -- 172.21.15.77:0/646578919 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc162b30 con 0x7fdbcc1660b0 2023-11-26T07:22:24.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.541+0000 7fdbc3fff640 1 --2- 172.21.15.77:0/646578919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbcc1660b0 0x7fdbcc162000 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009870 tx=0x7fdbb402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d605bab4cc5f0c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:24.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.541+0000 7fdbcb7fe640 1 -- 172.21.15.77:0/646578919 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4031640 con 0x7fdbcc1660b0 2023-11-26T07:22:24.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.541+0000 7fdbcb7fe640 1 -- 172.21.15.77:0/646578919 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb40317a0 con 0x7fdbcc1660b0 2023-11-26T07:22:24.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.541+0000 7fdbcb7fe640 1 -- 172.21.15.77:0/646578919 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4031b30 con 0x7fdbcc1660b0 2023-11-26T07:22:24.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.542+0000 7fdbd2823640 1 -- 172.21.15.77:0/646578919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbcc1660b0 msgr2=0x7fdbcc162000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:24.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.542+0000 7fdbd2823640 1 --2- 172.21.15.77:0/646578919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbcc1660b0 0x7fdbcc162000 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009870 tx=0x7fdbb402b8f0 comp rx=0 tx=0).stop 2023-11-26T07:22:24.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.542+0000 7fdbd2823640 1 -- 172.21.15.77:0/646578919 shutdown_connections 2023-11-26T07:22:24.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.542+0000 7fdbd2823640 1 --2- 172.21.15.77:0/646578919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdbcc162540 0x7fdbcc0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:24.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.542+0000 7fdbd2823640 1 --2- 172.21.15.77:0/646578919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbcc1660b0 0x7fdbcc162000 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:24.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.542+0000 7fdbd2823640 1 -- 172.21.15.77:0/646578919 >> 172.21.15.77:0/646578919 conn(0x7fdbcc0b0c50 msgr2=0x7fdbcc0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:24.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.542+0000 7fdbd2823640 1 -- 172.21.15.77:0/646578919 shutdown_connections 2023-11-26T07:22:24.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.542+0000 7fdbd2823640 1 -- 172.21.15.77:0/646578919 wait complete. 2023-11-26T07:22:24.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.545+0000 7fdbd2823640 1 Processor -- start 2023-11-26T07:22:24.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.545+0000 7fdbd2823640 1 -- start start 2023-11-26T07:22:24.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.546+0000 7fdbd2823640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdbcc0ccbd0 0x7fdbcc1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:24.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.546+0000 7fdbd2823640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbcc162540 0x7fdbcc1eb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:24.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.546+0000 7fdbd2823640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbcc1660b0 0x7fdbcc071e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:24.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.546+0000 7fdbd2823640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc0ac490 con 0x7fdbcc162540 2023-11-26T07:22:24.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.546+0000 7fdbd2823640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc1ec2f0 con 0x7fdbcc1660b0 2023-11-26T07:22:24.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.546+0000 7fdbd2823640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc1587f0 con 0x7fdbcc0ccbd0 2023-11-26T07:22:24.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.546+0000 7fdbc3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbcc162540 0x7fdbcc1eb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:24.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.547+0000 7fdbc3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbcc162540 0x7fdbcc1eb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40562/0 (socket says 172.21.15.77:40562) 2023-11-26T07:22:24.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.547+0000 7fdbc3fff640 1 -- 172.21.15.77:0/1941970857 learned_addr learned my addr 172.21.15.77:0/1941970857 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.547+0000 7fdbc3fff640 1 -- 172.21.15.77:0/1941970857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdbcc0ccbd0 msgr2=0x7fdbcc1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.547+0000 7fdbc3fff640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdbcc0ccbd0 0x7fdbcc1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.547+0000 7fdbc3fff640 1 -- 172.21.15.77:0/1941970857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbcc1660b0 msgr2=0x7fdbcc071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.547+0000 7fdbc3fff640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbcc1660b0 0x7fdbcc071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.547+0000 7fdbc3fff640 1 -- 172.21.15.77:0/1941970857 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb40094d0 con 0x7fdbcc162540 2023-11-26T07:22:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.547+0000 7fdbc3fff640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbcc162540 0x7fdbcc1eb430 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4000c00 tx=0x7fdbb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.548+0000 7fdbc97fa640 1 -- 172.21.15.77:0/1941970857 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4031ea0 con 0x7fdbcc162540 2023-11-26T07:22:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.548+0000 7fdbc97fa640 1 -- 172.21.15.77:0/1941970857 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb403ac60 con 0x7fdbcc162540 2023-11-26T07:22:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.548+0000 7fdbc97fa640 1 -- 172.21.15.77:0/1941970857 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40443f0 con 0x7fdbcc162540 2023-11-26T07:22:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.548+0000 7fdbd2823640 1 -- 172.21.15.77:0/1941970857 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc1ebd30 con 0x7fdbcc162540 2023-11-26T07:22:24.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.548+0000 7fdbd2823640 1 -- 172.21.15.77:0/1941970857 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc0ac0b0 con 0x7fdbcc162540 2023-11-26T07:22:24.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.549+0000 7fdbd2823640 1 -- 172.21.15.77:0/1941970857 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc04e8b0 con 0x7fdbcc162540 2023-11-26T07:22:24.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.550+0000 7fdbc97fa640 1 -- 172.21.15.77:0/1941970857 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) v1 ==== 89792+0+0 (secure 0 0 0) 0x7fdbb402f050 con 0x7fdbcc162540 2023-11-26T07:22:24.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.551+0000 7fdbc97fa640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbac06b470 0x7fdbac06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:24.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.551+0000 7fdbc97fa640 1 -- 172.21.15.77:0/1941970857 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbb40ac200 con 0x7fdbcc162540 2023-11-26T07:22:24.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.552+0000 7fdbcbfff640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbac06b470 0x7fdbac06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:24.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.552+0000 7fdbcbfff640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbac06b470 0x7fdbac06d930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc070a30 tx=0x7fdbbc0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:24.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.556+0000 7fdbc97fa640 1 -- 172.21.15.77:0/1941970857 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdbb4076980 con 0x7fdbcc162540 2023-11-26T07:22:24.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:24.782+0000 7fdbd2823640 1 -- 172.21.15.77:0/1941970857 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone63530", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbcc0abf30 con 0x7fdbac06b470 2023-11-26T07:22:26.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:26.738+0000 7fdbc97fa640 1 -- 172.21.15.77:0/1941970857 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 13) v1 ==== 89945+0+0 (secure 0 0 0) 0x7fdbb4076d50 con 0x7fdbcc162540 2023-11-26T07:22:27.853 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:22:27.863 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:22:32.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.597+0000 7fdbc97fa640 1 -- 172.21.15.77:0/1941970857 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdbbc003950 con 0x7fdbac06b470 2023-11-26T07:22:32.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.601+0000 7fdbd2823640 1 -- 172.21.15.77:0/1941970857 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbac06b470 msgr2=0x7fdbac06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.601+0000 7fdbd2823640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbac06b470 0x7fdbac06d930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc070a30 tx=0x7fdbbc0079b0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.601+0000 7fdbd2823640 1 -- 172.21.15.77:0/1941970857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbcc162540 msgr2=0x7fdbcc1eb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.601+0000 7fdbd2823640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbcc162540 0x7fdbcc1eb430 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4000c00 tx=0x7fdbb40046c0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.601+0000 7fdbd2823640 1 -- 172.21.15.77:0/1941970857 shutdown_connections 2023-11-26T07:22:32.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.601+0000 7fdbd2823640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbac06b470 0x7fdbac06d930 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.601+0000 7fdbd2823640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbcc1660b0 0x7fdbcc071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.601+0000 7fdbd2823640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbcc162540 0x7fdbcc1eb430 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.601+0000 7fdbd2823640 1 --2- 172.21.15.77:0/1941970857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdbcc0ccbd0 0x7fdbcc1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.601+0000 7fdbd2823640 1 -- 172.21.15.77:0/1941970857 >> 172.21.15.77:0/1941970857 conn(0x7fdbcc0b0c50 msgr2=0x7fdbcc0cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.602+0000 7fdbd2823640 1 -- 172.21.15.77:0/1941970857 shutdown_connections 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.602+0000 7fdbd2823640 1 -- 172.21.15.77:0/1941970857 wait complete. 2023-11-26T07:22:32.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone63530 2023-11-26T07:22:32.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.840+0000 7fa3cb348640 1 Processor -- start 2023-11-26T07:22:32.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.840+0000 7fa3cb348640 1 -- start start 2023-11-26T07:22:32.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.841+0000 7fa3cb348640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c406de10 0x7fa3c415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.841+0000 7fa3cb348640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa3c40c49f0 0x7fa3c40705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.841+0000 7fa3cb348640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c415ec90 con 0x7fa3c4072160 2023-11-26T07:22:32.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.841+0000 7fa3cb348640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c40cd530 con 0x7fa3c40c49f0 2023-11-26T07:22:32.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.841+0000 7fa3cb348640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40c4ed0 con 0x7fa3c406de10 2023-11-26T07:22:32.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.842+0000 7fa3c88e3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c406de10 0x7fa3c415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.842+0000 7fa3c88e3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c406de10 0x7fa3c415e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:45834/0 (socket says 172.21.15.77:45834) 2023-11-26T07:22:32.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.842+0000 7fa3c88e3640 1 -- 172.21.15.77:0/1126716932 learned_addr learned my addr 172.21.15.77:0/1126716932 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:32.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.842+0000 7fa3c98e5640 1 --2- 172.21.15.77:0/1126716932 >> v2:172.21.15.159:3300/0 conn(0x7fa3c40c49f0 0x7fa3c40705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.843+0000 7fa3c88e3640 1 -- 172.21.15.77:0/1126716932 >> v2:172.21.15.159:3300/0 conn(0x7fa3c40c49f0 msgr2=0x7fa3c40705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:32.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.843+0000 7fa3c88e3640 1 --2- 172.21.15.77:0/1126716932 >> v2:172.21.15.159:3300/0 conn(0x7fa3c40c49f0 0x7fa3c40705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.843+0000 7fa3c88e3640 1 -- 172.21.15.77:0/1126716932 >> v1:172.21.15.159:6789/0 conn(0x7fa3c4072160 legacy=0x7fa3c406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.843+0000 7fa3c88e3640 1 -- 172.21.15.77:0/1126716932 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c40c51b0 con 0x7fa3c406de10 2023-11-26T07:22:32.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.845+0000 7fa3c88e3640 1 --2- 172.21.15.77:0/1126716932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c406de10 0x7fa3c415e750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009870 tx=0x7fa3b402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2a0fb7de33da560 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:32.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.845+0000 7fa3bbfff640 1 -- 172.21.15.77:0/1126716932 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4030840 con 0x7fa3c406de10 2023-11-26T07:22:32.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.845+0000 7fa3bbfff640 1 -- 172.21.15.77:0/1126716932 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b40309a0 con 0x7fa3c406de10 2023-11-26T07:22:32.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.845+0000 7fa3bbfff640 1 -- 172.21.15.77:0/1126716932 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4030d30 con 0x7fa3c406de10 2023-11-26T07:22:32.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.846+0000 7fa3cb348640 1 -- 172.21.15.77:0/1126716932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c406de10 msgr2=0x7fa3c415e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.846+0000 7fa3cb348640 1 --2- 172.21.15.77:0/1126716932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c406de10 0x7fa3c415e750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009870 tx=0x7fa3b402b980 comp rx=0 tx=0).stop 2023-11-26T07:22:32.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.846+0000 7fa3cb348640 1 -- 172.21.15.77:0/1126716932 shutdown_connections 2023-11-26T07:22:32.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.846+0000 7fa3cb348640 1 --2- 172.21.15.77:0/1126716932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c406de10 0x7fa3c415e750 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.846+0000 7fa3cb348640 1 --2- 172.21.15.77:0/1126716932 >> v2:172.21.15.159:3300/0 conn(0x7fa3c40c49f0 0x7fa3c40705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.846+0000 7fa3cb348640 1 -- 172.21.15.77:0/1126716932 >> 172.21.15.77:0/1126716932 conn(0x7fa3c40b0c50 msgr2=0x7fa3c40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:32.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.846+0000 7fa3cb348640 1 -- 172.21.15.77:0/1126716932 shutdown_connections 2023-11-26T07:22:32.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.846+0000 7fa3cb348640 1 -- 172.21.15.77:0/1126716932 wait complete. 2023-11-26T07:22:32.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.848+0000 7fa3cb348640 1 Processor -- start 2023-11-26T07:22:32.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.848+0000 7fa3cb348640 1 -- start start 2023-11-26T07:22:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.849+0000 7fa3cb348640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3c406de10 0x7fa3c4158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.849+0000 7fa3cb348640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3c4072160 0x7fa3c40c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.849+0000 7fa3cb348640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c40c49f0 0x7fa3c40c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.849+0000 7fa3cb348640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41589a0 con 0x7fa3c4072160 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.849+0000 7fa3cb348640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40c6670 con 0x7fa3c406de10 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.849+0000 7fa3cb348640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40c6950 con 0x7fa3c40c49f0 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.849+0000 7fa3c88e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3c4072160 0x7fa3c40c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.849+0000 7fa3c88e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3c4072160 0x7fa3c40c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44924/0 (socket says 172.21.15.77:44924) 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.849+0000 7fa3c88e3640 1 -- 172.21.15.77:0/2442165844 learned_addr learned my addr 172.21.15.77:0/2442165844 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.850+0000 7fa3c98e5640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c40c49f0 0x7fa3c40c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.850+0000 7fa3c88e3640 1 -- 172.21.15.77:0/2442165844 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c40c49f0 msgr2=0x7fa3c40c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.850+0000 7fa3c88e3640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c40c49f0 0x7fa3c40c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.850+0000 7fa3c88e3640 1 -- 172.21.15.77:0/2442165844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3c406de10 msgr2=0x7fa3c4158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.850+0000 7fa3c90e4640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3c406de10 0x7fa3c4158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.850+0000 7fa3c88e3640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3c406de10 0x7fa3c4158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.850+0000 7fa3c88e3640 1 -- 172.21.15.77:0/2442165844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b40094d0 con 0x7fa3c4072160 2023-11-26T07:22:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.850+0000 7fa3c98e5640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c40c49f0 0x7fa3c40c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.850+0000 7fa3c88e3640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3c4072160 0x7fa3c40c8590 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40090b0 tx=0x7fa3b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.851+0000 7fa3b9ffb640 1 -- 172.21.15.77:0/2442165844 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4047070 con 0x7fa3c4072160 2023-11-26T07:22:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.851+0000 7fa3b9ffb640 1 -- 172.21.15.77:0/2442165844 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b4039b50 con 0x7fa3c4072160 2023-11-26T07:22:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.851+0000 7fa3cb348640 1 -- 172.21.15.77:0/2442165844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c40c6c30 con 0x7fa3c4072160 2023-11-26T07:22:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.851+0000 7fa3b9ffb640 1 -- 172.21.15.77:0/2442165844 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4043400 con 0x7fa3c4072160 2023-11-26T07:22:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.851+0000 7fa3cb348640 1 -- 172.21.15.77:0/2442165844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c40c71f0 con 0x7fa3c4072160 2023-11-26T07:22:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.852+0000 7fa3cb348640 1 -- 172.21.15.77:0/2442165844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c404e8b0 con 0x7fa3c4072160 2023-11-26T07:22:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.853+0000 7fa3b9ffb640 1 -- 172.21.15.77:0/2442165844 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 89945+0+0 (secure 0 0 0) 0x7fa3b4043560 con 0x7fa3c4072160 2023-11-26T07:22:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.854+0000 7fa3b9ffb640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa3a806b620 0x7fa3a806dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.854+0000 7fa3b9ffb640 1 -- 172.21.15.77:0/2442165844 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3b403e070 con 0x7fa3c4072160 2023-11-26T07:22:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.854+0000 7fa3c90e4640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa3a806b620 0x7fa3a806dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.855+0000 7fa3c90e4640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa3a806b620 0x7fa3a806dae0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00015a0 tx=0x7fa3c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:32.859+0000 7fa3b9ffb640 1 -- 172.21.15.77:0/2442165844 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa3b40dfe90 con 0x7fa3c4072160 2023-11-26T07:22:33.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.083+0000 7fa3cb348640 1 -- 172.21.15.77:0/2442165844 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone63530", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3c406c5f0 con 0x7fa3a806b620 2023-11-26T07:22:33.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.625+0000 7fa3b9ffb640 1 -- 172.21.15.77:0/2442165844 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+263 (secure 0 0 0) 0x7fa3c406c5f0 con 0x7fa3a806b620 2023-11-26T07:22:33.627 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:22:33.627 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "canceled", 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol4780", 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap93340" 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: "failure": { 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: "errno": "4", 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: "error_msg": "user interrupted clone operation" 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:22:33.628 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:22:33.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 -- 172.21.15.77:0/2442165844 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa3a806b620 msgr2=0x7fa3a806dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:33.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa3a806b620 0x7fa3a806dae0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00015a0 tx=0x7fa3c0009040 comp rx=0 tx=0).stop 2023-11-26T07:22:33.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 -- 172.21.15.77:0/2442165844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3c4072160 msgr2=0x7fa3c40c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:33.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3c4072160 0x7fa3c40c8590 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40090b0 tx=0x7fa3b4004730 comp rx=0 tx=0).stop 2023-11-26T07:22:33.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 -- 172.21.15.77:0/2442165844 shutdown_connections 2023-11-26T07:22:33.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa3a806b620 0x7fa3a806dae0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa3c40c49f0 0x7fa3c40c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3c4072160 0x7fa3c40c8590 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 --2- 172.21.15.77:0/2442165844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3c406de10 0x7fa3c4158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 -- 172.21.15.77:0/2442165844 >> 172.21.15.77:0/2442165844 conn(0x7fa3c40b0c50 msgr2=0x7fa3c40cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:33.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 -- 172.21.15.77:0/2442165844 shutdown_connections 2023-11-26T07:22:33.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.628+0000 7fa3cb348640 1 -- 172.21.15.77:0/2442165844 wait complete. 2023-11-26T07:22:33.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone63530 --force 2023-11-26T07:22:33.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.867+0000 7fce6aa21640 1 Processor -- start 2023-11-26T07:22:33.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.867+0000 7fce6aa21640 1 -- start start 2023-11-26T07:22:33.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.868+0000 7fce6aa21640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fce64144510 0x7fce6406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.868+0000 7fce6aa21640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce6415edd0 0x7fce640b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce6aa21640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce640ccd00 0x7fce640b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce6aa21640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce641448f0 con 0x7fce640ccd00 2023-11-26T07:22:33.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce6aa21640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce64144d80 con 0x7fce64144510 2023-11-26T07:22:33.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce6aa21640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6415f2d0 con 0x7fce6415edd0 2023-11-26T07:22:33.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce6a220640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce640ccd00 0x7fce640b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce6a220640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce640ccd00 0x7fce640b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44936/0 (socket says 172.21.15.77:44936) 2023-11-26T07:22:33.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce6a220640 1 -- 172.21.15.77:0/2796240239 learned_addr learned my addr 172.21.15.77:0/2796240239 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:33.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce6921e640 1 --2- 172.21.15.77:0/2796240239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce6415edd0 0x7fce640b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce6a220640 1 -- 172.21.15.77:0/2796240239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce6415edd0 msgr2=0x7fce640b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:33.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce69a1f640 1 --2- 172.21.15.77:0/2796240239 >> v2:172.21.15.159:3300/0 conn(0x7fce64144510 0x7fce6406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce6a220640 1 --2- 172.21.15.77:0/2796240239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce6415edd0 0x7fce640b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.869+0000 7fce6a220640 1 -- 172.21.15.77:0/2796240239 >> v2:172.21.15.159:3300/0 conn(0x7fce64144510 msgr2=0x7fce6406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:33.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.870+0000 7fce6a220640 1 --2- 172.21.15.77:0/2796240239 >> v2:172.21.15.159:3300/0 conn(0x7fce64144510 0x7fce6406d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.870+0000 7fce6a220640 1 -- 172.21.15.77:0/2796240239 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6415f5b0 con 0x7fce640ccd00 2023-11-26T07:22:33.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.870+0000 7fce6921e640 1 --2- 172.21.15.77:0/2796240239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce6415edd0 0x7fce640b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:33.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.870+0000 7fce69a1f640 1 --2- 172.21.15.77:0/2796240239 >> v2:172.21.15.159:3300/0 conn(0x7fce64144510 0x7fce6406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:33.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.871+0000 7fce6a220640 1 --2- 172.21.15.77:0/2796240239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640ccd00 0x7fce640b1020 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fce640b1730 tx=0x7fce5c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90643b43874f0baa server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:33.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.871+0000 7fce68a1d640 1 -- 172.21.15.77:0/2796240239 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c02c9e0 con 0x7fce640ccd00 2023-11-26T07:22:33.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.871+0000 7fce68a1d640 1 -- 172.21.15.77:0/2796240239 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c02cb40 con 0x7fce640ccd00 2023-11-26T07:22:33.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.871+0000 7fce68a1d640 1 -- 172.21.15.77:0/2796240239 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c0343f0 con 0x7fce640ccd00 2023-11-26T07:22:33.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.872+0000 7fce6aa21640 1 -- 172.21.15.77:0/2796240239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640ccd00 msgr2=0x7fce640b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:33.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.872+0000 7fce6aa21640 1 --2- 172.21.15.77:0/2796240239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640ccd00 0x7fce640b1020 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fce640b1730 tx=0x7fce5c02be40 comp rx=0 tx=0).stop 2023-11-26T07:22:33.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.872+0000 7fce6aa21640 1 -- 172.21.15.77:0/2796240239 shutdown_connections 2023-11-26T07:22:33.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.872+0000 7fce6aa21640 1 --2- 172.21.15.77:0/2796240239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640ccd00 0x7fce640b1020 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.872+0000 7fce6aa21640 1 --2- 172.21.15.77:0/2796240239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce6415edd0 0x7fce640b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.872+0000 7fce6aa21640 1 --2- 172.21.15.77:0/2796240239 >> v2:172.21.15.159:3300/0 conn(0x7fce64144510 0x7fce6406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.872+0000 7fce6aa21640 1 -- 172.21.15.77:0/2796240239 >> 172.21.15.77:0/2796240239 conn(0x7fce640cb8a0 msgr2=0x7fce640cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:33.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.872+0000 7fce6aa21640 1 -- 172.21.15.77:0/2796240239 shutdown_connections 2023-11-26T07:22:33.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.872+0000 7fce6aa21640 1 -- 172.21.15.77:0/2796240239 wait complete. 2023-11-26T07:22:33.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.874+0000 7fce6aa21640 1 Processor -- start 2023-11-26T07:22:33.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.874+0000 7fce6aa21640 1 -- start start 2023-11-26T07:22:33.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.875+0000 7fce6aa21640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce640ccd00 0x7fce640702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.875+0000 7fce6aa21640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce64144510 0x7fce6415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.875+0000 7fce6aa21640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce6415edd0 0x7fce6413f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.875+0000 7fce6aa21640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64071200 con 0x7fce6415edd0 2023-11-26T07:22:33.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.875+0000 7fce6aa21640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6415e830 con 0x7fce64144510 2023-11-26T07:22:33.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.875+0000 7fce6aa21640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce641f6390 con 0x7fce640ccd00 2023-11-26T07:22:33.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.875+0000 7fce6a220640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce6415edd0 0x7fce6413f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.875+0000 7fce6a220640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce6415edd0 0x7fce6413f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44942/0 (socket says 172.21.15.77:44942) 2023-11-26T07:22:33.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.875+0000 7fce6a220640 1 -- 172.21.15.77:0/2985500249 learned_addr learned my addr 172.21.15.77:0/2985500249 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:33.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.875+0000 7fce69a1f640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce640ccd00 0x7fce640702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce6921e640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce64144510 0x7fce6415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce6a220640 1 -- 172.21.15.77:0/2985500249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce640ccd00 msgr2=0x7fce640702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce6a220640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce640ccd00 0x7fce640702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce6a220640 1 -- 172.21.15.77:0/2985500249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce64144510 msgr2=0x7fce6415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce6a220640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce64144510 0x7fce6415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce6a220640 1 -- 172.21.15.77:0/2985500249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c009b30 con 0x7fce6415edd0 2023-11-26T07:22:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce6921e640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce64144510 0x7fce6415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce6a220640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce6415edd0 0x7fce6413f630 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fce5c036040 tx=0x7fce5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce5a7fc640 1 -- 172.21.15.77:0/2985500249 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c009510 con 0x7fce6415edd0 2023-11-26T07:22:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce5a7fc640 1 -- 172.21.15.77:0/2985500249 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c03e450 con 0x7fce6415edd0 2023-11-26T07:22:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce6aa21640 1 -- 172.21.15.77:0/2985500249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6413fb70 con 0x7fce6415edd0 2023-11-26T07:22:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.876+0000 7fce5a7fc640 1 -- 172.21.15.77:0/2985500249 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c03e800 con 0x7fce6415edd0 2023-11-26T07:22:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.877+0000 7fce6aa21640 1 -- 172.21.15.77:0/2985500249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce64070c40 con 0x7fce6415edd0 2023-11-26T07:22:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.878+0000 7fce6aa21640 1 -- 172.21.15.77:0/2985500249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce641f6160 con 0x7fce6415edd0 2023-11-26T07:22:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.879+0000 7fce5a7fc640 1 -- 172.21.15.77:0/2985500249 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 89945+0+0 (secure 0 0 0) 0x7fce5c03e960 con 0x7fce6415edd0 2023-11-26T07:22:33.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.880+0000 7fce5a7fc640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fce4806b620 0x7fce4806dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.880+0000 7fce5a7fc640 1 -- 172.21.15.77:0/2985500249 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce5c0aab50 con 0x7fce6415edd0 2023-11-26T07:22:33.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.880+0000 7fce69a1f640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fce4806b620 0x7fce4806dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.881+0000 7fce69a1f640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fce4806b620 0x7fce4806dae0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fce640ce8e0 tx=0x7fce60008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:33.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:33.884+0000 7fce5a7fc640 1 -- 172.21.15.77:0/2985500249 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce641f6160 con 0x7fce6415edd0 2023-11-26T07:22:34.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.101+0000 7fce6aa21640 1 -- 172.21.15.77:0/2985500249 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone63530", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fce640b3c30 con 0x7fce4806b620 2023-11-26T07:22:34.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.127+0000 7fce5a7fc640 1 -- 172.21.15.77:0/2985500249 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fce6000a660 con 0x7fce4806b620 2023-11-26T07:22:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.130+0000 7fce6aa21640 1 -- 172.21.15.77:0/2985500249 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fce4806b620 msgr2=0x7fce4806dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.130+0000 7fce6aa21640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fce4806b620 0x7fce4806dae0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fce640ce8e0 tx=0x7fce60008040 comp rx=0 tx=0).stop 2023-11-26T07:22:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.130+0000 7fce6aa21640 1 -- 172.21.15.77:0/2985500249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce6415edd0 msgr2=0x7fce6413f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.130+0000 7fce6aa21640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce6415edd0 0x7fce6413f630 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fce5c036040 tx=0x7fce5c004a40 comp rx=0 tx=0).stop 2023-11-26T07:22:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.130+0000 7fce6aa21640 1 -- 172.21.15.77:0/2985500249 shutdown_connections 2023-11-26T07:22:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.131+0000 7fce6aa21640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fce4806b620 0x7fce4806dae0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.131+0000 7fce6aa21640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce6415edd0 0x7fce6413f630 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.131+0000 7fce6aa21640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce64144510 0x7fce6415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.131+0000 7fce6aa21640 1 --2- 172.21.15.77:0/2985500249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce640ccd00 0x7fce640702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.131+0000 7fce6aa21640 1 -- 172.21.15.77:0/2985500249 >> 172.21.15.77:0/2985500249 conn(0x7fce640cb8a0 msgr2=0x7fce640cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.131+0000 7fce6aa21640 1 -- 172.21.15.77:0/2985500249 shutdown_connections 2023-11-26T07:22:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.131+0000 7fce6aa21640 1 -- 172.21.15.77:0/2985500249 wait complete. 2023-11-26T07:22:34.145 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:34.143+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:34.145 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:34.143+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:34.145 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:34.143+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:34.145 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:34.143+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:34.145 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:22:34.143+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:34.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol4780 subvol_snap93340 2023-11-26T07:22:34.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.342+0000 7fb3dc81a640 1 Processor -- start 2023-11-26T07:22:34.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.342+0000 7fb3dc81a640 1 -- start start 2023-11-26T07:22:34.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.343+0000 7fb3dc81a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb3d81431f0 0x7fb3d815e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.343+0000 7fb3dc81a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806ddb0 0x7fb3d8071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.343+0000 7fb3dc81a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d815ec20 con 0x7fb3d80b2ad0 2023-11-26T07:22:34.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.343+0000 7fb3dc81a640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d80b4fd0 con 0x7fb3d81431f0 2023-11-26T07:22:34.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.343+0000 7fb3dc81a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8143c10 con 0x7fb3d806ddb0 2023-11-26T07:22:34.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.344+0000 7fb3cffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb3d80b2ad0 0x7fb3d806d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52414/0 (socket says 172.21.15.77:52414) 2023-11-26T07:22:34.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.344+0000 7fb3cffff640 1 -- 172.21.15.77:0/1660454660 learned_addr learned my addr 172.21.15.77:0/1660454660 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:34.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.344+0000 7fb3d7fff640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806ddb0 0x7fb3d8071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.344+0000 7fb3d77fe640 1 --2- 172.21.15.77:0/1660454660 >> v2:172.21.15.159:3300/0 conn(0x7fb3d81431f0 0x7fb3d815e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.344+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727965571 0 0) 0x7fb3d815ec20 con 0x7fb3d80b2ad0 2023-11-26T07:22:34.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.344+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3c4003520 con 0x7fb3d80b2ad0 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.344+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3887630121 0 0) 0x7fb3c4003520 con 0x7fb3d80b2ad0 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806ddb0 msgr2=0x7fb3d8071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806ddb0 0x7fb3d8071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 >> v2:172.21.15.159:3300/0 conn(0x7fb3d81431f0 msgr2=0x7fb3d815e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 --2- 172.21.15.77:0/1660454660 >> v2:172.21.15.159:3300/0 conn(0x7fb3d81431f0 0x7fb3d815e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d80705b0 con 0x7fb3d80b2ad0 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fb3c00017f0 con 0x7fb3d80b2ad0 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d77fe640 1 --2- 172.21.15.77:0/1660454660 >> v2:172.21.15.159:3300/0 conn(0x7fb3d81431f0 0x7fb3d815e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 >> v1:172.21.15.77:6789/0 conn(0x7fb3d80b2ad0 legacy=0x7fb3d806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806ddb0 0x7fb3c4003990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 0x7fb3c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c4004d00 0x7fb3c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d80b4fd0 con 0x7fb3c4003f10 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8143c10 con 0x7fb3c4004d00 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c400dcc0 con 0x7fb3d806ddb0 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.345+0000 7fb3cffff640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 0x7fb3c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.346+0000 7fb3d77fe640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806ddb0 0x7fb3c4003990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.346+0000 7fb3d7fff640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c4004d00 0x7fb3c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.346+0000 7fb3cffff640 1 -- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806ddb0 msgr2=0x7fb3c4003990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.346+0000 7fb3cffff640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806ddb0 0x7fb3c4003990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.346+0000 7fb3cffff640 1 -- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c4004d00 msgr2=0x7fb3c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.346+0000 7fb3cffff640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c4004d00 0x7fb3c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.346+0000 7fb3cffff640 1 -- 172.21.15.77:0/1660454660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c4003520 con 0x7fb3c4003f10 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.346+0000 7fb3d77fe640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806ddb0 0x7fb3c4003990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:34.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.346+0000 7fb3d7fff640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c4004d00 0x7fb3c4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:34.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.347+0000 7fb3cffff640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 0x7fb3c40047c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000c190 tx=0x7fb3c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1b237eed03f7df server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.347+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c002cad0 con 0x7fb3c4003f10 2023-11-26T07:22:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.347+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c002cc30 con 0x7fb3c4003f10 2023-11-26T07:22:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.347+0000 7fb3d6ffd640 1 -- 172.21.15.77:0/1660454660 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c00072b0 con 0x7fb3c4003f10 2023-11-26T07:22:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.348+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1660454660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 msgr2=0x7fb3c40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.348+0000 7fb3dc81a640 1 --2- 172.21.15.77:0/1660454660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 0x7fb3c40047c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000c190 tx=0x7fb3c40057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.348+0000 7fb3d7fff640 1 -- 172.21.15.77:0/1660454660 reap_dead start 2023-11-26T07:22:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.348+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1660454660 shutdown_connections 2023-11-26T07:22:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.348+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1660454660 >> 172.21.15.77:0/1660454660 conn(0x7fb3d80cb8a0 msgr2=0x7fb3d80cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.348+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1660454660 shutdown_connections 2023-11-26T07:22:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.348+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1660454660 wait complete. 2023-11-26T07:22:34.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.350+0000 7fb3dc81a640 1 Processor -- start 2023-11-26T07:22:34.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.350+0000 7fb3dc81a640 1 -- start start 2023-11-26T07:22:34.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.351+0000 7fb3dc81a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 0x7fb3d815c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.351+0000 7fb3dc81a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d81358b0 0x7fb3d815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.351+0000 7fb3dc81a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d81efbd0 0x7fb3d81f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.351+0000 7fb3dc81a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d80abf30 con 0x7fb3c4003f10 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.351+0000 7fb3dc81a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8133820 con 0x7fb3d81358b0 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.351+0000 7fb3dc81a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8135e20 con 0x7fb3d81efbd0 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.351+0000 7fb3d77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 0x7fb3d815c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.351+0000 7fb3d77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 0x7fb3d815c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44996/0 (socket says 172.21.15.77:44996) 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.351+0000 7fb3d77fe640 1 -- 172.21.15.77:0/1725484062 learned_addr learned my addr 172.21.15.77:0/1725484062 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.352+0000 7fb3d77fe640 1 -- 172.21.15.77:0/1725484062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d81efbd0 msgr2=0x7fb3d81f0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.352+0000 7fb3d77fe640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d81efbd0 0x7fb3d81f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.352+0000 7fb3d77fe640 1 -- 172.21.15.77:0/1725484062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d81358b0 msgr2=0x7fb3d815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.352+0000 7fb3d77fe640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d81358b0 0x7fb3d815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.352+0000 7fb3d77fe640 1 -- 172.21.15.77:0/1725484062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d8136100 con 0x7fb3c4003f10 2023-11-26T07:22:34.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.352+0000 7fb3d77fe640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 0x7fb3d815c700 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800f620 tx=0x7fb3c800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:34.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.352+0000 7fb3d4ff9640 1 -- 172.21.15.77:0/1725484062 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8014890 con 0x7fb3c4003f10 2023-11-26T07:22:34.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.352+0000 7fb3d4ff9640 1 -- 172.21.15.77:0/1725484062 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c800c030 con 0x7fb3c4003f10 2023-11-26T07:22:34.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.352+0000 7fb3d4ff9640 1 -- 172.21.15.77:0/1725484062 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8014bf0 con 0x7fb3c4003f10 2023-11-26T07:22:34.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.352+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1725484062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d81363e0 con 0x7fb3c4003f10 2023-11-26T07:22:34.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.352+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1725484062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d81f05a0 con 0x7fb3c4003f10 2023-11-26T07:22:34.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.353+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1725484062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d81f0820 con 0x7fb3c4003f10 2023-11-26T07:22:34.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.354+0000 7fb3d4ff9640 1 -- 172.21.15.77:0/1725484062 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 89945+0+0 (secure 0 0 0) 0x7fb3c8014d50 con 0x7fb3c4003f10 2023-11-26T07:22:34.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.355+0000 7fb3d4ff9640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3b806b620 0x7fb3b806dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.355+0000 7fb3d4ff9640 1 -- 172.21.15.77:0/1725484062 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3c8088070 con 0x7fb3c4003f10 2023-11-26T07:22:34.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.355+0000 7fb3cffff640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3b806b620 0x7fb3b806dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.356+0000 7fb3cffff640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3b806b620 0x7fb3b806dae0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0034000 tx=0x7fb3c002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:34.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.360+0000 7fb3d4ff9640 1 -- 172.21.15.77:0/1725484062 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb3c8054d20 con 0x7fb3c4003f10 2023-11-26T07:22:34.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.584+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1725484062 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol4780", "snap_name": "subvol_snap93340", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3d8070e50 con 0x7fb3b806b620 2023-11-26T07:22:34.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.637+0000 7fb3d4ff9640 1 -- 172.21.15.77:0/1725484062 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb3c002c990 con 0x7fb3b806b620 2023-11-26T07:22:34.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.640+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1725484062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3b806b620 msgr2=0x7fb3b806dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.640+0000 7fb3dc81a640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3b806b620 0x7fb3b806dae0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0034000 tx=0x7fb3c002e000 comp rx=0 tx=0).stop 2023-11-26T07:22:34.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.640+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1725484062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 msgr2=0x7fb3d815c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.640+0000 7fb3dc81a640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 0x7fb3d815c700 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800f620 tx=0x7fb3c800fae0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.641+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1725484062 shutdown_connections 2023-11-26T07:22:34.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.641+0000 7fb3dc81a640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb3b806b620 0x7fb3b806dae0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.641+0000 7fb3dc81a640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d81efbd0 0x7fb3d81f0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.641+0000 7fb3dc81a640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d81358b0 0x7fb3d815cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.641+0000 7fb3dc81a640 1 --2- 172.21.15.77:0/1725484062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3c4003f10 0x7fb3d815c700 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.641+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1725484062 >> 172.21.15.77:0/1725484062 conn(0x7fb3d80cb8a0 msgr2=0x7fb3d80b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:34.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.641+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1725484062 shutdown_connections 2023-11-26T07:22:34.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.641+0000 7fb3dc81a640 1 -- 172.21.15.77:0/1725484062 wait complete. 2023-11-26T07:22:34.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol4780 2023-11-26T07:22:34.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.868+0000 7f0a297c9640 1 Processor -- start 2023-11-26T07:22:34.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.868+0000 7f0a297c9640 1 -- start start 2023-11-26T07:22:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.870+0000 7f0a297c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2415b440 0x7f0a240cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.870+0000 7f0a297c9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0a240c59b0 0x7f0a2406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.870+0000 7f0a297c9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a240cc3a0 con 0x7f0a240cbf20 2023-11-26T07:22:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.870+0000 7f0a297c9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2415b820 con 0x7f0a240c59b0 2023-11-26T07:22:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.870+0000 7f0a297c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415eea0 con 0x7f0a2415b440 2023-11-26T07:22:34.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.870+0000 7f0a1bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0a240cbf20 0x7f0a240c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52424/0 (socket says 172.21.15.77:52424) 2023-11-26T07:22:34.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.870+0000 7f0a1bfff640 1 -- 172.21.15.77:0/4157692355 learned_addr learned my addr 172.21.15.77:0/4157692355 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.870+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471912546 0 0) 0x7f0a0c001110 con 0x7f0a240cbf20 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.870+0000 7f0a22ffd640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2415b440 0x7f0a240cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a10003520 con 0x7f0a240cbf20 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.870+0000 7f0a237fe640 1 --2- 172.21.15.77:0/4157692355 >> v2:172.21.15.159:3300/0 conn(0x7f0a240c59b0 0x7f0a2406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3815716676 0 0) 0x7f0a10003520 con 0x7f0a240cbf20 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2415b440 msgr2=0x7f0a240cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2415b440 0x7f0a240cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 >> v2:172.21.15.159:3300/0 conn(0x7f0a240c59b0 msgr2=0x7f0a2406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 --2- 172.21.15.77:0/4157692355 >> v2:172.21.15.159:3300/0 conn(0x7f0a240c59b0 0x7f0a2406c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a240abf30 con 0x7f0a240cbf20 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f0a0c001800 con 0x7f0a240cbf20 2023-11-26T07:22:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 >> v1:172.21.15.77:6789/0 conn(0x7f0a240cbf20 legacy=0x7f0a240c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2415b440 0x7f0a10003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10003fa0 0x7f0a100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a10004d00 0x7f0a10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415b820 con 0x7f0a10004d00 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415eea0 con 0x7f0a10003fa0 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1000bb40 con 0x7f0a2415b440 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.871+0000 7f0a237fe640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a10004d00 0x7f0a10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.872+0000 7f0a22ffd640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2415b440 0x7f0a10003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.872+0000 7f0a1bfff640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10003fa0 0x7f0a100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.872+0000 7f0a237fe640 1 -- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2415b440 msgr2=0x7f0a10003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.872+0000 7f0a237fe640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2415b440 0x7f0a10003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.872+0000 7f0a237fe640 1 -- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10003fa0 msgr2=0x7f0a100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.872+0000 7f0a237fe640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10003fa0 0x7f0a100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.872+0000 7f0a237fe640 1 -- 172.21.15.77:0/4157692355 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10003520 con 0x7f0a10004d00 2023-11-26T07:22:34.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.872+0000 7f0a1bfff640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10003fa0 0x7f0a100047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:34.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.872+0000 7f0a22ffd640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2415b440 0x7f0a10003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.873+0000 7f0a237fe640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a10004d00 0x7f0a10005180 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c007360 tx=0x7f0a100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a382d027345f8d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.873+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c02ccf0 con 0x7f0a10004d00 2023-11-26T07:22:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.873+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c02ce50 con 0x7f0a10004d00 2023-11-26T07:22:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.873+0000 7f0a227fc640 1 -- 172.21.15.77:0/4157692355 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c034660 con 0x7f0a10004d00 2023-11-26T07:22:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.874+0000 7f0a297c9640 1 -- 172.21.15.77:0/4157692355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a10004d00 msgr2=0x7f0a10005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.874+0000 7f0a297c9640 1 --2- 172.21.15.77:0/4157692355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a10004d00 0x7f0a10005180 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c007360 tx=0x7f0a100057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.874+0000 7f0a237fe640 1 -- 172.21.15.77:0/4157692355 reap_dead start 2023-11-26T07:22:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.874+0000 7f0a297c9640 1 -- 172.21.15.77:0/4157692355 shutdown_connections 2023-11-26T07:22:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.874+0000 7f0a297c9640 1 -- 172.21.15.77:0/4157692355 >> 172.21.15.77:0/4157692355 conn(0x7f0a240b0c50 msgr2=0x7f0a240b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.874+0000 7f0a297c9640 1 -- 172.21.15.77:0/4157692355 shutdown_connections 2023-11-26T07:22:34.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.874+0000 7f0a297c9640 1 -- 172.21.15.77:0/4157692355 wait complete. 2023-11-26T07:22:34.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.876+0000 7f0a297c9640 1 Processor -- start 2023-11-26T07:22:34.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.876+0000 7f0a297c9640 1 -- start start 2023-11-26T07:22:34.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a297c9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10004d00 0x7f0a241556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a297c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a240cdec0 0x7f0a24156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a297c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24156b90 0x7f0a240ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a297c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240ccbd0 con 0x7f0a24156b90 2023-11-26T07:22:34.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a297c9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240cce20 con 0x7f0a10004d00 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a297c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240cd100 con 0x7f0a240cdec0 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a237fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24156b90 0x7f0a240ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a237fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24156b90 0x7f0a240ad1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45016/0 (socket says 172.21.15.77:45016) 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a237fe640 1 -- 172.21.15.77:0/3050151788 learned_addr learned my addr 172.21.15.77:0/3050151788 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a237fe640 1 -- 172.21.15.77:0/3050151788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a240cdec0 msgr2=0x7f0a24156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a237fe640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a240cdec0 0x7f0a24156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a237fe640 1 -- 172.21.15.77:0/3050151788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10004d00 msgr2=0x7f0a241556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a237fe640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10004d00 0x7f0a241556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.877+0000 7f0a237fe640 1 -- 172.21.15.77:0/3050151788 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a240cd3e0 con 0x7f0a24156b90 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.878+0000 7f0a237fe640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24156b90 0x7f0a240ad1f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c02dfd0 tx=0x7f0a1c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.878+0000 7f0a1b7fe640 1 -- 172.21.15.77:0/3050151788 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c03e600 con 0x7f0a24156b90 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.878+0000 7f0a1b7fe640 1 -- 172.21.15.77:0/3050151788 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c03e760 con 0x7f0a24156b90 2023-11-26T07:22:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.878+0000 7f0a297c9640 1 -- 172.21.15.77:0/3050151788 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a240cd6c0 con 0x7f0a24156b90 2023-11-26T07:22:34.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.878+0000 7f0a1b7fe640 1 -- 172.21.15.77:0/3050151788 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c03eb10 con 0x7f0a24156b90 2023-11-26T07:22:34.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.878+0000 7f0a297c9640 1 -- 172.21.15.77:0/3050151788 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a240ad730 con 0x7f0a24156b90 2023-11-26T07:22:34.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.879+0000 7f0a297c9640 1 -- 172.21.15.77:0/3050151788 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2404e8b0 con 0x7f0a24156b90 2023-11-26T07:22:34.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.880+0000 7f0a1b7fe640 1 -- 172.21.15.77:0/3050151788 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 89945+0+0 (secure 0 0 0) 0x7f0a1c03ec70 con 0x7f0a24156b90 2023-11-26T07:22:34.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.881+0000 7f0a1b7fe640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0406b650 0x7f0a0406db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:34.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.881+0000 7f0a1b7fe640 1 -- 172.21.15.77:0/3050151788 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a1c0aa1b0 con 0x7f0a24156b90 2023-11-26T07:22:34.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.881+0000 7f0a22ffd640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0406b650 0x7f0a0406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:34.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.882+0000 7f0a22ffd640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0406b650 0x7f0a0406db10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a14006fd0 tx=0x7f0a14009350 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:34.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:34.885+0000 7f0a1b7fe640 1 -- 172.21.15.77:0/3050151788 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a1c076f00 con 0x7f0a24156b90 2023-11-26T07:22:35.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.105+0000 7f0a297c9640 1 -- 172.21.15.77:0/3050151788 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol4780", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a2415f6b0 con 0x7f0a0406b650 2023-11-26T07:22:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.130+0000 7f0a1b7fe640 1 -- 172.21.15.77:0/3050151788 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0a1400e510 con 0x7f0a0406b650 2023-11-26T07:22:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.133+0000 7f0a297c9640 1 -- 172.21.15.77:0/3050151788 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0406b650 msgr2=0x7f0a0406db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.133+0000 7f0a297c9640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0406b650 0x7f0a0406db10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a14006fd0 tx=0x7f0a14009350 comp rx=0 tx=0).stop 2023-11-26T07:22:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.133+0000 7f0a297c9640 1 -- 172.21.15.77:0/3050151788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24156b90 msgr2=0x7f0a240ad1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:35.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.133+0000 7f0a297c9640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24156b90 0x7f0a240ad1f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c02dfd0 tx=0x7f0a1c004ab0 comp rx=0 tx=0).stop 2023-11-26T07:22:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.133+0000 7f0a297c9640 1 -- 172.21.15.77:0/3050151788 shutdown_connections 2023-11-26T07:22:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.133+0000 7f0a297c9640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0a0406b650 0x7f0a0406db10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.133+0000 7f0a297c9640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24156b90 0x7f0a240ad1f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.133+0000 7f0a297c9640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a240cdec0 0x7f0a24156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.133+0000 7f0a297c9640 1 --2- 172.21.15.77:0/3050151788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10004d00 0x7f0a241556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.133+0000 7f0a297c9640 1 -- 172.21.15.77:0/3050151788 >> 172.21.15.77:0/3050151788 conn(0x7f0a240b0c50 msgr2=0x7f0a240af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:35.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.133+0000 7f0a297c9640 1 -- 172.21.15.77:0/3050151788 shutdown_connections 2023-11-26T07:22:35.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:35.134+0000 7f0a297c9640 1 -- 172.21.15.77:0/3050151788 wait complete. 2023-11-26T07:22:35.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:35.160 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:22:35.218 INFO:teuthology.orchestra.run.smithi077.stdout:3 2023-11-26T07:22:40.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:40.219 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:22:40.286 INFO:teuthology.orchestra.run.smithi077.stdout:2 2023-11-26T07:22:40.287 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:22:40.288 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:22:40.401 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:22:40.521 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:22:40.521 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:40.521 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:40.581 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:40.582 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:40.634 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:22:40.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.845+0000 7fb847ebb640 1 Processor -- start 2023-11-26T07:22:40.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.846+0000 7fb847ebb640 1 -- start start 2023-11-26T07:22:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.847+0000 7fb847ebb640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb84015df80 0x7fb8400ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.847+0000 7fb847ebb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8400cd470 0x7fb84015b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.847+0000 7fb847ebb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84015e3f0 con 0x7fb8400b2250 2023-11-26T07:22:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.847+0000 7fb847ebb640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84015a990 con 0x7fb84015df80 2023-11-26T07:22:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.847+0000 7fb847ebb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84015ab80 con 0x7fb8400cd470 2023-11-26T07:22:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.847+0000 7fb845c57640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb8400b2250 0x7fb8400b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58210/0 (socket says 172.21.15.77:58210) 2023-11-26T07:22:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.847+0000 7fb845c57640 1 -- 172.21.15.77:0/2498083097 learned_addr learned my addr 172.21.15.77:0/2498083097 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.848+0000 7fb845456640 1 --2- 172.21.15.77:0/2498083097 >> v2:172.21.15.77:3300/0 conn(0x7fb84015df80 0x7fb8400ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.848+0000 7fb844c55640 1 -- 172.21.15.77:0/2498083097 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594384000 0 0) 0x7fb84015e3f0 con 0x7fb8400b2250 2023-11-26T07:22:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.848+0000 7fb846458640 1 --2- 172.21.15.77:0/2498083097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8400cd470 0x7fb84015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.848+0000 7fb844c55640 1 -- 172.21.15.77:0/2498083097 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82c003520 con 0x7fb8400b2250 2023-11-26T07:22:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.848+0000 7fb845456640 1 -- 172.21.15.77:0/2498083097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8400cd470 msgr2=0x7fb84015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.848+0000 7fb845456640 1 --2- 172.21.15.77:0/2498083097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8400cd470 0x7fb84015b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.848+0000 7fb845456640 1 -- 172.21.15.77:0/2498083097 >> v1:172.21.15.77:6789/0 conn(0x7fb8400b2250 legacy=0x7fb8400b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.848+0000 7fb845456640 1 -- 172.21.15.77:0/2498083097 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400b2d40 con 0x7fb84015df80 2023-11-26T07:22:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.849+0000 7fb845456640 1 --2- 172.21.15.77:0/2498083097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb84015df80 0x7fb8400ccf30 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb8300097a0 tx=0x7fb83002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f09edbd6dae804 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.849+0000 7fb844c55640 1 -- 172.21.15.77:0/2498083097 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83002d040 con 0x7fb84015df80 2023-11-26T07:22:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.850+0000 7fb844c55640 1 -- 172.21.15.77:0/2498083097 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830031810 con 0x7fb84015df80 2023-11-26T07:22:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.850+0000 7fb844c55640 1 -- 172.21.15.77:0/2498083097 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830031ba0 con 0x7fb84015df80 2023-11-26T07:22:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.850+0000 7fb847ebb640 1 -- 172.21.15.77:0/2498083097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb84015df80 msgr2=0x7fb8400ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.850+0000 7fb847ebb640 1 --2- 172.21.15.77:0/2498083097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb84015df80 0x7fb8400ccf30 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb8300097a0 tx=0x7fb83002b8b0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.850+0000 7fb847ebb640 1 -- 172.21.15.77:0/2498083097 shutdown_connections 2023-11-26T07:22:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.850+0000 7fb847ebb640 1 --2- 172.21.15.77:0/2498083097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8400cd470 0x7fb84015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.850+0000 7fb847ebb640 1 --2- 172.21.15.77:0/2498083097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb84015df80 0x7fb8400ccf30 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.850+0000 7fb847ebb640 1 -- 172.21.15.77:0/2498083097 >> 172.21.15.77:0/2498083097 conn(0x7fb84006a920 msgr2=0x7fb84006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.850+0000 7fb847ebb640 1 -- 172.21.15.77:0/2498083097 shutdown_connections 2023-11-26T07:22:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.850+0000 7fb847ebb640 1 -- 172.21.15.77:0/2498083097 wait complete. 2023-11-26T07:22:40.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.852+0000 7fb847ebb640 1 Processor -- start 2023-11-26T07:22:40.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.852+0000 7fb847ebb640 1 -- start start 2023-11-26T07:22:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.853+0000 7fb847ebb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8400b2250 0x7fb8400ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.853+0000 7fb847ebb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8400cd470 0x7fb8401505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.853+0000 7fb847ebb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb84015df80 0x7fb8400ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.853+0000 7fb847ebb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400ad9c0 con 0x7fb8400b2250 2023-11-26T07:22:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.853+0000 7fb847ebb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400acdb0 con 0x7fb84015df80 2023-11-26T07:22:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.853+0000 7fb847ebb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400ad090 con 0x7fb8400cd470 2023-11-26T07:22:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.853+0000 7fb845c57640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8400b2250 0x7fb8400ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.853+0000 7fb845c57640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8400b2250 0x7fb8400ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47300/0 (socket says 172.21.15.77:47300) 2023-11-26T07:22:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.853+0000 7fb845c57640 1 -- 172.21.15.77:0/1862814937 learned_addr learned my addr 172.21.15.77:0/1862814937 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:40.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.854+0000 7fb845c57640 1 -- 172.21.15.77:0/1862814937 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8400cd470 msgr2=0x7fb8401505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.854+0000 7fb845c57640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8400cd470 0x7fb8401505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.854+0000 7fb845c57640 1 -- 172.21.15.77:0/1862814937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb84015df80 msgr2=0x7fb8400ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.854+0000 7fb845c57640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb84015df80 0x7fb8400ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.854+0000 7fb845c57640 1 -- 172.21.15.77:0/1862814937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb830009400 con 0x7fb8400b2250 2023-11-26T07:22:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.854+0000 7fb845c57640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8400b2250 0x7fb8400ade50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00c500 tx=0x7fb83c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.854+0000 7fb8367fc640 1 -- 172.21.15.77:0/1862814937 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c005ce0 con 0x7fb8400b2250 2023-11-26T07:22:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.854+0000 7fb8367fc640 1 -- 172.21.15.77:0/1862814937 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c005e40 con 0x7fb8400b2250 2023-11-26T07:22:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.854+0000 7fb847ebb640 1 -- 172.21.15.77:0/1862814937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8400ad370 con 0x7fb8400b2250 2023-11-26T07:22:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.854+0000 7fb8367fc640 1 -- 172.21.15.77:0/1862814937 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c007330 con 0x7fb8400b2250 2023-11-26T07:22:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.855+0000 7fb847ebb640 1 -- 172.21.15.77:0/1862814937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb840157ac0 con 0x7fb8400b2250 2023-11-26T07:22:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.856+0000 7fb847ebb640 1 -- 172.21.15.77:0/1862814937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb840067470 con 0x7fb8400b2250 2023-11-26T07:22:40.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.857+0000 7fb8367fc640 1 -- 172.21.15.77:0/1862814937 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fb83c007490 con 0x7fb8400b2250 2023-11-26T07:22:40.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.857+0000 7fb8367fc640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb82406b6e0 0x7fb82406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:40.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.858+0000 7fb8367fc640 1 -- 172.21.15.77:0/1862814937 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fb83c087740 con 0x7fb8400b2250 2023-11-26T07:22:40.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.858+0000 7fb845456640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb82406b6e0 0x7fb82406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:40.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.858+0000 7fb845456640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb82406b6e0 0x7fb82406dba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb830036000 tx=0x7fb830030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:40.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:40.862+0000 7fb8367fc640 1 -- 172.21.15.77:0/1862814937 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb83c057bc0 con 0x7fb8400b2250 2023-11-26T07:22:41.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.052+0000 7fb847ebb640 1 -- 172.21.15.77:0/1862814937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8400cea00 con 0x7fb8400b2250 2023-11-26T07:22:41.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.055+0000 7fb8367fc640 1 -- 172.21.15.77:0/1862814937 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16606 (secure 0 0 0) 0x7fb83c017090 con 0x7fb8400b2250 2023-11-26T07:22:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:22:41.058 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":64,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:22:40.721177+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:40.058564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:41.292572+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:22:41.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 -- 172.21.15.77:0/1862814937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb82406b6e0 msgr2=0x7fb82406dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb82406b6e0 0x7fb82406dba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb830036000 tx=0x7fb830030000 comp rx=0 tx=0).stop 2023-11-26T07:22:41.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 -- 172.21.15.77:0/1862814937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8400b2250 msgr2=0x7fb8400ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8400b2250 0x7fb8400ade50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00c500 tx=0x7fb83c00c9c0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 -- 172.21.15.77:0/1862814937 shutdown_connections 2023-11-26T07:22:41.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb82406b6e0 0x7fb82406dba0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb84015df80 0x7fb8400ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8400cd470 0x7fb8401505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 --2- 172.21.15.77:0/1862814937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8400b2250 0x7fb8400ade50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 -- 172.21.15.77:0/1862814937 >> 172.21.15.77:0/1862814937 conn(0x7fb84006a920 msgr2=0x7fb8400cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:41.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 -- 172.21.15.77:0/1862814937 shutdown_connections 2023-11-26T07:22:41.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.058+0000 7fb847ebb640 1 -- 172.21.15.77:0/1862814937 wait complete. 2023-11-26T07:22:41.080 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:21:40.058564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:21:41.292572+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 63, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:22:41.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:22:41.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.296+0000 7f7761c7c640 1 Processor -- start 2023-11-26T07:22:41.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.296+0000 7f7761c7c640 1 -- start start 2023-11-26T07:22:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.298+0000 7f7761c7c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f775c15b440 0x7f775c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.298+0000 7f7761c7c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f775c0c59b0 0x7f775c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.298+0000 7f7761c7c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c0cc3a0 con 0x7f775c0cbf20 2023-11-26T07:22:41.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.298+0000 7f7761c7c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775c15b820 con 0x7f775c0c59b0 2023-11-26T07:22:41.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.298+0000 7f7761c7c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c15eea0 con 0x7f775c15b440 2023-11-26T07:22:41.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.298+0000 7f7753fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f775c0cbf20 0x7f775c0c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58214/0 (socket says 172.21.15.77:58214) 2023-11-26T07:22:41.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.298+0000 7f7753fff640 1 -- 172.21.15.77:0/3043740517 learned_addr learned my addr 172.21.15.77:0/3043740517 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:41.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775b7fe640 1 --2- 172.21.15.77:0/3043740517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f775c15b440 0x7f775c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775bfff640 1 --2- 172.21.15.77:0/3043740517 >> v2:172.21.15.159:3300/0 conn(0x7f775c0c59b0 0x7f775c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886423674 0 0) 0x7f7744001110 con 0x7f775c0cbf20 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7748003520 con 0x7f775c0cbf20 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 151326512 0 0) 0x7f7748003520 con 0x7f775c0cbf20 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f775c15b440 msgr2=0x7f775c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 --2- 172.21.15.77:0/3043740517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f775c15b440 0x7f775c0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 >> v2:172.21.15.159:3300/0 conn(0x7f775c0c59b0 msgr2=0x7f775c06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 --2- 172.21.15.77:0/3043740517 >> v2:172.21.15.159:3300/0 conn(0x7f775c0c59b0 0x7f775c06c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c0abf30 con 0x7f775c0cbf20 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f7744001800 con 0x7f775c0cbf20 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 >> v1:172.21.15.77:6789/0 conn(0x7f775c0cbf20 legacy=0x7f775c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 --2- 172.21.15.77:0/3043740517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7748003970 0x7f7748003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 --2- 172.21.15.77:0/3043740517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f775c15b440 0x7f77480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 --2- 172.21.15.77:0/3043740517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748004d00 0x7f7748005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c15b820 con 0x7f7748003970 2023-11-26T07:22:41.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c15eea0 con 0x7f7748004d00 2023-11-26T07:22:41.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.299+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774800b980 con 0x7f775c15b440 2023-11-26T07:22:41.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.300+0000 7f775b7fe640 1 --2- 172.21.15.77:0/3043740517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7748003970 0x7f7748003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.300+0000 7f7753fff640 1 --2- 172.21.15.77:0/3043740517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f775c15b440 0x7f77480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.300+0000 7f775b7fe640 1 -- 172.21.15.77:0/3043740517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f775c15b440 msgr2=0x7f77480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:41.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.300+0000 7f775b7fe640 1 --2- 172.21.15.77:0/3043740517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f775c15b440 0x7f77480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.300+0000 7f775b7fe640 1 -- 172.21.15.77:0/3043740517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748004d00 msgr2=0x7f7748005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:41.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.300+0000 7f775b7fe640 1 --2- 172.21.15.77:0/3043740517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748004d00 0x7f7748005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.300+0000 7f775b7fe640 1 -- 172.21.15.77:0/3043740517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7748003520 con 0x7f7748003970 2023-11-26T07:22:41.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.301+0000 7f775b7fe640 1 --2- 172.21.15.77:0/3043740517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7748003970 0x7f7748003d90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f774c009ac0 tx=0x7f77480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a162162357b101d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.302+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c02c6b0 con 0x7f7748003970 2023-11-26T07:22:41.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.302+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c02c810 con 0x7f7748003970 2023-11-26T07:22:41.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.302+0000 7f775affd640 1 -- 172.21.15.77:0/3043740517 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c02cba0 con 0x7f7748003970 2023-11-26T07:22:41.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.302+0000 7f7761c7c640 1 -- 172.21.15.77:0/3043740517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7748003970 msgr2=0x7f7748003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.302+0000 7f7761c7c640 1 --2- 172.21.15.77:0/3043740517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7748003970 0x7f7748003d90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f774c009ac0 tx=0x7f77480057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.302+0000 7f775bfff640 1 -- 172.21.15.77:0/3043740517 reap_dead start 2023-11-26T07:22:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.302+0000 7f7761c7c640 1 -- 172.21.15.77:0/3043740517 shutdown_connections 2023-11-26T07:22:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.302+0000 7f7761c7c640 1 -- 172.21.15.77:0/3043740517 >> 172.21.15.77:0/3043740517 conn(0x7f775c0b0c50 msgr2=0x7f775c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.302+0000 7f7761c7c640 1 -- 172.21.15.77:0/3043740517 shutdown_connections 2023-11-26T07:22:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.302+0000 7f7761c7c640 1 -- 172.21.15.77:0/3043740517 wait complete. 2023-11-26T07:22:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.304+0000 7f7761c7c640 1 Processor -- start 2023-11-26T07:22:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.304+0000 7f7761c7c640 1 -- start start 2023-11-26T07:22:41.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.305+0000 7f7761c7c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7748003970 0x7f775c14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.305+0000 7f7761c7c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f775c0c7ad0 0x7f775c0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.305+0000 7f7761c7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775c0c7f20 0x7f775c0ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.305+0000 7f7761c7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c0b1cb0 con 0x7f775c0c7f20 2023-11-26T07:22:41.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.305+0000 7f7761c7c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c156b60 con 0x7f775c0c7ad0 2023-11-26T07:22:41.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.305+0000 7f7761c7c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c0b1ec0 con 0x7f7748003970 2023-11-26T07:22:41.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.305+0000 7f775bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775c0c7f20 0x7f775c0ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.305+0000 7f775bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775c0c7f20 0x7f775c0ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47314/0 (socket says 172.21.15.77:47314) 2023-11-26T07:22:41.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.305+0000 7f775bfff640 1 -- 172.21.15.77:0/3660187669 learned_addr learned my addr 172.21.15.77:0/3660187669 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:41.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.306+0000 7f775b7fe640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7748003970 0x7f775c14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.306+0000 7f775bfff640 1 -- 172.21.15.77:0/3660187669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7748003970 msgr2=0x7f775c14cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.306+0000 7f775bfff640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7748003970 0x7f775c14cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.306+0000 7f775bfff640 1 -- 172.21.15.77:0/3660187669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f775c0c7ad0 msgr2=0x7f775c0b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.306+0000 7f775bfff640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f775c0c7ad0 0x7f775c0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.306+0000 7f775bfff640 1 -- 172.21.15.77:0/3660187669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c0b21a0 con 0x7f775c0c7f20 2023-11-26T07:22:41.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.306+0000 7f775bfff640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775c0c7f20 0x7f775c0ad930 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f775c06e770 tx=0x7f775400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.306+0000 7f7758ff9640 1 -- 172.21.15.77:0/3660187669 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754010040 con 0x7f775c0c7f20 2023-11-26T07:22:41.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.306+0000 7f7758ff9640 1 -- 172.21.15.77:0/3660187669 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775400bce0 con 0x7f775c0c7f20 2023-11-26T07:22:41.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.306+0000 7f7758ff9640 1 -- 172.21.15.77:0/3660187669 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754014640 con 0x7f775c0c7f20 2023-11-26T07:22:41.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.306+0000 7f7761c7c640 1 -- 172.21.15.77:0/3660187669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775c0c8460 con 0x7f775c0c7f20 2023-11-26T07:22:41.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.307+0000 7f7761c7c640 1 -- 172.21.15.77:0/3660187669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775c0ade70 con 0x7f775c0c7f20 2023-11-26T07:22:41.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.308+0000 7f7761c7c640 1 -- 172.21.15.77:0/3660187669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775c156d20 con 0x7f775c0c7f20 2023-11-26T07:22:41.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.308+0000 7f7758ff9640 1 -- 172.21.15.77:0/3660187669 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f77540147a0 con 0x7f775c0c7f20 2023-11-26T07:22:41.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.309+0000 7f7758ff9640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f773c06b6b0 0x7f773c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.310+0000 7f7758ff9640 1 -- 172.21.15.77:0/3660187669 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f7754088600 con 0x7f775c0c7f20 2023-11-26T07:22:41.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.310+0000 7f775b7fe640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f773c06b6b0 0x7f773c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.311+0000 7f775b7fe640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f773c06b6b0 0x7f773c06db70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f774c036000 tx=0x7f774c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.314+0000 7f7758ff9640 1 -- 172.21.15.77:0/3660187669 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7754055100 con 0x7f775c0c7f20 2023-11-26T07:22:41.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.504+0000 7f7761c7c640 1 -- 172.21.15.77:0/3660187669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f775c04e8b0 con 0x7f775c0c7f20 2023-11-26T07:22:41.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.505+0000 7f7758ff9640 1 -- 172.21.15.77:0/3660187669 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7754058720 con 0x7f775c0c7f20 2023-11-26T07:22:41.507 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:22:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 -- 172.21.15.77:0/3660187669 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f773c06b6b0 msgr2=0x7f773c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f773c06b6b0 0x7f773c06db70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f774c036000 tx=0x7f774c030000 comp rx=0 tx=0).stop 2023-11-26T07:22:41.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 -- 172.21.15.77:0/3660187669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775c0c7f20 msgr2=0x7f775c0ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775c0c7f20 0x7f775c0ad930 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f775c06e770 tx=0x7f775400b480 comp rx=0 tx=0).stop 2023-11-26T07:22:41.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 -- 172.21.15.77:0/3660187669 shutdown_connections 2023-11-26T07:22:41.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f773c06b6b0 0x7f773c06db70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775c0c7f20 0x7f775c0ad930 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f775c0c7ad0 0x7f775c0b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 --2- 172.21.15.77:0/3660187669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7748003970 0x7f775c14cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 -- 172.21.15.77:0/3660187669 >> 172.21.15.77:0/3660187669 conn(0x7f775c0b0c50 msgr2=0x7f775c0b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:41.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 -- 172.21.15.77:0/3660187669 shutdown_connections 2023-11-26T07:22:41.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.507+0000 7f7761c7c640 1 -- 172.21.15.77:0/3660187669 wait complete. 2023-11-26T07:22:41.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:22:41.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.741+0000 7fd0affff640 1 Processor -- start 2023-11-26T07:22:41.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.741+0000 7fd0affff640 1 -- start start 2023-11-26T07:22:41.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.743+0000 7fd0affff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd0b015d310 0x7fd0b00ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.743+0000 7fd0affff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b00b0b40 0x7fd0b00b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.743+0000 7fd0affff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b00b14a0 con 0x7fd0b0160f70 2023-11-26T07:22:41.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.743+0000 7fd0affff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b006cd10 con 0x7fd0b015d310 2023-11-26T07:22:41.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.743+0000 7fd0affff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00ae5d0 con 0x7fd0b00b0b40 2023-11-26T07:22:41.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.743+0000 7fd0af7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd0b0160f70 0x7fd0b01613d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58224/0 (socket says 172.21.15.77:58224) 2023-11-26T07:22:41.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.743+0000 7fd0af7fe640 1 -- 172.21.15.77:0/3311310870 learned_addr learned my addr 172.21.15.77:0/3311310870 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:41.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0ae7fc640 1 --2- 172.21.15.77:0/3311310870 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b00b0b40 0x7fd0b00b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0aeffd640 1 --2- 172.21.15.77:0/3311310870 >> v2:172.21.15.159:3300/0 conn(0x7fd0b015d310 0x7fd0b00ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221336314 0 0) 0x7fd0b00b14a0 con 0x7fd0b0160f70 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd098003520 con 0x7fd0b0160f70 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1020247618 0 0) 0x7fd098003520 con 0x7fd0b0160f70 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b00b0b40 msgr2=0x7fd0b00b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 --2- 172.21.15.77:0/3311310870 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b00b0b40 0x7fd0b00b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 >> v2:172.21.15.159:3300/0 conn(0x7fd0b015d310 msgr2=0x7fd0b00ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 --2- 172.21.15.77:0/3311310870 >> v2:172.21.15.159:3300/0 conn(0x7fd0b015d310 0x7fd0b00ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00ae8b0 con 0x7fd0b0160f70 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fd0a80019f0 con 0x7fd0b0160f70 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 >> v1:172.21.15.77:6789/0 conn(0x7fd0b0160f70 legacy=0x7fd0b01613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 --2- 172.21.15.77:0/3311310870 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b00b0b40 0x7fd098003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 --2- 172.21.15.77:0/3311310870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd098003ef0 0x7fd0980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 --2- 172.21.15.77:0/3311310870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd098004d00 0x7fd098005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b006cd10 con 0x7fd098003ef0 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00ae5d0 con 0x7fd098004d00 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.744+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09800b980 con 0x7fd0b00b0b40 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.745+0000 7fd0ae7fc640 1 --2- 172.21.15.77:0/3311310870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd098003ef0 0x7fd0980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.745+0000 7fd0aeffd640 1 --2- 172.21.15.77:0/3311310870 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b00b0b40 0x7fd098003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.745+0000 7fd0ae7fc640 1 -- 172.21.15.77:0/3311310870 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b00b0b40 msgr2=0x7fd098003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.745+0000 7fd0ae7fc640 1 --2- 172.21.15.77:0/3311310870 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b00b0b40 0x7fd098003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.745+0000 7fd0ae7fc640 1 -- 172.21.15.77:0/3311310870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd098004d00 msgr2=0x7fd098005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.745+0000 7fd0ae7fc640 1 --2- 172.21.15.77:0/3311310870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd098004d00 0x7fd098005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.745+0000 7fd0ae7fc640 1 -- 172.21.15.77:0/3311310870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098003520 con 0x7fd098003ef0 2023-11-26T07:22:41.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.747+0000 7fd0ae7fc640 1 --2- 172.21.15.77:0/3311310870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd098003ef0 0x7fd0980047c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009ac0 tx=0x7fd0980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50e4cd9877839de server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.747+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a402c6b0 con 0x7fd098003ef0 2023-11-26T07:22:41.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.747+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a402c810 con 0x7fd098003ef0 2023-11-26T07:22:41.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.747+0000 7fd0adffb640 1 -- 172.21.15.77:0/3311310870 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a402cba0 con 0x7fd098003ef0 2023-11-26T07:22:41.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.748+0000 7fd0affff640 1 -- 172.21.15.77:0/3311310870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd098003ef0 msgr2=0x7fd0980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.748+0000 7fd0affff640 1 --2- 172.21.15.77:0/3311310870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd098003ef0 0x7fd0980047c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009ac0 tx=0x7fd0980057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.748+0000 7fd0af7fe640 1 -- 172.21.15.77:0/3311310870 reap_dead start 2023-11-26T07:22:41.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.748+0000 7fd0affff640 1 -- 172.21.15.77:0/3311310870 shutdown_connections 2023-11-26T07:22:41.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.748+0000 7fd0affff640 1 -- 172.21.15.77:0/3311310870 >> 172.21.15.77:0/3311310870 conn(0x7fd0b00cbb40 msgr2=0x7fd0b00cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:41.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.748+0000 7fd0affff640 1 -- 172.21.15.77:0/3311310870 shutdown_connections 2023-11-26T07:22:41.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.748+0000 7fd0affff640 1 -- 172.21.15.77:0/3311310870 wait complete. 2023-11-26T07:22:41.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.750+0000 7fd0affff640 1 Processor -- start 2023-11-26T07:22:41.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.750+0000 7fd0affff640 1 -- start start 2023-11-26T07:22:41.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0affff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd098003ef0 0x7fd0b0160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b01565e0 0x7fd0b014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0affff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0b00999d0 0x7fd0b00c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0affff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b014c9e0 con 0x7fd0b01565e0 2023-11-26T07:22:41.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0affff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00c3ce0 con 0x7fd0b00999d0 2023-11-26T07:22:41.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0affff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00c3f80 con 0x7fd098003ef0 2023-11-26T07:22:41.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0ae7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b01565e0 0x7fd0b014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0ae7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b01565e0 0x7fd0b014c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47338/0 (socket says 172.21.15.77:47338) 2023-11-26T07:22:41.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0ae7fc640 1 -- 172.21.15.77:0/3323123195 learned_addr learned my addr 172.21.15.77:0/3323123195 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:41.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0ae7fc640 1 -- 172.21.15.77:0/3323123195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd098003ef0 msgr2=0x7fd0b0160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0ae7fc640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd098003ef0 0x7fd0b0160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0ae7fc640 1 -- 172.21.15.77:0/3323123195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0b00999d0 msgr2=0x7fd0b00c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0ae7fc640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0b00999d0 0x7fd0b00c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.751+0000 7fd0ae7fc640 1 -- 172.21.15.77:0/3323123195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00c4260 con 0x7fd0b01565e0 2023-11-26T07:22:41.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.752+0000 7fd0ae7fc640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b01565e0 0x7fd0b014c4a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd0a402c2b0 tx=0x7fd0a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.752+0000 7fd0977fe640 1 -- 172.21.15.77:0/3323123195 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4003810 con 0x7fd0b01565e0 2023-11-26T07:22:41.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.752+0000 7fd0977fe640 1 -- 172.21.15.77:0/3323123195 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a4003970 con 0x7fd0b01565e0 2023-11-26T07:22:41.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.752+0000 7fd0affff640 1 -- 172.21.15.77:0/3323123195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b014c9e0 con 0x7fd0b01565e0 2023-11-26T07:22:41.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.752+0000 7fd0977fe640 1 -- 172.21.15.77:0/3323123195 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4003ce0 con 0x7fd0b01565e0 2023-11-26T07:22:41.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.752+0000 7fd0affff640 1 -- 172.21.15.77:0/3323123195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b00c4820 con 0x7fd0b01565e0 2023-11-26T07:22:41.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.753+0000 7fd0affff640 1 -- 172.21.15.77:0/3323123195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b004e840 con 0x7fd0b01565e0 2023-11-26T07:22:41.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.754+0000 7fd0977fe640 1 -- 172.21.15.77:0/3323123195 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fd0a4034440 con 0x7fd0b01565e0 2023-11-26T07:22:41.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.755+0000 7fd0977fe640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd09c06b6b0 0x7fd09c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.756+0000 7fd0977fe640 1 -- 172.21.15.77:0/3323123195 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fd0a40aa2a0 con 0x7fd0b01565e0 2023-11-26T07:22:41.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.756+0000 7fd0aeffd640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd09c06b6b0 0x7fd09c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.756+0000 7fd0aeffd640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd09c06b6b0 0x7fd09c06db70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009990 tx=0x7fd0a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.760+0000 7fd0977fe640 1 -- 172.21.15.77:0/3323123195 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0a4076c80 con 0x7fd0b01565e0 2023-11-26T07:22:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.951+0000 7fd0affff640 1 -- 172.21.15.77:0/3323123195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0b0160ca0 con 0x7fd0b01565e0 2023-11-26T07:22:41.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.952+0000 7fd0977fe640 1 -- 172.21.15.77:0/3323123195 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0a404c020 con 0x7fd0b01565e0 2023-11-26T07:22:41.955 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:22:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 -- 172.21.15.77:0/3323123195 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd09c06b6b0 msgr2=0x7fd09c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd09c06b6b0 0x7fd09c06db70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009990 tx=0x7fd0a0008040 comp rx=0 tx=0).stop 2023-11-26T07:22:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 -- 172.21.15.77:0/3323123195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b01565e0 msgr2=0x7fd0b014c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b01565e0 0x7fd0b014c4a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd0a402c2b0 tx=0x7fd0a4004730 comp rx=0 tx=0).stop 2023-11-26T07:22:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 -- 172.21.15.77:0/3323123195 shutdown_connections 2023-11-26T07:22:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd09c06b6b0 0x7fd09c06db70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0b00999d0 0x7fd0b00c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b01565e0 0x7fd0b014c4a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 --2- 172.21.15.77:0/3323123195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd098003ef0 0x7fd0b0160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 -- 172.21.15.77:0/3323123195 >> 172.21.15.77:0/3323123195 conn(0x7fd0b00cbb40 msgr2=0x7fd0b00b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 -- 172.21.15.77:0/3323123195 shutdown_connections 2023-11-26T07:22:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:41.955+0000 7fd0affff640 1 -- 172.21.15.77:0/3323123195 wait complete. 2023-11-26T07:22:41.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:22:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.192+0000 7f79ee4b4640 1 Processor -- start 2023-11-26T07:22:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.192+0000 7f79ee4b4640 1 -- start start 2023-11-26T07:22:42.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79ee4b4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e806f360 0x7f79e80cb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79ee4b4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e806bb90 con 0x7f79e80ce2c0 2023-11-26T07:22:42.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79ee4b4640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e806be70 con 0x7f79e815d380 2023-11-26T07:22:42.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79ee4b4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e806b980 con 0x7f79e806f360 2023-11-26T07:22:42.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79eca51640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f79e80ce2c0 0x7f79e8070100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58240/0 (socket says 172.21.15.77:58240) 2023-11-26T07:22:42.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79eca51640 1 -- 172.21.15.77:0/3217632610 learned_addr learned my addr 172.21.15.77:0/3217632610 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:42.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79dffff640 1 --2- 172.21.15.77:0/3217632610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e806f360 0x7f79e80cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:42.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943368134 0 0) 0x7f79e806bb90 con 0x7f79e80ce2c0 2023-11-26T07:22:42.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d4003520 con 0x7f79e80ce2c0 2023-11-26T07:22:42.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1885929347 0 0) 0x7f79d4003520 con 0x7f79e80ce2c0 2023-11-26T07:22:42.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e806f360 msgr2=0x7f79e80cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:42.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79e77fe640 1 --2- 172.21.15.77:0/3217632610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e806f360 0x7f79e80cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 >> v1:172.21.15.159:6789/0 conn(0x7f79e815d380 legacy=0x7f79e80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e806c150 con 0x7f79e80ce2c0 2023-11-26T07:22:42.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f79e00019f0 con 0x7f79e80ce2c0 2023-11-26T07:22:42.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 >> v1:172.21.15.77:6789/0 conn(0x7f79e80ce2c0 legacy=0x7f79e8070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.194+0000 7f79e77fe640 1 --2- 172.21.15.77:0/3217632610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d40039a0 0x7f79d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.195+0000 7f79e77fe640 1 --2- 172.21.15.77:0/3217632610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40047c0 0x7f79d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.195+0000 7f79e77fe640 1 --2- 172.21.15.77:0/3217632610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e806f360 0x7f79d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.195+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e806b980 con 0x7f79d40047c0 2023-11-26T07:22:42.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.195+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d400ba60 con 0x7f79d40039a0 2023-11-26T07:22:42.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.195+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d400bc20 con 0x7f79e806f360 2023-11-26T07:22:42.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.195+0000 7f79dffff640 1 --2- 172.21.15.77:0/3217632610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40047c0 0x7f79d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:42.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.195+0000 7f79dffff640 1 -- 172.21.15.77:0/3217632610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e806f360 msgr2=0x7f79d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:42.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.195+0000 7f79dffff640 1 --2- 172.21.15.77:0/3217632610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e806f360 0x7f79d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.195+0000 7f79dffff640 1 -- 172.21.15.77:0/3217632610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d40039a0 msgr2=0x7f79d4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:42.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.195+0000 7f79dffff640 1 --2- 172.21.15.77:0/3217632610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d40039a0 0x7f79d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.195+0000 7f79dffff640 1 -- 172.21.15.77:0/3217632610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d4003520 con 0x7f79d40047c0 2023-11-26T07:22:42.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.196+0000 7f79dffff640 1 --2- 172.21.15.77:0/3217632610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40047c0 0x7f79d4004c40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009a90 tx=0x7f79d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b87df57bc9157cd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:42.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.197+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d002c6b0 con 0x7f79d40047c0 2023-11-26T07:22:42.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.197+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d002c810 con 0x7f79d40047c0 2023-11-26T07:22:42.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.197+0000 7f79e77fe640 1 -- 172.21.15.77:0/3217632610 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d002cba0 con 0x7f79d40047c0 2023-11-26T07:22:42.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.197+0000 7f79ee4b4640 1 -- 172.21.15.77:0/3217632610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40047c0 msgr2=0x7f79d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.197+0000 7f79ee4b4640 1 --2- 172.21.15.77:0/3217632610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40047c0 0x7f79d4004c40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009a90 tx=0x7f79d40057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.197+0000 7f79eca51640 1 -- 172.21.15.77:0/3217632610 reap_dead start 2023-11-26T07:22:42.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.197+0000 7f79ee4b4640 1 -- 172.21.15.77:0/3217632610 shutdown_connections 2023-11-26T07:22:42.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.197+0000 7f79ee4b4640 1 -- 172.21.15.77:0/3217632610 >> 172.21.15.77:0/3217632610 conn(0x7f79e806e7d0 msgr2=0x7f79e806ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:42.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.197+0000 7f79ee4b4640 1 -- 172.21.15.77:0/3217632610 shutdown_connections 2023-11-26T07:22:42.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.197+0000 7f79ee4b4640 1 -- 172.21.15.77:0/3217632610 wait complete. 2023-11-26T07:22:42.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.199+0000 7f79ee4b4640 1 Processor -- start 2023-11-26T07:22:42.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.199+0000 7f79ee4b4640 1 -- start start 2023-11-26T07:22:42.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.200+0000 7f79ee4b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d40047c0 0x7f79e80c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.200+0000 7f79ee4b4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e80c7510 0x7f79e80c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.200+0000 7f79ee4b4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80c7970 0x7f79e80c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.200+0000 7f79ee4b4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80c64d0 con 0x7f79e80c7970 2023-11-26T07:22:42.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.200+0000 7f79ee4b4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80c6e30 con 0x7f79d40047c0 2023-11-26T07:22:42.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.200+0000 7f79ee4b4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80c5600 con 0x7f79e80c7510 2023-11-26T07:22:42.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79eca51640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80c7970 0x7f79e80c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:42.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79eca51640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80c7970 0x7f79e80c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47358/0 (socket says 172.21.15.77:47358) 2023-11-26T07:22:42.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79eca51640 1 -- 172.21.15.77:0/967793058 learned_addr learned my addr 172.21.15.77:0/967793058 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79dffff640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e80c7510 0x7f79e80c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79eca51640 1 -- 172.21.15.77:0/967793058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e80c7510 msgr2=0x7f79e80c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79eca51640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e80c7510 0x7f79e80c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79eca51640 1 -- 172.21.15.77:0/967793058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d40047c0 msgr2=0x7f79e80c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79e7fff640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d40047c0 0x7f79e80c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79eca51640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d40047c0 0x7f79e80c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79eca51640 1 -- 172.21.15.77:0/967793058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e8158800 con 0x7f79e80c7970 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79e7fff640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d40047c0 0x7f79e80c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.201+0000 7f79eca51640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80c7970 0x7f79e80c8810 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f79e80d0600 tx=0x7f79e000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.202+0000 7f79e57fa640 1 -- 172.21.15.77:0/967793058 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000a5b0 con 0x7f79e80c7970 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.202+0000 7f79e57fa640 1 -- 172.21.15.77:0/967793058 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e000a730 con 0x7f79e80c7970 2023-11-26T07:22:42.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.202+0000 7f79e57fa640 1 -- 172.21.15.77:0/967793058 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000aae0 con 0x7f79e80c7970 2023-11-26T07:22:42.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.202+0000 7f79ee4b4640 1 -- 172.21.15.77:0/967793058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e80c5850 con 0x7f79e80c7970 2023-11-26T07:22:42.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.202+0000 7f79ee4b4640 1 -- 172.21.15.77:0/967793058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e80c5e10 con 0x7f79e80c7970 2023-11-26T07:22:42.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.203+0000 7f79ee4b4640 1 -- 172.21.15.77:0/967793058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e804e8b0 con 0x7f79e80c7970 2023-11-26T07:22:42.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.204+0000 7f79e57fa640 1 -- 172.21.15.77:0/967793058 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f79e000ac40 con 0x7f79e80c7970 2023-11-26T07:22:42.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.205+0000 7f79e57fa640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79c806b6b0 0x7f79c806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.205+0000 7f79e57fa640 1 -- 172.21.15.77:0/967793058 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f79e0087320 con 0x7f79e80c7970 2023-11-26T07:22:42.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.205+0000 7f79e7fff640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79c806b6b0 0x7f79c806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:42.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.206+0000 7f79e7fff640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79c806b6b0 0x7f79c806db70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f79d80016b0 tx=0x7f79d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:42.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.209+0000 7f79e57fa640 1 -- 172.21.15.77:0/967793058 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79e0053c20 con 0x7f79e80c7970 2023-11-26T07:22:42.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.389+0000 7f79ee4b4640 1 -- 172.21.15.77:0/967793058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79e80b0670 con 0x7f79e80c7970 2023-11-26T07:22:42.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.390+0000 7f79e57fa640 1 -- 172.21.15.77:0/967793058 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79e0019030 con 0x7f79e80c7970 2023-11-26T07:22:42.392 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:22:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.392+0000 7f79ee4b4640 1 -- 172.21.15.77:0/967793058 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79c806b6b0 msgr2=0x7f79c806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.392+0000 7f79ee4b4640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79c806b6b0 0x7f79c806db70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f79d80016b0 tx=0x7f79d8009040 comp rx=0 tx=0).stop 2023-11-26T07:22:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.392+0000 7f79ee4b4640 1 -- 172.21.15.77:0/967793058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80c7970 msgr2=0x7f79e80c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.392+0000 7f79ee4b4640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80c7970 0x7f79e80c8810 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f79e80d0600 tx=0x7f79e000cf00 comp rx=0 tx=0).stop 2023-11-26T07:22:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.392+0000 7f79ee4b4640 1 -- 172.21.15.77:0/967793058 shutdown_connections 2023-11-26T07:22:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.392+0000 7f79ee4b4640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f79c806b6b0 0x7f79c806db70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.392+0000 7f79ee4b4640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80c7970 0x7f79e80c8810 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.392+0000 7f79ee4b4640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79e80c7510 0x7f79e80c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.392+0000 7f79ee4b4640 1 --2- 172.21.15.77:0/967793058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79d40047c0 0x7f79e80c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.392+0000 7f79ee4b4640 1 -- 172.21.15.77:0/967793058 >> 172.21.15.77:0/967793058 conn(0x7f79e806e7d0 msgr2=0x7f79e80cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:42.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.393+0000 7f79ee4b4640 1 -- 172.21.15.77:0/967793058 shutdown_connections 2023-11-26T07:22:42.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.393+0000 7f79ee4b4640 1 -- 172.21.15.77:0/967793058 wait complete. 2023-11-26T07:22:42.413 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:22:42.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.621+0000 7fac80953640 1 Processor -- start 2023-11-26T07:22:42.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.621+0000 7fac80953640 1 -- start start 2023-11-26T07:22:42.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.622+0000 7fac80953640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac7c15d720 0x7fac7c0d3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.622+0000 7fac80953640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fac7c0d3870 0x7fac7c0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.622+0000 7fac80953640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c15db00 con 0x7fac7c0b1400 2023-11-26T07:22:42.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.623+0000 7fac80953640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7c0d0ce0 con 0x7fac7c0d3870 2023-11-26T07:22:42.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.623+0000 7fac80953640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c06d400 con 0x7fac7c15d720 2023-11-26T07:22:42.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.623+0000 7fac79d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fac7c0d3870 0x7fac7c0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:42.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.623+0000 7fac79d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fac7c0d3870 0x7fac7c0b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47368/0 (socket says 172.21.15.77:47368) 2023-11-26T07:22:42.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.623+0000 7fac79d9b640 1 -- 172.21.15.77:0/1203179290 learned_addr learned my addr 172.21.15.77:0/1203179290 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:42.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.623+0000 7fac7a59c640 1 --2- 172.21.15.77:0/1203179290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac7c15d720 0x7fac7c0d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:42.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.623+0000 7fac79d9b640 1 -- 172.21.15.77:0/1203179290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac7c15d720 msgr2=0x7fac7c0d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:42.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.623+0000 7fac79d9b640 1 --2- 172.21.15.77:0/1203179290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac7c15d720 0x7fac7c0d3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.623+0000 7fac79d9b640 1 -- 172.21.15.77:0/1203179290 >> v1:172.21.15.159:6789/0 conn(0x7fac7c0b1400 legacy=0x7fac7c0b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:42.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.623+0000 7fac79d9b640 1 -- 172.21.15.77:0/1203179290 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c0d3cf0 con 0x7fac7c0d3870 2023-11-26T07:22:42.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.623+0000 7fac7a59c640 1 --2- 172.21.15.77:0/1203179290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac7c15d720 0x7fac7c0d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:42.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.624+0000 7fac79d9b640 1 --2- 172.21.15.77:0/1203179290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac7c0d3870 0x7fac7c0b0ec0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fac64009870 tx=0x7fac6402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ea05ea2cafce1d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:42.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.625+0000 7fac7959a640 1 -- 172.21.15.77:0/1203179290 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac640317c0 con 0x7fac7c0d3870 2023-11-26T07:22:42.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.625+0000 7fac7959a640 1 -- 172.21.15.77:0/1203179290 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac64031920 con 0x7fac7c0d3870 2023-11-26T07:22:42.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.625+0000 7fac7959a640 1 -- 172.21.15.77:0/1203179290 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64031cb0 con 0x7fac7c0d3870 2023-11-26T07:22:42.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.625+0000 7fac80953640 1 -- 172.21.15.77:0/1203179290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac7c0d3870 msgr2=0x7fac7c0b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.625+0000 7fac80953640 1 --2- 172.21.15.77:0/1203179290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac7c0d3870 0x7fac7c0b0ec0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fac64009870 tx=0x7fac6402b860 comp rx=0 tx=0).stop 2023-11-26T07:22:42.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.625+0000 7fac80953640 1 -- 172.21.15.77:0/1203179290 shutdown_connections 2023-11-26T07:22:42.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.625+0000 7fac80953640 1 --2- 172.21.15.77:0/1203179290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac7c0d3870 0x7fac7c0b0ec0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.625+0000 7fac80953640 1 --2- 172.21.15.77:0/1203179290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac7c15d720 0x7fac7c0d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.625+0000 7fac80953640 1 -- 172.21.15.77:0/1203179290 >> 172.21.15.77:0/1203179290 conn(0x7fac7c08af60 msgr2=0x7fac7c09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:42.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.626+0000 7fac80953640 1 -- 172.21.15.77:0/1203179290 shutdown_connections 2023-11-26T07:22:42.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.626+0000 7fac80953640 1 -- 172.21.15.77:0/1203179290 wait complete. 2023-11-26T07:22:42.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.627+0000 7fac80953640 1 Processor -- start 2023-11-26T07:22:42.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.627+0000 7fac80953640 1 -- start start 2023-11-26T07:22:42.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.628+0000 7fac80953640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac7c0b1400 0x7fac7c155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.628+0000 7fac80953640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac7c0d3870 0x7fac7c0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.628+0000 7fac80953640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac7c15d720 0x7fac7c0b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.628+0000 7fac80953640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c0c7f70 con 0x7fac7c0d3870 2023-11-26T07:22:42.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.628+0000 7fac80953640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c0c72f0 con 0x7fac7c0b1400 2023-11-26T07:22:42.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.628+0000 7fac80953640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c0c75d0 con 0x7fac7c15d720 2023-11-26T07:22:42.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.629+0000 7fac79d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac7c0d3870 0x7fac7c0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:42.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.629+0000 7fac79d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac7c0d3870 0x7fac7c0c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47380/0 (socket says 172.21.15.77:47380) 2023-11-26T07:22:42.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.629+0000 7fac79d9b640 1 -- 172.21.15.77:0/1218977598 learned_addr learned my addr 172.21.15.77:0/1218977598 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:42.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.629+0000 7fac79d9b640 1 -- 172.21.15.77:0/1218977598 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac7c15d720 msgr2=0x7fac7c0b7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.629+0000 7fac79d9b640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac7c15d720 0x7fac7c0b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.629+0000 7fac79d9b640 1 -- 172.21.15.77:0/1218977598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac7c0b1400 msgr2=0x7fac7c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.629+0000 7fac79d9b640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac7c0b1400 0x7fac7c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.629+0000 7fac79d9b640 1 -- 172.21.15.77:0/1218977598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac640094d0 con 0x7fac7c0d3870 2023-11-26T07:22:42.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.629+0000 7fac79d9b640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac7c0d3870 0x7fac7c0c8390 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fac64000c00 tx=0x7fac640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:42.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.630+0000 7fac72ffd640 1 -- 172.21.15.77:0/1218977598 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac640329a0 con 0x7fac7c0d3870 2023-11-26T07:22:42.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.630+0000 7fac72ffd640 1 -- 172.21.15.77:0/1218977598 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac64032b20 con 0x7fac7c0d3870 2023-11-26T07:22:42.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.630+0000 7fac80953640 1 -- 172.21.15.77:0/1218977598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7c0c78b0 con 0x7fac7c0d3870 2023-11-26T07:22:42.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.630+0000 7fac72ffd640 1 -- 172.21.15.77:0/1218977598 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac640453f0 con 0x7fac7c0d3870 2023-11-26T07:22:42.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.630+0000 7fac80953640 1 -- 172.21.15.77:0/1218977598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7c0c88d0 con 0x7fac7c0d3870 2023-11-26T07:22:42.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.631+0000 7fac80953640 1 -- 172.21.15.77:0/1218977598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7c0d1870 con 0x7fac7c0d3870 2023-11-26T07:22:42.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.632+0000 7fac72ffd640 1 -- 172.21.15.77:0/1218977598 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fac6404e450 con 0x7fac7c0d3870 2023-11-26T07:22:42.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.633+0000 7fac72ffd640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fac5c06b6b0 0x7fac5c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:42.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.633+0000 7fac72ffd640 1 -- 172.21.15.77:0/1218977598 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fac640aa510 con 0x7fac7c0d3870 2023-11-26T07:22:42.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.633+0000 7fac7a59c640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fac5c06b6b0 0x7fac5c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:42.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.634+0000 7fac7a59c640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fac5c06b6b0 0x7fac5c06db70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fac6c008ea0 tx=0x7fac6c0083d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:42.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.638+0000 7fac72ffd640 1 -- 172.21.15.77:0/1218977598 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac64076fc0 con 0x7fac7c0d3870 2023-11-26T07:22:42.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.841+0000 7fac80953640 1 -- 172.21.15.77:0/1218977598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fac7c0c80b0 con 0x7fac7c0d3870 2023-11-26T07:22:42.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.842+0000 7fac72ffd640 1 -- 172.21.15.77:0/1218977598 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) v1 ==== 80+0+0 (secure 0 0 0) 0x7fac7c0c80b0 con 0x7fac7c0d3870 2023-11-26T07:22:42.844 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:22:42.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 -- 172.21.15.77:0/1218977598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fac5c06b6b0 msgr2=0x7fac5c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fac5c06b6b0 0x7fac5c06db70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fac6c008ea0 tx=0x7fac6c0083d0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 -- 172.21.15.77:0/1218977598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac7c0d3870 msgr2=0x7fac7c0c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac7c0d3870 0x7fac7c0c8390 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fac64000c00 tx=0x7fac640046c0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 -- 172.21.15.77:0/1218977598 shutdown_connections 2023-11-26T07:22:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fac5c06b6b0 0x7fac5c06db70 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac7c15d720 0x7fac7c0b7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac7c0d3870 0x7fac7c0c8390 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 --2- 172.21.15.77:0/1218977598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac7c0b1400 0x7fac7c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 -- 172.21.15.77:0/1218977598 >> 172.21.15.77:0/1218977598 conn(0x7fac7c08af60 msgr2=0x7fac7c0b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 -- 172.21.15.77:0/1218977598 shutdown_connections 2023-11-26T07:22:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:42.845+0000 7fac80953640 1 -- 172.21.15.77:0/1218977598 wait complete. 2023-11-26T07:22:42.865 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-26T07:22:42.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:42.866 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-26T07:22:42.970 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:22:42.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:42.970 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:22:43.030 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:22:43.030 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:43.072 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:22:43.072 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:43.165 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:22:43.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.372+0000 7fabbe283640 1 Processor -- start 2023-11-26T07:22:43.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.372+0000 7fabbe283640 1 -- start start 2023-11-26T07:22:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.373+0000 7fabbe283640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb80cf450 0x7fabb80cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.373+0000 7fabbe283640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb80cece0 con 0x7fabb815c7f0 2023-11-26T07:22:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.373+0000 7fabbe283640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb806d040 con 0x7fabb80cdfb0 2023-11-26T07:22:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.373+0000 7fabbe283640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb8156010 con 0x7fabb80cf450 2023-11-26T07:22:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.374+0000 7fabb7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fabb815c7f0 0x7fabb806db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58252/0 (socket says 172.21.15.77:58252) 2023-11-26T07:22:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.374+0000 7fabb7fff640 1 -- 172.21.15.77:0/4276975379 learned_addr learned my addr 172.21.15.77:0/4276975379 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.374+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692252155 0 0) 0x7fabb80cece0 con 0x7fabb815c7f0 2023-11-26T07:22:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.374+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faba4003520 con 0x7fabb815c7f0 2023-11-26T07:22:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.374+0000 7fabaffff640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb80cf450 0x7fabb80cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.374+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3909807120 0 0) 0x7faba4003520 con 0x7fabb815c7f0 2023-11-26T07:22:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.374+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb80cf450 msgr2=0x7fabb80cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.374+0000 7fabb77fe640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb80cf450 0x7fabb80cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.374+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 >> v1:172.21.15.159:6789/0 conn(0x7fabb80cdfb0 legacy=0x7fabb80ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.374+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb806d320 con 0x7fabb815c7f0 2023-11-26T07:22:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.374+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7faba8001670 con 0x7fabb815c7f0 2023-11-26T07:22:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 >> v1:172.21.15.77:6789/0 conn(0x7fabb815c7f0 legacy=0x7fabb806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb77fe640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faba40039a0 0x7faba4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb77fe640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faba40047c0 0x7faba4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb77fe640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb80cf450 0x7faba40051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb8156010 con 0x7faba40039a0 2023-11-26T07:22:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba400bac0 con 0x7faba40047c0 2023-11-26T07:22:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba400bc80 con 0x7fabb80cf450 2023-11-26T07:22:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb7fff640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faba40039a0 0x7faba4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb7fff640 1 -- 172.21.15.77:0/4276975379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb80cf450 msgr2=0x7faba40051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabbc820640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb80cf450 0x7faba40051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabaffff640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faba40047c0 0x7faba4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb7fff640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb80cf450 0x7faba40051a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb7fff640 1 -- 172.21.15.77:0/4276975379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faba40047c0 msgr2=0x7faba4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb7fff640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faba40047c0 0x7faba4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.375+0000 7fabb7fff640 1 -- 172.21.15.77:0/4276975379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4003520 con 0x7faba40039a0 2023-11-26T07:22:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.376+0000 7fabb7fff640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faba40039a0 0x7faba4003da0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7faba800c210 tx=0x7faba40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35088c62344fb5ac server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.377+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba802cae0 con 0x7faba40039a0 2023-11-26T07:22:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.377+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba802cc60 con 0x7faba40039a0 2023-11-26T07:22:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.377+0000 7fabb77fe640 1 -- 172.21.15.77:0/4276975379 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba80058d0 con 0x7faba40039a0 2023-11-26T07:22:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.377+0000 7fabbe283640 1 -- 172.21.15.77:0/4276975379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faba40039a0 msgr2=0x7faba4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.377+0000 7fabbe283640 1 --2- 172.21.15.77:0/4276975379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faba40039a0 0x7faba4003da0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7faba800c210 tx=0x7faba40057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.377+0000 7fabbc820640 1 -- 172.21.15.77:0/4276975379 reap_dead start 2023-11-26T07:22:43.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.377+0000 7fabbe283640 1 -- 172.21.15.77:0/4276975379 shutdown_connections 2023-11-26T07:22:43.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.377+0000 7fabbe283640 1 -- 172.21.15.77:0/4276975379 >> 172.21.15.77:0/4276975379 conn(0x7fabb806a920 msgr2=0x7fabb806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:43.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.378+0000 7fabbe283640 1 -- 172.21.15.77:0/4276975379 shutdown_connections 2023-11-26T07:22:43.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.378+0000 7fabbe283640 1 -- 172.21.15.77:0/4276975379 wait complete. 2023-11-26T07:22:43.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.379+0000 7fabbe283640 1 Processor -- start 2023-11-26T07:22:43.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.379+0000 7fabbe283640 1 -- start start 2023-11-26T07:22:43.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.380+0000 7fabbe283640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faba40039a0 0x7fabb81484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.380+0000 7fabbe283640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb81f0b10 0x7fabb806da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.380+0000 7fabbe283640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb806df60 0x7fabb8156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.380+0000 7fabbe283640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb806e3f0 con 0x7fabb806df60 2023-11-26T07:22:43.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.380+0000 7fabbe283640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb8157bf0 con 0x7faba40039a0 2023-11-26T07:22:43.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.380+0000 7fabbe283640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb8157ed0 con 0x7fabb81f0b10 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.381+0000 7fabbc820640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb806df60 0x7fabb8156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.381+0000 7fabbc820640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb806df60 0x7fabb8156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47394/0 (socket says 172.21.15.77:47394) 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.381+0000 7fabbc820640 1 -- 172.21.15.77:0/3772030515 learned_addr learned my addr 172.21.15.77:0/3772030515 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.381+0000 7fabaffff640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb81f0b10 0x7fabb806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.381+0000 7fabbc820640 1 -- 172.21.15.77:0/3772030515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb81f0b10 msgr2=0x7fabb806da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.381+0000 7fabbc820640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb81f0b10 0x7fabb806da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.381+0000 7fabbc820640 1 -- 172.21.15.77:0/3772030515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faba40039a0 msgr2=0x7fabb81484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.381+0000 7fabb7fff640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faba40039a0 0x7fabb81484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.381+0000 7fabbc820640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faba40039a0 0x7fabb81484d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.381+0000 7fabbc820640 1 -- 172.21.15.77:0/3772030515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb81596b0 con 0x7fabb806df60 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.381+0000 7fabbc820640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb806df60 0x7fabb8156e10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fabb80ccd80 tx=0x7fabb000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.382+0000 7fabb57fa640 1 -- 172.21.15.77:0/3772030515 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0004b50 con 0x7fabb806df60 2023-11-26T07:22:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.382+0000 7fabb57fa640 1 -- 172.21.15.77:0/3772030515 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb0004cb0 con 0x7fabb806df60 2023-11-26T07:22:43.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.382+0000 7fabbe283640 1 -- 172.21.15.77:0/3772030515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb8159990 con 0x7fabb806df60 2023-11-26T07:22:43.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.382+0000 7fabb57fa640 1 -- 172.21.15.77:0/3772030515 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0005270 con 0x7fabb806df60 2023-11-26T07:22:43.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.382+0000 7fabbe283640 1 -- 172.21.15.77:0/3772030515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb8157350 con 0x7fabb806df60 2023-11-26T07:22:43.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.383+0000 7fabbe283640 1 -- 172.21.15.77:0/3772030515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb8159eb0 con 0x7fabb806df60 2023-11-26T07:22:43.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.384+0000 7fabb57fa640 1 -- 172.21.15.77:0/3772030515 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fabb00053d0 con 0x7fabb806df60 2023-11-26T07:22:43.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.385+0000 7fabb57fa640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fab9806b6e0 0x7fab9806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.385+0000 7fabb57fa640 1 -- 172.21.15.77:0/3772030515 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fabb0087e60 con 0x7fabb806df60 2023-11-26T07:22:43.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.385+0000 7fabb7fff640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fab9806b6e0 0x7fab9806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.386+0000 7fabb7fff640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fab9806b6e0 0x7fab9806dba0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faba8034000 tx=0x7faba8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:43.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.389+0000 7fabb57fa640 1 -- 172.21.15.77:0/3772030515 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fabb8159eb0 con 0x7fabb806df60 2023-11-26T07:22:43.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.580+0000 7fabbe283640 1 -- 172.21.15.77:0/3772030515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabb8159eb0 con 0x7fabb806df60 2023-11-26T07:22:43.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.582+0000 7fabb57fa640 1 -- 172.21.15.77:0/3772030515 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16606 (secure 0 0 0) 0x7fabb8159eb0 con 0x7fabb806df60 2023-11-26T07:22:43.584 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:22:43.584 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":64,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:22:40.721177+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:40.058564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:41.292572+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:22:43.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.584+0000 7fabbe283640 1 -- 172.21.15.77:0/3772030515 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fab9806b6e0 msgr2=0x7fab9806dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:43.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.584+0000 7fabbe283640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fab9806b6e0 0x7fab9806dba0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faba8034000 tx=0x7faba8009030 comp rx=0 tx=0).stop 2023-11-26T07:22:43.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.584+0000 7fabbe283640 1 -- 172.21.15.77:0/3772030515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb806df60 msgr2=0x7fabb8156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:43.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.584+0000 7fabbe283640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb806df60 0x7fabb8156e10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fabb80ccd80 tx=0x7fabb000d9d0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.585+0000 7fabbe283640 1 -- 172.21.15.77:0/3772030515 shutdown_connections 2023-11-26T07:22:43.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.585+0000 7fabbe283640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fab9806b6e0 0x7fab9806dba0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.585+0000 7fabbe283640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb806df60 0x7fabb8156e10 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.585+0000 7fabbe283640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fabb81f0b10 0x7fabb806da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.585+0000 7fabbe283640 1 --2- 172.21.15.77:0/3772030515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faba40039a0 0x7fabb81484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.585+0000 7fabbe283640 1 -- 172.21.15.77:0/3772030515 >> 172.21.15.77:0/3772030515 conn(0x7fabb806a920 msgr2=0x7fabb80aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:43.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.585+0000 7fabbe283640 1 -- 172.21.15.77:0/3772030515 shutdown_connections 2023-11-26T07:22:43.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.585+0000 7fabbe283640 1 -- 172.21.15.77:0/3772030515 wait complete. 2023-11-26T07:22:43.605 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:21:40.058564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:21:41.292572+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 63, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:22:43.606 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:22:43.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.818+0000 7fed613f5640 1 Processor -- start 2023-11-26T07:22:43.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.819+0000 7fed613f5640 1 -- start start 2023-11-26T07:22:43.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.821+0000 7fed613f5640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fed5c0c49f0 0x7fed5c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.821+0000 7fed613f5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c15ec90 con 0x7fed5c06de10 2023-11-26T07:22:43.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.821+0000 7fed613f5640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c0cd530 con 0x7fed5c072160 2023-11-26T07:22:43.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.821+0000 7fed613f5640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c0c4ed0 con 0x7fed5c0c49f0 2023-11-26T07:22:43.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.821+0000 7fed527fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fed5c06de10 0x7fed5c0705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58264/0 (socket says 172.21.15.77:58264) 2023-11-26T07:22:43.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.821+0000 7fed527fc640 1 -- 172.21.15.77:0/285213996 learned_addr learned my addr 172.21.15.77:0/285213996 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:43.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.821+0000 7fed5b7fe640 1 --2- 172.21.15.77:0/285213996 >> v2:172.21.15.159:3300/0 conn(0x7fed5c0c49f0 0x7fed5c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.822+0000 7fed5a7fc640 1 -- 172.21.15.77:0/285213996 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077835821 0 0) 0x7fed44001490 con 0x7fed5c06de10 2023-11-26T07:22:43.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.822+0000 7fed5a7fc640 1 -- 172.21.15.77:0/285213996 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed48003520 con 0x7fed5c06de10 2023-11-26T07:22:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.822+0000 7fed5b7fe640 1 -- 172.21.15.77:0/285213996 >> v1:172.21.15.159:6789/0 conn(0x7fed5c072160 legacy=0x7fed5c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.822+0000 7fed5b7fe640 1 -- 172.21.15.77:0/285213996 >> v1:172.21.15.77:6789/0 conn(0x7fed5c06de10 legacy=0x7fed5c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.822+0000 7fed5b7fe640 1 -- 172.21.15.77:0/285213996 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0c51b0 con 0x7fed5c0c49f0 2023-11-26T07:22:43.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.824+0000 7fed5b7fe640 1 --2- 172.21.15.77:0/285213996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed5c0c49f0 0x7fed5c15e750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed540097a0 tx=0x7fed5402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9196ed0451228f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.828+0000 7fed5a7fc640 1 -- 172.21.15.77:0/285213996 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54030610 con 0x7fed5c0c49f0 2023-11-26T07:22:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.828+0000 7fed5a7fc640 1 -- 172.21.15.77:0/285213996 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54030770 con 0x7fed5c0c49f0 2023-11-26T07:22:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.828+0000 7fed5a7fc640 1 -- 172.21.15.77:0/285213996 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54030b00 con 0x7fed5c0c49f0 2023-11-26T07:22:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.828+0000 7fed613f5640 1 -- 172.21.15.77:0/285213996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed5c0c49f0 msgr2=0x7fed5c15e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.828+0000 7fed613f5640 1 --2- 172.21.15.77:0/285213996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed5c0c49f0 0x7fed5c15e750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed540097a0 tx=0x7fed5402b960 comp rx=0 tx=0).stop 2023-11-26T07:22:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.829+0000 7fed613f5640 1 -- 172.21.15.77:0/285213996 shutdown_connections 2023-11-26T07:22:43.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.829+0000 7fed613f5640 1 --2- 172.21.15.77:0/285213996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed5c0c49f0 0x7fed5c15e750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.829+0000 7fed613f5640 1 -- 172.21.15.77:0/285213996 >> 172.21.15.77:0/285213996 conn(0x7fed5c0b0c50 msgr2=0x7fed5c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:43.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.829+0000 7fed613f5640 1 -- 172.21.15.77:0/285213996 shutdown_connections 2023-11-26T07:22:43.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.829+0000 7fed613f5640 1 -- 172.21.15.77:0/285213996 wait complete. 2023-11-26T07:22:43.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.831+0000 7fed613f5640 1 Processor -- start 2023-11-26T07:22:43.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.831+0000 7fed613f5640 1 -- start start 2023-11-26T07:22:43.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed613f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed5c06de10 0x7fed5c09aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed613f5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed5c072160 0x7fed5c159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed613f5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed5c0c49f0 0x7fed5c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed613f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c15bec0 con 0x7fed5c06de10 2023-11-26T07:22:43.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed613f5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c15b560 con 0x7fed5c072160 2023-11-26T07:22:43.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed613f5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c15b800 con 0x7fed5c0c49f0 2023-11-26T07:22:43.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed5affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed5c06de10 0x7fed5c09aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed5affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed5c06de10 0x7fed5c09aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47400/0 (socket says 172.21.15.77:47400) 2023-11-26T07:22:43.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed5affd640 1 -- 172.21.15.77:0/1259515472 learned_addr learned my addr 172.21.15.77:0/1259515472 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:43.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed5affd640 1 -- 172.21.15.77:0/1259515472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed5c0c49f0 msgr2=0x7fed5c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:43.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed5affd640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed5c0c49f0 0x7fed5c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed5affd640 1 -- 172.21.15.77:0/1259515472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed5c072160 msgr2=0x7fed5c159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:43.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.832+0000 7fed527fc640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed5c072160 0x7fed5c159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.833+0000 7fed5affd640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed5c072160 0x7fed5c159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:43.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.833+0000 7fed5affd640 1 -- 172.21.15.77:0/1259515472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54009400 con 0x7fed5c06de10 2023-11-26T07:22:43.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.833+0000 7fed5affd640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed5c06de10 0x7fed5c09aeb0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c450 tx=0x7fed4c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:43.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.833+0000 7fed53fff640 1 -- 172.21.15.77:0/1259515472 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0052d0 con 0x7fed5c06de10 2023-11-26T07:22:43.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.833+0000 7fed53fff640 1 -- 172.21.15.77:0/1259515472 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c005430 con 0x7fed5c06de10 2023-11-26T07:22:43.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.833+0000 7fed53fff640 1 -- 172.21.15.77:0/1259515472 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c012870 con 0x7fed5c06de10 2023-11-26T07:22:43.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.833+0000 7fed613f5640 1 -- 172.21.15.77:0/1259515472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c15bae0 con 0x7fed5c06de10 2023-11-26T07:22:43.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.833+0000 7fed613f5640 1 -- 172.21.15.77:0/1259515472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c0c7650 con 0x7fed5c06de10 2023-11-26T07:22:43.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.834+0000 7fed613f5640 1 -- 172.21.15.77:0/1259515472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c15c000 con 0x7fed5c06de10 2023-11-26T07:22:43.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.835+0000 7fed53fff640 1 -- 172.21.15.77:0/1259515472 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fed4c0129d0 con 0x7fed5c06de10 2023-11-26T07:22:43.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.836+0000 7fed53fff640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed3c06b6b0 0x7fed3c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:43.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.836+0000 7fed53fff640 1 -- 172.21.15.77:0/1259515472 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fed4c087bd0 con 0x7fed5c06de10 2023-11-26T07:22:43.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.836+0000 7fed527fc640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed3c06b6b0 0x7fed3c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:43.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.837+0000 7fed527fc640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed3c06b6b0 0x7fed3c06db70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0b0800 tx=0x7fed44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:43.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:43.841+0000 7fed53fff640 1 -- 172.21.15.77:0/1259515472 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed5c15c000 con 0x7fed5c06de10 2023-11-26T07:22:44.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.031+0000 7fed613f5640 1 -- 172.21.15.77:0/1259515472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed5c15c000 con 0x7fed5c06de10 2023-11-26T07:22:44.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.032+0000 7fed53fff640 1 -- 172.21.15.77:0/1259515472 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed4c054500 con 0x7fed5c06de10 2023-11-26T07:22:44.033 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:22:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 -- 172.21.15.77:0/1259515472 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed3c06b6b0 msgr2=0x7fed3c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed3c06b6b0 0x7fed3c06db70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0b0800 tx=0x7fed44009040 comp rx=0 tx=0).stop 2023-11-26T07:22:44.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 -- 172.21.15.77:0/1259515472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed5c06de10 msgr2=0x7fed5c09aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed5c06de10 0x7fed5c09aeb0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c450 tx=0x7fed4c00c910 comp rx=0 tx=0).stop 2023-11-26T07:22:44.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 -- 172.21.15.77:0/1259515472 shutdown_connections 2023-11-26T07:22:44.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fed3c06b6b0 0x7fed3c06db70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed5c0c49f0 0x7fed5c0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed5c072160 0x7fed5c159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 --2- 172.21.15.77:0/1259515472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed5c06de10 0x7fed5c09aeb0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 -- 172.21.15.77:0/1259515472 >> 172.21.15.77:0/1259515472 conn(0x7fed5c0b0c50 msgr2=0x7fed5c06c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:44.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 -- 172.21.15.77:0/1259515472 shutdown_connections 2023-11-26T07:22:44.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.035+0000 7fed613f5640 1 -- 172.21.15.77:0/1259515472 wait complete. 2023-11-26T07:22:44.056 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:22:44.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.268+0000 7fa44aebb640 1 Processor -- start 2023-11-26T07:22:44.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.268+0000 7fa44aebb640 1 -- start start 2023-11-26T07:22:44.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.270+0000 7fa44aebb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa44406e160 0x7fa4440ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.270+0000 7fa44aebb640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa4440cd110 0x7fa444070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.270+0000 7fa44aebb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4440cd510 con 0x7fa444146eb0 2023-11-26T07:22:44.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.270+0000 7fa44aebb640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa444161a10 con 0x7fa4440cd110 2023-11-26T07:22:44.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.270+0000 7fa44aebb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa444161cf0 con 0x7fa44406e160 2023-11-26T07:22:44.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.270+0000 7fa448c57640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa444146eb0 0x7fa444161150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58268/0 (socket says 172.21.15.77:58268) 2023-11-26T07:22:44.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.270+0000 7fa448c57640 1 -- 172.21.15.77:0/1824098776 learned_addr learned my addr 172.21.15.77:0/1824098776 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930453653 0 0) 0x7fa4440cd510 con 0x7fa444146eb0 2023-11-26T07:22:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa449458640 1 --2- 172.21.15.77:0/1824098776 >> v2:172.21.15.159:3300/0 conn(0x7fa4440cd110 0x7fa444070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa443fff640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa44406e160 0x7fa4440ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa434003520 con 0x7fa444146eb0 2023-11-26T07:22:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1702785522 0 0) 0x7fa434003520 con 0x7fa444146eb0 2023-11-26T07:22:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa44406e160 msgr2=0x7fa4440ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa44406e160 0x7fa4440ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 >> v2:172.21.15.159:3300/0 conn(0x7fa4440cd110 msgr2=0x7fa444070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 --2- 172.21.15.77:0/1824098776 >> v2:172.21.15.159:3300/0 conn(0x7fa4440cd110 0x7fa444070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa444161fd0 con 0x7fa444146eb0 2023-11-26T07:22:44.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fa438001670 con 0x7fa444146eb0 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 >> v1:172.21.15.77:6789/0 conn(0x7fa444146eb0 legacy=0x7fa444161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa434003970 0x7fa434003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 0x7fa434004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa44406e160 0x7fa434005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa444161a10 con 0x7fa4340047c0 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa444161cf0 con 0x7fa434003970 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43400ba80 con 0x7fa44406e160 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.271+0000 7fa443fff640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 0x7fa434004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.272+0000 7fa448c57640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa434003970 0x7fa434003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.272+0000 7fa449458640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa44406e160 0x7fa434005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.272+0000 7fa443fff640 1 -- 172.21.15.77:0/1824098776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa44406e160 msgr2=0x7fa434005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.272+0000 7fa443fff640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa44406e160 0x7fa434005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.272+0000 7fa443fff640 1 -- 172.21.15.77:0/1824098776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa434003970 msgr2=0x7fa434003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:44.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.272+0000 7fa443fff640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa434003970 0x7fa434003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.272+0000 7fa443fff640 1 -- 172.21.15.77:0/1824098776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434003520 con 0x7fa4340047c0 2023-11-26T07:22:44.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.273+0000 7fa443fff640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 0x7fa434004c40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa43000ba00 tx=0x7fa4340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13074c603c31ca91 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:44.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.273+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430033680 con 0x7fa4340047c0 2023-11-26T07:22:44.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.273+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4300337e0 con 0x7fa4340047c0 2023-11-26T07:22:44.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.273+0000 7fa4437fe640 1 -- 172.21.15.77:0/1824098776 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430033bb0 con 0x7fa4340047c0 2023-11-26T07:22:44.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.274+0000 7fa44aebb640 1 -- 172.21.15.77:0/1824098776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 msgr2=0x7fa434004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.274+0000 7fa44aebb640 1 --2- 172.21.15.77:0/1824098776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 0x7fa434004c40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa43000ba00 tx=0x7fa4340057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.274+0000 7fa449458640 1 -- 172.21.15.77:0/1824098776 reap_dead start 2023-11-26T07:22:44.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.274+0000 7fa44aebb640 1 -- 172.21.15.77:0/1824098776 shutdown_connections 2023-11-26T07:22:44.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.274+0000 7fa44aebb640 1 -- 172.21.15.77:0/1824098776 >> 172.21.15.77:0/1824098776 conn(0x7fa4440b0c50 msgr2=0x7fa4440b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:44.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.274+0000 7fa44aebb640 1 -- 172.21.15.77:0/1824098776 shutdown_connections 2023-11-26T07:22:44.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.274+0000 7fa44aebb640 1 -- 172.21.15.77:0/1824098776 wait complete. 2023-11-26T07:22:44.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.276+0000 7fa44aebb640 1 Processor -- start 2023-11-26T07:22:44.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.276+0000 7fa44aebb640 1 -- start start 2023-11-26T07:22:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.277+0000 7fa44aebb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 0x7fa444143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.277+0000 7fa44aebb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4440ad040 0x7fa4440ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.277+0000 7fa44aebb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4440b2700 0x7fa4440b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.277+0000 7fa44aebb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440ada00 con 0x7fa4340047c0 2023-11-26T07:22:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.277+0000 7fa44aebb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44415fbc0 con 0x7fa4440b2700 2023-11-26T07:22:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.277+0000 7fa44aebb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440b3ee0 con 0x7fa4440ad040 2023-11-26T07:22:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.277+0000 7fa448c57640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 0x7fa444143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.277+0000 7fa448c57640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 0x7fa444143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47422/0 (socket says 172.21.15.77:47422) 2023-11-26T07:22:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.277+0000 7fa448c57640 1 -- 172.21.15.77:0/2336955660 learned_addr learned my addr 172.21.15.77:0/2336955660 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa443fff640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4440ad040 0x7fa4440ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa449458640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4440b2700 0x7fa4440b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa448c57640 1 -- 172.21.15.77:0/2336955660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4440ad040 msgr2=0x7fa4440ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa448c57640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4440ad040 0x7fa4440ad4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa448c57640 1 -- 172.21.15.77:0/2336955660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4440b2700 msgr2=0x7fa4440b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa448c57640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4440b2700 0x7fa4440b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa448c57640 1 -- 172.21.15.77:0/2336955660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440b30a0 con 0x7fa4340047c0 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa448c57640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 0x7fa444143700 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa438001ae0 tx=0x7fa43800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa4417fa640 1 -- 172.21.15.77:0/2336955660 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43800c8d0 con 0x7fa4340047c0 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa4417fa640 1 -- 172.21.15.77:0/2336955660 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43800ca30 con 0x7fa4340047c0 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa4417fa640 1 -- 172.21.15.77:0/2336955660 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43800cdc0 con 0x7fa4340047c0 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa44aebb640 1 -- 172.21.15.77:0/2336955660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4440b3360 con 0x7fa4340047c0 2023-11-26T07:22:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.278+0000 7fa44aebb640 1 -- 172.21.15.77:0/2336955660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4440b3920 con 0x7fa4340047c0 2023-11-26T07:22:44.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.280+0000 7fa44aebb640 1 -- 172.21.15.77:0/2336955660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44404e8b0 con 0x7fa4340047c0 2023-11-26T07:22:44.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.281+0000 7fa4417fa640 1 -- 172.21.15.77:0/2336955660 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fa43801d460 con 0x7fa4340047c0 2023-11-26T07:22:44.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.282+0000 7fa4417fa640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa42806b6b0 0x7fa42806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.282+0000 7fa4417fa640 1 -- 172.21.15.77:0/2336955660 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fa438088100 con 0x7fa4340047c0 2023-11-26T07:22:44.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.282+0000 7fa443fff640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa42806b6b0 0x7fa42806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.283+0000 7fa443fff640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa42806b6b0 0x7fa42806db70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa4340057a0 tx=0x7fa430030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:44.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.286+0000 7fa4417fa640 1 -- 172.21.15.77:0/2336955660 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa438054a90 con 0x7fa4340047c0 2023-11-26T07:22:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.476+0000 7fa44aebb640 1 -- 172.21.15.77:0/2336955660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa44406ded0 con 0x7fa4340047c0 2023-11-26T07:22:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.477+0000 7fa4417fa640 1 -- 172.21.15.77:0/2336955660 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4380580b0 con 0x7fa4340047c0 2023-11-26T07:22:44.479 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:22:44.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.479+0000 7fa44aebb640 1 -- 172.21.15.77:0/2336955660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa42806b6b0 msgr2=0x7fa42806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.479+0000 7fa44aebb640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa42806b6b0 0x7fa42806db70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa4340057a0 tx=0x7fa430030000 comp rx=0 tx=0).stop 2023-11-26T07:22:44.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.479+0000 7fa44aebb640 1 -- 172.21.15.77:0/2336955660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 msgr2=0x7fa444143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.479+0000 7fa44aebb640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 0x7fa444143700 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa438001ae0 tx=0x7fa43800ec60 comp rx=0 tx=0).stop 2023-11-26T07:22:44.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.480+0000 7fa44aebb640 1 -- 172.21.15.77:0/2336955660 shutdown_connections 2023-11-26T07:22:44.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.480+0000 7fa44aebb640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa42806b6b0 0x7fa42806db70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.480+0000 7fa44aebb640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4440b2700 0x7fa4440b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.480+0000 7fa44aebb640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4440ad040 0x7fa4440ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.480+0000 7fa44aebb640 1 --2- 172.21.15.77:0/2336955660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4340047c0 0x7fa444143700 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.480+0000 7fa44aebb640 1 -- 172.21.15.77:0/2336955660 >> 172.21.15.77:0/2336955660 conn(0x7fa4440b0c50 msgr2=0x7fa444144dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:44.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.480+0000 7fa44aebb640 1 -- 172.21.15.77:0/2336955660 shutdown_connections 2023-11-26T07:22:44.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.480+0000 7fa44aebb640 1 -- 172.21.15.77:0/2336955660 wait complete. 2023-11-26T07:22:44.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:22:44.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.712+0000 7f2e31393640 1 Processor -- start 2023-11-26T07:22:44.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.712+0000 7f2e31393640 1 -- start start 2023-11-26T07:22:44.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.713+0000 7f2e31393640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e2c0cb580 0x7f2e2c0c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.713+0000 7f2e31393640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e2c0ca940 0x7f2e2c0c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.713+0000 7f2e31393640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c0b1a10 con 0x7f2e2c0b0e90 2023-11-26T07:22:44.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.713+0000 7f2e31393640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c0cb960 con 0x7f2e2c0ca940 2023-11-26T07:22:44.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.714+0000 7f2e31393640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c161e40 con 0x7f2e2c0cb580 2023-11-26T07:22:44.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.714+0000 7f2e23fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e2c0ca940 0x7f2e2c0c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.714+0000 7f2e30b92640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2e2c0b0e90 0x7f2e2c0b1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58278/0 (socket says 172.21.15.77:58278) 2023-11-26T07:22:44.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.714+0000 7f2e30b92640 1 -- 172.21.15.77:0/3508426687 learned_addr learned my addr 172.21.15.77:0/3508426687 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:44.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.714+0000 7f2e2bfff640 1 --2- 172.21.15.77:0/3508426687 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e2c0cb580 0x7f2e2c0c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.714+0000 7f2e23fff640 1 -- 172.21.15.77:0/3508426687 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e2c0cb580 msgr2=0x7f2e2c0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:44.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.714+0000 7f2e23fff640 1 --2- 172.21.15.77:0/3508426687 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e2c0cb580 0x7f2e2c0c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.714+0000 7f2e23fff640 1 -- 172.21.15.77:0/3508426687 >> v1:172.21.15.77:6789/0 conn(0x7f2e2c0b0e90 legacy=0x7f2e2c0b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.714+0000 7f2e23fff640 1 -- 172.21.15.77:0/3508426687 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c162120 con 0x7f2e2c0ca940 2023-11-26T07:22:44.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.714+0000 7f2e2b7fe640 1 -- 172.21.15.77:0/3508426687 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58187680 0 0) 0x7f2e2c0b1a10 con 0x7f2e2c0b0e90 2023-11-26T07:22:44.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.714+0000 7f2e2bfff640 1 --2- 172.21.15.77:0/3508426687 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e2c0cb580 0x7f2e2c0c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:44.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.716+0000 7f2e23fff640 1 --2- 172.21.15.77:0/3508426687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2c0ca940 0x7f2e2c0c25d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f2e140097a0 tx=0x7f2e1402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9d9cff80e88e99 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:44.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.716+0000 7f2e2b7fe640 1 -- 172.21.15.77:0/3508426687 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1402d040 con 0x7f2e2c0ca940 2023-11-26T07:22:44.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.716+0000 7f2e2b7fe640 1 -- 172.21.15.77:0/3508426687 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e14031810 con 0x7f2e2c0ca940 2023-11-26T07:22:44.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.716+0000 7f2e2b7fe640 1 -- 172.21.15.77:0/3508426687 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14031ba0 con 0x7f2e2c0ca940 2023-11-26T07:22:44.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.716+0000 7f2e31393640 1 -- 172.21.15.77:0/3508426687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2c0ca940 msgr2=0x7f2e2c0c25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.716+0000 7f2e31393640 1 --2- 172.21.15.77:0/3508426687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2c0ca940 0x7f2e2c0c25d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f2e140097a0 tx=0x7f2e1402b8b0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.716+0000 7f2e31393640 1 -- 172.21.15.77:0/3508426687 shutdown_connections 2023-11-26T07:22:44.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.716+0000 7f2e31393640 1 --2- 172.21.15.77:0/3508426687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2c0ca940 0x7f2e2c0c25d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.716+0000 7f2e31393640 1 --2- 172.21.15.77:0/3508426687 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e2c0cb580 0x7f2e2c0c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.716+0000 7f2e31393640 1 -- 172.21.15.77:0/3508426687 >> 172.21.15.77:0/3508426687 conn(0x7f2e2c0cbb40 msgr2=0x7f2e2c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:44.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.717+0000 7f2e31393640 1 -- 172.21.15.77:0/3508426687 shutdown_connections 2023-11-26T07:22:44.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.717+0000 7f2e31393640 1 -- 172.21.15.77:0/3508426687 wait complete. 2023-11-26T07:22:44.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.718+0000 7f2e31393640 1 Processor -- start 2023-11-26T07:22:44.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.718+0000 7f2e31393640 1 -- start start 2023-11-26T07:22:44.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.719+0000 7f2e31393640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e2c0b0e90 0x7f2e2c0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.719+0000 7f2e31393640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e2c0ca940 0x7f2e2c1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.719+0000 7f2e31393640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2c0cb580 0x7f2e2c0b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.719+0000 7f2e31393640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c0c5c90 con 0x7f2e2c0cb580 2023-11-26T07:22:44.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.719+0000 7f2e31393640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c0b3490 con 0x7f2e2c0ca940 2023-11-26T07:22:44.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.719+0000 7f2e31393640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c0b2880 con 0x7f2e2c0b0e90 2023-11-26T07:22:44.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.719+0000 7f2e30b92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2c0cb580 0x7f2e2c0b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.720+0000 7f2e30b92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2c0cb580 0x7f2e2c0b1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47436/0 (socket says 172.21.15.77:47436) 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.720+0000 7f2e30b92640 1 -- 172.21.15.77:0/297647329 learned_addr learned my addr 172.21.15.77:0/297647329 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.720+0000 7f2e2bfff640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e2c0b0e90 0x7f2e2c0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.720+0000 7f2e23fff640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e2c0ca940 0x7f2e2c1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.720+0000 7f2e30b92640 1 -- 172.21.15.77:0/297647329 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e2c0b0e90 msgr2=0x7f2e2c0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.720+0000 7f2e30b92640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e2c0b0e90 0x7f2e2c0b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.720+0000 7f2e30b92640 1 -- 172.21.15.77:0/297647329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e2c0ca940 msgr2=0x7f2e2c1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.720+0000 7f2e30b92640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e2c0ca940 0x7f2e2c1581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.720+0000 7f2e30b92640 1 -- 172.21.15.77:0/297647329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e14009400 con 0x7f2e2c0cb580 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.720+0000 7f2e30b92640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2c0cb580 0x7f2e2c0b1ce0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c7e0 tx=0x7f2e2400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.720+0000 7f2e297fa640 1 -- 172.21.15.77:0/297647329 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400a640 con 0x7f2e2c0cb580 2023-11-26T07:22:44.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.721+0000 7f2e297fa640 1 -- 172.21.15.77:0/297647329 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2400a7c0 con 0x7f2e2c0cb580 2023-11-26T07:22:44.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.721+0000 7f2e31393640 1 -- 172.21.15.77:0/297647329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c0b2b60 con 0x7f2e2c0cb580 2023-11-26T07:22:44.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.721+0000 7f2e297fa640 1 -- 172.21.15.77:0/297647329 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400ab70 con 0x7f2e2c0cb580 2023-11-26T07:22:44.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.721+0000 7f2e31393640 1 -- 172.21.15.77:0/297647329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c0b3120 con 0x7f2e2c0cb580 2023-11-26T07:22:44.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.722+0000 7f2e31393640 1 -- 172.21.15.77:0/297647329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2c06c7b0 con 0x7f2e2c0cb580 2023-11-26T07:22:44.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.723+0000 7f2e297fa640 1 -- 172.21.15.77:0/297647329 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f2e2400acd0 con 0x7f2e2c0cb580 2023-11-26T07:22:44.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.724+0000 7f2e297fa640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e0c06b6e0 0x7f2e0c06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:44.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.724+0000 7f2e297fa640 1 -- 172.21.15.77:0/297647329 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f2e240878d0 con 0x7f2e2c0cb580 2023-11-26T07:22:44.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.724+0000 7f2e2bfff640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e0c06b6e0 0x7f2e0c06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:44.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.725+0000 7f2e2bfff640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e0c06b6e0 0x7f2e0c06dba0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00b840 tx=0x7f2e1c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:44.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.728+0000 7f2e297fa640 1 -- 172.21.15.77:0/297647329 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e24054200 con 0x7f2e2c0cb580 2023-11-26T07:22:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.907+0000 7f2e31393640 1 -- 172.21.15.77:0/297647329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e2c0b3600 con 0x7f2e2c0cb580 2023-11-26T07:22:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.908+0000 7f2e297fa640 1 -- 172.21.15.77:0/297647329 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e24057820 con 0x7f2e2c0cb580 2023-11-26T07:22:44.910 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:22:44.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.910+0000 7f2e31393640 1 -- 172.21.15.77:0/297647329 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e0c06b6e0 msgr2=0x7f2e0c06dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.910+0000 7f2e31393640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e0c06b6e0 0x7f2e0c06dba0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00b840 tx=0x7f2e1c008040 comp rx=0 tx=0).stop 2023-11-26T07:22:44.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.911+0000 7f2e31393640 1 -- 172.21.15.77:0/297647329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2c0cb580 msgr2=0x7f2e2c0b1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:44.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.911+0000 7f2e31393640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2c0cb580 0x7f2e2c0b1ce0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c7e0 tx=0x7f2e2400cca0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.911+0000 7f2e31393640 1 -- 172.21.15.77:0/297647329 shutdown_connections 2023-11-26T07:22:44.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.911+0000 7f2e31393640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e0c06b6e0 0x7f2e0c06dba0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.911+0000 7f2e31393640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2c0cb580 0x7f2e2c0b1ce0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.911+0000 7f2e31393640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e2c0ca940 0x7f2e2c1581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.911+0000 7f2e31393640 1 --2- 172.21.15.77:0/297647329 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e2c0b0e90 0x7f2e2c0b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:44.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.911+0000 7f2e31393640 1 -- 172.21.15.77:0/297647329 >> 172.21.15.77:0/297647329 conn(0x7f2e2c0cbb40 msgr2=0x7f2e2c162d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:44.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.911+0000 7f2e31393640 1 -- 172.21.15.77:0/297647329 shutdown_connections 2023-11-26T07:22:44.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:44.911+0000 7f2e31393640 1 -- 172.21.15.77:0/297647329 wait complete. 2023-11-26T07:22:44.930 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:22:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.124+0000 7efc2a93c640 1 Processor -- start 2023-11-26T07:22:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.124+0000 7efc2a93c640 1 -- start start 2023-11-26T07:22:45.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.125+0000 7efc2a93c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc2415d270 0x7efc2415d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.125+0000 7efc2a93c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2415db90 con 0x7efc24161260 2023-11-26T07:22:45.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.125+0000 7efc2a93c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc24161ce0 con 0x7efc240cf220 2023-11-26T07:22:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.125+0000 7efc2a93c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc24161fc0 con 0x7efc2415d270 2023-11-26T07:22:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.126+0000 7efc23fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc2415d270 0x7efc2415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.126+0000 7efc237fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efc24161260 0x7efc240ceb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58294/0 (socket says 172.21.15.77:58294) 2023-11-26T07:22:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.126+0000 7efc23fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc2415d270 0x7efc2415d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47438/0 (socket says 172.21.15.77:47438) 2023-11-26T07:22:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.126+0000 7efc237fe640 1 -- 172.21.15.77:0/1077066955 learned_addr learned my addr 172.21.15.77:0/1077066955 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.126+0000 7efc23fff640 1 -- 172.21.15.77:0/1077066955 >> v1:172.21.15.159:6789/0 conn(0x7efc240cf220 legacy=0x7efc240d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.126+0000 7efc23fff640 1 -- 172.21.15.77:0/1077066955 >> v1:172.21.15.77:6789/0 conn(0x7efc24161260 legacy=0x7efc240ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.126+0000 7efc23fff640 1 -- 172.21.15.77:0/1077066955 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc240ce310 con 0x7efc2415d270 2023-11-26T07:22:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.126+0000 7efc22ffd640 1 -- 172.21.15.77:0/1077066955 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653905084 0 0) 0x7efc2415db90 con 0x7efc24161260 2023-11-26T07:22:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.127+0000 7efc23fff640 1 --2- 172.21.15.77:0/1077066955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc2415d270 0x7efc2415d650 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0097a0 tx=0x7efc0c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7286f43ba9fec96b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.128+0000 7efc22ffd640 1 -- 172.21.15.77:0/1077066955 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c031830 con 0x7efc2415d270 2023-11-26T07:22:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.128+0000 7efc22ffd640 1 -- 172.21.15.77:0/1077066955 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c031990 con 0x7efc2415d270 2023-11-26T07:22:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.128+0000 7efc22ffd640 1 -- 172.21.15.77:0/1077066955 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c031d20 con 0x7efc2415d270 2023-11-26T07:22:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.128+0000 7efc2a93c640 1 -- 172.21.15.77:0/1077066955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc2415d270 msgr2=0x7efc2415d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.128+0000 7efc2a93c640 1 --2- 172.21.15.77:0/1077066955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc2415d270 0x7efc2415d650 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0097a0 tx=0x7efc0c02b8d0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.128+0000 7efc2a93c640 1 -- 172.21.15.77:0/1077066955 shutdown_connections 2023-11-26T07:22:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.128+0000 7efc2a93c640 1 --2- 172.21.15.77:0/1077066955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc2415d270 0x7efc2415d650 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.128+0000 7efc2a93c640 1 -- 172.21.15.77:0/1077066955 >> 172.21.15.77:0/1077066955 conn(0x7efc2408af60 msgr2=0x7efc2409c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.128+0000 7efc2a93c640 1 -- 172.21.15.77:0/1077066955 shutdown_connections 2023-11-26T07:22:45.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.128+0000 7efc2a93c640 1 -- 172.21.15.77:0/1077066955 wait complete. 2023-11-26T07:22:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.130+0000 7efc2a93c640 1 Processor -- start 2023-11-26T07:22:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.130+0000 7efc2a93c640 1 -- start start 2023-11-26T07:22:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.131+0000 7efc2a93c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc240cf220 0x7efc240b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.131+0000 7efc2a93c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc2415d270 0x7efc240b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.131+0000 7efc2a93c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc24161260 0x7efc24157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.131+0000 7efc2a93c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc240b8c20 con 0x7efc24161260 2023-11-26T07:22:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.131+0000 7efc2a93c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc240b74a0 con 0x7efc240cf220 2023-11-26T07:22:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.131+0000 7efc2a93c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc240b6960 con 0x7efc2415d270 2023-11-26T07:22:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.131+0000 7efc28ed9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc24161260 0x7efc24157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:45.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.131+0000 7efc28ed9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc24161260 0x7efc24157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47454/0 (socket says 172.21.15.77:47454) 2023-11-26T07:22:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.131+0000 7efc28ed9640 1 -- 172.21.15.77:0/5036138 learned_addr learned my addr 172.21.15.77:0/5036138 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc28ed9640 1 -- 172.21.15.77:0/5036138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc2415d270 msgr2=0x7efc240b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc28ed9640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc2415d270 0x7efc240b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc23fff640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc240cf220 0x7efc240b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc28ed9640 1 -- 172.21.15.77:0/5036138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc240cf220 msgr2=0x7efc240b86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc28ed9640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc240cf220 0x7efc240b86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc28ed9640 1 -- 172.21.15.77:0/5036138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c009400 con 0x7efc24161260 2023-11-26T07:22:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc28ed9640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc24161260 0x7efc24157ff0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00b410 tx=0x7efc1c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc20ff9640 1 -- 172.21.15.77:0/5036138 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c011830 con 0x7efc24161260 2023-11-26T07:22:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc20ff9640 1 -- 172.21.15.77:0/5036138 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c011990 con 0x7efc24161260 2023-11-26T07:22:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc20ff9640 1 -- 172.21.15.77:0/5036138 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c011d40 con 0x7efc24161260 2023-11-26T07:22:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc2a93c640 1 -- 172.21.15.77:0/5036138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc240b6c00 con 0x7efc24161260 2023-11-26T07:22:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.132+0000 7efc2a93c640 1 -- 172.21.15.77:0/5036138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc240b71c0 con 0x7efc24161260 2023-11-26T07:22:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.133+0000 7efc2a93c640 1 -- 172.21.15.77:0/5036138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2404e8b0 con 0x7efc24161260 2023-11-26T07:22:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.134+0000 7efc20ff9640 1 -- 172.21.15.77:0/5036138 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7efc1c01a400 con 0x7efc24161260 2023-11-26T07:22:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.135+0000 7efc20ff9640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc0406b6b0 0x7efc0406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.135+0000 7efc20ff9640 1 -- 172.21.15.77:0/5036138 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7efc1c0880f0 con 0x7efc24161260 2023-11-26T07:22:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.135+0000 7efc23fff640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc0406b6b0 0x7efc0406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.136+0000 7efc23fff640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc0406b6b0 0x7efc0406db70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efc0c036000 tx=0x7efc0c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.140+0000 7efc20ff9640 1 -- 172.21.15.77:0/5036138 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc1c054a80 con 0x7efc24161260 2023-11-26T07:22:45.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.325+0000 7efc2a93c640 1 -- 172.21.15.77:0/5036138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efc240ce000 con 0x7efc24161260 2023-11-26T07:22:45.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.326+0000 7efc20ff9640 1 -- 172.21.15.77:0/5036138 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) v1 ==== 80+0+0 (secure 0 0 0) 0x7efc1c015020 con 0x7efc24161260 2023-11-26T07:22:45.327 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:22:45.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.328+0000 7efc2a93c640 1 -- 172.21.15.77:0/5036138 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc0406b6b0 msgr2=0x7efc0406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:45.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.328+0000 7efc2a93c640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc0406b6b0 0x7efc0406db70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efc0c036000 tx=0x7efc0c008030 comp rx=0 tx=0).stop 2023-11-26T07:22:45.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.328+0000 7efc2a93c640 1 -- 172.21.15.77:0/5036138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc24161260 msgr2=0x7efc24157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:45.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.328+0000 7efc2a93c640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc24161260 0x7efc24157ff0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00b410 tx=0x7efc1c00b8d0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.328+0000 7efc2a93c640 1 -- 172.21.15.77:0/5036138 shutdown_connections 2023-11-26T07:22:45.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.328+0000 7efc2a93c640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efc0406b6b0 0x7efc0406db70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.328+0000 7efc2a93c640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc24161260 0x7efc24157ff0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.328+0000 7efc2a93c640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc2415d270 0x7efc240b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.328+0000 7efc2a93c640 1 --2- 172.21.15.77:0/5036138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc240cf220 0x7efc240b86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.329+0000 7efc2a93c640 1 -- 172.21.15.77:0/5036138 >> 172.21.15.77:0/5036138 conn(0x7efc2408af60 msgr2=0x7efc240b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:45.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.329+0000 7efc2a93c640 1 -- 172.21.15.77:0/5036138 shutdown_connections 2023-11-26T07:22:45.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.329+0000 7efc2a93c640 1 -- 172.21.15.77:0/5036138 wait complete. 2023-11-26T07:22:45.348 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-26T07:22:45.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:45.348 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-26T07:22:45.461 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:22:45.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:45.461 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:22:45.518 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:45.518 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:45.576 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:22:45.577 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:22:45.577 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:45.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:22:45.636 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:22:45.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.856+0000 7f06aa8d3640 1 Processor -- start 2023-11-26T07:22:45.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.856+0000 7f06aa8d3640 1 -- start start 2023-11-26T07:22:45.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.857+0000 7f06aa8d3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06a40cf450 0x7f06a40cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.858+0000 7f06aa8d3640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a40cece0 con 0x7f06a415c7f0 2023-11-26T07:22:45.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.858+0000 7f06aa8d3640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a406d040 con 0x7f06a40cdfb0 2023-11-26T07:22:45.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.858+0000 7f06aa8d3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a4156010 con 0x7f06a40cf450 2023-11-26T07:22:45.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.858+0000 7f06a3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f06a415c7f0 0x7f06a406db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58308/0 (socket says 172.21.15.77:58308) 2023-11-26T07:22:45.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.858+0000 7f06a3fff640 1 -- 172.21.15.77:0/3716207379 learned_addr learned my addr 172.21.15.77:0/3716207379 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:45.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.858+0000 7f06a37fe640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06a40cf450 0x7f06a40cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:45.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.858+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903537790 0 0) 0x7f06a40cece0 con 0x7f06a415c7f0 2023-11-26T07:22:45.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.858+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f068c003520 con 0x7f06a415c7f0 2023-11-26T07:22:45.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186931964 0 0) 0x7f068c003520 con 0x7f06a415c7f0 2023-11-26T07:22:45.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06a40cf450 msgr2=0x7f06a40cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:45.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06a40cf450 0x7f06a40cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 >> v1:172.21.15.159:6789/0 conn(0x7f06a40cdfb0 legacy=0x7f06a40ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:45.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a406d320 con 0x7f06a415c7f0 2023-11-26T07:22:45.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f0694001670 con 0x7f06a415c7f0 2023-11-26T07:22:45.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 >> v1:172.21.15.77:6789/0 conn(0x7f06a415c7f0 legacy=0x7f06a406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:45.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f068c0039a0 0x7f068c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f068c0047c0 0x7f068c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06a40cf450 0x7f068c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a4156010 con 0x7f068c0047c0 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c00ba90 con 0x7f068c0039a0 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068c00bc50 con 0x7f06a40cf450 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a37fe640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f068c0047c0 0x7f068c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a37fe640 1 -- 172.21.15.77:0/3716207379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06a40cf450 msgr2=0x7f068c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a37fe640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06a40cf450 0x7f068c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a37fe640 1 -- 172.21.15.77:0/3716207379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f068c0039a0 msgr2=0x7f068c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.859+0000 7f06a3fff640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f068c0039a0 0x7f068c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.860+0000 7f06a37fe640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f068c0039a0 0x7f068c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.860+0000 7f06a37fe640 1 -- 172.21.15.77:0/3716207379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c003520 con 0x7f068c0047c0 2023-11-26T07:22:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.860+0000 7f06a3fff640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f068c0039a0 0x7f068c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:45.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.861+0000 7f06a37fe640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f068c0047c0 0x7f068c004c40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0698009a90 tx=0x7f068c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcba092a807ad8af server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.861+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069802c6b0 con 0x7f068c0047c0 2023-11-26T07:22:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.861+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069802c810 con 0x7f068c0047c0 2023-11-26T07:22:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.861+0000 7f06a2ffd640 1 -- 172.21.15.77:0/3716207379 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069802cba0 con 0x7f068c0047c0 2023-11-26T07:22:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.861+0000 7f06aa8d3640 1 -- 172.21.15.77:0/3716207379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f068c0047c0 msgr2=0x7f068c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.861+0000 7f06aa8d3640 1 --2- 172.21.15.77:0/3716207379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f068c0047c0 0x7f068c004c40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0698009a90 tx=0x7f068c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.861+0000 7f06a8e70640 1 -- 172.21.15.77:0/3716207379 reap_dead start 2023-11-26T07:22:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.862+0000 7f06aa8d3640 1 -- 172.21.15.77:0/3716207379 shutdown_connections 2023-11-26T07:22:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.862+0000 7f06aa8d3640 1 -- 172.21.15.77:0/3716207379 >> 172.21.15.77:0/3716207379 conn(0x7f06a406a920 msgr2=0x7f06a406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.862+0000 7f06aa8d3640 1 -- 172.21.15.77:0/3716207379 shutdown_connections 2023-11-26T07:22:45.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.862+0000 7f06aa8d3640 1 -- 172.21.15.77:0/3716207379 wait complete. 2023-11-26T07:22:45.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.863+0000 7f06aa8d3640 1 Processor -- start 2023-11-26T07:22:45.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.863+0000 7f06aa8d3640 1 -- start start 2023-11-26T07:22:45.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.864+0000 7f06aa8d3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068c0047c0 0x7f06a40b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.864+0000 7f06aa8d3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06a4151a20 0x7f06a4151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.864+0000 7f06aa8d3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06a40aece0 0x7f06a40af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.864+0000 7f06aa8d3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a40af6a0 con 0x7f06a4151a20 2023-11-26T07:22:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.864+0000 7f06aa8d3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a4139c30 con 0x7f06a40aece0 2023-11-26T07:22:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.864+0000 7f06aa8d3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a40b1ac0 con 0x7f068c0047c0 2023-11-26T07:22:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.865+0000 7f06a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06a4151a20 0x7f06a4151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.865+0000 7f06a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06a4151a20 0x7f06a4151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47484/0 (socket says 172.21.15.77:47484) 2023-11-26T07:22:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.865+0000 7f06a37fe640 1 -- 172.21.15.77:0/1376958812 learned_addr learned my addr 172.21.15.77:0/1376958812 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.865+0000 7f06a37fe640 1 -- 172.21.15.77:0/1376958812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068c0047c0 msgr2=0x7f06a40b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.865+0000 7f06a37fe640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068c0047c0 0x7f06a40b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.865+0000 7f06a37fe640 1 -- 172.21.15.77:0/1376958812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06a40aece0 msgr2=0x7f06a40af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.865+0000 7f06a37fe640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06a40aece0 0x7f06a40af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.865+0000 7f06a37fe640 1 -- 172.21.15.77:0/1376958812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4152570 con 0x7f06a4151a20 2023-11-26T07:22:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.865+0000 7f06a37fe640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06a4151a20 0x7f06a4151ea0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f069802c250 tx=0x7f0698004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.866+0000 7f06a0ff9640 1 -- 172.21.15.77:0/1376958812 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698003810 con 0x7f06a4151a20 2023-11-26T07:22:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.866+0000 7f06a0ff9640 1 -- 172.21.15.77:0/1376958812 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0698003970 con 0x7f06a4151a20 2023-11-26T07:22:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.866+0000 7f06a0ff9640 1 -- 172.21.15.77:0/1376958812 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698003ce0 con 0x7f06a4151a20 2023-11-26T07:22:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.866+0000 7f06aa8d3640 1 -- 172.21.15.77:0/1376958812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a4152850 con 0x7f06a4151a20 2023-11-26T07:22:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.866+0000 7f06aa8d3640 1 -- 172.21.15.77:0/1376958812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a4152e10 con 0x7f06a4151a20 2023-11-26T07:22:45.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.867+0000 7f06aa8d3640 1 -- 172.21.15.77:0/1376958812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a406ef90 con 0x7f06a4151a20 2023-11-26T07:22:45.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.868+0000 7f06a0ff9640 1 -- 172.21.15.77:0/1376958812 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f0698040450 con 0x7f06a4151a20 2023-11-26T07:22:45.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.868+0000 7f06a0ff9640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f069006b6e0 0x7f069006dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:45.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.869+0000 7f06a0ff9640 1 -- 172.21.15.77:0/1376958812 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f06980a9f30 con 0x7f06a4151a20 2023-11-26T07:22:45.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.869+0000 7f06a3fff640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f069006b6e0 0x7f069006dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:45.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.869+0000 7f06a3fff640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f069006b6e0 0x7f069006dba0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f06a415b870 tx=0x7f0694009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:45.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:45.873+0000 7f06a0ff9640 1 -- 172.21.15.77:0/1376958812 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0698076980 con 0x7f06a4151a20 2023-11-26T07:22:46.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.101+0000 7f06aa8d3640 1 -- 172.21.15.77:0/1376958812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06a4067470 con 0x7f06a4151a20 2023-11-26T07:22:46.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.102+0000 7f06a0ff9640 1 -- 172.21.15.77:0/1376958812 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f06980044e0 con 0x7f06a4151a20 2023-11-26T07:22:46.104 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:22:46.104 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1822281363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1822281363},{"type":"v1","addr":"172.21.15.159:6834","nonce":1822281363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":4901,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2261329569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2261329569},{"type":"v1","addr":"172.21.15.159:6835","nonce":2261329569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3602997657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3602997657},{"type":"v1","addr":"172.21.15.77:6837","nonce":3602997657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:42.260010+0000","modified":"2023-11-26T07:21:45.350069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/3771669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3771669807},{"type":"v1","addr":"172.21.15.77:6836","nonce":3771669807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:22:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 36 2023-11-26T07:22:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 -- 172.21.15.77:0/1376958812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f069006b6e0 msgr2=0x7f069006dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f069006b6e0 0x7f069006dba0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f06a415b870 tx=0x7f0694009040 comp rx=0 tx=0).stop 2023-11-26T07:22:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 -- 172.21.15.77:0/1376958812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06a4151a20 msgr2=0x7f06a4151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06a4151a20 0x7f06a4151ea0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f069802c250 tx=0x7f0698004730 comp rx=0 tx=0).stop 2023-11-26T07:22:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 -- 172.21.15.77:0/1376958812 shutdown_connections 2023-11-26T07:22:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f069006b6e0 0x7f069006dba0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06a40aece0 0x7f06a40af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06a4151a20 0x7f06a4151ea0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 --2- 172.21.15.77:0/1376958812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068c0047c0 0x7f06a40b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 -- 172.21.15.77:0/1376958812 >> 172.21.15.77:0/1376958812 conn(0x7f06a406a920 msgr2=0x7f06a415cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 -- 172.21.15.77:0/1376958812 shutdown_connections 2023-11-26T07:22:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.105+0000 7f06aa8d3640 1 -- 172.21.15.77:0/1376958812 wait complete. 2023-11-26T07:22:46.125 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:22:46.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.340+0000 7f847cbf5640 1 Processor -- start 2023-11-26T07:22:46.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.340+0000 7f847cbf5640 1 -- start start 2023-11-26T07:22:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.342+0000 7f847cbf5640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f847815c7f0 0x7f847806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.342+0000 7f847cbf5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cf450 0x7f84780cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.342+0000 7f847cbf5640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84780cece0 con 0x7f84780cdfb0 2023-11-26T07:22:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.342+0000 7f847cbf5640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8478156010 con 0x7f847815c7f0 2023-11-26T07:22:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.342+0000 7f847cbf5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847806ce30 con 0x7f84780cf450 2023-11-26T07:22:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.343+0000 7f847659c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f847815c7f0 0x7f847806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.343+0000 7f846dd9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cf450 0x7f84780cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.343+0000 7f846dd9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cf450 0x7f84780cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:53634/0 (socket says 172.21.15.77:53634) 2023-11-26T07:22:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.343+0000 7f846dd9b640 1 -- 172.21.15.77:0/2557172097 learned_addr learned my addr 172.21.15.77:0/2557172097 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.343+0000 7f846dd9b640 1 -- 172.21.15.77:0/2557172097 >> v2:172.21.15.159:3300/0 conn(0x7f847815c7f0 msgr2=0x7f847806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.343+0000 7f846dd9b640 1 --2- 172.21.15.77:0/2557172097 >> v2:172.21.15.159:3300/0 conn(0x7f847815c7f0 0x7f847806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.343+0000 7f846dd9b640 1 -- 172.21.15.77:0/2557172097 >> v1:172.21.15.159:6789/0 conn(0x7f84780cdfb0 legacy=0x7f84780ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.343+0000 7f846dd9b640 1 -- 172.21.15.77:0/2557172097 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847806d040 con 0x7f84780cf450 2023-11-26T07:22:46.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.345+0000 7f846dd9b640 1 --2- 172.21.15.77:0/2557172097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cf450 0x7f84780cf8d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8460009870 tx=0x7f846002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0a56831145dd7b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:46.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.346+0000 7f8475d9b640 1 -- 172.21.15.77:0/2557172097 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460030840 con 0x7f84780cf450 2023-11-26T07:22:46.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.346+0000 7f8475d9b640 1 -- 172.21.15.77:0/2557172097 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84600309a0 con 0x7f84780cf450 2023-11-26T07:22:46.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.346+0000 7f8475d9b640 1 -- 172.21.15.77:0/2557172097 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460030d30 con 0x7f84780cf450 2023-11-26T07:22:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.346+0000 7f847cbf5640 1 -- 172.21.15.77:0/2557172097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cf450 msgr2=0x7f84780cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.346+0000 7f847cbf5640 1 --2- 172.21.15.77:0/2557172097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cf450 0x7f84780cf8d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8460009870 tx=0x7f846002b980 comp rx=0 tx=0).stop 2023-11-26T07:22:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.346+0000 7f847cbf5640 1 -- 172.21.15.77:0/2557172097 shutdown_connections 2023-11-26T07:22:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.346+0000 7f847cbf5640 1 --2- 172.21.15.77:0/2557172097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cf450 0x7f84780cf8d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.346+0000 7f847cbf5640 1 --2- 172.21.15.77:0/2557172097 >> v2:172.21.15.159:3300/0 conn(0x7f847815c7f0 0x7f847806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.346+0000 7f847cbf5640 1 -- 172.21.15.77:0/2557172097 >> 172.21.15.77:0/2557172097 conn(0x7f847806a920 msgr2=0x7f847806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.346+0000 7f847cbf5640 1 -- 172.21.15.77:0/2557172097 shutdown_connections 2023-11-26T07:22:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.346+0000 7f847cbf5640 1 -- 172.21.15.77:0/2557172097 wait complete. 2023-11-26T07:22:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.348+0000 7f847cbf5640 1 Processor -- start 2023-11-26T07:22:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.348+0000 7f847cbf5640 1 -- start start 2023-11-26T07:22:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.349+0000 7f847cbf5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cdfb0 0x7f84780ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.349+0000 7f847cbf5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84780cf450 0x7f8478140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.349+0000 7f847cbf5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847815c7f0 0x7f8478156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.349+0000 7f847cbf5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84780ac620 con 0x7f847815c7f0 2023-11-26T07:22:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.349+0000 7f847cbf5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84780ac830 con 0x7f84780cf450 2023-11-26T07:22:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.349+0000 7f847cbf5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8478159800 con 0x7f84780cdfb0 2023-11-26T07:22:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.350+0000 7f8476d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847815c7f0 0x7f8478156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.350+0000 7f8476d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847815c7f0 0x7f8478156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59592/0 (socket says 172.21.15.77:59592) 2023-11-26T07:22:46.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.350+0000 7f8476d9d640 1 -- 172.21.15.77:0/2661618027 learned_addr learned my addr 172.21.15.77:0/2661618027 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:46.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.350+0000 7f847659c640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cdfb0 0x7f84780ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.350+0000 7f846dd9b640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84780cf450 0x7f8478140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.350+0000 7f8476d9d640 1 -- 172.21.15.77:0/2661618027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cdfb0 msgr2=0x7f84780ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:46.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.350+0000 7f8476d9d640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cdfb0 0x7f84780ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.350+0000 7f8476d9d640 1 -- 172.21.15.77:0/2661618027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84780cf450 msgr2=0x7f8478140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:46.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.350+0000 7f8476d9d640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84780cf450 0x7f8478140640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.350+0000 7f8476d9d640 1 -- 172.21.15.77:0/2661618027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84600094d0 con 0x7f847815c7f0 2023-11-26T07:22:46.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.350+0000 7f8476d9d640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847815c7f0 0x7f8478156150 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f847000c730 tx=0x7f847000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:46.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.351+0000 7f846f7fe640 1 -- 172.21.15.77:0/2661618027 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470003b70 con 0x7f847815c7f0 2023-11-26T07:22:46.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.351+0000 7f846f7fe640 1 -- 172.21.15.77:0/2661618027 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8470003cf0 con 0x7f847815c7f0 2023-11-26T07:22:46.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.351+0000 7f847cbf5640 1 -- 172.21.15.77:0/2661618027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8478159aa0 con 0x7f847815c7f0 2023-11-26T07:22:46.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.351+0000 7f846f7fe640 1 -- 172.21.15.77:0/2661618027 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470003ea0 con 0x7f847815c7f0 2023-11-26T07:22:46.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.351+0000 7f847cbf5640 1 -- 172.21.15.77:0/2661618027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847815a060 con 0x7f847815c7f0 2023-11-26T07:22:46.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.352+0000 7f847cbf5640 1 -- 172.21.15.77:0/2661618027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847815a250 con 0x7f847815c7f0 2023-11-26T07:22:46.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.353+0000 7f846f7fe640 1 -- 172.21.15.77:0/2661618027 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f8470005520 con 0x7f847815c7f0 2023-11-26T07:22:46.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.354+0000 7f846f7fe640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845806b6b0 0x7f845806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.354+0000 7f846f7fe640 1 -- 172.21.15.77:0/2661618027 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f8470088040 con 0x7f847815c7f0 2023-11-26T07:22:46.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.355+0000 7f847659c640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845806b6b0 0x7f845806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.355+0000 7f847659c640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845806b6b0 0x7f845806db70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8468009a30 tx=0x7f8468008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:46.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.359+0000 7f846f7fe640 1 -- 172.21.15.77:0/2661618027 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8470054970 con 0x7f847815c7f0 2023-11-26T07:22:46.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.550+0000 7f847cbf5640 1 -- 172.21.15.77:0/2661618027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8478067470 con 0x7f847815c7f0 2023-11-26T07:22:46.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.553+0000 7f846f7fe640 1 -- 172.21.15.77:0/2661618027 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f8470057f90 con 0x7f847815c7f0 2023-11-26T07:22:46.555 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:22:46.555 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":64,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:22:40.721177+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:40.058564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:41.292572+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:22:46.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 -- 172.21.15.77:0/2661618027 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845806b6b0 msgr2=0x7f845806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:46.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845806b6b0 0x7f845806db70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8468009a30 tx=0x7f8468008040 comp rx=0 tx=0).stop 2023-11-26T07:22:46.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 -- 172.21.15.77:0/2661618027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847815c7f0 msgr2=0x7f8478156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:46.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847815c7f0 0x7f8478156150 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f847000c730 tx=0x7f847000cbf0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 -- 172.21.15.77:0/2661618027 shutdown_connections 2023-11-26T07:22:46.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f845806b6b0 0x7f845806db70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847815c7f0 0x7f8478156150 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84780cf450 0x7f8478140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 --2- 172.21.15.77:0/2661618027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84780cdfb0 0x7f84780ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 -- 172.21.15.77:0/2661618027 >> 172.21.15.77:0/2661618027 conn(0x7f847806a920 msgr2=0x7f84780ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:46.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 -- 172.21.15.77:0/2661618027 shutdown_connections 2023-11-26T07:22:46.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.556+0000 7f847cbf5640 1 -- 172.21.15.77:0/2661618027 wait complete. 2023-11-26T07:22:46.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:21:40.058564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:21:41.292572+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 63, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:22:46.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:22:46.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.791+0000 7f5fb65e5640 1 Processor -- start 2023-11-26T07:22:46.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.792+0000 7f5fb65e5640 1 -- start start 2023-11-26T07:22:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.793+0000 7f5fb65e5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fb0141bd0 0x7f5fb00ae960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.793+0000 7f5fb65e5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5fb00ad0e0 0x7f5fb0142e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.793+0000 7f5fb65e5640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb0144310 con 0x7f5fb006a500 2023-11-26T07:22:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.793+0000 7f5fb65e5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb0143700 con 0x7f5fb00ad0e0 2023-11-26T07:22:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.793+0000 7f5fb65e5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb01439e0 con 0x7f5fb0141bd0 2023-11-26T07:22:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.794+0000 7f5faf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5fb00ad0e0 0x7f5fb0142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.794+0000 7f5faf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5fb00ad0e0 0x7f5fb0142e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59594/0 (socket says 172.21.15.77:59594) 2023-11-26T07:22:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.794+0000 7f5faf7fe640 1 -- 172.21.15.77:0/2684764827 learned_addr learned my addr 172.21.15.77:0/2684764827 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:46.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.794+0000 7f5faffff640 1 --2- 172.21.15.77:0/2684764827 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fb0141bd0 0x7f5fb00ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.794+0000 7f5faf7fe640 1 -- 172.21.15.77:0/2684764827 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fb0141bd0 msgr2=0x7f5fb00ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:46.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.794+0000 7f5faf7fe640 1 --2- 172.21.15.77:0/2684764827 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fb0141bd0 0x7f5fb00ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.794+0000 7f5faf7fe640 1 -- 172.21.15.77:0/2684764827 >> v1:172.21.15.159:6789/0 conn(0x7f5fb006a500 legacy=0x7f5fb01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:46.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.794+0000 7f5faf7fe640 1 -- 172.21.15.77:0/2684764827 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0143cc0 con 0x7f5fb00ad0e0 2023-11-26T07:22:46.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.795+0000 7f5faf7fe640 1 --2- 172.21.15.77:0/2684764827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb00ad0e0 0x7f5fb0142e00 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009870 tx=0x7f5f9802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5a1516ead58e71 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:46.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.796+0000 7f5faeffd640 1 -- 172.21.15.77:0/2684764827 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98031640 con 0x7f5fb00ad0e0 2023-11-26T07:22:46.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.796+0000 7f5faeffd640 1 -- 172.21.15.77:0/2684764827 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f980317a0 con 0x7f5fb00ad0e0 2023-11-26T07:22:46.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.796+0000 7f5faeffd640 1 -- 172.21.15.77:0/2684764827 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98031b30 con 0x7f5fb00ad0e0 2023-11-26T07:22:46.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.796+0000 7f5fb65e5640 1 -- 172.21.15.77:0/2684764827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb00ad0e0 msgr2=0x7f5fb0142e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:46.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.796+0000 7f5fb65e5640 1 --2- 172.21.15.77:0/2684764827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb00ad0e0 0x7f5fb0142e00 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009870 tx=0x7f5f9802b8f0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.796+0000 7f5fb65e5640 1 -- 172.21.15.77:0/2684764827 shutdown_connections 2023-11-26T07:22:46.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.796+0000 7f5fb65e5640 1 --2- 172.21.15.77:0/2684764827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb00ad0e0 0x7f5fb0142e00 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.796+0000 7f5fb65e5640 1 --2- 172.21.15.77:0/2684764827 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fb0141bd0 0x7f5fb00ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.796+0000 7f5fb65e5640 1 -- 172.21.15.77:0/2684764827 >> 172.21.15.77:0/2684764827 conn(0x7f5fb00b55b0 msgr2=0x7f5fb00b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.796+0000 7f5fb65e5640 1 -- 172.21.15.77:0/2684764827 shutdown_connections 2023-11-26T07:22:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.797+0000 7f5fb65e5640 1 -- 172.21.15.77:0/2684764827 wait complete. 2023-11-26T07:22:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.798+0000 7f5fb65e5640 1 Processor -- start 2023-11-26T07:22:46.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.798+0000 7f5fb65e5640 1 -- start start 2023-11-26T07:22:46.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.799+0000 7f5fb65e5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fb006a500 0x7f5fb015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.799+0000 7f5fb65e5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fb00ad0e0 0x7f5fb01379c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.799+0000 7f5fb65e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb0141bd0 0x7f5fb00ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.799+0000 7f5fb65e5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00ce070 con 0x7f5fb0141bd0 2023-11-26T07:22:46.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.799+0000 7f5fb65e5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb013a710 con 0x7f5fb006a500 2023-11-26T07:22:46.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.799+0000 7f5fb65e5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb013a9f0 con 0x7f5fb00ad0e0 2023-11-26T07:22:46.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.800+0000 7f5fb4b82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb0141bd0 0x7f5fb00ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.800+0000 7f5fb4b82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb0141bd0 0x7f5fb00ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59596/0 (socket says 172.21.15.77:59596) 2023-11-26T07:22:46.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.800+0000 7f5fb4b82640 1 -- 172.21.15.77:0/1839130084 learned_addr learned my addr 172.21.15.77:0/1839130084 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:46.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.800+0000 7f5faffff640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fb006a500 0x7f5fb015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.800+0000 7f5faf7fe640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fb00ad0e0 0x7f5fb01379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.800+0000 7f5fb4b82640 1 -- 172.21.15.77:0/1839130084 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fb00ad0e0 msgr2=0x7f5fb01379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:46.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.800+0000 7f5fb4b82640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fb00ad0e0 0x7f5fb01379c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.800+0000 7f5fb4b82640 1 -- 172.21.15.77:0/1839130084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fb006a500 msgr2=0x7f5fb015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:46.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.800+0000 7f5fb4b82640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fb006a500 0x7f5fb015c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:46.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.800+0000 7f5fb4b82640 1 -- 172.21.15.77:0/1839130084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f980094d0 con 0x7f5fb0141bd0 2023-11-26T07:22:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.801+0000 7f5fb4b82640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb0141bd0 0x7f5fb00ce490 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800c390 tx=0x7f5fa800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.801+0000 7f5facff9640 1 -- 172.21.15.77:0/1839130084 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80035f0 con 0x7f5fb0141bd0 2023-11-26T07:22:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.801+0000 7f5facff9640 1 -- 172.21.15.77:0/1839130084 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8003750 con 0x7f5fb0141bd0 2023-11-26T07:22:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.801+0000 7f5facff9640 1 -- 172.21.15.77:0/1839130084 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8003b00 con 0x7f5fb0141bd0 2023-11-26T07:22:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.801+0000 7f5fb65e5640 1 -- 172.21.15.77:0/1839130084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb00cd9b0 con 0x7f5fb0141bd0 2023-11-26T07:22:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.801+0000 7f5fb65e5640 1 -- 172.21.15.77:0/1839130084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb015cba0 con 0x7f5fb0141bd0 2023-11-26T07:22:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.803+0000 7f5fb65e5640 1 -- 172.21.15.77:0/1839130084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb00ce1b0 con 0x7f5fb0141bd0 2023-11-26T07:22:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.804+0000 7f5facff9640 1 -- 172.21.15.77:0/1839130084 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f5fa8003c60 con 0x7f5fb0141bd0 2023-11-26T07:22:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.805+0000 7f5facff9640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f9006b700 0x7f5f9006dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.805+0000 7f5facff9640 1 -- 172.21.15.77:0/1839130084 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f5fa80876a0 con 0x7f5fb0141bd0 2023-11-26T07:22:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.806+0000 7f5faffff640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f9006b700 0x7f5f9006dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.806+0000 7f5faffff640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f9006b700 0x7f5f9006dbc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00099c0 tx=0x7f5fa0003990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:46.809+0000 7f5facff9640 1 -- 172.21.15.77:0/1839130084 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5fb00ce1b0 con 0x7f5fb0141bd0 2023-11-26T07:22:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.005+0000 7f5fb65e5640 1 -- 172.21.15.77:0/1839130084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5fb00ce1b0 con 0x7f5fb0141bd0 2023-11-26T07:22:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.006+0000 7f5facff9640 1 -- 172.21.15.77:0/1839130084 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5fb00ce1b0 con 0x7f5fb0141bd0 2023-11-26T07:22:47.007 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:22:47.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.008+0000 7f5fb65e5640 1 -- 172.21.15.77:0/1839130084 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f9006b700 msgr2=0x7f5f9006dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.008+0000 7f5fb65e5640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f9006b700 0x7f5f9006dbc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00099c0 tx=0x7f5fa0003990 comp rx=0 tx=0).stop 2023-11-26T07:22:47.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.008+0000 7f5fb65e5640 1 -- 172.21.15.77:0/1839130084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb0141bd0 msgr2=0x7f5fb00ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.008+0000 7f5fb65e5640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb0141bd0 0x7f5fb00ce490 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800c390 tx=0x7f5fa800c850 comp rx=0 tx=0).stop 2023-11-26T07:22:47.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.008+0000 7f5fb65e5640 1 -- 172.21.15.77:0/1839130084 shutdown_connections 2023-11-26T07:22:47.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.008+0000 7f5fb65e5640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f9006b700 0x7f5f9006dbc0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.008+0000 7f5fb65e5640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb0141bd0 0x7f5fb00ce490 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.008+0000 7f5fb65e5640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fb00ad0e0 0x7f5fb01379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.008+0000 7f5fb65e5640 1 --2- 172.21.15.77:0/1839130084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fb006a500 0x7f5fb015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.008+0000 7f5fb65e5640 1 -- 172.21.15.77:0/1839130084 >> 172.21.15.77:0/1839130084 conn(0x7f5fb00b55b0 msgr2=0x7f5fb00af090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:47.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.009+0000 7f5fb65e5640 1 -- 172.21.15.77:0/1839130084 shutdown_connections 2023-11-26T07:22:47.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.009+0000 7f5fb65e5640 1 -- 172.21.15.77:0/1839130084 wait complete. 2023-11-26T07:22:47.028 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:22:47.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.243+0000 7f7446d43640 1 Processor -- start 2023-11-26T07:22:47.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.243+0000 7f7446d43640 1 -- start start 2023-11-26T07:22:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.244+0000 7f7446d43640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f74400cc0f0 0x7f74400c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.244+0000 7f7446d43640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74400c57e0 0x7f744006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.244+0000 7f7446d43640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744015eea0 con 0x7f744015b440 2023-11-26T07:22:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.245+0000 7f7446d43640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744015b820 con 0x7f74400c57e0 2023-11-26T07:22:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.245+0000 7f7446d43640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74400abf30 con 0x7f74400cc0f0 2023-11-26T07:22:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.245+0000 7f74452e0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74400c57e0 0x7f744006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.245+0000 7f74452e0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74400c57e0 0x7f744006c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59612/0 (socket says 172.21.15.77:59612) 2023-11-26T07:22:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.245+0000 7f74452e0640 1 -- 172.21.15.77:0/972700867 learned_addr learned my addr 172.21.15.77:0/972700867 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.245+0000 7f743ffff640 1 --2- 172.21.15.77:0/972700867 >> v2:172.21.15.159:3300/0 conn(0x7f74400cc0f0 0x7f74400c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.245+0000 7f74452e0640 1 -- 172.21.15.77:0/972700867 >> v2:172.21.15.159:3300/0 conn(0x7f74400cc0f0 msgr2=0x7f74400c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.245+0000 7f74452e0640 1 --2- 172.21.15.77:0/972700867 >> v2:172.21.15.159:3300/0 conn(0x7f74400cc0f0 0x7f74400c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.245+0000 7f74452e0640 1 -- 172.21.15.77:0/972700867 >> v1:172.21.15.159:6789/0 conn(0x7f744015b440 legacy=0x7f74400cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:47.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.245+0000 7f74452e0640 1 -- 172.21.15.77:0/972700867 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744015f0f0 con 0x7f74400c57e0 2023-11-26T07:22:47.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.245+0000 7f743ffff640 1 --2- 172.21.15.77:0/972700867 >> v2:172.21.15.159:3300/0 conn(0x7f74400cc0f0 0x7f74400c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:47.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.246+0000 7f74452e0640 1 --2- 172.21.15.77:0/972700867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400c57e0 0x7f744006c5f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f744006e720 tx=0x7f743802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c6818d8daf8d82 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.247+0000 7f743f7fe640 1 -- 172.21.15.77:0/972700867 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380317e0 con 0x7f74400c57e0 2023-11-26T07:22:47.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.247+0000 7f743f7fe640 1 -- 172.21.15.77:0/972700867 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438031940 con 0x7f74400c57e0 2023-11-26T07:22:47.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.247+0000 7f743f7fe640 1 -- 172.21.15.77:0/972700867 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438031cd0 con 0x7f74400c57e0 2023-11-26T07:22:47.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.247+0000 7f7446d43640 1 -- 172.21.15.77:0/972700867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400c57e0 msgr2=0x7f744006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.247+0000 7f7446d43640 1 --2- 172.21.15.77:0/972700867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400c57e0 0x7f744006c5f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f744006e720 tx=0x7f743802b880 comp rx=0 tx=0).stop 2023-11-26T07:22:47.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.248+0000 7f7446d43640 1 -- 172.21.15.77:0/972700867 shutdown_connections 2023-11-26T07:22:47.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.248+0000 7f7446d43640 1 --2- 172.21.15.77:0/972700867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400c57e0 0x7f744006c5f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.248+0000 7f7446d43640 1 --2- 172.21.15.77:0/972700867 >> v2:172.21.15.159:3300/0 conn(0x7f74400cc0f0 0x7f74400c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.248+0000 7f7446d43640 1 -- 172.21.15.77:0/972700867 >> 172.21.15.77:0/972700867 conn(0x7f74400b0c50 msgr2=0x7f74400b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:47.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.248+0000 7f7446d43640 1 -- 172.21.15.77:0/972700867 shutdown_connections 2023-11-26T07:22:47.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.248+0000 7f7446d43640 1 -- 172.21.15.77:0/972700867 wait complete. 2023-11-26T07:22:47.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.249+0000 7f7446d43640 1 Processor -- start 2023-11-26T07:22:47.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.250+0000 7f7446d43640 1 -- start start 2023-11-26T07:22:47.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.250+0000 7f7446d43640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74400c57e0 0x7f74401541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.250+0000 7f7446d43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400cc0f0 0x7f7440156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.250+0000 7f7446d43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f744015b440 0x7f74400afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f7446d43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7440154700 con 0x7f74400cc0f0 2023-11-26T07:22:47.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f7446d43640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744015ccd0 con 0x7f74400c57e0 2023-11-26T07:22:47.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f7446d43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744015cf00 con 0x7f744015b440 2023-11-26T07:22:47.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f743ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400cc0f0 0x7f7440156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f743ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400cc0f0 0x7f7440156f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59626/0 (socket says 172.21.15.77:59626) 2023-11-26T07:22:47.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f743ffff640 1 -- 172.21.15.77:0/495846576 learned_addr learned my addr 172.21.15.77:0/495846576 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:47.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f7444adf640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74400c57e0 0x7f74401541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f743ffff640 1 -- 172.21.15.77:0/495846576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f744015b440 msgr2=0x7f74400afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f743ffff640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f744015b440 0x7f74400afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f743ffff640 1 -- 172.21.15.77:0/495846576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74400c57e0 msgr2=0x7f74401541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f743ffff640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74400c57e0 0x7f74401541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.251+0000 7f743ffff640 1 -- 172.21.15.77:0/495846576 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380094d0 con 0x7f74400cc0f0 2023-11-26T07:22:47.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.252+0000 7f743ffff640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400cc0f0 0x7f7440156f80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f742c00c7f0 tx=0x7f742c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.252+0000 7f743d7fa640 1 -- 172.21.15.77:0/495846576 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c007a30 con 0x7f74400cc0f0 2023-11-26T07:22:47.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.252+0000 7f743d7fa640 1 -- 172.21.15.77:0/495846576 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c007b90 con 0x7f74400cc0f0 2023-11-26T07:22:47.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.252+0000 7f7446d43640 1 -- 172.21.15.77:0/495846576 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744015d1e0 con 0x7f74400cc0f0 2023-11-26T07:22:47.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.252+0000 7f743d7fa640 1 -- 172.21.15.77:0/495846576 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00ce40 con 0x7f74400cc0f0 2023-11-26T07:22:47.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.252+0000 7f7446d43640 1 -- 172.21.15.77:0/495846576 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744015d7a0 con 0x7f74400cc0f0 2023-11-26T07:22:47.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.253+0000 7f7446d43640 1 -- 172.21.15.77:0/495846576 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744004e8b0 con 0x7f74400cc0f0 2023-11-26T07:22:47.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.254+0000 7f743d7fa640 1 -- 172.21.15.77:0/495846576 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f742c0113f0 con 0x7f74400cc0f0 2023-11-26T07:22:47.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.255+0000 7f743d7fa640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b6b0 0x7f742406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.255+0000 7f743d7fa640 1 -- 172.21.15.77:0/495846576 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f742c088200 con 0x7f74400cc0f0 2023-11-26T07:22:47.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.255+0000 7f7444adf640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b6b0 0x7f742406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.256+0000 7f7444adf640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b6b0 0x7f742406db70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7434009f60 tx=0x7f74340094f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.259+0000 7f743d7fa640 1 -- 172.21.15.77:0/495846576 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f742c054b90 con 0x7f74400cc0f0 2023-11-26T07:22:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.451+0000 7f7446d43640 1 -- 172.21.15.77:0/495846576 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f744006dc80 con 0x7f74400cc0f0 2023-11-26T07:22:47.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.452+0000 7f743d7fa640 1 -- 172.21.15.77:0/495846576 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f742c01f020 con 0x7f74400cc0f0 2023-11-26T07:22:47.453 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:22:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.454+0000 7f7446d43640 1 -- 172.21.15.77:0/495846576 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b6b0 msgr2=0x7f742406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.454+0000 7f7446d43640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b6b0 0x7f742406db70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7434009f60 tx=0x7f74340094f0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.454+0000 7f7446d43640 1 -- 172.21.15.77:0/495846576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400cc0f0 msgr2=0x7f7440156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.454+0000 7f7446d43640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400cc0f0 0x7f7440156f80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f742c00c7f0 tx=0x7f742c00cbf0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.454+0000 7f7446d43640 1 -- 172.21.15.77:0/495846576 shutdown_connections 2023-11-26T07:22:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.454+0000 7f7446d43640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f742406b6b0 0x7f742406db70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.454+0000 7f7446d43640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f744015b440 0x7f74400afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.454+0000 7f7446d43640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400cc0f0 0x7f7440156f80 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.454+0000 7f7446d43640 1 --2- 172.21.15.77:0/495846576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74400c57e0 0x7f74401541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.454+0000 7f7446d43640 1 -- 172.21.15.77:0/495846576 >> 172.21.15.77:0/495846576 conn(0x7f74400b0c50 msgr2=0x7f7440071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:47.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.455+0000 7f7446d43640 1 -- 172.21.15.77:0/495846576 shutdown_connections 2023-11-26T07:22:47.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.455+0000 7f7446d43640 1 -- 172.21.15.77:0/495846576 wait complete. 2023-11-26T07:22:47.476 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:22:47.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.693+0000 7fe9cacda640 1 Processor -- start 2023-11-26T07:22:47.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.694+0000 7fe9cacda640 1 -- start start 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9cacda640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe9c415d3f0 0x7fe9c40d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9cacda640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9c40d0e40 0x7fe9c40d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9cacda640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c40d15e0 con 0x7fe9c415d7d0 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9cacda640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c40d0280 con 0x7fe9c40d0e40 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9cacda640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c40d1300 con 0x7fe9c415d3f0 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9ca4d9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9c40d0e40 0x7fe9c40d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9ca4d9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9c40d0e40 0x7fe9c40d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59628/0 (socket says 172.21.15.77:59628) 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9ca4d9640 1 -- 172.21.15.77:0/2263017760 learned_addr learned my addr 172.21.15.77:0/2263017760 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9c9cd8640 1 --2- 172.21.15.77:0/2263017760 >> v2:172.21.15.159:3300/0 conn(0x7fe9c415d3f0 0x7fe9c40d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9ca4d9640 1 -- 172.21.15.77:0/2263017760 >> v2:172.21.15.159:3300/0 conn(0x7fe9c415d3f0 msgr2=0x7fe9c40d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9ca4d9640 1 --2- 172.21.15.77:0/2263017760 >> v2:172.21.15.159:3300/0 conn(0x7fe9c415d3f0 0x7fe9c40d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.695+0000 7fe9ca4d9640 1 -- 172.21.15.77:0/2263017760 >> v1:172.21.15.159:6789/0 conn(0x7fe9c415d7d0 legacy=0x7fe9c40afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.696+0000 7fe9ca4d9640 1 -- 172.21.15.77:0/2263017760 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c40cfc30 con 0x7fe9c40d0e40 2023-11-26T07:22:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.697+0000 7fe9ca4d9640 1 --2- 172.21.15.77:0/2263017760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c40d0e40 0x7fe9c40d1d70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4067c60 tx=0x7fe9bc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff00ec61af3e5209 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.697+0000 7fe9c8cd6640 1 -- 172.21.15.77:0/2263017760 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc02ca80 con 0x7fe9c40d0e40 2023-11-26T07:22:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.697+0000 7fe9c8cd6640 1 -- 172.21.15.77:0/2263017760 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc02cbe0 con 0x7fe9c40d0e40 2023-11-26T07:22:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.697+0000 7fe9c8cd6640 1 -- 172.21.15.77:0/2263017760 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0343f0 con 0x7fe9c40d0e40 2023-11-26T07:22:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.697+0000 7fe9cacda640 1 -- 172.21.15.77:0/2263017760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c40d0e40 msgr2=0x7fe9c40d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.697+0000 7fe9cacda640 1 --2- 172.21.15.77:0/2263017760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c40d0e40 0x7fe9c40d1d70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4067c60 tx=0x7fe9bc02bee0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.698+0000 7fe9cacda640 1 -- 172.21.15.77:0/2263017760 shutdown_connections 2023-11-26T07:22:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.698+0000 7fe9cacda640 1 --2- 172.21.15.77:0/2263017760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c40d0e40 0x7fe9c40d1d70 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.698+0000 7fe9cacda640 1 --2- 172.21.15.77:0/2263017760 >> v2:172.21.15.159:3300/0 conn(0x7fe9c415d3f0 0x7fe9c40d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.698+0000 7fe9cacda640 1 -- 172.21.15.77:0/2263017760 >> 172.21.15.77:0/2263017760 conn(0x7fe9c409c5b0 msgr2=0x7fe9c40d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.698+0000 7fe9cacda640 1 -- 172.21.15.77:0/2263017760 shutdown_connections 2023-11-26T07:22:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.698+0000 7fe9cacda640 1 -- 172.21.15.77:0/2263017760 wait complete. 2023-11-26T07:22:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.699+0000 7fe9cacda640 1 Processor -- start 2023-11-26T07:22:47.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.700+0000 7fe9cacda640 1 -- start start 2023-11-26T07:22:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.700+0000 7fe9cacda640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c40d0e40 0x7fe9c40b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9cacda640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c415d3f0 0x7fe9c40b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9cacda640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9c415d7d0 0x7fe9c40b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9cacda640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40c96d0 con 0x7fe9c415d3f0 2023-11-26T07:22:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9cacda640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40b5d10 con 0x7fe9c40d0e40 2023-11-26T07:22:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9cacda640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40c8800 con 0x7fe9c415d7d0 2023-11-26T07:22:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9c94d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c415d3f0 0x7fe9c40b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9c94d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c415d3f0 0x7fe9c40b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59644/0 (socket says 172.21.15.77:59644) 2023-11-26T07:22:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9c94d7640 1 -- 172.21.15.77:0/738310354 learned_addr learned my addr 172.21.15.77:0/738310354 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9c9cd8640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c40d0e40 0x7fe9c40b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9c94d7640 1 -- 172.21.15.77:0/738310354 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9c415d7d0 msgr2=0x7fe9c40b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9c94d7640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9c415d7d0 0x7fe9c40b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9c94d7640 1 -- 172.21.15.77:0/738310354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c40d0e40 msgr2=0x7fe9c40b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9c94d7640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c40d0e40 0x7fe9c40b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.701+0000 7fe9c94d7640 1 -- 172.21.15.77:0/738310354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc009b30 con 0x7fe9c415d3f0 2023-11-26T07:22:47.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.702+0000 7fe9c94d7640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c415d3f0 0x7fe9c40b6360 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400b3c0 tx=0x7fe9b400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.702+0000 7fe9ba7fc640 1 -- 172.21.15.77:0/738310354 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4011830 con 0x7fe9c415d3f0 2023-11-26T07:22:47.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.702+0000 7fe9ba7fc640 1 -- 172.21.15.77:0/738310354 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b4011990 con 0x7fe9c415d3f0 2023-11-26T07:22:47.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.702+0000 7fe9ba7fc640 1 -- 172.21.15.77:0/738310354 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4011d60 con 0x7fe9c415d3f0 2023-11-26T07:22:47.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.702+0000 7fe9cacda640 1 -- 172.21.15.77:0/738310354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c40b75a0 con 0x7fe9c415d3f0 2023-11-26T07:22:47.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.702+0000 7fe9cacda640 1 -- 172.21.15.77:0/738310354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c40c8d30 con 0x7fe9c415d3f0 2023-11-26T07:22:47.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.703+0000 7fe9cacda640 1 -- 172.21.15.77:0/738310354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c404e840 con 0x7fe9c415d3f0 2023-11-26T07:22:47.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.704+0000 7fe9ba7fc640 1 -- 172.21.15.77:0/738310354 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fe9b401b460 con 0x7fe9c415d3f0 2023-11-26T07:22:47.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.705+0000 7fe9ba7fc640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9a806b6b0 0x7fe9a806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.705+0000 7fe9ba7fc640 1 -- 172.21.15.77:0/738310354 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fe9b408a670 con 0x7fe9c415d3f0 2023-11-26T07:22:47.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.705+0000 7fe9c9cd8640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9a806b6b0 0x7fe9a806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.706+0000 7fe9c9cd8640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9a806b6b0 0x7fe9a806db70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0006fd0 tx=0x7fe9c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.710+0000 7fe9ba7fc640 1 -- 172.21.15.77:0/738310354 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9b4054750 con 0x7fe9c415d3f0 2023-11-26T07:22:47.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.901+0000 7fe9cacda640 1 -- 172.21.15.77:0/738310354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe9c40b1140 con 0x7fe9c415d3f0 2023-11-26T07:22:47.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.901+0000 7fe9ba7fc640 1 -- 172.21.15.77:0/738310354 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe9b4057d70 con 0x7fe9c415d3f0 2023-11-26T07:22:47.903 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:22:47.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 -- 172.21.15.77:0/738310354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9a806b6b0 msgr2=0x7fe9a806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9a806b6b0 0x7fe9a806db70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0006fd0 tx=0x7fe9c0008040 comp rx=0 tx=0).stop 2023-11-26T07:22:47.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 -- 172.21.15.77:0/738310354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c415d3f0 msgr2=0x7fe9c40b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c415d3f0 0x7fe9c40b6360 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400b3c0 tx=0x7fe9b400b880 comp rx=0 tx=0).stop 2023-11-26T07:22:47.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 -- 172.21.15.77:0/738310354 shutdown_connections 2023-11-26T07:22:47.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe9a806b6b0 0x7fe9a806db70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9c415d7d0 0x7fe9c40b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c415d3f0 0x7fe9c40b6360 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 --2- 172.21.15.77:0/738310354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c40d0e40 0x7fe9c40b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 -- 172.21.15.77:0/738310354 >> 172.21.15.77:0/738310354 conn(0x7fe9c409c5b0 msgr2=0x7fe9c40d1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:47.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 -- 172.21.15.77:0/738310354 shutdown_connections 2023-11-26T07:22:47.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:47.904+0000 7fe9cacda640 1 -- 172.21.15.77:0/738310354 wait complete. 2023-11-26T07:22:47.924 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:22:48.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.139+0000 7f490f1a5640 1 Processor -- start 2023-11-26T07:22:48.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.139+0000 7f490f1a5640 1 -- start start 2023-11-26T07:22:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.141+0000 7f490f1a5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f49080ce6c0 0x7f49080cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.141+0000 7f490f1a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49080cece0 con 0x7f490815c7f0 2023-11-26T07:22:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.141+0000 7f490f1a5640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490806d040 con 0x7f49080cf450 2023-11-26T07:22:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.141+0000 7f490f1a5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49080cfe40 con 0x7f49080ce6c0 2023-11-26T07:22:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.141+0000 7f490d742640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f49080ce6c0 0x7f49080cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.141+0000 7f490d742640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f49080ce6c0 0x7f49080cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59652/0 (socket says 172.21.15.77:59652) 2023-11-26T07:22:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.141+0000 7f490d742640 1 -- 172.21.15.77:0/2325835448 learned_addr learned my addr 172.21.15.77:0/2325835448 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.142+0000 7f490d742640 1 -- 172.21.15.77:0/2325835448 >> v1:172.21.15.159:6789/0 conn(0x7f49080cf450 legacy=0x7f49080cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.142+0000 7f490d742640 1 -- 172.21.15.77:0/2325835448 >> v1:172.21.15.77:6789/0 conn(0x7f490815c7f0 legacy=0x7f490806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.142+0000 7f490d742640 1 -- 172.21.15.77:0/2325835448 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490806d320 con 0x7f49080ce6c0 2023-11-26T07:22:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.143+0000 7f490d742640 1 --2- 172.21.15.77:0/2325835448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49080ce6c0 0x7f49080cf900 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f4900009870 tx=0x7f490002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21c82c6132ce9b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.143+0000 7f49077fe640 1 -- 172.21.15.77:0/2325835448 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900030860 con 0x7f49080ce6c0 2023-11-26T07:22:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.143+0000 7f49077fe640 1 -- 172.21.15.77:0/2325835448 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49000309c0 con 0x7f49080ce6c0 2023-11-26T07:22:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.143+0000 7f49077fe640 1 -- 172.21.15.77:0/2325835448 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900030d50 con 0x7f49080ce6c0 2023-11-26T07:22:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.144+0000 7f490f1a5640 1 -- 172.21.15.77:0/2325835448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49080ce6c0 msgr2=0x7f49080cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.144+0000 7f490f1a5640 1 --2- 172.21.15.77:0/2325835448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49080ce6c0 0x7f49080cf900 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f4900009870 tx=0x7f490002b9a0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.144+0000 7f490f1a5640 1 -- 172.21.15.77:0/2325835448 shutdown_connections 2023-11-26T07:22:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.144+0000 7f490f1a5640 1 --2- 172.21.15.77:0/2325835448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49080ce6c0 0x7f49080cf900 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.144+0000 7f490f1a5640 1 -- 172.21.15.77:0/2325835448 >> 172.21.15.77:0/2325835448 conn(0x7f490806a920 msgr2=0x7f490806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.144+0000 7f490f1a5640 1 -- 172.21.15.77:0/2325835448 shutdown_connections 2023-11-26T07:22:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.144+0000 7f490f1a5640 1 -- 172.21.15.77:0/2325835448 wait complete. 2023-11-26T07:22:48.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.146+0000 7f490f1a5640 1 Processor -- start 2023-11-26T07:22:48.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.146+0000 7f490f1a5640 1 -- start start 2023-11-26T07:22:48.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490f1a5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49080ce6c0 0x7f49081f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490f1a5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49080cf450 0x7f49081510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490f1a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f490815c7f0 0x7f49081f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490f1a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49080abfc0 con 0x7f490815c7f0 2023-11-26T07:22:48.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490f1a5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49081515e0 con 0x7f49080cf450 2023-11-26T07:22:48.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490f1a5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49080ac1d0 con 0x7f49080ce6c0 2023-11-26T07:22:48.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490d742640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f490815c7f0 0x7f49081f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490d742640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f490815c7f0 0x7f49081f4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59654/0 (socket says 172.21.15.77:59654) 2023-11-26T07:22:48.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490d742640 1 -- 172.21.15.77:0/1175658840 learned_addr learned my addr 172.21.15.77:0/1175658840 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:48.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490d742640 1 -- 172.21.15.77:0/1175658840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49080ce6c0 msgr2=0x7f49081f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490d742640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49080ce6c0 0x7f49081f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f4907fff640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49080cf450 0x7f49081510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.147+0000 7f490d742640 1 -- 172.21.15.77:0/1175658840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49080cf450 msgr2=0x7f49081510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.148+0000 7f490d742640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49080cf450 0x7f49081510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.148+0000 7f490d742640 1 -- 172.21.15.77:0/1175658840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49000094d0 con 0x7f490815c7f0 2023-11-26T07:22:48.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.148+0000 7f4907fff640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49080cf450 0x7f49081510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:48.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.148+0000 7f490d742640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f490815c7f0 0x7f49081f4d70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f490002b9e0 tx=0x7f4900004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.148+0000 7f49057fa640 1 -- 172.21.15.77:0/1175658840 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900039e20 con 0x7f490815c7f0 2023-11-26T07:22:48.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.148+0000 7f49057fa640 1 -- 172.21.15.77:0/1175658840 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900043400 con 0x7f490815c7f0 2023-11-26T07:22:48.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.148+0000 7f49057fa640 1 -- 172.21.15.77:0/1175658840 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000437b0 con 0x7f490815c7f0 2023-11-26T07:22:48.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.148+0000 7f490f1a5640 1 -- 172.21.15.77:0/1175658840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49080ac4b0 con 0x7f490815c7f0 2023-11-26T07:22:48.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.148+0000 7f490f1a5640 1 -- 172.21.15.77:0/1175658840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49080aca70 con 0x7f490815c7f0 2023-11-26T07:22:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.149+0000 7f490f1a5640 1 -- 172.21.15.77:0/1175658840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4908067470 con 0x7f490815c7f0 2023-11-26T07:22:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.150+0000 7f49057fa640 1 -- 172.21.15.77:0/1175658840 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f4900043910 con 0x7f490815c7f0 2023-11-26T07:22:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.151+0000 7f49057fa640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f48e806b6b0 0x7f48e806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.151+0000 7f49057fa640 1 -- 172.21.15.77:0/1175658840 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f490003e070 con 0x7f490815c7f0 2023-11-26T07:22:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.152+0000 7f490cf41640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f48e806b6b0 0x7f48e806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.152+0000 7f490cf41640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f48e806b6b0 0x7f48e806db70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f48f80012e0 tx=0x7f48f8007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.155+0000 7f49057fa640 1 -- 172.21.15.77:0/1175658840 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4900077e20 con 0x7f490815c7f0 2023-11-26T07:22:48.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.382+0000 7f490f1a5640 1 -- 172.21.15.77:0/1175658840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49081552b0 con 0x7f490815c7f0 2023-11-26T07:22:48.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.383+0000 7f49057fa640 1 -- 172.21.15.77:0/1175658840 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f490007b440 con 0x7f490815c7f0 2023-11-26T07:22:48.385 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:22:48.385 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1822281363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1822281363},{"type":"v1","addr":"172.21.15.159:6834","nonce":1822281363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":4901,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2261329569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2261329569},{"type":"v1","addr":"172.21.15.159:6835","nonce":2261329569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3602997657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3602997657},{"type":"v1","addr":"172.21.15.77:6837","nonce":3602997657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:42.260010+0000","modified":"2023-11-26T07:21:45.350069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/3771669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3771669807},{"type":"v1","addr":"172.21.15.77:6836","nonce":3771669807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:22:48.385 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 36 2023-11-26T07:22:48.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 -- 172.21.15.77:0/1175658840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f48e806b6b0 msgr2=0x7f48e806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f48e806b6b0 0x7f48e806db70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f48f80012e0 tx=0x7f48f8007d30 comp rx=0 tx=0).stop 2023-11-26T07:22:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 -- 172.21.15.77:0/1175658840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f490815c7f0 msgr2=0x7f49081f4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f490815c7f0 0x7f49081f4d70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f490002b9e0 tx=0x7f4900004730 comp rx=0 tx=0).stop 2023-11-26T07:22:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 -- 172.21.15.77:0/1175658840 shutdown_connections 2023-11-26T07:22:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f48e806b6b0 0x7f48e806db70 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f490815c7f0 0x7f49081f4d70 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49080cf450 0x7f49081510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 --2- 172.21.15.77:0/1175658840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49080ce6c0 0x7f49081f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 -- 172.21.15.77:0/1175658840 >> 172.21.15.77:0/1175658840 conn(0x7f490806a920 msgr2=0x7f49080aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 -- 172.21.15.77:0/1175658840 shutdown_connections 2023-11-26T07:22:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.386+0000 7f490f1a5640 1 -- 172.21.15.77:0/1175658840 wait complete. 2023-11-26T07:22:48.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:22:48.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.622+0000 7f92f7202640 1 Processor -- start 2023-11-26T07:22:48.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.622+0000 7f92f7202640 1 -- start start 2023-11-26T07:22:48.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.624+0000 7f92f7202640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92f0157c70 0x7f92f0161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.624+0000 7f92f7202640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f92f00cf450 0x7f92f00cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.624+0000 7f92f7202640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f00ce0b0 con 0x7f92f015dc80 2023-11-26T07:22:48.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.624+0000 7f92f7202640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f00cfe10 con 0x7f92f00cf450 2023-11-26T07:22:48.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.624+0000 7f92f7202640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f0161960 con 0x7f92f0157c70 2023-11-26T07:22:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.624+0000 7f92effff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f92f00cf450 0x7f92f00cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.624+0000 7f92f4f9e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92f0157c70 0x7f92f0161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.624+0000 7f92effff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f92f00cf450 0x7f92f00cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:41778/0 (socket says 172.21.15.77:41778) 2023-11-26T07:22:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.624+0000 7f92effff640 1 -- 172.21.15.77:0/572033954 learned_addr learned my addr 172.21.15.77:0/572033954 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.625+0000 7f92effff640 1 -- 172.21.15.77:0/572033954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92f0157c70 msgr2=0x7f92f0161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.625+0000 7f92effff640 1 --2- 172.21.15.77:0/572033954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92f0157c70 0x7f92f0161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.625+0000 7f92effff640 1 -- 172.21.15.77:0/572033954 >> v1:172.21.15.159:6789/0 conn(0x7f92f015dc80 legacy=0x7f92f015e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.625+0000 7f92effff640 1 -- 172.21.15.77:0/572033954 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f015e8d0 con 0x7f92f00cf450 2023-11-26T07:22:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.625+0000 7f92f4f9e640 1 --2- 172.21.15.77:0/572033954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92f0157c70 0x7f92f0161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:22:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.625+0000 7f92ef7fe640 1 -- 172.21.15.77:0/572033954 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784107299 0 0) 0x7f92f00ce0b0 con 0x7f92f015dc80 2023-11-26T07:22:48.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.627+0000 7f92effff640 1 --2- 172.21.15.77:0/572033954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92f00cf450 0x7f92f00cf8d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009870 tx=0x7f92dc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ace15a67ca69d6f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.628+0000 7f92ef7fe640 1 -- 172.21.15.77:0/572033954 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc031640 con 0x7f92f00cf450 2023-11-26T07:22:48.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.628+0000 7f92ef7fe640 1 -- 172.21.15.77:0/572033954 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc0317a0 con 0x7f92f00cf450 2023-11-26T07:22:48.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.628+0000 7f92ef7fe640 1 -- 172.21.15.77:0/572033954 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc031b30 con 0x7f92f00cf450 2023-11-26T07:22:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.628+0000 7f92f7202640 1 -- 172.21.15.77:0/572033954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92f00cf450 msgr2=0x7f92f00cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.628+0000 7f92f7202640 1 --2- 172.21.15.77:0/572033954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92f00cf450 0x7f92f00cf8d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009870 tx=0x7f92dc02b8f0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.629+0000 7f92f7202640 1 -- 172.21.15.77:0/572033954 shutdown_connections 2023-11-26T07:22:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.629+0000 7f92f7202640 1 --2- 172.21.15.77:0/572033954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92f00cf450 0x7f92f00cf8d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.629+0000 7f92f7202640 1 --2- 172.21.15.77:0/572033954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92f0157c70 0x7f92f0161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.629+0000 7f92f7202640 1 -- 172.21.15.77:0/572033954 >> 172.21.15.77:0/572033954 conn(0x7f92f006a920 msgr2=0x7f92f006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.629+0000 7f92f7202640 1 -- 172.21.15.77:0/572033954 shutdown_connections 2023-11-26T07:22:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.629+0000 7f92f7202640 1 -- 172.21.15.77:0/572033954 wait complete. 2023-11-26T07:22:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.631+0000 7f92f7202640 1 Processor -- start 2023-11-26T07:22:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.631+0000 7f92f7202640 1 -- start start 2023-11-26T07:22:48.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f7202640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92f00cf450 0x7f92f00ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f7202640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92f0157c70 0x7f92f00cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f7202640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92f015dc80 0x7f92f00cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f7202640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f014b1f0 con 0x7f92f00cf450 2023-11-26T07:22:48.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f7202640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f01f4270 con 0x7f92f015dc80 2023-11-26T07:22:48.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f7202640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00af030 con 0x7f92f0157c70 2023-11-26T07:22:48.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f4f9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92f00cf450 0x7f92f00ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f4f9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92f00cf450 0x7f92f00ae9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59666/0 (socket says 172.21.15.77:59666) 2023-11-26T07:22:48.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f4f9e640 1 -- 172.21.15.77:0/3355691441 learned_addr learned my addr 172.21.15.77:0/3355691441 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:48.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f4f9e640 1 -- 172.21.15.77:0/3355691441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92f0157c70 msgr2=0x7f92f00cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f4f9e640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92f0157c70 0x7f92f00cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f4f9e640 1 -- 172.21.15.77:0/3355691441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92f015dc80 msgr2=0x7f92f00cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f579f640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92f015dc80 0x7f92f00cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f4f9e640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92f015dc80 0x7f92f00cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.632+0000 7f92f4f9e640 1 -- 172.21.15.77:0/3355691441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e4009400 con 0x7f92f00cf450 2023-11-26T07:22:48.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.633+0000 7f92f4f9e640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92f00cf450 0x7f92f00ae9e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f92e400ebe0 tx=0x7f92e400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.633+0000 7f92ed7fa640 1 -- 172.21.15.77:0/3355691441 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4009760 con 0x7f92f00cf450 2023-11-26T07:22:48.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.633+0000 7f92ed7fa640 1 -- 172.21.15.77:0/3355691441 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e400cc30 con 0x7f92f00cf450 2023-11-26T07:22:48.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.633+0000 7f92ed7fa640 1 -- 172.21.15.77:0/3355691441 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e400eee0 con 0x7f92f00cf450 2023-11-26T07:22:48.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.633+0000 7f92f7202640 1 -- 172.21.15.77:0/3355691441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc0094d0 con 0x7f92f00cf450 2023-11-26T07:22:48.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.633+0000 7f92f7202640 1 -- 172.21.15.77:0/3355691441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f00af5f0 con 0x7f92f00cf450 2023-11-26T07:22:48.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.634+0000 7f92f7202640 1 -- 172.21.15.77:0/3355691441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f0067470 con 0x7f92f00cf450 2023-11-26T07:22:48.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.635+0000 7f92ed7fa640 1 -- 172.21.15.77:0/3355691441 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f92e4013470 con 0x7f92f00cf450 2023-11-26T07:22:48.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.637+0000 7f92ed7fa640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d406b6b0 0x7f92d406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.637+0000 7f92ed7fa640 1 -- 172.21.15.77:0/3355691441 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f92e4088710 con 0x7f92f00cf450 2023-11-26T07:22:48.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.637+0000 7f92effff640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d406b6b0 0x7f92d406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.638+0000 7f92effff640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d406b6b0 0x7f92d406db70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f92dc036000 tx=0x7f92dc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.642+0000 7f92ed7fa640 1 -- 172.21.15.77:0/3355691441 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92e4055040 con 0x7f92f00cf450 2023-11-26T07:22:48.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.835+0000 7f92f7202640 1 -- 172.21.15.77:0/3355691441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92f00cd910 con 0x7f92f00cf450 2023-11-26T07:22:48.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.837+0000 7f92ed7fa640 1 -- 172.21.15.77:0/3355691441 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f92e4058660 con 0x7f92f00cf450 2023-11-26T07:22:48.839 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:22:48.839 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":64,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:22:40.721177+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:40.058564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:41.292572+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:22:48.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.840+0000 7f92f7202640 1 -- 172.21.15.77:0/3355691441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d406b6b0 msgr2=0x7f92d406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.840+0000 7f92f7202640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d406b6b0 0x7f92d406db70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f92dc036000 tx=0x7f92dc030000 comp rx=0 tx=0).stop 2023-11-26T07:22:48.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.840+0000 7f92f7202640 1 -- 172.21.15.77:0/3355691441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92f00cf450 msgr2=0x7f92f00ae9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.840+0000 7f92f7202640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92f00cf450 0x7f92f00ae9e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f92e400ebe0 tx=0x7f92e400c520 comp rx=0 tx=0).stop 2023-11-26T07:22:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.841+0000 7f92f7202640 1 -- 172.21.15.77:0/3355691441 shutdown_connections 2023-11-26T07:22:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.841+0000 7f92f7202640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f92d406b6b0 0x7f92d406db70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.841+0000 7f92f7202640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92f015dc80 0x7f92f00cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.841+0000 7f92f7202640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92f0157c70 0x7f92f00cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.841+0000 7f92f7202640 1 --2- 172.21.15.77:0/3355691441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92f00cf450 0x7f92f00ae9e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.841+0000 7f92f7202640 1 -- 172.21.15.77:0/3355691441 >> 172.21.15.77:0/3355691441 conn(0x7f92f006a920 msgr2=0x7f92f00b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.841+0000 7f92f7202640 1 -- 172.21.15.77:0/3355691441 shutdown_connections 2023-11-26T07:22:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:48.841+0000 7f92f7202640 1 -- 172.21.15.77:0/3355691441 wait complete. 2023-11-26T07:22:48.860 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:22:48.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:22:49.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.069+0000 7fc52826b640 1 Processor -- start 2023-11-26T07:22:49.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.069+0000 7fc52826b640 1 -- start start 2023-11-26T07:22:49.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.071+0000 7fc52826b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5200cf450 0x7fc5200cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.071+0000 7fc52826b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5200cece0 con 0x7fc52015c7f0 2023-11-26T07:22:49.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.071+0000 7fc52826b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52006d040 con 0x7fc5200cdfb0 2023-11-26T07:22:49.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.071+0000 7fc52826b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc520156010 con 0x7fc5200cf450 2023-11-26T07:22:49.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.071+0000 7fc526007640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc52015c7f0 0x7fc52006db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44550/0 (socket says 172.21.15.77:44550) 2023-11-26T07:22:49.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.071+0000 7fc526007640 1 -- 172.21.15.77:0/2378501056 learned_addr learned my addr 172.21.15.77:0/2378501056 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:49.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.071+0000 7fc525806640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5200cf450 0x7fc5200cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.071+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800703641 0 0) 0x7fc5200cece0 con 0x7fc52015c7f0 2023-11-26T07:22:49.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.071+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc50c003520 con 0x7fc52015c7f0 2023-11-26T07:22:49.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3883940587 0 0) 0x7fc50c003520 con 0x7fc52015c7f0 2023-11-26T07:22:49.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5200cf450 msgr2=0x7fc5200cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:49.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5200cf450 0x7fc5200cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 >> v1:172.21.15.159:6789/0 conn(0x7fc5200cdfb0 legacy=0x7fc5200ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52006d320 con 0x7fc52015c7f0 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fc51c001670 con 0x7fc52015c7f0 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 >> v1:172.21.15.77:6789/0 conn(0x7fc52015c7f0 legacy=0x7fc52006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc50c0039a0 0x7fc50c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 0x7fc50c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5200cf450 0x7fc50c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520156010 con 0x7fc50c0047c0 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c00bae0 con 0x7fc50c0039a0 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c00bca0 con 0x7fc5200cf450 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc525806640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 0x7fc50c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.072+0000 7fc526007640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc50c0039a0 0x7fc50c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.073+0000 7fc526808640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5200cf450 0x7fc50c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.073+0000 7fc525806640 1 -- 172.21.15.77:0/2378501056 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5200cf450 msgr2=0x7fc50c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:49.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.073+0000 7fc525806640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5200cf450 0x7fc50c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.073+0000 7fc525806640 1 -- 172.21.15.77:0/2378501056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc50c0039a0 msgr2=0x7fc50c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:49.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.073+0000 7fc525806640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc50c0039a0 0x7fc50c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.073+0000 7fc525806640 1 -- 172.21.15.77:0/2378501056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c003520 con 0x7fc50c0047c0 2023-11-26T07:22:49.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.074+0000 7fc525806640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 0x7fc50c004c40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc51000ba30 tx=0x7fc50c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b739f84ea0d4bb53 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.074+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc510032640 con 0x7fc50c0047c0 2023-11-26T07:22:49.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.074+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5100327a0 con 0x7fc50c0047c0 2023-11-26T07:22:49.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.074+0000 7fc525005640 1 -- 172.21.15.77:0/2378501056 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc510032b30 con 0x7fc50c0047c0 2023-11-26T07:22:49.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.075+0000 7fc52826b640 1 -- 172.21.15.77:0/2378501056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 msgr2=0x7fc50c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.075+0000 7fc52826b640 1 --2- 172.21.15.77:0/2378501056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 0x7fc50c004c40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc51000ba30 tx=0x7fc50c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.075+0000 7fc526808640 1 -- 172.21.15.77:0/2378501056 reap_dead start 2023-11-26T07:22:49.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.075+0000 7fc52826b640 1 -- 172.21.15.77:0/2378501056 shutdown_connections 2023-11-26T07:22:49.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.075+0000 7fc52826b640 1 -- 172.21.15.77:0/2378501056 >> 172.21.15.77:0/2378501056 conn(0x7fc52006a920 msgr2=0x7fc52006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:49.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.075+0000 7fc52826b640 1 -- 172.21.15.77:0/2378501056 shutdown_connections 2023-11-26T07:22:49.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.075+0000 7fc52826b640 1 -- 172.21.15.77:0/2378501056 wait complete. 2023-11-26T07:22:49.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.077+0000 7fc52826b640 1 Processor -- start 2023-11-26T07:22:49.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.077+0000 7fc52826b640 1 -- start start 2023-11-26T07:22:49.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc52826b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 0x7fc520145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc52826b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc52009ce10 0x7fc5200999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc52826b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc520151490 0x7fc520099f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc52826b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200b37b0 con 0x7fc50c0047c0 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc52826b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5201457d0 con 0x7fc52009ce10 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc52826b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200b2ba0 con 0x7fc520151490 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc526007640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 0x7fc520145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc526007640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 0x7fc520145290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59690/0 (socket says 172.21.15.77:59690) 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc526007640 1 -- 172.21.15.77:0/3415452007 learned_addr learned my addr 172.21.15.77:0/3415452007 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc526007640 1 -- 172.21.15.77:0/3415452007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc520151490 msgr2=0x7fc520099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc526007640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc520151490 0x7fc520099f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc526007640 1 -- 172.21.15.77:0/3415452007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc52009ce10 msgr2=0x7fc5200999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc526007640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc52009ce10 0x7fc5200999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.078+0000 7fc526007640 1 -- 172.21.15.77:0/3415452007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200b2e80 con 0x7fc50c0047c0 2023-11-26T07:22:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.079+0000 7fc526007640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 0x7fc520145290 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00e800 tx=0x7fc51c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.079+0000 7fc516ffd640 1 -- 172.21.15.77:0/3415452007 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c00c8d0 con 0x7fc50c0047c0 2023-11-26T07:22:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.079+0000 7fc516ffd640 1 -- 172.21.15.77:0/3415452007 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c00ca30 con 0x7fc50c0047c0 2023-11-26T07:22:49.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.079+0000 7fc516ffd640 1 -- 172.21.15.77:0/3415452007 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c00cde0 con 0x7fc50c0047c0 2023-11-26T07:22:49.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.079+0000 7fc52826b640 1 -- 172.21.15.77:0/3415452007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5200b3160 con 0x7fc50c0047c0 2023-11-26T07:22:49.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.079+0000 7fc52826b640 1 -- 172.21.15.77:0/3415452007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5200b27c0 con 0x7fc50c0047c0 2023-11-26T07:22:49.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.080+0000 7fc52826b640 1 -- 172.21.15.77:0/3415452007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5200b2950 con 0x7fc50c0047c0 2023-11-26T07:22:49.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.081+0000 7fc516ffd640 1 -- 172.21.15.77:0/3415452007 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fc51c01d460 con 0x7fc50c0047c0 2023-11-26T07:22:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.082+0000 7fc516ffd640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc50406b6b0 0x7fc50406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.083+0000 7fc516ffd640 1 -- 172.21.15.77:0/3415452007 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc51c0880a0 con 0x7fc50c0047c0 2023-11-26T07:22:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.083+0000 7fc525806640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc50406b6b0 0x7fc50406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.083+0000 7fc525806640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc50406b6b0 0x7fc50406db70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc51000ba00 tx=0x7fc510032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.087+0000 7fc516ffd640 1 -- 172.21.15.77:0/3415452007 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc51c054a30 con 0x7fc50c0047c0 2023-11-26T07:22:49.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.314+0000 7fc52826b640 1 -- 172.21.15.77:0/3415452007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc520067470 con 0x7fc50c0047c0 2023-11-26T07:22:49.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.316+0000 7fc516ffd640 1 -- 172.21.15.77:0/3415452007 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fc51c058050 con 0x7fc50c0047c0 2023-11-26T07:22:49.317 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:22:49.318 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1822281363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1822281363},{"type":"v1","addr":"172.21.15.159:6834","nonce":1822281363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":4901,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2261329569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2261329569},{"type":"v1","addr":"172.21.15.159:6835","nonce":2261329569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3602997657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3602997657},{"type":"v1","addr":"172.21.15.77:6837","nonce":3602997657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:42.260010+0000","modified":"2023-11-26T07:21:45.350069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/3771669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3771669807},{"type":"v1","addr":"172.21.15.77:6836","nonce":3771669807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:22:49.318 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 36 2023-11-26T07:22:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.318+0000 7fc52826b640 1 -- 172.21.15.77:0/3415452007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc50406b6b0 msgr2=0x7fc50406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.318+0000 7fc52826b640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc50406b6b0 0x7fc50406db70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc51000ba00 tx=0x7fc510032000 comp rx=0 tx=0).stop 2023-11-26T07:22:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.318+0000 7fc52826b640 1 -- 172.21.15.77:0/3415452007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 msgr2=0x7fc520145290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.318+0000 7fc52826b640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 0x7fc520145290 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00e800 tx=0x7fc51c00ecc0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.318+0000 7fc52826b640 1 -- 172.21.15.77:0/3415452007 shutdown_connections 2023-11-26T07:22:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.318+0000 7fc52826b640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc50406b6b0 0x7fc50406db70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.318+0000 7fc52826b640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc520151490 0x7fc520099f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.318+0000 7fc52826b640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc52009ce10 0x7fc5200999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.318+0000 7fc52826b640 1 --2- 172.21.15.77:0/3415452007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c0047c0 0x7fc520145290 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.318+0000 7fc52826b640 1 -- 172.21.15.77:0/3415452007 >> 172.21.15.77:0/3415452007 conn(0x7fc52006a920 msgr2=0x7fc52006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.319+0000 7fc52826b640 1 -- 172.21.15.77:0/3415452007 shutdown_connections 2023-11-26T07:22:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.319+0000 7fc52826b640 1 -- 172.21.15.77:0/3415452007 wait complete. 2023-11-26T07:22:49.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:22:49.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.550+0000 7f0555b28640 1 Processor -- start 2023-11-26T07:22:49.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.550+0000 7f0555b28640 1 -- start start 2023-11-26T07:22:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.552+0000 7f0555b28640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0550144b30 0x7f055015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.552+0000 7f0555b28640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f05500b1de0 0x7f05500b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.552+0000 7f0555b28640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055015bf80 con 0x7f055015c410 2023-11-26T07:22:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.552+0000 7f0555b28640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05500b27b0 con 0x7f05500b1de0 2023-11-26T07:22:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.552+0000 7f0555b28640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05500b1560 con 0x7f0550144b30 2023-11-26T07:22:49.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.552+0000 7f0555327640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f05500b1de0 0x7f05500b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.553+0000 7f0554b26640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0550144b30 0x7f055015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.553+0000 7f054ffff640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f055015c410 0x7f05500b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:60186/0 (socket says 172.21.15.77:60186) 2023-11-26T07:22:49.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.553+0000 7f054ffff640 1 -- 172.21.15.77:0/4234096556 learned_addr learned my addr 172.21.15.77:0/4234096556 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:49.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.553+0000 7f0555327640 1 -- 172.21.15.77:0/4234096556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0550144b30 msgr2=0x7f055015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:49.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.553+0000 7f0555327640 1 --2- 172.21.15.77:0/4234096556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0550144b30 0x7f055015f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.553+0000 7f0555327640 1 -- 172.21.15.77:0/4234096556 >> v1:172.21.15.159:6789/0 conn(0x7f055015c410 legacy=0x7f05500b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.553+0000 7f0555327640 1 -- 172.21.15.77:0/4234096556 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500b1280 con 0x7f05500b1de0 2023-11-26T07:22:49.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.555+0000 7f0555327640 1 --2- 172.21.15.77:0/4234096556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05500b1de0 0x7f05500b2270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0548009d90 tx=0x7f054802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da01c5336c6fcb7f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.555+0000 7f054f7fe640 1 -- 172.21.15.77:0/4234096556 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054802cc60 con 0x7f05500b1de0 2023-11-26T07:22:49.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.556+0000 7f054f7fe640 1 -- 172.21.15.77:0/4234096556 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054802cdc0 con 0x7f05500b1de0 2023-11-26T07:22:49.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.556+0000 7f054f7fe640 1 -- 172.21.15.77:0/4234096556 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548034660 con 0x7f05500b1de0 2023-11-26T07:22:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.556+0000 7f0555b28640 1 -- 172.21.15.77:0/4234096556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05500b1de0 msgr2=0x7f05500b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.556+0000 7f0555b28640 1 --2- 172.21.15.77:0/4234096556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05500b1de0 0x7f05500b2270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0548009d90 tx=0x7f054802beb0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.556+0000 7f0555b28640 1 -- 172.21.15.77:0/4234096556 shutdown_connections 2023-11-26T07:22:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.556+0000 7f0555b28640 1 --2- 172.21.15.77:0/4234096556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05500b1de0 0x7f05500b2270 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.556+0000 7f0555b28640 1 --2- 172.21.15.77:0/4234096556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0550144b30 0x7f055015f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.556+0000 7f0555b28640 1 -- 172.21.15.77:0/4234096556 >> 172.21.15.77:0/4234096556 conn(0x7f05500cb830 msgr2=0x7f05500cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.556+0000 7f0555b28640 1 -- 172.21.15.77:0/4234096556 shutdown_connections 2023-11-26T07:22:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.556+0000 7f0555b28640 1 -- 172.21.15.77:0/4234096556 wait complete. 2023-11-26T07:22:49.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.559+0000 7f0555b28640 1 Processor -- start 2023-11-26T07:22:49.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.559+0000 7f0555b28640 1 -- start start 2023-11-26T07:22:49.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.560+0000 7f0555b28640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05500b1de0 0x7f05501346e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.560+0000 7f0555b28640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0550144b30 0x7f055013f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.560+0000 7f0555b28640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f055015c410 0x7f055013f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.560+0000 7f0555b28640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0550072520 con 0x7f0550144b30 2023-11-26T07:22:49.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.560+0000 7f0555b28640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0550143740 con 0x7f055015c410 2023-11-26T07:22:49.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.560+0000 7f0555b28640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0550072090 con 0x7f05500b1de0 2023-11-26T07:22:49.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.560+0000 7f054ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0550144b30 0x7f055013f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.560+0000 7f054ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0550144b30 0x7f055013f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59696/0 (socket says 172.21.15.77:59696) 2023-11-26T07:22:49.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.560+0000 7f054ffff640 1 -- 172.21.15.77:0/717252417 learned_addr learned my addr 172.21.15.77:0/717252417 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:49.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f0554b26640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05500b1de0 0x7f05501346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f0555327640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f055015c410 0x7f055013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f054ffff640 1 -- 172.21.15.77:0/717252417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05500b1de0 msgr2=0x7f05501346e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f054ffff640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05500b1de0 0x7f05501346e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f054ffff640 1 -- 172.21.15.77:0/717252417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f055015c410 msgr2=0x7f055013f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f054ffff640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f055015c410 0x7f055013f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f054ffff640 1 -- 172.21.15.77:0/717252417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548009a70 con 0x7f0550144b30 2023-11-26T07:22:49.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f054ffff640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0550144b30 0x7f055013f0e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f053c00c480 tx=0x7f053c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f054d7fa640 1 -- 172.21.15.77:0/717252417 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c005ce0 con 0x7f0550144b30 2023-11-26T07:22:49.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f054d7fa640 1 -- 172.21.15.77:0/717252417 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c005e40 con 0x7f0550144b30 2023-11-26T07:22:49.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f054d7fa640 1 -- 172.21.15.77:0/717252417 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0072f0 con 0x7f0550144b30 2023-11-26T07:22:49.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.561+0000 7f0555b28640 1 -- 172.21.15.77:0/717252417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05500711a0 con 0x7f0550144b30 2023-11-26T07:22:49.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.562+0000 7f0555b28640 1 -- 172.21.15.77:0/717252417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0550071760 con 0x7f0550144b30 2023-11-26T07:22:49.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.563+0000 7f0555b28640 1 -- 172.21.15.77:0/717252417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05500b3610 con 0x7f0550144b30 2023-11-26T07:22:49.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.563+0000 7f054d7fa640 1 -- 172.21.15.77:0/717252417 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f053c007510 con 0x7f0550144b30 2023-11-26T07:22:49.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.564+0000 7f054d7fa640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053406b6b0 0x7f053406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.565+0000 7f054d7fa640 1 -- 172.21.15.77:0/717252417 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f053c0875b0 con 0x7f0550144b30 2023-11-26T07:22:49.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.565+0000 7f0554b26640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053406b6b0 0x7f053406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.565+0000 7f0554b26640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053406b6b0 0x7f053406db70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0544009a10 tx=0x7f0544008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.569+0000 7f054d7fa640 1 -- 172.21.15.77:0/717252417 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05500b3610 con 0x7f0550144b30 2023-11-26T07:22:49.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.790+0000 7f0555b28640 1 -- 172.21.15.77:0/717252417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05500b3610 con 0x7f0550144b30 2023-11-26T07:22:49.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.791+0000 7f054d7fa640 1 -- 172.21.15.77:0/717252417 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f05500b3610 con 0x7f0550144b30 2023-11-26T07:22:49.793 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:22:49.793 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1822281363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1822281363},{"type":"v1","addr":"172.21.15.159:6834","nonce":1822281363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":4901,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2261329569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2261329569},{"type":"v1","addr":"172.21.15.159:6835","nonce":2261329569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3602997657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3602997657},{"type":"v1","addr":"172.21.15.77:6837","nonce":3602997657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:42.260010+0000","modified":"2023-11-26T07:21:45.350069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/3771669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3771669807},{"type":"v1","addr":"172.21.15.77:6836","nonce":3771669807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:22:49.793 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 36 2023-11-26T07:22:49.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.793+0000 7f0555b28640 1 -- 172.21.15.77:0/717252417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053406b6b0 msgr2=0x7f053406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.793+0000 7f0555b28640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053406b6b0 0x7f053406db70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0544009a10 tx=0x7f0544008040 comp rx=0 tx=0).stop 2023-11-26T07:22:49.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.793+0000 7f0555b28640 1 -- 172.21.15.77:0/717252417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0550144b30 msgr2=0x7f055013f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.793+0000 7f0555b28640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0550144b30 0x7f055013f0e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f053c00c480 tx=0x7f053c00c940 comp rx=0 tx=0).stop 2023-11-26T07:22:49.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.794+0000 7f0555b28640 1 -- 172.21.15.77:0/717252417 shutdown_connections 2023-11-26T07:22:49.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.794+0000 7f0555b28640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f053406b6b0 0x7f053406db70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.794+0000 7f0555b28640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f055015c410 0x7f055013f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.794+0000 7f0555b28640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0550144b30 0x7f055013f0e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.794+0000 7f0555b28640 1 --2- 172.21.15.77:0/717252417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05500b1de0 0x7f05501346e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.794+0000 7f0555b28640 1 -- 172.21.15.77:0/717252417 >> 172.21.15.77:0/717252417 conn(0x7f05500cb830 msgr2=0x7f05500cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:49.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.794+0000 7f0555b28640 1 -- 172.21.15.77:0/717252417 shutdown_connections 2023-11-26T07:22:49.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:49.794+0000 7f0555b28640 1 -- 172.21.15.77:0/717252417 wait complete. 2023-11-26T07:22:49.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:22:50.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.025+0000 7ff9406a2640 1 Processor -- start 2023-11-26T07:22:50.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.025+0000 7ff9406a2640 1 -- start start 2023-11-26T07:22:50.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.026+0000 7ff9406a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff93815df80 0x7ff9380ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.026+0000 7ff9406a2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93815e3f0 con 0x7ff9380b2250 2023-11-26T07:22:50.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.026+0000 7ff9406a2640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93815ab80 con 0x7ff9380cd470 2023-11-26T07:22:50.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.026+0000 7ff9406a2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93815a990 con 0x7ff93815df80 2023-11-26T07:22:50.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.027+0000 7ff93e43e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff9380b2250 0x7ff9380b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44560/0 (socket says 172.21.15.77:44560) 2023-11-26T07:22:50.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.027+0000 7ff93e43e640 1 -- 172.21.15.77:0/2183779334 learned_addr learned my addr 172.21.15.77:0/2183779334 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:50.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.027+0000 7ff93dc3d640 1 --2- 172.21.15.77:0/2183779334 >> v2:172.21.15.77:3300/0 conn(0x7ff93815df80 0x7ff9380ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.027+0000 7ff93d43c640 1 -- 172.21.15.77:0/2183779334 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712041309 0 0) 0x7ff93815e3f0 con 0x7ff9380b2250 2023-11-26T07:22:50.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.027+0000 7ff93d43c640 1 -- 172.21.15.77:0/2183779334 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff924005730 con 0x7ff9380b2250 2023-11-26T07:22:50.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.027+0000 7ff93dc3d640 1 -- 172.21.15.77:0/2183779334 >> v1:172.21.15.159:6789/0 conn(0x7ff9380cd470 legacy=0x7ff93815b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.027+0000 7ff93dc3d640 1 -- 172.21.15.77:0/2183779334 >> v1:172.21.15.77:6789/0 conn(0x7ff9380b2250 legacy=0x7ff9380b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.027+0000 7ff93dc3d640 1 -- 172.21.15.77:0/2183779334 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9380b2d40 con 0x7ff93815df80 2023-11-26T07:22:50.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.029+0000 7ff93dc3d640 1 --2- 172.21.15.77:0/2183779334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93815df80 0x7ff9380ccf30 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff9280097a0 tx=0x7ff92802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7276e25eec35ca1e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.029+0000 7ff93d43c640 1 -- 172.21.15.77:0/2183779334 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928031830 con 0x7ff93815df80 2023-11-26T07:22:50.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.029+0000 7ff93d43c640 1 -- 172.21.15.77:0/2183779334 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff928031990 con 0x7ff93815df80 2023-11-26T07:22:50.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.029+0000 7ff93d43c640 1 -- 172.21.15.77:0/2183779334 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928031d20 con 0x7ff93815df80 2023-11-26T07:22:50.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.029+0000 7ff9406a2640 1 -- 172.21.15.77:0/2183779334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93815df80 msgr2=0x7ff9380ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.029+0000 7ff9406a2640 1 --2- 172.21.15.77:0/2183779334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93815df80 0x7ff9380ccf30 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff9280097a0 tx=0x7ff92802b8d0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.030+0000 7ff9406a2640 1 -- 172.21.15.77:0/2183779334 shutdown_connections 2023-11-26T07:22:50.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.030+0000 7ff9406a2640 1 --2- 172.21.15.77:0/2183779334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93815df80 0x7ff9380ccf30 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.030+0000 7ff9406a2640 1 -- 172.21.15.77:0/2183779334 >> 172.21.15.77:0/2183779334 conn(0x7ff93806a920 msgr2=0x7ff93806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:50.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.030+0000 7ff9406a2640 1 -- 172.21.15.77:0/2183779334 shutdown_connections 2023-11-26T07:22:50.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.030+0000 7ff9406a2640 1 -- 172.21.15.77:0/2183779334 wait complete. 2023-11-26T07:22:50.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.031+0000 7ff9406a2640 1 Processor -- start 2023-11-26T07:22:50.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.031+0000 7ff9406a2640 1 -- start start 2023-11-26T07:22:50.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.032+0000 7ff9406a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380b2250 0x7ff9380cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.032+0000 7ff9406a2640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9380cd470 0x7ff938151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.032+0000 7ff9406a2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff93815df80 0x7ff938151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.032+0000 7ff9406a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380c8690 con 0x7ff9380b2250 2023-11-26T07:22:50.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.032+0000 7ff9406a2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9381f3680 con 0x7ff93815df80 2023-11-26T07:22:50.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.032+0000 7ff9406a2640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9381f3960 con 0x7ff9380cd470 2023-11-26T07:22:50.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.033+0000 7ff93e43e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380b2250 0x7ff9380cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.033+0000 7ff93e43e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380b2250 0x7ff9380cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59720/0 (socket says 172.21.15.77:59720) 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.033+0000 7ff93e43e640 1 -- 172.21.15.77:0/2106011071 learned_addr learned my addr 172.21.15.77:0/2106011071 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.033+0000 7ff93e43e640 1 -- 172.21.15.77:0/2106011071 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9380cd470 msgr2=0x7ff938151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.033+0000 7ff93e43e640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9380cd470 0x7ff938151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.033+0000 7ff93e43e640 1 -- 172.21.15.77:0/2106011071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff93815df80 msgr2=0x7ff938151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.033+0000 7ff93e43e640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff93815df80 0x7ff938151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.033+0000 7ff93e43e640 1 -- 172.21.15.77:0/2106011071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff928009400 con 0x7ff9380b2250 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.033+0000 7ff93e43e640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380b2250 0x7ff9380cabe0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c500 tx=0x7ff93400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.033+0000 7ff92effd640 1 -- 172.21.15.77:0/2106011071 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934005ce0 con 0x7ff9380b2250 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.033+0000 7ff92effd640 1 -- 172.21.15.77:0/2106011071 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff934005e40 con 0x7ff9380b2250 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.034+0000 7ff92effd640 1 -- 172.21.15.77:0/2106011071 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934007330 con 0x7ff9380b2250 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.034+0000 7ff9406a2640 1 -- 172.21.15.77:0/2106011071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9381f3c40 con 0x7ff9380b2250 2023-11-26T07:22:50.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.034+0000 7ff9406a2640 1 -- 172.21.15.77:0/2106011071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9380c9e50 con 0x7ff9380b2250 2023-11-26T07:22:50.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.035+0000 7ff9406a2640 1 -- 172.21.15.77:0/2106011071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff938067470 con 0x7ff9380b2250 2023-11-26T07:22:50.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.036+0000 7ff92effd640 1 -- 172.21.15.77:0/2106011071 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7ff934007490 con 0x7ff9380b2250 2023-11-26T07:22:50.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.037+0000 7ff92effd640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff91c06b6b0 0x7ff91c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.037+0000 7ff92effd640 1 -- 172.21.15.77:0/2106011071 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7ff934087740 con 0x7ff9380b2250 2023-11-26T07:22:50.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.037+0000 7ff93dc3d640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff91c06b6b0 0x7ff91c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.038+0000 7ff93dc3d640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff91c06b6b0 0x7ff91c06db70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff928036000 tx=0x7ff928030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.041+0000 7ff92effd640 1 -- 172.21.15.77:0/2106011071 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff934057bc0 con 0x7ff9380b2250 2023-11-26T07:22:50.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.216+0000 7ff9406a2640 1 -- 172.21.15.77:0/2106011071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff93815b1b0 con 0x7ff9380b2250 2023-11-26T07:22:50.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.217+0000 7ff92effd640 1 -- 172.21.15.77:0/2106011071 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16606 (secure 0 0 0) 0x7ff934017090 con 0x7ff9380b2250 2023-11-26T07:22:50.219 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:22:50.219 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":64,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:22:40.721177+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:40.058564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:41.292572+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:22:50.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.220+0000 7ff9406a2640 1 -- 172.21.15.77:0/2106011071 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff91c06b6b0 msgr2=0x7ff91c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.220+0000 7ff9406a2640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff91c06b6b0 0x7ff91c06db70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff928036000 tx=0x7ff928030000 comp rx=0 tx=0).stop 2023-11-26T07:22:50.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.220+0000 7ff9406a2640 1 -- 172.21.15.77:0/2106011071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380b2250 msgr2=0x7ff9380cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.220+0000 7ff9406a2640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380b2250 0x7ff9380cabe0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c500 tx=0x7ff93400c9c0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.220+0000 7ff9406a2640 1 -- 172.21.15.77:0/2106011071 shutdown_connections 2023-11-26T07:22:50.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.220+0000 7ff9406a2640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff91c06b6b0 0x7ff91c06db70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.220+0000 7ff9406a2640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff93815df80 0x7ff938151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.220+0000 7ff9406a2640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9380cd470 0x7ff938151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.220+0000 7ff9406a2640 1 --2- 172.21.15.77:0/2106011071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380b2250 0x7ff9380cabe0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.220+0000 7ff9406a2640 1 -- 172.21.15.77:0/2106011071 >> 172.21.15.77:0/2106011071 conn(0x7ff93806a920 msgr2=0x7ff9380b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.220+0000 7ff9406a2640 1 -- 172.21.15.77:0/2106011071 shutdown_connections 2023-11-26T07:22:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.221+0000 7ff9406a2640 1 -- 172.21.15.77:0/2106011071 wait complete. 2023-11-26T07:22:50.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:22:50.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.448+0000 7f5797924640 1 Processor -- start 2023-11-26T07:22:50.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.448+0000 7f5797924640 1 -- start start 2023-11-26T07:22:50.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.450+0000 7f5797924640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f579015b440 0x7f57900cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.450+0000 7f5797924640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900cc3a0 con 0x7f57900cbf20 2023-11-26T07:22:50.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.450+0000 7f5797924640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579015eea0 con 0x7f57900c59b0 2023-11-26T07:22:50.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.450+0000 7f5797924640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579015b820 con 0x7f579015b440 2023-11-26T07:22:50.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.450+0000 7f5794ebf640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f57900cbf20 0x7f57900c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44572/0 (socket says 172.21.15.77:44572) 2023-11-26T07:22:50.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.450+0000 7f5794ebf640 1 -- 172.21.15.77:0/2497414235 learned_addr learned my addr 172.21.15.77:0/2497414235 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:50.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146676778 0 0) 0x7f5780001110 con 0x7f57900cbf20 2023-11-26T07:22:50.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f577c003520 con 0x7f57900cbf20 2023-11-26T07:22:50.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f57956c0640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f579015b440 0x7f57900cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1308859856 0 0) 0x7f577c003520 con 0x7f57900cbf20 2023-11-26T07:22:50.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f579015b440 msgr2=0x7f57900cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f579015b440 0x7f57900cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 >> v1:172.21.15.159:6789/0 conn(0x7f57900c59b0 legacy=0x7f579006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57900abf30 con 0x7f57900cbf20 2023-11-26T07:22:50.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f5780001800 con 0x7f57900cbf20 2023-11-26T07:22:50.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 >> v1:172.21.15.77:6789/0 conn(0x7f57900cbf20 legacy=0x7f57900c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f577c0039a0 0x7f577c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f579015b440 0x7f577c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 0x7f577c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579015b820 con 0x7f577c004d00 2023-11-26T07:22:50.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c00bb90 con 0x7f577c0039a0 2023-11-26T07:22:50.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c00bd50 con 0x7f579015b440 2023-11-26T07:22:50.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.451+0000 7f5795ec1640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 0x7f577c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.452+0000 7f57956c0640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f577c0039a0 0x7f577c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.452+0000 7f5794ebf640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f579015b440 0x7f577c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.452+0000 7f5795ec1640 1 -- 172.21.15.77:0/2497414235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f579015b440 msgr2=0x7f577c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.452+0000 7f5795ec1640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f579015b440 0x7f577c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.452+0000 7f5795ec1640 1 -- 172.21.15.77:0/2497414235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f577c0039a0 msgr2=0x7f577c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.452+0000 7f5795ec1640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f577c0039a0 0x7f577c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.452+0000 7f5795ec1640 1 -- 172.21.15.77:0/2497414235 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c003520 con 0x7f577c004d00 2023-11-26T07:22:50.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.453+0000 7f5795ec1640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 0x7f577c005180 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f5788004480 tx=0x7f577c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21112e7959fa771 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.453+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788030400 con 0x7f577c004d00 2023-11-26T07:22:50.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.453+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788030560 con 0x7f577c004d00 2023-11-26T07:22:50.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.453+0000 7f5787fff640 1 -- 172.21.15.77:0/2497414235 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788030990 con 0x7f577c004d00 2023-11-26T07:22:50.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.454+0000 7f5797924640 1 -- 172.21.15.77:0/2497414235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 msgr2=0x7f577c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.454+0000 7f5797924640 1 --2- 172.21.15.77:0/2497414235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 0x7f577c005180 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f5788004480 tx=0x7f577c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.454+0000 7f5795ec1640 1 -- 172.21.15.77:0/2497414235 reap_dead start 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.454+0000 7f5797924640 1 -- 172.21.15.77:0/2497414235 shutdown_connections 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.454+0000 7f5797924640 1 -- 172.21.15.77:0/2497414235 >> 172.21.15.77:0/2497414235 conn(0x7f57900b0c50 msgr2=0x7f57900b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.454+0000 7f5797924640 1 -- 172.21.15.77:0/2497414235 shutdown_connections 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.454+0000 7f5797924640 1 -- 172.21.15.77:0/2497414235 wait complete. 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.456+0000 7f5797924640 1 Processor -- start 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.456+0000 7f5797924640 1 -- start start 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.456+0000 7f5797924640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 0x7f5790156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f5797924640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5790158760 0x7f5790158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f5797924640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5790159100 0x7f579015c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f5797924640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579015c550 con 0x7f577c004d00 2023-11-26T07:22:50.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f5797924640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579015b960 con 0x7f5790159100 2023-11-26T07:22:50.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f5797924640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57900cd4e0 con 0x7f5790158760 2023-11-26T07:22:50.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f57956c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 0x7f5790156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f57956c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 0x7f5790156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59742/0 (socket says 172.21.15.77:59742) 2023-11-26T07:22:50.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f57956c0640 1 -- 172.21.15.77:0/243015520 learned_addr learned my addr 172.21.15.77:0/243015520 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:50.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f57956c0640 1 -- 172.21.15.77:0/243015520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5790158760 msgr2=0x7f5790158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f57956c0640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5790158760 0x7f5790158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f57956c0640 1 -- 172.21.15.77:0/243015520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5790159100 msgr2=0x7f579015c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f57956c0640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5790159100 0x7f579015c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f57956c0640 1 -- 172.21.15.77:0/243015520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790159580 con 0x7f577c004d00 2023-11-26T07:22:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.457+0000 7f57956c0640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 0x7f5790156f60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f578c00f5e0 tx=0x7f578c00faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.458+0000 7f5785ffb640 1 -- 172.21.15.77:0/243015520 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c013810 con 0x7f577c004d00 2023-11-26T07:22:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.458+0000 7f5785ffb640 1 -- 172.21.15.77:0/243015520 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c013970 con 0x7f577c004d00 2023-11-26T07:22:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.458+0000 7f5797924640 1 -- 172.21.15.77:0/243015520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579015bbb0 con 0x7f577c004d00 2023-11-26T07:22:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.458+0000 7f5785ffb640 1 -- 172.21.15.77:0/243015520 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c013ce0 con 0x7f577c004d00 2023-11-26T07:22:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.458+0000 7f5797924640 1 -- 172.21.15.77:0/243015520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579015c170 con 0x7f577c004d00 2023-11-26T07:22:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.459+0000 7f5797924640 1 -- 172.21.15.77:0/243015520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579004e8b0 con 0x7f577c004d00 2023-11-26T07:22:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.460+0000 7f5785ffb640 1 -- 172.21.15.77:0/243015520 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f578c01f460 con 0x7f577c004d00 2023-11-26T07:22:50.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.461+0000 7f5785ffb640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f577406b6b0 0x7f577406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.461+0000 7f5785ffb640 1 -- 172.21.15.77:0/243015520 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f578c0883a0 con 0x7f577c004d00 2023-11-26T07:22:50.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.461+0000 7f5794ebf640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f577406b6b0 0x7f577406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.462+0000 7f5794ebf640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f577406b6b0 0x7f577406db70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5780001eb0 tx=0x7f5780009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.465+0000 7f5785ffb640 1 -- 172.21.15.77:0/243015520 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f578c054cd0 con 0x7f577c004d00 2023-11-26T07:22:50.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.691+0000 7f5797924640 1 -- 172.21.15.77:0/243015520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f579006dc80 con 0x7f577c004d00 2023-11-26T07:22:50.694 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-26T07:22:50.692+0000 7f36d32f9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:22:50.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.696+0000 7f5785ffb640 1 -- 172.21.15.77:0/243015520 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7f578c0582f0 con 0x7f577c004d00 2023-11-26T07:22:50.698 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:22:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.699+0000 7f5797924640 1 -- 172.21.15.77:0/243015520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f577406b6b0 msgr2=0x7f577406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.699+0000 7f5797924640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f577406b6b0 0x7f577406db70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5780001eb0 tx=0x7f5780009040 comp rx=0 tx=0).stop 2023-11-26T07:22:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.699+0000 7f5797924640 1 -- 172.21.15.77:0/243015520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 msgr2=0x7f5790156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.699+0000 7f5797924640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 0x7f5790156f60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f578c00f5e0 tx=0x7f578c00faa0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.700+0000 7f5797924640 1 -- 172.21.15.77:0/243015520 shutdown_connections 2023-11-26T07:22:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.700+0000 7f5797924640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f577406b6b0 0x7f577406db70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.700+0000 7f5797924640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5790159100 0x7f579015c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.700+0000 7f5797924640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5790158760 0x7f5790158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.700+0000 7f5797924640 1 --2- 172.21.15.77:0/243015520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c004d00 0x7f5790156f60 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.700+0000 7f5797924640 1 -- 172.21.15.77:0/243015520 >> 172.21.15.77:0/243015520 conn(0x7f57900b0c50 msgr2=0x7f57900c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:50.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.700+0000 7f5797924640 1 -- 172.21.15.77:0/243015520 shutdown_connections 2023-11-26T07:22:50.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.700+0000 7f5797924640 1 -- 172.21.15.77:0/243015520 wait complete. 2023-11-26T07:22:50.721 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:22:50.777 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-26T07:22:50.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.908+0000 7fb576bcf640 1 Processor -- start 2023-11-26T07:22:50.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.908+0000 7fb576bcf640 1 -- start start 2023-11-26T07:22:50.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.910+0000 7fb576bcf640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb570160dd0 0x7fb5700b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.910+0000 7fb576bcf640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5700b41b0 con 0x7fb5700d1a00 2023-11-26T07:22:50.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.910+0000 7fb576bcf640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5700b4490 con 0x7fb5701609f0 2023-11-26T07:22:50.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.910+0000 7fb576bcf640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5700b0090 con 0x7fb570160dd0 2023-11-26T07:22:50.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.910+0000 7fb5753cc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb5700d1a00 0x7fb5700b2be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44588/0 (socket says 172.21.15.77:44588) 2023-11-26T07:22:50.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.910+0000 7fb5753cc640 1 -- 172.21.15.77:0/3766116617 learned_addr learned my addr 172.21.15.77:0/3766116617 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:50.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.910+0000 7fb5763ce640 1 --2- 172.21.15.77:0/3766116617 >> v2:172.21.15.159:3300/0 conn(0x7fb570160dd0 0x7fb5700b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113802504 0 0) 0x7fb5700b41b0 con 0x7fb5700d1a00 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb558003520 con 0x7fb5700d1a00 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1010065798 0 0) 0x7fb558003520 con 0x7fb5700d1a00 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 >> v2:172.21.15.159:3300/0 conn(0x7fb570160dd0 msgr2=0x7fb5700b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 --2- 172.21.15.77:0/3766116617 >> v2:172.21.15.159:3300/0 conn(0x7fb570160dd0 0x7fb5700b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 >> v1:172.21.15.159:6789/0 conn(0x7fb5701609f0 legacy=0x7fb5700d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700b0370 con 0x7fb5700d1a00 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fb564001670 con 0x7fb5700d1a00 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 >> v1:172.21.15.77:6789/0 conn(0x7fb5700d1a00 legacy=0x7fb5700b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558003970 0x7fb558003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580047c0 0x7fb558004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb558005180 0x7fb55800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700b0090 con 0x7fb558003970 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55800c000 con 0x7fb558005180 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55800c1c0 con 0x7fb5580047c0 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.911+0000 7fb575bcd640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558003970 0x7fb558003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.912+0000 7fb5753cc640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580047c0 0x7fb558004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.912+0000 7fb5763ce640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb558005180 0x7fb55800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.912+0000 7fb575bcd640 1 -- 172.21.15.77:0/3766116617 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580047c0 msgr2=0x7fb558004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.912+0000 7fb575bcd640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580047c0 0x7fb558004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.912+0000 7fb575bcd640 1 -- 172.21.15.77:0/3766116617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb558005180 msgr2=0x7fb55800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.912+0000 7fb575bcd640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb558005180 0x7fb55800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.912+0000 7fb575bcd640 1 -- 172.21.15.77:0/3766116617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558003520 con 0x7fb558003970 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.912+0000 7fb5763ce640 1 -- 172.21.15.77:0/3766116617 reap_dead start 2023-11-26T07:22:50.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.912+0000 7fb5753cc640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580047c0 0x7fb558004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:50.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.913+0000 7fb575bcd640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558003970 0x7fb558003d70 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb5600044b0 tx=0x7fb5580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87152802dfd1990 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.913+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560030400 con 0x7fb558003970 2023-11-26T07:22:50.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.913+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560030560 con 0x7fb558003970 2023-11-26T07:22:50.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.913+0000 7fb574bcb640 1 -- 172.21.15.77:0/3766116617 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560030950 con 0x7fb558003970 2023-11-26T07:22:50.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.914+0000 7fb576bcf640 1 -- 172.21.15.77:0/3766116617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558003970 msgr2=0x7fb558003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.914+0000 7fb576bcf640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558003970 0x7fb558003d70 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb5600044b0 tx=0x7fb5580057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.914+0000 7fb576bcf640 1 -- 172.21.15.77:0/3766116617 shutdown_connections 2023-11-26T07:22:50.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.914+0000 7fb576bcf640 1 --2- 172.21.15.77:0/3766116617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558003970 0x7fb558003d70 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.914+0000 7fb576bcf640 1 -- 172.21.15.77:0/3766116617 >> 172.21.15.77:0/3766116617 conn(0x7fb57009c5b0 msgr2=0x7fb5700d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:50.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.914+0000 7fb576bcf640 1 -- 172.21.15.77:0/3766116617 shutdown_connections 2023-11-26T07:22:50.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.914+0000 7fb576bcf640 1 -- 172.21.15.77:0/3766116617 wait complete. 2023-11-26T07:22:50.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.915+0000 7fb576bcf640 1 Processor -- start 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.916+0000 7fb576bcf640 1 -- start start 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.916+0000 7fb576bcf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb558003970 0x7fb5700b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.916+0000 7fb576bcf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57015db20 0x7fb5701f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.916+0000 7fb576bcf640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5701f6b90 0x7fb5701f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.916+0000 7fb576bcf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700cc4c0 con 0x7fb57015db20 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.916+0000 7fb576bcf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700cb940 con 0x7fb558003970 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.916+0000 7fb576bcf640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700cbc20 con 0x7fb5701f6b90 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.917+0000 7fb5753cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57015db20 0x7fb5701f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.917+0000 7fb5753cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57015db20 0x7fb5701f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59778/0 (socket says 172.21.15.77:59778) 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.917+0000 7fb5753cc640 1 -- 172.21.15.77:0/3222718003 learned_addr learned my addr 172.21.15.77:0/3222718003 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.917+0000 7fb5753cc640 1 -- 172.21.15.77:0/3222718003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5701f6b90 msgr2=0x7fb5701f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.917+0000 7fb5753cc640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5701f6b90 0x7fb5701f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.917+0000 7fb5753cc640 1 -- 172.21.15.77:0/3222718003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb558003970 msgr2=0x7fb5700b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.917+0000 7fb5753cc640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb558003970 0x7fb5700b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.917+0000 7fb5753cc640 1 -- 172.21.15.77:0/3222718003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700cbf00 con 0x7fb57015db20 2023-11-26T07:22:50.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.917+0000 7fb5753cc640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57015db20 0x7fb5701f6650 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb56400d810 tx=0x7fb56400dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.918+0000 7fb56e7fc640 1 -- 172.21.15.77:0/3222718003 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640074e0 con 0x7fb57015db20 2023-11-26T07:22:50.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.918+0000 7fb56e7fc640 1 -- 172.21.15.77:0/3222718003 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564007640 con 0x7fb57015db20 2023-11-26T07:22:50.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.918+0000 7fb56e7fc640 1 -- 172.21.15.77:0/3222718003 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564004a00 con 0x7fb57015db20 2023-11-26T07:22:50.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.918+0000 7fb576bcf640 1 -- 172.21.15.77:0/3222718003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5700cc1e0 con 0x7fb57015db20 2023-11-26T07:22:50.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.918+0000 7fb576bcf640 1 -- 172.21.15.77:0/3222718003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5700b0f20 con 0x7fb57015db20 2023-11-26T07:22:50.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.919+0000 7fb576bcf640 1 -- 172.21.15.77:0/3222718003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57004e840 con 0x7fb57015db20 2023-11-26T07:22:50.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.920+0000 7fb56e7fc640 1 -- 172.21.15.77:0/3222718003 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fb564004b60 con 0x7fb57015db20 2023-11-26T07:22:50.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.921+0000 7fb56e7fc640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb55c06b6b0 0x7fb55c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.921+0000 7fb56e7fc640 1 -- 172.21.15.77:0/3222718003 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb564087860 con 0x7fb57015db20 2023-11-26T07:22:50.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.921+0000 7fb575bcd640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb55c06b6b0 0x7fb55c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.922+0000 7fb575bcd640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb55c06b6b0 0x7fb55c06db70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb560036000 tx=0x7fb560030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:50.926+0000 7fb56e7fc640 1 -- 172.21.15.77:0/3222718003 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb564054240 con 0x7fb57015db20 2023-11-26T07:22:51.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.149+0000 7fb576bcf640 1 -- 172.21.15.77:0/3222718003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb5700cd510 con 0x7fb57015db20 2023-11-26T07:22:51.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.732+0000 7fb56e7fc640 1 -- 172.21.15.77:0/3222718003 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb564057860 con 0x7fb57015db20 2023-11-26T07:22:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.735+0000 7fb576bcf640 1 -- 172.21.15.77:0/3222718003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb55c06b6b0 msgr2=0x7fb55c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.735+0000 7fb576bcf640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb55c06b6b0 0x7fb55c06db70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb560036000 tx=0x7fb560030000 comp rx=0 tx=0).stop 2023-11-26T07:22:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.735+0000 7fb576bcf640 1 -- 172.21.15.77:0/3222718003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57015db20 msgr2=0x7fb5701f6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.735+0000 7fb576bcf640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57015db20 0x7fb5701f6650 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb56400d810 tx=0x7fb56400dcd0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.736+0000 7fb576bcf640 1 -- 172.21.15.77:0/3222718003 shutdown_connections 2023-11-26T07:22:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.736+0000 7fb576bcf640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb55c06b6b0 0x7fb55c06db70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.736+0000 7fb576bcf640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5701f6b90 0x7fb5701f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.736+0000 7fb576bcf640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57015db20 0x7fb5701f6650 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.736+0000 7fb576bcf640 1 --2- 172.21.15.77:0/3222718003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb558003970 0x7fb5700b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.736+0000 7fb576bcf640 1 -- 172.21.15.77:0/3222718003 >> 172.21.15.77:0/3222718003 conn(0x7fb57009c5b0 msgr2=0x7fb5700b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.736+0000 7fb576bcf640 1 -- 172.21.15.77:0/3222718003 shutdown_connections 2023-11-26T07:22:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.736+0000 7fb576bcf640 1 -- 172.21.15.77:0/3222718003 wait complete. 2023-11-26T07:22:51.759 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:22:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.973+0000 7fde014ad640 1 Processor -- start 2023-11-26T07:22:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.974+0000 7fde014ad640 1 -- start start 2023-11-26T07:22:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.975+0000 7fde014ad640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fddfc0b2250 0x7fddfc15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.975+0000 7fde014ad640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fddfc0b2630 0x7fddfc0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.975+0000 7fde014ad640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc15ab80 con 0x7fddfc0b2aa0 2023-11-26T07:22:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.975+0000 7fde014ad640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc15a990 con 0x7fddfc0b2630 2023-11-26T07:22:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.975+0000 7fde014ad640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc15e680 con 0x7fddfc0b2250 2023-11-26T07:22:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.976+0000 7fddf3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fddfc0b2630 0x7fddfc0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.976+0000 7fddfb7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fddfc0b2aa0 0x7fddfc15b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44590/0 (socket says 172.21.15.77:44590) 2023-11-26T07:22:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.976+0000 7fddfb7fe640 1 -- 172.21.15.77:0/4189444938 learned_addr learned my addr 172.21.15.77:0/4189444938 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.976+0000 7fddfaffd640 1 --2- 172.21.15.77:0/4189444938 >> v2:172.21.15.159:3300/0 conn(0x7fddfc0b2250 0x7fddfc15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.976+0000 7fddf3fff640 1 -- 172.21.15.77:0/4189444938 >> v2:172.21.15.159:3300/0 conn(0x7fddfc0b2250 msgr2=0x7fddfc15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.976+0000 7fddf3fff640 1 --2- 172.21.15.77:0/4189444938 >> v2:172.21.15.159:3300/0 conn(0x7fddfc0b2250 0x7fddfc15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.976+0000 7fddf3fff640 1 -- 172.21.15.77:0/4189444938 >> v1:172.21.15.77:6789/0 conn(0x7fddfc0b2aa0 legacy=0x7fddfc15b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.976+0000 7fddf3fff640 1 -- 172.21.15.77:0/4189444938 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc15e960 con 0x7fddfc0b2630 2023-11-26T07:22:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.976+0000 7fddfa7fc640 1 -- 172.21.15.77:0/4189444938 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173374261 0 0) 0x7fddfc15ab80 con 0x7fddfc0b2aa0 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.977+0000 7fddf3fff640 1 --2- 172.21.15.77:0/4189444938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddfc0b2630 0x7fddfc0ccf30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fddfc072a70 tx=0x7fdde402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18ceceecffe41ef server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.978+0000 7fddfa7fc640 1 -- 172.21.15.77:0/4189444938 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4031830 con 0x7fddfc0b2630 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.978+0000 7fddfa7fc640 1 -- 172.21.15.77:0/4189444938 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde4031990 con 0x7fddfc0b2630 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.978+0000 7fddfa7fc640 1 -- 172.21.15.77:0/4189444938 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4031d20 con 0x7fddfc0b2630 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.978+0000 7fde014ad640 1 -- 172.21.15.77:0/4189444938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddfc0b2630 msgr2=0x7fddfc0ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.978+0000 7fde014ad640 1 --2- 172.21.15.77:0/4189444938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddfc0b2630 0x7fddfc0ccf30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fddfc072a70 tx=0x7fdde402b8d0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.978+0000 7fde014ad640 1 -- 172.21.15.77:0/4189444938 shutdown_connections 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.978+0000 7fde014ad640 1 --2- 172.21.15.77:0/4189444938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddfc0b2630 0x7fddfc0ccf30 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.978+0000 7fde014ad640 1 --2- 172.21.15.77:0/4189444938 >> v2:172.21.15.159:3300/0 conn(0x7fddfc0b2250 0x7fddfc15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.978+0000 7fde014ad640 1 -- 172.21.15.77:0/4189444938 >> 172.21.15.77:0/4189444938 conn(0x7fddfc06a920 msgr2=0x7fddfc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.978+0000 7fde014ad640 1 -- 172.21.15.77:0/4189444938 shutdown_connections 2023-11-26T07:22:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.978+0000 7fde014ad640 1 -- 172.21.15.77:0/4189444938 wait complete. 2023-11-26T07:22:51.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.980+0000 7fde014ad640 1 Processor -- start 2023-11-26T07:22:51.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.980+0000 7fde014ad640 1 -- start start 2023-11-26T07:22:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.981+0000 7fde014ad640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddfc0b2250 0x7fddfc0c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.981+0000 7fde014ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddfc0b2630 0x7fddfc153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.981+0000 7fde014ad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddfc0b2aa0 0x7fddfc151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.981+0000 7fde014ad640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc152470 con 0x7fddfc0b2630 2023-11-26T07:22:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.981+0000 7fde014ad640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc1526d0 con 0x7fddfc0b2aa0 2023-11-26T07:22:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.981+0000 7fde014ad640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc1529b0 con 0x7fddfc0b2250 2023-11-26T07:22:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.981+0000 7fddf3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddfc0b2630 0x7fddfc153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.981+0000 7fddf3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddfc0b2630 0x7fddfc153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59800/0 (socket says 172.21.15.77:59800) 2023-11-26T07:22:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.981+0000 7fddf3fff640 1 -- 172.21.15.77:0/3817340332 learned_addr learned my addr 172.21.15.77:0/3817340332 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.982+0000 7fddf3fff640 1 -- 172.21.15.77:0/3817340332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddfc0b2250 msgr2=0x7fddfc0c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.982+0000 7fddf3fff640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddfc0b2250 0x7fddfc0c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.982+0000 7fddf3fff640 1 -- 172.21.15.77:0/3817340332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddfc0b2aa0 msgr2=0x7fddfc151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.982+0000 7fddf3fff640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddfc0b2aa0 0x7fddfc151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.982+0000 7fddf3fff640 1 -- 172.21.15.77:0/3817340332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde4009400 con 0x7fddfc0b2630 2023-11-26T07:22:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.982+0000 7fddf3fff640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddfc0b2630 0x7fddfc153770 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009890 tx=0x7fdde40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:51.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.982+0000 7fddf37fe640 1 -- 172.21.15.77:0/3817340332 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde403ba70 con 0x7fddfc0b2630 2023-11-26T07:22:51.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.982+0000 7fddf37fe640 1 -- 172.21.15.77:0/3817340332 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde403bbf0 con 0x7fddfc0b2630 2023-11-26T07:22:51.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.982+0000 7fddf37fe640 1 -- 172.21.15.77:0/3817340332 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4045400 con 0x7fddfc0b2630 2023-11-26T07:22:51.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.982+0000 7fde014ad640 1 -- 172.21.15.77:0/3817340332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc152c90 con 0x7fddfc0b2630 2023-11-26T07:22:51.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.982+0000 7fde014ad640 1 -- 172.21.15.77:0/3817340332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc153250 con 0x7fddfc0b2630 2023-11-26T07:22:51.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.984+0000 7fde014ad640 1 -- 172.21.15.77:0/3817340332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc153440 con 0x7fddfc0b2630 2023-11-26T07:22:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.984+0000 7fddf37fe640 1 -- 172.21.15.77:0/3817340332 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fdde404e440 con 0x7fddfc0b2630 2023-11-26T07:22:51.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.985+0000 7fddf37fe640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 0x7fdddc06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:51.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.985+0000 7fddf37fe640 1 -- 172.21.15.77:0/3817340332 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fdde40aa340 con 0x7fddfc0b2630 2023-11-26T07:22:51.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.986+0000 7fddfaffd640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 0x7fdddc06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:51.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.986+0000 7fddfaffd640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 0x7fdddc06db70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fddec0098f0 tx=0x7fddec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:51.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:51.990+0000 7fddf37fe640 1 -- 172.21.15.77:0/3817340332 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdde4076c70 con 0x7fddfc0b2630 2023-11-26T07:22:52.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.169+0000 7fde014ad640 1 -- 172.21.15.77:0/3817340332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fddfc067470 con 0x7fddfc0b2630 2023-11-26T07:22:52.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.894+0000 7fddf37fe640 1 -- 172.21.15.77:0/3817340332 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v66) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdde407a290 con 0x7fddfc0b2630 2023-11-26T07:22:52.896 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:22:52.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.898+0000 7fde014ad640 1 -- 172.21.15.77:0/3817340332 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 msgr2=0x7fdddc06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.898+0000 7fde014ad640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 0x7fdddc06db70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fddec0098f0 tx=0x7fddec008040 comp rx=0 tx=0).stop 2023-11-26T07:22:52.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.898+0000 7fde014ad640 1 -- 172.21.15.77:0/3817340332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddfc0b2630 msgr2=0x7fddfc153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.898+0000 7fde014ad640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddfc0b2630 0x7fddfc153770 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009890 tx=0x7fdde40046c0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.899+0000 7fde014ad640 1 -- 172.21.15.77:0/3817340332 shutdown_connections 2023-11-26T07:22:52.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.899+0000 7fde014ad640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 0x7fdddc06db70 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.899+0000 7fde014ad640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddfc0b2aa0 0x7fddfc151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.899+0000 7fde014ad640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddfc0b2630 0x7fddfc153770 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.899+0000 7fde014ad640 1 --2- 172.21.15.77:0/3817340332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddfc0b2250 0x7fddfc0c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.899+0000 7fde014ad640 1 -- 172.21.15.77:0/3817340332 >> 172.21.15.77:0/3817340332 conn(0x7fddfc06a920 msgr2=0x7fddfc0cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:52.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.899+0000 7fde014ad640 1 -- 172.21.15.77:0/3817340332 shutdown_connections 2023-11-26T07:22:52.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:52.900+0000 7fde014ad640 1 -- 172.21.15.77:0/3817340332 wait complete. 2023-11-26T07:22:52.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:22:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.127+0000 7f0df7fff640 1 Processor -- start 2023-11-26T07:22:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.127+0000 7f0df7fff640 1 -- start start 2023-11-26T07:22:53.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.129+0000 7f0df7fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0df80d1ec0 0x7f0df80cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.129+0000 7f0df7fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80d2750 0x7f0df80d2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.129+0000 7f0df7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df80ce280 con 0x7f0df815d260 2023-11-26T07:22:53.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.129+0000 7f0df7fff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df80ce4d0 con 0x7f0df80d1ec0 2023-11-26T07:22:53.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.129+0000 7f0df7fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80ce7b0 con 0x7f0df80d2750 2023-11-26T07:22:53.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.129+0000 7f0df6ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0df815d260 0x7f0df80d17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44596/0 (socket says 172.21.15.77:44596) 2023-11-26T07:22:53.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.129+0000 7f0df6ffd640 1 -- 172.21.15.77:0/3088949150 learned_addr learned my addr 172.21.15.77:0/3088949150 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0df77fe640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80d2750 0x7f0df80d2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0deffff640 1 --2- 172.21.15.77:0/3088949150 >> v2:172.21.15.159:3300/0 conn(0x7f0df80d1ec0 0x7f0df80cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957113211 0 0) 0x7f0df80ce280 con 0x7f0df815d260 2023-11-26T07:22:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de4003520 con 0x7f0df815d260 2023-11-26T07:22:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1645954612 0 0) 0x7f0de4003520 con 0x7f0df815d260 2023-11-26T07:22:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80d2750 msgr2=0x7f0df80d2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0df67fc640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80d2750 0x7f0df80d2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 >> v2:172.21.15.159:3300/0 conn(0x7f0df80d1ec0 msgr2=0x7f0df80cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0df67fc640 1 --2- 172.21.15.77:0/3088949150 >> v2:172.21.15.159:3300/0 conn(0x7f0df80d1ec0 0x7f0df80cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df80b8b40 con 0x7f0df815d260 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f0de8001670 con 0x7f0df815d260 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.130+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 >> v1:172.21.15.77:6789/0 conn(0x7f0df815d260 legacy=0x7f0df80d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df67fc640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de4003970 0x7f0de4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df67fc640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80d2750 0x7f0de40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df67fc640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0de4004d00 0x7f0de4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80ce4d0 con 0x7f0de4004d00 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80ce7b0 con 0x7f0de4003970 2023-11-26T07:22:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de400b980 con 0x7f0df80d2750 2023-11-26T07:22:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df77fe640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0de4004d00 0x7f0de4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df6ffd640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de4003970 0x7f0de4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df77fe640 1 -- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80d2750 msgr2=0x7f0de40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0deffff640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80d2750 0x7f0de40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df77fe640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80d2750 0x7f0de40047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df77fe640 1 -- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de4003970 msgr2=0x7f0de4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df77fe640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de4003970 0x7f0de4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df77fe640 1 -- 172.21.15.77:0/3088949150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de4003520 con 0x7f0de4004d00 2023-11-26T07:22:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.131+0000 7f0df6ffd640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de4003970 0x7f0de4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:53.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.133+0000 7f0df77fe640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0de4004d00 0x7f0de4005180 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009fc0 tx=0x7f0de40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ebaec9a894fa26 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.133+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df002cc20 con 0x7f0de4004d00 2023-11-26T07:22:53.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.133+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df000f040 con 0x7f0de4004d00 2023-11-26T07:22:53.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.133+0000 7f0df67fc640 1 -- 172.21.15.77:0/3088949150 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0034440 con 0x7f0de4004d00 2023-11-26T07:22:53.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.133+0000 7f0df7fff640 1 -- 172.21.15.77:0/3088949150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0de4004d00 msgr2=0x7f0de4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.133+0000 7f0df7fff640 1 --2- 172.21.15.77:0/3088949150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0de4004d00 0x7f0de4005180 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009fc0 tx=0x7f0de40057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.133+0000 7f0df77fe640 1 -- 172.21.15.77:0/3088949150 reap_dead start 2023-11-26T07:22:53.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.134+0000 7f0df7fff640 1 -- 172.21.15.77:0/3088949150 shutdown_connections 2023-11-26T07:22:53.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.134+0000 7f0df7fff640 1 -- 172.21.15.77:0/3088949150 >> 172.21.15.77:0/3088949150 conn(0x7f0df8061340 msgr2=0x7f0df8061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:53.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.134+0000 7f0df7fff640 1 -- 172.21.15.77:0/3088949150 shutdown_connections 2023-11-26T07:22:53.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.134+0000 7f0df7fff640 1 -- 172.21.15.77:0/3088949150 wait complete. 2023-11-26T07:22:53.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.135+0000 7f0df7fff640 1 Processor -- start 2023-11-26T07:22:53.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.136+0000 7f0df7fff640 1 -- start start 2023-11-26T07:22:53.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.136+0000 7f0df7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0df80c63e0 0x7f0df8148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.136+0000 7f0df7fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80c67c0 0x7f0df8148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.136+0000 7f0df7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0df80b68a0 0x7f0df80b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.136+0000 7f0df7fff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80b7290 con 0x7f0df80c63e0 2023-11-26T07:22:53.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.136+0000 7f0df7fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df8160680 con 0x7f0df80b68a0 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.136+0000 7f0df7fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df8148bc0 con 0x7f0df80c67c0 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.137+0000 7f0df6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0df80c63e0 0x7f0df8148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.137+0000 7f0df6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0df80c63e0 0x7f0df8148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59812/0 (socket says 172.21.15.77:59812) 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.137+0000 7f0df6ffd640 1 -- 172.21.15.77:0/3093636536 learned_addr learned my addr 172.21.15.77:0/3093636536 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.137+0000 7f0df6ffd640 1 -- 172.21.15.77:0/3093636536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80c67c0 msgr2=0x7f0df8148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.137+0000 7f0df6ffd640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80c67c0 0x7f0df8148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.137+0000 7f0df6ffd640 1 -- 172.21.15.77:0/3093636536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0df80b68a0 msgr2=0x7f0df80b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.137+0000 7f0df6ffd640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0df80b68a0 0x7f0df80b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.137+0000 7f0df6ffd640 1 -- 172.21.15.77:0/3093636536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df8148ea0 con 0x7f0df80c63e0 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.137+0000 7f0df6ffd640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0df80c63e0 0x7f0df8148050 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0de800daf0 tx=0x7f0de8007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.138+0000 7f0df4ff9640 1 -- 172.21.15.77:0/3093636536 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de8004cb0 con 0x7f0df80c63e0 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.138+0000 7f0df4ff9640 1 -- 172.21.15.77:0/3093636536 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de8004e10 con 0x7f0df80c63e0 2023-11-26T07:22:53.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.138+0000 7f0df4ff9640 1 -- 172.21.15.77:0/3093636536 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de80072d0 con 0x7f0df80c63e0 2023-11-26T07:22:53.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.138+0000 7f0df7fff640 1 -- 172.21.15.77:0/3093636536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df8149180 con 0x7f0df80c63e0 2023-11-26T07:22:53.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.138+0000 7f0df7fff640 1 -- 172.21.15.77:0/3093636536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df8149740 con 0x7f0df80c63e0 2023-11-26T07:22:53.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.139+0000 7f0df7fff640 1 -- 172.21.15.77:0/3093636536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df8067990 con 0x7f0df80c63e0 2023-11-26T07:22:53.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.140+0000 7f0df4ff9640 1 -- 172.21.15.77:0/3093636536 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f0de8007430 con 0x7f0df80c63e0 2023-11-26T07:22:53.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.141+0000 7f0df4ff9640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0dd806b6b0 0x7f0dd806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.141+0000 7f0df4ff9640 1 -- 172.21.15.77:0/3093636536 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f0de8087ac0 con 0x7f0df80c63e0 2023-11-26T07:22:53.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.141+0000 7f0deffff640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0dd806b6b0 0x7f0dd806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.142+0000 7f0deffff640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0dd806b6b0 0x7f0dd806db70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0df80c6bc0 tx=0x7f0de0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.145+0000 7f0df4ff9640 1 -- 172.21.15.77:0/3093636536 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0de8057f40 con 0x7f0df80c63e0 2023-11-26T07:22:53.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.335+0000 7f0df7fff640 1 -- 172.21.15.77:0/3093636536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0df804e840 con 0x7f0df80c63e0 2023-11-26T07:22:53.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.898+0000 7f0df4ff9640 1 -- 172.21.15.77:0/3093636536 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v67) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0de8057ad0 con 0x7f0df80c63e0 2023-11-26T07:22:53.900 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-11-26T07:22:53.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.902+0000 7f0df7fff640 1 -- 172.21.15.77:0/3093636536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0dd806b6b0 msgr2=0x7f0dd806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.902+0000 7f0df7fff640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0dd806b6b0 0x7f0dd806db70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0df80c6bc0 tx=0x7f0de0008040 comp rx=0 tx=0).stop 2023-11-26T07:22:53.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.902+0000 7f0df7fff640 1 -- 172.21.15.77:0/3093636536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0df80c63e0 msgr2=0x7f0df8148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.902+0000 7f0df7fff640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0df80c63e0 0x7f0df8148050 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0de800daf0 tx=0x7f0de8007e30 comp rx=0 tx=0).stop 2023-11-26T07:22:53.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.903+0000 7f0df7fff640 1 -- 172.21.15.77:0/3093636536 shutdown_connections 2023-11-26T07:22:53.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.903+0000 7f0df7fff640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0dd806b6b0 0x7f0dd806db70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.903+0000 7f0df7fff640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0df80b68a0 0x7f0df80b6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.903+0000 7f0df7fff640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0df80c67c0 0x7f0df8148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.903+0000 7f0df7fff640 1 --2- 172.21.15.77:0/3093636536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0df80c63e0 0x7f0df8148050 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.903+0000 7f0df7fff640 1 -- 172.21.15.77:0/3093636536 >> 172.21.15.77:0/3093636536 conn(0x7f0df8061340 msgr2=0x7f0df80d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:53.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.904+0000 7f0df7fff640 1 -- 172.21.15.77:0/3093636536 shutdown_connections 2023-11-26T07:22:53.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:53.905+0000 7f0df7fff640 1 -- 172.21.15.77:0/3093636536 wait complete. 2023-11-26T07:22:53.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:22:54.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.129+0000 7fa0596bb640 1 Processor -- start 2023-11-26T07:22:54.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.129+0000 7fa0596bb640 1 -- start start 2023-11-26T07:22:54.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.131+0000 7fa0596bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0540b16b0 0x7fa0540cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.131+0000 7fa0596bb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0540ccd90 con 0x7fa0540b25d0 2023-11-26T07:22:54.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.131+0000 7fa0596bb640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0540cc500 con 0x7fa0540b3f30 2023-11-26T07:22:54.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.131+0000 7fa0596bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0541403d0 con 0x7fa0540b16b0 2023-11-26T07:22:54.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.132+0000 7fa058eba640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa0540b25d0 0x7fa0540cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44600/0 (socket says 172.21.15.77:44600) 2023-11-26T07:22:54.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.132+0000 7fa058eba640 1 -- 172.21.15.77:0/3011028628 learned_addr learned my addr 172.21.15.77:0/3011028628 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086291630 0 0) 0x7fa0540ccd90 con 0x7fa0540b25d0 2023-11-26T07:22:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa03c003520 con 0x7fa0540b25d0 2023-11-26T07:22:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa053fff640 1 --2- 172.21.15.77:0/3011028628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0540b16b0 0x7fa0540cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2096767469 0 0) 0x7fa03c003520 con 0x7fa0540b25d0 2023-11-26T07:22:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0540b16b0 msgr2=0x7fa0540cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 --2- 172.21.15.77:0/3011028628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0540b16b0 0x7fa0540cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 >> v1:172.21.15.159:6789/0 conn(0x7fa0540b3f30 legacy=0x7fa0540b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0540cd030 con 0x7fa0540b25d0 2023-11-26T07:22:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fa048001670 con 0x7fa0540b25d0 2023-11-26T07:22:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 >> v1:172.21.15.77:6789/0 conn(0x7fa0540b25d0 legacy=0x7fa0540cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 --2- 172.21.15.77:0/3011028628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa03c0039a0 0x7fa03c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 --2- 172.21.15.77:0/3011028628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03c0047c0 0x7fa03c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 --2- 172.21.15.77:0/3011028628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0540b16b0 0x7fa03c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0054b0 con 0x7fa03c0039a0 2023-11-26T07:22:54.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c005620 con 0x7fa03c0047c0 2023-11-26T07:22:54.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.133+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c00bef0 con 0x7fa0540b16b0 2023-11-26T07:22:54.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.134+0000 7fa053fff640 1 --2- 172.21.15.77:0/3011028628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa03c0039a0 0x7fa03c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.134+0000 7fa0537fe640 1 --2- 172.21.15.77:0/3011028628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03c0047c0 0x7fa03c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.135+0000 7fa053fff640 1 -- 172.21.15.77:0/3011028628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0540b16b0 msgr2=0x7fa03c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.135+0000 7fa053fff640 1 --2- 172.21.15.77:0/3011028628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0540b16b0 0x7fa03c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.135+0000 7fa053fff640 1 -- 172.21.15.77:0/3011028628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03c0047c0 msgr2=0x7fa03c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.135+0000 7fa053fff640 1 --2- 172.21.15.77:0/3011028628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03c0047c0 0x7fa03c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.135+0000 7fa053fff640 1 -- 172.21.15.77:0/3011028628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c003520 con 0x7fa03c0039a0 2023-11-26T07:22:54.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.136+0000 7fa053fff640 1 --2- 172.21.15.77:0/3011028628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa03c0039a0 0x7fa03c003da0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa04c007f60 tx=0x7fa03c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8ccbc318fb0f9f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.137+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c033600 con 0x7fa03c0039a0 2023-11-26T07:22:54.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.137+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c02f050 con 0x7fa03c0039a0 2023-11-26T07:22:54.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.137+0000 7fa052ffd640 1 -- 172.21.15.77:0/3011028628 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c033960 con 0x7fa03c0039a0 2023-11-26T07:22:54.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.138+0000 7fa0596bb640 1 -- 172.21.15.77:0/3011028628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa03c0039a0 msgr2=0x7fa03c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.138+0000 7fa0596bb640 1 --2- 172.21.15.77:0/3011028628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa03c0039a0 0x7fa03c003da0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa04c007f60 tx=0x7fa03c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.138+0000 7fa058eba640 1 -- 172.21.15.77:0/3011028628 reap_dead start 2023-11-26T07:22:54.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.138+0000 7fa0596bb640 1 -- 172.21.15.77:0/3011028628 shutdown_connections 2023-11-26T07:22:54.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.138+0000 7fa0596bb640 1 -- 172.21.15.77:0/3011028628 >> 172.21.15.77:0/3011028628 conn(0x7fa0540b0bc0 msgr2=0x7fa0540b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:54.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.138+0000 7fa0596bb640 1 -- 172.21.15.77:0/3011028628 shutdown_connections 2023-11-26T07:22:54.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.138+0000 7fa0596bb640 1 -- 172.21.15.77:0/3011028628 wait complete. 2023-11-26T07:22:54.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.140+0000 7fa0596bb640 1 Processor -- start 2023-11-26T07:22:54.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.140+0000 7fa0596bb640 1 -- start start 2023-11-26T07:22:54.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.141+0000 7fa0596bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0540af700 0x7fa05413d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.141+0000 7fa0596bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0540afae0 0x7fa0540ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.141+0000 7fa0596bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0541302a0 0x7fa054130720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.141+0000 7fa0596bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05413cc30 con 0x7fa0540afae0 2023-11-26T07:22:54.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.141+0000 7fa0596bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05413bd60 con 0x7fa0541302a0 2023-11-26T07:22:54.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.141+0000 7fa0596bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa054130c60 con 0x7fa0540af700 2023-11-26T07:22:54.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.141+0000 7fa0537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0540afae0 0x7fa0540ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.141+0000 7fa0537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0540afae0 0x7fa0540ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59830/0 (socket says 172.21.15.77:59830) 2023-11-26T07:22:54.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.141+0000 7fa0537fe640 1 -- 172.21.15.77:0/1140625161 learned_addr learned my addr 172.21.15.77:0/1140625161 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:54.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.142+0000 7fa0537fe640 1 -- 172.21.15.77:0/1140625161 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0540af700 msgr2=0x7fa05413d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.142+0000 7fa0537fe640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0540af700 0x7fa05413d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.142+0000 7fa0537fe640 1 -- 172.21.15.77:0/1140625161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0541302a0 msgr2=0x7fa054130720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.142+0000 7fa0537fe640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0541302a0 0x7fa054130720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.142+0000 7fa0537fe640 1 -- 172.21.15.77:0/1140625161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05413bfb0 con 0x7fa0540afae0 2023-11-26T07:22:54.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.142+0000 7fa0537fe640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0540afae0 0x7fa0540ae6a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa04400d5f0 tx=0x7fa04400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.142+0000 7fa050ff9640 1 -- 172.21.15.77:0/1140625161 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440035f0 con 0x7fa0540afae0 2023-11-26T07:22:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.142+0000 7fa050ff9640 1 -- 172.21.15.77:0/1140625161 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044003770 con 0x7fa0540afae0 2023-11-26T07:22:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.142+0000 7fa050ff9640 1 -- 172.21.15.77:0/1140625161 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044003b20 con 0x7fa0540afae0 2023-11-26T07:22:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.142+0000 7fa0596bb640 1 -- 172.21.15.77:0/1140625161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05413c290 con 0x7fa0540afae0 2023-11-26T07:22:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.142+0000 7fa0596bb640 1 -- 172.21.15.77:0/1140625161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05413c850 con 0x7fa0540afae0 2023-11-26T07:22:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.143+0000 7fa0596bb640 1 -- 172.21.15.77:0/1140625161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05413cd70 con 0x7fa0540afae0 2023-11-26T07:22:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.144+0000 7fa050ff9640 1 -- 172.21.15.77:0/1140625161 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fa044003c80 con 0x7fa0540afae0 2023-11-26T07:22:54.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.145+0000 7fa050ff9640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa04006b6b0 0x7fa04006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.145+0000 7fa050ff9640 1 -- 172.21.15.77:0/1140625161 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa0440880b0 con 0x7fa0540afae0 2023-11-26T07:22:54.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.146+0000 7fa053fff640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa04006b6b0 0x7fa04006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.146+0000 7fa053fff640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa04006b6b0 0x7fa04006db70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa04c036000 tx=0x7fa04c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.150+0000 7fa050ff9640 1 -- 172.21.15.77:0/1140625161 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa05413cd70 con 0x7fa0540afae0 2023-11-26T07:22:54.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.340+0000 7fa0596bb640 1 -- 172.21.15.77:0/1140625161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7fa05413cd70 con 0x7fa0540afae0 2023-11-26T07:22:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.347+0000 7fa050ff9640 1 -- 172.21.15.77:0/1140625161 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v20) v1 ==== 115+0+0 (secure 0 0 0) 0x7fa05413cd70 con 0x7fa0540afae0 2023-11-26T07:22:54.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.350+0000 7fa0596bb640 1 -- 172.21.15.77:0/1140625161 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa04006b6b0 msgr2=0x7fa04006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.350+0000 7fa0596bb640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa04006b6b0 0x7fa04006db70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa04c036000 tx=0x7fa04c030000 comp rx=0 tx=0).stop 2023-11-26T07:22:54.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.350+0000 7fa0596bb640 1 -- 172.21.15.77:0/1140625161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0540afae0 msgr2=0x7fa0540ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.350+0000 7fa0596bb640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0540afae0 0x7fa0540ae6a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa04400d5f0 tx=0x7fa04400dab0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.351+0000 7fa0596bb640 1 -- 172.21.15.77:0/1140625161 shutdown_connections 2023-11-26T07:22:54.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.351+0000 7fa0596bb640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa04006b6b0 0x7fa04006db70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.351+0000 7fa0596bb640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0541302a0 0x7fa054130720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.351+0000 7fa0596bb640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0540afae0 0x7fa0540ae6a0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.351+0000 7fa0596bb640 1 --2- 172.21.15.77:0/1140625161 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0540af700 0x7fa05413d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.351+0000 7fa0596bb640 1 -- 172.21.15.77:0/1140625161 >> 172.21.15.77:0/1140625161 conn(0x7fa0540b0bc0 msgr2=0x7fa05406dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.351+0000 7fa0596bb640 1 -- 172.21.15.77:0/1140625161 shutdown_connections 2023-11-26T07:22:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.351+0000 7fa0596bb640 1 -- 172.21.15.77:0/1140625161 wait complete. 2023-11-26T07:22:54.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:22:54.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.581+0000 7fddffc23640 1 Processor -- start 2023-11-26T07:22:54.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.582+0000 7fddffc23640 1 -- start start 2023-11-26T07:22:54.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.583+0000 7fddffc23640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fddf80c59b0 0x7fddf8166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.583+0000 7fddffc23640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf80c5dc0 con 0x7fddf815b440 2023-11-26T07:22:54.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.583+0000 7fddffc23640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf815eea0 con 0x7fddf80cc0f0 2023-11-26T07:22:54.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.583+0000 7fddffc23640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf815b820 con 0x7fddf80c59b0 2023-11-26T07:22:54.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.584+0000 7fddfd9bf640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fddf815b440 0x7fddf80cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44612/0 (socket says 172.21.15.77:44612) 2023-11-26T07:22:54.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.584+0000 7fddfd9bf640 1 -- 172.21.15.77:0/707161136 learned_addr learned my addr 172.21.15.77:0/707161136 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:54.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.584+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019027036 0 0) 0x7fddf80c5dc0 con 0x7fddf815b440 2023-11-26T07:22:54.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.584+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdde4003520 con 0x7fddf815b440 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.584+0000 7fddfe1c0640 1 --2- 172.21.15.77:0/707161136 >> v2:172.21.15.159:3300/0 conn(0x7fddf80c59b0 0x7fddf8166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.584+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3259274747 0 0) 0x7fdde4003520 con 0x7fddf815b440 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.584+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 >> v2:172.21.15.159:3300/0 conn(0x7fddf80c59b0 msgr2=0x7fddf8166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.584+0000 7fddfc9bd640 1 --2- 172.21.15.77:0/707161136 >> v2:172.21.15.159:3300/0 conn(0x7fddf80c59b0 0x7fddf8166230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.584+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 >> v1:172.21.15.159:6789/0 conn(0x7fddf80cc0f0 legacy=0x7fddf80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.584+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf806d600 con 0x7fddf815b440 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.584+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fddf4001670 con 0x7fddf815b440 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 >> v1:172.21.15.77:6789/0 conn(0x7fddf815b440 legacy=0x7fddf80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfc9bd640 1 --2- 172.21.15.77:0/707161136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde4003970 0x7fdde4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfc9bd640 1 --2- 172.21.15.77:0/707161136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde40047c0 0x7fdde4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfc9bd640 1 --2- 172.21.15.77:0/707161136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 0x7fdde400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf815b820 con 0x7fdde40052a0 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde400c150 con 0x7fdde4003970 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde400c310 con 0x7fdde40047c0 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfe1c0640 1 --2- 172.21.15.77:0/707161136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 0x7fdde400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfd9bf640 1 --2- 172.21.15.77:0/707161136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde4003970 0x7fdde4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfe1c0640 1 -- 172.21.15.77:0/707161136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde40047c0 msgr2=0x7fdde4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfe1c0640 1 --2- 172.21.15.77:0/707161136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde40047c0 0x7fdde4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfe1c0640 1 -- 172.21.15.77:0/707161136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde4003970 msgr2=0x7fdde4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfe1c0640 1 --2- 172.21.15.77:0/707161136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde4003970 0x7fdde4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfe1c0640 1 -- 172.21.15.77:0/707161136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde4003520 con 0x7fdde40052a0 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.585+0000 7fddfd9bf640 1 --2- 172.21.15.77:0/707161136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde4003970 0x7fdde4003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.586+0000 7fddfe1c0640 1 -- 172.21.15.77:0/707161136 reap_dead start 2023-11-26T07:22:54.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.586+0000 7fddfe1c0640 1 --2- 172.21.15.77:0/707161136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 0x7fdde400b980 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009fc0 tx=0x7fdde40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38328e669d7c5a12 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.587+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf002ccb0 con 0x7fdde40052a0 2023-11-26T07:22:54.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.587+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf002ce30 con 0x7fdde40052a0 2023-11-26T07:22:54.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.587+0000 7fddfc9bd640 1 -- 172.21.15.77:0/707161136 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0034680 con 0x7fdde40052a0 2023-11-26T07:22:54.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.587+0000 7fddffc23640 1 -- 172.21.15.77:0/707161136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 msgr2=0x7fdde400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.587+0000 7fddffc23640 1 --2- 172.21.15.77:0/707161136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 0x7fdde400b980 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009fc0 tx=0x7fdde40057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.587+0000 7fddffc23640 1 -- 172.21.15.77:0/707161136 shutdown_connections 2023-11-26T07:22:54.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.587+0000 7fddffc23640 1 --2- 172.21.15.77:0/707161136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 0x7fdde400b980 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.587+0000 7fddffc23640 1 -- 172.21.15.77:0/707161136 >> 172.21.15.77:0/707161136 conn(0x7fddf80b0c50 msgr2=0x7fddf80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:54.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.587+0000 7fddffc23640 1 -- 172.21.15.77:0/707161136 shutdown_connections 2023-11-26T07:22:54.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.587+0000 7fddffc23640 1 -- 172.21.15.77:0/707161136 wait complete. 2023-11-26T07:22:54.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.589+0000 7fddffc23640 1 Processor -- start 2023-11-26T07:22:54.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.589+0000 7fddffc23640 1 -- start start 2023-11-26T07:22:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.590+0000 7fddffc23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 0x7fddf8154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.590+0000 7fddffc23640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddf80cd770 0x7fddf80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.590+0000 7fddffc23640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80c3ec0 0x7fddf80c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.590+0000 7fddffc23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c4880 con 0x7fdde40052a0 2023-11-26T07:22:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.590+0000 7fddffc23640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81f3f60 con 0x7fddf80c3ec0 2023-11-26T07:22:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.590+0000 7fddffc23640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80ce1c0 con 0x7fddf80cd770 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.590+0000 7fddfd9bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 0x7fddf8154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.591+0000 7fddfd9bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 0x7fddf8154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59846/0 (socket says 172.21.15.77:59846) 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.591+0000 7fddfd9bf640 1 -- 172.21.15.77:0/929025483 learned_addr learned my addr 172.21.15.77:0/929025483 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.591+0000 7fddfd9bf640 1 -- 172.21.15.77:0/929025483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddf80cd770 msgr2=0x7fddf80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.591+0000 7fddfd9bf640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddf80cd770 0x7fddf80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.591+0000 7fddfd9bf640 1 -- 172.21.15.77:0/929025483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80c3ec0 msgr2=0x7fddf80c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.591+0000 7fddfd9bf640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80c3ec0 0x7fddf80c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.591+0000 7fddfd9bf640 1 -- 172.21.15.77:0/929025483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80ce4a0 con 0x7fdde40052a0 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.591+0000 7fddfd9bf640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 0x7fddf8154150 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fddf40018e0 tx=0x7fddf400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.591+0000 7fddee7fc640 1 -- 172.21.15.77:0/929025483 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40074e0 con 0x7fdde40052a0 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.591+0000 7fddee7fc640 1 -- 172.21.15.77:0/929025483 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4007640 con 0x7fdde40052a0 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.591+0000 7fddffc23640 1 -- 172.21.15.77:0/929025483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf80ce780 con 0x7fdde40052a0 2023-11-26T07:22:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.592+0000 7fddee7fc640 1 -- 172.21.15.77:0/929025483 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4004a00 con 0x7fdde40052a0 2023-11-26T07:22:54.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.592+0000 7fddffc23640 1 -- 172.21.15.77:0/929025483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf80aca40 con 0x7fdde40052a0 2023-11-26T07:22:54.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.593+0000 7fddffc23640 1 -- 172.21.15.77:0/929025483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf804e8b0 con 0x7fdde40052a0 2023-11-26T07:22:54.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.594+0000 7fddee7fc640 1 -- 172.21.15.77:0/929025483 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fddf4004b60 con 0x7fdde40052a0 2023-11-26T07:22:54.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.595+0000 7fddee7fc640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 0x7fdddc06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.595+0000 7fddee7fc640 1 -- 172.21.15.77:0/929025483 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fddf4087b00 con 0x7fdde40052a0 2023-11-26T07:22:54.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.595+0000 7fddfd1be640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 0x7fdddc06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.596+0000 7fddfd1be640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 0x7fdddc06db70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fddf8157020 tx=0x7fdde80079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.599+0000 7fddee7fc640 1 -- 172.21.15.77:0/929025483 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fddf40543b0 con 0x7fdde40052a0 2023-11-26T07:22:54.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.788+0000 7fddffc23640 1 -- 172.21.15.77:0/929025483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fddf806dc80 con 0x7fdde40052a0 2023-11-26T07:22:54.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.795+0000 7fddee7fc640 1 -- 172.21.15.77:0/929025483 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fddf40579d0 con 0x7fdde40052a0 2023-11-26T07:22:54.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 -- 172.21.15.77:0/929025483 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 msgr2=0x7fdddc06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 0x7fdddc06db70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fddf8157020 tx=0x7fdde80079b0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 -- 172.21.15.77:0/929025483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 msgr2=0x7fddf8154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 0x7fddf8154150 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fddf40018e0 tx=0x7fddf400dd20 comp rx=0 tx=0).stop 2023-11-26T07:22:54.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 -- 172.21.15.77:0/929025483 shutdown_connections 2023-11-26T07:22:54.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdddc06b6b0 0x7fdddc06db70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80c3ec0 0x7fddf80c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddf80cd770 0x7fddf80cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 --2- 172.21.15.77:0/929025483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde40052a0 0x7fddf8154150 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 -- 172.21.15.77:0/929025483 >> 172.21.15.77:0/929025483 conn(0x7fddf80b0c50 msgr2=0x7fddf8071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:54.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 -- 172.21.15.77:0/929025483 shutdown_connections 2023-11-26T07:22:54.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:54.798+0000 7fddffc23640 1 -- 172.21.15.77:0/929025483 wait complete. 2023-11-26T07:22:54.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled' 2023-11-26T07:22:55.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.044+0000 7f8f16b43640 1 Processor -- start 2023-11-26T07:22:55.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.045+0000 7f8f16b43640 1 -- start start 2023-11-26T07:22:55.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.046+0000 7f8f16b43640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8f100cd5b0 0x7f8f100b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:55.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.046+0000 7f8f16b43640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f100711e0 con 0x7f8f100abf50 2023-11-26T07:22:55.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.046+0000 7f8f16b43640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f100cdc80 con 0x7f8f1015b5e0 2023-11-26T07:22:55.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.046+0000 7f8f16b43640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f100705d0 con 0x7f8f100cd5b0 2023-11-26T07:22:55.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.047+0000 7f8f07fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8f100cd5b0 0x7f8f100b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:55.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.047+0000 7f8f07fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8f100cd5b0 0x7f8f100b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59848/0 (socket says 172.21.15.77:59848) 2023-11-26T07:22:55.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.047+0000 7f8f07fff640 1 -- 172.21.15.77:0/3928220399 learned_addr learned my addr 172.21.15.77:0/3928220399 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:55.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.047+0000 7f8f07fff640 1 -- 172.21.15.77:0/3928220399 >> v1:172.21.15.159:6789/0 conn(0x7f8f1015b5e0 legacy=0x7f8f100ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:55.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.047+0000 7f8f07fff640 1 -- 172.21.15.77:0/3928220399 >> v1:172.21.15.77:6789/0 conn(0x7f8f100abf50 legacy=0x7f8f10071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.047+0000 7f8f07fff640 1 -- 172.21.15.77:0/3928220399 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f100708b0 con 0x7f8f100cd5b0 2023-11-26T07:22:55.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.048+0000 7f8f07fff640 1 --2- 172.21.15.77:0/3928220399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f100cd5b0 0x7f8f100b3010 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009870 tx=0x7f8f0002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d576b231719370c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:55.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.048+0000 7f8f077fe640 1 -- 172.21.15.77:0/3928220399 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00030860 con 0x7f8f100cd5b0 2023-11-26T07:22:55.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.048+0000 7f8f077fe640 1 -- 172.21.15.77:0/3928220399 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000309c0 con 0x7f8f100cd5b0 2023-11-26T07:22:55.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.048+0000 7f8f077fe640 1 -- 172.21.15.77:0/3928220399 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00030d50 con 0x7f8f100cd5b0 2023-11-26T07:22:55.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.049+0000 7f8f16b43640 1 -- 172.21.15.77:0/3928220399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f100cd5b0 msgr2=0x7f8f100b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.049+0000 7f8f16b43640 1 --2- 172.21.15.77:0/3928220399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f100cd5b0 0x7f8f100b3010 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009870 tx=0x7f8f0002b9a0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.049+0000 7f8f16b43640 1 -- 172.21.15.77:0/3928220399 shutdown_connections 2023-11-26T07:22:55.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.049+0000 7f8f16b43640 1 --2- 172.21.15.77:0/3928220399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f100cd5b0 0x7f8f100b3010 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.049+0000 7f8f16b43640 1 -- 172.21.15.77:0/3928220399 >> 172.21.15.77:0/3928220399 conn(0x7f8f100b0c70 msgr2=0x7f8f100b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:55.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.049+0000 7f8f16b43640 1 -- 172.21.15.77:0/3928220399 shutdown_connections 2023-11-26T07:22:55.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.049+0000 7f8f16b43640 1 -- 172.21.15.77:0/3928220399 wait complete. 2023-11-26T07:22:55.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.051+0000 7f8f16b43640 1 Processor -- start 2023-11-26T07:22:55.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.052+0000 7f8f16b43640 1 -- start start 2023-11-26T07:22:55.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f16b43640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f100abf50 0x7f8f101557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:55.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f16b43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f100cd5b0 0x7f8f10150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:55.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f16b43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f1015b5e0 0x7f8f10151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:55.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f16b43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f101f3130 con 0x7f8f1015b5e0 2023-11-26T07:22:55.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f16b43640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10150380 con 0x7f8f100abf50 2023-11-26T07:22:55.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f16b43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10157a60 con 0x7f8f100cd5b0 2023-11-26T07:22:55.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f150e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f1015b5e0 0x7f8f10151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:55.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f150e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f1015b5e0 0x7f8f10151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59862/0 (socket says 172.21.15.77:59862) 2023-11-26T07:22:55.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f150e0640 1 -- 172.21.15.77:0/4188150877 learned_addr learned my addr 172.21.15.77:0/4188150877 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:55.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f148df640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f100abf50 0x7f8f101557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:55.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f07fff640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f100cd5b0 0x7f8f10150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:55.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f150e0640 1 -- 172.21.15.77:0/4188150877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f100cd5b0 msgr2=0x7f8f10150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f150e0640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f100cd5b0 0x7f8f10150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f150e0640 1 -- 172.21.15.77:0/4188150877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f100abf50 msgr2=0x7f8f101557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f150e0640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f100abf50 0x7f8f101557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.053+0000 7f8f150e0640 1 -- 172.21.15.77:0/4188150877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f000094d0 con 0x7f8f1015b5e0 2023-11-26T07:22:55.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.054+0000 7f8f07fff640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f100cd5b0 0x7f8f10150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.054+0000 7f8f148df640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f100abf50 0x7f8f101557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.054+0000 7f8f150e0640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f1015b5e0 0x7f8f10151380 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800c7a0 tx=0x7f8f0800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.054+0000 7f8f057fa640 1 -- 172.21.15.77:0/4188150877 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08003b70 con 0x7f8f1015b5e0 2023-11-26T07:22:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.054+0000 7f8f057fa640 1 -- 172.21.15.77:0/4188150877 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08003cf0 con 0x7f8f1015b5e0 2023-11-26T07:22:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.054+0000 7f8f057fa640 1 -- 172.21.15.77:0/4188150877 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08003ea0 con 0x7f8f1015b5e0 2023-11-26T07:22:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.054+0000 7f8f16b43640 1 -- 172.21.15.77:0/4188150877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f10157d40 con 0x7f8f1015b5e0 2023-11-26T07:22:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.054+0000 7f8f16b43640 1 -- 172.21.15.77:0/4188150877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f10150920 con 0x7f8f1015b5e0 2023-11-26T07:22:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.056+0000 7f8f16b43640 1 -- 172.21.15.77:0/4188150877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1004e8b0 con 0x7f8f1015b5e0 2023-11-26T07:22:55.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.056+0000 7f8f057fa640 1 -- 172.21.15.77:0/4188150877 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f8f0800aa90 con 0x7f8f1015b5e0 2023-11-26T07:22:55.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.057+0000 7f8f057fa640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8efc06b6e0 0x7f8efc06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:55.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.058+0000 7f8f057fa640 1 -- 172.21.15.77:0/4188150877 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8f08087e50 con 0x7f8f1015b5e0 2023-11-26T07:22:55.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.058+0000 7f8f148df640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8efc06b6e0 0x7f8efc06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:55.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.058+0000 7f8f148df640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8efc06b6e0 0x7f8efc06dba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00a830 tx=0x7f8f0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:55.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.062+0000 7f8f057fa640 1 -- 172.21.15.77:0/4188150877 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f080547e0 con 0x7f8f1015b5e0 2023-11-26T07:22:55.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.321+0000 7f8f16b43640 1 -- 172.21.15.77:0/4188150877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]} v 0) v1 -- 0x7f8f100cc9e0 con 0x7f8f1015b5e0 2023-11-26T07:22:55.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.923+0000 7f8f057fa640 1 -- 172.21.15.77:0/4188150877 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]}]=0 v278) v1 ==== 176+0+0 (secure 0 0 0) 0x7f8f08057e00 con 0x7f8f1015b5e0 2023-11-26T07:22:55.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.928+0000 7f8f16b43640 1 -- 172.21.15.77:0/4188150877 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8efc06b6e0 msgr2=0x7f8efc06dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.928+0000 7f8f16b43640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8efc06b6e0 0x7f8efc06dba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00a830 tx=0x7f8f0c008040 comp rx=0 tx=0).stop 2023-11-26T07:22:55.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.928+0000 7f8f16b43640 1 -- 172.21.15.77:0/4188150877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f1015b5e0 msgr2=0x7f8f10151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.928+0000 7f8f16b43640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f1015b5e0 0x7f8f10151380 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800c7a0 tx=0x7f8f0800cc60 comp rx=0 tx=0).stop 2023-11-26T07:22:55.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.928+0000 7f8f16b43640 1 -- 172.21.15.77:0/4188150877 shutdown_connections 2023-11-26T07:22:55.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.928+0000 7f8f16b43640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8efc06b6e0 0x7f8efc06dba0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.928+0000 7f8f16b43640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f1015b5e0 0x7f8f10151380 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.928+0000 7f8f16b43640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f100cd5b0 0x7f8f10150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.928+0000 7f8f16b43640 1 --2- 172.21.15.77:0/4188150877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f100abf50 0x7f8f101557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.928+0000 7f8f16b43640 1 -- 172.21.15.77:0/4188150877 >> 172.21.15.77:0/4188150877 conn(0x7f8f100b0c70 msgr2=0x7f8f100afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:55.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.929+0000 7f8f16b43640 1 -- 172.21.15.77:0/4188150877 shutdown_connections 2023-11-26T07:22:55.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:55.929+0000 7f8f16b43640 1 -- 172.21.15.77:0/4188150877 wait complete. 2023-11-26T07:22:55.953 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during pending state and validate the reason ... ok 2023-11-26T07:22:55.953 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is not shown when clone is not in failed/cancelled state 2023-11-26T07:22:55.953 INFO:tasks.cephfs_test_runner:test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:22:55.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.169+0000 7f0b059c9640 1 Processor -- start 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.169+0000 7f0b059c9640 1 -- start start 2023-11-26T07:22:56.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.170+0000 7f0b059c9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0b000b2250 0x7f0b0015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.170+0000 7f0b059c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b000b2630 0x7f0b000ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.170+0000 7f0b059c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0b000cd470 0x7f0b0015b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.170+0000 7f0b059c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0015a990 con 0x7f0b000cd470 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.170+0000 7f0b059c9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0015ab80 con 0x7f0b000b2250 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.170+0000 7f0b059c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0015e680 con 0x7f0b000b2630 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.171+0000 7f0aff7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0b000cd470 0x7f0b0015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.171+0000 7f0aff7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0b000cd470 0x7f0b0015b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42236/0 (socket says 172.21.15.77:42236) 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.171+0000 7f0aff7fe640 1 -- 172.21.15.77:0/3485710511 learned_addr learned my addr 172.21.15.77:0/3485710511 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.171+0000 7f0afe7fc640 1 --2- 172.21.15.77:0/3485710511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b000b2630 0x7f0b000ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.171+0000 7f0afeffd640 1 --2- 172.21.15.77:0/3485710511 >> v2:172.21.15.159:3300/0 conn(0x7f0b000b2250 0x7f0b0015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.171+0000 7f0aff7fe640 1 -- 172.21.15.77:0/3485710511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b000b2630 msgr2=0x7f0b000ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.171+0000 7f0aff7fe640 1 --2- 172.21.15.77:0/3485710511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b000b2630 0x7f0b000ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.171+0000 7f0aff7fe640 1 -- 172.21.15.77:0/3485710511 >> v2:172.21.15.159:3300/0 conn(0x7f0b000b2250 msgr2=0x7f0b0015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:56.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.171+0000 7f0aff7fe640 1 --2- 172.21.15.77:0/3485710511 >> v2:172.21.15.159:3300/0 conn(0x7f0b000b2250 0x7f0b0015df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.171+0000 7f0aff7fe640 1 -- 172.21.15.77:0/3485710511 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0015e960 con 0x7f0b000cd470 2023-11-26T07:22:56.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.173+0000 7f0aff7fe640 1 --2- 172.21.15.77:0/3485710511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b000cd470 0x7f0b0015b080 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0b00072a70 tx=0x7f0af802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9a6ec60b572c7a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:56.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.173+0000 7f0afdffb640 1 -- 172.21.15.77:0/3485710511 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af802ee90 con 0x7f0b000cd470 2023-11-26T07:22:56.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.173+0000 7f0afdffb640 1 -- 172.21.15.77:0/3485710511 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af8036440 con 0x7f0b000cd470 2023-11-26T07:22:56.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.173+0000 7f0afdffb640 1 -- 172.21.15.77:0/3485710511 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af80367d0 con 0x7f0b000cd470 2023-11-26T07:22:56.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.173+0000 7f0b059c9640 1 -- 172.21.15.77:0/3485710511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b000cd470 msgr2=0x7f0b0015b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.173+0000 7f0b059c9640 1 --2- 172.21.15.77:0/3485710511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b000cd470 0x7f0b0015b080 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0b00072a70 tx=0x7f0af802e0e0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.174+0000 7f0b059c9640 1 -- 172.21.15.77:0/3485710511 shutdown_connections 2023-11-26T07:22:56.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.174+0000 7f0b059c9640 1 --2- 172.21.15.77:0/3485710511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b000cd470 0x7f0b0015b080 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.174+0000 7f0b059c9640 1 --2- 172.21.15.77:0/3485710511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b000b2630 0x7f0b000ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.174+0000 7f0b059c9640 1 --2- 172.21.15.77:0/3485710511 >> v2:172.21.15.159:3300/0 conn(0x7f0b000b2250 0x7f0b0015df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.174+0000 7f0b059c9640 1 -- 172.21.15.77:0/3485710511 >> 172.21.15.77:0/3485710511 conn(0x7f0b0006a920 msgr2=0x7f0b0006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:56.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.174+0000 7f0b059c9640 1 -- 172.21.15.77:0/3485710511 shutdown_connections 2023-11-26T07:22:56.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.174+0000 7f0b059c9640 1 -- 172.21.15.77:0/3485710511 wait complete. 2023-11-26T07:22:56.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.175+0000 7f0b059c9640 1 Processor -- start 2023-11-26T07:22:56.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.176+0000 7f0b059c9640 1 -- start start 2023-11-26T07:22:56.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0b059c9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000b2250 0x7f0b001f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0b059c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b000b2630 0x7f0b000accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0b059c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b000cd470 0x7f0b0014d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0b059c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000c8e00 con 0x7f0b000cd470 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0b059c9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001f79e0 con 0x7f0b000b2250 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0b059c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000c9030 con 0x7f0b000b2630 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b000cd470 0x7f0b0014d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b000cd470 0x7f0b0014d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42238/0 (socket says 172.21.15.77:42238) 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0aff7fe640 1 -- 172.21.15.77:0/1022101182 learned_addr learned my addr 172.21.15.77:0/1022101182 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0aff7fe640 1 -- 172.21.15.77:0/1022101182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b000b2630 msgr2=0x7f0b000accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0aff7fe640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b000b2630 0x7f0b000accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0aff7fe640 1 -- 172.21.15.77:0/1022101182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000b2250 msgr2=0x7f0b001f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0aff7fe640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000b2250 0x7f0b001f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.177+0000 7f0aff7fe640 1 -- 172.21.15.77:0/1022101182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af800b770 con 0x7f0b000cd470 2023-11-26T07:22:56.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.178+0000 7f0aff7fe640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b000cd470 0x7f0b0014d2b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0af802e120 tx=0x7f0af80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:56.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.178+0000 7f0af7fff640 1 -- 172.21.15.77:0/1022101182 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af80347d0 con 0x7f0b000cd470 2023-11-26T07:22:56.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.178+0000 7f0af7fff640 1 -- 172.21.15.77:0/1022101182 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af8034950 con 0x7f0b000cd470 2023-11-26T07:22:56.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.178+0000 7f0af7fff640 1 -- 172.21.15.77:0/1022101182 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8034d00 con 0x7f0b000cd470 2023-11-26T07:22:56.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.178+0000 7f0b059c9640 1 -- 172.21.15.77:0/1022101182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b000c9310 con 0x7f0b000cd470 2023-11-26T07:22:56.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.178+0000 7f0b059c9640 1 -- 172.21.15.77:0/1022101182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b000c98d0 con 0x7f0b000cd470 2023-11-26T07:22:56.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.179+0000 7f0b059c9640 1 -- 172.21.15.77:0/1022101182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b00067470 con 0x7f0b000cd470 2023-11-26T07:22:56.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.180+0000 7f0af7fff640 1 -- 172.21.15.77:0/1022101182 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f0af80403e0 con 0x7f0b000cd470 2023-11-26T07:22:56.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.181+0000 7f0af7fff640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ae006b6b0 0x7f0ae006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.181+0000 7f0af7fff640 1 -- 172.21.15.77:0/1022101182 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0af80ac380 con 0x7f0b000cd470 2023-11-26T07:22:56.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.181+0000 7f0afeffd640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ae006b6b0 0x7f0ae006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.182+0000 7f0afeffd640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ae006b6b0 0x7f0ae006db70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009540 tx=0x7f0af0009450 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.186+0000 7f0af7fff640 1 -- 172.21.15.77:0/1022101182 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0af8076b90 con 0x7f0b000cd470 2023-11-26T07:22:56.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.373+0000 7f0b059c9640 1 -- 172.21.15.77:0/1022101182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b000cea00 con 0x7f0b000cd470 2023-11-26T07:22:56.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.375+0000 7f0af7fff640 1 -- 172.21.15.77:0/1022101182 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+12962 (secure 0 0 0) 0x7f0af8034e60 con 0x7f0b000cd470 2023-11-26T07:22:56.377 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:22:56.377 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":67,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:22:53.894713+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6836/3771669807":"2023-11-27T07:22:50.692527+0000","172.21.15.77:6834/3771669807":"2023-11-27T07:22:50.692527+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:22:56.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.377+0000 7f0b059c9640 1 -- 172.21.15.77:0/1022101182 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ae006b6b0 msgr2=0x7f0ae006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.377+0000 7f0b059c9640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ae006b6b0 0x7f0ae006db70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009540 tx=0x7f0af0009450 comp rx=0 tx=0).stop 2023-11-26T07:22:56.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.377+0000 7f0b059c9640 1 -- 172.21.15.77:0/1022101182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b000cd470 msgr2=0x7f0b0014d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.377+0000 7f0b059c9640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b000cd470 0x7f0b0014d2b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0af802e120 tx=0x7f0af80046c0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.377+0000 7f0b059c9640 1 -- 172.21.15.77:0/1022101182 shutdown_connections 2023-11-26T07:22:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.377+0000 7f0b059c9640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ae006b6b0 0x7f0ae006db70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.377+0000 7f0b059c9640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b000cd470 0x7f0b0014d2b0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.378+0000 7f0b059c9640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b000b2630 0x7f0b000accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.378+0000 7f0b059c9640 1 --2- 172.21.15.77:0/1022101182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000b2250 0x7f0b001f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.378+0000 7f0b059c9640 1 -- 172.21.15.77:0/1022101182 >> 172.21.15.77:0/1022101182 conn(0x7f0b0006a920 msgr2=0x7f0b000ac2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.378+0000 7f0b059c9640 1 -- 172.21.15.77:0/1022101182 shutdown_connections 2023-11-26T07:22:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.378+0000 7f0b059c9640 1 -- 172.21.15.77:0/1022101182 wait complete. 2023-11-26T07:22:56.397 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:22:56.397 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:22:56.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.598+0000 7f343df9e640 1 Processor -- start 2023-11-26T07:22:56.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.598+0000 7f343df9e640 1 -- start start 2023-11-26T07:22:56.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.600+0000 7f343df9e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34381660b0 0x7f3438162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.600+0000 7f343df9e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3438162540 0x7f34380c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.600+0000 7f343df9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3438166510 con 0x7f34380ccbd0 2023-11-26T07:22:56.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.600+0000 7f343df9e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34381655f0 con 0x7f34381660b0 2023-11-26T07:22:56.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.600+0000 7f343df9e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34380cc380 con 0x7f3438162540 2023-11-26T07:22:56.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.600+0000 7f342ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34381660b0 0x7f3438162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.600+0000 7f342ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34381660b0 0x7f3438162000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42250/0 (socket says 172.21.15.77:42250) 2023-11-26T07:22:56.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.600+0000 7f342ffff640 1 -- 172.21.15.77:0/3676582804 learned_addr learned my addr 172.21.15.77:0/3676582804 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:56.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.601+0000 7f3437fff640 1 --2- 172.21.15.77:0/3676582804 >> v2:172.21.15.159:3300/0 conn(0x7f3438162540 0x7f34380c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.601+0000 7f342ffff640 1 -- 172.21.15.77:0/3676582804 >> v2:172.21.15.159:3300/0 conn(0x7f3438162540 msgr2=0x7f34380c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:56.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.601+0000 7f342ffff640 1 --2- 172.21.15.77:0/3676582804 >> v2:172.21.15.159:3300/0 conn(0x7f3438162540 0x7f34380c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.601+0000 7f342ffff640 1 -- 172.21.15.77:0/3676582804 >> v1:172.21.15.77:6789/0 conn(0x7f34380ccbd0 legacy=0x7f34380ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.601+0000 7f342ffff640 1 -- 172.21.15.77:0/3676582804 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3438162b30 con 0x7f34381660b0 2023-11-26T07:22:56.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.602+0000 7f342ffff640 1 --2- 172.21.15.77:0/3676582804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34381660b0 0x7f3438162000 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f34380ae430 tx=0x7f342002b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d1f33736292cab server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:56.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.602+0000 7f3436ffd640 1 -- 172.21.15.77:0/3676582804 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420030880 con 0x7f34381660b0 2023-11-26T07:22:56.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.602+0000 7f3436ffd640 1 -- 172.21.15.77:0/3676582804 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34200309e0 con 0x7f34381660b0 2023-11-26T07:22:56.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.602+0000 7f3436ffd640 1 -- 172.21.15.77:0/3676582804 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420030d70 con 0x7f34381660b0 2023-11-26T07:22:56.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.603+0000 7f343df9e640 1 -- 172.21.15.77:0/3676582804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34381660b0 msgr2=0x7f3438162000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.603+0000 7f343df9e640 1 --2- 172.21.15.77:0/3676582804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34381660b0 0x7f3438162000 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f34380ae430 tx=0x7f342002b9c0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.603+0000 7f343df9e640 1 -- 172.21.15.77:0/3676582804 shutdown_connections 2023-11-26T07:22:56.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.603+0000 7f343df9e640 1 --2- 172.21.15.77:0/3676582804 >> v2:172.21.15.159:3300/0 conn(0x7f3438162540 0x7f34380c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.603+0000 7f343df9e640 1 --2- 172.21.15.77:0/3676582804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34381660b0 0x7f3438162000 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.603+0000 7f343df9e640 1 -- 172.21.15.77:0/3676582804 >> 172.21.15.77:0/3676582804 conn(0x7f34380b0c50 msgr2=0x7f34380b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:56.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.603+0000 7f343df9e640 1 -- 172.21.15.77:0/3676582804 shutdown_connections 2023-11-26T07:22:56.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.603+0000 7f343df9e640 1 -- 172.21.15.77:0/3676582804 wait complete. 2023-11-26T07:22:56.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.605+0000 7f343df9e640 1 Processor -- start 2023-11-26T07:22:56.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.605+0000 7f343df9e640 1 -- start start 2023-11-26T07:22:56.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.606+0000 7f343df9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34380ccbd0 0x7f343815b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.606+0000 7f343df9e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3438162540 0x7f34381609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.606+0000 7f343df9e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34381660b0 0x7f3438160f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.606+0000 7f343df9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3438071bb0 con 0x7f34380ccbd0 2023-11-26T07:22:56.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.606+0000 7f343df9e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34380abf30 con 0x7f3438162540 2023-11-26T07:22:56.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.606+0000 7f343df9e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343815be50 con 0x7f34381660b0 2023-11-26T07:22:56.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.606+0000 7f34377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34380ccbd0 0x7f343815b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.606+0000 7f34377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34380ccbd0 0x7f343815b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42260/0 (socket says 172.21.15.77:42260) 2023-11-26T07:22:56.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.606+0000 7f34377fe640 1 -- 172.21.15.77:0/2417797799 learned_addr learned my addr 172.21.15.77:0/2417797799 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:56.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.607+0000 7f34377fe640 1 -- 172.21.15.77:0/2417797799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34381660b0 msgr2=0x7f3438160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.607+0000 7f34377fe640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34381660b0 0x7f3438160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.607+0000 7f34377fe640 1 -- 172.21.15.77:0/2417797799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3438162540 msgr2=0x7f34381609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.607+0000 7f34377fe640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3438162540 0x7f34381609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.607+0000 7f34377fe640 1 -- 172.21.15.77:0/2417797799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34200094d0 con 0x7f34380ccbd0 2023-11-26T07:22:56.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.607+0000 7f34377fe640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34380ccbd0 0x7f343815b910 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f342800c450 tx=0x7f342800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:56.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.607+0000 7f3434ff9640 1 -- 172.21.15.77:0/2417797799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280052d0 con 0x7f34380ccbd0 2023-11-26T07:22:56.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.607+0000 7f3434ff9640 1 -- 172.21.15.77:0/2417797799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3428005430 con 0x7f34380ccbd0 2023-11-26T07:22:56.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.607+0000 7f3434ff9640 1 -- 172.21.15.77:0/2417797799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428012870 con 0x7f34380ccbd0 2023-11-26T07:22:56.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.607+0000 7f343df9e640 1 -- 172.21.15.77:0/2417797799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343815aa50 con 0x7f34380ccbd0 2023-11-26T07:22:56.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.607+0000 7f343df9e640 1 -- 172.21.15.77:0/2417797799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343815b010 con 0x7f34380ccbd0 2023-11-26T07:22:56.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.609+0000 7f343df9e640 1 -- 172.21.15.77:0/2417797799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343815c200 con 0x7f34380ccbd0 2023-11-26T07:22:56.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.610+0000 7f3434ff9640 1 -- 172.21.15.77:0/2417797799 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f34280129d0 con 0x7f34380ccbd0 2023-11-26T07:22:56.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.610+0000 7f3434ff9640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f341806b6b0 0x7f341806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.611+0000 7f3434ff9640 1 -- 172.21.15.77:0/2417797799 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3428087a50 con 0x7f34380ccbd0 2023-11-26T07:22:56.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.611+0000 7f342ffff640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f341806b6b0 0x7f341806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.611+0000 7f342ffff640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f341806b6b0 0x7f341806db70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3420036000 tx=0x7f3420030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:56.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.615+0000 7f3434ff9640 1 -- 172.21.15.77:0/2417797799 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3428054380 con 0x7f34380ccbd0 2023-11-26T07:22:56.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.805+0000 7f343df9e640 1 -- 172.21.15.77:0/2417797799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3438166510 con 0x7f34380ccbd0 2023-11-26T07:22:56.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.806+0000 7f3434ff9640 1 -- 172.21.15.77:0/2417797799 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3438166510 con 0x7f34380ccbd0 2023-11-26T07:22:56.808 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:22:56.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.809+0000 7f343df9e640 1 -- 172.21.15.77:0/2417797799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f341806b6b0 msgr2=0x7f341806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.809+0000 7f343df9e640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f341806b6b0 0x7f341806db70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3420036000 tx=0x7f3420030000 comp rx=0 tx=0).stop 2023-11-26T07:22:56.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.809+0000 7f343df9e640 1 -- 172.21.15.77:0/2417797799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34380ccbd0 msgr2=0x7f343815b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.809+0000 7f343df9e640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34380ccbd0 0x7f343815b910 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f342800c450 tx=0x7f342800c910 comp rx=0 tx=0).stop 2023-11-26T07:22:56.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.809+0000 7f343df9e640 1 -- 172.21.15.77:0/2417797799 shutdown_connections 2023-11-26T07:22:56.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.809+0000 7f343df9e640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f341806b6b0 0x7f341806db70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.809+0000 7f343df9e640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34381660b0 0x7f3438160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.809+0000 7f343df9e640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3438162540 0x7f34381609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.809+0000 7f343df9e640 1 --2- 172.21.15.77:0/2417797799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34380ccbd0 0x7f343815b910 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.809+0000 7f343df9e640 1 -- 172.21.15.77:0/2417797799 >> 172.21.15.77:0/2417797799 conn(0x7f34380b0c50 msgr2=0x7f343806c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:56.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.809+0000 7f343df9e640 1 -- 172.21.15.77:0/2417797799 shutdown_connections 2023-11-26T07:22:56.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:56.810+0000 7f343df9e640 1 -- 172.21.15.77:0/2417797799 wait complete. 2023-11-26T07:22:56.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete' 2023-11-26T07:22:57.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.028+0000 7f60662c2640 1 Processor -- start 2023-11-26T07:22:57.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.029+0000 7f60662c2640 1 -- start start 2023-11-26T07:22:57.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.030+0000 7f60662c2640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f60600cd5b0 0x7f60600b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.030+0000 7f60662c2640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60600abf50 0x7f60600b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.030+0000 7f60662c2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60600711e0 con 0x7f606015b5e0 2023-11-26T07:22:57.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.030+0000 7f60662c2640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60600b4540 con 0x7f60600cd5b0 2023-11-26T07:22:57.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.030+0000 7f60662c2640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60600cdc80 con 0x7f60600abf50 2023-11-26T07:22:57.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.030+0000 7f605ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f606015b5e0 0x7f60600ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49760/0 (socket says 172.21.15.77:49760) 2023-11-26T07:22:57.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.030+0000 7f605ffff640 1 -- 172.21.15.77:0/3670571466 learned_addr learned my addr 172.21.15.77:0/3670571466 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:57.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.031+0000 7f605f7fe640 1 --2- 172.21.15.77:0/3670571466 >> v2:172.21.15.159:3300/0 conn(0x7f60600cd5b0 0x7f60600b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.031+0000 7f606485f640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60600abf50 0x7f60600b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.031+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954543383 0 0) 0x7f60600711e0 con 0x7f606015b5e0 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.031+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f604c003520 con 0x7f606015b5e0 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.031+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3768807399 0 0) 0x7f604c003520 con 0x7f606015b5e0 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.031+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60600abf50 msgr2=0x7f60600b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.031+0000 7f605effd640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60600abf50 0x7f60600b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.031+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 >> v2:172.21.15.159:3300/0 conn(0x7f60600cd5b0 msgr2=0x7f60600b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.031+0000 7f605effd640 1 --2- 172.21.15.77:0/3670571466 >> v2:172.21.15.159:3300/0 conn(0x7f60600cd5b0 0x7f60600b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.031+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600705d0 con 0x7f606015b5e0 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.032+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f60500019f0 con 0x7f606015b5e0 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.032+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 >> v1:172.21.15.77:6789/0 conn(0x7f606015b5e0 legacy=0x7f60600ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.032+0000 7f605effd640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f604c003970 0x7f604c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.032+0000 7f605effd640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604c0047c0 0x7f604c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.032+0000 7f605effd640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60600abf50 0x7f604c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.032+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60600cdc80 con 0x7f604c0047c0 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.032+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c00b980 con 0x7f604c003970 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.032+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604c00bac0 con 0x7f60600abf50 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.032+0000 7f605f7fe640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604c0047c0 0x7f604c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.032+0000 7f605ffff640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f604c003970 0x7f604c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.032+0000 7f606485f640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60600abf50 0x7f604c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.033+0000 7f605f7fe640 1 -- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60600abf50 msgr2=0x7f604c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.033+0000 7f605f7fe640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60600abf50 0x7f604c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.033+0000 7f605f7fe640 1 -- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f604c003970 msgr2=0x7f604c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.033+0000 7f605f7fe640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f604c003970 0x7f604c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.033+0000 7f605f7fe640 1 -- 172.21.15.77:0/3670571466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c003520 con 0x7f604c0047c0 2023-11-26T07:22:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.033+0000 7f606485f640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60600abf50 0x7f604c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.034+0000 7f605f7fe640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604c0047c0 0x7f604c004c40 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f6048009ac0 tx=0x7f604c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bccc904b411c3be server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.035+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604802c6d0 con 0x7f604c0047c0 2023-11-26T07:22:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.035+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604802c830 con 0x7f604c0047c0 2023-11-26T07:22:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.035+0000 7f605effd640 1 -- 172.21.15.77:0/3670571466 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604802cbc0 con 0x7f604c0047c0 2023-11-26T07:22:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.035+0000 7f60662c2640 1 -- 172.21.15.77:0/3670571466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604c0047c0 msgr2=0x7f604c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.035+0000 7f60662c2640 1 --2- 172.21.15.77:0/3670571466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604c0047c0 0x7f604c004c40 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f6048009ac0 tx=0x7f604c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.035+0000 7f606485f640 1 -- 172.21.15.77:0/3670571466 reap_dead start 2023-11-26T07:22:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.035+0000 7f60662c2640 1 -- 172.21.15.77:0/3670571466 shutdown_connections 2023-11-26T07:22:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.035+0000 7f60662c2640 1 -- 172.21.15.77:0/3670571466 >> 172.21.15.77:0/3670571466 conn(0x7f60600b0c70 msgr2=0x7f60600b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.035+0000 7f60662c2640 1 -- 172.21.15.77:0/3670571466 shutdown_connections 2023-11-26T07:22:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.035+0000 7f60662c2640 1 -- 172.21.15.77:0/3670571466 wait complete. 2023-11-26T07:22:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.038+0000 7f60662c2640 1 Processor -- start 2023-11-26T07:22:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.038+0000 7f60662c2640 1 -- start start 2023-11-26T07:22:57.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.039+0000 7f60662c2640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f604c0047c0 0x7f606009a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.039+0000 7f60662c2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60601f8880 0x7f60601f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.039+0000 7f60662c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606009b630 0x7f606009bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.039+0000 7f60662c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606006e490 con 0x7f606009b630 2023-11-26T07:22:57.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.039+0000 7f60662c2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6060154d40 con 0x7f60601f8880 2023-11-26T07:22:57.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.039+0000 7f60662c2640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606009b1a0 con 0x7f604c0047c0 2023-11-26T07:22:57.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.039+0000 7f606485f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606009b630 0x7f606009bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.039+0000 7f606485f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606009b630 0x7f606009bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42286/0 (socket says 172.21.15.77:42286) 2023-11-26T07:22:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.039+0000 7f606485f640 1 -- 172.21.15.77:0/2495339232 learned_addr learned my addr 172.21.15.77:0/2495339232 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f605ffff640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f604c0047c0 0x7f606009a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f605f7fe640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60601f8880 0x7f60601f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f606485f640 1 -- 172.21.15.77:0/2495339232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f604c0047c0 msgr2=0x7f606009a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f606485f640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f604c0047c0 0x7f606009a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f606485f640 1 -- 172.21.15.77:0/2495339232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60601f8880 msgr2=0x7f60601f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f606485f640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60601f8880 0x7f60601f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f606485f640 1 -- 172.21.15.77:0/2495339232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606006d1a0 con 0x7f606009b630 2023-11-26T07:22:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f605f7fe640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60601f8880 0x7f60601f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:57.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f606485f640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606009b630 0x7f606009bab0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f60600aea30 tx=0x7f6058010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:57.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f605cff9640 1 -- 172.21.15.77:0/2495339232 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605800e8d0 con 0x7f606009b630 2023-11-26T07:22:57.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f605cff9640 1 -- 172.21.15.77:0/2495339232 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605800ea50 con 0x7f606009b630 2023-11-26T07:22:57.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.040+0000 7f60662c2640 1 -- 172.21.15.77:0/2495339232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606006d480 con 0x7f606009b630 2023-11-26T07:22:57.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.041+0000 7f605cff9640 1 -- 172.21.15.77:0/2495339232 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605800ee00 con 0x7f606009b630 2023-11-26T07:22:57.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.041+0000 7f60662c2640 1 -- 172.21.15.77:0/2495339232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606009ae30 con 0x7f606009b630 2023-11-26T07:22:57.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.042+0000 7f60662c2640 1 -- 172.21.15.77:0/2495339232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606009b310 con 0x7f606009b630 2023-11-26T07:22:57.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.043+0000 7f605cff9640 1 -- 172.21.15.77:0/2495339232 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f6058020410 con 0x7f606009b630 2023-11-26T07:22:57.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.043+0000 7f605cff9640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604006b6e0 0x7f604006dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.044+0000 7f605cff9640 1 -- 172.21.15.77:0/2495339232 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6058087820 con 0x7f606009b630 2023-11-26T07:22:57.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.044+0000 7f605ffff640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604006b6e0 0x7f604006dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.044+0000 7f605ffff640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604006b6e0 0x7f604006dba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6050001330 tx=0x7f6050009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:57.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.048+0000 7f605cff9640 1 -- 172.21.15.77:0/2495339232 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6058054260 con 0x7f606009b630 2023-11-26T07:22:57.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.305+0000 7f60662c2640 1 -- 172.21.15.77:0/2495339232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]} v 0) v1 -- 0x7f606004e8b0 con 0x7f606009b630 2023-11-26T07:22:57.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.929+0000 7f605cff9640 1 -- 172.21.15.77:0/2495339232 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]}]=0 v280) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6058057880 con 0x7f606009b630 2023-11-26T07:22:57.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.932+0000 7f60662c2640 1 -- 172.21.15.77:0/2495339232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604006b6e0 msgr2=0x7f604006dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.932+0000 7f60662c2640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604006b6e0 0x7f604006dba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6050001330 tx=0x7f6050009040 comp rx=0 tx=0).stop 2023-11-26T07:22:57.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.932+0000 7f60662c2640 1 -- 172.21.15.77:0/2495339232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606009b630 msgr2=0x7f606009bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.932+0000 7f60662c2640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606009b630 0x7f606009bab0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f60600aea30 tx=0x7f6058010c20 comp rx=0 tx=0).stop 2023-11-26T07:22:57.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.932+0000 7f60662c2640 1 -- 172.21.15.77:0/2495339232 shutdown_connections 2023-11-26T07:22:57.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.932+0000 7f60662c2640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604006b6e0 0x7f604006dba0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.932+0000 7f60662c2640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606009b630 0x7f606009bab0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.932+0000 7f60662c2640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60601f8880 0x7f60601f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.932+0000 7f60662c2640 1 --2- 172.21.15.77:0/2495339232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f604c0047c0 0x7f606009a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.932+0000 7f60662c2640 1 -- 172.21.15.77:0/2495339232 >> 172.21.15.77:0/2495339232 conn(0x7f60600b0c70 msgr2=0x7f60600734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:57.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.933+0000 7f60662c2640 1 -- 172.21.15.77:0/2495339232 shutdown_connections 2023-11-26T07:22:57.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:57.933+0000 7f60662c2640 1 -- 172.21.15.77:0/2495339232 wait complete. 2023-11-26T07:22:57.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:22:58.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:22:58.008 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:22:58.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.161+0000 7fb06adce640 1 Processor -- start 2023-11-26T07:22:58.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.161+0000 7fb06adce640 1 -- start start 2023-11-26T07:22:58.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.163+0000 7fb06adce640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb064072160 0x7fb06415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.163+0000 7fb06adce640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06415ec90 con 0x7fb0640c49f0 2023-11-26T07:22:58.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.163+0000 7fb06adce640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0640cd530 con 0x7fb06406de10 2023-11-26T07:22:58.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.163+0000 7fb06adce640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640c4ed0 con 0x7fb064072160 2023-11-26T07:22:58.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.163+0000 7fb063fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb0640c49f0 0x7fb06406d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49762/0 (socket says 172.21.15.77:49762) 2023-11-26T07:22:58.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.163+0000 7fb063fff640 1 -- 172.21.15.77:0/2494494058 learned_addr learned my addr 172.21.15.77:0/2494494058 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.163+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210964200 0 0) 0x7fb054001110 con 0x7fb0640c49f0 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.163+0000 7fb068b6a640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb064072160 0x7fb06415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.163+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb04c003520 con 0x7fb0640c49f0 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3585152368 0 0) 0x7fb04c003520 con 0x7fb0640c49f0 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb064072160 msgr2=0x7fb06415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb064072160 0x7fb06415e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 >> v1:172.21.15.159:6789/0 conn(0x7fb06406de10 legacy=0x7fb0640705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0640c51b0 con 0x7fb0640c49f0 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fb054001800 con 0x7fb0640c49f0 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 >> v1:172.21.15.77:6789/0 conn(0x7fb0640c49f0 legacy=0x7fb06406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04c0039a0 0x7fb04c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb064072160 0x7fb04c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb04c004d00 0x7fb04c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640c4ed0 con 0x7fb04c0039a0 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c00bb10 con 0x7fb04c004d00 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c00bca0 con 0x7fb064072160 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb068b6a640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04c0039a0 0x7fb04c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.164+0000 7fb06936b640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb04c004d00 0x7fb04c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.165+0000 7fb063fff640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb064072160 0x7fb04c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.165+0000 7fb068b6a640 1 -- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb064072160 msgr2=0x7fb04c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.165+0000 7fb068b6a640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb064072160 0x7fb04c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.165+0000 7fb068b6a640 1 -- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb04c004d00 msgr2=0x7fb04c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.165+0000 7fb068b6a640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb04c004d00 0x7fb04c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.165+0000 7fb068b6a640 1 -- 172.21.15.77:0/2494494058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c003520 con 0x7fb04c0039a0 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.165+0000 7fb063fff640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb064072160 0x7fb04c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.165+0000 7fb06936b640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb04c004d00 0x7fb04c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.166+0000 7fb068b6a640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04c0039a0 0x7fb04c003dc0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fb05800ba60 tx=0x7fb04c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc89ec4b93cc008e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.166+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058032630 con 0x7fb04c0039a0 2023-11-26T07:22:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.166+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058032790 con 0x7fb04c0039a0 2023-11-26T07:22:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.166+0000 7fb0637fe640 1 -- 172.21.15.77:0/2494494058 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058032b20 con 0x7fb04c0039a0 2023-11-26T07:22:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.167+0000 7fb06adce640 1 -- 172.21.15.77:0/2494494058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04c0039a0 msgr2=0x7fb04c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.167+0000 7fb06adce640 1 --2- 172.21.15.77:0/2494494058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04c0039a0 0x7fb04c003dc0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fb05800ba60 tx=0x7fb04c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.167+0000 7fb06936b640 1 -- 172.21.15.77:0/2494494058 reap_dead start 2023-11-26T07:22:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.167+0000 7fb06adce640 1 -- 172.21.15.77:0/2494494058 shutdown_connections 2023-11-26T07:22:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.167+0000 7fb06adce640 1 -- 172.21.15.77:0/2494494058 >> 172.21.15.77:0/2494494058 conn(0x7fb0640b0c50 msgr2=0x7fb0640b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.167+0000 7fb06adce640 1 -- 172.21.15.77:0/2494494058 shutdown_connections 2023-11-26T07:22:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.167+0000 7fb06adce640 1 -- 172.21.15.77:0/2494494058 wait complete. 2023-11-26T07:22:58.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.169+0000 7fb06adce640 1 Processor -- start 2023-11-26T07:22:58.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.169+0000 7fb06adce640 1 -- start start 2023-11-26T07:22:58.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06adce640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb04c0039a0 0x7fb064154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06adce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0640ae220 0x7fb064158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06adce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb064158780 0x7fb0640c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06adce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640c8280 con 0x7fb064158780 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06adce640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640ad7d0 con 0x7fb0640ae220 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06adce640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640add90 con 0x7fb04c0039a0 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06936b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb064158780 0x7fb0640c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06936b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb064158780 0x7fb0640c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42304/0 (socket says 172.21.15.77:42304) 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06936b640 1 -- 172.21.15.77:0/2355848327 learned_addr learned my addr 172.21.15.77:0/2355848327 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb063fff640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0640ae220 0x7fb064158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb068b6a640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb04c0039a0 0x7fb064154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06936b640 1 -- 172.21.15.77:0/2355848327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb04c0039a0 msgr2=0x7fb064154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06936b640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb04c0039a0 0x7fb064154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06936b640 1 -- 172.21.15.77:0/2355848327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0640ae220 msgr2=0x7fb064158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06936b640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0640ae220 0x7fb064158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.170+0000 7fb06936b640 1 -- 172.21.15.77:0/2355848327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0640c6de0 con 0x7fb064158780 2023-11-26T07:22:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.171+0000 7fb06936b640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb064158780 0x7fb0640c8780 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fb06406ead0 tx=0x7fb05c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.171+0000 7fb0617fa640 1 -- 172.21.15.77:0/2355848327 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00eed0 con 0x7fb064158780 2023-11-26T07:22:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.171+0000 7fb0617fa640 1 -- 172.21.15.77:0/2355848327 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c006b50 con 0x7fb064158780 2023-11-26T07:22:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.171+0000 7fb06adce640 1 -- 172.21.15.77:0/2355848327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0640c70c0 con 0x7fb064158780 2023-11-26T07:22:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.171+0000 7fb0617fa640 1 -- 172.21.15.77:0/2355848327 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c003970 con 0x7fb064158780 2023-11-26T07:22:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.171+0000 7fb06adce640 1 -- 172.21.15.77:0/2355848327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0640c6a70 con 0x7fb064158780 2023-11-26T07:22:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.172+0000 7fb06adce640 1 -- 172.21.15.77:0/2355848327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0640adf20 con 0x7fb064158780 2023-11-26T07:22:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.173+0000 7fb0617fa640 1 -- 172.21.15.77:0/2355848327 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fb05c003ad0 con 0x7fb064158780 2023-11-26T07:22:58.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.174+0000 7fb0617fa640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb05006b6b0 0x7fb05006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.174+0000 7fb0617fa640 1 -- 172.21.15.77:0/2355848327 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb05c087980 con 0x7fb064158780 2023-11-26T07:22:58.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.174+0000 7fb068b6a640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb05006b6b0 0x7fb05006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.175+0000 7fb068b6a640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb05006b6b0 0x7fb05006db70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb05800ba30 tx=0x7fb05803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.178+0000 7fb0617fa640 1 -- 172.21.15.77:0/2355848327 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb05c0542b0 con 0x7fb064158780 2023-11-26T07:22:58.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.371+0000 7fb06adce640 1 -- 172.21.15.77:0/2355848327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb06404e8b0 con 0x7fb064158780 2023-11-26T07:22:58.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.379+0000 7fb0617fa640 1 -- 172.21.15.77:0/2355848327 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb05c0578d0 con 0x7fb064158780 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 -- 172.21.15.77:0/2355848327 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb05006b6b0 msgr2=0x7fb05006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb05006b6b0 0x7fb05006db70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb05800ba30 tx=0x7fb05803d040 comp rx=0 tx=0).stop 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 -- 172.21.15.77:0/2355848327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb064158780 msgr2=0x7fb0640c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb064158780 0x7fb0640c8780 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fb06406ead0 tx=0x7fb05c00eb90 comp rx=0 tx=0).stop 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 -- 172.21.15.77:0/2355848327 shutdown_connections 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb05006b6b0 0x7fb05006db70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb064158780 0x7fb0640c8780 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0640ae220 0x7fb064158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 --2- 172.21.15.77:0/2355848327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb04c0039a0 0x7fb064154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 -- 172.21.15.77:0/2355848327 >> 172.21.15.77:0/2355848327 conn(0x7fb0640b0c50 msgr2=0x7fb064071330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 -- 172.21.15.77:0/2355848327 shutdown_connections 2023-11-26T07:22:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:58.382+0000 7fb06adce640 1 -- 172.21.15.77:0/2355848327 wait complete. 2023-11-26T07:22:58.402 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:22:58.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:22:58.515 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:22:58.648 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:22:58.648 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:58.648 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:58.708 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:22:58.708 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:22:58.708 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:58.769 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:22:58.769 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:22:58.769 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:58.828 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:22:58.828 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:22:58.828 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:58.889 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:22:58.889 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:22:58.889 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:22:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.112+0000 7f41805be640 1 Processor -- start 2023-11-26T07:22:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.112+0000 7f41805be640 1 -- start start 2023-11-26T07:22:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.114+0000 7f41805be640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f417815c7f0 0x7f417806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.114+0000 7f41805be640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41780cece0 con 0x7f41780cf450 2023-11-26T07:22:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.114+0000 7f41805be640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417806d040 con 0x7f41780ce6c0 2023-11-26T07:22:59.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.114+0000 7f41805be640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4178156010 con 0x7f417815c7f0 2023-11-26T07:22:59.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.114+0000 7f417db59640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f41780cf450 0x7f41780cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49770/0 (socket says 172.21.15.77:49770) 2023-11-26T07:22:59.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.114+0000 7f417db59640 1 -- 172.21.15.77:0/953234517 learned_addr learned my addr 172.21.15.77:0/953234517 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417e35a640 1 --2- 172.21.15.77:0/953234517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f417815c7f0 0x7f417806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375758138 0 0) 0x7f41780cece0 con 0x7f41780cf450 2023-11-26T07:22:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4164003520 con 0x7f41780cf450 2023-11-26T07:22:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 913055242 0 0) 0x7f4164003520 con 0x7f41780cf450 2023-11-26T07:22:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f417815c7f0 msgr2=0x7f417806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 --2- 172.21.15.77:0/953234517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f417815c7f0 0x7f417806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 >> v1:172.21.15.159:6789/0 conn(0x7f41780ce6c0 legacy=0x7f41780714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417806d320 con 0x7f41780cf450 2023-11-26T07:22:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f4168001670 con 0x7f41780cf450 2023-11-26T07:22:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 >> v1:172.21.15.77:6789/0 conn(0x7f41780cf450 legacy=0x7f41780cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 --2- 172.21.15.77:0/953234517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41640039a0 0x7f4164003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 --2- 172.21.15.77:0/953234517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f417815c7f0 0x7f41640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 --2- 172.21.15.77:0/953234517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4164004d00 0x7f4164005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4178156010 con 0x7f41640039a0 2023-11-26T07:22:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416400ba30 con 0x7f4164004d00 2023-11-26T07:22:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416400bbf0 con 0x7f417815c7f0 2023-11-26T07:22:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.115+0000 7f417e35a640 1 --2- 172.21.15.77:0/953234517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41640039a0 0x7f4164003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.116+0000 7f417e35a640 1 -- 172.21.15.77:0/953234517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f417815c7f0 msgr2=0x7f41640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.116+0000 7f417e35a640 1 --2- 172.21.15.77:0/953234517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f417815c7f0 0x7f41640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.116+0000 7f417e35a640 1 -- 172.21.15.77:0/953234517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4164004d00 msgr2=0x7f4164005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.116+0000 7f417e35a640 1 --2- 172.21.15.77:0/953234517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4164004d00 0x7f4164005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.116+0000 7f417e35a640 1 -- 172.21.15.77:0/953234517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4164003520 con 0x7f41640039a0 2023-11-26T07:22:59.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.117+0000 7f417e35a640 1 --2- 172.21.15.77:0/953234517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41640039a0 0x7f4164003dc0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f4174009a90 tx=0x7f41640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d0d0709106909f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:59.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.117+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417402c6b0 con 0x7f41640039a0 2023-11-26T07:22:59.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.117+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417402c810 con 0x7f41640039a0 2023-11-26T07:22:59.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.117+0000 7f417d358640 1 -- 172.21.15.77:0/953234517 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417402cba0 con 0x7f41640039a0 2023-11-26T07:22:59.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.118+0000 7f41805be640 1 -- 172.21.15.77:0/953234517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41640039a0 msgr2=0x7f4164003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.118+0000 7f41805be640 1 --2- 172.21.15.77:0/953234517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41640039a0 0x7f4164003dc0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f4174009a90 tx=0x7f41640057f0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.118+0000 7f417eb5b640 1 -- 172.21.15.77:0/953234517 reap_dead start 2023-11-26T07:22:59.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.118+0000 7f41805be640 1 -- 172.21.15.77:0/953234517 shutdown_connections 2023-11-26T07:22:59.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.118+0000 7f41805be640 1 -- 172.21.15.77:0/953234517 >> 172.21.15.77:0/953234517 conn(0x7f417806a920 msgr2=0x7f417806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:59.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.118+0000 7f41805be640 1 -- 172.21.15.77:0/953234517 shutdown_connections 2023-11-26T07:22:59.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.118+0000 7f41805be640 1 -- 172.21.15.77:0/953234517 wait complete. 2023-11-26T07:22:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.120+0000 7f41805be640 1 Processor -- start 2023-11-26T07:22:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.120+0000 7f41805be640 1 -- start start 2023-11-26T07:22:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.121+0000 7f41805be640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41640039a0 0x7f41781f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.121+0000 7f41805be640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4178156b10 0x7f4178156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.121+0000 7f41805be640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41780b08b0 0x7f41780b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.121+0000 7f41805be640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780b1270 con 0x7f41780b08b0 2023-11-26T07:22:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.121+0000 7f41805be640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41781f6a10 con 0x7f4178156b10 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.121+0000 7f41805be640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41781575b0 con 0x7f41640039a0 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.121+0000 7f417eb5b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41780b08b0 0x7f41780b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.121+0000 7f417eb5b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41780b08b0 0x7f41780b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42314/0 (socket says 172.21.15.77:42314) 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.121+0000 7f417eb5b640 1 -- 172.21.15.77:0/648624623 learned_addr learned my addr 172.21.15.77:0/648624623 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.121+0000 7f417e35a640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41640039a0 0x7f41781f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.121+0000 7f417db59640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4178156b10 0x7f4178156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f417eb5b640 1 -- 172.21.15.77:0/648624623 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41640039a0 msgr2=0x7f41781f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f417eb5b640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41640039a0 0x7f41781f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f417eb5b640 1 -- 172.21.15.77:0/648624623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4178156b10 msgr2=0x7f4178156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f417eb5b640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4178156b10 0x7f4178156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f417eb5b640 1 -- 172.21.15.77:0/648624623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178157890 con 0x7f41780b08b0 2023-11-26T07:22:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f417e35a640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41640039a0 0x7f41781f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f417eb5b640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41780b08b0 0x7f41780b0d30 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f41780d0040 tx=0x7f417000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f416effd640 1 -- 172.21.15.77:0/648624623 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170005d40 con 0x7f41780b08b0 2023-11-26T07:22:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f416effd640 1 -- 172.21.15.77:0/648624623 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417000ced0 con 0x7f41780b08b0 2023-11-26T07:22:59.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f41805be640 1 -- 172.21.15.77:0/648624623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4178157b70 con 0x7f41780b08b0 2023-11-26T07:22:59.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f416effd640 1 -- 172.21.15.77:0/648624623 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417000a850 con 0x7f41780b08b0 2023-11-26T07:22:59.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.122+0000 7f41805be640 1 -- 172.21.15.77:0/648624623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4178158130 con 0x7f41780b08b0 2023-11-26T07:22:59.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.123+0000 7f41805be640 1 -- 172.21.15.77:0/648624623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417806eed0 con 0x7f41780b08b0 2023-11-26T07:22:59.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.125+0000 7f416effd640 1 -- 172.21.15.77:0/648624623 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f417000a9b0 con 0x7f41780b08b0 2023-11-26T07:22:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.126+0000 7f416effd640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415c06b6e0 0x7f415c06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.126+0000 7f416effd640 1 -- 172.21.15.77:0/648624623 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f41700874c0 con 0x7f41780b08b0 2023-11-26T07:22:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.126+0000 7f417e35a640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415c06b6e0 0x7f415c06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:59.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.127+0000 7f417e35a640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415c06b6e0 0x7f415c06dba0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4174036000 tx=0x7f4174030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:59.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.130+0000 7f416effd640 1 -- 172.21.15.77:0/648624623 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4170053df0 con 0x7f41780b08b0 2023-11-26T07:22:59.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.360+0000 7f41805be640 1 -- 172.21.15.77:0/648624623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4178067470 con 0x7f41780b08b0 2023-11-26T07:22:59.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.362+0000 7f416effd640 1 -- 172.21.15.77:0/648624623 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f4170017020 con 0x7f41780b08b0 2023-11-26T07:22:59.364 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:22:59.364 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1822281363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1822281363},{"type":"v1","addr":"172.21.15.159:6834","nonce":1822281363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":4901,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2261329569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2261329569},{"type":"v1","addr":"172.21.15.159:6835","nonce":2261329569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3602997657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3602997657},{"type":"v1","addr":"172.21.15.77:6837","nonce":3602997657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6645,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3547410875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3547410875},{"type":"v1","addr":"172.21.15.77:6836","nonce":3547410875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[]} 2023-11-26T07:22:59.365 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 38 2023-11-26T07:22:59.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.364+0000 7f41805be640 1 -- 172.21.15.77:0/648624623 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415c06b6e0 msgr2=0x7f415c06dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.364+0000 7f41805be640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415c06b6e0 0x7f415c06dba0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4174036000 tx=0x7f4174030000 comp rx=0 tx=0).stop 2023-11-26T07:22:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.364+0000 7f41805be640 1 -- 172.21.15.77:0/648624623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41780b08b0 msgr2=0x7f41780b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.364+0000 7f41805be640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41780b08b0 0x7f41780b0d30 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f41780d0040 tx=0x7f417000cb90 comp rx=0 tx=0).stop 2023-11-26T07:22:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.364+0000 7f41805be640 1 -- 172.21.15.77:0/648624623 shutdown_connections 2023-11-26T07:22:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.365+0000 7f41805be640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f415c06b6e0 0x7f415c06dba0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.365+0000 7f41805be640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41780b08b0 0x7f41780b0d30 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.365+0000 7f41805be640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4178156b10 0x7f4178156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.365+0000 7f41805be640 1 --2- 172.21.15.77:0/648624623 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41640039a0 0x7f41781f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.365+0000 7f41805be640 1 -- 172.21.15.77:0/648624623 >> 172.21.15.77:0/648624623 conn(0x7f417806a920 msgr2=0x7f417806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.365+0000 7f41805be640 1 -- 172.21.15.77:0/648624623 shutdown_connections 2023-11-26T07:22:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.365+0000 7f41805be640 1 -- 172.21.15.77:0/648624623 wait complete. 2023-11-26T07:22:59.386 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:22:59.386 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:22:59.386 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:22:59.386 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:22:59.387 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:22:59.387 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:22:59.387 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:22:59.387 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:22:59.387 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:22:59.387 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:22:59.387 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:22:59.388 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:22:59.388 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:22:59.388 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:22:59.388 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:22:59.388 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:22:59.403 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:22:59.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:22:59.408 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:22:59.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:22:59.409 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:22:59.409 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:22:59.410 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:22:59.410 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:22:59.456 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:22:59.457 DEBUG:teuthology.parallel:result is None 2023-11-26T07:22:59.458 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:22:59.458 DEBUG:teuthology.parallel:result is None 2023-11-26T07:22:59.464 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:22:59.464 DEBUG:teuthology.parallel:result is None 2023-11-26T07:22:59.465 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:22:59.465 DEBUG:teuthology.parallel:result is None 2023-11-26T07:22:59.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:22:59.614 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-26T07:22:59.619 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-26T07:22:59.623 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-11-26T07:22:59.623 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-11-26T07:22:59.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.656+0000 7f2eaec1c640 1 Processor -- start 2023-11-26T07:22:59.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.656+0000 7f2eaec1c640 1 -- start start 2023-11-26T07:22:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.657+0000 7f2eaec1c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2ea80c59b0 0x7f2ea8166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.657+0000 7f2eaec1c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea80c5dc0 con 0x7f2ea80cc0f0 2023-11-26T07:22:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.657+0000 7f2eaec1c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea815eea0 con 0x7f2ea815b440 2023-11-26T07:22:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.657+0000 7f2eaec1c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea815b820 con 0x7f2ea80c59b0 2023-11-26T07:22:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.658+0000 7f2ea7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2ea80cc0f0 0x7f2ea80c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49790/0 (socket says 172.21.15.77:49790) 2023-11-26T07:22:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.658+0000 7f2ea7fff640 1 -- 172.21.15.77:0/777646939 learned_addr learned my addr 172.21.15.77:0/777646939 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:22:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.658+0000 7f2ead1b9640 1 --2- 172.21.15.77:0/777646939 >> v2:172.21.15.77:3300/0 conn(0x7f2ea80c59b0 0x7f2ea8166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.658+0000 7f2ead1b9640 1 -- 172.21.15.77:0/777646939 >> v1:172.21.15.159:6789/0 conn(0x7f2ea815b440 legacy=0x7f2ea80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.658+0000 7f2ea77fe640 1 -- 172.21.15.77:0/777646939 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709098336 0 0) 0x7f2ea80c5dc0 con 0x7f2ea80cc0f0 2023-11-26T07:22:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.658+0000 7f2ead1b9640 1 -- 172.21.15.77:0/777646939 >> v1:172.21.15.77:6789/0 conn(0x7f2ea80cc0f0 legacy=0x7f2ea80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.658+0000 7f2ead1b9640 1 -- 172.21.15.77:0/777646939 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea806d600 con 0x7f2ea80c59b0 2023-11-26T07:22:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.659+0000 7f2ead1b9640 1 --2- 172.21.15.77:0/777646939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ea80c59b0 0x7f2ea8166230 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009d90 tx=0x7f2ea002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc52471c8a5fed0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.660+0000 7f2ea77fe640 1 -- 172.21.15.77:0/777646939 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea002cbd0 con 0x7f2ea80c59b0 2023-11-26T07:22:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.660+0000 7f2ea77fe640 1 -- 172.21.15.77:0/777646939 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea002cd30 con 0x7f2ea80c59b0 2023-11-26T07:22:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.660+0000 7f2ea77fe640 1 -- 172.21.15.77:0/777646939 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea002cea0 con 0x7f2ea80c59b0 2023-11-26T07:22:59.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.660+0000 7f2eaec1c640 1 -- 172.21.15.77:0/777646939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ea80c59b0 msgr2=0x7f2ea8166230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.660+0000 7f2eaec1c640 1 --2- 172.21.15.77:0/777646939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ea80c59b0 0x7f2ea8166230 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009d90 tx=0x7f2ea002be20 comp rx=0 tx=0).stop 2023-11-26T07:22:59.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.660+0000 7f2eaec1c640 1 -- 172.21.15.77:0/777646939 shutdown_connections 2023-11-26T07:22:59.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.660+0000 7f2eaec1c640 1 --2- 172.21.15.77:0/777646939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ea80c59b0 0x7f2ea8166230 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.660+0000 7f2eaec1c640 1 -- 172.21.15.77:0/777646939 >> 172.21.15.77:0/777646939 conn(0x7f2ea80b0c50 msgr2=0x7f2ea80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:59.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.661+0000 7f2eaec1c640 1 -- 172.21.15.77:0/777646939 shutdown_connections 2023-11-26T07:22:59.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.661+0000 7f2eaec1c640 1 -- 172.21.15.77:0/777646939 wait complete. 2023-11-26T07:22:59.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.662+0000 7f2eaec1c640 1 Processor -- start 2023-11-26T07:22:59.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.662+0000 7f2eaec1c640 1 -- start start 2023-11-26T07:22:59.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.663+0000 7f2eaec1c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ea80c59b0 0x7f2ea81565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.663+0000 7f2eaec1c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ea80cc0f0 0x7f2ea80ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.663+0000 7f2eaec1c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ea815b440 0x7f2ea8153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.663+0000 7f2eaec1c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea80ad8c0 con 0x7f2ea80c59b0 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.663+0000 7f2eaec1c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea8158a30 con 0x7f2ea815b440 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.663+0000 7f2eaec1c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea8158cf0 con 0x7f2ea80cc0f0 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.663+0000 7f2eac9b8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ea80c59b0 0x7f2ea81565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.664+0000 7f2eac9b8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ea80c59b0 0x7f2ea81565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42340/0 (socket says 172.21.15.77:42340) 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.664+0000 7f2eac9b8640 1 -- 172.21.15.77:0/2831675903 learned_addr learned my addr 172.21.15.77:0/2831675903 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.664+0000 7f2ea7fff640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ea80cc0f0 0x7f2ea80ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.664+0000 7f2ead1b9640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ea815b440 0x7f2ea8153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.664+0000 7f2eac9b8640 1 -- 172.21.15.77:0/2831675903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ea80cc0f0 msgr2=0x7f2ea80ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.664+0000 7f2eac9b8640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ea80cc0f0 0x7f2ea80ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.664+0000 7f2eac9b8640 1 -- 172.21.15.77:0/2831675903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ea815b440 msgr2=0x7f2ea8153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.664+0000 7f2eac9b8640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ea815b440 0x7f2ea8153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.664+0000 7f2eac9b8640 1 -- 172.21.15.77:0/2831675903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0009a70 con 0x7f2ea80c59b0 2023-11-26T07:22:59.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.664+0000 7f2eac9b8640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ea80c59b0 0x7f2ea81565e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00b3f0 tx=0x7f2e9c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:59.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.664+0000 7f2ea57fa640 1 -- 172.21.15.77:0/2831675903 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c011830 con 0x7f2ea80c59b0 2023-11-26T07:22:59.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.665+0000 7f2ea57fa640 1 -- 172.21.15.77:0/2831675903 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c011990 con 0x7f2ea80c59b0 2023-11-26T07:22:59.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.665+0000 7f2ea57fa640 1 -- 172.21.15.77:0/2831675903 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c011d40 con 0x7f2ea80c59b0 2023-11-26T07:22:59.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.665+0000 7f2eaec1c640 1 -- 172.21.15.77:0/2831675903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea8158fd0 con 0x7f2ea80c59b0 2023-11-26T07:22:59.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.665+0000 7f2eaec1c640 1 -- 172.21.15.77:0/2831675903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea8159b80 con 0x7f2ea80c59b0 2023-11-26T07:22:59.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.666+0000 7f2eaec1c640 1 -- 172.21.15.77:0/2831675903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea804e8b0 con 0x7f2ea80c59b0 2023-11-26T07:22:59.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.667+0000 7f2ea57fa640 1 -- 172.21.15.77:0/2831675903 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f2e9c01a400 con 0x7f2ea80c59b0 2023-11-26T07:22:59.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.668+0000 7f2ea57fa640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e8c06b6b0 0x7f2e8c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:59.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.668+0000 7f2ea57fa640 1 -- 172.21.15.77:0/2831675903 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2e9c087cf0 con 0x7f2ea80c59b0 2023-11-26T07:22:59.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.668+0000 7f2ea7fff640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e8c06b6b0 0x7f2e8c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:59.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.669+0000 7f2ea7fff640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e8c06b6b0 0x7f2e8c06db70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2ea806d550 tx=0x7f2e94007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:59.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.672+0000 7f2ea57fa640 1 -- 172.21.15.77:0/2831675903 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e9c054730 con 0x7f2ea80c59b0 2023-11-26T07:22:59.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.875+0000 7f2eaec1c640 1 -- 172.21.15.77:0/2831675903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2ea806dc80 con 0x7f2ea80c59b0 2023-11-26T07:22:59.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.954+0000 7f2ea57fa640 1 -- 172.21.15.77:0/2831675903 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2e9c057d50 con 0x7f2ea80c59b0 2023-11-26T07:22:59.956 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2023-11-26T07:22:59.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.958+0000 7f2eaec1c640 1 -- 172.21.15.77:0/2831675903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e8c06b6b0 msgr2=0x7f2e8c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.958+0000 7f2eaec1c640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e8c06b6b0 0x7f2e8c06db70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2ea806d550 tx=0x7f2e94007d50 comp rx=0 tx=0).stop 2023-11-26T07:22:59.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.958+0000 7f2eaec1c640 1 -- 172.21.15.77:0/2831675903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ea80c59b0 msgr2=0x7f2ea81565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.958+0000 7f2eaec1c640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ea80c59b0 0x7f2ea81565e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00b3f0 tx=0x7f2e9c00b8b0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.958+0000 7f2eaec1c640 1 -- 172.21.15.77:0/2831675903 shutdown_connections 2023-11-26T07:22:59.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.958+0000 7f2eaec1c640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2e8c06b6b0 0x7f2e8c06db70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.958+0000 7f2eaec1c640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ea815b440 0x7f2ea8153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.958+0000 7f2eaec1c640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ea80cc0f0 0x7f2ea80ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.958+0000 7f2eaec1c640 1 --2- 172.21.15.77:0/2831675903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ea80c59b0 0x7f2ea81565e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.959+0000 7f2eaec1c640 1 -- 172.21.15.77:0/2831675903 >> 172.21.15.77:0/2831675903 conn(0x7f2ea80b0c50 msgr2=0x7f2ea80cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:59.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.959+0000 7f2eaec1c640 1 -- 172.21.15.77:0/2831675903 shutdown_connections 2023-11-26T07:22:59.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:22:59.959+0000 7f2eaec1c640 1 -- 172.21.15.77:0/2831675903 wait complete. 2023-11-26T07:22:59.985 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:23:00.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.181+0000 7f2a65e9b640 1 Processor -- start 2023-11-26T07:23:00.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.181+0000 7f2a65e9b640 1 -- start start 2023-11-26T07:23:00.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.183+0000 7f2a65e9b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2a600cd5b0 0x7f2a600b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.183+0000 7f2a65e9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2a600abf50 0x7f2a600b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.183+0000 7f2a65e9b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a600711e0 con 0x7f2a6015b5e0 2023-11-26T07:23:00.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.183+0000 7f2a65e9b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a600b4540 con 0x7f2a600abf50 2023-11-26T07:23:00.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.183+0000 7f2a65e9b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a600cdc80 con 0x7f2a600cd5b0 2023-11-26T07:23:00.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.183+0000 7f2a5ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2a600abf50 0x7f2a600b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.183+0000 7f2a5ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2a600abf50 0x7f2a600b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42348/0 (socket says 172.21.15.77:42348) 2023-11-26T07:23:00.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.183+0000 7f2a5ffff640 1 -- 172.21.15.77:0/3046788438 learned_addr learned my addr 172.21.15.77:0/3046788438 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:00.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.184+0000 7f2a57fff640 1 --2- 172.21.15.77:0/3046788438 >> v2:172.21.15.159:3300/0 conn(0x7f2a600cd5b0 0x7f2a600b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.184+0000 7f2a5ffff640 1 -- 172.21.15.77:0/3046788438 >> v2:172.21.15.159:3300/0 conn(0x7f2a600cd5b0 msgr2=0x7f2a600b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:00.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.184+0000 7f2a5ffff640 1 --2- 172.21.15.77:0/3046788438 >> v2:172.21.15.159:3300/0 conn(0x7f2a600cd5b0 0x7f2a600b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.184+0000 7f2a5ffff640 1 -- 172.21.15.77:0/3046788438 >> v1:172.21.15.159:6789/0 conn(0x7f2a6015b5e0 legacy=0x7f2a600ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:00.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.184+0000 7f2a5ffff640 1 -- 172.21.15.77:0/3046788438 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a600705d0 con 0x7f2a600abf50 2023-11-26T07:23:00.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.185+0000 7f2a5ffff640 1 --2- 172.21.15.77:0/3046788438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a600abf50 0x7f2a600b4000 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2a6006f8d0 tx=0x7f2a5802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846040b804f33084 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.185+0000 7f2a5effd640 1 -- 172.21.15.77:0/3046788438 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5802ca80 con 0x7f2a600abf50 2023-11-26T07:23:00.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.185+0000 7f2a5effd640 1 -- 172.21.15.77:0/3046788438 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5802cbe0 con 0x7f2a600abf50 2023-11-26T07:23:00.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.185+0000 7f2a5effd640 1 -- 172.21.15.77:0/3046788438 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580343f0 con 0x7f2a600abf50 2023-11-26T07:23:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.186+0000 7f2a65e9b640 1 -- 172.21.15.77:0/3046788438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a600abf50 msgr2=0x7f2a600b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.186+0000 7f2a65e9b640 1 --2- 172.21.15.77:0/3046788438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a600abf50 0x7f2a600b4000 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2a6006f8d0 tx=0x7f2a5802bee0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.186+0000 7f2a65e9b640 1 -- 172.21.15.77:0/3046788438 shutdown_connections 2023-11-26T07:23:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.186+0000 7f2a65e9b640 1 --2- 172.21.15.77:0/3046788438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a600abf50 0x7f2a600b4000 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.186+0000 7f2a65e9b640 1 --2- 172.21.15.77:0/3046788438 >> v2:172.21.15.159:3300/0 conn(0x7f2a600cd5b0 0x7f2a600b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.186+0000 7f2a65e9b640 1 -- 172.21.15.77:0/3046788438 >> 172.21.15.77:0/3046788438 conn(0x7f2a600b0c70 msgr2=0x7f2a600b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.186+0000 7f2a65e9b640 1 -- 172.21.15.77:0/3046788438 shutdown_connections 2023-11-26T07:23:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.186+0000 7f2a65e9b640 1 -- 172.21.15.77:0/3046788438 wait complete. 2023-11-26T07:23:00.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.188+0000 7f2a65e9b640 1 Processor -- start 2023-11-26T07:23:00.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.188+0000 7f2a65e9b640 1 -- start start 2023-11-26T07:23:00.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.189+0000 7f2a65e9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a600abf50 0x7f2a601f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.189+0000 7f2a65e9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a600cd5b0 0x7f2a6014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.189+0000 7f2a65e9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a6015b5e0 0x7f2a60159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.189+0000 7f2a65e9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a601587d0 con 0x7f2a600cd5b0 2023-11-26T07:23:00.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.189+0000 7f2a65e9b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6014ddd0 con 0x7f2a6015b5e0 2023-11-26T07:23:00.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.189+0000 7f2a65e9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6014e0b0 con 0x7f2a600abf50 2023-11-26T07:23:00.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.189+0000 7f2a57fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a600cd5b0 0x7f2a6014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.189+0000 7f2a57fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a600cd5b0 0x7f2a6014c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42358/0 (socket says 172.21.15.77:42358) 2023-11-26T07:23:00.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.189+0000 7f2a57fff640 1 -- 172.21.15.77:0/2192606977 learned_addr learned my addr 172.21.15.77:0/2192606977 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.190+0000 7f2a57fff640 1 -- 172.21.15.77:0/2192606977 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a600abf50 msgr2=0x7f2a601f3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.190+0000 7f2a57fff640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a600abf50 0x7f2a601f3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.190+0000 7f2a57fff640 1 -- 172.21.15.77:0/2192606977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a6015b5e0 msgr2=0x7f2a60159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.190+0000 7f2a57fff640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a6015b5e0 0x7f2a60159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.190+0000 7f2a57fff640 1 -- 172.21.15.77:0/2192606977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58009b30 con 0x7f2a600cd5b0 2023-11-26T07:23:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.190+0000 7f2a57fff640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a600cd5b0 0x7f2a6014c250 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800d800 tx=0x7f2a4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.190+0000 7f2a5cff9640 1 -- 172.21.15.77:0/2192606977 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800b6c0 con 0x7f2a600cd5b0 2023-11-26T07:23:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.190+0000 7f2a5cff9640 1 -- 172.21.15.77:0/2192606977 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4800b820 con 0x7f2a600cd5b0 2023-11-26T07:23:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.190+0000 7f2a5cff9640 1 -- 172.21.15.77:0/2192606977 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800bbb0 con 0x7f2a600cd5b0 2023-11-26T07:23:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.190+0000 7f2a65e9b640 1 -- 172.21.15.77:0/2192606977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6014e390 con 0x7f2a600cd5b0 2023-11-26T07:23:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.190+0000 7f2a65e9b640 1 -- 172.21.15.77:0/2192606977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6014e950 con 0x7f2a600cd5b0 2023-11-26T07:23:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.191+0000 7f2a65e9b640 1 -- 172.21.15.77:0/2192606977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6014eb10 con 0x7f2a600cd5b0 2023-11-26T07:23:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.192+0000 7f2a5cff9640 1 -- 172.21.15.77:0/2192606977 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f2a4800bd10 con 0x7f2a600cd5b0 2023-11-26T07:23:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.193+0000 7f2a5cff9640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2a4006b6b0 0x7f2a4006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.194+0000 7f2a5cff9640 1 -- 172.21.15.77:0/2192606977 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2a48088630 con 0x7f2a600cd5b0 2023-11-26T07:23:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.194+0000 7f2a5f7fe640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2a4006b6b0 0x7f2a4006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.194+0000 7f2a5f7fe640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2a4006b6b0 0x7f2a4006db70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2a50006fd0 tx=0x7f2a50006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.198+0000 7f2a5cff9640 1 -- 172.21.15.77:0/2192606977 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a48054f60 con 0x7f2a600cd5b0 2023-11-26T07:23:00.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.455+0000 7f2a65e9b640 1 -- 172.21.15.77:0/2192606977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2a60071650 con 0x7f2a600cd5b0 2023-11-26T07:23:00.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.456+0000 7f2a5cff9640 1 -- 172.21.15.77:0/2192606977 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2a60071650 con 0x7f2a600cd5b0 2023-11-26T07:23:00.458 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:23:00.458 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJls/H7KhAAJS2XRN0c7/K+7oskAg2PWQ==", 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJljSp5DRAAOH30kXLDMsVQpQomhskVow==", 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJlejOkOBAAdCCERoTPpw8Fk1PciaPtag==", 2023-11-26T07:23:00.460 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJl5HpoHhAAaW2/GvlUZsizM1A5Gd3U7A==", 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:23:00.461 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:23:00.462 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:23:00.462 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.462 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.462 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2023-11-26T07:23:00.462 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDS8GJlaI6nFxAARyjS0s1azVjAfqdNZIT4BA==", 2023-11-26T07:23:00.462 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.462 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:00.462 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:23:00.462 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDV8GJl+YY9IhAAPh7GuZ2EhEZBybZJJL16gA==", 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.463 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDY8GJlWjPxOhAApethgteKlUOMhor55mJc9A==", 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDc8GJl9OCqFxAAJeYH2CcWuQG8iILjc/PmTw==", 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDj8GJlVXaWGxAAfxXHfo561p+2qKX1+9C7+A==", 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDm8GJlrAsENhAALSWl4bAiy33+ZxX95xvcIw==", 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDq8GJlUm5MEhAAVlkzzyqBJP1qdcuCfwhZmw==", 2023-11-26T07:23:00.466 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDt8GJlhvw+KxAAfn+Rklyv9MbMoGvi64A3eQ==", 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.467 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJlhqOIKxAAiafAbVhNu4B+yTd/1i7+1A==", 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow r", 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDO8GJlTnRuBhAA00v94pDxY21mhcK5h8b5ag==", 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.468 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDN8GJlCgKpNhAAX0HSBMyXxclLtvXwdw4gBQ==", 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:23:00.469 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDO8GJlFP2HERAA02DfbslNoErl7daZAir6yw==", 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.470 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDL8GJlGorHHhAAWxHMjiSUuG8u/Jl0dYqSBg==", 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJlYYTeIBAATi/P7CpbfWNxuKAyi2DChA==", 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.471 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDM8GJl07f3FBAAL3JjjVDVa3eQe+Phdo0agw==", 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.472 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:00.473 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2023-11-26T07:23:00.473 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:23:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.458+0000 7f2a65e9b640 1 -- 172.21.15.77:0/2192606977 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2a4006b6b0 msgr2=0x7f2a4006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.458+0000 7f2a65e9b640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2a4006b6b0 0x7f2a4006db70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2a50006fd0 tx=0x7f2a50006bc0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.458+0000 7f2a65e9b640 1 -- 172.21.15.77:0/2192606977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a600cd5b0 msgr2=0x7f2a6014c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.458+0000 7f2a65e9b640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a600cd5b0 0x7f2a6014c250 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800d800 tx=0x7f2a4800dcc0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.459+0000 7f2a65e9b640 1 -- 172.21.15.77:0/2192606977 shutdown_connections 2023-11-26T07:23:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.459+0000 7f2a65e9b640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2a4006b6b0 0x7f2a4006db70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.459+0000 7f2a65e9b640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a6015b5e0 0x7f2a60159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.459+0000 7f2a65e9b640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a600cd5b0 0x7f2a6014c250 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.459+0000 7f2a65e9b640 1 --2- 172.21.15.77:0/2192606977 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a600abf50 0x7f2a601f3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.459+0000 7f2a65e9b640 1 -- 172.21.15.77:0/2192606977 >> 172.21.15.77:0/2192606977 conn(0x7f2a600b0c70 msgr2=0x7f2a6015a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:00.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.459+0000 7f2a65e9b640 1 -- 172.21.15.77:0/2192606977 shutdown_connections 2023-11-26T07:23:00.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.459+0000 7f2a65e9b640 1 -- 172.21.15.77:0/2192606977 wait complete. 2023-11-26T07:23:00.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:23:00.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.680+0000 7f5acddd5640 1 Processor -- start 2023-11-26T07:23:00.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.681+0000 7f5acddd5640 1 -- start start 2023-11-26T07:23:00.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.682+0000 7f5acddd5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ac815da20 0x7f5ac80d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.682+0000 7f5acddd5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ac806ba90 0x7f5ac806bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.682+0000 7f5acddd5640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac80ce0a0 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.682+0000 7f5acddd5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac80d0d70 con 0x7f5ac815da20 2023-11-26T07:23:00.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.682+0000 7f5acddd5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac80cf4c0 con 0x7f5ac806ba90 2023-11-26T07:23:00.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.682+0000 7f5ac77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ac815da20 0x7f5ac80d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.683+0000 7f5ac77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ac815da20 0x7f5ac80d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42360/0 (socket says 172.21.15.77:42360) 2023-11-26T07:23:00.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.683+0000 7f5ac77fe640 1 -- 172.21.15.77:0/3394683604 learned_addr learned my addr 172.21.15.77:0/3394683604 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:00.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.683+0000 7f5ac77fe640 1 -- 172.21.15.77:0/3394683604 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ac806ba90 msgr2=0x7f5ac806bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:00.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.683+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/3394683604 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ac806ba90 0x7f5ac806bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.683+0000 7f5ac77fe640 1 -- 172.21.15.77:0/3394683604 >> v1:172.21.15.159:6789/0 conn(0x7f5ac80d1fd0 legacy=0x7f5ac80cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:00.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.683+0000 7f5ac77fe640 1 -- 172.21.15.77:0/3394683604 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac80d0a90 con 0x7f5ac815da20 2023-11-26T07:23:00.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.684+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/3394683604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac815da20 0x7f5ac80d0480 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009e50 tx=0x7f5ab802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520492850c4dc42c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.684+0000 7f5ac67fc640 1 -- 172.21.15.77:0/3394683604 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab802ca70 con 0x7f5ac815da20 2023-11-26T07:23:00.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.684+0000 7f5ac67fc640 1 -- 172.21.15.77:0/3394683604 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab802cbd0 con 0x7f5ac815da20 2023-11-26T07:23:00.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.684+0000 7f5ac67fc640 1 -- 172.21.15.77:0/3394683604 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80343f0 con 0x7f5ac815da20 2023-11-26T07:23:00.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.685+0000 7f5acddd5640 1 -- 172.21.15.77:0/3394683604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac815da20 msgr2=0x7f5ac80d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.685+0000 7f5acddd5640 1 --2- 172.21.15.77:0/3394683604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac815da20 0x7f5ac80d0480 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009e50 tx=0x7f5ab802bed0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.685+0000 7f5acddd5640 1 -- 172.21.15.77:0/3394683604 shutdown_connections 2023-11-26T07:23:00.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.685+0000 7f5acddd5640 1 --2- 172.21.15.77:0/3394683604 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ac806ba90 0x7f5ac806bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.685+0000 7f5acddd5640 1 --2- 172.21.15.77:0/3394683604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac815da20 0x7f5ac80d0480 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.685+0000 7f5acddd5640 1 -- 172.21.15.77:0/3394683604 >> 172.21.15.77:0/3394683604 conn(0x7f5ac809c7e0 msgr2=0x7f5ac808af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:00.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.685+0000 7f5acddd5640 1 -- 172.21.15.77:0/3394683604 shutdown_connections 2023-11-26T07:23:00.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.685+0000 7f5acddd5640 1 -- 172.21.15.77:0/3394683604 wait complete. 2023-11-26T07:23:00.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.687+0000 7f5acddd5640 1 Processor -- start 2023-11-26T07:23:00.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.687+0000 7f5acddd5640 1 -- start start 2023-11-26T07:23:00.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.688+0000 7f5acddd5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ac806ba90 0x7f5ac814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.688+0000 7f5acddd5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80d1fd0 0x7f5ac80b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.688+0000 7f5acddd5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ac815da20 0x7f5ac80b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.688+0000 7f5acddd5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac81500d0 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.688+0000 7f5acddd5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac80cb340 con 0x7f5ac806ba90 2023-11-26T07:23:00.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.688+0000 7f5acddd5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac80cb620 con 0x7f5ac815da20 2023-11-26T07:23:00.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.688+0000 7f5ac6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80d1fd0 0x7f5ac80b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.688+0000 7f5ac6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80d1fd0 0x7f5ac80b56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42364/0 (socket says 172.21.15.77:42364) 2023-11-26T07:23:00.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.688+0000 7f5ac6ffd640 1 -- 172.21.15.77:0/2852277684 learned_addr learned my addr 172.21.15.77:0/2852277684 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:00.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ac806ba90 0x7f5ac814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5ac6ffd640 1 -- 172.21.15.77:0/2852277684 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ac815da20 msgr2=0x7f5ac80b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5ac7fff640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ac815da20 0x7f5ac80b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5ac6ffd640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ac815da20 0x7f5ac80b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5ac6ffd640 1 -- 172.21.15.77:0/2852277684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ac806ba90 msgr2=0x7f5ac814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5ac6ffd640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ac806ba90 0x7f5ac814fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5ac6ffd640 1 -- 172.21.15.77:0/2852277684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8009b30 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5ac6ffd640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80d1fd0 0x7f5ac80b56a0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c400 tx=0x7f5ab000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5abffff640 1 -- 172.21.15.77:0/2852277684 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab00035f0 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5abffff640 1 -- 172.21.15.77:0/2852277684 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab0003750 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5acddd5640 1 -- 172.21.15.77:0/2852277684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac80cb900 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.689+0000 7f5abffff640 1 -- 172.21.15.77:0/2852277684 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0003b40 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.690+0000 7f5acddd5640 1 -- 172.21.15.77:0/2852277684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac80cbec0 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.691+0000 7f5acddd5640 1 -- 172.21.15.77:0/2852277684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac8067b80 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.692+0000 7f5abffff640 1 -- 172.21.15.77:0/2852277684 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f5ab0003ca0 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.692+0000 7f5abffff640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa806b6b0 0x7f5aa806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.693+0000 7f5abffff640 1 -- 172.21.15.77:0/2852277684 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ab0087510 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.693+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa806b6b0 0x7f5aa806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.693+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa806b6b0 0x7f5aa806db70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8035000 tx=0x7f5ab8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.697+0000 7f5abffff640 1 -- 172.21.15.77:0/2852277684 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ab0053f50 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.890+0000 7f5acddd5640 1 -- 172.21.15.77:0/2852277684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ac80d4340 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.892+0000 7f5abffff640 1 -- 172.21.15.77:0/2852277684 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+12833 (secure 0 0 0) 0x7f5ab0017020 con 0x7f5ac80d1fd0 2023-11-26T07:23:00.894 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:23:00.895 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":71,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:22:59.970041+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.894+0000 7f5acddd5640 1 -- 172.21.15.77:0/2852277684 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa806b6b0 msgr2=0x7f5aa806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.894+0000 7f5acddd5640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa806b6b0 0x7f5aa806db70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8035000 tx=0x7f5ab8030000 comp rx=0 tx=0).stop 2023-11-26T07:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.894+0000 7f5acddd5640 1 -- 172.21.15.77:0/2852277684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80d1fd0 msgr2=0x7f5ac80b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.894+0000 7f5acddd5640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80d1fd0 0x7f5ac80b56a0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c400 tx=0x7f5ab000c8c0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.894+0000 7f5acddd5640 1 -- 172.21.15.77:0/2852277684 shutdown_connections 2023-11-26T07:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.894+0000 7f5acddd5640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa806b6b0 0x7f5aa806db70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.894+0000 7f5acddd5640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ac815da20 0x7f5ac80b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.894+0000 7f5acddd5640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80d1fd0 0x7f5ac80b56a0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.894+0000 7f5acddd5640 1 --2- 172.21.15.77:0/2852277684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ac806ba90 0x7f5ac814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.894+0000 7f5acddd5640 1 -- 172.21.15.77:0/2852277684 >> 172.21.15.77:0/2852277684 conn(0x7f5ac809c7e0 msgr2=0x7f5ac815e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.895+0000 7f5acddd5640 1 -- 172.21.15.77:0/2852277684 shutdown_connections 2023-11-26T07:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:00.895+0000 7f5acddd5640 1 -- 172.21.15.77:0/2852277684 wait complete. 2023-11-26T07:23:00.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:23:00.916 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:23:01.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.122+0000 7fea221a9640 1 Processor -- start 2023-11-26T07:23:01.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.122+0000 7fea221a9640 1 -- start start 2023-11-26T07:23:01.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.123+0000 7fea221a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea1c15d720 0x7fea1c0d3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.123+0000 7fea221a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1c0d3870 0x7fea1c0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.123+0000 7fea221a9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fea1c0b1400 0x7fea1c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.123+0000 7fea221a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c0d3d20 con 0x7fea1c15d720 2023-11-26T07:23:01.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.123+0000 7fea221a9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c15db00 con 0x7fea1c0b1400 2023-11-26T07:23:01.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.123+0000 7fea221a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0d0ce0 con 0x7fea1c0d3870 2023-11-26T07:23:01.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.124+0000 7fea1b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea1c15d720 0x7fea1c0d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:01.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.124+0000 7fea1b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea1c15d720 0x7fea1c0d3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42372/0 (socket says 172.21.15.77:42372) 2023-11-26T07:23:01.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.124+0000 7fea1b7fe640 1 -- 172.21.15.77:0/2298334417 learned_addr learned my addr 172.21.15.77:0/2298334417 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:01.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.124+0000 7fea1affd640 1 --2- 172.21.15.77:0/2298334417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1c0d3870 0x7fea1c0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:01.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.124+0000 7fea1bfff640 1 --2- 172.21.15.77:0/2298334417 >> v2:172.21.15.159:3300/0 conn(0x7fea1c0b1400 0x7fea1c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:01.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.124+0000 7fea1b7fe640 1 -- 172.21.15.77:0/2298334417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1c0d3870 msgr2=0x7fea1c0b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:01.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.124+0000 7fea1b7fe640 1 --2- 172.21.15.77:0/2298334417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1c0d3870 0x7fea1c0b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.124+0000 7fea1b7fe640 1 -- 172.21.15.77:0/2298334417 >> v2:172.21.15.159:3300/0 conn(0x7fea1c0b1400 msgr2=0x7fea1c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:01.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.124+0000 7fea1b7fe640 1 --2- 172.21.15.77:0/2298334417 >> v2:172.21.15.159:3300/0 conn(0x7fea1c0b1400 0x7fea1c0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.124+0000 7fea1b7fe640 1 -- 172.21.15.77:0/2298334417 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c06d400 con 0x7fea1c15d720 2023-11-26T07:23:01.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.125+0000 7fea1b7fe640 1 --2- 172.21.15.77:0/2298334417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c15d720 0x7fea1c0d3330 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fea1c08cd90 tx=0x7fea0c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c266a758bac389 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:01.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.126+0000 7fea1a7fc640 1 -- 172.21.15.77:0/2298334417 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0317e0 con 0x7fea1c15d720 2023-11-26T07:23:01.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.126+0000 7fea1a7fc640 1 -- 172.21.15.77:0/2298334417 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c031940 con 0x7fea1c15d720 2023-11-26T07:23:01.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.126+0000 7fea1a7fc640 1 -- 172.21.15.77:0/2298334417 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c031cd0 con 0x7fea1c15d720 2023-11-26T07:23:01.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.126+0000 7fea221a9640 1 -- 172.21.15.77:0/2298334417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c15d720 msgr2=0x7fea1c0d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.126+0000 7fea221a9640 1 --2- 172.21.15.77:0/2298334417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c15d720 0x7fea1c0d3330 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fea1c08cd90 tx=0x7fea0c02b880 comp rx=0 tx=0).stop 2023-11-26T07:23:01.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.126+0000 7fea221a9640 1 -- 172.21.15.77:0/2298334417 shutdown_connections 2023-11-26T07:23:01.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.126+0000 7fea221a9640 1 --2- 172.21.15.77:0/2298334417 >> v2:172.21.15.159:3300/0 conn(0x7fea1c0b1400 0x7fea1c0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.126+0000 7fea221a9640 1 --2- 172.21.15.77:0/2298334417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1c0d3870 0x7fea1c0b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.126+0000 7fea221a9640 1 --2- 172.21.15.77:0/2298334417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c15d720 0x7fea1c0d3330 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.126+0000 7fea221a9640 1 -- 172.21.15.77:0/2298334417 >> 172.21.15.77:0/2298334417 conn(0x7fea1c08af60 msgr2=0x7fea1c09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:01.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.127+0000 7fea221a9640 1 -- 172.21.15.77:0/2298334417 shutdown_connections 2023-11-26T07:23:01.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.127+0000 7fea221a9640 1 -- 172.21.15.77:0/2298334417 wait complete. 2023-11-26T07:23:01.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.129+0000 7fea221a9640 1 Processor -- start 2023-11-26T07:23:01.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.129+0000 7fea221a9640 1 -- start start 2023-11-26T07:23:01.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.130+0000 7fea221a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1c0b1400 0x7fea1c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.130+0000 7fea221a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1c0d3870 0x7fea1c1f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.130+0000 7fea221a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c15d720 0x7fea1c159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.130+0000 7fea221a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c1f7d90 con 0x7fea1c15d720 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.130+0000 7fea221a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c15ecb0 con 0x7fea1c0d3870 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.130+0000 7fea221a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c15e9d0 con 0x7fea1c0b1400 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.130+0000 7fea1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c15d720 0x7fea1c159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.130+0000 7fea1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c15d720 0x7fea1c159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42388/0 (socket says 172.21.15.77:42388) 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.130+0000 7fea1bfff640 1 -- 172.21.15.77:0/1994720389 learned_addr learned my addr 172.21.15.77:0/1994720389 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.130+0000 7fea1b7fe640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1c0b1400 0x7fea1c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea1affd640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1c0d3870 0x7fea1c1f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea1bfff640 1 -- 172.21.15.77:0/1994720389 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1c0b1400 msgr2=0x7fea1c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea1bfff640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1c0b1400 0x7fea1c0c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea1bfff640 1 -- 172.21.15.77:0/1994720389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1c0d3870 msgr2=0x7fea1c1f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea1bfff640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1c0d3870 0x7fea1c1f7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea1bfff640 1 -- 172.21.15.77:0/1994720389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c0094d0 con 0x7fea1c15d720 2023-11-26T07:23:01.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea1bfff640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c15d720 0x7fea1c159470 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fea14007e60 tx=0x7fea1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:01.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea03fff640 1 -- 172.21.15.77:0/1994720389 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14014420 con 0x7fea1c15d720 2023-11-26T07:23:01.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea03fff640 1 -- 172.21.15.77:0/1994720389 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea140145a0 con 0x7fea1c15d720 2023-11-26T07:23:01.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea03fff640 1 -- 172.21.15.77:0/1994720389 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14014950 con 0x7fea1c15d720 2023-11-26T07:23:01.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea221a9640 1 -- 172.21.15.77:0/1994720389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c15f090 con 0x7fea1c15d720 2023-11-26T07:23:01.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.131+0000 7fea221a9640 1 -- 172.21.15.77:0/1994720389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c15e660 con 0x7fea1c15d720 2023-11-26T07:23:01.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.133+0000 7fea221a9640 1 -- 172.21.15.77:0/1994720389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c15f890 con 0x7fea1c15d720 2023-11-26T07:23:01.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.133+0000 7fea03fff640 1 -- 172.21.15.77:0/1994720389 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fea14014ab0 con 0x7fea1c15d720 2023-11-26T07:23:01.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.134+0000 7fea03fff640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fea0806b6b0 0x7fea0806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.135+0000 7fea03fff640 1 -- 172.21.15.77:0/1994720389 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea14088960 con 0x7fea1c15d720 2023-11-26T07:23:01.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.135+0000 7fea1b7fe640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fea0806b6b0 0x7fea0806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:01.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.135+0000 7fea1b7fe640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fea0806b6b0 0x7fea0806db70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fea0c036000 tx=0x7fea0c03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:01.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.139+0000 7fea03fff640 1 -- 172.21.15.77:0/1994720389 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea1c15f890 con 0x7fea1c15d720 2023-11-26T07:23:01.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.326+0000 7fea221a9640 1 -- 172.21.15.77:0/1994720389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea1c15f890 con 0x7fea1c15d720 2023-11-26T07:23:01.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.327+0000 7fea03fff640 1 -- 172.21.15.77:0/1994720389 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea1c15f890 con 0x7fea1c15d720 2023-11-26T07:23:01.329 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:23:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.329+0000 7fea221a9640 1 -- 172.21.15.77:0/1994720389 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fea0806b6b0 msgr2=0x7fea0806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.329+0000 7fea221a9640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fea0806b6b0 0x7fea0806db70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fea0c036000 tx=0x7fea0c03d040 comp rx=0 tx=0).stop 2023-11-26T07:23:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.329+0000 7fea221a9640 1 -- 172.21.15.77:0/1994720389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c15d720 msgr2=0x7fea1c159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.329+0000 7fea221a9640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c15d720 0x7fea1c159470 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fea14007e60 tx=0x7fea1400e4b0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.330+0000 7fea221a9640 1 -- 172.21.15.77:0/1994720389 shutdown_connections 2023-11-26T07:23:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.330+0000 7fea221a9640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fea0806b6b0 0x7fea0806db70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.330+0000 7fea221a9640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c15d720 0x7fea1c159470 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.330+0000 7fea221a9640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1c0d3870 0x7fea1c1f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.330+0000 7fea221a9640 1 --2- 172.21.15.77:0/1994720389 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1c0b1400 0x7fea1c0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.330+0000 7fea221a9640 1 -- 172.21.15.77:0/1994720389 >> 172.21.15.77:0/1994720389 conn(0x7fea1c08af60 msgr2=0x7fea1c0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.330+0000 7fea221a9640 1 -- 172.21.15.77:0/1994720389 shutdown_connections 2023-11-26T07:23:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.330+0000 7fea221a9640 1 -- 172.21.15.77:0/1994720389 wait complete. 2023-11-26T07:23:01.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:23:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.557+0000 7f900b3e9640 1 Processor -- start 2023-11-26T07:23:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.557+0000 7f900b3e9640 1 -- start start 2023-11-26T07:23:01.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.558+0000 7f900b3e9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90040d1e20 0x7f90040cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.558+0000 7f900b3e9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90040d0070 0x7f90040b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.558+0000 7f900b3e9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90040d04b0 con 0x7f900415d4e0 2023-11-26T07:23:01.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.558+0000 7f900b3e9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90040d4110 con 0x7f90040d1e20 2023-11-26T07:23:01.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.558+0000 7f900b3e9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90040ce990 con 0x7f90040d0070 2023-11-26T07:23:01.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.559+0000 7f900a3e7640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f900415d4e0 0x7f90040d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49796/0 (socket says 172.21.15.77:49796) 2023-11-26T07:23:01.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.559+0000 7f900a3e7640 1 -- 172.21.15.77:0/3475982330 learned_addr learned my addr 172.21.15.77:0/3475982330 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:01.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.559+0000 7f9009be6640 1 --2- 172.21.15.77:0/3475982330 >> v2:172.21.15.77:3300/0 conn(0x7f90040d1e20 0x7f90040cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:01.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.559+0000 7f900abe8640 1 --2- 172.21.15.77:0/3475982330 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90040d0070 0x7f90040b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:01.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.559+0000 7f90093e5640 1 -- 172.21.15.77:0/3475982330 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415154141 0 0) 0x7f90040d04b0 con 0x7f900415d4e0 2023-11-26T07:23:01.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.559+0000 7f90093e5640 1 -- 172.21.15.77:0/3475982330 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff0003520 con 0x7f900415d4e0 2023-11-26T07:23:01.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.559+0000 7f9009be6640 1 -- 172.21.15.77:0/3475982330 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90040d0070 msgr2=0x7f90040b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:01.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.559+0000 7f9009be6640 1 --2- 172.21.15.77:0/3475982330 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90040d0070 0x7f90040b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.559+0000 7f9009be6640 1 -- 172.21.15.77:0/3475982330 >> v1:172.21.15.77:6789/0 conn(0x7f900415d4e0 legacy=0x7f90040d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.559+0000 7f9009be6640 1 -- 172.21.15.77:0/3475982330 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90040cec70 con 0x7f90040d1e20 2023-11-26T07:23:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.561+0000 7f9009be6640 1 --2- 172.21.15.77:0/3475982330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040d1e20 0x7f90040cfb30 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40097a0 tx=0x7f8ff402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea97945760bef48 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.561+0000 7f90093e5640 1 -- 172.21.15.77:0/3475982330 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff402d040 con 0x7f90040d1e20 2023-11-26T07:23:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.561+0000 7f90093e5640 1 -- 172.21.15.77:0/3475982330 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff4031810 con 0x7f90040d1e20 2023-11-26T07:23:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.561+0000 7f90093e5640 1 -- 172.21.15.77:0/3475982330 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4031ba0 con 0x7f90040d1e20 2023-11-26T07:23:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.561+0000 7f900b3e9640 1 -- 172.21.15.77:0/3475982330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040d1e20 msgr2=0x7f90040cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.561+0000 7f900b3e9640 1 --2- 172.21.15.77:0/3475982330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040d1e20 0x7f90040cfb30 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40097a0 tx=0x7f8ff402b8b0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.561+0000 7f900b3e9640 1 -- 172.21.15.77:0/3475982330 shutdown_connections 2023-11-26T07:23:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.561+0000 7f900b3e9640 1 --2- 172.21.15.77:0/3475982330 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90040d0070 0x7f90040b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.561+0000 7f900b3e9640 1 --2- 172.21.15.77:0/3475982330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040d1e20 0x7f90040cfb30 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.561+0000 7f900b3e9640 1 -- 172.21.15.77:0/3475982330 >> 172.21.15.77:0/3475982330 conn(0x7f900409c510 msgr2=0x7f90040d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.562+0000 7f900b3e9640 1 -- 172.21.15.77:0/3475982330 shutdown_connections 2023-11-26T07:23:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.562+0000 7f900b3e9640 1 -- 172.21.15.77:0/3475982330 wait complete. 2023-11-26T07:23:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.563+0000 7f900b3e9640 1 Processor -- start 2023-11-26T07:23:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.563+0000 7f900b3e9640 1 -- start start 2023-11-26T07:23:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.564+0000 7f900b3e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040d0070 0x7f90041f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.564+0000 7f900b3e9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90040d1e20 0x7f900415ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.564+0000 7f900b3e9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f900415d4e0 0x7f900415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.564+0000 7f900b3e9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90040ca660 con 0x7f90040d0070 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.564+0000 7f900b3e9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90040ca940 con 0x7f900415d4e0 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.564+0000 7f900b3e9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90040cac20 con 0x7f90040d1e20 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.565+0000 7f900a3e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040d0070 0x7f90041f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.565+0000 7f900a3e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040d0070 0x7f90041f2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42406/0 (socket says 172.21.15.77:42406) 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.565+0000 7f900a3e7640 1 -- 172.21.15.77:0/149921165 learned_addr learned my addr 172.21.15.77:0/149921165 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.565+0000 7f900a3e7640 1 -- 172.21.15.77:0/149921165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90040d1e20 msgr2=0x7f900415ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.565+0000 7f900a3e7640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90040d1e20 0x7f900415ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.565+0000 7f900a3e7640 1 -- 172.21.15.77:0/149921165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f900415d4e0 msgr2=0x7f900415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.565+0000 7f900a3e7640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f900415d4e0 0x7f900415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.565+0000 7f900a3e7640 1 -- 172.21.15.77:0/149921165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff4009400 con 0x7f90040d0070 2023-11-26T07:23:01.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.565+0000 7f900a3e7640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040d0070 0x7f90041f2600 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f900000c410 tx=0x7f900000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:01.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.566+0000 7f8ffaffd640 1 -- 172.21.15.77:0/149921165 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000005ce0 con 0x7f90040d0070 2023-11-26T07:23:01.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.566+0000 7f8ffaffd640 1 -- 172.21.15.77:0/149921165 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9000005e40 con 0x7f90040d0070 2023-11-26T07:23:01.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.566+0000 7f8ffaffd640 1 -- 172.21.15.77:0/149921165 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90000072f0 con 0x7f90040d0070 2023-11-26T07:23:01.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.566+0000 7f900b3e9640 1 -- 172.21.15.77:0/149921165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90040caf00 con 0x7f90040d0070 2023-11-26T07:23:01.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.566+0000 7f900b3e9640 1 -- 172.21.15.77:0/149921165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90040ca2a0 con 0x7f90040d0070 2023-11-26T07:23:01.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.567+0000 7f900b3e9640 1 -- 172.21.15.77:0/149921165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90040cb090 con 0x7f90040d0070 2023-11-26T07:23:01.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.568+0000 7f8ffaffd640 1 -- 172.21.15.77:0/149921165 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f9000007510 con 0x7f90040d0070 2023-11-26T07:23:01.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.569+0000 7f8ffaffd640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe806b6b0 0x7f8fe806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:01.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.569+0000 7f8ffaffd640 1 -- 172.21.15.77:0/149921165 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9000087740 con 0x7f90040d0070 2023-11-26T07:23:01.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.570+0000 7f9009be6640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe806b6b0 0x7f8fe806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:01.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.570+0000 7f9009be6640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe806b6b0 0x7f8fe806db70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4036000 tx=0x7f8ff4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:01.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.574+0000 7f8ffaffd640 1 -- 172.21.15.77:0/149921165 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9000054130 con 0x7f90040d0070 2023-11-26T07:23:01.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.770+0000 7f900b3e9640 1 -- 172.21.15.77:0/149921165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f900404e840 con 0x7f90040d0070 2023-11-26T07:23:01.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.771+0000 7f8ffaffd640 1 -- 172.21.15.77:0/149921165 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9000017060 con 0x7f90040d0070 2023-11-26T07:23:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:23:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-26T07:23:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-11-26T07:23:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-11-26T07:23:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-26T07:23:01.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 -- 172.21.15.77:0/149921165 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe806b6b0 msgr2=0x7f8fe806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe806b6b0 0x7f8fe806db70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4036000 tx=0x7f8ff4030000 comp rx=0 tx=0).stop 2023-11-26T07:23:01.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 -- 172.21.15.77:0/149921165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040d0070 msgr2=0x7f90041f2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040d0070 0x7f90041f2600 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f900000c410 tx=0x7f900000c8d0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 -- 172.21.15.77:0/149921165 shutdown_connections 2023-11-26T07:23:01.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8fe806b6b0 0x7f8fe806db70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f900415d4e0 0x7f900415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90040d1e20 0x7f900415ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 --2- 172.21.15.77:0/149921165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040d0070 0x7f90041f2600 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 -- 172.21.15.77:0/149921165 >> 172.21.15.77:0/149921165 conn(0x7f900409c510 msgr2=0x7f90040b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:01.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 -- 172.21.15.77:0/149921165 shutdown_connections 2023-11-26T07:23:01.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:01.774+0000 7f900b3e9640 1 -- 172.21.15.77:0/149921165 wait complete. 2023-11-26T07:23:01.796 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:23:01.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:23:02.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.015+0000 7ff0e8d0c640 1 Processor -- start 2023-11-26T07:23:02.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.015+0000 7ff0e8d0c640 1 -- start start 2023-11-26T07:23:02.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.016+0000 7ff0e8d0c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0e415dab0 0x7ff0e40b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.016+0000 7ff0e8d0c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff0e40ce9f0 0x7ff0e40cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.016+0000 7ff0e8d0c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e415de90 con 0x7ff0e406e110 2023-11-26T07:23:02.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.016+0000 7ff0e8d0c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e40caa50 con 0x7ff0e415dab0 2023-11-26T07:23:02.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.016+0000 7ff0e8d0c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e40cabe0 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.016+0000 7ff0e259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0e415dab0 0x7ff0e40b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.016+0000 7ff0e259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0e415dab0 0x7ff0e40b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42422/0 (socket says 172.21.15.77:42422) 2023-11-26T07:23:02.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.016+0000 7ff0e259c640 1 -- 172.21.15.77:0/3950049066 learned_addr learned my addr 172.21.15.77:0/3950049066 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:02.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.017+0000 7ff0e259c640 1 -- 172.21.15.77:0/3950049066 >> v2:172.21.15.159:3300/0 conn(0x7ff0e40ce9f0 msgr2=0x7ff0e40cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:02.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.017+0000 7ff0e259c640 1 --2- 172.21.15.77:0/3950049066 >> v2:172.21.15.159:3300/0 conn(0x7ff0e40ce9f0 0x7ff0e40cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.017+0000 7ff0e259c640 1 -- 172.21.15.77:0/3950049066 >> v1:172.21.15.159:6789/0 conn(0x7ff0e406e110 legacy=0x7ff0e40ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:02.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.017+0000 7ff0e259c640 1 -- 172.21.15.77:0/3950049066 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e406f700 con 0x7ff0e415dab0 2023-11-26T07:23:02.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.018+0000 7ff0e259c640 1 --2- 172.21.15.77:0/3950049066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e415dab0 0x7ff0e40b2400 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ff0e406f340 tx=0x7ff0d402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423eb377bbf75197 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:02.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.018+0000 7ff0e159a640 1 -- 172.21.15.77:0/3950049066 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d402ea90 con 0x7ff0e415dab0 2023-11-26T07:23:02.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.019+0000 7ff0e159a640 1 -- 172.21.15.77:0/3950049066 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d402ebf0 con 0x7ff0e415dab0 2023-11-26T07:23:02.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.019+0000 7ff0e159a640 1 -- 172.21.15.77:0/3950049066 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4009600 con 0x7ff0e415dab0 2023-11-26T07:23:02.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.019+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/3950049066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e415dab0 msgr2=0x7ff0e40b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.019+0000 7ff0e8d0c640 1 --2- 172.21.15.77:0/3950049066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e415dab0 0x7ff0e40b2400 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ff0e406f340 tx=0x7ff0d402e0f0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.019+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/3950049066 shutdown_connections 2023-11-26T07:23:02.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.019+0000 7ff0e8d0c640 1 --2- 172.21.15.77:0/3950049066 >> v2:172.21.15.159:3300/0 conn(0x7ff0e40ce9f0 0x7ff0e40cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.019+0000 7ff0e8d0c640 1 --2- 172.21.15.77:0/3950049066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e415dab0 0x7ff0e40b2400 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.019+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/3950049066 >> 172.21.15.77:0/3950049066 conn(0x7ff0e40999d0 msgr2=0x7ff0e40b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:02.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.019+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/3950049066 shutdown_connections 2023-11-26T07:23:02.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.019+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/3950049066 wait complete. 2023-11-26T07:23:02.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.021+0000 7ff0e8d0c640 1 Processor -- start 2023-11-26T07:23:02.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.021+0000 7ff0e8d0c640 1 -- start start 2023-11-26T07:23:02.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.022+0000 7ff0e8d0c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e406e110 0x7ff0e414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.022+0000 7ff0e8d0c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e40ce9f0 0x7ff0e414fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.022+0000 7ff0e8d0c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0e415dab0 0x7ff0e40c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.022+0000 7ff0e8d0c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40aeb40 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.022+0000 7ff0e8d0c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40adbe0 con 0x7ff0e406e110 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.022+0000 7ff0e8d0c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40adec0 con 0x7ff0e415dab0 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.022+0000 7ff0e1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e40ce9f0 0x7ff0e414fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.022+0000 7ff0e1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e40ce9f0 0x7ff0e414fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42436/0 (socket says 172.21.15.77:42436) 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.022+0000 7ff0e1d9b640 1 -- 172.21.15.77:0/1861954743 learned_addr learned my addr 172.21.15.77:0/1861954743 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0e259c640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e406e110 0x7ff0e414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0e2d9d640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0e415dab0 0x7ff0e40c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0e1d9b640 1 -- 172.21.15.77:0/1861954743 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0e415dab0 msgr2=0x7ff0e40c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0e1d9b640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0e415dab0 0x7ff0e40c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0e1d9b640 1 -- 172.21.15.77:0/1861954743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e406e110 msgr2=0x7ff0e414f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0e1d9b640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e406e110 0x7ff0e414f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0e1d9b640 1 -- 172.21.15.77:0/1861954743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d400bd40 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0e259c640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e406e110 0x7ff0e414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:02.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0e1d9b640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e40ce9f0 0x7ff0e414fe80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800b3e0 tx=0x7ff0d800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:02.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0d2ffd640 1 -- 172.21.15.77:0/1861954743 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8011830 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0d2ffd640 1 -- 172.21.15.77:0/1861954743 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d80119b0 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.023+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/1861954743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e40ae1a0 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.024+0000 7ff0d2ffd640 1 -- 172.21.15.77:0/1861954743 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8011d60 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.024+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/1861954743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e40ae760 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.025+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/1861954743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e40ce0d0 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.026+0000 7ff0d2ffd640 1 -- 172.21.15.77:0/1861954743 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7ff0d801a400 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.026+0000 7ff0d2ffd640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff0c406b6e0 0x7ff0c406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.027+0000 7ff0d2ffd640 1 -- 172.21.15.77:0/1861954743 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff0d80881b0 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.027+0000 7ff0e259c640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff0c406b6e0 0x7ff0c406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.028+0000 7ff0e259c640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff0c406b6e0 0x7ff0c406dba0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4037000 tx=0x7ff0d4032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:02.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.031+0000 7ff0d2ffd640 1 -- 172.21.15.77:0/1861954743 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0d8054b40 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.219+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/1861954743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff0e4067470 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.985+0000 7ff0d2ffd640 1 -- 172.21.15.77:0/1861954743 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff0d80150b0 con 0x7ff0e40ce9f0 2023-11-26T07:23:02.988 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-11-26T07:23:02.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.990+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/1861954743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff0c406b6e0 msgr2=0x7ff0c406dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.990+0000 7ff0e8d0c640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff0c406b6e0 0x7ff0c406dba0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4037000 tx=0x7ff0d4032000 comp rx=0 tx=0).stop 2023-11-26T07:23:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.990+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/1861954743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e40ce9f0 msgr2=0x7ff0e414fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.990+0000 7ff0e8d0c640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e40ce9f0 0x7ff0e414fe80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800b3e0 tx=0x7ff0d800b8a0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.990+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/1861954743 shutdown_connections 2023-11-26T07:23:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.990+0000 7ff0e8d0c640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff0c406b6e0 0x7ff0c406dba0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.990+0000 7ff0e8d0c640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0e415dab0 0x7ff0e40c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.990+0000 7ff0e8d0c640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e40ce9f0 0x7ff0e414fe80 secure :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800b3e0 tx=0x7ff0d800b8a0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.990+0000 7ff0e8d0c640 1 --2- 172.21.15.77:0/1861954743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e406e110 0x7ff0e414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.990+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/1861954743 >> 172.21.15.77:0/1861954743 conn(0x7ff0e40999d0 msgr2=0x7ff0e40cb330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.990+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/1861954743 shutdown_connections 2023-11-26T07:23:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:02.991+0000 7ff0e8d0c640 1 -- 172.21.15.77:0/1861954743 wait complete. 2023-11-26T07:23:03.018 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:23:03.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.227+0000 7f46b9261640 1 Processor -- start 2023-11-26T07:23:03.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.227+0000 7f46b9261640 1 -- start start 2023-11-26T07:23:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.228+0000 7f46b9261640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f46b415b440 0x7f46b40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.229+0000 7f46b9261640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f46b40cbf20 0x7f46b40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.229+0000 7f46b9261640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b415eea0 con 0x7f46b40c57e0 2023-11-26T07:23:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.229+0000 7f46b9261640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b40cc3d0 con 0x7f46b415b440 2023-11-26T07:23:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.229+0000 7f46b9261640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b415b820 con 0x7f46b40cbf20 2023-11-26T07:23:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.229+0000 7f46b2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f46b415b440 0x7f46b40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.229+0000 7f46b37fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f46b40c57e0 0x7f46b40c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49802/0 (socket says 172.21.15.77:49802) 2023-11-26T07:23:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.229+0000 7f46b37fe640 1 -- 172.21.15.77:0/694196774 learned_addr learned my addr 172.21.15.77:0/694196774 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.229+0000 7f46abfff640 1 --2- 172.21.15.77:0/694196774 >> v2:172.21.15.159:3300/0 conn(0x7f46b40cbf20 0x7f46b40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.229+0000 7f46b27fc640 1 -- 172.21.15.77:0/694196774 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262371610 0 0) 0x7f46b415eea0 con 0x7f46b40c57e0 2023-11-26T07:23:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.230+0000 7f46b27fc640 1 -- 172.21.15.77:0/694196774 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a0003520 con 0x7f46b40c57e0 2023-11-26T07:23:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.230+0000 7f46b2ffd640 1 -- 172.21.15.77:0/694196774 >> v2:172.21.15.159:3300/0 conn(0x7f46b40cbf20 msgr2=0x7f46b40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.230+0000 7f46b2ffd640 1 --2- 172.21.15.77:0/694196774 >> v2:172.21.15.159:3300/0 conn(0x7f46b40cbf20 0x7f46b40c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.230+0000 7f46b2ffd640 1 -- 172.21.15.77:0/694196774 >> v1:172.21.15.77:6789/0 conn(0x7f46b40c57e0 legacy=0x7f46b40c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.230+0000 7f46b2ffd640 1 -- 172.21.15.77:0/694196774 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b406d600 con 0x7f46b415b440 2023-11-26T07:23:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.231+0000 7f46b2ffd640 1 --2- 172.21.15.77:0/694196774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b415b440 0x7f46b40cb9e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f46b406e890 tx=0x7f46a402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5752db8aa49549 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.231+0000 7f46b27fc640 1 -- 172.21.15.77:0/694196774 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a402e070 con 0x7f46b415b440 2023-11-26T07:23:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.231+0000 7f46b27fc640 1 -- 172.21.15.77:0/694196774 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a40315a0 con 0x7f46b415b440 2023-11-26T07:23:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.231+0000 7f46b27fc640 1 -- 172.21.15.77:0/694196774 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4031910 con 0x7f46b415b440 2023-11-26T07:23:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.232+0000 7f46b9261640 1 -- 172.21.15.77:0/694196774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b415b440 msgr2=0x7f46b40cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.232+0000 7f46b9261640 1 --2- 172.21.15.77:0/694196774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b415b440 0x7f46b40cb9e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f46b406e890 tx=0x7f46a402b840 comp rx=0 tx=0).stop 2023-11-26T07:23:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.232+0000 7f46b9261640 1 -- 172.21.15.77:0/694196774 shutdown_connections 2023-11-26T07:23:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.232+0000 7f46b9261640 1 --2- 172.21.15.77:0/694196774 >> v2:172.21.15.159:3300/0 conn(0x7f46b40cbf20 0x7f46b40c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.232+0000 7f46b9261640 1 --2- 172.21.15.77:0/694196774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b415b440 0x7f46b40cb9e0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.232+0000 7f46b9261640 1 -- 172.21.15.77:0/694196774 >> 172.21.15.77:0/694196774 conn(0x7f46b40b0c50 msgr2=0x7f46b40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.232+0000 7f46b9261640 1 -- 172.21.15.77:0/694196774 shutdown_connections 2023-11-26T07:23:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.232+0000 7f46b9261640 1 -- 172.21.15.77:0/694196774 wait complete. 2023-11-26T07:23:03.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.234+0000 7f46b9261640 1 Processor -- start 2023-11-26T07:23:03.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.234+0000 7f46b9261640 1 -- start start 2023-11-26T07:23:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.235+0000 7f46b9261640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46b40c57e0 0x7f46b40ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.235+0000 7f46b9261640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b40cbf20 0x7f46b40c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.235+0000 7f46b9261640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46b415b440 0x7f46b41530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.235+0000 7f46b9261640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40c7940 con 0x7f46b40cbf20 2023-11-26T07:23:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.235+0000 7f46b9261640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40c81a0 con 0x7f46b415b440 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.235+0000 7f46b9261640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b41540d0 con 0x7f46b40c57e0 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.235+0000 7f46abfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b40cbf20 0x7f46b40c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.235+0000 7f46abfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b40cbf20 0x7f46b40c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42458/0 (socket says 172.21.15.77:42458) 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.235+0000 7f46abfff640 1 -- 172.21.15.77:0/1135953240 learned_addr learned my addr 172.21.15.77:0/1135953240 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46b2ffd640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46b40c57e0 0x7f46b40ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46b37fe640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46b415b440 0x7f46b41530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46abfff640 1 -- 172.21.15.77:0/1135953240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46b40c57e0 msgr2=0x7f46b40ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46abfff640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46b40c57e0 0x7f46b40ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46abfff640 1 -- 172.21.15.77:0/1135953240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46b415b440 msgr2=0x7f46b41530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46abfff640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46b415b440 0x7f46b41530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46abfff640 1 -- 172.21.15.77:0/1135953240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4009400 con 0x7f46b40cbf20 2023-11-26T07:23:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46abfff640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b40cbf20 0x7f46b40c8c80 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f469c00e9b0 tx=0x7f469c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:03.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46ab7fe640 1 -- 172.21.15.77:0/1135953240 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c009670 con 0x7f46b40cbf20 2023-11-26T07:23:03.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46ab7fe640 1 -- 172.21.15.77:0/1135953240 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c00c9a0 con 0x7f46b40cbf20 2023-11-26T07:23:03.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46b9261640 1 -- 172.21.15.77:0/1135953240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b40cea50 con 0x7f46b40cbf20 2023-11-26T07:23:03.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.236+0000 7f46ab7fe640 1 -- 172.21.15.77:0/1135953240 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00cd50 con 0x7f46b40cbf20 2023-11-26T07:23:03.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.237+0000 7f46b9261640 1 -- 172.21.15.77:0/1135953240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b40c7e30 con 0x7f46b40cbf20 2023-11-26T07:23:03.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.237+0000 7f46b9261640 1 -- 172.21.15.77:0/1135953240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b40c8330 con 0x7f46b40cbf20 2023-11-26T07:23:03.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.239+0000 7f46ab7fe640 1 -- 172.21.15.77:0/1135953240 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f469c013470 con 0x7f46b40cbf20 2023-11-26T07:23:03.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.240+0000 7f46ab7fe640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f469406b6b0 0x7f469406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.240+0000 7f46ab7fe640 1 -- 172.21.15.77:0/1135953240 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f469c088b30 con 0x7f46b40cbf20 2023-11-26T07:23:03.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.240+0000 7f46b2ffd640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f469406b6b0 0x7f469406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.241+0000 7f46b2ffd640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f469406b6b0 0x7f469406db70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f46a4036000 tx=0x7f46a403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:03.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.244+0000 7f46ab7fe640 1 -- 172.21.15.77:0/1135953240 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f469c0554a0 con 0x7f46b40cbf20 2023-11-26T07:23:03.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.440+0000 7f46b9261640 1 -- 172.21.15.77:0/1135953240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f46b404e8b0 con 0x7f46b40cbf20 2023-11-26T07:23:03.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.991+0000 7f46ab7fe640 1 -- 172.21.15.77:0/1135953240 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) v1 ==== 170+0+0 (secure 0 0 0) 0x7f469c0210d0 con 0x7f46b40cbf20 2023-11-26T07:23:03.994 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-11-26T07:23:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.996+0000 7f46b9261640 1 -- 172.21.15.77:0/1135953240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f469406b6b0 msgr2=0x7f469406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.996+0000 7f46b9261640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f469406b6b0 0x7f469406db70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f46a4036000 tx=0x7f46a403d040 comp rx=0 tx=0).stop 2023-11-26T07:23:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.996+0000 7f46b9261640 1 -- 172.21.15.77:0/1135953240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b40cbf20 msgr2=0x7f46b40c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.996+0000 7f46b9261640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b40cbf20 0x7f46b40c8c80 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f469c00e9b0 tx=0x7f469c00ee70 comp rx=0 tx=0).stop 2023-11-26T07:23:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.996+0000 7f46b9261640 1 -- 172.21.15.77:0/1135953240 shutdown_connections 2023-11-26T07:23:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.996+0000 7f46b9261640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f469406b6b0 0x7f469406db70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.996+0000 7f46b9261640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46b415b440 0x7f46b41530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.996+0000 7f46b9261640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b40cbf20 0x7f46b40c8c80 secure :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f469c00e9b0 tx=0x7f469c00ee70 comp rx=0 tx=0).stop 2023-11-26T07:23:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.996+0000 7f46b9261640 1 --2- 172.21.15.77:0/1135953240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46b40c57e0 0x7f46b40ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.996+0000 7f46b9261640 1 -- 172.21.15.77:0/1135953240 >> 172.21.15.77:0/1135953240 conn(0x7f46b40b0c50 msgr2=0x7f46b40acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.997+0000 7f46b9261640 1 -- 172.21.15.77:0/1135953240 shutdown_connections 2023-11-26T07:23:04.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:03.999+0000 7f46b9261640 1 -- 172.21.15.77:0/1135953240 wait complete. 2023-11-26T07:23:04.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:23:04.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.221+0000 7f5389b27640 1 Processor -- start 2023-11-26T07:23:04.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.221+0000 7f5389b27640 1 -- start start 2023-11-26T07:23:04.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.223+0000 7f5389b27640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f53841608f0 0x7f53840d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:04.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.223+0000 7f5389b27640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53840d3890 0x7f53840b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:04.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.223+0000 7f5389b27640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5384160cd0 con 0x7f53840ce260 2023-11-26T07:23:04.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.223+0000 7f5389b27640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53840b8f60 con 0x7f53840d3890 2023-11-26T07:23:04.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.223+0000 7f5389b27640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53840cdcb0 con 0x7f53841608f0 2023-11-26T07:23:04.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.223+0000 7f5389326640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53840d3890 0x7f53840b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:04.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.223+0000 7f5389326640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53840d3890 0x7f53840b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42472/0 (socket says 172.21.15.77:42472) 2023-11-26T07:23:04.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.223+0000 7f5389326640 1 -- 172.21.15.77:0/1340585713 learned_addr learned my addr 172.21.15.77:0/1340585713 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:04.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.224+0000 7f5388b25640 1 --2- 172.21.15.77:0/1340585713 >> v2:172.21.15.159:3300/0 conn(0x7f53841608f0 0x7f53840d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:04.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.224+0000 7f5389326640 1 -- 172.21.15.77:0/1340585713 >> v2:172.21.15.159:3300/0 conn(0x7f53841608f0 msgr2=0x7f53840d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:04.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.224+0000 7f5389326640 1 --2- 172.21.15.77:0/1340585713 >> v2:172.21.15.159:3300/0 conn(0x7f53841608f0 0x7f53840d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:04.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.224+0000 7f5389326640 1 -- 172.21.15.77:0/1340585713 >> v1:172.21.15.159:6789/0 conn(0x7f53840ce260 legacy=0x7f53840d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:04.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.224+0000 7f5389326640 1 -- 172.21.15.77:0/1340585713 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53840cdf90 con 0x7f53840d3890 2023-11-26T07:23:04.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.225+0000 7f5389326640 1 --2- 172.21.15.77:0/1340585713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53840d3890 0x7f53840b63d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f53840b90a0 tx=0x7f537c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fc9ebfae44421e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:04.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.225+0000 7f53837fe640 1 -- 172.21.15.77:0/1340585713 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c02ca70 con 0x7f53840d3890 2023-11-26T07:23:04.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.225+0000 7f53837fe640 1 -- 172.21.15.77:0/1340585713 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c02cbd0 con 0x7f53840d3890 2023-11-26T07:23:04.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.225+0000 7f53837fe640 1 -- 172.21.15.77:0/1340585713 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c0343f0 con 0x7f53840d3890 2023-11-26T07:23:04.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.226+0000 7f5389b27640 1 -- 172.21.15.77:0/1340585713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53840d3890 msgr2=0x7f53840b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:04.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.226+0000 7f5389b27640 1 --2- 172.21.15.77:0/1340585713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53840d3890 0x7f53840b63d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f53840b90a0 tx=0x7f537c02bed0 comp rx=0 tx=0).stop 2023-11-26T07:23:04.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.226+0000 7f5389b27640 1 -- 172.21.15.77:0/1340585713 shutdown_connections 2023-11-26T07:23:04.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.226+0000 7f5389b27640 1 --2- 172.21.15.77:0/1340585713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53840d3890 0x7f53840b63d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:04.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.226+0000 7f5389b27640 1 --2- 172.21.15.77:0/1340585713 >> v2:172.21.15.159:3300/0 conn(0x7f53841608f0 0x7f53840d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:04.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.226+0000 7f5389b27640 1 -- 172.21.15.77:0/1340585713 >> 172.21.15.77:0/1340585713 conn(0x7f5384061340 msgr2=0x7f5384061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:04.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.226+0000 7f5389b27640 1 -- 172.21.15.77:0/1340585713 shutdown_connections 2023-11-26T07:23:04.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.226+0000 7f5389b27640 1 -- 172.21.15.77:0/1340585713 wait complete. 2023-11-26T07:23:04.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.228+0000 7f5389b27640 1 Processor -- start 2023-11-26T07:23:04.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.228+0000 7f5389b27640 1 -- start start 2023-11-26T07:23:04.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.229+0000 7f5389b27640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53840ce260 0x7f53840c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:04.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.229+0000 7f5389b27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53840d3890 0x7f53841f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:04.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.229+0000 7f5389b27640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53841608f0 0x7f538414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:04.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.229+0000 7f5389b27640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53840c69c0 con 0x7f53840d3890 2023-11-26T07:23:04.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.229+0000 7f5389b27640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53841f66a0 con 0x7f53841608f0 2023-11-26T07:23:04.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.229+0000 7f5389b27640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53841f6940 con 0x7f53840ce260 2023-11-26T07:23:04.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.229+0000 7f5383fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53840d3890 0x7f53841f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:04.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.229+0000 7f5383fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53840d3890 0x7f53841f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42482/0 (socket says 172.21.15.77:42482) 2023-11-26T07:23:04.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.229+0000 7f5383fff640 1 -- 172.21.15.77:0/574115831 learned_addr learned my addr 172.21.15.77:0/574115831 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:04.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.229+0000 7f5388b25640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53840ce260 0x7f53840c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:04.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f5389326640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53841608f0 0x7f538414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:04.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f5383fff640 1 -- 172.21.15.77:0/574115831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53840ce260 msgr2=0x7f53840c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:04.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f5383fff640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53840ce260 0x7f53840c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:04.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f5383fff640 1 -- 172.21.15.77:0/574115831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53841608f0 msgr2=0x7f538414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:04.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f5383fff640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53841608f0 0x7f538414d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:04.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f5383fff640 1 -- 172.21.15.77:0/574115831 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c009b30 con 0x7f53840d3890 2023-11-26T07:23:04.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f5383fff640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53840d3890 0x7f53841f6160 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f537000c430 tx=0x7f537000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:04.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f53817fa640 1 -- 172.21.15.77:0/574115831 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370011790 con 0x7f53840d3890 2023-11-26T07:23:04.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f53817fa640 1 -- 172.21.15.77:0/574115831 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53700118f0 con 0x7f53840d3890 2023-11-26T07:23:04.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f53817fa640 1 -- 172.21.15.77:0/574115831 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370011ce0 con 0x7f53840d3890 2023-11-26T07:23:04.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f5389b27640 1 -- 172.21.15.77:0/574115831 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53841f6c20 con 0x7f53840d3890 2023-11-26T07:23:04.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.230+0000 7f5389b27640 1 -- 172.21.15.77:0/574115831 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53840c6bd0 con 0x7f53840d3890 2023-11-26T07:23:04.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.232+0000 7f5389b27640 1 -- 172.21.15.77:0/574115831 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538404e840 con 0x7f53840d3890 2023-11-26T07:23:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.233+0000 7f53817fa640 1 -- 172.21.15.77:0/574115831 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f537001c460 con 0x7f53840d3890 2023-11-26T07:23:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.234+0000 7f53817fa640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f536806b6e0 0x7f536806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.234+0000 7f53817fa640 1 -- 172.21.15.77:0/574115831 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5370088000 con 0x7f53840d3890 2023-11-26T07:23:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.234+0000 7f5388b25640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f536806b6e0 0x7f536806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:04.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.234+0000 7f5388b25640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f536806b6e0 0x7f536806dba0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5378006fd0 tx=0x7f5378008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:04.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.238+0000 7f53817fa640 1 -- 172.21.15.77:0/574115831 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5370054930 con 0x7f53840d3890 2023-11-26T07:23:04.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:04.462+0000 7f5389b27640 1 -- 172.21.15.77:0/574115831 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f538415fc10 con 0x7f53840d3890 2023-11-26T07:23:05.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.007+0000 7f53817fa640 1 -- 172.21.15.77:0/574115831 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v41) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5370057f50 con 0x7f53840d3890 2023-11-26T07:23:05.010 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 10 and data pool 11 2023-11-26T07:23:05.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.012+0000 7f5389b27640 1 -- 172.21.15.77:0/574115831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f536806b6e0 msgr2=0x7f536806dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.012+0000 7f5389b27640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f536806b6e0 0x7f536806dba0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5378006fd0 tx=0x7f5378008040 comp rx=0 tx=0).stop 2023-11-26T07:23:05.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.012+0000 7f5389b27640 1 -- 172.21.15.77:0/574115831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53840d3890 msgr2=0x7f53841f6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.012+0000 7f5389b27640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53840d3890 0x7f53841f6160 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f537000c430 tx=0x7f537000c8f0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.013+0000 7f5389b27640 1 -- 172.21.15.77:0/574115831 shutdown_connections 2023-11-26T07:23:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.013+0000 7f5389b27640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f536806b6e0 0x7f536806dba0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.014+0000 7f5389b27640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53841608f0 0x7f538414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.014+0000 7f5389b27640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53840d3890 0x7f53841f6160 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.014+0000 7f5389b27640 1 --2- 172.21.15.77:0/574115831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53840ce260 0x7f53840c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.014+0000 7f5389b27640 1 -- 172.21.15.77:0/574115831 >> 172.21.15.77:0/574115831 conn(0x7f5384061340 msgr2=0x7f53840b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.014+0000 7f5389b27640 1 -- 172.21.15.77:0/574115831 shutdown_connections 2023-11-26T07:23:05.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.014+0000 7f5389b27640 1 -- 172.21.15.77:0/574115831 wait complete. 2023-11-26T07:23:05.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:23:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.229+0000 7f84e4483640 1 Processor -- start 2023-11-26T07:23:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.229+0000 7f84e4483640 1 -- start start 2023-11-26T07:23:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.230+0000 7f84e4483640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f84dc0b2250 0x7f84dc15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.230+0000 7f84e4483640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f84dc0b2aa0 0x7f84dc15b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.230+0000 7f84e4483640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84dc15ab80 con 0x7f84dc0b2630 2023-11-26T07:23:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.230+0000 7f84e4483640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84dc15a990 con 0x7f84dc0b2250 2023-11-26T07:23:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.230+0000 7f84e4483640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84dc15e680 con 0x7f84dc0b2aa0 2023-11-26T07:23:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.230+0000 7f84e221f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f84dc0b2250 0x7f84dc15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.231+0000 7f84e221f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f84dc0b2250 0x7f84dc15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42494/0 (socket says 172.21.15.77:42494) 2023-11-26T07:23:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.231+0000 7f84e221f640 1 -- 172.21.15.77:0/2732610868 learned_addr learned my addr 172.21.15.77:0/2732610868 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.231+0000 7f84e1a1e640 1 --1- 172.21.15.77:0/2732610868 >> v1:172.21.15.77:6789/0 conn(0x7f84dc0b2630 0x7f84dc0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49812/0 (socket says 172.21.15.77:49812) 2023-11-26T07:23:05.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.231+0000 7f84e221f640 1 -- 172.21.15.77:0/2732610868 >> v2:172.21.15.159:3300/0 conn(0x7f84dc0b2aa0 msgr2=0x7f84dc15b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:05.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.231+0000 7f84e221f640 1 --2- 172.21.15.77:0/2732610868 >> v2:172.21.15.159:3300/0 conn(0x7f84dc0b2aa0 0x7f84dc15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.231+0000 7f84e221f640 1 -- 172.21.15.77:0/2732610868 >> v1:172.21.15.77:6789/0 conn(0x7f84dc0b2630 legacy=0x7f84dc0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.231+0000 7f84e221f640 1 -- 172.21.15.77:0/2732610868 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc15e960 con 0x7f84dc0b2250 2023-11-26T07:23:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.232+0000 7f84e221f640 1 --2- 172.21.15.77:0/2732610868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84dc0b2250 0x7f84dc15df80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0b2fa0 tx=0x7f84d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953b52987e6c4e33 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.232+0000 7f84e121d640 1 -- 172.21.15.77:0/2732610868 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8030860 con 0x7f84dc0b2250 2023-11-26T07:23:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.232+0000 7f84e121d640 1 -- 172.21.15.77:0/2732610868 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d80309c0 con 0x7f84dc0b2250 2023-11-26T07:23:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.232+0000 7f84e121d640 1 -- 172.21.15.77:0/2732610868 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8030d50 con 0x7f84dc0b2250 2023-11-26T07:23:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.233+0000 7f84e4483640 1 -- 172.21.15.77:0/2732610868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84dc0b2250 msgr2=0x7f84dc15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.233+0000 7f84e4483640 1 --2- 172.21.15.77:0/2732610868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84dc0b2250 0x7f84dc15df80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0b2fa0 tx=0x7f84d802b9a0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.233+0000 7f84e4483640 1 -- 172.21.15.77:0/2732610868 shutdown_connections 2023-11-26T07:23:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.233+0000 7f84e4483640 1 --2- 172.21.15.77:0/2732610868 >> v2:172.21.15.159:3300/0 conn(0x7f84dc0b2aa0 0x7f84dc15b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.233+0000 7f84e4483640 1 --2- 172.21.15.77:0/2732610868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84dc0b2250 0x7f84dc15df80 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.233+0000 7f84e4483640 1 -- 172.21.15.77:0/2732610868 >> 172.21.15.77:0/2732610868 conn(0x7f84dc06a920 msgr2=0x7f84dc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.233+0000 7f84e4483640 1 -- 172.21.15.77:0/2732610868 shutdown_connections 2023-11-26T07:23:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.233+0000 7f84e4483640 1 -- 172.21.15.77:0/2732610868 wait complete. 2023-11-26T07:23:05.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.235+0000 7f84e4483640 1 Processor -- start 2023-11-26T07:23:05.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.235+0000 7f84e4483640 1 -- start start 2023-11-26T07:23:05.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.236+0000 7f84e4483640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84dc0b2250 0x7f84dc0720a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.236+0000 7f84e4483640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84dc0b2630 0x7f84dc0b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.236+0000 7f84e4483640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84dc0b2aa0 0x7f84dc0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.236+0000 7f84e4483640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc071490 con 0x7f84dc0b2630 2023-11-26T07:23:05.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.236+0000 7f84e4483640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc0705c0 con 0x7f84dc0b2aa0 2023-11-26T07:23:05.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.236+0000 7f84e4483640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc070810 con 0x7f84dc0b2250 2023-11-26T07:23:05.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.236+0000 7f84e1a1e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84dc0b2630 0x7f84dc0b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.236+0000 7f84e1a1e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84dc0b2630 0x7f84dc0b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42506/0 (socket says 172.21.15.77:42506) 2023-11-26T07:23:05.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.236+0000 7f84e1a1e640 1 -- 172.21.15.77:0/79737933 learned_addr learned my addr 172.21.15.77:0/79737933 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:05.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.237+0000 7f84e1a1e640 1 -- 172.21.15.77:0/79737933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84dc0b2250 msgr2=0x7f84dc0720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.237+0000 7f84e1a1e640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84dc0b2250 0x7f84dc0720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.237+0000 7f84e1a1e640 1 -- 172.21.15.77:0/79737933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84dc0b2aa0 msgr2=0x7f84dc0b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.237+0000 7f84e1a1e640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84dc0b2aa0 0x7f84dc0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.237+0000 7f84e1a1e640 1 -- 172.21.15.77:0/79737933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d80094d0 con 0x7f84dc0b2630 2023-11-26T07:23:05.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.237+0000 7f84e1a1e640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84dc0b2630 0x7f84dc0b0b90 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c4d0 tx=0x7f84cc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.237+0000 7f84d2ffd640 1 -- 172.21.15.77:0/79737933 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc007480 con 0x7f84dc0b2630 2023-11-26T07:23:05.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.237+0000 7f84d2ffd640 1 -- 172.21.15.77:0/79737933 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc0075e0 con 0x7f84dc0b2630 2023-11-26T07:23:05.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.237+0000 7f84e4483640 1 -- 172.21.15.77:0/79737933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84dc0cd7c0 con 0x7f84dc0b2630 2023-11-26T07:23:05.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.237+0000 7f84d2ffd640 1 -- 172.21.15.77:0/79737933 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0049e0 con 0x7f84dc0b2630 2023-11-26T07:23:05.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.237+0000 7f84e4483640 1 -- 172.21.15.77:0/79737933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84dc070dd0 con 0x7f84dc0b2630 2023-11-26T07:23:05.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.238+0000 7f84e4483640 1 -- 172.21.15.77:0/79737933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84dc067470 con 0x7f84dc0b2630 2023-11-26T07:23:05.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.240+0000 7f84d2ffd640 1 -- 172.21.15.77:0/79737933 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f84cc004b40 con 0x7f84dc0b2630 2023-11-26T07:23:05.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.241+0000 7f84d2ffd640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84c006b6b0 0x7f84c006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.241+0000 7f84d2ffd640 1 -- 172.21.15.77:0/79737933 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84cc0875a0 con 0x7f84dc0b2630 2023-11-26T07:23:05.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.241+0000 7f84e221f640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84c006b6b0 0x7f84c006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.242+0000 7f84e221f640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84c006b6b0 0x7f84c006db70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f84d8036000 tx=0x7f84d803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.245+0000 7f84d2ffd640 1 -- 172.21.15.77:0/79737933 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f84cc053f30 con 0x7f84dc0b2630 2023-11-26T07:23:05.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.424+0000 7f84e4483640 1 -- 172.21.15.77:0/79737933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84dc0cb460 con 0x7f84dc0b2630 2023-11-26T07:23:05.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.427+0000 7f84d2ffd640 1 -- 172.21.15.77:0/79737933 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16557 (secure 0 0 0) 0x7f84cc018090 con 0x7f84dc0b2630 2023-11-26T07:23:05.430 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:23:05.430 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":74,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:23:04.463931+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:02.276143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:03.495874+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:23:05.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.429+0000 7f84e4483640 1 -- 172.21.15.77:0/79737933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84c006b6b0 msgr2=0x7f84c006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.429+0000 7f84e4483640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84c006b6b0 0x7f84c006db70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f84d8036000 tx=0x7f84d803b040 comp rx=0 tx=0).stop 2023-11-26T07:23:05.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.429+0000 7f84e4483640 1 -- 172.21.15.77:0/79737933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84dc0b2630 msgr2=0x7f84dc0b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.429+0000 7f84e4483640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84dc0b2630 0x7f84dc0b0b90 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c4d0 tx=0x7f84cc00c990 comp rx=0 tx=0).stop 2023-11-26T07:23:05.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.429+0000 7f84e4483640 1 -- 172.21.15.77:0/79737933 shutdown_connections 2023-11-26T07:23:05.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.429+0000 7f84e4483640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f84c006b6b0 0x7f84c006db70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.429+0000 7f84e4483640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84dc0b2aa0 0x7f84dc0b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.429+0000 7f84e4483640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84dc0b2630 0x7f84dc0b0b90 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.429+0000 7f84e4483640 1 --2- 172.21.15.77:0/79737933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84dc0b2250 0x7f84dc0720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.429+0000 7f84e4483640 1 -- 172.21.15.77:0/79737933 >> 172.21.15.77:0/79737933 conn(0x7f84dc06a920 msgr2=0x7f84dc0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:05.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.430+0000 7f84e4483640 1 -- 172.21.15.77:0/79737933 shutdown_connections 2023-11-26T07:23:05.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.430+0000 7f84e4483640 1 -- 172.21.15.77:0/79737933 wait complete. 2023-11-26T07:23:05.450 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:23:05.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.656+0000 7f7afaec9640 1 Processor -- start 2023-11-26T07:23:05.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.656+0000 7f7afaec9640 1 -- start start 2023-11-26T07:23:05.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.658+0000 7f7afaec9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7af40b2250 0x7f7af415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.658+0000 7f7afaec9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7af40b2aa0 0x7f7af415b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.658+0000 7f7afaec9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af415ab80 con 0x7f7af40b2630 2023-11-26T07:23:05.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.658+0000 7f7afaec9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af415a990 con 0x7f7af40b2aa0 2023-11-26T07:23:05.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.658+0000 7f7afaec9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af415e680 con 0x7f7af40b2250 2023-11-26T07:23:05.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.658+0000 7f7af9466640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7af40b2aa0 0x7f7af415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.658+0000 7f7af3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7af40b2630 0x7f7af40ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49820/0 (socket says 172.21.15.77:49820) 2023-11-26T07:23:05.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.658+0000 7f7af9466640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7af40b2aa0 0x7f7af415b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42516/0 (socket says 172.21.15.77:42516) 2023-11-26T07:23:05.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.658+0000 7f7af3fff640 1 -- 172.21.15.77:0/203358301 learned_addr learned my addr 172.21.15.77:0/203358301 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:05.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.659+0000 7f7af8c65640 1 --2- 172.21.15.77:0/203358301 >> v2:172.21.15.159:3300/0 conn(0x7f7af40b2250 0x7f7af415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.659+0000 7f7af9466640 1 -- 172.21.15.77:0/203358301 >> v2:172.21.15.159:3300/0 conn(0x7f7af40b2250 msgr2=0x7f7af415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:05.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.659+0000 7f7af9466640 1 --2- 172.21.15.77:0/203358301 >> v2:172.21.15.159:3300/0 conn(0x7f7af40b2250 0x7f7af415df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.659+0000 7f7af9466640 1 -- 172.21.15.77:0/203358301 >> v1:172.21.15.77:6789/0 conn(0x7f7af40b2630 legacy=0x7f7af40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.659+0000 7f7af9466640 1 -- 172.21.15.77:0/203358301 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af415e960 con 0x7f7af40b2aa0 2023-11-26T07:23:05.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.659+0000 7f7af37fe640 1 -- 172.21.15.77:0/203358301 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075374503 0 0) 0x7f7af415ab80 con 0x7f7af40b2630 2023-11-26T07:23:05.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.660+0000 7f7af9466640 1 --2- 172.21.15.77:0/203358301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7af40b2aa0 0x7f7af415b080 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f7af4072a70 tx=0x7f7aec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c97b87a876bfd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.660+0000 7f7af37fe640 1 -- 172.21.15.77:0/203358301 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec02cc80 con 0x7f7af40b2aa0 2023-11-26T07:23:05.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.660+0000 7f7af37fe640 1 -- 172.21.15.77:0/203358301 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec02cde0 con 0x7f7af40b2aa0 2023-11-26T07:23:05.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.660+0000 7f7af37fe640 1 -- 172.21.15.77:0/203358301 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec034660 con 0x7f7af40b2aa0 2023-11-26T07:23:05.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.661+0000 7f7afaec9640 1 -- 172.21.15.77:0/203358301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7af40b2aa0 msgr2=0x7f7af415b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.661+0000 7f7afaec9640 1 --2- 172.21.15.77:0/203358301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7af40b2aa0 0x7f7af415b080 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f7af4072a70 tx=0x7f7aec02bed0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.661+0000 7f7afaec9640 1 -- 172.21.15.77:0/203358301 shutdown_connections 2023-11-26T07:23:05.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.661+0000 7f7afaec9640 1 --2- 172.21.15.77:0/203358301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7af40b2aa0 0x7f7af415b080 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.661+0000 7f7afaec9640 1 --2- 172.21.15.77:0/203358301 >> v2:172.21.15.159:3300/0 conn(0x7f7af40b2250 0x7f7af415df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.661+0000 7f7afaec9640 1 -- 172.21.15.77:0/203358301 >> 172.21.15.77:0/203358301 conn(0x7f7af406a920 msgr2=0x7f7af406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:05.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.661+0000 7f7afaec9640 1 -- 172.21.15.77:0/203358301 shutdown_connections 2023-11-26T07:23:05.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.661+0000 7f7afaec9640 1 -- 172.21.15.77:0/203358301 wait complete. 2023-11-26T07:23:05.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.663+0000 7f7afaec9640 1 Processor -- start 2023-11-26T07:23:05.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.663+0000 7f7afaec9640 1 -- start start 2023-11-26T07:23:05.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.664+0000 7f7afaec9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7af40b2250 0x7f7af415cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.664+0000 7f7afaec9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af40b2630 0x7f7af40b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.664+0000 7f7afaec9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af40b2aa0 0x7f7af40983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.664+0000 7f7afaec9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af40b0fd0 con 0x7f7af40b2250 2023-11-26T07:23:05.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.664+0000 7f7afaec9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af41551d0 con 0x7f7af40b2630 2023-11-26T07:23:05.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.664+0000 7f7afaec9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af41554b0 con 0x7f7af40b2aa0 2023-11-26T07:23:05.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.664+0000 7f7af8c65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7af40b2250 0x7f7af415cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.664+0000 7f7af8c65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7af40b2250 0x7f7af415cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42530/0 (socket says 172.21.15.77:42530) 2023-11-26T07:23:05.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.664+0000 7f7af8c65640 1 -- 172.21.15.77:0/1701954296 learned_addr learned my addr 172.21.15.77:0/1701954296 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:05.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7af3fff640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af40b2630 0x7f7af40b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7af9466640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af40b2aa0 0x7f7af40983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7af8c65640 1 -- 172.21.15.77:0/1701954296 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af40b2aa0 msgr2=0x7f7af40983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7af8c65640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af40b2aa0 0x7f7af40983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7af8c65640 1 -- 172.21.15.77:0/1701954296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af40b2630 msgr2=0x7f7af40b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7af8c65640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af40b2630 0x7f7af40b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7af8c65640 1 -- 172.21.15.77:0/1701954296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec009a70 con 0x7f7af40b2250 2023-11-26T07:23:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7af8c65640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7af40b2250 0x7f7af415cc40 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800d800 tx=0x7f7ae800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7af17fa640 1 -- 172.21.15.77:0/1701954296 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae800b6c0 con 0x7f7af40b2250 2023-11-26T07:23:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7af17fa640 1 -- 172.21.15.77:0/1701954296 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae800b820 con 0x7f7af40b2250 2023-11-26T07:23:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7af17fa640 1 -- 172.21.15.77:0/1701954296 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae800bbb0 con 0x7f7af40b2250 2023-11-26T07:23:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.665+0000 7f7afaec9640 1 -- 172.21.15.77:0/1701954296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af40cd7c0 con 0x7f7af40b2250 2023-11-26T07:23:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.666+0000 7f7afaec9640 1 -- 172.21.15.77:0/1701954296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af40afa70 con 0x7f7af40b2250 2023-11-26T07:23:05.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.667+0000 7f7afaec9640 1 -- 172.21.15.77:0/1701954296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af4067470 con 0x7f7af40b2250 2023-11-26T07:23:05.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.668+0000 7f7af17fa640 1 -- 172.21.15.77:0/1701954296 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f7ae800bd10 con 0x7f7af40b2250 2023-11-26T07:23:05.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.669+0000 7f7af17fa640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ad806b6b0 0x7f7ad806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.669+0000 7f7af17fa640 1 -- 172.21.15.77:0/1701954296 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ae80885d0 con 0x7f7af40b2250 2023-11-26T07:23:05.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.669+0000 7f7af3fff640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ad806b6b0 0x7f7ad806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.669+0000 7f7af3fff640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ad806b6b0 0x7f7ad806db70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0007fd0 tx=0x7f7ae0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.673+0000 7f7af17fa640 1 -- 172.21.15.77:0/1701954296 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ae8054f60 con 0x7f7af40b2250 2023-11-26T07:23:05.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.867+0000 7f7afaec9640 1 -- 172.21.15.77:0/1701954296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7af4155030 con 0x7f7af40b2250 2023-11-26T07:23:05.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.870+0000 7f7af17fa640 1 -- 172.21.15.77:0/1701954296 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16557 (secure 0 0 0) 0x7f7af4155030 con 0x7f7af40b2250 2023-11-26T07:23:05.873 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:23:05.873 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":74,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:23:04.463931+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:02.276143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:03.495874+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:23:05.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 -- 172.21.15.77:0/1701954296 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ad806b6b0 msgr2=0x7f7ad806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ad806b6b0 0x7f7ad806db70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0007fd0 tx=0x7f7ae0009040 comp rx=0 tx=0).stop 2023-11-26T07:23:05.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 -- 172.21.15.77:0/1701954296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7af40b2250 msgr2=0x7f7af415cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7af40b2250 0x7f7af415cc40 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800d800 tx=0x7f7ae800dcc0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 -- 172.21.15.77:0/1701954296 shutdown_connections 2023-11-26T07:23:05.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7ad806b6b0 0x7f7ad806db70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af40b2aa0 0x7f7af40983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af40b2630 0x7f7af40b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 --2- 172.21.15.77:0/1701954296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7af40b2250 0x7f7af415cc40 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 -- 172.21.15.77:0/1701954296 >> 172.21.15.77:0/1701954296 conn(0x7f7af406a920 msgr2=0x7f7af415ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:05.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 -- 172.21.15.77:0/1701954296 shutdown_connections 2023-11-26T07:23:05.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:05.873+0000 7f7afaec9640 1 -- 172.21.15.77:0/1701954296 wait complete. 2023-11-26T07:23:05.895 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:23:05.969 INFO:tasks.ceph.mds.c.smithi077.stderr:2023-11-26T07:23:05.966+0000 7f3eb31f2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:23:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.112+0000 7f4050b78640 1 Processor -- start 2023-11-26T07:23:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.112+0000 7f4050b78640 1 -- start start 2023-11-26T07:23:06.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.114+0000 7f4050b78640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f404c0ccbd0 0x7f404c1660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.114+0000 7f4050b78640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f404c0ccfb0 0x7f404c162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.114+0000 7f4050b78640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f404c162540 0x7f404c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.114+0000 7f4050b78640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c1655f0 con 0x7f404c0ccfb0 2023-11-26T07:23:06.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.114+0000 7f4050b78640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c0cc380 con 0x7f404c162540 2023-11-26T07:23:06.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.114+0000 7f4050b78640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c162b30 con 0x7f404c0ccbd0 2023-11-26T07:23:06.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.114+0000 7f4049d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f404c0ccfb0 0x7f404c162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.114+0000 7f4049d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f404c0ccfb0 0x7f404c162000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49734/0 (socket says 172.21.15.77:49734) 2023-11-26T07:23:06.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.114+0000 7f4049d9b640 1 -- 172.21.15.77:0/1026741327 learned_addr learned my addr 172.21.15.77:0/1026741327 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:06.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.115+0000 7f404ad9d640 1 --2- 172.21.15.77:0/1026741327 >> v2:172.21.15.159:3300/0 conn(0x7f404c162540 0x7f404c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.115+0000 7f404a59c640 1 --2- 172.21.15.77:0/1026741327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f404c0ccbd0 0x7f404c1660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.115+0000 7f4049d9b640 1 -- 172.21.15.77:0/1026741327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f404c0ccbd0 msgr2=0x7f404c1660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:06.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.115+0000 7f4049d9b640 1 --2- 172.21.15.77:0/1026741327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f404c0ccbd0 0x7f404c1660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.115+0000 7f4049d9b640 1 -- 172.21.15.77:0/1026741327 >> v2:172.21.15.159:3300/0 conn(0x7f404c162540 msgr2=0x7f404c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:06.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.115+0000 7f4049d9b640 1 --2- 172.21.15.77:0/1026741327 >> v2:172.21.15.159:3300/0 conn(0x7f404c162540 0x7f404c0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.115+0000 7f4049d9b640 1 -- 172.21.15.77:0/1026741327 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c162e10 con 0x7f404c0ccfb0 2023-11-26T07:23:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.116+0000 7f4049d9b640 1 --2- 172.21.15.77:0/1026741327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f404c0ccfb0 0x7f404c162000 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4040009870 tx=0x7f404002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fe643b60d3bfcf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.117+0000 7f404959a640 1 -- 172.21.15.77:0/1026741327 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040031640 con 0x7f404c0ccfb0 2023-11-26T07:23:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.117+0000 7f404959a640 1 -- 172.21.15.77:0/1026741327 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40400317a0 con 0x7f404c0ccfb0 2023-11-26T07:23:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.117+0000 7f404959a640 1 -- 172.21.15.77:0/1026741327 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040031b30 con 0x7f404c0ccfb0 2023-11-26T07:23:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.117+0000 7f4050b78640 1 -- 172.21.15.77:0/1026741327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f404c0ccfb0 msgr2=0x7f404c162000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.117+0000 7f4050b78640 1 --2- 172.21.15.77:0/1026741327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f404c0ccfb0 0x7f404c162000 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4040009870 tx=0x7f404002b8f0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.117+0000 7f4050b78640 1 -- 172.21.15.77:0/1026741327 shutdown_connections 2023-11-26T07:23:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.117+0000 7f4050b78640 1 --2- 172.21.15.77:0/1026741327 >> v2:172.21.15.159:3300/0 conn(0x7f404c162540 0x7f404c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.117+0000 7f4050b78640 1 --2- 172.21.15.77:0/1026741327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f404c0ccfb0 0x7f404c162000 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.117+0000 7f4050b78640 1 --2- 172.21.15.77:0/1026741327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f404c0ccbd0 0x7f404c1660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.117+0000 7f4050b78640 1 -- 172.21.15.77:0/1026741327 >> 172.21.15.77:0/1026741327 conn(0x7f404c0b0c50 msgr2=0x7f404c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.118+0000 7f4050b78640 1 -- 172.21.15.77:0/1026741327 shutdown_connections 2023-11-26T07:23:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.118+0000 7f4050b78640 1 -- 172.21.15.77:0/1026741327 wait complete. 2023-11-26T07:23:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.119+0000 7f4050b78640 1 Processor -- start 2023-11-26T07:23:06.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.120+0000 7f4050b78640 1 -- start start 2023-11-26T07:23:06.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.120+0000 7f4050b78640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f404c0ccbd0 0x7f404c158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.120+0000 7f4050b78640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f404c0ccfb0 0x7f404c0c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4050b78640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f404c162540 0x7f404c0c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4050b78640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c0ac620 con 0x7f404c0ccfb0 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4050b78640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c0c67d0 con 0x7f404c0ccbd0 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4050b78640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c0c90e0 con 0x7f404c162540 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4049d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f404c0ccfb0 0x7f404c0c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4049d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f404c0ccfb0 0x7f404c0c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49736/0 (socket says 172.21.15.77:49736) 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4049d9b640 1 -- 172.21.15.77:0/807285885 learned_addr learned my addr 172.21.15.77:0/807285885 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4049d9b640 1 -- 172.21.15.77:0/807285885 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f404c162540 msgr2=0x7f404c0c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4049d9b640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f404c162540 0x7f404c0c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f404a59c640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f404c0ccbd0 0x7f404c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4049d9b640 1 -- 172.21.15.77:0/807285885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f404c0ccbd0 msgr2=0x7f404c158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4049d9b640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f404c0ccbd0 0x7f404c158920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.121+0000 7f4049d9b640 1 -- 172.21.15.77:0/807285885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40400094d0 con 0x7f404c0ccfb0 2023-11-26T07:23:06.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.122+0000 7f4049d9b640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f404c0ccfb0 0x7f404c0c8770 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4040000c00 tx=0x7f40400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:06.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.122+0000 7f403affd640 1 -- 172.21.15.77:0/807285885 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404003ac60 con 0x7f404c0ccfb0 2023-11-26T07:23:06.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.122+0000 7f403affd640 1 -- 172.21.15.77:0/807285885 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404003ade0 con 0x7f404c0ccfb0 2023-11-26T07:23:06.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.122+0000 7f403affd640 1 -- 172.21.15.77:0/807285885 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040044630 con 0x7f404c0ccfb0 2023-11-26T07:23:06.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.122+0000 7f4050b78640 1 -- 172.21.15.77:0/807285885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c0c8e00 con 0x7f404c0ccfb0 2023-11-26T07:23:06.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.122+0000 7f4050b78640 1 -- 172.21.15.77:0/807285885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c0ac2b0 con 0x7f404c0ccfb0 2023-11-26T07:23:06.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.123+0000 7f4050b78640 1 -- 172.21.15.77:0/807285885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c0c9440 con 0x7f404c0ccfb0 2023-11-26T07:23:06.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.124+0000 7f403affd640 1 -- 172.21.15.77:0/807285885 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f404002f050 con 0x7f404c0ccfb0 2023-11-26T07:23:06.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.125+0000 7f403affd640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f402c06b6e0 0x7f402c06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.125+0000 7f403affd640 1 -- 172.21.15.77:0/807285885 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40400aa1d0 con 0x7f404c0ccfb0 2023-11-26T07:23:06.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.125+0000 7f404a59c640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f402c06b6e0 0x7f402c06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.126+0000 7f404a59c640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f402c06b6e0 0x7f402c06dba0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f403c00b7e0 tx=0x7f403c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:06.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.130+0000 7f403affd640 1 -- 172.21.15.77:0/807285885 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4040076b00 con 0x7f404c0ccfb0 2023-11-26T07:23:06.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:06.357+0000 7f4050b78640 1 -- 172.21.15.77:0/807285885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f404c04e8b0 con 0x7f404c0ccfb0 2023-11-26T07:23:07.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.038+0000 7f403affd640 1 -- 172.21.15.77:0/807285885 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7f40400350b0 con 0x7f404c0ccfb0 2023-11-26T07:23:07.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.042+0000 7f4050b78640 1 -- 172.21.15.77:0/807285885 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f402c06b6e0 msgr2=0x7f402c06dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.042+0000 7f4050b78640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f402c06b6e0 0x7f402c06dba0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f403c00b7e0 tx=0x7f403c008040 comp rx=0 tx=0).stop 2023-11-26T07:23:07.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.042+0000 7f4050b78640 1 -- 172.21.15.77:0/807285885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f404c0ccfb0 msgr2=0x7f404c0c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.042+0000 7f4050b78640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f404c0ccfb0 0x7f404c0c8770 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4040000c00 tx=0x7f40400046c0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.043+0000 7f4050b78640 1 -- 172.21.15.77:0/807285885 shutdown_connections 2023-11-26T07:23:07.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.043+0000 7f4050b78640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f402c06b6e0 0x7f402c06dba0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.043+0000 7f4050b78640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f404c162540 0x7f404c0c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.043+0000 7f4050b78640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f404c0ccfb0 0x7f404c0c8770 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.043+0000 7f4050b78640 1 --2- 172.21.15.77:0/807285885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f404c0ccbd0 0x7f404c158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.043+0000 7f4050b78640 1 -- 172.21.15.77:0/807285885 >> 172.21.15.77:0/807285885 conn(0x7f404c0b0c50 msgr2=0x7f404c06d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.043+0000 7f4050b78640 1 -- 172.21.15.77:0/807285885 shutdown_connections 2023-11-26T07:23:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.043+0000 7f4050b78640 1 -- 172.21.15.77:0/807285885 wait complete. 2023-11-26T07:23:07.069 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:23:07.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:23:07.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.289+0000 7fcee8389640 1 Processor -- start 2023-11-26T07:23:07.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.289+0000 7fcee8389640 1 -- start start 2023-11-26T07:23:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.291+0000 7fcee8389640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee015b440 0x7fcee00cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.291+0000 7fcee8389640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcee00cbf20 0x7fcee00c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.291+0000 7fcee8389640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee00cc3a0 con 0x7fcee00c57e0 2023-11-26T07:23:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.291+0000 7fcee8389640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee015b820 con 0x7fcee00cbf20 2023-11-26T07:23:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.291+0000 7fcee8389640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee015eea0 con 0x7fcee015b440 2023-11-26T07:23:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.292+0000 7fcee5924640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcee00cbf20 0x7fcee00c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.292+0000 7fcee5924640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcee00cbf20 0x7fcee00c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49752/0 (socket says 172.21.15.77:49752) 2023-11-26T07:23:07.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.292+0000 7fcee5924640 1 -- 172.21.15.77:0/2624847454 learned_addr learned my addr 172.21.15.77:0/2624847454 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.292+0000 7fcee5924640 1 -- 172.21.15.77:0/2624847454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee015b440 msgr2=0x7fcee00cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.292+0000 7fcee6125640 1 --2- 172.21.15.77:0/2624847454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee015b440 0x7fcee00cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.292+0000 7fcee5924640 1 --2- 172.21.15.77:0/2624847454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee015b440 0x7fcee00cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.292+0000 7fcee5924640 1 -- 172.21.15.77:0/2624847454 >> v1:172.21.15.159:6789/0 conn(0x7fcee00c57e0 legacy=0x7fcee00c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.292+0000 7fcee5924640 1 -- 172.21.15.77:0/2624847454 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee006d600 con 0x7fcee00cbf20 2023-11-26T07:23:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.292+0000 7fcee6125640 1 --2- 172.21.15.77:0/2624847454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee015b440 0x7fcee00cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.293+0000 7fcee5924640 1 --2- 172.21.15.77:0/2624847454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee00cbf20 0x7fcee00c52a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fced0009870 tx=0x7fced002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d17b6e0eb74ab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.294+0000 7fcee5123640 1 -- 172.21.15.77:0/2624847454 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced00317c0 con 0x7fcee00cbf20 2023-11-26T07:23:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.294+0000 7fcee5123640 1 -- 172.21.15.77:0/2624847454 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0031920 con 0x7fcee00cbf20 2023-11-26T07:23:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.294+0000 7fcee5123640 1 -- 172.21.15.77:0/2624847454 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0031cb0 con 0x7fcee00cbf20 2023-11-26T07:23:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.294+0000 7fcee8389640 1 -- 172.21.15.77:0/2624847454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee00cbf20 msgr2=0x7fcee00c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.294+0000 7fcee8389640 1 --2- 172.21.15.77:0/2624847454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee00cbf20 0x7fcee00c52a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fced0009870 tx=0x7fced002b860 comp rx=0 tx=0).stop 2023-11-26T07:23:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.294+0000 7fcee8389640 1 -- 172.21.15.77:0/2624847454 shutdown_connections 2023-11-26T07:23:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.294+0000 7fcee8389640 1 --2- 172.21.15.77:0/2624847454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee00cbf20 0x7fcee00c52a0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.294+0000 7fcee8389640 1 --2- 172.21.15.77:0/2624847454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee015b440 0x7fcee00cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.294+0000 7fcee8389640 1 -- 172.21.15.77:0/2624847454 >> 172.21.15.77:0/2624847454 conn(0x7fcee00b0c50 msgr2=0x7fcee00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.294+0000 7fcee8389640 1 -- 172.21.15.77:0/2624847454 shutdown_connections 2023-11-26T07:23:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.294+0000 7fcee8389640 1 -- 172.21.15.77:0/2624847454 wait complete. 2023-11-26T07:23:07.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.296+0000 7fcee8389640 1 Processor -- start 2023-11-26T07:23:07.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.296+0000 7fcee8389640 1 -- start start 2023-11-26T07:23:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.297+0000 7fcee8389640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00c57e0 0x7fcee00afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.297+0000 7fcee8389640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee00cbf20 0x7fcee0156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.297+0000 7fcee8389640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee015b440 0x7fcee01545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.297+0000 7fcee8389640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee015db30 con 0x7fcee015b440 2023-11-26T07:23:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.297+0000 7fcee8389640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee015de10 con 0x7fcee00c57e0 2023-11-26T07:23:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.297+0000 7fcee8389640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee015e0f0 con 0x7fcee00cbf20 2023-11-26T07:23:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee6926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee015b440 0x7fcee01545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee6926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee015b440 0x7fcee01545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49762/0 (socket says 172.21.15.77:49762) 2023-11-26T07:23:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee6926640 1 -- 172.21.15.77:0/3990889679 learned_addr learned my addr 172.21.15.77:0/3990889679 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee6125640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00c57e0 0x7fcee00afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee5924640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee00cbf20 0x7fcee0156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee6926640 1 -- 172.21.15.77:0/3990889679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee00cbf20 msgr2=0x7fcee0156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee6926640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee00cbf20 0x7fcee0156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee6926640 1 -- 172.21.15.77:0/3990889679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00c57e0 msgr2=0x7fcee00afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee6926640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00c57e0 0x7fcee00afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee6926640 1 -- 172.21.15.77:0/3990889679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00094d0 con 0x7fcee015b440 2023-11-26T07:23:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee6125640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00c57e0 0x7fcee00afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee5924640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee00cbf20 0x7fcee0156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.298+0000 7fcee6926640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee015b440 0x7fcee01545c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fced800c780 tx=0x7fced800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.299+0000 7fced6ffd640 1 -- 172.21.15.77:0/3990889679 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8004b60 con 0x7fcee015b440 2023-11-26T07:23:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.299+0000 7fced6ffd640 1 -- 172.21.15.77:0/3990889679 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced800ce90 con 0x7fcee015b440 2023-11-26T07:23:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.299+0000 7fced6ffd640 1 -- 172.21.15.77:0/3990889679 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced800a850 con 0x7fcee015b440 2023-11-26T07:23:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.299+0000 7fcee8389640 1 -- 172.21.15.77:0/3990889679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee015e3d0 con 0x7fcee015b440 2023-11-26T07:23:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.299+0000 7fcee8389640 1 -- 172.21.15.77:0/3990889679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee01554b0 con 0x7fcee015b440 2023-11-26T07:23:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.300+0000 7fcee8389640 1 -- 172.21.15.77:0/3990889679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee004e8b0 con 0x7fcee015b440 2023-11-26T07:23:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.301+0000 7fced6ffd640 1 -- 172.21.15.77:0/3990889679 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fced800a9b0 con 0x7fcee015b440 2023-11-26T07:23:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.302+0000 7fced6ffd640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcec406b6e0 0x7fcec406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.302+0000 7fced6ffd640 1 -- 172.21.15.77:0/3990889679 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fced8088240 con 0x7fcee015b440 2023-11-26T07:23:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.302+0000 7fcee6125640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcec406b6e0 0x7fcec406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.303+0000 7fcee6125640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcec406b6e0 0x7fcec406dba0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcedc006fd0 tx=0x7fcedc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.306+0000 7fced6ffd640 1 -- 172.21.15.77:0/3990889679 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fced8054ae0 con 0x7fcee015b440 2023-11-26T07:23:07.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:07.538+0000 7fcee8389640 1 -- 172.21.15.77:0/3990889679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcee006dc80 con 0x7fcee015b440 2023-11-26T07:23:08.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.050+0000 7fced6ffd640 1 -- 172.21.15.77:0/3990889679 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) v1 ==== 122+0+0 (secure 0 0 0) 0x7fced8058100 con 0x7fcee015b440 2023-11-26T07:23:08.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.053+0000 7fcee8389640 1 -- 172.21.15.77:0/3990889679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcec406b6e0 msgr2=0x7fcec406dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.053+0000 7fcee8389640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcec406b6e0 0x7fcec406dba0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcedc006fd0 tx=0x7fcedc008040 comp rx=0 tx=0).stop 2023-11-26T07:23:08.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.053+0000 7fcee8389640 1 -- 172.21.15.77:0/3990889679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee015b440 msgr2=0x7fcee01545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.053+0000 7fcee8389640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee015b440 0x7fcee01545c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fced800c780 tx=0x7fced800cc40 comp rx=0 tx=0).stop 2023-11-26T07:23:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.054+0000 7fcee8389640 1 -- 172.21.15.77:0/3990889679 shutdown_connections 2023-11-26T07:23:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.054+0000 7fcee8389640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fcec406b6e0 0x7fcec406dba0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.054+0000 7fcee8389640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee015b440 0x7fcee01545c0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.054+0000 7fcee8389640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee00cbf20 0x7fcee0156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.054+0000 7fcee8389640 1 --2- 172.21.15.77:0/3990889679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00c57e0 0x7fcee00afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.054+0000 7fcee8389640 1 -- 172.21.15.77:0/3990889679 >> 172.21.15.77:0/3990889679 conn(0x7fcee00b0c50 msgr2=0x7fcee00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.054+0000 7fcee8389640 1 -- 172.21.15.77:0/3990889679 shutdown_connections 2023-11-26T07:23:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.054+0000 7fcee8389640 1 -- 172.21.15.77:0/3990889679 wait complete. 2023-11-26T07:23:08.077 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:23:08.077 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:23:08.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.282+0000 7f470bc9b640 1 Processor -- start 2023-11-26T07:23:08.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.283+0000 7f470bc9b640 1 -- start start 2023-11-26T07:23:08.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.284+0000 7f470bc9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47040b2250 0x7f470415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.284+0000 7f470bc9b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f47040b2a70 0x7f470415b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.284+0000 7f470bc9b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470415ab80 con 0x7f47040b2630 2023-11-26T07:23:08.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.284+0000 7f470bc9b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470415a990 con 0x7f47040b2a70 2023-11-26T07:23:08.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.284+0000 7f470bc9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470415e680 con 0x7f47040b2250 2023-11-26T07:23:08.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.284+0000 7f4709236640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f47040b2630 0x7f47040ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45802/0 (socket says 172.21.15.77:45802) 2023-11-26T07:23:08.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.284+0000 7f4709236640 1 -- 172.21.15.77:0/3164825386 learned_addr learned my addr 172.21.15.77:0/3164825386 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:08.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f4709a37640 1 --2- 172.21.15.77:0/3164825386 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47040b2250 0x7f470415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f470a238640 1 --2- 172.21.15.77:0/3164825386 >> v2:172.21.15.159:3300/0 conn(0x7f47040b2a70 0x7f470415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420994356 0 0) 0x7f470415ab80 con 0x7f47040b2630 2023-11-26T07:23:08.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46f0003520 con 0x7f47040b2630 2023-11-26T07:23:08.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4271210522 0 0) 0x7f46f0003520 con 0x7f47040b2630 2023-11-26T07:23:08.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47040b2250 msgr2=0x7f470415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f4708a35640 1 --2- 172.21.15.77:0/3164825386 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47040b2250 0x7f470415df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 >> v2:172.21.15.159:3300/0 conn(0x7f47040b2a70 msgr2=0x7f470415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f4708a35640 1 --2- 172.21.15.77:0/3164825386 >> v2:172.21.15.159:3300/0 conn(0x7f47040b2a70 0x7f470415b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470415e960 con 0x7f47040b2630 2023-11-26T07:23:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f46f4001670 con 0x7f47040b2630 2023-11-26T07:23:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.285+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 >> v1:172.21.15.77:6789/0 conn(0x7f47040b2630 legacy=0x7f47040ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4708a35640 1 --2- 172.21.15.77:0/3164825386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46f0003970 0x7f46f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4708a35640 1 --2- 172.21.15.77:0/3164825386 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47040b2250 0x7f46f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4708a35640 1 --2- 172.21.15.77:0/3164825386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46f0004d00 0x7f46f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470415e680 con 0x7f46f0003970 2023-11-26T07:23:08.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f000b980 con 0x7f46f0004d00 2023-11-26T07:23:08.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f000bac0 con 0x7f47040b2250 2023-11-26T07:23:08.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4709a37640 1 --2- 172.21.15.77:0/3164825386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46f0003970 0x7f46f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4709a37640 1 -- 172.21.15.77:0/3164825386 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47040b2250 msgr2=0x7f46f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:08.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4709a37640 1 --2- 172.21.15.77:0/3164825386 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47040b2250 0x7f46f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4709a37640 1 -- 172.21.15.77:0/3164825386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46f0004d00 msgr2=0x7f46f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:08.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f470a238640 1 --2- 172.21.15.77:0/3164825386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46f0004d00 0x7f46f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4709a37640 1 --2- 172.21.15.77:0/3164825386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46f0004d00 0x7f46f0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.286+0000 7f4709a37640 1 -- 172.21.15.77:0/3164825386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0003520 con 0x7f46f0003970 2023-11-26T07:23:08.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.287+0000 7f4709a37640 1 --2- 172.21.15.77:0/3164825386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46f0003970 0x7f46f0003d90 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4700009ac0 tx=0x7f46f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403a18d4cb813367 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:08.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.288+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470002c710 con 0x7f46f0003970 2023-11-26T07:23:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.288+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470002c870 con 0x7f46f0003970 2023-11-26T07:23:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.288+0000 7f4708a35640 1 -- 172.21.15.77:0/3164825386 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470002cc00 con 0x7f46f0003970 2023-11-26T07:23:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.288+0000 7f470bc9b640 1 -- 172.21.15.77:0/3164825386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46f0003970 msgr2=0x7f46f0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.288+0000 7f470bc9b640 1 --2- 172.21.15.77:0/3164825386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46f0003970 0x7f46f0003d90 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4700009ac0 tx=0x7f46f00057f0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.288+0000 7f470a238640 1 -- 172.21.15.77:0/3164825386 reap_dead start 2023-11-26T07:23:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.288+0000 7f470bc9b640 1 -- 172.21.15.77:0/3164825386 shutdown_connections 2023-11-26T07:23:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.288+0000 7f470bc9b640 1 -- 172.21.15.77:0/3164825386 >> 172.21.15.77:0/3164825386 conn(0x7f470406a920 msgr2=0x7f470406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.288+0000 7f470bc9b640 1 -- 172.21.15.77:0/3164825386 shutdown_connections 2023-11-26T07:23:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.288+0000 7f470bc9b640 1 -- 172.21.15.77:0/3164825386 wait complete. 2023-11-26T07:23:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.290+0000 7f470bc9b640 1 Processor -- start 2023-11-26T07:23:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.290+0000 7f470bc9b640 1 -- start start 2023-11-26T07:23:08.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.291+0000 7f470bc9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46f0003970 0x7f47040c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.291+0000 7f470bc9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47040af510 0x7f470414bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.291+0000 7f470bc9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47040af970 0x7f470414c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.291+0000 7f470bc9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47040afed0 con 0x7f47040af970 2023-11-26T07:23:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.291+0000 7f470bc9b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47040b01b0 con 0x7f47040af510 2023-11-26T07:23:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.291+0000 7f470bc9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47040b0490 con 0x7f46f0003970 2023-11-26T07:23:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f470a238640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47040af970 0x7f470414c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f470a238640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47040af970 0x7f470414c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49772/0 (socket says 172.21.15.77:49772) 2023-11-26T07:23:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f470a238640 1 -- 172.21.15.77:0/713782272 learned_addr learned my addr 172.21.15.77:0/713782272 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f4709a37640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46f0003970 0x7f47040c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f4709236640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47040af510 0x7f470414bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f470a238640 1 -- 172.21.15.77:0/713782272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46f0003970 msgr2=0x7f47040c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f470a238640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46f0003970 0x7f47040c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f470a238640 1 -- 172.21.15.77:0/713782272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47040af510 msgr2=0x7f470414bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f470a238640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47040af510 0x7f470414bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f470a238640 1 -- 172.21.15.77:0/713782272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040cd7c0 con 0x7f47040af970 2023-11-26T07:23:08.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f4709236640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47040af510 0x7f470414bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:08.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.292+0000 7f470a238640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47040af970 0x7f470414c4b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f47040b2fa0 tx=0x7f46fc00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:08.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.293+0000 7f46fa7fc640 1 -- 172.21.15.77:0/713782272 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc01a070 con 0x7f47040af970 2023-11-26T07:23:08.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.293+0000 7f46fa7fc640 1 -- 172.21.15.77:0/713782272 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc00fd90 con 0x7f47040af970 2023-11-26T07:23:08.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.293+0000 7f46fa7fc640 1 -- 172.21.15.77:0/713782272 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc003bb0 con 0x7f47040af970 2023-11-26T07:23:08.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.293+0000 7f470bc9b640 1 -- 172.21.15.77:0/713782272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47040b0770 con 0x7f47040af970 2023-11-26T07:23:08.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.293+0000 7f470bc9b640 1 -- 172.21.15.77:0/713782272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47040c9b60 con 0x7f47040af970 2023-11-26T07:23:08.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.294+0000 7f470bc9b640 1 -- 172.21.15.77:0/713782272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47040c9d20 con 0x7f47040af970 2023-11-26T07:23:08.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.295+0000 7f46fa7fc640 1 -- 172.21.15.77:0/713782272 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f46fc016420 con 0x7f47040af970 2023-11-26T07:23:08.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.295+0000 7f46fa7fc640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f46e806b6b0 0x7f46e806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.296+0000 7f46fa7fc640 1 -- 172.21.15.77:0/713782272 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46fc0888f0 con 0x7f47040af970 2023-11-26T07:23:08.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.296+0000 7f4709a37640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f46e806b6b0 0x7f46e806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.296+0000 7f4709a37640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f46e806b6b0 0x7f46e806db70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4700036000 tx=0x7f4700030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:08.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.300+0000 7f46fa7fc640 1 -- 172.21.15.77:0/713782272 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46fc055220 con 0x7f47040af970 2023-11-26T07:23:08.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.531+0000 7f470bc9b640 1 -- 172.21.15.77:0/713782272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47040ae960 con 0x7f47040af970 2023-11-26T07:23:08.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.532+0000 7f46fa7fc640 1 -- 172.21.15.77:0/713782272 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f46fc058840 con 0x7f47040af970 2023-11-26T07:23:08.535 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:23:08.535 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/277058454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":277058454},{"type":"v1","addr":"172.21.15.159:6835","nonce":277058454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4120615192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4120615192},{"type":"v1","addr":"172.21.15.77:6835","nonce":4120615192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/52209425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":52209425},{"type":"v1","addr":"172.21.15.159:6834","nonce":52209425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:04.464261+0000","modified":"2023-11-26T07:23:07.539892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/3837428408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3837428408},{"type":"v1","addr":"172.21.15.77:6837","nonce":3837428408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:23:08.536 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 44 2023-11-26T07:23:08.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.535+0000 7f470bc9b640 1 -- 172.21.15.77:0/713782272 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f46e806b6b0 msgr2=0x7f46e806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.535+0000 7f470bc9b640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f46e806b6b0 0x7f46e806db70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4700036000 tx=0x7f4700030000 comp rx=0 tx=0).stop 2023-11-26T07:23:08.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.535+0000 7f470bc9b640 1 -- 172.21.15.77:0/713782272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47040af970 msgr2=0x7f470414c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.535+0000 7f470bc9b640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47040af970 0x7f470414c4b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f47040b2fa0 tx=0x7f46fc00f520 comp rx=0 tx=0).stop 2023-11-26T07:23:08.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.535+0000 7f470bc9b640 1 -- 172.21.15.77:0/713782272 shutdown_connections 2023-11-26T07:23:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.535+0000 7f470bc9b640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f46e806b6b0 0x7f46e806db70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.535+0000 7f470bc9b640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47040af970 0x7f470414c4b0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.535+0000 7f470bc9b640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47040af510 0x7f470414bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.535+0000 7f470bc9b640 1 --2- 172.21.15.77:0/713782272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46f0003970 0x7f47040c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.535+0000 7f470bc9b640 1 -- 172.21.15.77:0/713782272 >> 172.21.15.77:0/713782272 conn(0x7f470406a920 msgr2=0x7f47040cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.535+0000 7f470bc9b640 1 -- 172.21.15.77:0/713782272 shutdown_connections 2023-11-26T07:23:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.536+0000 7f470bc9b640 1 -- 172.21.15.77:0/713782272 wait complete. 2023-11-26T07:23:08.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:23:08.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.766+0000 7f25559ce640 1 Processor -- start 2023-11-26T07:23:08.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.766+0000 7f25559ce640 1 -- start start 2023-11-26T07:23:08.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.767+0000 7f25559ce640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f255015c7f0 0x7f255006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.767+0000 7f25559ce640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25500cf450 0x7f25500cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.768+0000 7f25559ce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f25500cdfb0 0x7f25500ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.768+0000 7f25559ce640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2550156010 con 0x7f25500cdfb0 2023-11-26T07:23:08.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.768+0000 7f25559ce640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255006ce30 con 0x7f255015c7f0 2023-11-26T07:23:08.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.768+0000 7f25559ce640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25500cfe10 con 0x7f25500cf450 2023-11-26T07:23:08.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.768+0000 7f254f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f25500cdfb0 0x7f25500ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.768+0000 7f254f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f25500cdfb0 0x7f25500ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49784/0 (socket says 172.21.15.77:49784) 2023-11-26T07:23:08.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.768+0000 7f254f7fe640 1 -- 172.21.15.77:0/3399098337 learned_addr learned my addr 172.21.15.77:0/3399098337 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:08.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.768+0000 7f254e7fc640 1 --2- 172.21.15.77:0/3399098337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25500cf450 0x7f25500cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.768+0000 7f254effd640 1 --2- 172.21.15.77:0/3399098337 >> v2:172.21.15.159:3300/0 conn(0x7f255015c7f0 0x7f255006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.768+0000 7f254f7fe640 1 -- 172.21.15.77:0/3399098337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25500cf450 msgr2=0x7f25500cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:08.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.768+0000 7f254f7fe640 1 --2- 172.21.15.77:0/3399098337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25500cf450 0x7f25500cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.769+0000 7f254f7fe640 1 -- 172.21.15.77:0/3399098337 >> v2:172.21.15.159:3300/0 conn(0x7f255015c7f0 msgr2=0x7f255006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:08.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.769+0000 7f254f7fe640 1 --2- 172.21.15.77:0/3399098337 >> v2:172.21.15.159:3300/0 conn(0x7f255015c7f0 0x7f255006db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.769+0000 7f254f7fe640 1 -- 172.21.15.77:0/3399098337 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25500cece0 con 0x7f25500cdfb0 2023-11-26T07:23:08.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.770+0000 7f254f7fe640 1 --2- 172.21.15.77:0/3399098337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25500cdfb0 0x7f25500ce440 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f25500d0130 tx=0x7f254802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510c75184d86bc51 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:08.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.770+0000 7f254dffb640 1 -- 172.21.15.77:0/3399098337 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254802ca70 con 0x7f25500cdfb0 2023-11-26T07:23:08.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.770+0000 7f254dffb640 1 -- 172.21.15.77:0/3399098337 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254802cbd0 con 0x7f25500cdfb0 2023-11-26T07:23:08.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.770+0000 7f254dffb640 1 -- 172.21.15.77:0/3399098337 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480343f0 con 0x7f25500cdfb0 2023-11-26T07:23:08.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.771+0000 7f25559ce640 1 -- 172.21.15.77:0/3399098337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25500cdfb0 msgr2=0x7f25500ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.771+0000 7f25559ce640 1 --2- 172.21.15.77:0/3399098337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25500cdfb0 0x7f25500ce440 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f25500d0130 tx=0x7f254802bed0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.771+0000 7f25559ce640 1 -- 172.21.15.77:0/3399098337 shutdown_connections 2023-11-26T07:23:08.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.771+0000 7f25559ce640 1 --2- 172.21.15.77:0/3399098337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25500cdfb0 0x7f25500ce440 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.771+0000 7f25559ce640 1 --2- 172.21.15.77:0/3399098337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25500cf450 0x7f25500cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.771+0000 7f25559ce640 1 --2- 172.21.15.77:0/3399098337 >> v2:172.21.15.159:3300/0 conn(0x7f255015c7f0 0x7f255006db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.771+0000 7f25559ce640 1 -- 172.21.15.77:0/3399098337 >> 172.21.15.77:0/3399098337 conn(0x7f255006a920 msgr2=0x7f255006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:08.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.771+0000 7f25559ce640 1 -- 172.21.15.77:0/3399098337 shutdown_connections 2023-11-26T07:23:08.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.771+0000 7f25559ce640 1 -- 172.21.15.77:0/3399098337 wait complete. 2023-11-26T07:23:08.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.773+0000 7f25559ce640 1 Processor -- start 2023-11-26T07:23:08.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.773+0000 7f25559ce640 1 -- start start 2023-11-26T07:23:08.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f25559ce640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25500cdfb0 0x7f255009b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f25559ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25500cf450 0x7f255015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f25559ce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f255015c7f0 0x7f255015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f25559ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25501f4150 con 0x7f25500cf450 2023-11-26T07:23:08.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f25559ce640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25501f3e70 con 0x7f255015c7f0 2023-11-26T07:23:08.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f25559ce640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25500b2210 con 0x7f25500cdfb0 2023-11-26T07:23:08.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f254e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25500cf450 0x7f255015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f254e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25500cf450 0x7f255015a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49800/0 (socket says 172.21.15.77:49800) 2023-11-26T07:23:08.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f254e7fc640 1 -- 172.21.15.77:0/4222850341 learned_addr learned my addr 172.21.15.77:0/4222850341 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:08.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f254e7fc640 1 -- 172.21.15.77:0/4222850341 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25500cdfb0 msgr2=0x7f255009b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f254effd640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25500cdfb0 0x7f255009b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f254f7fe640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f255015c7f0 0x7f255015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f254e7fc640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25500cdfb0 0x7f255009b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f254e7fc640 1 -- 172.21.15.77:0/4222850341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f255015c7f0 msgr2=0x7f255015aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f254e7fc640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f255015c7f0 0x7f255015aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.774+0000 7f254e7fc640 1 -- 172.21.15.77:0/4222850341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2548009b30 con 0x7f25500cf450 2023-11-26T07:23:08.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.775+0000 7f254e7fc640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25500cf450 0x7f255015a580 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f254400d800 tx=0x7f254400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:08.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.775+0000 7f2537fff640 1 -- 172.21.15.77:0/4222850341 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25440096a0 con 0x7f25500cf450 2023-11-26T07:23:08.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.775+0000 7f2537fff640 1 -- 172.21.15.77:0/4222850341 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2544009800 con 0x7f25500cf450 2023-11-26T07:23:08.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.775+0000 7f2537fff640 1 -- 172.21.15.77:0/4222850341 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544009b90 con 0x7f25500cf450 2023-11-26T07:23:08.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.775+0000 7f25559ce640 1 -- 172.21.15.77:0/4222850341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25500b24f0 con 0x7f25500cf450 2023-11-26T07:23:08.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.775+0000 7f25559ce640 1 -- 172.21.15.77:0/4222850341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255009b980 con 0x7f25500cf450 2023-11-26T07:23:08.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.776+0000 7f25559ce640 1 -- 172.21.15.77:0/4222850341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255009bb70 con 0x7f25500cf450 2023-11-26T07:23:08.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.777+0000 7f2537fff640 1 -- 172.21.15.77:0/4222850341 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f2544009cf0 con 0x7f25500cf450 2023-11-26T07:23:08.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.778+0000 7f2537fff640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f253c06b6e0 0x7f253c06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.778+0000 7f2537fff640 1 -- 172.21.15.77:0/4222850341 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2544088400 con 0x7f25500cf450 2023-11-26T07:23:08.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.779+0000 7f254effd640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f253c06b6e0 0x7f253c06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.779+0000 7f254effd640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f253c06b6e0 0x7f253c06dba0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2540006fd0 tx=0x7f2540008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:08.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.783+0000 7f2537fff640 1 -- 172.21.15.77:0/4222850341 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2544054d90 con 0x7f25500cf450 2023-11-26T07:23:08.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.973+0000 7f25559ce640 1 -- 172.21.15.77:0/4222850341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2550067470 con 0x7f25500cf450 2023-11-26T07:23:08.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.976+0000 7f2537fff640 1 -- 172.21.15.77:0/4222850341 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16544 (secure 0 0 0) 0x7f254400b440 con 0x7f25500cf450 2023-11-26T07:23:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:23:08.979 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":75,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:23:06.008681+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:02.276143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:03.495874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:23:08.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.978+0000 7f25559ce640 1 -- 172.21.15.77:0/4222850341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f253c06b6e0 msgr2=0x7f253c06dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.978+0000 7f25559ce640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f253c06b6e0 0x7f253c06dba0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2540006fd0 tx=0x7f2540008040 comp rx=0 tx=0).stop 2023-11-26T07:23:08.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.978+0000 7f25559ce640 1 -- 172.21.15.77:0/4222850341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25500cf450 msgr2=0x7f255015a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.978+0000 7f25559ce640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25500cf450 0x7f255015a580 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f254400d800 tx=0x7f254400dcc0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.978+0000 7f25559ce640 1 -- 172.21.15.77:0/4222850341 shutdown_connections 2023-11-26T07:23:08.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.978+0000 7f25559ce640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f253c06b6e0 0x7f253c06dba0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.978+0000 7f25559ce640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f255015c7f0 0x7f255015aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.978+0000 7f25559ce640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25500cf450 0x7f255015a580 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.978+0000 7f25559ce640 1 --2- 172.21.15.77:0/4222850341 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25500cdfb0 0x7f255009b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.978+0000 7f25559ce640 1 -- 172.21.15.77:0/4222850341 >> 172.21.15.77:0/4222850341 conn(0x7f255006a920 msgr2=0x7f255006db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:08.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.979+0000 7f25559ce640 1 -- 172.21.15.77:0/4222850341 shutdown_connections 2023-11-26T07:23:08.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:08.979+0000 7f25559ce640 1 -- 172.21.15.77:0/4222850341 wait complete. 2023-11-26T07:23:09.000 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:23:09.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:23:09.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.207+0000 7f2485d43640 1 Processor -- start 2023-11-26T07:23:09.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.207+0000 7f2485d43640 1 -- start start 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.208+0000 7f2485d43640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f24800cfb60 0x7f2480161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.208+0000 7f2485d43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 0x7f248015e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.208+0000 7f2485d43640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24800ce0b0 con 0x7f2480157c70 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.208+0000 7f2485d43640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2480161960 con 0x7f24800cfb60 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.208+0000 7f2485d43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248015e670 con 0x7f248015dc80 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.209+0000 7f247effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f24800cfb60 0x7f2480161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.209+0000 7f247f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2480157c70 0x7f24800cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45808/0 (socket says 172.21.15.77:45808) 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.209+0000 7f247f7fe640 1 -- 172.21.15.77:0/2816360769 learned_addr learned my addr 172.21.15.77:0/2816360769 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:09.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.209+0000 7f247ffff640 1 --2- 172.21.15.77:0/2816360769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 0x7f248015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.209+0000 7f247effd640 1 -- 172.21.15.77:0/2816360769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 msgr2=0x7f248015e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:09.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.209+0000 7f247effd640 1 --2- 172.21.15.77:0/2816360769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 0x7f248015e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.209+0000 7f247effd640 1 -- 172.21.15.77:0/2816360769 >> v1:172.21.15.77:6789/0 conn(0x7f2480157c70 legacy=0x7f24800cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.209+0000 7f247effd640 1 -- 172.21.15.77:0/2816360769 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248015e8d0 con 0x7f24800cfb60 2023-11-26T07:23:09.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.209+0000 7f247e7fc640 1 -- 172.21.15.77:0/2816360769 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053430471 0 0) 0x7f24800ce0b0 con 0x7f2480157c70 2023-11-26T07:23:09.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.209+0000 7f247ffff640 1 --2- 172.21.15.77:0/2816360769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 0x7f248015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.210+0000 7f247effd640 1 --2- 172.21.15.77:0/2816360769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24800cfb60 0x7f2480161df0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2474009d90 tx=0x7f247402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91690f8ecb80d9c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.211+0000 7f247e7fc640 1 -- 172.21.15.77:0/2816360769 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247402cbd0 con 0x7f24800cfb60 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.211+0000 7f247e7fc640 1 -- 172.21.15.77:0/2816360769 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247402cd30 con 0x7f24800cfb60 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.211+0000 7f247e7fc640 1 -- 172.21.15.77:0/2816360769 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247402cea0 con 0x7f24800cfb60 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.211+0000 7f2485d43640 1 -- 172.21.15.77:0/2816360769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24800cfb60 msgr2=0x7f2480161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.211+0000 7f2485d43640 1 --2- 172.21.15.77:0/2816360769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24800cfb60 0x7f2480161df0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2474009d90 tx=0x7f247402be20 comp rx=0 tx=0).stop 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.211+0000 7f2485d43640 1 -- 172.21.15.77:0/2816360769 shutdown_connections 2023-11-26T07:23:09.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.211+0000 7f2485d43640 1 --2- 172.21.15.77:0/2816360769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 0x7f248015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.211+0000 7f2485d43640 1 --2- 172.21.15.77:0/2816360769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24800cfb60 0x7f2480161df0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.211+0000 7f2485d43640 1 -- 172.21.15.77:0/2816360769 >> 172.21.15.77:0/2816360769 conn(0x7f248006a920 msgr2=0x7f248006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:09.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.211+0000 7f2485d43640 1 -- 172.21.15.77:0/2816360769 shutdown_connections 2023-11-26T07:23:09.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.212+0000 7f2485d43640 1 -- 172.21.15.77:0/2816360769 wait complete. 2023-11-26T07:23:09.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.213+0000 7f2485d43640 1 Processor -- start 2023-11-26T07:23:09.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.213+0000 7f2485d43640 1 -- start start 2023-11-26T07:23:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.214+0000 7f2485d43640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24800cfb60 0x7f2480150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.214+0000 7f2485d43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2480157c70 0x7f24800c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.214+0000 7f2485d43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 0x7f24800c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.214+0000 7f2485d43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24801513b0 con 0x7f2480157c70 2023-11-26T07:23:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.214+0000 7f2485d43640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24800c8c40 con 0x7f24800cfb60 2023-11-26T07:23:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.214+0000 7f2485d43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24800c8f20 con 0x7f248015dc80 2023-11-26T07:23:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.215+0000 7f247effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2480157c70 0x7f24800c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.215+0000 7f247effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2480157c70 0x7f24800c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49822/0 (socket says 172.21.15.77:49822) 2023-11-26T07:23:09.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.215+0000 7f247effd640 1 -- 172.21.15.77:0/2170849520 learned_addr learned my addr 172.21.15.77:0/2170849520 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:09.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.215+0000 7f247f7fe640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24800cfb60 0x7f2480150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.215+0000 7f247ffff640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 0x7f24800c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.215+0000 7f247effd640 1 -- 172.21.15.77:0/2170849520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 msgr2=0x7f24800c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.215+0000 7f247effd640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 0x7f24800c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.215+0000 7f247effd640 1 -- 172.21.15.77:0/2170849520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24800cfb60 msgr2=0x7f2480150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.215+0000 7f247effd640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24800cfb60 0x7f2480150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.215+0000 7f247effd640 1 -- 172.21.15.77:0/2170849520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2474009a70 con 0x7f2480157c70 2023-11-26T07:23:09.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.215+0000 7f247ffff640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 0x7f24800c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:09.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.216+0000 7f247effd640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2480157c70 0x7f24800c8360 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f2474009d90 tx=0x7f2474004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.216+0000 7f2467fff640 1 -- 172.21.15.77:0/2170849520 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247402cea0 con 0x7f2480157c70 2023-11-26T07:23:09.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.216+0000 7f2467fff640 1 -- 172.21.15.77:0/2170849520 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2474040650 con 0x7f2480157c70 2023-11-26T07:23:09.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.216+0000 7f2467fff640 1 -- 172.21.15.77:0/2170849520 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474040a00 con 0x7f2480157c70 2023-11-26T07:23:09.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.216+0000 7f2485d43640 1 -- 172.21.15.77:0/2170849520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24800c9200 con 0x7f2480157c70 2023-11-26T07:23:09.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.216+0000 7f2485d43640 1 -- 172.21.15.77:0/2170849520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24800c97c0 con 0x7f2480157c70 2023-11-26T07:23:09.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.217+0000 7f2485d43640 1 -- 172.21.15.77:0/2170849520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2480067470 con 0x7f2480157c70 2023-11-26T07:23:09.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.218+0000 7f2467fff640 1 -- 172.21.15.77:0/2170849520 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f2474040b60 con 0x7f2480157c70 2023-11-26T07:23:09.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.219+0000 7f2467fff640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f246c06b6b0 0x7f246c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.220+0000 7f2467fff640 1 -- 172.21.15.77:0/2170849520 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24740aaeb0 con 0x7f2480157c70 2023-11-26T07:23:09.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.220+0000 7f247f7fe640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f246c06b6b0 0x7f246c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.220+0000 7f247f7fe640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f246c06b6b0 0x7f246c06db70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2470000f60 tx=0x7f2470007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.224+0000 7f2467fff640 1 -- 172.21.15.77:0/2170849520 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f24740777e0 con 0x7f2480157c70 2023-11-26T07:23:09.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.411+0000 7f2485d43640 1 -- 172.21.15.77:0/2170849520 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24801615f0 con 0x7f246c06b6b0 2023-11-26T07:23:09.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.434+0000 7f2467fff640 1 -- 172.21.15.77:0/2170849520 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275258 (secure 0 0 0) 0x7f2470007170 con 0x7f246c06b6b0 2023-11-26T07:23:09.440 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:23:09.441 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:23:09.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 -- 172.21.15.77:0/2170849520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f246c06b6b0 msgr2=0x7f246c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f246c06b6b0 0x7f246c06db70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2470000f60 tx=0x7f2470007b50 comp rx=0 tx=0).stop 2023-11-26T07:23:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 -- 172.21.15.77:0/2170849520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2480157c70 msgr2=0x7f24800c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2480157c70 0x7f24800c8360 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f2474009d90 tx=0x7f2474004a40 comp rx=0 tx=0).stop 2023-11-26T07:23:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 -- 172.21.15.77:0/2170849520 shutdown_connections 2023-11-26T07:23:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f246c06b6b0 0x7f246c06db70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f248015dc80 0x7f24800c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2480157c70 0x7f24800c8360 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 --2- 172.21.15.77:0/2170849520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24800cfb60 0x7f2480150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 -- 172.21.15.77:0/2170849520 >> 172.21.15.77:0/2170849520 conn(0x7f248006a920 msgr2=0x7f248015edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 -- 172.21.15.77:0/2170849520 shutdown_connections 2023-11-26T07:23:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.440+0000 7f2485d43640 1 -- 172.21.15.77:0/2170849520 wait complete. 2023-11-26T07:23:09.462 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2023-11-26T07:23:07.712797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257452,"kb_used_data":7996,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717268,"statfs":{"total":773094113280,"available":772830482432,"internally_reserved":0,"allocated":8187904,"data_stored":4146471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.724625"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.005883+0000","last_change":"2023-11-26T07:23:03.005883+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.005883+0000","last_undegraded":"2023-11-26T07:23:03.005883+0000","last_fullsized":"2023-11-26T07:23:03.005883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.993297+0000","last_change":"2023-11-26T07:23:02.993297+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.993297+0000","last_undegraded":"2023-11-26T07:23:02.993297+0000","last_fullsized":"2023-11-26T07:23:02.993297+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.997252+0000","last_change":"2023-11-26T07:23:02.997252+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.997252+0000","last_undegraded":"2023-11-26T07:23:02.997252+0000","last_fullsized":"2023-11-26T07:23:02.997252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.003112+0000","last_change":"2023-11-26T07:23:03.003112+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.003112+0000","last_undegraded":"2023-11-26T07:23:03.003112+0000","last_fullsized":"2023-11-26T07:23:03.003112+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.992043+0000","last_change":"2023-11-26T07:23:02.992043+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.992043+0000","last_undegraded":"2023-11-26T07:23:02.992043+0000","last_fullsized":"2023-11-26T07:23:02.992043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.005597+0000","last_change":"2023-11-26T07:23:03.005597+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.005597+0000","last_undegraded":"2023-11-26T07:23:03.005597+0000","last_fullsized":"2023-11-26T07:23:03.005597+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.000381+0000","last_change":"2023-11-26T07:23:03.000381+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.000381+0000","last_undegraded":"2023-11-26T07:23:03.000381+0000","last_fullsized":"2023-11-26T07:23:03.000381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.996623+0000","last_change":"2023-11-26T07:23:02.996623+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.996623+0000","last_undegraded":"2023-11-26T07:23:02.996623+0000","last_fullsized":"2023-11-26T07:23:02.996623+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.997761+0000","last_change":"2023-11-26T07:23:02.997761+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.997761+0000","last_undegraded":"2023-11-26T07:23:02.997761+0000","last_fullsized":"2023-11-26T07:23:02.997761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.003103+0000","last_change":"2023-11-26T07:23:03.003103+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.003103+0000","last_undegraded":"2023-11-26T07:23:03.003103+0000","last_fullsized":"2023-11-26T07:23:03.003103+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.991950+0000","last_change":"2023-11-26T07:23:02.991950+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.991950+0000","last_undegraded":"2023-11-26T07:23:02.991950+0000","last_fullsized":"2023-11-26T07:23:02.991950+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.000398+0000","last_change":"2023-11-26T07:23:03.000398+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.000398+0000","last_undegraded":"2023-11-26T07:23:03.000398+0000","last_fullsized":"2023-11-26T07:23:03.000398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.000388+0000","last_change":"2023-11-26T07:23:03.000388+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.000388+0000","last_undegraded":"2023-11-26T07:23:03.000388+0000","last_fullsized":"2023-11-26T07:23:03.000388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.004502+0000","last_change":"2023-11-26T07:23:03.004502+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.004502+0000","last_undegraded":"2023-11-26T07:23:03.004502+0000","last_fullsized":"2023-11-26T07:23:03.004502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.994742+0000","last_change":"2023-11-26T07:23:02.994742+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.994742+0000","last_undegraded":"2023-11-26T07:23:02.994742+0000","last_fullsized":"2023-11-26T07:23:02.994742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.997090+0000","last_change":"2023-11-26T07:23:02.997090+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.997090+0000","last_undegraded":"2023-11-26T07:23:02.997090+0000","last_fullsized":"2023-11-26T07:23:02.997090+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.006170+0000","last_change":"2023-11-26T07:23:03.006170+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.006170+0000","last_undegraded":"2023-11-26T07:23:03.006170+0000","last_fullsized":"2023-11-26T07:23:03.006170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.997640+0000","last_change":"2023-11-26T07:23:02.997640+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.997640+0000","last_undegraded":"2023-11-26T07:23:02.997640+0000","last_fullsized":"2023-11-26T07:23:02.997640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.003191+0000","last_change":"2023-11-26T07:23:03.003191+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.003191+0000","last_undegraded":"2023-11-26T07:23:03.003191+0000","last_fullsized":"2023-11-26T07:23:03.003191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.006895+0000","last_change":"2023-11-26T07:23:03.006895+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.006895+0000","last_undegraded":"2023-11-26T07:23:03.006895+0000","last_fullsized":"2023-11-26T07:23:03.006895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.002914+0000","last_change":"2023-11-26T07:23:03.002914+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.002914+0000","last_undegraded":"2023-11-26T07:23:03.002914+0000","last_fullsized":"2023-11-26T07:23:03.002914+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.993629+0000","last_change":"2023-11-26T07:23:02.993629+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.993629+0000","last_undegraded":"2023-11-26T07:23:02.993629+0000","last_fullsized":"2023-11-26T07:23:02.993629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.993232+0000","last_change":"2023-11-26T07:23:02.993232+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.993232+0000","last_undegraded":"2023-11-26T07:23:02.993232+0000","last_fullsized":"2023-11-26T07:23:02.993232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.003000+0000","last_change":"2023-11-26T07:23:03.003000+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.003000+0000","last_undegraded":"2023-11-26T07:23:03.003000+0000","last_fullsized":"2023-11-26T07:23:03.003000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.993651+0000","last_change":"2023-11-26T07:23:02.993651+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.993651+0000","last_undegraded":"2023-11-26T07:23:02.993651+0000","last_fullsized":"2023-11-26T07:23:02.993651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.996627+0000","last_change":"2023-11-26T07:23:02.996627+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.996627+0000","last_undegraded":"2023-11-26T07:23:02.996627+0000","last_fullsized":"2023-11-26T07:23:02.996627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.993143+0000","last_change":"2023-11-26T07:23:02.993143+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.993143+0000","last_undegraded":"2023-11-26T07:23:02.993143+0000","last_fullsized":"2023-11-26T07:23:02.993143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.996950+0000","last_change":"2023-11-26T07:23:02.996950+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.996950+0000","last_undegraded":"2023-11-26T07:23:02.996950+0000","last_fullsized":"2023-11-26T07:23:02.996950+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.000825+0000","last_change":"2023-11-26T07:23:03.000825+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.000825+0000","last_undegraded":"2023-11-26T07:23:03.000825+0000","last_fullsized":"2023-11-26T07:23:03.000825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:02.997065+0000","last_change":"2023-11-26T07:23:02.997065+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:02.997065+0000","last_undegraded":"2023-11-26T07:23:02.997065+0000","last_fullsized":"2023-11-26T07:23:02.997065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.002913+0000","last_change":"2023-11-26T07:23:03.002913+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.002913+0000","last_undegraded":"2023-11-26T07:23:03.002913+0000","last_fullsized":"2023-11-26T07:23:03.002913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:23:03.986828+0000","last_change":"2023-11-26T07:23:03.986828+0000","last_active":"2023-11-26T07:23:03.986828+0000","last_peered":"2023-11-26T07:23:03.986828+0000","last_clean":"2023-11-26T07:23:03.986828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.986828+0000","last_undegraded":"2023-11-26T07:23:03.986828+0000","last_fullsized":"2023-11-26T07:23:03.986828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-11-26T07:23:03.003311+0000","last_change":"2023-11-26T07:23:03.003311+0000","last_active":"2023-11-26T07:23:02.972900+0000","last_peered":"2023-11-26T07:23:02.972900+0000","last_clean":"2023-11-26T07:23:02.972900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:23:03.003311+0000","last_undegraded":"2023-11-26T07:23:03.003311+0000","last_fullsized":"2023-11-26T07:23:03.003311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:23:00.099603+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:23:00.099603+0000","last_peered":"2023-11-26T07:23:00.099603+0000","last_clean":"2023-11-26T07:23:00.099603+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:23:00.099603+0000","last_undegraded":"2023-11-26T07:23:00.099603+0000","last_fullsized":"2023-11-26T07:23:00.099603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":961812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0649999999999999,"15min":1.0389999999999999},"min":{"1min":0.64000000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.417,"5min":1.768,"15min":1.768},"last":1.24},{"interface":"front","average":{"1min":1.2,"5min":1.101,"15min":1.0780000000000001},"min":{"1min":0.77400000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.6359999999999999,"5min":2.298,"15min":2.298},"last":1.425}]},{"osd":1,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0780000000000001,"15min":1.056},"min":{"1min":0.85299999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4790000000000001,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1779999999999999,"15min":1.2110000000000001},"min":{"1min":0.78000000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6479999999999999,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.153}]},{"osd":2,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.214,"15min":1.173},"min":{"1min":0.76000000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.591,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.018},{"interface":"front","average":{"1min":1.169,"5min":1.1870000000000001,"15min":1.2669999999999999},"min":{"1min":0.73599999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7929999999999999,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.5189999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1830000000000001,"15min":1.2250000000000001},"min":{"1min":0.80500000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.3959999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.27},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.349,"15min":1.361},"min":{"1min":0.87,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.724,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.476}]},{"osd":4,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3100000000000001,"15min":1.3460000000000001},"min":{"1min":0.93799999999999994,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9039999999999999,"5min":2.774,"15min":2.774},"last":1.329},{"interface":"front","average":{"1min":1.454,"5min":1.452,"15min":1.4610000000000001},"min":{"1min":1.024,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.778,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.359}]},{"osd":5,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.454,"15min":1.4890000000000001},"min":{"1min":0.86399999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.02,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.395,"15min":1.4570000000000001},"min":{"1min":0.96799999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.637,"5min":2.149,"15min":2.149},"last":1.391}]},{"osd":6,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5860000000000001,"15min":1.659},"min":{"1min":1.077,"5min":0.75,"15min":0.75},"max":{"1min":2.1059999999999999,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.738},{"interface":"front","average":{"1min":1.532,"5min":1.5780000000000001,"15min":1.6279999999999999},"min":{"1min":1.2749999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.76,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.698}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":876544,"data_stored":371444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.103,"15min":1.117},"min":{"1min":0.68400000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.946,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1499999999999999,"15min":1.2490000000000001},"min":{"1min":0.76400000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4670000000000001,"5min":3.169,"15min":3.169},"last":0.872}]},{"osd":1,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":0.82499999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.2090000000000001,"15min":1.1499999999999999},"min":{"1min":0.94199999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.754,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.042}]},{"osd":2,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.119,"15min":1.121},"min":{"1min":0.77500000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.403,"5min":1.298,"15min":1.3660000000000001},"min":{"1min":0.96999999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.5950000000000002,"5min":3.1110000000000002,"15min":3.1110000000000002},"last":1.0900000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3009999999999999,"15min":1.2789999999999999},"min":{"1min":1.0049999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7629999999999999,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.2549999999999999,"15min":1.2589999999999999},"min":{"1min":0.92900000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.6180000000000001,"5min":1.736,"15min":1.736},"last":1.155}]},{"osd":4,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.3959999999999999,"15min":1.3779999999999999},"min":{"1min":0.89900000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.6850000000000001,"5min":4.6539999999999999,"15min":4.6539999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.4219999999999999,"15min":1.385},"min":{"1min":1.1759999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.929,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":1.502}]},{"osd":5,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.399,"15min":1.4059999999999999},"min":{"1min":0.93899999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.929,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.401},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.5469999999999999,"15min":1.5409999999999999},"min":{"1min":1.071,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.7749999999999999,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":1.302}]},{"osd":7,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.5620000000000001,"15min":1.5509999999999999},"min":{"1min":1.2549999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.1059999999999999,"5min":4.202,"15min":4.202},"last":1.589},{"interface":"front","average":{"1min":1.631,"5min":1.5669999999999999,"15min":1.5700000000000001},"min":{"1min":1.2450000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.958,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.5580000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":371444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0609999999999999,"15min":1.0269999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5700000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.111,"15min":1.0329999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6519999999999999,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":1.4430000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.145,"15min":1.081},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.8080000000000001,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":1.181},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.1739999999999999,"15min":1.169},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.3129999999999999,"5min":4.7859999999999996,"15min":4.7859999999999996},"last":1.224}]},{"osd":2,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0980000000000001,"15min":1.0549999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.835,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":1.349},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2749999999999999,"15min":1.2949999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6080000000000001,"5min":3.77,"15min":3.77},"last":1.0880000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.2709999999999999,"15min":1.2989999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4850000000000001,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":1.391},{"interface":"front","average":{"1min":1.216,"5min":1.2529999999999999,"15min":1.2130000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.9099999999999999,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":0.81399999999999995}]},{"osd":4,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4159999999999999,"15min":1.456},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.893,"5min":3.835,"15min":3.835},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.415,"15min":1.4550000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.726,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":1.3260000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.5209999999999999,"15min":1.5449999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.716,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4390000000000001,"15min":1.46},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.0649999999999999,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.5429999999999999,"15min":1.593},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.8260000000000001,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":1.502},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.5549999999999999,"15min":1.5960000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.1309999999999998,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":1.2569999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":876544,"data_stored":371444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.048,"15min":1.1220000000000001},"min":{"1min":0.69799999999999995,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6040000000000001,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.087,"15min":1.0249999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.486,"5min":2.04,"15min":2.04},"last":0.71399999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.177,"15min":1.177},"min":{"1min":0.83599999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.593,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.246,"15min":1.242},"min":{"1min":0.75700000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5369999999999999,"5min":1.79,"15min":1.79},"last":1.54}]},{"osd":2,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.244,"15min":1.2789999999999999},"min":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.532,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.232,"15min":1.278},"min":{"1min":0.84399999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.95199999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.3009999999999999,"15min":1.3160000000000001},"min":{"1min":0.871,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6040000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.294},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3340000000000001,"15min":1.3480000000000001},"min":{"1min":0.96199999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.087}]},{"osd":5,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.3420000000000001,"15min":1.3580000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.8720000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.6220000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.4750000000000001,"15min":1.5029999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.99,"5min":2.899,"15min":2.899},"last":1.407}]},{"osd":6,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4690000000000001,"15min":1.5009999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.238},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5980000000000001,"15min":1.635},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.29,"5min":3.008,"15min":3.008},"last":1.5880000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.6739999999999999,"15min":1.7410000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.242,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.524,"5min":1.6439999999999999,"15min":1.698},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.343,"5min":3.085,"15min":3.085},"last":1.375}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":371444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.85599999999999998},"min":{"1min":0.47599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.292,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.90300000000000002,"15min":0.90800000000000003},"min":{"1min":0.498,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.5920000000000001,"5min":1.764,"15min":1.764},"last":1.242}]},{"osd":1,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79000000000000004,"15min":0.84199999999999997},"min":{"1min":0.56599999999999995,"5min":0.371,"15min":0.371},"max":{"1min":1.145,"5min":1.784,"15min":1.784},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.89200000000000002,"15min":0.98799999999999999},"min":{"1min":0.434,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5649999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.032}]},{"osd":2,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0269999999999999,"15min":1.073},"min":{"1min":0.63900000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.627,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.325},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0800000000000001,"15min":1.1140000000000001},"min":{"1min":0.65400000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.548,"5min":2.379,"15min":2.379},"last":1.2989999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.111,"15min":1.131},"min":{"1min":0.72099999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.546,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.232,"15min":1.333},"min":{"1min":1.091,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5269999999999999,"5min":2.859,"15min":2.859},"last":1.181}]},{"osd":5,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.258,"15min":1.347},"min":{"1min":0.86899999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.6899999999999999,"5min":2.504,"15min":2.504},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.1890000000000001,"15min":1.2430000000000001},"min":{"1min":0.78300000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.51,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.5189999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.292,"15min":1.4199999999999999},"min":{"1min":0.90100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7270000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.474},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.337,"15min":1.427},"min":{"1min":0.83899999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.903,"5min":3.226,"15min":3.226},"last":1.5}]},{"osd":7,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2529999999999999,"15min":1.2869999999999999},"min":{"1min":0.86599999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5960000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.605},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3959999999999999,"15min":1.4950000000000001},"min":{"1min":1.0149999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.996,"5min":3.956,"15min":3.956},"last":1.5680000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":876544,"data_stored":371444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.81599999999999995,"15min":0.94499999999999995},"min":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3380000000000001,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.3520000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.92500000000000004,"15min":1.052},"min":{"1min":0.51000000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2909999999999999,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.4039999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":0.94999999999999996},"min":{"1min":0.439,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.5229999999999999,"5min":1.645,"15min":1.645},"last":1.222},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.92000000000000004,"15min":1.016},"min":{"1min":0.48499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.609,"5min":1.901,"15min":1.901},"last":1.151}]},{"osd":3,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.042},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.9430000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.04,"5min":1.103,"15min":1.224},"min":{"1min":0.59099999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6719999999999999,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.5529999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2050000000000001,"15min":1.27},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8939999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.647},{"interface":"front","average":{"1min":1.137,"5min":1.2050000000000001,"15min":1.28},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.736,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1599999999999999,"15min":1.2350000000000001},"min":{"1min":0.83399999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.641,"5min":1.901,"15min":1.901},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.246,"15min":1.3680000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.724,"5min":2.395,"15min":2.395},"last":1.4550000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.3460000000000001,"15min":1.4370000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.9039999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2889999999999999,"15min":1.3380000000000001},"min":{"1min":0.80200000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.871,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.258}]},{"osd":7,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.3560000000000001,"15min":1.4690000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.841,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.355,"15min":1.419},"min":{"1min":0.86099999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7769999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.1950000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":365627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76200000000000001,"15min":0.81000000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.3180000000000001,"5min":1.589,"15min":1.589},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.95099999999999996},"min":{"1min":0.44400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.851,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.93500000000000005}]},{"osd":2,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.83799999999999997,"15min":0.86399999999999999},"min":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3839999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.024},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.95299999999999996,"15min":0.99299999999999999},"min":{"1min":0.47399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.55,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.0620000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0489999999999999,"15min":1.073},"min":{"1min":0.55700000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5449999999999999,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.97699999999999998,"15min":1.046},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6040000000000001,"5min":2.319,"15min":2.319},"last":1.1699999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1830000000000001,"15min":1.2330000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.635,"5min":2.294,"15min":2.294},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.1659999999999999,"15min":1.244},"min":{"1min":0.65500000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.653,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.2789999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2569999999999999,"15min":1.355},"min":{"1min":0.76500000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.7170000000000001,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.194},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.359,"15min":1.3799999999999999},"min":{"1min":0.86699999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.788,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.5740000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.302,"15min":1.3720000000000001},"min":{"1min":0.873,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.839,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.518},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2769999999999999,"15min":1.3460000000000001},"min":{"1min":0.75600000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8080000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.6539999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.878,"5min":0.755,"15min":0.755},"max":{"1min":1.8819999999999999,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.637},{"interface":"front","average":{"1min":1.349,"5min":1.379,"15min":1.484},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.954,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.6080000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":961812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.39600000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.2969999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81999999999999995,"15min":0.878},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.65400000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.91600000000000004,"15min":0.95599999999999996},"min":{"1min":0.58499999999999996,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93200000000000005,"15min":1.0009999999999999},"min":{"1min":0.50700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.2270000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.006,"15min":0.95399999999999996},"min":{"1min":0.55300000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.2360000000000002,"5min":9.4939999999999998,"15min":9.4939999999999998},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.099,"15min":1.1459999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8609999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":1.385}]},{"osd":4,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.339,"15min":1.3160000000000001},"min":{"1min":0.878,"5min":0.753,"15min":0.753},"max":{"1min":4.9290000000000003,"5min":4.9290000000000003,"15min":4.9290000000000003},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.3320000000000001,"15min":1.2649999999999999},"min":{"1min":0.96499999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5649999999999999,"5min":9.7240000000000002,"15min":9.7240000000000002},"last":1.738}]},{"osd":5,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.302,"15min":1.2829999999999999},"min":{"1min":0.93000000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.5470000000000002,"5min":9.6039999999999992,"15min":9.6039999999999992},"last":1.8280000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.367,"15min":1.3839999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":4.4800000000000004,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":1.4359999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.369,"15min":1.401},"min":{"1min":0.85699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":4.6349999999999998,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.2789999999999999,"15min":1.349},"min":{"1min":1.008,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0590000000000002,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.3520000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.389,"15min":1.431},"min":{"1min":0.79900000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.79},{"interface":"front","average":{"1min":1.518,"5min":1.389,"15min":1.357},"min":{"1min":0.79900000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":4.1079999999999997,"5min":9.9320000000000004,"15min":9.9320000000000004},"last":2.3639999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:23:09.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:23:09.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.718+0000 7f1bed87c640 1 Processor -- start 2023-11-26T07:23:09.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.718+0000 7f1bed87c640 1 -- start start 2023-11-26T07:23:09.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1bed87c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1be80b2250 0x7f1be815df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1bed87c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1be80b2630 0x7f1be80ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1bed87c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be815ab80 con 0x7f1be80cd470 2023-11-26T07:23:09.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1bed87c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be815a990 con 0x7f1be80b2630 2023-11-26T07:23:09.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1bed87c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be815e680 con 0x7f1be80b2250 2023-11-26T07:23:09.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1bde7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1be80b2630 0x7f1be80ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1be77fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1be80cd470 0x7f1be815b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45814/0 (socket says 172.21.15.77:45814) 2023-11-26T07:23:09.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1be77fe640 1 -- 172.21.15.77:0/3190837047 learned_addr learned my addr 172.21.15.77:0/3190837047 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:09.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1be6ffd640 1 --2- 172.21.15.77:0/3190837047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1be80b2250 0x7f1be815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1bde7fc640 1 -- 172.21.15.77:0/3190837047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1be80b2250 msgr2=0x7f1be815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:09.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1bde7fc640 1 --2- 172.21.15.77:0/3190837047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1be80b2250 0x7f1be815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.720+0000 7f1bde7fc640 1 -- 172.21.15.77:0/3190837047 >> v1:172.21.15.77:6789/0 conn(0x7f1be80cd470 legacy=0x7f1be815b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.721+0000 7f1bde7fc640 1 -- 172.21.15.77:0/3190837047 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be815e960 con 0x7f1be80b2630 2023-11-26T07:23:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.722+0000 7f1bde7fc640 1 --2- 172.21.15.77:0/3190837047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be80b2630 0x7f1be80ccf30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00097a0 tx=0x7f1bd002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a081e9e2e055844 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.722+0000 7f1be67fc640 1 -- 172.21.15.77:0/3190837047 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd002d040 con 0x7f1be80b2630 2023-11-26T07:23:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.722+0000 7f1be67fc640 1 -- 172.21.15.77:0/3190837047 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd0031810 con 0x7f1be80b2630 2023-11-26T07:23:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.722+0000 7f1be67fc640 1 -- 172.21.15.77:0/3190837047 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0031ba0 con 0x7f1be80b2630 2023-11-26T07:23:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.722+0000 7f1bed87c640 1 -- 172.21.15.77:0/3190837047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be80b2630 msgr2=0x7f1be80ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.722+0000 7f1bed87c640 1 --2- 172.21.15.77:0/3190837047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be80b2630 0x7f1be80ccf30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00097a0 tx=0x7f1bd002b8b0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.723+0000 7f1bed87c640 1 -- 172.21.15.77:0/3190837047 shutdown_connections 2023-11-26T07:23:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.723+0000 7f1bed87c640 1 --2- 172.21.15.77:0/3190837047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be80b2630 0x7f1be80ccf30 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.723+0000 7f1bed87c640 1 --2- 172.21.15.77:0/3190837047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1be80b2250 0x7f1be815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.723+0000 7f1bed87c640 1 -- 172.21.15.77:0/3190837047 >> 172.21.15.77:0/3190837047 conn(0x7f1be806a920 msgr2=0x7f1be806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.723+0000 7f1bed87c640 1 -- 172.21.15.77:0/3190837047 shutdown_connections 2023-11-26T07:23:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.723+0000 7f1bed87c640 1 -- 172.21.15.77:0/3190837047 wait complete. 2023-11-26T07:23:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.724+0000 7f1bed87c640 1 Processor -- start 2023-11-26T07:23:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.724+0000 7f1bed87c640 1 -- start start 2023-11-26T07:23:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.725+0000 7f1bed87c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80b2250 0x7f1be80abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.725+0000 7f1bed87c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1be80b2630 0x7f1be80c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.725+0000 7f1bed87c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be80cd470 0x7f1be81522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.725+0000 7f1bed87c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be814f1f0 con 0x7f1be80cd470 2023-11-26T07:23:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.725+0000 7f1bed87c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80ac8c0 con 0x7f1be80b2250 2023-11-26T07:23:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.725+0000 7f1bed87c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80acba0 con 0x7f1be80b2630 2023-11-26T07:23:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.726+0000 7f1be77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be80cd470 0x7f1be81522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.726+0000 7f1be77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be80cd470 0x7f1be81522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49834/0 (socket says 172.21.15.77:49834) 2023-11-26T07:23:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.726+0000 7f1be77fe640 1 -- 172.21.15.77:0/1510684782 learned_addr learned my addr 172.21.15.77:0/1510684782 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.726+0000 7f1be77fe640 1 -- 172.21.15.77:0/1510684782 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1be80b2630 msgr2=0x7f1be80c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.726+0000 7f1be77fe640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1be80b2630 0x7f1be80c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.726+0000 7f1be77fe640 1 -- 172.21.15.77:0/1510684782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80b2250 msgr2=0x7f1be80abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.726+0000 7f1be6ffd640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80b2250 0x7f1be80abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.726+0000 7f1be77fe640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80b2250 0x7f1be80abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.726+0000 7f1be77fe640 1 -- 172.21.15.77:0/1510684782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd0009400 con 0x7f1be80cd470 2023-11-26T07:23:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.726+0000 7f1be6ffd640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80b2250 0x7f1be80abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.726+0000 7f1be77fe640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be80cd470 0x7f1be81522f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f1be000caa0 tx=0x7f1be000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.727+0000 7f1be4ff9640 1 -- 172.21.15.77:0/1510684782 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be000ab40 con 0x7f1be80cd470 2023-11-26T07:23:09.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.727+0000 7f1be4ff9640 1 -- 172.21.15.77:0/1510684782 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be000aca0 con 0x7f1be80cd470 2023-11-26T07:23:09.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.727+0000 7f1be4ff9640 1 -- 172.21.15.77:0/1510684782 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0012600 con 0x7f1be80cd470 2023-11-26T07:23:09.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.727+0000 7f1bed87c640 1 -- 172.21.15.77:0/1510684782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be814ee10 con 0x7f1be80cd470 2023-11-26T07:23:09.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.727+0000 7f1bed87c640 1 -- 172.21.15.77:0/1510684782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be80ac500 con 0x7f1be80cd470 2023-11-26T07:23:09.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.728+0000 7f1bed87c640 1 -- 172.21.15.77:0/1510684782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be814f330 con 0x7f1be80cd470 2023-11-26T07:23:09.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.729+0000 7f1be4ff9640 1 -- 172.21.15.77:0/1510684782 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f1be0007070 con 0x7f1be80cd470 2023-11-26T07:23:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.730+0000 7f1be4ff9640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1bc806b6b0 0x7f1bc806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.730+0000 7f1be4ff9640 1 -- 172.21.15.77:0/1510684782 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1be0087d80 con 0x7f1be80cd470 2023-11-26T07:23:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.730+0000 7f1be6ffd640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1bc806b6b0 0x7f1bc806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.731+0000 7f1be6ffd640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1bc806b6b0 0x7f1bc806db70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8006fd0 tx=0x7f1bd8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.734+0000 7f1be4ff9640 1 -- 172.21.15.77:0/1510684782 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1be814f330 con 0x7f1be80cd470 2023-11-26T07:23:09.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.923+0000 7f1bed87c640 1 -- 172.21.15.77:0/1510684782 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1be80b2a70 con 0x7f1bc806b6b0 2023-11-26T07:23:09.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.945+0000 7f1be4ff9640 1 -- 172.21.15.77:0/1510684782 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287127 (secure 0 0 0) 0x7f1bd80095f0 con 0x7f1bc806b6b0 2023-11-26T07:23:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:23:09.953 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:23:09.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 -- 172.21.15.77:0/1510684782 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1bc806b6b0 msgr2=0x7f1bc806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1bc806b6b0 0x7f1bc806db70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8006fd0 tx=0x7f1bd8008040 comp rx=0 tx=0).stop 2023-11-26T07:23:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 -- 172.21.15.77:0/1510684782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be80cd470 msgr2=0x7f1be81522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be80cd470 0x7f1be81522f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f1be000caa0 tx=0x7f1be000cf60 comp rx=0 tx=0).stop 2023-11-26T07:23:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 -- 172.21.15.77:0/1510684782 shutdown_connections 2023-11-26T07:23:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1bc806b6b0 0x7f1bc806db70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be80cd470 0x7f1be81522f0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1be80b2630 0x7f1be80c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 --2- 172.21.15.77:0/1510684782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1be80b2250 0x7f1be80abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 -- 172.21.15.77:0/1510684782 >> 172.21.15.77:0/1510684782 conn(0x7f1be806a920 msgr2=0x7f1be815ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:09.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 -- 172.21.15.77:0/1510684782 shutdown_connections 2023-11-26T07:23:09.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:09.951+0000 7f1bed87c640 1 -- 172.21.15.77:0/1510684782 wait complete. 2023-11-26T07:23:09.971 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2023-11-26T07:23:09.713411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257820,"kb_used_data":8360,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716900,"statfs":{"total":773094113280,"available":772830105600,"internally_reserved":0,"allocated":8560640,"data_stored":4311908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001679"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.022303+0000","last_change":"2023-11-26T07:23:05.051191+0000","last_active":"2023-11-26T07:23:06.022303+0000","last_peered":"2023-11-26T07:23:06.022303+0000","last_clean":"2023-11-26T07:23:06.022303+0000","last_became_active":"2023-11-26T07:23:05.050618+0000","last_became_peered":"2023-11-26T07:23:05.050618+0000","last_unstale":"2023-11-26T07:23:06.022303+0000","last_undegraded":"2023-11-26T07:23:06.022303+0000","last_fullsized":"2023-11-26T07:23:06.022303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:32:20.984794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.024595+0000","last_change":"2023-11-26T07:23:05.052784+0000","last_active":"2023-11-26T07:23:06.024595+0000","last_peered":"2023-11-26T07:23:06.024595+0000","last_clean":"2023-11-26T07:23:06.024595+0000","last_became_active":"2023-11-26T07:23:05.052342+0000","last_became_peered":"2023-11-26T07:23:05.052342+0000","last_unstale":"2023-11-26T07:23:06.024595+0000","last_undegraded":"2023-11-26T07:23:06.024595+0000","last_fullsized":"2023-11-26T07:23:06.024595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:58:54.266153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.700017+0000","last_change":"2023-11-26T07:23:05.047170+0000","last_active":"2023-11-26T07:23:07.700017+0000","last_peered":"2023-11-26T07:23:07.700017+0000","last_clean":"2023-11-26T07:23:07.700017+0000","last_became_active":"2023-11-26T07:23:05.046131+0000","last_became_peered":"2023-11-26T07:23:05.046131+0000","last_unstale":"2023-11-26T07:23:07.700017+0000","last_undegraded":"2023-11-26T07:23:07.700017+0000","last_fullsized":"2023-11-26T07:23:07.700017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:32:10.021270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.543589+0000","last_change":"2023-11-26T07:23:05.054992+0000","last_active":"2023-11-26T07:23:07.543589+0000","last_peered":"2023-11-26T07:23:07.543589+0000","last_clean":"2023-11-26T07:23:07.543589+0000","last_became_active":"2023-11-26T07:23:05.054705+0000","last_became_peered":"2023-11-26T07:23:05.054705+0000","last_unstale":"2023-11-26T07:23:07.543589+0000","last_undegraded":"2023-11-26T07:23:07.543589+0000","last_fullsized":"2023-11-26T07:23:07.543589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:04:43.796957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.819543+0000","last_change":"2023-11-26T07:23:05.046743+0000","last_active":"2023-11-26T07:23:06.819543+0000","last_peered":"2023-11-26T07:23:06.819543+0000","last_clean":"2023-11-26T07:23:06.819543+0000","last_became_active":"2023-11-26T07:23:05.043894+0000","last_became_peered":"2023-11-26T07:23:05.043894+0000","last_unstale":"2023-11-26T07:23:06.819543+0000","last_undegraded":"2023-11-26T07:23:06.819543+0000","last_fullsized":"2023-11-26T07:23:06.819543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:45:36.800231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.022409+0000","last_change":"2023-11-26T07:23:05.049851+0000","last_active":"2023-11-26T07:23:06.022409+0000","last_peered":"2023-11-26T07:23:06.022409+0000","last_clean":"2023-11-26T07:23:06.022409+0000","last_became_active":"2023-11-26T07:23:05.049567+0000","last_became_peered":"2023-11-26T07:23:05.049567+0000","last_unstale":"2023-11-26T07:23:06.022409+0000","last_undegraded":"2023-11-26T07:23:06.022409+0000","last_fullsized":"2023-11-26T07:23:06.022409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:26:16.400642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.269336+0000","last_change":"2023-11-26T07:23:05.039102+0000","last_active":"2023-11-26T07:23:07.269336+0000","last_peered":"2023-11-26T07:23:07.269336+0000","last_clean":"2023-11-26T07:23:07.269336+0000","last_became_active":"2023-11-26T07:23:05.036689+0000","last_became_peered":"2023-11-26T07:23:05.036689+0000","last_unstale":"2023-11-26T07:23:07.269336+0000","last_undegraded":"2023-11-26T07:23:07.269336+0000","last_fullsized":"2023-11-26T07:23:07.269336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:27:15.481162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.022408+0000","last_change":"2023-11-26T07:23:05.055300+0000","last_active":"2023-11-26T07:23:06.022408+0000","last_peered":"2023-11-26T07:23:06.022408+0000","last_clean":"2023-11-26T07:23:06.022408+0000","last_became_active":"2023-11-26T07:23:05.055041+0000","last_became_peered":"2023-11-26T07:23:05.055041+0000","last_unstale":"2023-11-26T07:23:06.022408+0000","last_undegraded":"2023-11-26T07:23:06.022408+0000","last_fullsized":"2023-11-26T07:23:06.022408+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:54:50.421367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.820210+0000","last_change":"2023-11-26T07:23:05.034861+0000","last_active":"2023-11-26T07:23:06.820210+0000","last_peered":"2023-11-26T07:23:06.820210+0000","last_clean":"2023-11-26T07:23:06.820210+0000","last_became_active":"2023-11-26T07:23:05.034314+0000","last_became_peered":"2023-11-26T07:23:05.034314+0000","last_unstale":"2023-11-26T07:23:06.820210+0000","last_undegraded":"2023-11-26T07:23:06.820210+0000","last_fullsized":"2023-11-26T07:23:06.820210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:56:03.353761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.700169+0000","last_change":"2023-11-26T07:23:05.035284+0000","last_active":"2023-11-26T07:23:07.700169+0000","last_peered":"2023-11-26T07:23:07.700169+0000","last_clean":"2023-11-26T07:23:07.700169+0000","last_became_active":"2023-11-26T07:23:05.035012+0000","last_became_peered":"2023-11-26T07:23:05.035012+0000","last_unstale":"2023-11-26T07:23:07.700169+0000","last_undegraded":"2023-11-26T07:23:07.700169+0000","last_fullsized":"2023-11-26T07:23:07.700169+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:34:56.023028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.021826+0000","last_change":"2023-11-26T07:23:05.048921+0000","last_active":"2023-11-26T07:23:06.021826+0000","last_peered":"2023-11-26T07:23:06.021826+0000","last_clean":"2023-11-26T07:23:06.021826+0000","last_became_active":"2023-11-26T07:23:05.048281+0000","last_became_peered":"2023-11-26T07:23:05.048281+0000","last_unstale":"2023-11-26T07:23:06.021826+0000","last_undegraded":"2023-11-26T07:23:06.021826+0000","last_fullsized":"2023-11-26T07:23:06.021826+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:25:59.666419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.543364+0000","last_change":"2023-11-26T07:23:05.029517+0000","last_active":"2023-11-26T07:23:07.543364+0000","last_peered":"2023-11-26T07:23:07.543364+0000","last_clean":"2023-11-26T07:23:07.543364+0000","last_became_active":"2023-11-26T07:23:05.028459+0000","last_became_peered":"2023-11-26T07:23:05.028459+0000","last_unstale":"2023-11-26T07:23:07.543364+0000","last_undegraded":"2023-11-26T07:23:07.543364+0000","last_fullsized":"2023-11-26T07:23:07.543364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:49.207227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.019623+0000","last_change":"2023-11-26T07:23:05.055497+0000","last_active":"2023-11-26T07:23:06.019623+0000","last_peered":"2023-11-26T07:23:06.019623+0000","last_clean":"2023-11-26T07:23:06.019623+0000","last_became_active":"2023-11-26T07:23:05.055123+0000","last_became_peered":"2023-11-26T07:23:05.055123+0000","last_unstale":"2023-11-26T07:23:06.019623+0000","last_undegraded":"2023-11-26T07:23:06.019623+0000","last_fullsized":"2023-11-26T07:23:06.019623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:02:16.220572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.819605+0000","last_change":"2023-11-26T07:23:05.042260+0000","last_active":"2023-11-26T07:23:06.819605+0000","last_peered":"2023-11-26T07:23:06.819605+0000","last_clean":"2023-11-26T07:23:06.819605+0000","last_became_active":"2023-11-26T07:23:05.041977+0000","last_became_peered":"2023-11-26T07:23:05.041977+0000","last_unstale":"2023-11-26T07:23:06.819605+0000","last_undegraded":"2023-11-26T07:23:06.819605+0000","last_fullsized":"2023-11-26T07:23:06.819605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:56:39.791971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.019392+0000","last_change":"2023-11-26T07:23:05.041376+0000","last_active":"2023-11-26T07:23:06.019392+0000","last_peered":"2023-11-26T07:23:06.019392+0000","last_clean":"2023-11-26T07:23:06.019392+0000","last_became_active":"2023-11-26T07:23:05.041105+0000","last_became_peered":"2023-11-26T07:23:05.041105+0000","last_unstale":"2023-11-26T07:23:06.019392+0000","last_undegraded":"2023-11-26T07:23:06.019392+0000","last_fullsized":"2023-11-26T07:23:06.019392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:37:22.692599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.699352+0000","last_change":"2023-11-26T07:23:05.055318+0000","last_active":"2023-11-26T07:23:07.699352+0000","last_peered":"2023-11-26T07:23:07.699352+0000","last_clean":"2023-11-26T07:23:07.699352+0000","last_became_active":"2023-11-26T07:23:05.054994+0000","last_became_peered":"2023-11-26T07:23:05.054994+0000","last_unstale":"2023-11-26T07:23:07.699352+0000","last_undegraded":"2023-11-26T07:23:07.699352+0000","last_fullsized":"2023-11-26T07:23:07.699352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:54:05.552088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.820191+0000","last_change":"2023-11-26T07:23:05.034731+0000","last_active":"2023-11-26T07:23:06.820191+0000","last_peered":"2023-11-26T07:23:06.820191+0000","last_clean":"2023-11-26T07:23:06.820191+0000","last_became_active":"2023-11-26T07:23:05.033956+0000","last_became_peered":"2023-11-26T07:23:05.033956+0000","last_unstale":"2023-11-26T07:23:06.820191+0000","last_undegraded":"2023-11-26T07:23:06.820191+0000","last_fullsized":"2023-11-26T07:23:06.820191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:38:27.475533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.543608+0000","last_change":"2023-11-26T07:23:05.053382+0000","last_active":"2023-11-26T07:23:07.543608+0000","last_peered":"2023-11-26T07:23:07.543608+0000","last_clean":"2023-11-26T07:23:07.543608+0000","last_became_active":"2023-11-26T07:23:05.053066+0000","last_became_peered":"2023-11-26T07:23:05.053066+0000","last_unstale":"2023-11-26T07:23:07.543608+0000","last_undegraded":"2023-11-26T07:23:07.543608+0000","last_fullsized":"2023-11-26T07:23:07.543608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:04:32.708977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.024000+0000","last_change":"2023-11-26T07:23:05.054145+0000","last_active":"2023-11-26T07:23:06.024000+0000","last_peered":"2023-11-26T07:23:06.024000+0000","last_clean":"2023-11-26T07:23:06.024000+0000","last_became_active":"2023-11-26T07:23:05.053397+0000","last_became_peered":"2023-11-26T07:23:05.053397+0000","last_unstale":"2023-11-26T07:23:06.024000+0000","last_undegraded":"2023-11-26T07:23:06.024000+0000","last_fullsized":"2023-11-26T07:23:06.024000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:05:02.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.019791+0000","last_change":"2023-11-26T07:23:05.043146+0000","last_active":"2023-11-26T07:23:06.019791+0000","last_peered":"2023-11-26T07:23:06.019791+0000","last_clean":"2023-11-26T07:23:06.019791+0000","last_became_active":"2023-11-26T07:23:05.042899+0000","last_became_peered":"2023-11-26T07:23:05.042899+0000","last_unstale":"2023-11-26T07:23:06.019791+0000","last_undegraded":"2023-11-26T07:23:06.019791+0000","last_fullsized":"2023-11-26T07:23:06.019791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:25:59.666419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.699895+0000","last_change":"2023-11-26T07:23:05.041933+0000","last_active":"2023-11-26T07:23:07.699895+0000","last_peered":"2023-11-26T07:23:07.699895+0000","last_clean":"2023-11-26T07:23:07.699895+0000","last_became_active":"2023-11-26T07:23:05.040099+0000","last_became_peered":"2023-11-26T07:23:05.040099+0000","last_unstale":"2023-11-26T07:23:07.699895+0000","last_undegraded":"2023-11-26T07:23:07.699895+0000","last_fullsized":"2023-11-26T07:23:07.699895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:06:31.110095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.699433+0000","last_change":"2023-11-26T07:23:05.032649+0000","last_active":"2023-11-26T07:23:07.699433+0000","last_peered":"2023-11-26T07:23:07.699433+0000","last_clean":"2023-11-26T07:23:07.699433+0000","last_became_active":"2023-11-26T07:23:05.032293+0000","last_became_peered":"2023-11-26T07:23:05.032293+0000","last_unstale":"2023-11-26T07:23:07.699433+0000","last_undegraded":"2023-11-26T07:23:07.699433+0000","last_fullsized":"2023-11-26T07:23:07.699433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:16:55.394149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.022376+0000","last_change":"2023-11-26T07:23:05.046296+0000","last_active":"2023-11-26T07:23:06.022376+0000","last_peered":"2023-11-26T07:23:06.022376+0000","last_clean":"2023-11-26T07:23:06.022376+0000","last_became_active":"2023-11-26T07:23:05.045207+0000","last_became_peered":"2023-11-26T07:23:05.045207+0000","last_unstale":"2023-11-26T07:23:06.022376+0000","last_undegraded":"2023-11-26T07:23:06.022376+0000","last_fullsized":"2023-11-26T07:23:06.022376+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:29:22.129372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.021002+0000","last_change":"2023-11-26T07:23:05.059253+0000","last_active":"2023-11-26T07:23:06.021002+0000","last_peered":"2023-11-26T07:23:06.021002+0000","last_clean":"2023-11-26T07:23:06.021002+0000","last_became_active":"2023-11-26T07:23:05.058959+0000","last_became_peered":"2023-11-26T07:23:05.058959+0000","last_unstale":"2023-11-26T07:23:06.021002+0000","last_undegraded":"2023-11-26T07:23:06.021002+0000","last_fullsized":"2023-11-26T07:23:06.021002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:37:22.692599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.700602+0000","last_change":"2023-11-26T07:23:05.048151+0000","last_active":"2023-11-26T07:23:07.700602+0000","last_peered":"2023-11-26T07:23:07.700602+0000","last_clean":"2023-11-26T07:23:07.700602+0000","last_became_active":"2023-11-26T07:23:05.047668+0000","last_became_peered":"2023-11-26T07:23:05.047668+0000","last_unstale":"2023-11-26T07:23:07.700602+0000","last_undegraded":"2023-11-26T07:23:07.700602+0000","last_fullsized":"2023-11-26T07:23:07.700602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:32:41.542257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.269683+0000","last_change":"2023-11-26T07:23:05.054532+0000","last_active":"2023-11-26T07:23:07.269683+0000","last_peered":"2023-11-26T07:23:07.269683+0000","last_clean":"2023-11-26T07:23:07.269683+0000","last_became_active":"2023-11-26T07:23:05.054202+0000","last_became_peered":"2023-11-26T07:23:05.054202+0000","last_unstale":"2023-11-26T07:23:07.269683+0000","last_undegraded":"2023-11-26T07:23:07.269683+0000","last_fullsized":"2023-11-26T07:23:07.269683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:38:01.670362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.700137+0000","last_change":"2023-11-26T07:23:05.045912+0000","last_active":"2023-11-26T07:23:07.700137+0000","last_peered":"2023-11-26T07:23:07.700137+0000","last_clean":"2023-11-26T07:23:07.700137+0000","last_became_active":"2023-11-26T07:23:05.045376+0000","last_became_peered":"2023-11-26T07:23:05.045376+0000","last_unstale":"2023-11-26T07:23:07.700137+0000","last_undegraded":"2023-11-26T07:23:07.700137+0000","last_fullsized":"2023-11-26T07:23:07.700137+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:43:56.188046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.700193+0000","last_change":"2023-11-26T07:23:05.033773+0000","last_active":"2023-11-26T07:23:07.700193+0000","last_peered":"2023-11-26T07:23:07.700193+0000","last_clean":"2023-11-26T07:23:07.700193+0000","last_became_active":"2023-11-26T07:23:05.032132+0000","last_became_peered":"2023-11-26T07:23:05.032132+0000","last_unstale":"2023-11-26T07:23:07.700193+0000","last_undegraded":"2023-11-26T07:23:07.700193+0000","last_fullsized":"2023-11-26T07:23:07.700193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:21:47.727813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.699689+0000","last_change":"2023-11-26T07:23:05.044905+0000","last_active":"2023-11-26T07:23:07.699689+0000","last_peered":"2023-11-26T07:23:07.699689+0000","last_clean":"2023-11-26T07:23:07.699689+0000","last_became_active":"2023-11-26T07:23:05.044562+0000","last_became_peered":"2023-11-26T07:23:05.044562+0000","last_unstale":"2023-11-26T07:23:07.699689+0000","last_undegraded":"2023-11-26T07:23:07.699689+0000","last_fullsized":"2023-11-26T07:23:07.699689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:02:51.526605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.269320+0000","last_change":"2023-11-26T07:23:05.058415+0000","last_active":"2023-11-26T07:23:07.269320+0000","last_peered":"2023-11-26T07:23:07.269320+0000","last_clean":"2023-11-26T07:23:07.269320+0000","last_became_active":"2023-11-26T07:23:05.058076+0000","last_became_peered":"2023-11-26T07:23:05.058076+0000","last_unstale":"2023-11-26T07:23:07.269320+0000","last_undegraded":"2023-11-26T07:23:07.269320+0000","last_fullsized":"2023-11-26T07:23:07.269320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:56:32.948213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.269221+0000","last_change":"2023-11-26T07:23:05.039776+0000","last_active":"2023-11-26T07:23:07.269221+0000","last_peered":"2023-11-26T07:23:07.269221+0000","last_clean":"2023-11-26T07:23:07.269221+0000","last_became_active":"2023-11-26T07:23:05.038429+0000","last_became_peered":"2023-11-26T07:23:05.038429+0000","last_unstale":"2023-11-26T07:23:07.269221+0000","last_undegraded":"2023-11-26T07:23:07.269221+0000","last_fullsized":"2023-11-26T07:23:07.269221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:32:41.542257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.022754+0000","last_change":"2023-11-26T07:23:05.054860+0000","last_active":"2023-11-26T07:23:06.022754+0000","last_peered":"2023-11-26T07:23:06.022754+0000","last_clean":"2023-11-26T07:23:06.022754+0000","last_became_active":"2023-11-26T07:23:05.054496+0000","last_became_peered":"2023-11-26T07:23:05.054496+0000","last_unstale":"2023-11-26T07:23:06.022754+0000","last_undegraded":"2023-11-26T07:23:06.022754+0000","last_fullsized":"2023-11-26T07:23:06.022754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:22:25.009065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.021684+0000","last_change":"2023-11-26T07:23:05.059070+0000","last_active":"2023-11-26T07:23:06.021684+0000","last_peered":"2023-11-26T07:23:06.021684+0000","last_clean":"2023-11-26T07:23:06.021684+0000","last_became_active":"2023-11-26T07:23:05.058688+0000","last_became_peered":"2023-11-26T07:23:05.058688+0000","last_unstale":"2023-11-26T07:23:06.021684+0000","last_undegraded":"2023-11-26T07:23:06.021684+0000","last_fullsized":"2023-11-26T07:23:06.021684+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:56:30.705469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"74'4","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.048758+0000","last_change":"2023-11-26T07:23:04.029041+0000","last_active":"2023-11-26T07:23:05.048758+0000","last_peered":"2023-11-26T07:23:05.048758+0000","last_clean":"2023-11-26T07:23:05.048758+0000","last_became_active":"2023-11-26T07:23:04.028666+0000","last_became_peered":"2023-11-26T07:23:04.028666+0000","last_unstale":"2023-11-26T07:23:05.048758+0000","last_undegraded":"2023-11-26T07:23:05.048758+0000","last_fullsized":"2023-11-26T07:23:05.048758+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:14:20.338459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.820405+0000","last_change":"2023-11-26T07:23:05.034570+0000","last_active":"2023-11-26T07:23:06.820405+0000","last_peered":"2023-11-26T07:23:06.820405+0000","last_clean":"2023-11-26T07:23:06.820405+0000","last_became_active":"2023-11-26T07:23:05.033562+0000","last_became_peered":"2023-11-26T07:23:05.033562+0000","last_unstale":"2023-11-26T07:23:06.820405+0000","last_undegraded":"2023-11-26T07:23:06.820405+0000","last_fullsized":"2023-11-26T07:23:06.820405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:54:15.979131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.042481+0000","last_change":"2023-11-26T07:23:04.014268+0000","last_active":"2023-11-26T07:23:05.042481+0000","last_peered":"2023-11-26T07:23:05.042481+0000","last_clean":"2023-11-26T07:23:05.042481+0000","last_became_active":"2023-11-26T07:23:04.011332+0000","last_became_peered":"2023-11-26T07:23:04.011332+0000","last_unstale":"2023-11-26T07:23:05.042481+0000","last_undegraded":"2023-11-26T07:23:05.042481+0000","last_fullsized":"2023-11-26T07:23:05.042481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:38:00.656434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.023958+0000","last_change":"2023-11-26T07:23:05.058708+0000","last_active":"2023-11-26T07:23:06.023958+0000","last_peered":"2023-11-26T07:23:06.023958+0000","last_clean":"2023-11-26T07:23:06.023958+0000","last_became_active":"2023-11-26T07:23:05.058422+0000","last_became_peered":"2023-11-26T07:23:05.058422+0000","last_unstale":"2023-11-26T07:23:06.023958+0000","last_undegraded":"2023-11-26T07:23:06.023958+0000","last_fullsized":"2023-11-26T07:23:06.023958+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:11:40.960647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.057295+0000","last_change":"2023-11-26T07:23:04.031209+0000","last_active":"2023-11-26T07:23:05.057295+0000","last_peered":"2023-11-26T07:23:05.057295+0000","last_clean":"2023-11-26T07:23:05.057295+0000","last_became_active":"2023-11-26T07:23:04.030530+0000","last_became_peered":"2023-11-26T07:23:04.030530+0000","last_unstale":"2023-11-26T07:23:05.057295+0000","last_undegraded":"2023-11-26T07:23:05.057295+0000","last_fullsized":"2023-11-26T07:23:05.057295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:04:49.168540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.022186+0000","last_change":"2023-11-26T07:23:05.044315+0000","last_active":"2023-11-26T07:23:06.022186+0000","last_peered":"2023-11-26T07:23:06.022186+0000","last_clean":"2023-11-26T07:23:06.022186+0000","last_became_active":"2023-11-26T07:23:05.043320+0000","last_became_peered":"2023-11-26T07:23:05.043320+0000","last_unstale":"2023-11-26T07:23:06.022186+0000","last_undegraded":"2023-11-26T07:23:06.022186+0000","last_fullsized":"2023-11-26T07:23:06.022186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:44:15.056558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.053514+0000","last_change":"2023-11-26T07:23:04.022058+0000","last_active":"2023-11-26T07:23:05.053514+0000","last_peered":"2023-11-26T07:23:05.053514+0000","last_clean":"2023-11-26T07:23:05.053514+0000","last_became_active":"2023-11-26T07:23:04.021725+0000","last_became_peered":"2023-11-26T07:23:04.021725+0000","last_unstale":"2023-11-26T07:23:05.053514+0000","last_undegraded":"2023-11-26T07:23:05.053514+0000","last_fullsized":"2023-11-26T07:23:05.053514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:04:42.783030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.269218+0000","last_change":"2023-11-26T07:23:05.033606+0000","last_active":"2023-11-26T07:23:07.269218+0000","last_peered":"2023-11-26T07:23:07.269218+0000","last_clean":"2023-11-26T07:23:07.269218+0000","last_became_active":"2023-11-26T07:23:05.033262+0000","last_became_peered":"2023-11-26T07:23:05.033262+0000","last_unstale":"2023-11-26T07:23:07.269218+0000","last_undegraded":"2023-11-26T07:23:07.269218+0000","last_fullsized":"2023-11-26T07:23:07.269218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:52:22.481473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.044521+0000","last_change":"2023-11-26T07:23:04.030912+0000","last_active":"2023-11-26T07:23:05.044521+0000","last_peered":"2023-11-26T07:23:05.044521+0000","last_clean":"2023-11-26T07:23:05.044521+0000","last_became_active":"2023-11-26T07:23:04.030574+0000","last_became_peered":"2023-11-26T07:23:04.030574+0000","last_unstale":"2023-11-26T07:23:05.044521+0000","last_undegraded":"2023-11-26T07:23:05.044521+0000","last_fullsized":"2023-11-26T07:23:05.044521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:28:34.175188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.699874+0000","last_change":"2023-11-26T07:23:05.047012+0000","last_active":"2023-11-26T07:23:07.699874+0000","last_peered":"2023-11-26T07:23:07.699874+0000","last_clean":"2023-11-26T07:23:07.699874+0000","last_became_active":"2023-11-26T07:23:05.046685+0000","last_became_peered":"2023-11-26T07:23:05.046685+0000","last_unstale":"2023-11-26T07:23:07.699874+0000","last_undegraded":"2023-11-26T07:23:07.699874+0000","last_fullsized":"2023-11-26T07:23:07.699874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:58.982535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.057044+0000","last_change":"2023-11-26T07:23:04.024062+0000","last_active":"2023-11-26T07:23:05.057044+0000","last_peered":"2023-11-26T07:23:05.057044+0000","last_clean":"2023-11-26T07:23:05.057044+0000","last_became_active":"2023-11-26T07:23:04.023818+0000","last_became_peered":"2023-11-26T07:23:04.023818+0000","last_unstale":"2023-11-26T07:23:05.057044+0000","last_undegraded":"2023-11-26T07:23:05.057044+0000","last_fullsized":"2023-11-26T07:23:05.057044+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:41:03.601799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.819101+0000","last_change":"2023-11-26T07:23:05.027328+0000","last_active":"2023-11-26T07:23:06.819101+0000","last_peered":"2023-11-26T07:23:06.819101+0000","last_clean":"2023-11-26T07:23:06.819101+0000","last_became_active":"2023-11-26T07:23:05.027043+0000","last_became_peered":"2023-11-26T07:23:05.027043+0000","last_unstale":"2023-11-26T07:23:06.819101+0000","last_undegraded":"2023-11-26T07:23:06.819101+0000","last_fullsized":"2023-11-26T07:23:06.819101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:01:48.517984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.019953+0000","last_change":"2023-11-26T07:23:04.028017+0000","last_active":"2023-11-26T07:23:05.019953+0000","last_peered":"2023-11-26T07:23:05.019953+0000","last_clean":"2023-11-26T07:23:05.019953+0000","last_became_active":"2023-11-26T07:23:04.027735+0000","last_became_peered":"2023-11-26T07:23:04.027735+0000","last_unstale":"2023-11-26T07:23:05.019953+0000","last_undegraded":"2023-11-26T07:23:05.019953+0000","last_fullsized":"2023-11-26T07:23:05.019953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:05:58.145620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.019868+0000","last_change":"2023-11-26T07:23:05.044318+0000","last_active":"2023-11-26T07:23:06.019868+0000","last_peered":"2023-11-26T07:23:06.019868+0000","last_clean":"2023-11-26T07:23:06.019868+0000","last_became_active":"2023-11-26T07:23:05.044069+0000","last_became_peered":"2023-11-26T07:23:05.044069+0000","last_unstale":"2023-11-26T07:23:06.019868+0000","last_undegraded":"2023-11-26T07:23:06.019868+0000","last_fullsized":"2023-11-26T07:23:06.019868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:44:15.056558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.014467+0000","last_change":"2023-11-26T07:23:04.013517+0000","last_active":"2023-11-26T07:23:05.014467+0000","last_peered":"2023-11-26T07:23:05.014467+0000","last_clean":"2023-11-26T07:23:05.014467+0000","last_became_active":"2023-11-26T07:23:04.011762+0000","last_became_peered":"2023-11-26T07:23:04.011762+0000","last_unstale":"2023-11-26T07:23:05.014467+0000","last_undegraded":"2023-11-26T07:23:05.014467+0000","last_fullsized":"2023-11-26T07:23:05.014467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:40:55.272989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.269583+0000","last_change":"2023-11-26T07:23:05.044044+0000","last_active":"2023-11-26T07:23:07.269583+0000","last_peered":"2023-11-26T07:23:07.269583+0000","last_clean":"2023-11-26T07:23:07.269583+0000","last_became_active":"2023-11-26T07:23:05.043574+0000","last_became_peered":"2023-11-26T07:23:05.043574+0000","last_unstale":"2023-11-26T07:23:07.269583+0000","last_undegraded":"2023-11-26T07:23:07.269583+0000","last_fullsized":"2023-11-26T07:23:07.269583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:14:21.352386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.024697+0000","last_change":"2023-11-26T07:23:04.030481+0000","last_active":"2023-11-26T07:23:05.024697+0000","last_peered":"2023-11-26T07:23:05.024697+0000","last_clean":"2023-11-26T07:23:05.024697+0000","last_became_active":"2023-11-26T07:23:04.030087+0000","last_became_peered":"2023-11-26T07:23:04.030087+0000","last_unstale":"2023-11-26T07:23:05.024697+0000","last_undegraded":"2023-11-26T07:23:05.024697+0000","last_fullsized":"2023-11-26T07:23:05.024697+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:37:31.744074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.022676+0000","last_change":"2023-11-26T07:23:05.059214+0000","last_active":"2023-11-26T07:23:06.022676+0000","last_peered":"2023-11-26T07:23:06.022676+0000","last_clean":"2023-11-26T07:23:06.022676+0000","last_became_active":"2023-11-26T07:23:05.058874+0000","last_became_peered":"2023-11-26T07:23:05.058874+0000","last_unstale":"2023-11-26T07:23:06.022676+0000","last_undegraded":"2023-11-26T07:23:06.022676+0000","last_fullsized":"2023-11-26T07:23:06.022676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:41:47.069263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.033956+0000","last_change":"2023-11-26T07:23:04.028003+0000","last_active":"2023-11-26T07:23:05.033956+0000","last_peered":"2023-11-26T07:23:05.033956+0000","last_clean":"2023-11-26T07:23:05.033956+0000","last_became_active":"2023-11-26T07:23:04.026827+0000","last_became_peered":"2023-11-26T07:23:04.026827+0000","last_unstale":"2023-11-26T07:23:05.033956+0000","last_undegraded":"2023-11-26T07:23:05.033956+0000","last_fullsized":"2023-11-26T07:23:05.033956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:08:54.344278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.023957+0000","last_change":"2023-11-26T07:23:05.050838+0000","last_active":"2023-11-26T07:23:06.023957+0000","last_peered":"2023-11-26T07:23:06.023957+0000","last_clean":"2023-11-26T07:23:06.023957+0000","last_became_active":"2023-11-26T07:23:05.050548+0000","last_became_peered":"2023-11-26T07:23:05.050548+0000","last_unstale":"2023-11-26T07:23:06.023957+0000","last_undegraded":"2023-11-26T07:23:06.023957+0000","last_fullsized":"2023-11-26T07:23:06.023957+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:02:00.926116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.045771+0000","last_change":"2023-11-26T07:23:04.025706+0000","last_active":"2023-11-26T07:23:05.045771+0000","last_peered":"2023-11-26T07:23:05.045771+0000","last_clean":"2023-11-26T07:23:05.045771+0000","last_became_active":"2023-11-26T07:23:04.025166+0000","last_became_peered":"2023-11-26T07:23:04.025166+0000","last_unstale":"2023-11-26T07:23:05.045771+0000","last_undegraded":"2023-11-26T07:23:05.045771+0000","last_fullsized":"2023-11-26T07:23:05.045771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:19:23.389430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.819419+0000","last_change":"2023-11-26T07:23:05.022633+0000","last_active":"2023-11-26T07:23:06.819419+0000","last_peered":"2023-11-26T07:23:06.819419+0000","last_clean":"2023-11-26T07:23:06.819419+0000","last_became_active":"2023-11-26T07:23:05.022312+0000","last_became_peered":"2023-11-26T07:23:05.022312+0000","last_unstale":"2023-11-26T07:23:06.819419+0000","last_undegraded":"2023-11-26T07:23:06.819419+0000","last_fullsized":"2023-11-26T07:23:06.819419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:37:49.475962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.052321+0000","last_change":"2023-11-26T07:23:04.014776+0000","last_active":"2023-11-26T07:23:05.052321+0000","last_peered":"2023-11-26T07:23:05.052321+0000","last_clean":"2023-11-26T07:23:05.052321+0000","last_became_active":"2023-11-26T07:23:04.014428+0000","last_became_peered":"2023-11-26T07:23:04.014428+0000","last_unstale":"2023-11-26T07:23:05.052321+0000","last_undegraded":"2023-11-26T07:23:05.052321+0000","last_fullsized":"2023-11-26T07:23:05.052321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:40:51.718198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.021229+0000","last_change":"2023-11-26T07:23:05.051318+0000","last_active":"2023-11-26T07:23:06.021229+0000","last_peered":"2023-11-26T07:23:06.021229+0000","last_clean":"2023-11-26T07:23:06.021229+0000","last_became_active":"2023-11-26T07:23:05.051035+0000","last_became_peered":"2023-11-26T07:23:05.051035+0000","last_unstale":"2023-11-26T07:23:06.021229+0000","last_undegraded":"2023-11-26T07:23:06.021229+0000","last_fullsized":"2023-11-26T07:23:06.021229+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:02:16.220572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.053068+0000","last_change":"2023-11-26T07:23:04.024682+0000","last_active":"2023-11-26T07:23:05.053068+0000","last_peered":"2023-11-26T07:23:05.053068+0000","last_clean":"2023-11-26T07:23:05.053068+0000","last_became_active":"2023-11-26T07:23:04.024333+0000","last_became_peered":"2023-11-26T07:23:04.024333+0000","last_unstale":"2023-11-26T07:23:05.053068+0000","last_undegraded":"2023-11-26T07:23:05.053068+0000","last_fullsized":"2023-11-26T07:23:05.053068+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:17:33.456190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.269195+0000","last_change":"2023-11-26T07:23:05.044853+0000","last_active":"2023-11-26T07:23:07.269195+0000","last_peered":"2023-11-26T07:23:07.269195+0000","last_clean":"2023-11-26T07:23:07.269195+0000","last_became_active":"2023-11-26T07:23:05.043616+0000","last_became_peered":"2023-11-26T07:23:05.043616+0000","last_unstale":"2023-11-26T07:23:07.269195+0000","last_undegraded":"2023-11-26T07:23:07.269195+0000","last_fullsized":"2023-11-26T07:23:07.269195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:21:47.727813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.031499+0000","last_change":"2023-11-26T07:23:04.024004+0000","last_active":"2023-11-26T07:23:05.031499+0000","last_peered":"2023-11-26T07:23:05.031499+0000","last_clean":"2023-11-26T07:23:05.031499+0000","last_became_active":"2023-11-26T07:23:04.023735+0000","last_became_peered":"2023-11-26T07:23:04.023735+0000","last_unstale":"2023-11-26T07:23:05.031499+0000","last_undegraded":"2023-11-26T07:23:05.031499+0000","last_fullsized":"2023-11-26T07:23:05.031499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:40:51.718198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.019162+0000","last_change":"2023-11-26T07:23:05.055664+0000","last_active":"2023-11-26T07:23:06.019162+0000","last_peered":"2023-11-26T07:23:06.019162+0000","last_clean":"2023-11-26T07:23:06.019162+0000","last_became_active":"2023-11-26T07:23:05.055398+0000","last_became_peered":"2023-11-26T07:23:05.055398+0000","last_unstale":"2023-11-26T07:23:06.019162+0000","last_undegraded":"2023-11-26T07:23:06.019162+0000","last_fullsized":"2023-11-26T07:23:06.019162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:17:33.766200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.028399+0000","last_change":"2023-11-26T07:23:04.019482+0000","last_active":"2023-11-26T07:23:05.028399+0000","last_peered":"2023-11-26T07:23:05.028399+0000","last_clean":"2023-11-26T07:23:05.028399+0000","last_became_active":"2023-11-26T07:23:04.018316+0000","last_became_peered":"2023-11-26T07:23:04.018316+0000","last_unstale":"2023-11-26T07:23:05.028399+0000","last_undegraded":"2023-11-26T07:23:05.028399+0000","last_fullsized":"2023-11-26T07:23:05.028399+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:16:54.380222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.819151+0000","last_change":"2023-11-26T07:23:05.034120+0000","last_active":"2023-11-26T07:23:06.819151+0000","last_peered":"2023-11-26T07:23:06.819151+0000","last_clean":"2023-11-26T07:23:06.819151+0000","last_became_active":"2023-11-26T07:23:05.033814+0000","last_became_peered":"2023-11-26T07:23:05.033814+0000","last_unstale":"2023-11-26T07:23:06.819151+0000","last_undegraded":"2023-11-26T07:23:06.819151+0000","last_fullsized":"2023-11-26T07:23:06.819151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:19:57.326885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"74'8","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.057803+0000","last_change":"2023-11-26T07:23:04.025937+0000","last_active":"2023-11-26T07:23:05.057803+0000","last_peered":"2023-11-26T07:23:05.057803+0000","last_clean":"2023-11-26T07:23:05.057803+0000","last_became_active":"2023-11-26T07:23:04.025645+0000","last_became_peered":"2023-11-26T07:23:04.025645+0000","last_unstale":"2023-11-26T07:23:05.057803+0000","last_undegraded":"2023-11-26T07:23:05.057803+0000","last_fullsized":"2023-11-26T07:23:05.057803+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:39:28.724233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.700469+0000","last_change":"2023-11-26T07:23:05.034247+0000","last_active":"2023-11-26T07:23:07.700469+0000","last_peered":"2023-11-26T07:23:07.700469+0000","last_clean":"2023-11-26T07:23:07.700469+0000","last_became_active":"2023-11-26T07:23:05.033897+0000","last_became_peered":"2023-11-26T07:23:05.033897+0000","last_unstale":"2023-11-26T07:23:07.700469+0000","last_undegraded":"2023-11-26T07:23:07.700469+0000","last_fullsized":"2023-11-26T07:23:07.700469+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:52:22.481473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.057579+0000","last_change":"2023-11-26T07:23:04.026574+0000","last_active":"2023-11-26T07:23:05.057579+0000","last_peered":"2023-11-26T07:23:05.057579+0000","last_clean":"2023-11-26T07:23:05.057579+0000","last_became_active":"2023-11-26T07:23:04.025902+0000","last_became_peered":"2023-11-26T07:23:04.025902+0000","last_unstale":"2023-11-26T07:23:05.057579+0000","last_undegraded":"2023-11-26T07:23:05.057579+0000","last_fullsized":"2023-11-26T07:23:05.057579+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:38:26.461605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.023010+0000","last_change":"2023-11-26T07:23:05.044543+0000","last_active":"2023-11-26T07:23:06.023010+0000","last_peered":"2023-11-26T07:23:06.023010+0000","last_clean":"2023-11-26T07:23:06.023010+0000","last_became_active":"2023-11-26T07:23:05.043494+0000","last_became_peered":"2023-11-26T07:23:05.043494+0000","last_unstale":"2023-11-26T07:23:06.023010+0000","last_undegraded":"2023-11-26T07:23:06.023010+0000","last_fullsized":"2023-11-26T07:23:06.023010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:12:48.513771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.054015+0000","last_change":"2023-11-26T07:23:04.031062+0000","last_active":"2023-11-26T07:23:05.054015+0000","last_peered":"2023-11-26T07:23:05.054015+0000","last_clean":"2023-11-26T07:23:05.054015+0000","last_became_active":"2023-11-26T07:23:04.030546+0000","last_became_peered":"2023-11-26T07:23:04.030546+0000","last_unstale":"2023-11-26T07:23:05.054015+0000","last_undegraded":"2023-11-26T07:23:05.054015+0000","last_fullsized":"2023-11-26T07:23:05.054015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:22:23.896932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.543463+0000","last_change":"2023-11-26T07:23:05.030416+0000","last_active":"2023-11-26T07:23:07.543463+0000","last_peered":"2023-11-26T07:23:07.543463+0000","last_clean":"2023-11-26T07:23:07.543463+0000","last_became_active":"2023-11-26T07:23:05.030104+0000","last_became_peered":"2023-11-26T07:23:05.030104+0000","last_unstale":"2023-11-26T07:23:07.543463+0000","last_undegraded":"2023-11-26T07:23:07.543463+0000","last_fullsized":"2023-11-26T07:23:07.543463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:57:56.986517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.057444+0000","last_change":"2023-11-26T07:23:04.032922+0000","last_active":"2023-11-26T07:23:05.057444+0000","last_peered":"2023-11-26T07:23:05.057444+0000","last_clean":"2023-11-26T07:23:05.057444+0000","last_became_active":"2023-11-26T07:23:04.032603+0000","last_became_peered":"2023-11-26T07:23:04.032603+0000","last_unstale":"2023-11-26T07:23:05.057444+0000","last_undegraded":"2023-11-26T07:23:05.057444+0000","last_fullsized":"2023-11-26T07:23:05.057444+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:39:59.595365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.819848+0000","last_change":"2023-11-26T07:23:05.026850+0000","last_active":"2023-11-26T07:23:06.819848+0000","last_peered":"2023-11-26T07:23:06.819848+0000","last_clean":"2023-11-26T07:23:06.819848+0000","last_became_active":"2023-11-26T07:23:05.026564+0000","last_became_peered":"2023-11-26T07:23:05.026564+0000","last_unstale":"2023-11-26T07:23:06.819848+0000","last_undegraded":"2023-11-26T07:23:06.819848+0000","last_fullsized":"2023-11-26T07:23:06.819848+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:44:10.367703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.030361+0000","last_change":"2023-11-26T07:23:04.032734+0000","last_active":"2023-11-26T07:23:05.030361+0000","last_peered":"2023-11-26T07:23:05.030361+0000","last_clean":"2023-11-26T07:23:05.030361+0000","last_became_active":"2023-11-26T07:23:04.032312+0000","last_became_peered":"2023-11-26T07:23:04.032312+0000","last_unstale":"2023-11-26T07:23:05.030361+0000","last_undegraded":"2023-11-26T07:23:05.030361+0000","last_fullsized":"2023-11-26T07:23:05.030361+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:57.968608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.699712+0000","last_change":"2023-11-26T07:23:05.037265+0000","last_active":"2023-11-26T07:23:07.699712+0000","last_peered":"2023-11-26T07:23:07.699712+0000","last_clean":"2023-11-26T07:23:07.699712+0000","last_became_active":"2023-11-26T07:23:05.036976+0000","last_became_peered":"2023-11-26T07:23:05.036976+0000","last_unstale":"2023-11-26T07:23:07.699712+0000","last_undegraded":"2023-11-26T07:23:07.699712+0000","last_fullsized":"2023-11-26T07:23:07.699712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:34:18.632617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.036039+0000","last_change":"2023-11-26T07:23:04.023417+0000","last_active":"2023-11-26T07:23:05.036039+0000","last_peered":"2023-11-26T07:23:05.036039+0000","last_clean":"2023-11-26T07:23:05.036039+0000","last_became_active":"2023-11-26T07:23:04.023132+0000","last_became_peered":"2023-11-26T07:23:04.023132+0000","last_unstale":"2023-11-26T07:23:05.036039+0000","last_undegraded":"2023-11-26T07:23:05.036039+0000","last_fullsized":"2023-11-26T07:23:05.036039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:48.193300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.699434+0000","last_change":"2023-11-26T07:23:05.056016+0000","last_active":"2023-11-26T07:23:07.699434+0000","last_peered":"2023-11-26T07:23:07.699434+0000","last_clean":"2023-11-26T07:23:07.699434+0000","last_became_active":"2023-11-26T07:23:05.055769+0000","last_became_peered":"2023-11-26T07:23:05.055769+0000","last_unstale":"2023-11-26T07:23:07.699434+0000","last_undegraded":"2023-11-26T07:23:07.699434+0000","last_fullsized":"2023-11-26T07:23:07.699434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:22:26.596437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.025260+0000","last_change":"2023-11-26T07:23:04.018895+0000","last_active":"2023-11-26T07:23:05.025260+0000","last_peered":"2023-11-26T07:23:05.025260+0000","last_clean":"2023-11-26T07:23:05.025260+0000","last_became_active":"2023-11-26T07:23:04.013737+0000","last_became_peered":"2023-11-26T07:23:04.013737+0000","last_unstale":"2023-11-26T07:23:05.025260+0000","last_undegraded":"2023-11-26T07:23:05.025260+0000","last_fullsized":"2023-11-26T07:23:05.025260+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:54:04.538161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.699582+0000","last_change":"2023-11-26T07:23:05.054320+0000","last_active":"2023-11-26T07:23:07.699582+0000","last_peered":"2023-11-26T07:23:07.699582+0000","last_clean":"2023-11-26T07:23:07.699582+0000","last_became_active":"2023-11-26T07:23:05.054043+0000","last_became_peered":"2023-11-26T07:23:05.054043+0000","last_unstale":"2023-11-26T07:23:07.699582+0000","last_undegraded":"2023-11-26T07:23:07.699582+0000","last_fullsized":"2023-11-26T07:23:07.699582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:06:38.525744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.032234+0000","last_change":"2023-11-26T07:23:04.013897+0000","last_active":"2023-11-26T07:23:05.032234+0000","last_peered":"2023-11-26T07:23:05.032234+0000","last_clean":"2023-11-26T07:23:05.032234+0000","last_became_active":"2023-11-26T07:23:04.013581+0000","last_became_peered":"2023-11-26T07:23:04.013581+0000","last_unstale":"2023-11-26T07:23:05.032234+0000","last_undegraded":"2023-11-26T07:23:05.032234+0000","last_fullsized":"2023-11-26T07:23:05.032234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:27:14.467235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.019609+0000","last_change":"2023-11-26T07:23:05.038486+0000","last_active":"2023-11-26T07:23:06.019609+0000","last_peered":"2023-11-26T07:23:06.019609+0000","last_clean":"2023-11-26T07:23:06.019609+0000","last_became_active":"2023-11-26T07:23:05.038178+0000","last_became_peered":"2023-11-26T07:23:05.038178+0000","last_unstale":"2023-11-26T07:23:06.019609+0000","last_undegraded":"2023-11-26T07:23:06.019609+0000","last_fullsized":"2023-11-26T07:23:06.019609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:56:30.705469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.057670+0000","last_change":"2023-11-26T07:23:04.026179+0000","last_active":"2023-11-26T07:23:05.057670+0000","last_peered":"2023-11-26T07:23:05.057670+0000","last_clean":"2023-11-26T07:23:05.057670+0000","last_became_active":"2023-11-26T07:23:04.025503+0000","last_became_peered":"2023-11-26T07:23:04.025503+0000","last_unstale":"2023-11-26T07:23:05.057670+0000","last_undegraded":"2023-11-26T07:23:05.057670+0000","last_fullsized":"2023-11-26T07:23:05.057670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:54:14.965203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.269125+0000","last_change":"2023-11-26T07:23:05.033548+0000","last_active":"2023-11-26T07:23:07.269125+0000","last_peered":"2023-11-26T07:23:07.269125+0000","last_clean":"2023-11-26T07:23:07.269125+0000","last_became_active":"2023-11-26T07:23:05.033140+0000","last_became_peered":"2023-11-26T07:23:05.033140+0000","last_unstale":"2023-11-26T07:23:07.269125+0000","last_undegraded":"2023-11-26T07:23:07.269125+0000","last_fullsized":"2023-11-26T07:23:07.269125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:34:56.023028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.030105+0000","last_change":"2023-11-26T07:23:04.019210+0000","last_active":"2023-11-26T07:23:05.030105+0000","last_peered":"2023-11-26T07:23:05.030105+0000","last_clean":"2023-11-26T07:23:05.030105+0000","last_became_active":"2023-11-26T07:23:04.018181+0000","last_became_peered":"2023-11-26T07:23:04.018181+0000","last_unstale":"2023-11-26T07:23:05.030105+0000","last_undegraded":"2023-11-26T07:23:05.030105+0000","last_fullsized":"2023-11-26T07:23:05.030105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:57.968608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.023085+0000","last_change":"2023-11-26T07:23:05.060299+0000","last_active":"2023-11-26T07:23:06.023085+0000","last_peered":"2023-11-26T07:23:06.023085+0000","last_clean":"2023-11-26T07:23:06.023085+0000","last_became_active":"2023-11-26T07:23:05.059634+0000","last_became_peered":"2023-11-26T07:23:05.059634+0000","last_unstale":"2023-11-26T07:23:06.023085+0000","last_undegraded":"2023-11-26T07:23:06.023085+0000","last_fullsized":"2023-11-26T07:23:06.023085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:14:24.736295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.014379+0000","last_change":"2023-11-26T07:23:04.018754+0000","last_active":"2023-11-26T07:23:05.014379+0000","last_peered":"2023-11-26T07:23:05.014379+0000","last_clean":"2023-11-26T07:23:05.014379+0000","last_became_active":"2023-11-26T07:23:04.017867+0000","last_became_peered":"2023-11-26T07:23:04.017867+0000","last_unstale":"2023-11-26T07:23:05.014379+0000","last_undegraded":"2023-11-26T07:23:05.014379+0000","last_fullsized":"2023-11-26T07:23:05.014379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:44:35.576585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.022523+0000","last_change":"2023-11-26T07:23:05.047652+0000","last_active":"2023-11-26T07:23:06.022523+0000","last_peered":"2023-11-26T07:23:06.022523+0000","last_clean":"2023-11-26T07:23:06.022523+0000","last_became_active":"2023-11-26T07:23:05.047370+0000","last_became_peered":"2023-11-26T07:23:05.047370+0000","last_unstale":"2023-11-26T07:23:06.022523+0000","last_undegraded":"2023-11-26T07:23:06.022523+0000","last_fullsized":"2023-11-26T07:23:06.022523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:48:46.705989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.033975+0000","last_change":"2023-11-26T07:23:04.031292+0000","last_active":"2023-11-26T07:23:05.033975+0000","last_peered":"2023-11-26T07:23:05.033975+0000","last_clean":"2023-11-26T07:23:05.033975+0000","last_became_active":"2023-11-26T07:23:04.030927+0000","last_became_peered":"2023-11-26T07:23:04.030927+0000","last_unstale":"2023-11-26T07:23:05.033975+0000","last_undegraded":"2023-11-26T07:23:05.033975+0000","last_fullsized":"2023-11-26T07:23:05.033975+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:14:20.338459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.819833+0000","last_change":"2023-11-26T07:23:05.031915+0000","last_active":"2023-11-26T07:23:06.819833+0000","last_peered":"2023-11-26T07:23:06.819833+0000","last_clean":"2023-11-26T07:23:06.819833+0000","last_became_active":"2023-11-26T07:23:05.031673+0000","last_became_peered":"2023-11-26T07:23:05.031673+0000","last_unstale":"2023-11-26T07:23:06.819833+0000","last_undegraded":"2023-11-26T07:23:06.819833+0000","last_fullsized":"2023-11-26T07:23:06.819833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:03:07.908273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.014269+0000","last_change":"2023-11-26T07:23:04.020114+0000","last_active":"2023-11-26T07:23:05.014269+0000","last_peered":"2023-11-26T07:23:05.014269+0000","last_clean":"2023-11-26T07:23:05.014269+0000","last_became_active":"2023-11-26T07:23:04.019839+0000","last_became_peered":"2023-11-26T07:23:04.019839+0000","last_unstale":"2023-11-26T07:23:05.014269+0000","last_undegraded":"2023-11-26T07:23:05.014269+0000","last_fullsized":"2023-11-26T07:23:05.014269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:19:56.407750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.023033+0000","last_change":"2023-11-26T07:23:05.056120+0000","last_active":"2023-11-26T07:23:06.023033+0000","last_peered":"2023-11-26T07:23:06.023033+0000","last_clean":"2023-11-26T07:23:06.023033+0000","last_became_active":"2023-11-26T07:23:05.055788+0000","last_became_peered":"2023-11-26T07:23:05.055788+0000","last_unstale":"2023-11-26T07:23:06.023033+0000","last_undegraded":"2023-11-26T07:23:06.023033+0000","last_fullsized":"2023-11-26T07:23:06.023033+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:26:18.291698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.020038+0000","last_change":"2023-11-26T07:23:04.028093+0000","last_active":"2023-11-26T07:23:05.020038+0000","last_peered":"2023-11-26T07:23:05.020038+0000","last_clean":"2023-11-26T07:23:05.020038+0000","last_became_active":"2023-11-26T07:23:04.027732+0000","last_became_peered":"2023-11-26T07:23:04.027732+0000","last_unstale":"2023-11-26T07:23:05.020038+0000","last_undegraded":"2023-11-26T07:23:05.020038+0000","last_fullsized":"2023-11-26T07:23:05.020038+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:40:41.721505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.543131+0000","last_change":"2023-11-26T07:23:05.032914+0000","last_active":"2023-11-26T07:23:07.543131+0000","last_peered":"2023-11-26T07:23:07.543131+0000","last_clean":"2023-11-26T07:23:07.543131+0000","last_became_active":"2023-11-26T07:23:05.032619+0000","last_became_peered":"2023-11-26T07:23:05.032619+0000","last_unstale":"2023-11-26T07:23:07.543131+0000","last_undegraded":"2023-11-26T07:23:07.543131+0000","last_fullsized":"2023-11-26T07:23:07.543131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:20:49.506076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.020822+0000","last_change":"2023-11-26T07:23:04.026800+0000","last_active":"2023-11-26T07:23:05.020822+0000","last_peered":"2023-11-26T07:23:05.020822+0000","last_clean":"2023-11-26T07:23:05.020822+0000","last_became_active":"2023-11-26T07:23:04.026491+0000","last_became_peered":"2023-11-26T07:23:04.026491+0000","last_unstale":"2023-11-26T07:23:05.020822+0000","last_undegraded":"2023-11-26T07:23:05.020822+0000","last_fullsized":"2023-11-26T07:23:05.020822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:47:52.546074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:06.022200+0000","last_change":"2023-11-26T07:23:05.053070+0000","last_active":"2023-11-26T07:23:06.022200+0000","last_peered":"2023-11-26T07:23:06.022200+0000","last_clean":"2023-11-26T07:23:06.022200+0000","last_became_active":"2023-11-26T07:23:05.052780+0000","last_became_peered":"2023-11-26T07:23:05.052780+0000","last_unstale":"2023-11-26T07:23:06.022200+0000","last_undegraded":"2023-11-26T07:23:06.022200+0000","last_fullsized":"2023-11-26T07:23:06.022200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:04:32.708977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.035030+0000","last_change":"2023-11-26T07:23:04.022973+0000","last_active":"2023-11-26T07:23:05.035030+0000","last_peered":"2023-11-26T07:23:05.035030+0000","last_clean":"2023-11-26T07:23:05.035030+0000","last_became_active":"2023-11-26T07:23:04.021892+0000","last_became_peered":"2023-11-26T07:23:04.021892+0000","last_unstale":"2023-11-26T07:23:05.035030+0000","last_undegraded":"2023-11-26T07:23:05.035030+0000","last_fullsized":"2023-11-26T07:23:05.035030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:20:48.492149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-26T07:23:07.699716+0000","last_change":"2023-11-26T07:23:05.056683+0000","last_active":"2023-11-26T07:23:07.699716+0000","last_peered":"2023-11-26T07:23:07.699716+0000","last_clean":"2023-11-26T07:23:07.699716+0000","last_became_active":"2023-11-26T07:23:05.056365+0000","last_became_peered":"2023-11-26T07:23:05.056365+0000","last_unstale":"2023-11-26T07:23:07.699716+0000","last_undegraded":"2023-11-26T07:23:07.699716+0000","last_fullsized":"2023-11-26T07:23:07.699716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:03.986828+0000","last_clean_scrub_stamp":"2023-11-26T07:23:03.986828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:05:22.266750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.057271+0000","last_change":"2023-11-26T07:23:04.022058+0000","last_active":"2023-11-26T07:23:05.057271+0000","last_peered":"2023-11-26T07:23:05.057271+0000","last_clean":"2023-11-26T07:23:05.057271+0000","last_became_active":"2023-11-26T07:23:04.021776+0000","last_became_peered":"2023-11-26T07:23:04.021776+0000","last_unstale":"2023-11-26T07:23:05.057271+0000","last_undegraded":"2023-11-26T07:23:05.057271+0000","last_fullsized":"2023-11-26T07:23:05.057271+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:02.972900+0000","last_clean_scrub_stamp":"2023-11-26T07:23:02.972900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:18.342542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":215,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-26T07:23:05.032139+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:23:05.032139+0000","last_peered":"2023-11-26T07:23:05.032139+0000","last_clean":"2023-11-26T07:23:05.032139+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:23:05.032139+0000","last_undegraded":"2023-11-26T07:23:05.032139+0000","last_fullsized":"2023-11-26T07:23:05.032139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1515520,"data_stored":981778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0649999999999999,"15min":1.0389999999999999},"min":{"1min":0.64000000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.417,"5min":1.768,"15min":1.768},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.2,"5min":1.101,"15min":1.0780000000000001},"min":{"1min":0.77400000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.6359999999999999,"5min":2.298,"15min":2.298},"last":1.244}]},{"osd":1,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0780000000000001,"15min":1.056},"min":{"1min":0.85299999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4790000000000001,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1779999999999999,"15min":1.2110000000000001},"min":{"1min":0.78000000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6479999999999999,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.8180000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.214,"15min":1.173},"min":{"1min":0.76000000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.591,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.171},{"interface":"front","average":{"1min":1.169,"5min":1.1870000000000001,"15min":1.2669999999999999},"min":{"1min":0.73599999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7929999999999999,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.3759999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1830000000000001,"15min":1.2250000000000001},"min":{"1min":0.80500000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.3959999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.538},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.349,"15min":1.361},"min":{"1min":0.87,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.724,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.7390000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3100000000000001,"15min":1.3460000000000001},"min":{"1min":0.93799999999999994,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9039999999999999,"5min":2.774,"15min":2.774},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.452,"15min":1.4610000000000001},"min":{"1min":1.024,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.778,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.431}]},{"osd":5,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.454,"15min":1.4890000000000001},"min":{"1min":0.86399999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.02,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.776},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.395,"15min":1.4570000000000001},"min":{"1min":0.96799999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.637,"5min":2.149,"15min":2.149},"last":1.319}]},{"osd":6,"last update":"Sun Nov 26 07:22:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5860000000000001,"15min":1.659},"min":{"1min":1.077,"5min":0.75,"15min":0.75},"max":{"1min":2.1059999999999999,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":2.0070000000000001},{"interface":"front","average":{"1min":1.532,"5min":1.5780000000000001,"15min":1.6279999999999999},"min":{"1min":1.2749999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.76,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.6970000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":390886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.103,"15min":1.117},"min":{"1min":0.68400000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.946,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1499999999999999,"15min":1.2490000000000001},"min":{"1min":0.76400000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4670000000000001,"5min":3.169,"15min":3.169},"last":0.872}]},{"osd":1,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":0.82499999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.2090000000000001,"15min":1.1499999999999999},"min":{"1min":0.94199999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.754,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.042}]},{"osd":2,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.119,"15min":1.121},"min":{"1min":0.77500000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.403,"5min":1.298,"15min":1.3660000000000001},"min":{"1min":0.96999999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.5950000000000002,"5min":3.1110000000000002,"15min":3.1110000000000002},"last":1.0900000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3009999999999999,"15min":1.2789999999999999},"min":{"1min":1.0049999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7629999999999999,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.2549999999999999,"15min":1.2589999999999999},"min":{"1min":0.92900000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.6180000000000001,"5min":1.736,"15min":1.736},"last":1.155}]},{"osd":4,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.3959999999999999,"15min":1.3779999999999999},"min":{"1min":0.89900000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.6850000000000001,"5min":4.6539999999999999,"15min":4.6539999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.4219999999999999,"15min":1.385},"min":{"1min":1.1759999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.929,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":1.502}]},{"osd":5,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.399,"15min":1.4059999999999999},"min":{"1min":0.93899999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.929,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.401},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.5469999999999999,"15min":1.5409999999999999},"min":{"1min":1.071,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.7749999999999999,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":1.302}]},{"osd":7,"last update":"Sun Nov 26 07:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.5620000000000001,"15min":1.5509999999999999},"min":{"1min":1.2549999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.1059999999999999,"5min":4.202,"15min":4.202},"last":1.589},{"interface":"front","average":{"1min":1.631,"5min":1.5669999999999999,"15min":1.5700000000000001},"min":{"1min":1.2450000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.958,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.5580000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":390884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0609999999999999,"15min":1.0269999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5700000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.111,"15min":1.0329999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6519999999999999,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":1.736}]},{"osd":1,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.145,"15min":1.081},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.8080000000000001,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":1.474},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.1739999999999999,"15min":1.169},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.3129999999999999,"5min":4.7859999999999996,"15min":4.7859999999999996},"last":1.194}]},{"osd":2,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0980000000000001,"15min":1.0549999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.835,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":1.605},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2749999999999999,"15min":1.2949999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6080000000000001,"5min":3.77,"15min":3.77},"last":1.413}]},{"osd":3,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.2709999999999999,"15min":1.2989999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4850000000000001,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":1.571},{"interface":"front","average":{"1min":1.216,"5min":1.2529999999999999,"15min":1.2130000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.9099999999999999,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.24}]},{"osd":4,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4159999999999999,"15min":1.456},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.893,"5min":3.835,"15min":3.835},"last":1.538},{"interface":"front","average":{"1min":1.276,"5min":1.415,"15min":1.4550000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.726,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":1.381}]},{"osd":6,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.5209999999999999,"15min":1.5449999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.716,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":1.284},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4390000000000001,"15min":1.46},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.0649999999999999,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":1.3280000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.5429999999999999,"15min":1.593},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.8260000000000001,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":1.8340000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.5549999999999999,"15min":1.5960000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.1309999999999998,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":1.7050000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":390864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.048,"15min":1.1220000000000001},"min":{"1min":0.69799999999999995,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6040000000000001,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.375},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.087,"15min":1.0249999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.486,"5min":2.04,"15min":2.04},"last":1.4510000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.177,"15min":1.177},"min":{"1min":0.83599999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.593,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.246,"15min":1.242},"min":{"1min":0.75700000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5369999999999999,"5min":1.79,"15min":1.79},"last":1.673}]},{"osd":2,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.244,"15min":1.2789999999999999},"min":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.532,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.232,"15min":1.278},"min":{"1min":0.84399999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.206}]},{"osd":3,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.3009999999999999,"15min":1.3160000000000001},"min":{"1min":0.871,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6040000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3340000000000001,"15min":1.3480000000000001},"min":{"1min":0.96199999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.327}]},{"osd":5,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.3420000000000001,"15min":1.3580000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.8720000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.542},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.4750000000000001,"15min":1.5029999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.99,"5min":2.899,"15min":2.899},"last":1.7030000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4690000000000001,"15min":1.5009999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5980000000000001,"15min":1.635},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.29,"5min":3.008,"15min":3.008},"last":1.6299999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.6739999999999999,"15min":1.7410000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.242,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.524,"5min":1.6439999999999999,"15min":1.698},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.343,"5min":3.085,"15min":3.085},"last":1.744}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":921600,"data_stored":390906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.85599999999999998},"min":{"1min":0.47599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.292,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.3999999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.90300000000000002,"15min":0.90800000000000003},"min":{"1min":0.498,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.5920000000000001,"5min":1.764,"15min":1.764},"last":1.452}]},{"osd":1,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79000000000000004,"15min":0.84199999999999997},"min":{"1min":0.56599999999999995,"5min":0.371,"15min":0.371},"max":{"1min":1.145,"5min":1.784,"15min":1.784},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.89200000000000002,"15min":0.98799999999999999},"min":{"1min":0.434,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5649999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.98799999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0269999999999999,"15min":1.073},"min":{"1min":0.63900000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.627,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.173},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0800000000000001,"15min":1.1140000000000001},"min":{"1min":0.65400000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.548,"5min":2.379,"15min":2.379},"last":1.2050000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.111,"15min":1.131},"min":{"1min":0.72099999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.546,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.232,"15min":1.333},"min":{"1min":1.091,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5269999999999999,"5min":2.859,"15min":2.859},"last":1.272}]},{"osd":5,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.258,"15min":1.347},"min":{"1min":0.86899999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.6899999999999999,"5min":2.504,"15min":2.504},"last":1.498},{"interface":"front","average":{"1min":1.107,"5min":1.1890000000000001,"15min":1.2430000000000001},"min":{"1min":0.78300000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.51,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.115}]},{"osd":6,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.292,"15min":1.4199999999999999},"min":{"1min":0.90100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7270000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.337,"15min":1.427},"min":{"1min":0.83899999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.903,"5min":3.226,"15min":3.226},"last":1.589}]},{"osd":7,"last update":"Sun Nov 26 07:22:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2529999999999999,"15min":1.2869999999999999},"min":{"1min":0.86599999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5960000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3959999999999999,"15min":1.4950000000000001},"min":{"1min":1.0149999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.996,"5min":3.956,"15min":3.956},"last":1.423}]}]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":925696,"data_stored":392406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.81599999999999995,"15min":0.94499999999999995},"min":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3380000000000001,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.149},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.92500000000000004,"15min":1.052},"min":{"1min":0.51000000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2909999999999999,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.266}]},{"osd":1,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":0.94999999999999996},"min":{"1min":0.439,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.5229999999999999,"5min":1.645,"15min":1.645},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.92000000000000004,"15min":1.016},"min":{"1min":0.48499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.609,"5min":1.901,"15min":1.901},"last":1.0609999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.042},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.9430000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.103,"15min":1.224},"min":{"1min":0.59099999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6719999999999999,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.615}]},{"osd":4,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2050000000000001,"15min":1.27},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8939999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.2050000000000001,"15min":1.28},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.736,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.381}]},{"osd":5,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1599999999999999,"15min":1.2350000000000001},"min":{"1min":0.83399999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.641,"5min":1.901,"15min":1.901},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.246,"15min":1.3680000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.724,"5min":2.395,"15min":2.395},"last":1.796}]},{"osd":6,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.3460000000000001,"15min":1.4370000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.9039999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.52},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2889999999999999,"15min":1.3380000000000001},"min":{"1min":0.80200000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.871,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.653}]},{"osd":7,"last update":"Sun Nov 26 07:22:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.3560000000000001,"15min":1.4690000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.841,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.698},{"interface":"front","average":{"1min":1.274,"5min":1.355,"15min":1.419},"min":{"1min":0.86099999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7769999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.74}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":393022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76200000000000001,"15min":0.81000000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.3180000000000001,"5min":1.589,"15min":1.589},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.95099999999999996},"min":{"1min":0.44400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.851,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.69299999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.83799999999999997,"15min":0.86399999999999999},"min":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3839999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.95299999999999996,"15min":0.99299999999999999},"min":{"1min":0.47399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.55,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.98799999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0489999999999999,"15min":1.073},"min":{"1min":0.55700000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5449999999999999,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.97699999999999998,"15min":1.046},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6040000000000001,"5min":2.319,"15min":2.319},"last":0.73699999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1830000000000001,"15min":1.2330000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.635,"5min":2.294,"15min":2.294},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.1659999999999999,"15min":1.244},"min":{"1min":0.65500000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.653,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.3169999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2569999999999999,"15min":1.355},"min":{"1min":0.76500000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.7170000000000001,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.359,"15min":1.3799999999999999},"min":{"1min":0.86699999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.788,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.5669999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.302,"15min":1.3720000000000001},"min":{"1min":0.873,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.839,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2769999999999999,"15min":1.3460000000000001},"min":{"1min":0.75600000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8080000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.478}]},{"osd":7,"last update":"Sun Nov 26 07:22:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.878,"5min":0.755,"15min":0.755},"max":{"1min":1.8819999999999999,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.379,"15min":1.484},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.954,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":1.1259999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1507328,"data_stored":981162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.39600000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81999999999999995,"15min":0.878},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.91600000000000004,"15min":0.95599999999999996},"min":{"1min":0.58499999999999996,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93200000000000005,"15min":1.0009999999999999},"min":{"1min":0.50700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.52200000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.006,"15min":0.95399999999999996},"min":{"1min":0.55300000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.2360000000000002,"5min":9.4939999999999998,"15min":9.4939999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.099,"15min":1.1459999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8609999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.339,"15min":1.3160000000000001},"min":{"1min":0.878,"5min":0.753,"15min":0.753},"max":{"1min":4.9290000000000003,"5min":4.9290000000000003,"15min":4.9290000000000003},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.3320000000000001,"15min":1.2649999999999999},"min":{"1min":0.96499999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5649999999999999,"5min":9.7240000000000002,"15min":9.7240000000000002},"last":1.0089999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.302,"15min":1.2829999999999999},"min":{"1min":0.93000000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.5470000000000002,"5min":9.6039999999999992,"15min":9.6039999999999992},"last":1.093},{"interface":"front","average":{"1min":1.512,"5min":1.367,"15min":1.3839999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":4.4800000000000004,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":1.042}]},{"osd":6,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.369,"15min":1.401},"min":{"1min":0.85699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":4.6349999999999998,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.2789999999999999,"15min":1.349},"min":{"1min":1.008,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0590000000000002,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.95599999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.389,"15min":1.431},"min":{"1min":0.79900000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.069},{"interface":"front","average":{"1min":1.518,"5min":1.389,"15min":1.357},"min":{"1min":0.79900000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":4.1079999999999997,"5min":9.9320000000000004,"15min":9.9320000000000004},"last":0.82899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:23:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:23:09.977 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:23:10.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.243+0000 7fe9ac615640 1 Processor -- start 2023-11-26T07:23:10.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.243+0000 7fe9ac615640 1 -- start start 2023-11-26T07:23:10.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.245+0000 7fe9ac615640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe9a415b440 0x7fe9a40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.245+0000 7fe9ac615640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a40cbf20 0x7fe9a40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.245+0000 7fe9ac615640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9a40c57e0 0x7fe9a40c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.245+0000 7fe9ac615640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a40cc3d0 con 0x7fe9a40c57e0 2023-11-26T07:23:10.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.245+0000 7fe9ac615640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a415b820 con 0x7fe9a415b440 2023-11-26T07:23:10.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.245+0000 7fe9ac615640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a415eea0 con 0x7fe9a40cbf20 2023-11-26T07:23:10.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.245+0000 7fe9aabb2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9a40c57e0 0x7fe9a40c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.245+0000 7fe9aabb2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9a40c57e0 0x7fe9a40c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49844/0 (socket says 172.21.15.77:49844) 2023-11-26T07:23:10.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.246+0000 7fe9aabb2640 1 -- 172.21.15.77:0/2824760557 learned_addr learned my addr 172.21.15.77:0/2824760557 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.246+0000 7fe9a9bb0640 1 --2- 172.21.15.77:0/2824760557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a40cbf20 0x7fe9a40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.246+0000 7fe9aa3b1640 1 --2- 172.21.15.77:0/2824760557 >> v2:172.21.15.159:3300/0 conn(0x7fe9a415b440 0x7fe9a40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.246+0000 7fe9aabb2640 1 -- 172.21.15.77:0/2824760557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a40cbf20 msgr2=0x7fe9a40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.246+0000 7fe9aabb2640 1 --2- 172.21.15.77:0/2824760557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a40cbf20 0x7fe9a40c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.246+0000 7fe9aabb2640 1 -- 172.21.15.77:0/2824760557 >> v2:172.21.15.159:3300/0 conn(0x7fe9a415b440 msgr2=0x7fe9a40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.246+0000 7fe9aabb2640 1 --2- 172.21.15.77:0/2824760557 >> v2:172.21.15.159:3300/0 conn(0x7fe9a415b440 0x7fe9a40cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.246+0000 7fe9aabb2640 1 -- 172.21.15.77:0/2824760557 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a40abf30 con 0x7fe9a40c57e0 2023-11-26T07:23:10.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.246+0000 7fe9aa3b1640 1 --2- 172.21.15.77:0/2824760557 >> v2:172.21.15.159:3300/0 conn(0x7fe9a415b440 0x7fe9a40cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:10.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.247+0000 7fe9aabb2640 1 --2- 172.21.15.77:0/2824760557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a40c57e0 0x7fe9a40c3ec0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fe9a406e770 tx=0x7fe99c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfff7bb07c29d11 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:10.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.247+0000 7fe9a93af640 1 -- 172.21.15.77:0/2824760557 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c0317e0 con 0x7fe9a40c57e0 2023-11-26T07:23:10.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.247+0000 7fe9a93af640 1 -- 172.21.15.77:0/2824760557 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c031940 con 0x7fe9a40c57e0 2023-11-26T07:23:10.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.247+0000 7fe9a93af640 1 -- 172.21.15.77:0/2824760557 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c031cd0 con 0x7fe9a40c57e0 2023-11-26T07:23:10.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.248+0000 7fe9ac615640 1 -- 172.21.15.77:0/2824760557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a40c57e0 msgr2=0x7fe9a40c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:10.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.248+0000 7fe9ac615640 1 --2- 172.21.15.77:0/2824760557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a40c57e0 0x7fe9a40c3ec0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fe9a406e770 tx=0x7fe99c02b880 comp rx=0 tx=0).stop 2023-11-26T07:23:10.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.248+0000 7fe9ac615640 1 -- 172.21.15.77:0/2824760557 shutdown_connections 2023-11-26T07:23:10.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.248+0000 7fe9ac615640 1 --2- 172.21.15.77:0/2824760557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a40c57e0 0x7fe9a40c3ec0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.248+0000 7fe9ac615640 1 --2- 172.21.15.77:0/2824760557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a40cbf20 0x7fe9a40c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.248+0000 7fe9ac615640 1 --2- 172.21.15.77:0/2824760557 >> v2:172.21.15.159:3300/0 conn(0x7fe9a415b440 0x7fe9a40cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.248+0000 7fe9ac615640 1 -- 172.21.15.77:0/2824760557 >> 172.21.15.77:0/2824760557 conn(0x7fe9a40b0c50 msgr2=0x7fe9a40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:10.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.248+0000 7fe9ac615640 1 -- 172.21.15.77:0/2824760557 shutdown_connections 2023-11-26T07:23:10.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.248+0000 7fe9ac615640 1 -- 172.21.15.77:0/2824760557 wait complete. 2023-11-26T07:23:10.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.250+0000 7fe9ac615640 1 Processor -- start 2023-11-26T07:23:10.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.250+0000 7fe9ac615640 1 -- start start 2023-11-26T07:23:10.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.251+0000 7fe9ac615640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a40c57e0 0x7fe9a4156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.251+0000 7fe9ac615640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a40cbf20 0x7fe9a40ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.251+0000 7fe9ac615640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a415b440 0x7fe9a40ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.251+0000 7fe9ac615640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a40c7550 con 0x7fe9a40cbf20 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.251+0000 7fe9ac615640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a40c70c0 con 0x7fe9a40c57e0 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.251+0000 7fe9ac615640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a40c64b0 con 0x7fe9a415b440 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.251+0000 7fe9a9bb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a40cbf20 0x7fe9a40ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9a9bb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a40cbf20 0x7fe9a40ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49860/0 (socket says 172.21.15.77:49860) 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9a9bb0640 1 -- 172.21.15.77:0/1087849226 learned_addr learned my addr 172.21.15.77:0/1087849226 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9aa3b1640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a40c57e0 0x7fe9a4156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9aabb2640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a415b440 0x7fe9a40ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9a9bb0640 1 -- 172.21.15.77:0/1087849226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a415b440 msgr2=0x7fe9a40ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9a9bb0640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a415b440 0x7fe9a40ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9a9bb0640 1 -- 172.21.15.77:0/1087849226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a40c57e0 msgr2=0x7fe9a4156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9a9bb0640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a40c57e0 0x7fe9a4156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9a9bb0640 1 -- 172.21.15.77:0/1087849226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c0094d0 con 0x7fe9a40cbf20 2023-11-26T07:23:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9aabb2640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a415b440 0x7fe9a40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:10.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9a9bb0640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a40cbf20 0x7fe9a40ad1a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe99800c7f0 tx=0x7fe99800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:10.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.252+0000 7fe9a2ffd640 1 -- 172.21.15.77:0/1087849226 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998004220 con 0x7fe9a40cbf20 2023-11-26T07:23:10.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.253+0000 7fe9a2ffd640 1 -- 172.21.15.77:0/1087849226 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe998004380 con 0x7fe9a40cbf20 2023-11-26T07:23:10.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.253+0000 7fe9a2ffd640 1 -- 172.21.15.77:0/1087849226 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998007860 con 0x7fe9a40cbf20 2023-11-26T07:23:10.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.253+0000 7fe9ac615640 1 -- 172.21.15.77:0/1087849226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a40c6790 con 0x7fe9a40cbf20 2023-11-26T07:23:10.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.253+0000 7fe9ac615640 1 -- 172.21.15.77:0/1087849226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a40c6d50 con 0x7fe9a40cbf20 2023-11-26T07:23:10.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.254+0000 7fe9ac615640 1 -- 172.21.15.77:0/1087849226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a40c7270 con 0x7fe9a40cbf20 2023-11-26T07:23:10.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.255+0000 7fe9a2ffd640 1 -- 172.21.15.77:0/1087849226 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fe998007bd0 con 0x7fe9a40cbf20 2023-11-26T07:23:10.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.256+0000 7fe9a2ffd640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe99006b6b0 0x7fe99006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.256+0000 7fe9a2ffd640 1 -- 172.21.15.77:0/1087849226 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe998088050 con 0x7fe9a40cbf20 2023-11-26T07:23:10.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.257+0000 7fe9aa3b1640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe99006b6b0 0x7fe99006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.257+0000 7fe9aa3b1640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe99006b6b0 0x7fe99006db70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe994007510 tx=0x7fe9940074a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:10.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.261+0000 7fe9a2ffd640 1 -- 172.21.15.77:0/1087849226 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9a40c7270 con 0x7fe9a40cbf20 2023-11-26T07:23:10.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.520+0000 7fe9ac615640 1 -- 172.21.15.77:0/1087849226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe9a40c7230 con 0x7fe9a40cbf20 2023-11-26T07:23:10.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.525+0000 7fe9a2ffd640 1 -- 172.21.15.77:0/1087849226 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe99801e0b0 con 0x7fe9a40cbf20 2023-11-26T07:23:10.528 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-11-26T07:23:10.528 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDN8GJlhqOIKxAAiafAbVhNu4B+yTd/1i7+1A== 2023-11-26T07:23:10.528 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2023-11-26T07:23:10.528 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2023-11-26T07:23:10.528 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:23:10.528 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2023-11-26T07:23:10.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 -- 172.21.15.77:0/1087849226 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe99006b6b0 msgr2=0x7fe99006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:10.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe99006b6b0 0x7fe99006db70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe994007510 tx=0x7fe9940074a0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 -- 172.21.15.77:0/1087849226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a40cbf20 msgr2=0x7fe9a40ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:10.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a40cbf20 0x7fe9a40ad1a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe99800c7f0 tx=0x7fe99800ccb0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 -- 172.21.15.77:0/1087849226 shutdown_connections 2023-11-26T07:23:10.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe99006b6b0 0x7fe99006db70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a415b440 0x7fe9a40ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a40cbf20 0x7fe9a40ad1a0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 --2- 172.21.15.77:0/1087849226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a40c57e0 0x7fe9a4156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 -- 172.21.15.77:0/1087849226 >> 172.21.15.77:0/1087849226 conn(0x7fe9a40b0c50 msgr2=0x7fe9a406c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:10.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 -- 172.21.15.77:0/1087849226 shutdown_connections 2023-11-26T07:23:10.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.528+0000 7fe9ac615640 1 -- 172.21.15.77:0/1087849226 wait complete. 2023-11-26T07:23:10.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:23:10.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.764+0000 7f1c70f7c640 1 Processor -- start 2023-11-26T07:23:10.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.764+0000 7f1c70f7c640 1 -- start start 2023-11-26T07:23:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.765+0000 7f1c70f7c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1c6c144b30 0x7f1c6c15f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.765+0000 7f1c70f7c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c15c410 0x7f1c6c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.765+0000 7f1c70f7c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c15bf80 con 0x7f1c6c0b1de0 2023-11-26T07:23:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.765+0000 7f1c70f7c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b1560 con 0x7f1c6c144b30 2023-11-26T07:23:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.765+0000 7f1c70f7c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b0fb0 con 0x7f1c6c15c410 2023-11-26T07:23:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.766+0000 7f1c6bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1c6c0b1de0 0x7f1c6c06c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45820/0 (socket says 172.21.15.77:45820) 2023-11-26T07:23:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.766+0000 7f1c6bfff640 1 -- 172.21.15.77:0/1183212922 learned_addr learned my addr 172.21.15.77:0/1183212922 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:10.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.766+0000 7f1c6b7fe640 1 --2- 172.21.15.77:0/1183212922 >> v2:172.21.15.159:3300/0 conn(0x7f1c6c144b30 0x7f1c6c15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.766+0000 7f1c63fff640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c15c410 0x7f1c6c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.766+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470096486 0 0) 0x7f1c6c15bf80 con 0x7f1c6c0b1de0 2023-11-26T07:23:10.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.766+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c58003520 con 0x7f1c6c0b1de0 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2152622661 0 0) 0x7f1c58003520 con 0x7f1c6c0b1de0 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c15c410 msgr2=0x7f1c6c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c15c410 0x7f1c6c0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 >> v2:172.21.15.159:3300/0 conn(0x7f1c6c144b30 msgr2=0x7f1c6c15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 --2- 172.21.15.77:0/1183212922 >> v2:172.21.15.159:3300/0 conn(0x7f1c6c144b30 0x7f1c6c15f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0b1280 con 0x7f1c6c0b1de0 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f1c640019f0 con 0x7f1c6c0b1de0 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 >> v1:172.21.15.77:6789/0 conn(0x7f1c6c0b1de0 legacy=0x7f1c6c06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c15c410 0x7f1c58003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c58003f40 0x7f1c580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c58004d00 0x7f1c58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b1560 con 0x7f1c58004d00 2023-11-26T07:23:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b0fb0 con 0x7f1c58003f40 2023-11-26T07:23:10.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5800b980 con 0x7f1c6c15c410 2023-11-26T07:23:10.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.767+0000 7f1c6bfff640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c58004d00 0x7f1c58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.768+0000 7f1c63fff640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c58003f40 0x7f1c580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.768+0000 7f1c6b7fe640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c15c410 0x7f1c58003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.768+0000 7f1c6bfff640 1 -- 172.21.15.77:0/1183212922 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c15c410 msgr2=0x7f1c58003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:10.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.768+0000 7f1c6bfff640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c15c410 0x7f1c58003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.768+0000 7f1c6bfff640 1 -- 172.21.15.77:0/1183212922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c58003f40 msgr2=0x7f1c580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:10.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.768+0000 7f1c6bfff640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c58003f40 0x7f1c580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.768+0000 7f1c6bfff640 1 -- 172.21.15.77:0/1183212922 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58003520 con 0x7f1c58004d00 2023-11-26T07:23:10.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.769+0000 7f1c6bfff640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c58004d00 0x7f1c58005180 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400a7c0 tx=0x7f1c580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3bcc79d6eefdb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:10.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.769+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64034630 con 0x7f1c58004d00 2023-11-26T07:23:10.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.769+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6402f070 con 0x7f1c58004d00 2023-11-26T07:23:10.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.769+0000 7f1c6affd640 1 -- 172.21.15.77:0/1183212922 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64034a30 con 0x7f1c58004d00 2023-11-26T07:23:10.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.770+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1183212922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c58004d00 msgr2=0x7f1c58005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:10.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.770+0000 7f1c70f7c640 1 --2- 172.21.15.77:0/1183212922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c58004d00 0x7f1c58005180 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400a7c0 tx=0x7f1c580057f0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.770+0000 7f1c6bfff640 1 -- 172.21.15.77:0/1183212922 reap_dead start 2023-11-26T07:23:10.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.770+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1183212922 shutdown_connections 2023-11-26T07:23:10.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.770+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1183212922 >> 172.21.15.77:0/1183212922 conn(0x7f1c6c0cb830 msgr2=0x7f1c6c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:10.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.770+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1183212922 shutdown_connections 2023-11-26T07:23:10.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.770+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1183212922 wait complete. 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.771+0000 7f1c70f7c640 1 Processor -- start 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.772+0000 7f1c70f7c640 1 -- start start 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.772+0000 7f1c70f7c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c58004d00 0x7f1c6c148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c70f7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c6c15adf0 0x7f1c6c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c70f7c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c134310 0x7f1c6c131d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c70f7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c1387c0 con 0x7f1c6c15adf0 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c70f7c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c071b30 con 0x7f1c58004d00 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c70f7c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c138a60 con 0x7f1c6c134310 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c6c15adf0 0x7f1c6c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c6c15adf0 0x7f1c6c133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49882/0 (socket says 172.21.15.77:49882) 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c63fff640 1 -- 172.21.15.77:0/1282227055 learned_addr learned my addr 172.21.15.77:0/1282227055 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c63fff640 1 -- 172.21.15.77:0/1282227055 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c134310 msgr2=0x7f1c6c131d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c63fff640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c134310 0x7f1c6c131d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c6b7fe640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c58004d00 0x7f1c6c148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c63fff640 1 -- 172.21.15.77:0/1282227055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c58004d00 msgr2=0x7f1c6c148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:10.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c63fff640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c58004d00 0x7f1c6c148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:10.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c63fff640 1 -- 172.21.15.77:0/1282227055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c138d40 con 0x7f1c6c15adf0 2023-11-26T07:23:10.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.773+0000 7f1c6b7fe640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c58004d00 0x7f1c6c148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:10.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.774+0000 7f1c63fff640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c6c15adf0 0x7f1c6c133dd0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f1c540114c0 tx=0x7f1c54011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:10.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.774+0000 7f1c68ff9640 1 -- 172.21.15.77:0/1282227055 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54015930 con 0x7f1c6c15adf0 2023-11-26T07:23:10.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.774+0000 7f1c68ff9640 1 -- 172.21.15.77:0/1282227055 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54015a90 con 0x7f1c6c15adf0 2023-11-26T07:23:10.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.774+0000 7f1c68ff9640 1 -- 172.21.15.77:0/1282227055 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54015e60 con 0x7f1c6c15adf0 2023-11-26T07:23:10.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.774+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1282227055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c139020 con 0x7f1c6c15adf0 2023-11-26T07:23:10.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.774+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1282227055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c148d70 con 0x7f1c6c15adf0 2023-11-26T07:23:10.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.775+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1282227055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c04e840 con 0x7f1c6c15adf0 2023-11-26T07:23:10.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.776+0000 7f1c68ff9640 1 -- 172.21.15.77:0/1282227055 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f1c5401d400 con 0x7f1c6c15adf0 2023-11-26T07:23:10.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.777+0000 7f1c68ff9640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1c4c06b6b0 0x7f1c4c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:10.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.777+0000 7f1c68ff9640 1 -- 172.21.15.77:0/1282227055 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c540887e0 con 0x7f1c6c15adf0 2023-11-26T07:23:10.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.777+0000 7f1c6b7fe640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1c4c06b6b0 0x7f1c4c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:10.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.778+0000 7f1c6b7fe640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1c4c06b6b0 0x7f1c4c06db70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c1f6950 tx=0x7f1c5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:10.781+0000 7f1c68ff9640 1 -- 172.21.15.77:0/1282227055 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c54055110 con 0x7f1c6c15adf0 2023-11-26T07:23:11.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.007+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1282227055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c6c0cb5b0 con 0x7f1c6c15adf0 2023-11-26T07:23:11.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.008+0000 7f1c68ff9640 1 -- 172.21.15.77:0/1282227055 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f1c54058730 con 0x7f1c6c15adf0 2023-11-26T07:23:11.011 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:23:11.011 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/277058454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":277058454},{"type":"v1","addr":"172.21.15.159:6835","nonce":277058454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4120615192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4120615192},{"type":"v1","addr":"172.21.15.77:6835","nonce":4120615192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/52209425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":52209425},{"type":"v1","addr":"172.21.15.159:6834","nonce":52209425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:04.464261+0000","modified":"2023-11-26T07:23:07.539892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/3837428408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3837428408},{"type":"v1","addr":"172.21.15.77:6837","nonce":3837428408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:23:11.011 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 44 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1282227055 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1c4c06b6b0 msgr2=0x7f1c4c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1c4c06b6b0 0x7f1c4c06db70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c1f6950 tx=0x7f1c5c008040 comp rx=0 tx=0).stop 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1282227055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c6c15adf0 msgr2=0x7f1c6c133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c6c15adf0 0x7f1c6c133dd0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f1c540114c0 tx=0x7f1c54011980 comp rx=0 tx=0).stop 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1282227055 shutdown_connections 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1c4c06b6b0 0x7f1c4c06db70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c6c134310 0x7f1c6c131d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c6c15adf0 0x7f1c6c133dd0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 --2- 172.21.15.77:0/1282227055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c58004d00 0x7f1c6c148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1282227055 >> 172.21.15.77:0/1282227055 conn(0x7f1c6c0cb830 msgr2=0x7f1c6c15ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1282227055 shutdown_connections 2023-11-26T07:23:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.011+0000 7f1c70f7c640 1 -- 172.21.15.77:0/1282227055 wait complete. 2023-11-26T07:23:11.432 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:23:04.464261+0000', 'modified': '2023-11-26T07:23:07.539892+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6735}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6735': {'gid': 6735, 'name': 'c', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6837/3837428408', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6836', 'nonce': 3837428408}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 3837428408}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:23:11.432 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:23:11.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-26T07:23:11.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.652+0000 7fba1502d640 1 Processor -- start 2023-11-26T07:23:11.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.653+0000 7fba1502d640 1 -- start start 2023-11-26T07:23:11.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.654+0000 7fba1502d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba10072160 0x7fba1015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.654+0000 7fba1502d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fba100c49f0 0x7fba1006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.654+0000 7fba1502d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1015ec90 con 0x7fba1006dc40 2023-11-26T07:23:11.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.654+0000 7fba1502d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1006e090 con 0x7fba10072160 2023-11-26T07:23:11.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.654+0000 7fba1502d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100cd530 con 0x7fba100c49f0 2023-11-26T07:23:11.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.654+0000 7fba0ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba10072160 0x7fba1015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.655+0000 7fba0ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba10072160 0x7fba1015e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49896/0 (socket says 172.21.15.77:49896) 2023-11-26T07:23:11.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.655+0000 7fba0ed9d640 1 -- 172.21.15.77:0/2334392782 learned_addr learned my addr 172.21.15.77:0/2334392782 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:11.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.655+0000 7fba0ed9d640 1 -- 172.21.15.77:0/2334392782 >> v2:172.21.15.159:3300/0 conn(0x7fba100c49f0 msgr2=0x7fba1006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.655+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/2334392782 >> v2:172.21.15.159:3300/0 conn(0x7fba100c49f0 0x7fba1006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.655+0000 7fba0ed9d640 1 -- 172.21.15.77:0/2334392782 >> v1:172.21.15.159:6789/0 conn(0x7fba1006dc40 legacy=0x7fba100cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.655+0000 7fba0ed9d640 1 -- 172.21.15.77:0/2334392782 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100c4ed0 con 0x7fba10072160 2023-11-26T07:23:11.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.656+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/2334392782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba10072160 0x7fba1015e750 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fba100cef60 tx=0x7fba0002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2d76c2c8ec370d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.656+0000 7fba0e59c640 1 -- 172.21.15.77:0/2334392782 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00031870 con 0x7fba10072160 2023-11-26T07:23:11.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.656+0000 7fba0e59c640 1 -- 172.21.15.77:0/2334392782 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba000319d0 con 0x7fba10072160 2023-11-26T07:23:11.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.656+0000 7fba0e59c640 1 -- 172.21.15.77:0/2334392782 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00031d60 con 0x7fba10072160 2023-11-26T07:23:11.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.657+0000 7fba1502d640 1 -- 172.21.15.77:0/2334392782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba10072160 msgr2=0x7fba1015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.657+0000 7fba1502d640 1 --2- 172.21.15.77:0/2334392782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba10072160 0x7fba1015e750 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fba100cef60 tx=0x7fba0002b910 comp rx=0 tx=0).stop 2023-11-26T07:23:11.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.657+0000 7fba1502d640 1 -- 172.21.15.77:0/2334392782 shutdown_connections 2023-11-26T07:23:11.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.657+0000 7fba1502d640 1 --2- 172.21.15.77:0/2334392782 >> v2:172.21.15.159:3300/0 conn(0x7fba100c49f0 0x7fba1006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.657+0000 7fba1502d640 1 --2- 172.21.15.77:0/2334392782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba10072160 0x7fba1015e750 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.657+0000 7fba1502d640 1 -- 172.21.15.77:0/2334392782 >> 172.21.15.77:0/2334392782 conn(0x7fba100b0c50 msgr2=0x7fba100b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:11.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.657+0000 7fba1502d640 1 -- 172.21.15.77:0/2334392782 shutdown_connections 2023-11-26T07:23:11.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.657+0000 7fba1502d640 1 -- 172.21.15.77:0/2334392782 wait complete. 2023-11-26T07:23:11.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.659+0000 7fba1502d640 1 Processor -- start 2023-11-26T07:23:11.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.659+0000 7fba1502d640 1 -- start start 2023-11-26T07:23:11.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.660+0000 7fba1502d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1006dc40 0x7fba1014caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.660+0000 7fba1502d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba10072160 0x7fba1015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.660+0000 7fba1502d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba100c49f0 0x7fba1009a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.660+0000 7fba1502d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba100c6e80 con 0x7fba1006dc40 2023-11-26T07:23:11.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.660+0000 7fba1502d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1014d030 con 0x7fba10072160 2023-11-26T07:23:11.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.660+0000 7fba1502d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba100c6200 con 0x7fba100c49f0 2023-11-26T07:23:11.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.660+0000 7fba0ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1006dc40 0x7fba1014caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.660+0000 7fba0ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1006dc40 0x7fba1014caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49902/0 (socket says 172.21.15.77:49902) 2023-11-26T07:23:11.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.660+0000 7fba0ed9d640 1 -- 172.21.15.77:0/1372753228 learned_addr learned my addr 172.21.15.77:0/1372753228 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:11.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba07fff640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba10072160 0x7fba1015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba0f59e640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba100c49f0 0x7fba1009a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba0ed9d640 1 -- 172.21.15.77:0/1372753228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba100c49f0 msgr2=0x7fba1009a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba100c49f0 0x7fba1009a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba0ed9d640 1 -- 172.21.15.77:0/1372753228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba10072160 msgr2=0x7fba1015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba10072160 0x7fba1015ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba0ed9d640 1 -- 172.21.15.77:0/1372753228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba000094d0 con 0x7fba1006dc40 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba07fff640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba10072160 0x7fba1015ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba0f59e640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba100c49f0 0x7fba1009a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1006dc40 0x7fba1014caf0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fba00000c00 tx=0x7fba000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba077fe640 1 -- 172.21.15.77:0/1372753228 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0003ad10 con 0x7fba1006dc40 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba077fe640 1 -- 172.21.15.77:0/1372753228 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0003ae70 con 0x7fba1006dc40 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba077fe640 1 -- 172.21.15.77:0/1372753228 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00044610 con 0x7fba1006dc40 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.661+0000 7fba1502d640 1 -- 172.21.15.77:0/1372753228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba100c64e0 con 0x7fba1006dc40 2023-11-26T07:23:11.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.662+0000 7fba1502d640 1 -- 172.21.15.77:0/1372753228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba100c6aa0 con 0x7fba1006dc40 2023-11-26T07:23:11.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.663+0000 7fba077fe640 1 -- 172.21.15.77:0/1372753228 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fba00044770 con 0x7fba1006dc40 2023-11-26T07:23:11.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.664+0000 7fba077fe640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9f006b6b0 0x7fb9f006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.664+0000 7fba077fe640 1 -- 172.21.15.77:0/1372753228 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba0002d040 con 0x7fba1006dc40 2023-11-26T07:23:11.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.665+0000 7fba07fff640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9f006b6b0 0x7fb9f006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.665+0000 7fba17bc4740 1 Processor -- start 2023-11-26T07:23:11.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.665+0000 7fba07fff640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9f006b6b0 0x7fb9f006db70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8006fd0 tx=0x7fb9f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.665+0000 7fba17bc4740 1 -- start start 2023-11-26T07:23:11.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.666+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 0x558596635280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.666+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x5585966340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.666+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5585966345e0 0x558596678560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.666+0000 7fba17bc4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558596593880 con 0x55859662fba0 2023-11-26T07:23:11.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.666+0000 7fba17bc4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585965a2ae0 con 0x558596634ea0 2023-11-26T07:23:11.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.666+0000 7fba17bc4740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585965a01d0 con 0x5585966345e0 2023-11-26T07:23:11.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.666+0000 7fba07fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x5585966340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.666+0000 7fba07fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x5585966340a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49910/0 (socket says 172.21.15.77:49910) 2023-11-26T07:23:11.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.666+0000 7fba07fff640 1 -- 172.21.15.77:0/2799882065 learned_addr learned my addr 172.21.15.77:0/2799882065 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:11.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba0f59e640 1 --2- 172.21.15.77:0/2799882065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5585966345e0 0x558596678560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/2799882065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 0x558596635280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba07fff640 1 -- 172.21.15.77:0/2799882065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5585966345e0 msgr2=0x558596678560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba07fff640 1 --2- 172.21.15.77:0/2799882065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5585966345e0 0x558596678560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba07fff640 1 -- 172.21.15.77:0/2799882065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 msgr2=0x558596635280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba07fff640 1 --2- 172.21.15.77:0/2799882065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 0x558596635280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba07fff640 1 -- 172.21.15.77:0/2799882065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558596563860 con 0x55859662fba0 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba0f59e640 1 --2- 172.21.15.77:0/2799882065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5585966345e0 0x558596678560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba07fff640 1 --2- 172.21.15.77:0/2799882065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x5585966340a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800ca70 tx=0x7fb9f800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3263eafbb24a1c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba04ff9640 1 -- 172.21.15.77:0/2799882065 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8013db0 con 0x55859662fba0 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba04ff9640 1 -- 172.21.15.77:0/2799882065 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f801e400 con 0x55859662fba0 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.667+0000 7fba04ff9640 1 -- 172.21.15.77:0/2799882065 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f801e770 con 0x55859662fba0 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.668+0000 7fba17bc4740 1 -- 172.21.15.77:0/2799882065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 msgr2=0x5585966340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.668+0000 7fba17bc4740 1 --2- 172.21.15.77:0/2799882065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x5585966340a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800ca70 tx=0x7fb9f800f000 comp rx=0 tx=0).stop 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.668+0000 7fba17bc4740 1 -- 172.21.15.77:0/2799882065 shutdown_connections 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.668+0000 7fba17bc4740 1 --2- 172.21.15.77:0/2799882065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5585966345e0 0x558596678560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.668+0000 7fba17bc4740 1 --2- 172.21.15.77:0/2799882065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x5585966340a0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.668+0000 7fba17bc4740 1 --2- 172.21.15.77:0/2799882065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 0x558596635280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.668+0000 7fba17bc4740 1 -- 172.21.15.77:0/2799882065 >> 172.21.15.77:0/2799882065 conn(0x5585965f6c70 msgr2=0x55859667a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:11.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.668+0000 7fba17bc4740 1 -- 172.21.15.77:0/2799882065 shutdown_connections 2023-11-26T07:23:11.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.668+0000 7fba17bc4740 1 -- 172.21.15.77:0/2799882065 wait complete. 2023-11-26T07:23:11.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.669+0000 7fba17bc4740 1 -- start start 2023-11-26T07:23:11.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.669+0000 7fba17bc4740 1 Processor -- start 2023-11-26T07:23:11.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859665b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585966345e0 0x558596673cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x558596634ea0 0x5585966822e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba17bc4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859659bac0 con 0x55859662fba0 2023-11-26T07:23:11.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba17bc4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585965382f0 con 0x5585966345e0 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba17bc4740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x558596555c70 con 0x558596634ea0 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba17bc4740 10 client.0 _ll_register_callbacks cb 0x55859655a3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba0ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859665b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba0ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859665b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49916/0 (socket says 172.21.15.77:49916) 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba0ed9d640 1 -- 172.21.15.77:0/2837275421 learned_addr learned my addr 172.21.15.77:0/2837275421 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba0ed9d640 1 -- 172.21.15.77:0/2837275421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x558596634ea0 msgr2=0x5585966822e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba0f59e640 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x558596634ea0 0x5585966822e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fba07fff640 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585966345e0 0x558596673cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.670+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x558596634ea0 0x5585966822e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fba0ed9d640 1 -- 172.21.15.77:0/2837275421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585966345e0 msgr2=0x558596673cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585966345e0 0x558596673cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fba0ed9d640 1 -- 172.21.15.77:0/2837275421 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f800c7e0 con 0x55859662fba0 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859665b500 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fba0002b950 tx=0x7fba0007b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a073f973bbef6b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fb9edffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fb9edffb640 1 -- 172.21.15.77:0/2837275421 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00077120 con 0x55859662fba0 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fb9edffb640 1 -- 172.21.15.77:0/2837275421 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba000830c0 con 0x55859662fba0 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fba17bc4740 1 -- 172.21.15.77:0/2837275421 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558596594aa0 con 0x55859662fba0 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fb9edffb640 1 -- 172.21.15.77:0/2837275421 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba000aa1b0 con 0x55859662fba0 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fba17bc4740 10 client.6882 fetch_fsmap learned FSMap version 44 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fba17bc4740 1 -- 172.21.15.77:0/2837275421 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55859659a140 con 0x55859662fba0 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.671+0000 7fb9edffb640 1 -- 172.21.15.77:0/2837275421 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558596594aa0 con 0x55859662fba0 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.672+0000 7fb9edffb640 1 -- 172.21.15.77:0/2837275421 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fba00082c30 con 0x55859662fba0 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.672+0000 7fba17bc4740 10 client.6882 fetch_fsmap finished waiting for FSMap version 44 2023-11-26T07:23:11.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.672+0000 7fba17bc4740 10 client.6882 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.672+0000 7fba17bc4740 20 client.6882 populate_metadata read hostname 'smithi077' 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.672+0000 7fba17bc4740 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.77:6836/3837428408,v1:172.21.15.77:6837/3837428408] conn(0x55859665a9c0 0x558596697db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.672+0000 7fba17bc4740 4 client.6882 mds_command: new command op to 6735 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.672+0000 7fba17bc4740 1 -- 172.21.15.77:0/2837275421 --> [v2:172.21.15.77:6836/3837428408,v1:172.21.15.77:6837/3837428408] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585965947c0 con 0x55859665a9c0 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.672+0000 7fba07fff640 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.77:6836/3837428408,v1:172.21.15.77:6837/3837428408] conn(0x55859665a9c0 0x558596697db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.672+0000 7fba07fff640 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.77:6836/3837428408,v1:172.21.15.77:6837/3837428408] conn(0x55859665a9c0 0x558596697db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b585577bb452853b server_cookie=3b7b3011bb35db84 in_seq=0 out_seq=0 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.672+0000 7fb9edffb640 10 client.6882 ms_handle_connect on v2:172.21.15.77:6836/3837428408 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fb9edffb640 1 -- 172.21.15.77:0/2837275421 <== mds.0 v2:172.21.15.77:6836/3837428408 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5585965947c0 con 0x55859665a9c0 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fb9edffb640 10 client.6882 handle_command_reply: tid=0 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fba17bc4740 1 client.6882 shutdown 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fba17bc4740 1 -- 172.21.15.77:0/2837275421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 msgr2=0x55859665b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fba17bc4740 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859665b500 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fba0002b950 tx=0x7fba0007b580 comp rx=0 tx=0).stop 2023-11-26T07:23:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fba17bc4740 1 -- 172.21.15.77:0/2837275421 shutdown_connections 2023-11-26T07:23:11.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fba17bc4740 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.77:6836/3837428408,v1:172.21.15.77:6837/3837428408] conn(0x55859665a9c0 0x558596697db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fba17bc4740 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x558596634ea0 0x5585966822e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fba17bc4740 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585966345e0 0x558596673cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fb9edffb640 0 client.6882 ms_handle_reset on v2:172.21.15.77:6836/3837428408 2023-11-26T07:23:11.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fba17bc4740 1 --2- 172.21.15.77:0/2837275421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859665b500 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.673+0000 7fba17bc4740 1 -- 172.21.15.77:0/2837275421 >> 172.21.15.77:0/2837275421 conn(0x5585965f6c70 msgr2=0x558596635280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:11.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.674+0000 7fba17bc4740 1 -- 172.21.15.77:0/2837275421 shutdown_connections 2023-11-26T07:23:11.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.674+0000 7fba17bc4740 1 -- 172.21.15.77:0/2837275421 wait complete. 2023-11-26T07:23:11.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.674+0000 7fba17bc4740 20 client.6882 trim_cache size 0 max 16384 2023-11-26T07:23:11.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.690+0000 7fba17bc4740 1 Processor -- start 2023-11-26T07:23:11.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.690+0000 7fba17bc4740 1 -- start start 2023-11-26T07:23:11.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.691+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859669bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.691+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5585966345e0 0x558596633bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.691+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 0x558596674320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.691+0000 7fba17bc4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585962fef20 con 0x55859662fba0 2023-11-26T07:23:11.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.691+0000 7fba17bc4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585966825e0 con 0x558596634ea0 2023-11-26T07:23:11.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.691+0000 7fba17bc4740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x558596673bc0 con 0x5585966345e0 2023-11-26T07:23:11.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.691+0000 7fba0ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859669bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.692+0000 7fba0ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859669bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49928/0 (socket says 172.21.15.77:49928) 2023-11-26T07:23:11.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.692+0000 7fba0ed9d640 1 -- 172.21.15.77:0/706726133 learned_addr learned my addr 172.21.15.77:0/706726133 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:11.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.692+0000 7fba07fff640 1 --2- 172.21.15.77:0/706726133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5585966345e0 0x558596633bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.692+0000 7fba0ed9d640 1 -- 172.21.15.77:0/706726133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5585966345e0 msgr2=0x558596633bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.692+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/706726133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5585966345e0 0x558596633bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.692+0000 7fba0ed9d640 1 -- 172.21.15.77:0/706726133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 msgr2=0x558596674320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.692+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/706726133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 0x558596674320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.692+0000 7fba0ed9d640 1 -- 172.21.15.77:0/706726133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558596537b80 con 0x55859662fba0 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.692+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/706726133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859669bed0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fba000777e0 tx=0x7fba0008f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e863fafe56a258 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.692+0000 7fba057fa640 1 -- 172.21.15.77:0/706726133 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000aa1c0 con 0x55859662fba0 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.693+0000 7fba057fa640 1 -- 172.21.15.77:0/706726133 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba000aa500 con 0x55859662fba0 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.693+0000 7fba057fa640 1 -- 172.21.15.77:0/706726133 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0008eb10 con 0x55859662fba0 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.693+0000 7fba17bc4740 1 -- 172.21.15.77:0/706726133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 msgr2=0x55859669bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.693+0000 7fba17bc4740 1 --2- 172.21.15.77:0/706726133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859669bed0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fba000777e0 tx=0x7fba0008f000 comp rx=0 tx=0).stop 2023-11-26T07:23:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.693+0000 7fba17bc4740 1 -- 172.21.15.77:0/706726133 shutdown_connections 2023-11-26T07:23:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.693+0000 7fba17bc4740 1 --2- 172.21.15.77:0/706726133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 0x558596674320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.693+0000 7fba17bc4740 1 --2- 172.21.15.77:0/706726133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5585966345e0 0x558596633bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.693+0000 7fba17bc4740 1 --2- 172.21.15.77:0/706726133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55859662fba0 0x55859669bed0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.693+0000 7fba17bc4740 1 -- 172.21.15.77:0/706726133 >> 172.21.15.77:0/706726133 conn(0x5585965f6c70 msgr2=0x55859662f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.693+0000 7fba17bc4740 1 -- 172.21.15.77:0/706726133 shutdown_connections 2023-11-26T07:23:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.693+0000 7fba17bc4740 1 -- 172.21.15.77:0/706726133 wait complete. 2023-11-26T07:23:11.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.694+0000 7fba17bc4740 1 -- start start 2023-11-26T07:23:11.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.694+0000 7fba17bc4740 1 Processor -- start 2023-11-26T07:23:11.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55859662fba0 0x558596689050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585966345e0 0x558596689590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba17bc4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 0x55859667f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba17bc4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558596689ec0 con 0x5585966345e0 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba17bc4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x558596631e10 con 0x558596634ea0 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba17bc4740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x558596631f80 con 0x55859662fba0 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba17bc4740 10 client.0 _ll_register_callbacks cb 0x7fba000aa780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba07fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585966345e0 0x558596689590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba07fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585966345e0 0x558596689590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49932/0 (socket says 172.21.15.77:49932) 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba07fff640 1 -- 172.21.15.77:0/348534324 learned_addr learned my addr 172.21.15.77:0/348534324 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba07fff640 1 -- 172.21.15.77:0/348534324 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55859662fba0 msgr2=0x558596689050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.695+0000 7fba07fff640 1 --2- 172.21.15.77:0/348534324 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55859662fba0 0x558596689050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.696+0000 7fba07fff640 1 -- 172.21.15.77:0/348534324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 msgr2=0x55859667f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.696+0000 7fba07fff640 1 --2- 172.21.15.77:0/348534324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 0x55859667f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.696+0000 7fba07fff640 1 -- 172.21.15.77:0/348534324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55859659a140 con 0x5585966345e0 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.696+0000 7fba07fff640 1 --2- 172.21.15.77:0/348534324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585966345e0 0x558596689590 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800afd0 tx=0x7fb9f8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916e3fa27470ed31 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.696+0000 7fb9edffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.696+0000 7fb9edffb640 1 -- 172.21.15.77:0/348534324 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f802eea0 con 0x5585966345e0 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.696+0000 7fb9edffb640 1 -- 172.21.15.77:0/348534324 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9f802e5d0 con 0x5585966345e0 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.696+0000 7fba17bc4740 1 -- 172.21.15.77:0/348534324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9f801e400 con 0x5585966345e0 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.696+0000 7fb9edffb640 1 -- 172.21.15.77:0/348534324 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9f802e790 con 0x5585966345e0 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.696+0000 7fba17bc4740 10 client.6888 fetch_fsmap learned FSMap version 44 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.696+0000 7fba17bc4740 1 -- 172.21.15.77:0/348534324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55859655d170 con 0x5585966345e0 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.697+0000 7fb9edffb640 1 -- 172.21.15.77:0/348534324 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f801e400 con 0x5585966345e0 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.697+0000 7fb9edffb640 1 -- 172.21.15.77:0/348534324 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb9f801e570 con 0x5585966345e0 2023-11-26T07:23:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.697+0000 7fba17bc4740 10 client.6888 fetch_fsmap finished waiting for FSMap version 44 2023-11-26T07:23:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.697+0000 7fba17bc4740 10 client.6888 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-26T07:23:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.697+0000 7fba17bc4740 20 client.6888 populate_metadata read hostname 'smithi077' 2023-11-26T07:23:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.697+0000 7fba17bc4740 1 --2- 172.21.15.77:0/348534324 >> [v2:172.21.15.77:6836/3837428408,v1:172.21.15.77:6837/3837428408] conn(0x55859667f730 0x55859667fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.697+0000 7fba17bc4740 4 client.6888 mds_command: new command op to 6735 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:23:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.697+0000 7fba17bc4740 1 -- 172.21.15.77:0/348534324 --> [v2:172.21.15.77:6836/3837428408,v1:172.21.15.77:6837/3837428408] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55859629c6c0 con 0x55859667f730 2023-11-26T07:23:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.697+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/348534324 >> [v2:172.21.15.77:6836/3837428408,v1:172.21.15.77:6837/3837428408] conn(0x55859667f730 0x55859667fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.697+0000 7fba0ed9d640 1 --2- 172.21.15.77:0/348534324 >> [v2:172.21.15.77:6836/3837428408,v1:172.21.15.77:6837/3837428408] conn(0x55859667f730 0x55859667fb10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fad4d6e96b9fa4c server_cookie=5a3f4297f55e6b1b in_seq=0 out_seq=0 2023-11-26T07:23:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.697+0000 7fb9edffb640 10 client.6888 ms_handle_connect on v2:172.21.15.77:6836/3837428408 2023-11-26T07:23:11.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fb9edffb640 1 -- 172.21.15.77:0/348534324 <== mds.0 v2:172.21.15.77:6836/3837428408 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55859629c6c0 con 0x55859667f730 2023-11-26T07:23:11.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fb9edffb640 10 client.6888 handle_command_reply: tid=0 2023-11-26T07:23:11.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 1 client.6888 shutdown 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 1 -- 172.21.15.77:0/348534324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585966345e0 msgr2=0x558596689590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 1 --2- 172.21.15.77:0/348534324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585966345e0 0x558596689590 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800afd0 tx=0x7fb9f8013000 comp rx=0 tx=0).stop 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 1 -- 172.21.15.77:0/348534324 shutdown_connections 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 1 --2- 172.21.15.77:0/348534324 >> [v2:172.21.15.77:6836/3837428408,v1:172.21.15.77:6837/3837428408] conn(0x55859667f730 0x55859667fb10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 1 --2- 172.21.15.77:0/348534324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558596634ea0 0x55859667f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 1 --2- 172.21.15.77:0/348534324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585966345e0 0x558596689590 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 1 --2- 172.21.15.77:0/348534324 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55859662fba0 0x558596689050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fb9edffb640 0 client.6888 ms_handle_reset on v2:172.21.15.77:6836/3837428408 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 1 -- 172.21.15.77:0/348534324 >> 172.21.15.77:0/348534324 conn(0x5585965f6c70 msgr2=0x55859665c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 1 -- 172.21.15.77:0/348534324 shutdown_connections 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 1 -- 172.21.15.77:0/348534324 wait complete. 2023-11-26T07:23:11.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.698+0000 7fba17bc4740 20 client.6888 trim_cache size 0 max 16384 2023-11-26T07:23:11.705 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:23:11.705 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "957368bd-e942-499b-9938-86266ae9bafb", 2023-11-26T07:23:11.705 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-26T07:23:11.705 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 6735, 2023-11-26T07:23:11.705 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-26T07:23:11.705 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-26T07:23:11.705 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-26T07:23:11.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 6.6878056800000003, 2023-11-26T07:23:11.705 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 44, 2023-11-26T07:23:11.705 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 75, 2023-11-26T07:23:11.705 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 75, 2023-11-26T07:23:11.706 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 12.073789809999999 2023-11-26T07:23:11.706 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:23:11.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 -- 172.21.15.77:0/1372753228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9f006b6b0 msgr2=0x7fb9f006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9f006b6b0 0x7fb9f006db70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8006fd0 tx=0x7fb9f8008040 comp rx=0 tx=0).stop 2023-11-26T07:23:11.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 -- 172.21.15.77:0/1372753228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1006dc40 msgr2=0x7fba1014caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1006dc40 0x7fba1014caf0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fba00000c00 tx=0x7fba000046c0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 -- 172.21.15.77:0/1372753228 shutdown_connections 2023-11-26T07:23:11.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb9f006b6b0 0x7fb9f006db70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba100c49f0 0x7fba1009a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba10072160 0x7fba1015ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 --2- 172.21.15.77:0/1372753228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1006dc40 0x7fba1014caf0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 -- 172.21.15.77:0/1372753228 >> 172.21.15.77:0/1372753228 conn(0x7fba100b0c50 msgr2=0x7fba1006d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:11.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 -- 172.21.15.77:0/1372753228 shutdown_connections 2023-11-26T07:23:11.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.699+0000 7fba1502d640 1 -- 172.21.15.77:0/1372753228 wait complete. 2023-11-26T07:23:11.718 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:23:11.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.926+0000 7f288d0cf640 1 Processor -- start 2023-11-26T07:23:11.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.926+0000 7f288d0cf640 1 -- start start 2023-11-26T07:23:11.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.928+0000 7f288d0cf640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f288815df80 0x7f28880ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.928+0000 7f288d0cf640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288815e3f0 con 0x7f28880b2250 2023-11-26T07:23:11.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.928+0000 7f288d0cf640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288815ab80 con 0x7f28880cd470 2023-11-26T07:23:11.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.928+0000 7f288d0cf640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288815a990 con 0x7f288815df80 2023-11-26T07:23:11.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.928+0000 7f2886d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f28880b2250 0x7f28880b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45828/0 (socket says 172.21.15.77:45828) 2023-11-26T07:23:11.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.928+0000 7f2886d9d640 1 -- 172.21.15.77:0/4051808145 learned_addr learned my addr 172.21.15.77:0/4051808145 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f287ffff640 1 --2- 172.21.15.77:0/4051808145 >> v2:172.21.15.159:3300/0 conn(0x7f288815df80 0x7f28880ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550490303 0 0) 0x7f288815e3f0 con 0x7f28880b2250 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2874003520 con 0x7f28880b2250 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2311200395 0 0) 0x7f2874003520 con 0x7f28880b2250 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 >> v2:172.21.15.159:3300/0 conn(0x7f288815df80 msgr2=0x7f28880ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 --2- 172.21.15.77:0/4051808145 >> v2:172.21.15.159:3300/0 conn(0x7f288815df80 0x7f28880ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 >> v1:172.21.15.159:6789/0 conn(0x7f28880cd470 legacy=0x7f288815b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880b2d40 con 0x7f28880b2250 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f2878001670 con 0x7f28880b2250 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 >> v1:172.21.15.77:6789/0 conn(0x7f28880b2250 legacy=0x7f28880b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 --2- 172.21.15.77:0/4051808145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2874003970 0x7f2874003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 --2- 172.21.15.77:0/4051808145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28740047c0 0x7f2874004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 --2- 172.21.15.77:0/4051808145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 0x7f287400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287400e200 con 0x7f2874005180 2023-11-26T07:23:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287400e370 con 0x7f28740047c0 2023-11-26T07:23:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.929+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287400e530 con 0x7f2874003970 2023-11-26T07:23:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.930+0000 7f288759e640 1 --2- 172.21.15.77:0/4051808145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 0x7f287400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.930+0000 7f287ffff640 1 --2- 172.21.15.77:0/4051808145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28740047c0 0x7f2874004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.930+0000 7f288759e640 1 -- 172.21.15.77:0/4051808145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2874003970 msgr2=0x7f2874003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.930+0000 7f288759e640 1 --2- 172.21.15.77:0/4051808145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2874003970 0x7f2874003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.930+0000 7f288759e640 1 -- 172.21.15.77:0/4051808145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28740047c0 msgr2=0x7f2874004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.930+0000 7f288759e640 1 --2- 172.21.15.77:0/4051808145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28740047c0 0x7f2874004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.930+0000 7f288759e640 1 -- 172.21.15.77:0/4051808145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874003520 con 0x7f2874005180 2023-11-26T07:23:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.930+0000 7f287ffff640 1 --2- 172.21.15.77:0/4051808145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28740047c0 0x7f2874004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:11.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.931+0000 7f288759e640 1 -- 172.21.15.77:0/4051808145 reap_dead start 2023-11-26T07:23:11.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.931+0000 7f288759e640 1 --2- 172.21.15.77:0/4051808145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 0x7f287400db90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2880001e50 tx=0x7f28740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17428d2347765046 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.931+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880003b70 con 0x7f2874005180 2023-11-26T07:23:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.932+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2880003d10 con 0x7f2874005180 2023-11-26T07:23:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.932+0000 7f288659c640 1 -- 172.21.15.77:0/4051808145 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880005310 con 0x7f2874005180 2023-11-26T07:23:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.932+0000 7f288d0cf640 1 -- 172.21.15.77:0/4051808145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 msgr2=0x7f287400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.932+0000 7f288d0cf640 1 --2- 172.21.15.77:0/4051808145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 0x7f287400db90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2880001e50 tx=0x7f28740057f0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.932+0000 7f288d0cf640 1 -- 172.21.15.77:0/4051808145 shutdown_connections 2023-11-26T07:23:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.932+0000 7f288d0cf640 1 --2- 172.21.15.77:0/4051808145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 0x7f287400db90 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.932+0000 7f288d0cf640 1 -- 172.21.15.77:0/4051808145 >> 172.21.15.77:0/4051808145 conn(0x7f288806a920 msgr2=0x7f288806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.932+0000 7f288d0cf640 1 -- 172.21.15.77:0/4051808145 shutdown_connections 2023-11-26T07:23:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.932+0000 7f288d0cf640 1 -- 172.21.15.77:0/4051808145 wait complete. 2023-11-26T07:23:11.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.934+0000 7f288d0cf640 1 Processor -- start 2023-11-26T07:23:11.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.934+0000 7f288d0cf640 1 -- start start 2023-11-26T07:23:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.935+0000 7f288d0cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 0x7f2888150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.935+0000 7f288d0cf640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28880ac9d0 0x7f28880c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.935+0000 7f288d0cf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28880b1430 0x7f28880c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.935+0000 7f288d0cf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2888150d40 con 0x7f2874005180 2023-11-26T07:23:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.935+0000 7f288d0cf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880ace60 con 0x7f28880b1430 2023-11-26T07:23:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.935+0000 7f288d0cf640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28880ad140 con 0x7f28880ac9d0 2023-11-26T07:23:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.936+0000 7f2886d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 0x7f2888150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.936+0000 7f2886d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 0x7f2888150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49956/0 (socket says 172.21.15.77:49956) 2023-11-26T07:23:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.936+0000 7f2886d9d640 1 -- 172.21.15.77:0/3357647314 learned_addr learned my addr 172.21.15.77:0/3357647314 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.936+0000 7f2886d9d640 1 -- 172.21.15.77:0/3357647314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28880ac9d0 msgr2=0x7f28880c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.936+0000 7f287ffff640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28880ac9d0 0x7f28880c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.936+0000 7f288759e640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28880b1430 0x7f28880c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.936+0000 7f2886d9d640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28880ac9d0 0x7f28880c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.936+0000 7f2886d9d640 1 -- 172.21.15.77:0/3357647314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28880b1430 msgr2=0x7f28880c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.936+0000 7f2886d9d640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28880b1430 0x7f28880c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.936+0000 7f2886d9d640 1 -- 172.21.15.77:0/3357647314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880ad420 con 0x7f2874005180 2023-11-26T07:23:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.936+0000 7f2886d9d640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 0x7f2888150800 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f287800c770 tx=0x7f287800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.937+0000 7f287f7fe640 1 -- 172.21.15.77:0/3357647314 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28780074e0 con 0x7f2874005180 2023-11-26T07:23:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.937+0000 7f287f7fe640 1 -- 172.21.15.77:0/3357647314 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2878007640 con 0x7f2874005180 2023-11-26T07:23:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.937+0000 7f287f7fe640 1 -- 172.21.15.77:0/3357647314 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878004a20 con 0x7f2874005180 2023-11-26T07:23:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.937+0000 7f288d0cf640 1 -- 172.21.15.77:0/3357647314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28880ad700 con 0x7f2874005180 2023-11-26T07:23:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.937+0000 7f288d0cf640 1 -- 172.21.15.77:0/3357647314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28880c8540 con 0x7f2874005180 2023-11-26T07:23:11.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.938+0000 7f288d0cf640 1 -- 172.21.15.77:0/3357647314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2888067470 con 0x7f2874005180 2023-11-26T07:23:11.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.939+0000 7f287f7fe640 1 -- 172.21.15.77:0/3357647314 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f2878004b80 con 0x7f2874005180 2023-11-26T07:23:11.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.940+0000 7f287f7fe640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286806b6e0 0x7f286806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.940+0000 7f287f7fe640 1 -- 172.21.15.77:0/3357647314 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2878087490 con 0x7f2874005180 2023-11-26T07:23:11.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.940+0000 7f287ffff640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286806b6e0 0x7f286806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.941+0000 7f287ffff640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286806b6e0 0x7f286806dba0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f28880ae6e0 tx=0x7f2870008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:11.944+0000 7f287f7fe640 1 -- 172.21.15.77:0/3357647314 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2878053dc0 con 0x7f2874005180 2023-11-26T07:23:12.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.175+0000 7f288d0cf640 1 -- 172.21.15.77:0/3357647314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28880ae0e0 con 0x7f2874005180 2023-11-26T07:23:12.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.176+0000 7f287f7fe640 1 -- 172.21.15.77:0/3357647314 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2878018070 con 0x7f2874005180 2023-11-26T07:23:12.178 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:23:12.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.178+0000 7f288d0cf640 1 -- 172.21.15.77:0/3357647314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286806b6e0 msgr2=0x7f286806dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.178+0000 7f288d0cf640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286806b6e0 0x7f286806dba0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f28880ae6e0 tx=0x7f2870008040 comp rx=0 tx=0).stop 2023-11-26T07:23:12.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.178+0000 7f288d0cf640 1 -- 172.21.15.77:0/3357647314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 msgr2=0x7f2888150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.178+0000 7f288d0cf640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 0x7f2888150800 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f287800c770 tx=0x7f287800cc30 comp rx=0 tx=0).stop 2023-11-26T07:23:12.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.179+0000 7f288d0cf640 1 -- 172.21.15.77:0/3357647314 shutdown_connections 2023-11-26T07:23:12.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.179+0000 7f288d0cf640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f286806b6e0 0x7f286806dba0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.179+0000 7f288d0cf640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28880b1430 0x7f28880c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.179+0000 7f288d0cf640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28880ac9d0 0x7f28880c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.179+0000 7f288d0cf640 1 --2- 172.21.15.77:0/3357647314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2874005180 0x7f2888150800 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.179+0000 7f288d0cf640 1 -- 172.21.15.77:0/3357647314 >> 172.21.15.77:0/3357647314 conn(0x7f288806a920 msgr2=0x7f28880cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:12.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.179+0000 7f288d0cf640 1 -- 172.21.15.77:0/3357647314 shutdown_connections 2023-11-26T07:23:12.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:12.179+0000 7f288d0cf640 1 -- 172.21.15.77:0/3357647314 wait complete. 2023-11-26T07:23:12.201 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:23:12.201 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:23:12.201 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-26T07:23:12.201 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:23:12.201 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:23:12.201 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:23:12.201 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:23:12.201 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:23:12.201 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:23:12.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:12.202 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-26T07:23:12.252 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:23:12.252 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:23:12.252 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:23:12.252 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:12.252 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-26T07:23:12.252 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:12.252 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:23:12.252 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:12.252 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42056sec preferred_lft 42056sec 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:23:12.253 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 36:2c:fb:c0:b0:85 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::609f:3dff:fe4d:944c/64 scope link 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether ba:55:90:99:11:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::b855:90ff:fe99:11fe/64 scope link 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 36:2c:fb:c0:b0:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::342c:fbff:fec0:b085/64 scope link 2023-11-26T07:23:12.254 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:12.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:12.255 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:23:12.340 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-26T07:23:12.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:12.344 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-26T07:23:12.396 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-26T07:23:12.396 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:23:12.396 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:23:12.396 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:23:12.396 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:23:12.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:12.397 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-26T07:23:12.398 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-26T07:23:12.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:23:12.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:23:12.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:23:12.398 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-26T07:23:12.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:12.580 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-26T07:23:12.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:23:12.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:23:12.633 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:23:12.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:12.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-26T07:23:12.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:23:12.730 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:23:12.782 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:23:12.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:23:12.783 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:23:12.828 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:23:12.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:12.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:23:13.017 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:23:13.017 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:23:13.017 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:23:13.040 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:23:13.040 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:23:13.040 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:23:13.040 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:23:13.040 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:23:13.065 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:23:13.065 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:23:13.066 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2023-11-26T07:23:13.066 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:23:13.066 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:23:13.066 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:23:13.066 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:23:13.066 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:23:13.067 INFO:teuthology.orchestra.run.smithi077.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-26T07:23:13.067 INFO:teuthology.orchestra.run.smithi077.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:23:13.067 INFO:teuthology.orchestra.run.smithi077.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:23:13.067 INFO:teuthology.orchestra.run.smithi077.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:23:13.068 INFO:teuthology.orchestra.run.smithi077.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:23:13.071 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:23:13.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:13.071 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:23:13.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:13.152 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:23:13.216 INFO:teuthology.orchestra.run.smithi077.stdout:client5096 2023-11-26T07:23:13.217 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:13.217 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:13.267 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:23:13.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.469+0000 7f73e2a59640 1 Processor -- start 2023-11-26T07:23:13.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.469+0000 7f73e2a59640 1 -- start start 2023-11-26T07:23:13.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.471+0000 7f73e2a59640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f73dc15d4e0 0x7f73dc0d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.471+0000 7f73e2a59640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73dc0d38e0 0x7f73dc0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.471+0000 7f73e2a59640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc0ce990 con 0x7f73dc0d0070 2023-11-26T07:23:13.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.471+0000 7f73e2a59640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73dc0d4110 con 0x7f73dc15d4e0 2023-11-26T07:23:13.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.471+0000 7f73e2a59640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0d04e0 con 0x7f73dc0d38e0 2023-11-26T07:23:13.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.472+0000 7f73e1256640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73dc0d38e0 0x7f73dc0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.472+0000 7f73e1a57640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f73dc15d4e0 0x7f73dc0d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.472+0000 7f73e1a57640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f73dc15d4e0 0x7f73dc0d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:45400/0 (socket says 172.21.15.77:45400) 2023-11-26T07:23:13.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.472+0000 7f73e1a57640 1 -- 172.21.15.77:0/2840765537 learned_addr learned my addr 172.21.15.77:0/2840765537 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:13.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.472+0000 7f73e1256640 1 -- 172.21.15.77:0/2840765537 >> v2:172.21.15.159:3300/0 conn(0x7f73dc15d4e0 msgr2=0x7f73dc0d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:13.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.472+0000 7f73e1256640 1 --2- 172.21.15.77:0/2840765537 >> v2:172.21.15.159:3300/0 conn(0x7f73dc15d4e0 0x7f73dc0d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.472+0000 7f73e1256640 1 -- 172.21.15.77:0/2840765537 >> v1:172.21.15.159:6789/0 conn(0x7f73dc0d0070 legacy=0x7f73dc0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.473+0000 7f73e1256640 1 -- 172.21.15.77:0/2840765537 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0cec70 con 0x7f73dc0d38e0 2023-11-26T07:23:13.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.474+0000 7f73e1256640 1 --2- 172.21.15.77:0/2840765537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73dc0d38e0 0x7f73dc0cfb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0097a0 tx=0x7f73cc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6404772eb248edc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:13.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.475+0000 7f73e0a55640 1 -- 172.21.15.77:0/2840765537 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc031830 con 0x7f73dc0d38e0 2023-11-26T07:23:13.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.475+0000 7f73e0a55640 1 -- 172.21.15.77:0/2840765537 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc031990 con 0x7f73dc0d38e0 2023-11-26T07:23:13.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.475+0000 7f73e0a55640 1 -- 172.21.15.77:0/2840765537 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc031d20 con 0x7f73dc0d38e0 2023-11-26T07:23:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.475+0000 7f73e2a59640 1 -- 172.21.15.77:0/2840765537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73dc0d38e0 msgr2=0x7f73dc0cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.475+0000 7f73e2a59640 1 --2- 172.21.15.77:0/2840765537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73dc0d38e0 0x7f73dc0cfb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0097a0 tx=0x7f73cc02b8d0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.475+0000 7f73e2a59640 1 -- 172.21.15.77:0/2840765537 shutdown_connections 2023-11-26T07:23:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.475+0000 7f73e2a59640 1 --2- 172.21.15.77:0/2840765537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73dc0d38e0 0x7f73dc0cfb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.476+0000 7f73e2a59640 1 --2- 172.21.15.77:0/2840765537 >> v2:172.21.15.159:3300/0 conn(0x7f73dc15d4e0 0x7f73dc0d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.476+0000 7f73e2a59640 1 -- 172.21.15.77:0/2840765537 >> 172.21.15.77:0/2840765537 conn(0x7f73dc09c510 msgr2=0x7f73dc0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.476+0000 7f73e2a59640 1 -- 172.21.15.77:0/2840765537 shutdown_connections 2023-11-26T07:23:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.476+0000 7f73e2a59640 1 -- 172.21.15.77:0/2840765537 wait complete. 2023-11-26T07:23:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.478+0000 7f73e2a59640 1 Processor -- start 2023-11-26T07:23:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.478+0000 7f73e2a59640 1 -- start start 2023-11-26T07:23:13.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.479+0000 7f73e2a59640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73dc0d0070 0x7f73dc1601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.479+0000 7f73e2a59640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73dc0d38e0 0x7f73dc1f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.479+0000 7f73e2a59640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73dc15d4e0 0x7f73dc1f6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.479+0000 7f73e2a59640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0cad70 con 0x7f73dc0d38e0 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.479+0000 7f73e2a59640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0cccc0 con 0x7f73dc0d0070 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.479+0000 7f73e2a59640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0b8340 con 0x7f73dc15d4e0 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.480+0000 7f73e1256640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73dc0d38e0 0x7f73dc1f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.480+0000 7f73e1256640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73dc0d38e0 0x7f73dc1f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49972/0 (socket says 172.21.15.77:49972) 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.480+0000 7f73e1256640 1 -- 172.21.15.77:0/1237367901 learned_addr learned my addr 172.21.15.77:0/1237367901 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.480+0000 7f73e1a57640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73dc0d0070 0x7f73dc1601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.480+0000 7f73e2258640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73dc15d4e0 0x7f73dc1f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.480+0000 7f73e1256640 1 -- 172.21.15.77:0/1237367901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73dc15d4e0 msgr2=0x7f73dc1f6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.480+0000 7f73e1256640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73dc15d4e0 0x7f73dc1f6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.480+0000 7f73e1256640 1 -- 172.21.15.77:0/1237367901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73dc0d0070 msgr2=0x7f73dc1601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.480+0000 7f73e1256640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73dc0d0070 0x7f73dc1601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.480+0000 7f73e1256640 1 -- 172.21.15.77:0/1237367901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc009400 con 0x7f73dc0d38e0 2023-11-26T07:23:13.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.481+0000 7f73e1256640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73dc0d38e0 0x7f73dc1f3f20 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0098c0 tx=0x7f73cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:13.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.481+0000 7f73d27fc640 1 -- 172.21.15.77:0/1237367901 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc03a630 con 0x7f73dc0d38e0 2023-11-26T07:23:13.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.481+0000 7f73d27fc640 1 -- 172.21.15.77:0/1237367901 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc03a7d0 con 0x7f73dc0d38e0 2023-11-26T07:23:13.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.481+0000 7f73e2a59640 1 -- 172.21.15.77:0/1237367901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73dc0ca3d0 con 0x7f73dc0d38e0 2023-11-26T07:23:13.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.481+0000 7f73d27fc640 1 -- 172.21.15.77:0/1237367901 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc03ab80 con 0x7f73dc0d38e0 2023-11-26T07:23:13.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.481+0000 7f73e2a59640 1 -- 172.21.15.77:0/1237367901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc0ca990 con 0x7f73dc0d38e0 2023-11-26T07:23:13.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.482+0000 7f73e2a59640 1 -- 172.21.15.77:0/1237367901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc0caeb0 con 0x7f73dc0d38e0 2023-11-26T07:23:13.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.484+0000 7f73d27fc640 1 -- 172.21.15.77:0/1237367901 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f73cc03ace0 con 0x7f73dc0d38e0 2023-11-26T07:23:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.485+0000 7f73d27fc640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73c006b6b0 0x7f73c006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.485+0000 7f73d27fc640 1 -- 172.21.15.77:0/1237367901 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73cc0ac670 con 0x7f73dc0d38e0 2023-11-26T07:23:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.485+0000 7f73e1a57640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73c006b6b0 0x7f73c006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.486+0000 7f73e1a57640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73c006b6b0 0x7f73c006db70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0d2f40 tx=0x7f73d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:13.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.489+0000 7f73d27fc640 1 -- 172.21.15.77:0/1237367901 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73dc0caeb0 con 0x7f73dc0d38e0 2023-11-26T07:23:13.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.719+0000 7f73e2a59640 1 -- 172.21.15.77:0/1237367901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f73dc0caeb0 con 0x7f73dc0d38e0 2023-11-26T07:23:13.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.720+0000 7f73d27fc640 1 -- 172.21.15.77:0/1237367901 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f73dc0caeb0 con 0x7f73dc0d38e0 2023-11-26T07:23:13.722 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:23:13.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.722+0000 7f73e2a59640 1 -- 172.21.15.77:0/1237367901 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73c006b6b0 msgr2=0x7f73c006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.722+0000 7f73e2a59640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73c006b6b0 0x7f73c006db70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0d2f40 tx=0x7f73d8008040 comp rx=0 tx=0).stop 2023-11-26T07:23:13.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.722+0000 7f73e2a59640 1 -- 172.21.15.77:0/1237367901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73dc0d38e0 msgr2=0x7f73dc1f3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.722+0000 7f73e2a59640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73dc0d38e0 0x7f73dc1f3f20 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0098c0 tx=0x7f73cc0046c0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.722+0000 7f73e2a59640 1 -- 172.21.15.77:0/1237367901 shutdown_connections 2023-11-26T07:23:13.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.722+0000 7f73e2a59640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f73c006b6b0 0x7f73c006db70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.722+0000 7f73e2a59640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73dc15d4e0 0x7f73dc1f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.722+0000 7f73e2a59640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73dc0d38e0 0x7f73dc1f3f20 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.723+0000 7f73e2a59640 1 --2- 172.21.15.77:0/1237367901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73dc0d0070 0x7f73dc1601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.723+0000 7f73e2a59640 1 -- 172.21.15.77:0/1237367901 >> 172.21.15.77:0/1237367901 conn(0x7f73dc09c510 msgr2=0x7f73dc0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:13.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.723+0000 7f73e2a59640 1 -- 172.21.15.77:0/1237367901 shutdown_connections 2023-11-26T07:23:13.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:13.723+0000 7f73e2a59640 1 -- 172.21.15.77:0/1237367901 wait complete. 2023-11-26T07:23:13.743 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:23:13.743 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:23:13.744 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-11-26T07:23:13.744 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:23:13.744 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:23:13.744 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:23:13.744 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:23:13.744 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:23:13.744 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:23:13.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:13.745 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-11-26T07:23:13.805 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:23:13.805 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:23:13.805 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:23:13.805 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:13.805 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-11-26T07:23:13.806 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:13.806 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:23:13.806 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:13.806 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-11-26T07:23:13.806 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:23:13.806 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:13.806 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-11-26T07:23:13.807 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:23:13.807 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:13.807 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:23:13.807 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:13.807 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:23:13.807 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42014sec preferred_lft 42014sec 2023-11-26T07:23:13.807 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-11-26T07:23:13.807 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:13.808 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:23:13.808 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 5a:27:d9:14:0a:5b brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:13.808 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:23:13.808 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:13.808 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::5429:19ff:fe3d:266e/64 scope link 2023-11-26T07:23:13.808 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:13.808 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:23:13.809 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether be:e0:26:a8:90:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:23:13.809 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::bce0:26ff:fea8:90e7/64 scope link 2023-11-26T07:23:13.809 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:13.809 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:23:13.809 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 5a:27:d9:14:0a:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:23:13.809 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::5827:d9ff:fe14:a5b/64 scope link 2023-11-26T07:23:13.809 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:13.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:13.811 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:23:13.901 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-11-26T07:23:13.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:13.906 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-11-26T07:23:13.960 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-11-26T07:23:13.960 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:23:13.960 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:23:13.960 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:23:13.960 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:23:13.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:13.961 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-11-26T07:23:13.961 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-11-26T07:23:13.961 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:23:13.961 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:23:13.961 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:23:13.961 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-11-26T07:23:14.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:14.146 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-11-26T07:23:14.195 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:23:14.195 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:23:14.196 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:23:14.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:14.196 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-11-26T07:23:14.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:23:14.292 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:23:14.347 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:23:14.347 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:23:14.347 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:23:14.394 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:23:14.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:14.395 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:23:14.583 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:23:14.583 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:23:14.583 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:23:14.605 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:23:14.605 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:23:14.605 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:23:14.605 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:23:14.605 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:23:14.636 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:23:14.636 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:23:14.636 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-11-26T07:23:14.636 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-11-26T07:23:14.636 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:23:14.636 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-11-26T07:23:14.636 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-11-26T07:23:14.636 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=957368bd-e942-499b-9938-86266ae9bafb" will pass to kernel 2023-11-26T07:23:14.638 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-26T07:23:14.638 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2023-11-26T07:23:14.638 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-26T07:23:14.639 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2023-11-26T07:23:14.639 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-26T07:23:14.644 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:23:14.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:14.644 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:23:14.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:14.726 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:23:14.781 INFO:teuthology.orchestra.run.smithi159.stdout:client6900 2023-11-26T07:23:14.782 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:23:14.782 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:14.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:23:15.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.055+0000 7fdd64968640 1 Processor -- start 2023-11-26T07:23:15.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.056+0000 7fdd64968640 1 -- start start 2023-11-26T07:23:15.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.057+0000 7fdd64968640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdd600d0a50 0x7fdd600d30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.057+0000 7fdd64968640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600d3630 0x7fdd600d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.057+0000 7fdd64968640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd600cdf30 con 0x7fdd6015d4f0 2023-11-26T07:23:15.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.057+0000 7fdd64968640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd600d3e30 con 0x7fdd600d0a50 2023-11-26T07:23:15.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.057+0000 7fdd64968640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600cf3c0 con 0x7fdd600d3630 2023-11-26T07:23:15.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.057+0000 7fdd5e59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdd6015d4f0 0x7fdd600cecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45834/0 (socket says 172.21.15.77:45834) 2023-11-26T07:23:15.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.057+0000 7fdd5e59c640 1 -- 172.21.15.77:0/3858657667 learned_addr learned my addr 172.21.15.77:0/3858657667 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:15.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993973427 0 0) 0x7fdd600cdf30 con 0x7fdd6015d4f0 2023-11-26T07:23:15.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5dd9b640 1 --2- 172.21.15.77:0/3858657667 >> v2:172.21.15.159:3300/0 conn(0x7fdd600d0a50 0x7fdd600d30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd4c003520 con 0x7fdd6015d4f0 2023-11-26T07:23:15.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5ed9d640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600d3630 0x7fdd600d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2003253113 0 0) 0x7fdd4c003520 con 0x7fdd6015d4f0 2023-11-26T07:23:15.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600d3630 msgr2=0x7fdd600d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600d3630 0x7fdd600d17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 >> v2:172.21.15.159:3300/0 conn(0x7fdd600d0a50 msgr2=0x7fdd600d30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 --2- 172.21.15.77:0/3858657667 >> v2:172.21.15.159:3300/0 conn(0x7fdd600d0a50 0x7fdd600d30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd600d3b50 con 0x7fdd6015d4f0 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fdd500019f0 con 0x7fdd6015d4f0 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 >> v1:172.21.15.77:6789/0 conn(0x7fdd6015d4f0 legacy=0x7fdd600cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600d3630 0x7fdd4c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd4c003f40 0x7fdd4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.058+0000 7fdd5d59a640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 0x7fdd4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600d3e30 con 0x7fdd4c004d00 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600cf3c0 con 0x7fdd4c003f40 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c00ba30 con 0x7fdd600d3630 2023-11-26T07:23:15.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5ed9d640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 0x7fdd4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5e59c640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600d3630 0x7fdd4c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5dd9b640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd4c003f40 0x7fdd4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5ed9d640 1 -- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600d3630 msgr2=0x7fdd4c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:15.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5ed9d640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600d3630 0x7fdd4c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5ed9d640 1 -- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd4c003f40 msgr2=0x7fdd4c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:15.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5ed9d640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd4c003f40 0x7fdd4c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5ed9d640 1 -- 172.21.15.77:0/3858657667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c003520 con 0x7fdd4c004d00 2023-11-26T07:23:15.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.059+0000 7fdd5dd9b640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd4c003f40 0x7fdd4c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:15.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.060+0000 7fdd5ed9d640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 0x7fdd4c005180 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800ba10 tx=0x7fdd4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71175ab8242e1d6f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:15.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.061+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58032630 con 0x7fdd4c004d00 2023-11-26T07:23:15.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.061+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd58032790 con 0x7fdd4c004d00 2023-11-26T07:23:15.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.061+0000 7fdd5d59a640 1 -- 172.21.15.77:0/3858657667 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58032b20 con 0x7fdd4c004d00 2023-11-26T07:23:15.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.061+0000 7fdd64968640 1 -- 172.21.15.77:0/3858657667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 msgr2=0x7fdd4c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.061+0000 7fdd64968640 1 --2- 172.21.15.77:0/3858657667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 0x7fdd4c005180 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800ba10 tx=0x7fdd4c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.061+0000 7fdd5ed9d640 1 -- 172.21.15.77:0/3858657667 reap_dead start 2023-11-26T07:23:15.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.061+0000 7fdd64968640 1 -- 172.21.15.77:0/3858657667 shutdown_connections 2023-11-26T07:23:15.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.061+0000 7fdd64968640 1 -- 172.21.15.77:0/3858657667 >> 172.21.15.77:0/3858657667 conn(0x7fdd60061950 msgr2=0x7fdd6008af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:15.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.062+0000 7fdd64968640 1 -- 172.21.15.77:0/3858657667 shutdown_connections 2023-11-26T07:23:15.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.062+0000 7fdd64968640 1 -- 172.21.15.77:0/3858657667 wait complete. 2023-11-26T07:23:15.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.063+0000 7fdd64968640 1 Processor -- start 2023-11-26T07:23:15.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.064+0000 7fdd64968640 1 -- start start 2023-11-26T07:23:15.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.064+0000 7fdd64968640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 0x7fdd600ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.064+0000 7fdd64968640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600cb540 0x7fdd6015fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.064+0000 7fdd64968640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd6015b2d0 0x7fdd6015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.064+0000 7fdd64968640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6015bcc0 con 0x7fdd4c004d00 2023-11-26T07:23:15.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.064+0000 7fdd64968640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600cd4a0 con 0x7fdd6015b2d0 2023-11-26T07:23:15.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd64968640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600ccb90 con 0x7fdd600cb540 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd5e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 0x7fdd600ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd5e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 0x7fdd600ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49998/0 (socket says 172.21.15.77:49998) 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd5e59c640 1 -- 172.21.15.77:0/3797984373 learned_addr learned my addr 172.21.15.77:0/3797984373 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd5ed9d640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd6015b2d0 0x7fdd6015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd5dd9b640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600cb540 0x7fdd6015fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd5e59c640 1 -- 172.21.15.77:0/3797984373 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600cb540 msgr2=0x7fdd6015fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd5e59c640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600cb540 0x7fdd6015fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd5e59c640 1 -- 172.21.15.77:0/3797984373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd6015b2d0 msgr2=0x7fdd6015b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd5e59c640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd6015b2d0 0x7fdd6015b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd5e59c640 1 -- 172.21.15.77:0/3797984373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd600cba40 con 0x7fdd4c004d00 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.065+0000 7fdd5ed9d640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd6015b2d0 0x7fdd6015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.066+0000 7fdd5e59c640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 0x7fdd600ccf60 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fdd50007ae0 tx=0x7fdd5000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:15.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.066+0000 7fdd56ffd640 1 -- 172.21.15.77:0/3797984373 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000eeb0 con 0x7fdd4c004d00 2023-11-26T07:23:15.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.066+0000 7fdd56ffd640 1 -- 172.21.15.77:0/3797984373 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd50013420 con 0x7fdd4c004d00 2023-11-26T07:23:15.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.066+0000 7fdd56ffd640 1 -- 172.21.15.77:0/3797984373 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd500137d0 con 0x7fdd4c004d00 2023-11-26T07:23:15.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.066+0000 7fdd64968640 1 -- 172.21.15.77:0/3797984373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd600cbd20 con 0x7fdd4c004d00 2023-11-26T07:23:15.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.066+0000 7fdd64968640 1 -- 172.21.15.77:0/3797984373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd600cc2e0 con 0x7fdd4c004d00 2023-11-26T07:23:15.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.067+0000 7fdd64968640 1 -- 172.21.15.77:0/3797984373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd60067470 con 0x7fdd4c004d00 2023-11-26T07:23:15.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.068+0000 7fdd56ffd640 1 -- 172.21.15.77:0/3797984373 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fdd50013930 con 0x7fdd4c004d00 2023-11-26T07:23:15.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.069+0000 7fdd56ffd640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd4006b6e0 0x7fdd4006dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.069+0000 7fdd56ffd640 1 -- 172.21.15.77:0/3797984373 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd50088960 con 0x7fdd4c004d00 2023-11-26T07:23:15.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.069+0000 7fdd5dd9b640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd4006b6e0 0x7fdd4006dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.070+0000 7fdd5dd9b640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd4006b6e0 0x7fdd4006dba0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdd600a12c0 tx=0x7fdd48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:15.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.073+0000 7fdd56ffd640 1 -- 172.21.15.77:0/3797984373 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd500bde90 con 0x7fdd4c004d00 2023-11-26T07:23:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.299+0000 7fdd64968640 1 -- 172.21.15.77:0/3797984373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdd600b8c10 con 0x7fdd4c004d00 2023-11-26T07:23:15.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.354+0000 7fdd56ffd640 1 -- 172.21.15.77:0/3797984373 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 136+0+0 (secure 0 0 0) 0x7fdd50055290 con 0x7fdd4c004d00 2023-11-26T07:23:15.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.356+0000 7fdd64968640 1 -- 172.21.15.77:0/3797984373 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd4006b6e0 msgr2=0x7fdd4006dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.356+0000 7fdd64968640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd4006b6e0 0x7fdd4006dba0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdd600a12c0 tx=0x7fdd48008040 comp rx=0 tx=0).stop 2023-11-26T07:23:15.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.356+0000 7fdd64968640 1 -- 172.21.15.77:0/3797984373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 msgr2=0x7fdd600ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.356+0000 7fdd64968640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 0x7fdd600ccf60 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fdd50007ae0 tx=0x7fdd5000e530 comp rx=0 tx=0).stop 2023-11-26T07:23:15.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.357+0000 7fdd64968640 1 -- 172.21.15.77:0/3797984373 shutdown_connections 2023-11-26T07:23:15.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.357+0000 7fdd64968640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdd4006b6e0 0x7fdd4006dba0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.357+0000 7fdd64968640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd6015b2d0 0x7fdd6015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.357+0000 7fdd64968640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd600cb540 0x7fdd6015fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.357+0000 7fdd64968640 1 --2- 172.21.15.77:0/3797984373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c004d00 0x7fdd600ccf60 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.357+0000 7fdd64968640 1 -- 172.21.15.77:0/3797984373 >> 172.21.15.77:0/3797984373 conn(0x7fdd60061950 msgr2=0x7fdd600b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:15.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.357+0000 7fdd64968640 1 -- 172.21.15.77:0/3797984373 shutdown_connections 2023-11-26T07:23:15.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.357+0000 7fdd64968640 1 -- 172.21.15.77:0/3797984373 wait complete. 2023-11-26T07:23:15.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:23:15.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.572+0000 7fb7507a9640 1 Processor -- start 2023-11-26T07:23:15.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.572+0000 7fb7507a9640 1 -- start start 2023-11-26T07:23:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.574+0000 7fb7507a9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb74815b440 0x7fb7480cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.574+0000 7fb7507a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7480cbf20 0x7fb7480c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.574+0000 7fb7507a9640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74815eea0 con 0x7fb7480c57e0 2023-11-26T07:23:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.574+0000 7fb7507a9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7480cc3d0 con 0x7fb74815b440 2023-11-26T07:23:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.574+0000 7fb7507a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815b820 con 0x7fb7480cbf20 2023-11-26T07:23:15.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.575+0000 7fb74dd44640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7480cbf20 0x7fb7480c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.575+0000 7fb74e545640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb74815b440 0x7fb7480cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.575+0000 7fb74ed46640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fb7480c57e0 0x7fb7480c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:56616/0 (socket says 172.21.15.77:56616) 2023-11-26T07:23:15.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.575+0000 7fb74e545640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb74815b440 0x7fb7480cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:45440/0 (socket says 172.21.15.77:45440) 2023-11-26T07:23:15.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.575+0000 7fb74ed46640 1 -- 172.21.15.77:0/237598132 learned_addr learned my addr 172.21.15.77:0/237598132 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:15.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.575+0000 7fb74e545640 1 -- 172.21.15.77:0/237598132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7480cbf20 msgr2=0x7fb7480c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:15.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.575+0000 7fb74e545640 1 --2- 172.21.15.77:0/237598132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7480cbf20 0x7fb7480c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.575+0000 7fb74e545640 1 -- 172.21.15.77:0/237598132 >> v1:172.21.15.159:6789/0 conn(0x7fb7480c57e0 legacy=0x7fb7480c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.575+0000 7fb74e545640 1 -- 172.21.15.77:0/237598132 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74806d600 con 0x7fb74815b440 2023-11-26T07:23:15.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.577+0000 7fb74e545640 1 --2- 172.21.15.77:0/237598132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb74815b440 0x7fb7480cb9e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097a0 tx=0x7fb74402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7840aa6459e47225 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:15.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.577+0000 7fb74d543640 1 -- 172.21.15.77:0/237598132 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74402e070 con 0x7fb74815b440 2023-11-26T07:23:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.577+0000 7fb74d543640 1 -- 172.21.15.77:0/237598132 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7440315a0 con 0x7fb74815b440 2023-11-26T07:23:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.577+0000 7fb74d543640 1 -- 172.21.15.77:0/237598132 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744031930 con 0x7fb74815b440 2023-11-26T07:23:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.578+0000 7fb7507a9640 1 -- 172.21.15.77:0/237598132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb74815b440 msgr2=0x7fb7480cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.578+0000 7fb7507a9640 1 --2- 172.21.15.77:0/237598132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb74815b440 0x7fb7480cb9e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097a0 tx=0x7fb74402b840 comp rx=0 tx=0).stop 2023-11-26T07:23:15.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.578+0000 7fb7507a9640 1 -- 172.21.15.77:0/237598132 shutdown_connections 2023-11-26T07:23:15.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.578+0000 7fb7507a9640 1 --2- 172.21.15.77:0/237598132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7480cbf20 0x7fb7480c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.578+0000 7fb7507a9640 1 --2- 172.21.15.77:0/237598132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb74815b440 0x7fb7480cb9e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.578+0000 7fb7507a9640 1 -- 172.21.15.77:0/237598132 >> 172.21.15.77:0/237598132 conn(0x7fb7480b0c50 msgr2=0x7fb7480b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:15.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.578+0000 7fb7507a9640 1 -- 172.21.15.77:0/237598132 shutdown_connections 2023-11-26T07:23:15.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.578+0000 7fb7507a9640 1 -- 172.21.15.77:0/237598132 wait complete. 2023-11-26T07:23:15.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.580+0000 7fb7507a9640 1 Processor -- start 2023-11-26T07:23:15.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.580+0000 7fb7507a9640 1 -- start start 2023-11-26T07:23:15.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.581+0000 7fb7507a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7480c57e0 0x7fb7481f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.581+0000 7fb7507a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7480cbf20 0x7fb7480cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.581+0000 7fb7507a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb74815b440 0x7fb7480704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.581+0000 7fb7507a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815bd40 con 0x7fb7480c57e0 2023-11-26T07:23:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.581+0000 7fb7507a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815c020 con 0x7fb7480cbf20 2023-11-26T07:23:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.581+0000 7fb7507a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815c300 con 0x7fb74815b440 2023-11-26T07:23:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.581+0000 7fb74e545640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7480c57e0 0x7fb7481f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.581+0000 7fb74e545640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7480c57e0 0x7fb7481f3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50000/0 (socket says 172.21.15.77:50000) 2023-11-26T07:23:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.581+0000 7fb74e545640 1 -- 172.21.15.77:0/1179325228 learned_addr learned my addr 172.21.15.77:0/1179325228 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.581+0000 7fb74ed46640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb74815b440 0x7fb7480704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.581+0000 7fb74dd44640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7480cbf20 0x7fb7480cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.582+0000 7fb74e545640 1 -- 172.21.15.77:0/1179325228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb74815b440 msgr2=0x7fb7480704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.582+0000 7fb74e545640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb74815b440 0x7fb7480704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.582+0000 7fb74e545640 1 -- 172.21.15.77:0/1179325228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7480cbf20 msgr2=0x7fb7480cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.582+0000 7fb74e545640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7480cbf20 0x7fb7480cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.582+0000 7fb74e545640 1 -- 172.21.15.77:0/1179325228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744009400 con 0x7fb7480c57e0 2023-11-26T07:23:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.582+0000 7fb74e545640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7480c57e0 0x7fb7481f3fd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb744000c00 tx=0x7fb7440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.582+0000 7fb73effd640 1 -- 172.21.15.77:0/1179325228 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744032840 con 0x7fb7480c57e0 2023-11-26T07:23:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.582+0000 7fb73effd640 1 -- 172.21.15.77:0/1179325228 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7440329a0 con 0x7fb7480c57e0 2023-11-26T07:23:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.582+0000 7fb73effd640 1 -- 172.21.15.77:0/1179325228 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744032d50 con 0x7fb7480c57e0 2023-11-26T07:23:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.582+0000 7fb7507a9640 1 -- 172.21.15.77:0/1179325228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74815c5e0 con 0x7fb7480c57e0 2023-11-26T07:23:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.582+0000 7fb7507a9640 1 -- 172.21.15.77:0/1179325228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74815b960 con 0x7fb7480c57e0 2023-11-26T07:23:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.584+0000 7fb7507a9640 1 -- 172.21.15.77:0/1179325228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7480ae410 con 0x7fb7480c57e0 2023-11-26T07:23:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.584+0000 7fb73effd640 1 -- 172.21.15.77:0/1179325228 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fb74404d3f0 con 0x7fb7480c57e0 2023-11-26T07:23:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.586+0000 7fb73effd640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb72c06b6b0 0x7fb72c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.586+0000 7fb73effd640 1 -- 172.21.15.77:0/1179325228 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7440a9b90 con 0x7fb7480c57e0 2023-11-26T07:23:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.586+0000 7fb74dd44640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb72c06b6b0 0x7fb72c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.586+0000 7fb74dd44640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb72c06b6b0 0x7fb72c06db70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb7480c6340 tx=0x7fb738008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:15.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.590+0000 7fb73effd640 1 -- 172.21.15.77:0/1179325228 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb7440765d0 con 0x7fb7480c57e0 2023-11-26T07:23:15.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.805+0000 7fb7507a9640 1 -- 172.21.15.77:0/1179325228 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb74815c190 con 0x7fb72c06b6b0 2023-11-26T07:23:15.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.808+0000 7fb73effd640 1 -- 172.21.15.77:0/1179325228 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb74815c190 con 0x7fb72c06b6b0 2023-11-26T07:23:15.810 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-26T07:23:15.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-26T07:23:15.810 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cephfs" 2023-11-26T07:23:15.810 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:15.811 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-26T07:23:15.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.810+0000 7fb7507a9640 1 -- 172.21.15.77:0/1179325228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb72c06b6b0 msgr2=0x7fb72c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.810+0000 7fb7507a9640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb72c06b6b0 0x7fb72c06db70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb7480c6340 tx=0x7fb738008040 comp rx=0 tx=0).stop 2023-11-26T07:23:15.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.810+0000 7fb7507a9640 1 -- 172.21.15.77:0/1179325228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7480c57e0 msgr2=0x7fb7481f3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.810+0000 7fb7507a9640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7480c57e0 0x7fb7481f3fd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb744000c00 tx=0x7fb7440046c0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.810+0000 7fb7507a9640 1 -- 172.21.15.77:0/1179325228 shutdown_connections 2023-11-26T07:23:15.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.810+0000 7fb7507a9640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb72c06b6b0 0x7fb72c06db70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.810+0000 7fb7507a9640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb74815b440 0x7fb7480704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.810+0000 7fb7507a9640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7480cbf20 0x7fb7480cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.810+0000 7fb7507a9640 1 --2- 172.21.15.77:0/1179325228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7480c57e0 0x7fb7481f3fd0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.810+0000 7fb7507a9640 1 -- 172.21.15.77:0/1179325228 >> 172.21.15.77:0/1179325228 conn(0x7fb7480b0c50 msgr2=0x7fb7480b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:15.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.810+0000 7fb7507a9640 1 -- 172.21.15.77:0/1179325228 shutdown_connections 2023-11-26T07:23:15.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:15.811+0000 7fb7507a9640 1 -- 172.21.15.77:0/1179325228 wait complete. 2023-11-26T07:23:15.831 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:23:16.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.048+0000 7f5a9a3e6640 1 Processor -- start 2023-11-26T07:23:16.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.048+0000 7f5a9a3e6640 1 -- start start 2023-11-26T07:23:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.050+0000 7f5a9a3e6640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5a9415ef00 0x7f5a94071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.050+0000 7f5a9a3e6640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a94071c40 0x7f5a940cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.050+0000 7f5a9a3e6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a940ccdf0 con 0x7f5a94141b30 2023-11-26T07:23:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.050+0000 7f5a9a3e6640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9406ce80 con 0x7f5a9415ef00 2023-11-26T07:23:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.050+0000 7f5a9a3e6640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9415f470 con 0x7f5a94071c40 2023-11-26T07:23:16.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.050+0000 7f5a993e4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5a94141b30 0x7f5a9406c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36208/0 (socket says 172.21.15.77:36208) 2023-11-26T07:23:16.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.050+0000 7f5a993e4640 1 -- 172.21.15.77:0/3902781704 learned_addr learned my addr 172.21.15.77:0/3902781704 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:16.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.050+0000 7f5a98be3640 1 --2- 172.21.15.77:0/3902781704 >> v2:172.21.15.159:3300/0 conn(0x7f5a9415ef00 0x7f5a94071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.050+0000 7f5a99be5640 1 --2- 172.21.15.77:0/3902781704 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a94071c40 0x7f5a940cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.050+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872819372 0 0) 0x7f5a940ccdf0 con 0x7f5a94141b30 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a80003520 con 0x7f5a94141b30 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2330499601 0 0) 0x7f5a80003520 con 0x7f5a94141b30 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a94071c40 msgr2=0x7f5a940cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 --2- 172.21.15.77:0/3902781704 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a94071c40 0x7f5a940cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 >> v2:172.21.15.159:3300/0 conn(0x7f5a9415ef00 msgr2=0x7f5a94071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 --2- 172.21.15.77:0/3902781704 >> v2:172.21.15.159:3300/0 conn(0x7f5a9415ef00 0x7f5a94071700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9415f750 con 0x7f5a94141b30 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f5a90001690 con 0x7f5a94141b30 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 >> v1:172.21.15.77:6789/0 conn(0x7f5a94141b30 legacy=0x7f5a9406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 --2- 172.21.15.77:0/3902781704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a80003970 0x7f5a80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 --2- 172.21.15.77:0/3902781704 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a94071c40 0x7f5a800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 --2- 172.21.15.77:0/3902781704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a80004d00 0x7f5a80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9406ce80 con 0x7f5a80003970 2023-11-26T07:23:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9415f470 con 0x7f5a80004d00 2023-11-26T07:23:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8000bab0 con 0x7f5a94071c40 2023-11-26T07:23:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.051+0000 7f5a993e4640 1 --2- 172.21.15.77:0/3902781704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a80003970 0x7f5a80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.052+0000 7f5a993e4640 1 -- 172.21.15.77:0/3902781704 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a94071c40 msgr2=0x7f5a800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.052+0000 7f5a993e4640 1 --2- 172.21.15.77:0/3902781704 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a94071c40 0x7f5a800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.052+0000 7f5a993e4640 1 -- 172.21.15.77:0/3902781704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a80004d00 msgr2=0x7f5a80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.052+0000 7f5a993e4640 1 --2- 172.21.15.77:0/3902781704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a80004d00 0x7f5a80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.052+0000 7f5a993e4640 1 -- 172.21.15.77:0/3902781704 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a80003520 con 0x7f5a80003970 2023-11-26T07:23:16.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.053+0000 7f5a993e4640 1 --2- 172.21.15.77:0/3902781704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a80003970 0x7f5a80003d90 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f5a9000c210 tx=0x7f5a800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9829cef96101e83f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:16.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.053+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90005ad0 con 0x7f5a80003970 2023-11-26T07:23:16.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.053+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a90005c30 con 0x7f5a80003970 2023-11-26T07:23:16.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.053+0000 7f5a8bfff640 1 -- 172.21.15.77:0/3902781704 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9002c8b0 con 0x7f5a80003970 2023-11-26T07:23:16.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.053+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/3902781704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a80003970 msgr2=0x7f5a80003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.053+0000 7f5a9a3e6640 1 --2- 172.21.15.77:0/3902781704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a80003970 0x7f5a80003d90 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f5a9000c210 tx=0x7f5a800057f0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.053+0000 7f5a99be5640 1 -- 172.21.15.77:0/3902781704 reap_dead start 2023-11-26T07:23:16.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.054+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/3902781704 shutdown_connections 2023-11-26T07:23:16.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.054+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/3902781704 >> 172.21.15.77:0/3902781704 conn(0x7f5a9406a500 msgr2=0x7f5a9406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:16.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.054+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/3902781704 shutdown_connections 2023-11-26T07:23:16.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.054+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/3902781704 wait complete. 2023-11-26T07:23:16.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.055+0000 7f5a9a3e6640 1 Processor -- start 2023-11-26T07:23:16.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.056+0000 7f5a9a3e6640 1 -- start start 2023-11-26T07:23:16.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a9a3e6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a80003970 0x7f5a941f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a9a3e6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a940ad5a0 0x7f5a940cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a9a3e6640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a940b1fc0 0x7f5a94144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a9a3e6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94143e30 con 0x7f5a940ad5a0 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a9a3e6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a941434d0 con 0x7f5a80003970 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a9a3e6640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94143770 con 0x7f5a940b1fc0 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a98be3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a940ad5a0 0x7f5a940cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a98be3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a940ad5a0 0x7f5a940cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54254/0 (socket says 172.21.15.77:54254) 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a98be3640 1 -- 172.21.15.77:0/1376504448 learned_addr learned my addr 172.21.15.77:0/1376504448 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a99be5640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a940b1fc0 0x7f5a94144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a993e4640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a80003970 0x7f5a941f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a98be3640 1 -- 172.21.15.77:0/1376504448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a940b1fc0 msgr2=0x7f5a94144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a98be3640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a940b1fc0 0x7f5a94144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a98be3640 1 -- 172.21.15.77:0/1376504448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a80003970 msgr2=0x7f5a941f6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a98be3640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a80003970 0x7f5a941f6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a98be3640 1 -- 172.21.15.77:0/1376504448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a94143a50 con 0x7f5a940ad5a0 2023-11-26T07:23:16.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a993e4640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a80003970 0x7f5a941f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:16.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.057+0000 7f5a99be5640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a940b1fc0 0x7f5a94144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:16.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.058+0000 7f5a98be3640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a940ad5a0 0x7f5a940cd410 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400e7c0 tx=0x7f5a8400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:16.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.058+0000 7f5a89ffb640 1 -- 172.21.15.77:0/1376504448 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400eed0 con 0x7f5a940ad5a0 2023-11-26T07:23:16.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.058+0000 7f5a89ffb640 1 -- 172.21.15.77:0/1376504448 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8400c940 con 0x7f5a940ad5a0 2023-11-26T07:23:16.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.058+0000 7f5a89ffb640 1 -- 172.21.15.77:0/1376504448 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400ccf0 con 0x7f5a940ad5a0 2023-11-26T07:23:16.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.058+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/1376504448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a940ada00 con 0x7f5a940ad5a0 2023-11-26T07:23:16.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.058+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/1376504448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a940cd950 con 0x7f5a940ad5a0 2023-11-26T07:23:16.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.059+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/1376504448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9406d450 con 0x7f5a940ad5a0 2023-11-26T07:23:16.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.060+0000 7f5a89ffb640 1 -- 172.21.15.77:0/1376504448 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f5a84013470 con 0x7f5a940ad5a0 2023-11-26T07:23:16.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.061+0000 7f5a89ffb640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5a7806b6e0 0x7f5a7806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.061+0000 7f5a89ffb640 1 -- 172.21.15.77:0/1376504448 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a840880b0 con 0x7f5a940ad5a0 2023-11-26T07:23:16.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.061+0000 7f5a993e4640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5a7806b6e0 0x7f5a7806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.062+0000 7f5a993e4640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5a7806b6e0 0x7f5a7806dba0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5a90034000 tx=0x7f5a90037040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:16.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.066+0000 7f5a89ffb640 1 -- 172.21.15.77:0/1376504448 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a84054a40 con 0x7f5a940ad5a0 2023-11-26T07:23:16.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.255+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/1376504448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5a9404e840 con 0x7f5a940ad5a0 2023-11-26T07:23:16.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.256+0000 7f5a89ffb640 1 -- 172.21.15.77:0/1376504448 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5a84058060 con 0x7f5a940ad5a0 2023-11-26T07:23:16.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.258+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/1376504448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5a7806b6e0 msgr2=0x7f5a7806dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.258+0000 7f5a9a3e6640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5a7806b6e0 0x7f5a7806dba0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5a90034000 tx=0x7f5a90037040 comp rx=0 tx=0).stop 2023-11-26T07:23:16.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.258+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/1376504448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a940ad5a0 msgr2=0x7f5a940cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.258+0000 7f5a9a3e6640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a940ad5a0 0x7f5a940cd410 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400e7c0 tx=0x7f5a8400ec80 comp rx=0 tx=0).stop 2023-11-26T07:23:16.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.258+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/1376504448 shutdown_connections 2023-11-26T07:23:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.258+0000 7f5a9a3e6640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5a7806b6e0 0x7f5a7806dba0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.258+0000 7f5a9a3e6640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a940b1fc0 0x7f5a94144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.258+0000 7f5a9a3e6640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a940ad5a0 0x7f5a940cd410 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.258+0000 7f5a9a3e6640 1 --2- 172.21.15.77:0/1376504448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a80003970 0x7f5a941f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.258+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/1376504448 >> 172.21.15.77:0/1376504448 conn(0x7f5a9406a500 msgr2=0x7f5a9406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.259+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/1376504448 shutdown_connections 2023-11-26T07:23:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.259+0000 7f5a9a3e6640 1 -- 172.21.15.77:0/1376504448 wait complete. 2023-11-26T07:23:16.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol55430 --mode=777 2023-11-26T07:23:16.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.497+0000 7f0d68d48640 1 Processor -- start 2023-11-26T07:23:16.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.498+0000 7f0d68d48640 1 -- start start 2023-11-26T07:23:16.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.499+0000 7f0d68d48640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0d6415c7f0 0x7f0d6406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.499+0000 7f0d68d48640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640ce6c0 0x7f0d640cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.499+0000 7f0d68d48640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d640cece0 con 0x7f0d640cf450 2023-11-26T07:23:16.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.499+0000 7f0d68d48640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d640cfe40 con 0x7f0d6415c7f0 2023-11-26T07:23:16.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.499+0000 7f0d68d48640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d64156010 con 0x7f0d640ce6c0 2023-11-26T07:23:16.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.499+0000 7f0d61d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0d640cf450 0x7f0d640cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36214/0 (socket says 172.21.15.77:36214) 2023-11-26T07:23:16.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.499+0000 7f0d61d9b640 1 -- 172.21.15.77:0/124377619 learned_addr learned my addr 172.21.15.77:0/124377619 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:16.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.500+0000 7f0d6259c640 1 --2- 172.21.15.77:0/124377619 >> v2:172.21.15.159:3300/0 conn(0x7f0d6415c7f0 0x7f0d6406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.500+0000 7f0d62d9d640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640ce6c0 0x7f0d640cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.500+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584305072 0 0) 0x7f0d640cece0 con 0x7f0d640cf450 2023-11-26T07:23:16.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.500+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d50003520 con 0x7f0d640cf450 2023-11-26T07:23:16.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.500+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2301820503 0 0) 0x7f0d50003520 con 0x7f0d640cf450 2023-11-26T07:23:16.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.500+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640ce6c0 msgr2=0x7f0d640cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.500+0000 7f0d6159a640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640ce6c0 0x7f0d640cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.500+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 >> v2:172.21.15.159:3300/0 conn(0x7f0d6415c7f0 msgr2=0x7f0d6406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.500+0000 7f0d6159a640 1 --2- 172.21.15.77:0/124377619 >> v2:172.21.15.159:3300/0 conn(0x7f0d6415c7f0 0x7f0d6406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.500+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6406d040 con 0x7f0d640cf450 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.500+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f0d540019f0 con 0x7f0d640cf450 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 >> v1:172.21.15.77:6789/0 conn(0x7f0d640cf450 legacy=0x7f0d640cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d6159a640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640ce6c0 0x7f0d50003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d6159a640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 0x7f0d500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d6159a640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d50004d00 0x7f0d50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640cfe40 con 0x7f0d50003ef0 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d64156010 con 0x7f0d50004d00 2023-11-26T07:23:16.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5000b980 con 0x7f0d640ce6c0 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d61d9b640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 0x7f0d500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d6259c640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640ce6c0 0x7f0d50003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d62d9d640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d50004d00 0x7f0d50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d61d9b640 1 -- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640ce6c0 msgr2=0x7f0d50003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d61d9b640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640ce6c0 0x7f0d50003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d61d9b640 1 -- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d50004d00 msgr2=0x7f0d50005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d61d9b640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d50004d00 0x7f0d50005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d61d9b640 1 -- 172.21.15.77:0/124377619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50003520 con 0x7f0d50003ef0 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.501+0000 7f0d62d9d640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d50004d00 0x7f0d50005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.503+0000 7f0d61d9b640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 0x7f0d500047c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400a8d0 tx=0x7f0d500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafe515bb1286598 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.503+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54034630 con 0x7f0d50003ef0 2023-11-26T07:23:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.503+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5402f070 con 0x7f0d50003ef0 2023-11-26T07:23:16.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.503+0000 7f0d6159a640 1 -- 172.21.15.77:0/124377619 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540349d0 con 0x7f0d50003ef0 2023-11-26T07:23:16.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.503+0000 7f0d68d48640 1 -- 172.21.15.77:0/124377619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 msgr2=0x7f0d500047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.503+0000 7f0d68d48640 1 --2- 172.21.15.77:0/124377619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 0x7f0d500047c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400a8d0 tx=0x7f0d500057f0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.503+0000 7f0d62d9d640 1 -- 172.21.15.77:0/124377619 reap_dead start 2023-11-26T07:23:16.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.503+0000 7f0d68d48640 1 -- 172.21.15.77:0/124377619 shutdown_connections 2023-11-26T07:23:16.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.503+0000 7f0d68d48640 1 -- 172.21.15.77:0/124377619 >> 172.21.15.77:0/124377619 conn(0x7f0d6406a920 msgr2=0x7f0d6406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:16.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.504+0000 7f0d68d48640 1 -- 172.21.15.77:0/124377619 shutdown_connections 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.504+0000 7f0d68d48640 1 -- 172.21.15.77:0/124377619 wait complete. 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.505+0000 7f0d68d48640 1 Processor -- start 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.505+0000 7f0d68d48640 1 -- start start 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.506+0000 7f0d68d48640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 0x7f0d641528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.506+0000 7f0d68d48640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640b2e60 0x7f0d640adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.506+0000 7f0d68d48640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d640ae170 0x7f0d64071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.506+0000 7f0d68d48640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640b2a40 con 0x7f0d50003ef0 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.506+0000 7f0d68d48640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640b20e0 con 0x7f0d640ae170 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.506+0000 7f0d68d48640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640ae6d0 con 0x7f0d640b2e60 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.507+0000 7f0d6259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 0x7f0d641528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.507+0000 7f0d6259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 0x7f0d641528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54266/0 (socket says 172.21.15.77:54266) 2023-11-26T07:23:16.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.507+0000 7f0d6259c640 1 -- 172.21.15.77:0/2839602307 learned_addr learned my addr 172.21.15.77:0/2839602307 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.507+0000 7f0d6259c640 1 -- 172.21.15.77:0/2839602307 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640b2e60 msgr2=0x7f0d640adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.507+0000 7f0d6259c640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640b2e60 0x7f0d640adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.507+0000 7f0d6259c640 1 -- 172.21.15.77:0/2839602307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d640ae170 msgr2=0x7f0d64071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.507+0000 7f0d6259c640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d640ae170 0x7f0d64071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.507+0000 7f0d6259c640 1 -- 172.21.15.77:0/2839602307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640b2380 con 0x7f0d50003ef0 2023-11-26T07:23:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.507+0000 7f0d6259c640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 0x7f0d641528b0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0116d0 tx=0x7f0d4c011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.508+0000 7f0d5affd640 1 -- 172.21.15.77:0/2839602307 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00f9c0 con 0x7f0d50003ef0 2023-11-26T07:23:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.508+0000 7f0d5affd640 1 -- 172.21.15.77:0/2839602307 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c00fb20 con 0x7f0d50003ef0 2023-11-26T07:23:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.508+0000 7f0d68d48640 1 -- 172.21.15.77:0/2839602307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d640b2660 con 0x7f0d50003ef0 2023-11-26T07:23:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.508+0000 7f0d5affd640 1 -- 172.21.15.77:0/2839602307 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00fe90 con 0x7f0d50003ef0 2023-11-26T07:23:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.508+0000 7f0d68d48640 1 -- 172.21.15.77:0/2839602307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d640cbf40 con 0x7f0d50003ef0 2023-11-26T07:23:16.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.509+0000 7f0d68d48640 1 -- 172.21.15.77:0/2839602307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d64067470 con 0x7f0d50003ef0 2023-11-26T07:23:16.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.510+0000 7f0d5affd640 1 -- 172.21.15.77:0/2839602307 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f0d4c015460 con 0x7f0d50003ef0 2023-11-26T07:23:16.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.511+0000 7f0d5affd640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0d4406b6e0 0x7f0d4406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.512+0000 7f0d5affd640 1 -- 172.21.15.77:0/2839602307 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d4c088900 con 0x7f0d50003ef0 2023-11-26T07:23:16.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.512+0000 7f0d61d9b640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0d4406b6e0 0x7f0d4406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.512+0000 7f0d61d9b640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0d4406b6e0 0x7f0d4406dba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0d54034000 tx=0x7f0d54007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:16.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.516+0000 7f0d5affd640 1 -- 172.21.15.77:0/2839602307 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d4c055290 con 0x7f0d50003ef0 2023-11-26T07:23:16.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.730+0000 7f0d68d48640 1 -- 172.21.15.77:0/2839602307 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol55430", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d6406e060 con 0x7f0d4406b6e0 2023-11-26T07:23:16.740 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:16.738+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:16.740 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:16.738+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:16.740 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:16.738+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:16.740 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:16.738+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:16.740 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:16.738+0000 7f59b2df8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:16.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.779+0000 7f0d5affd640 1 -- 172.21.15.77:0/2839602307 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0d540018d0 con 0x7f0d4406b6e0 2023-11-26T07:23:16.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 -- 172.21.15.77:0/2839602307 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0d4406b6e0 msgr2=0x7f0d4406dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0d4406b6e0 0x7f0d4406dba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0d54034000 tx=0x7f0d54007000 comp rx=0 tx=0).stop 2023-11-26T07:23:16.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 -- 172.21.15.77:0/2839602307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 msgr2=0x7f0d641528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 0x7f0d641528b0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0116d0 tx=0x7f0d4c011b90 comp rx=0 tx=0).stop 2023-11-26T07:23:16.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 -- 172.21.15.77:0/2839602307 shutdown_connections 2023-11-26T07:23:16.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0d4406b6e0 0x7f0d4406dba0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d640ae170 0x7f0d64071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d640b2e60 0x7f0d640adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 --2- 172.21.15.77:0/2839602307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d50003ef0 0x7f0d641528b0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 -- 172.21.15.77:0/2839602307 >> 172.21.15.77:0/2839602307 conn(0x7f0d6406a920 msgr2=0x7f0d6415eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:16.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 -- 172.21.15.77:0/2839602307 shutdown_connections 2023-11-26T07:23:16.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.782+0000 7f0d68d48640 1 -- 172.21.15.77:0/2839602307 wait complete. 2023-11-26T07:23:16.802 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol55430 2023-11-26T07:23:16.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.991+0000 7f40a3209640 1 Processor -- start 2023-11-26T07:23:16.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.991+0000 7f40a3209640 1 -- start start 2023-11-26T07:23:16.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.993+0000 7f40a3209640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f409c0cc0f0 0x7f409c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.993+0000 7f40a3209640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f409c0c57e0 0x7f409c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.993+0000 7f40a3209640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f409c15eea0 con 0x7f409c15b440 2023-11-26T07:23:16.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.993+0000 7f40a3209640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409c15b820 con 0x7f409c0c57e0 2023-11-26T07:23:16.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.993+0000 7f40a3209640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409c0abf30 con 0x7f409c0cc0f0 2023-11-26T07:23:16.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.993+0000 7f40a17a6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f409c0c57e0 0x7f409c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.993+0000 7f40a17a6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f409c0c57e0 0x7f409c06c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54274/0 (socket says 172.21.15.77:54274) 2023-11-26T07:23:16.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.993+0000 7f40a17a6640 1 -- 172.21.15.77:0/2470914937 learned_addr learned my addr 172.21.15.77:0/2470914937 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:16.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.993+0000 7f40a17a6640 1 -- 172.21.15.77:0/2470914937 >> v2:172.21.15.159:3300/0 conn(0x7f409c0cc0f0 msgr2=0x7f409c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:16.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.993+0000 7f40a17a6640 1 --2- 172.21.15.77:0/2470914937 >> v2:172.21.15.159:3300/0 conn(0x7f409c0cc0f0 0x7f409c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.993+0000 7f40a17a6640 1 -- 172.21.15.77:0/2470914937 >> v1:172.21.15.159:6789/0 conn(0x7f409c15b440 legacy=0x7f409c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:16.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.994+0000 7f40a17a6640 1 -- 172.21.15.77:0/2470914937 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c15f0f0 con 0x7f409c0c57e0 2023-11-26T07:23:16.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.995+0000 7f40a17a6640 1 --2- 172.21.15.77:0/2470914937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409c0c57e0 0x7f409c06c5f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f409c06e720 tx=0x7f409402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a161a9539ff40a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:16.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.995+0000 7f409b7fe640 1 -- 172.21.15.77:0/2470914937 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409402c9f0 con 0x7f409c0c57e0 2023-11-26T07:23:16.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.995+0000 7f409b7fe640 1 -- 172.21.15.77:0/2470914937 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409402cb50 con 0x7f409c0c57e0 2023-11-26T07:23:16.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.995+0000 7f409b7fe640 1 -- 172.21.15.77:0/2470914937 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940343f0 con 0x7f409c0c57e0 2023-11-26T07:23:16.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.996+0000 7f40a3209640 1 -- 172.21.15.77:0/2470914937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409c0c57e0 msgr2=0x7f409c06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.996+0000 7f40a3209640 1 --2- 172.21.15.77:0/2470914937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409c0c57e0 0x7f409c06c5f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f409c06e720 tx=0x7f409402be50 comp rx=0 tx=0).stop 2023-11-26T07:23:16.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.996+0000 7f40a3209640 1 -- 172.21.15.77:0/2470914937 shutdown_connections 2023-11-26T07:23:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.996+0000 7f40a3209640 1 --2- 172.21.15.77:0/2470914937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409c0c57e0 0x7f409c06c5f0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.996+0000 7f40a3209640 1 --2- 172.21.15.77:0/2470914937 >> v2:172.21.15.159:3300/0 conn(0x7f409c0cc0f0 0x7f409c0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.996+0000 7f40a3209640 1 -- 172.21.15.77:0/2470914937 >> 172.21.15.77:0/2470914937 conn(0x7f409c0b0c50 msgr2=0x7f409c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.996+0000 7f40a3209640 1 -- 172.21.15.77:0/2470914937 shutdown_connections 2023-11-26T07:23:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.996+0000 7f40a3209640 1 -- 172.21.15.77:0/2470914937 wait complete. 2023-11-26T07:23:17.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.998+0000 7f40a3209640 1 Processor -- start 2023-11-26T07:23:17.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.998+0000 7f40a3209640 1 -- start start 2023-11-26T07:23:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a3209640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409c0c57e0 0x7f409c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a3209640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f409c0cc0f0 0x7f409c154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a3209640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f409c15b440 0x7f409c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a3209640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c15c970 con 0x7f409c0c57e0 2023-11-26T07:23:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a3209640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c1551b0 con 0x7f409c15b440 2023-11-26T07:23:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a3209640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409c15a910 con 0x7f409c0cc0f0 2023-11-26T07:23:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a0fa5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409c0c57e0 0x7f409c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a0fa5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409c0c57e0 0x7f409c15e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54278/0 (socket says 172.21.15.77:54278) 2023-11-26T07:23:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a0fa5640 1 -- 172.21.15.77:0/3290700882 learned_addr learned my addr 172.21.15.77:0/3290700882 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:17.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a0fa5640 1 -- 172.21.15.77:0/3290700882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f409c0cc0f0 msgr2=0x7f409c154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:17.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a17a6640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f409c15b440 0x7f409c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:17.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a0fa5640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f409c0cc0f0 0x7f409c154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:17.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a0fa5640 1 -- 172.21.15.77:0/3290700882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f409c15b440 msgr2=0x7f409c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:17.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:16.999+0000 7f40a0fa5640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f409c15b440 0x7f409c15a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:17.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.000+0000 7f40a0fa5640 1 -- 172.21.15.77:0/3290700882 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4094009b30 con 0x7f409c0c57e0 2023-11-26T07:23:17.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.000+0000 7f40a0fa5640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409c0c57e0 0x7f409c15e180 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f409000b410 tx=0x7f409000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.000+0000 7f40997fa640 1 -- 172.21.15.77:0/3290700882 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090011830 con 0x7f409c0c57e0 2023-11-26T07:23:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.000+0000 7f40997fa640 1 -- 172.21.15.77:0/3290700882 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4090011990 con 0x7f409c0c57e0 2023-11-26T07:23:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.000+0000 7f40997fa640 1 -- 172.21.15.77:0/3290700882 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090011d40 con 0x7f409c0c57e0 2023-11-26T07:23:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.000+0000 7f40a3209640 1 -- 172.21.15.77:0/3290700882 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409c15a6e0 con 0x7f409c0c57e0 2023-11-26T07:23:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.000+0000 7f40a3209640 1 -- 172.21.15.77:0/3290700882 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409c15c2b0 con 0x7f409c0c57e0 2023-11-26T07:23:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.001+0000 7f40a3209640 1 -- 172.21.15.77:0/3290700882 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409c15cab0 con 0x7f409c0c57e0 2023-11-26T07:23:17.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.003+0000 7f40997fa640 1 -- 172.21.15.77:0/3290700882 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f409001a400 con 0x7f409c0c57e0 2023-11-26T07:23:17.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.004+0000 7f40997fa640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f408006b6b0 0x7f408006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:17.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.004+0000 7f40997fa640 1 -- 172.21.15.77:0/3290700882 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4090088200 con 0x7f409c0c57e0 2023-11-26T07:23:17.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.004+0000 7f409bfff640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f408006b6b0 0x7f408006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.005+0000 7f409bfff640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f408006b6b0 0x7f408006db70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f409c0cf7b0 tx=0x7f4088006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:17.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.008+0000 7f40997fa640 1 -- 172.21.15.77:0/3290700882 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f409c15cab0 con 0x7f409c0c57e0 2023-11-26T07:23:17.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.225+0000 7f40a3209640 1 -- 172.21.15.77:0/3290700882 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol55430", "target": ["mon-mgr", ""]}) v1 -- 0x7f409c15f990 con 0x7f408006b6b0 2023-11-26T07:23:17.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.236+0000 7f40997fa640 1 -- 172.21.15.77:0/3290700882 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7f4088013400 con 0x7f408006b6b0 2023-11-26T07:23:17.238 INFO:teuthology.orchestra.run.smithi077.stdout:/volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c 2023-11-26T07:23:17.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.238+0000 7f40a3209640 1 -- 172.21.15.77:0/3290700882 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f408006b6b0 msgr2=0x7f408006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:17.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.238+0000 7f40a3209640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f408006b6b0 0x7f408006db70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f409c0cf7b0 tx=0x7f4088006c90 comp rx=0 tx=0).stop 2023-11-26T07:23:17.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.238+0000 7f40a3209640 1 -- 172.21.15.77:0/3290700882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409c0c57e0 msgr2=0x7f409c15e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:17.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.238+0000 7f40a3209640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409c0c57e0 0x7f409c15e180 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f409000b410 tx=0x7f409000b8d0 comp rx=0 tx=0).stop 2023-11-26T07:23:17.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.238+0000 7f40a3209640 1 -- 172.21.15.77:0/3290700882 shutdown_connections 2023-11-26T07:23:17.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.238+0000 7f40a3209640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f408006b6b0 0x7f408006db70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:17.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.238+0000 7f40a3209640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f409c15b440 0x7f409c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:17.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.238+0000 7f40a3209640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f409c0cc0f0 0x7f409c154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:17.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.238+0000 7f40a3209640 1 --2- 172.21.15.77:0/3290700882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409c0c57e0 0x7f409c15e180 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:17.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.238+0000 7f40a3209640 1 -- 172.21.15.77:0/3290700882 >> 172.21.15.77:0/3290700882 conn(0x7f409c0b0c50 msgr2=0x7f409c0704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:17.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.239+0000 7f40a3209640 1 -- 172.21.15.77:0/3290700882 shutdown_connections 2023-11-26T07:23:17.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:17.239+0000 7f40a3209640 1 -- 172.21.15.77:0/3290700882 wait complete. 2023-11-26T07:23:17.258 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol55430 with 200 files each 1MB size under directory volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c 2023-11-26T07:23:17.258 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:17.258 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:17.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.308 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:17.455 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:17.455 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:17.455 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0377299 s, 27.8 MB/s 2023-11-26T07:23:17.457 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:17.457 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:17.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.507 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:17.640 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:17.640 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:17.640 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344485 s, 30.4 MB/s 2023-11-26T07:23:17.642 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:17.642 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:17.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.701 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:17.784 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:17.784 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:17.784 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279428 s, 37.5 MB/s 2023-11-26T07:23:17.786 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:17.786 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:17.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.845 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:17.923 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:17.924 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:17.924 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242324 s, 43.3 MB/s 2023-11-26T07:23:17.925 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:17.925 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:17.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.984 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:18.064 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:18.064 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:18.064 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257781 s, 40.7 MB/s 2023-11-26T07:23:18.066 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:18.066 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:18.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:18.123 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:18.202 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:18.203 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:18.203 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268055 s, 39.1 MB/s 2023-11-26T07:23:18.205 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:18.205 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:18.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:18.262 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:18.342 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:18.342 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:18.342 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273513 s, 38.3 MB/s 2023-11-26T07:23:18.343 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:18.344 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:18.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:18.401 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:18.476 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:18.476 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:18.476 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258942 s, 40.5 MB/s 2023-11-26T07:23:18.478 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:18.478 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:18.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:18.530 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:18.652 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:18.653 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:18.653 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247587 s, 42.4 MB/s 2023-11-26T07:23:18.654 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:18.654 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:18.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:18.712 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:18.798 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:18.798 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:18.798 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294681 s, 35.6 MB/s 2023-11-26T07:23:18.799 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:18.799 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:18.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:18.857 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:18.939 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:18.939 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:18.939 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267018 s, 39.3 MB/s 2023-11-26T07:23:18.941 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:18.941 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:18.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:18.995 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:19.060 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:19.060 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:19.060 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167389 s, 62.6 MB/s 2023-11-26T07:23:19.061 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:19.061 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:19.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:19.116 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:19.192 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:19.192 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:19.192 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251197 s, 41.7 MB/s 2023-11-26T07:23:19.193 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:19.194 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:19.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:19.248 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:19.323 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:19.323 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:19.324 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228922 s, 45.8 MB/s 2023-11-26T07:23:19.325 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:19.325 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:19.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:19.383 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:19.454 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:19.454 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:19.454 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201533 s, 52.0 MB/s 2023-11-26T07:23:19.456 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:19.456 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:19.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:19.513 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:19.587 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:19.588 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:19.588 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234862 s, 44.6 MB/s 2023-11-26T07:23:19.589 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:19.589 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:19.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:19.642 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:19.708 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:19.708 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:19.709 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199152 s, 52.7 MB/s 2023-11-26T07:23:19.710 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:19.710 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:19.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:19.759 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:19.889 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:19.889 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:19.890 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274213 s, 38.2 MB/s 2023-11-26T07:23:19.891 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:19.891 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:19.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:19.949 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:20.031 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:20.032 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:20.032 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282516 s, 37.1 MB/s 2023-11-26T07:23:20.033 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:20.033 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:20.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:20.090 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:20.181 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0407521 s, 25.7 MB/s 2023-11-26T07:23:20.183 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:20.183 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:20.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:20.239 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:20.326 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328637 s, 31.9 MB/s 2023-11-26T07:23:20.328 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:20.328 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:20.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:20.384 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:20.457 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:20.457 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:20.457 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02243 s, 46.7 MB/s 2023-11-26T07:23:20.459 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:20.459 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:20.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:20.514 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:20.592 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:20.619 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:20.619 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244721 s, 42.8 MB/s 2023-11-26T07:23:20.620 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:20.620 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:20.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:20.682 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:20.768 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:20.768 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:20.769 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228707 s, 45.8 MB/s 2023-11-26T07:23:20.770 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:20.770 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:20.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:20.826 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:20.905 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:20.905 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:20.905 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253567 s, 41.4 MB/s 2023-11-26T07:23:20.907 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:20.907 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:20.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:20.966 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.041 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:21.041 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:21.041 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232418 s, 45.1 MB/s 2023-11-26T07:23:21.043 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:21.043 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.099 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188133 s, 55.7 MB/s 2023-11-26T07:23:21.169 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:21.169 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.225 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.299 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:21.299 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:21.299 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207871 s, 50.4 MB/s 2023-11-26T07:23:21.301 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:21.301 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.355 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.431 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:21.431 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:21.431 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225591 s, 46.5 MB/s 2023-11-26T07:23:21.434 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:21.434 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.490 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.564 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:21.564 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:21.564 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216833 s, 48.4 MB/s 2023-11-26T07:23:21.566 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:21.566 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.621 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.701 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:21.701 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:21.701 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265146 s, 39.5 MB/s 2023-11-26T07:23:21.703 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:21.703 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.757 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.827 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:21.827 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:21.827 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197357 s, 53.1 MB/s 2023-11-26T07:23:21.828 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:21.828 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.880 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.959 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:21.959 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:21.960 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271332 s, 38.6 MB/s 2023-11-26T07:23:21.961 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:21.961 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.014 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.138 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:22.138 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:22.138 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237996 s, 44.1 MB/s 2023-11-26T07:23:22.140 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:22.140 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.193 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.266 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:22.266 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:22.266 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197708 s, 53.0 MB/s 2023-11-26T07:23:22.267 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:22.267 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.319 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.443 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:22.443 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:22.443 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238549 s, 44.0 MB/s 2023-11-26T07:23:22.445 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:22.445 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.501 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.575 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:22.575 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:22.575 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229516 s, 45.7 MB/s 2023-11-26T07:23:22.577 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:22.577 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.631 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:22.700 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:22.700 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186197 s, 56.3 MB/s 2023-11-26T07:23:22.701 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:22.701 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.757 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.830 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:22.830 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:22.830 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204861 s, 51.2 MB/s 2023-11-26T07:23:22.831 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:22.831 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.881 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.952 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:22.952 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:22.952 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236441 s, 44.3 MB/s 2023-11-26T07:23:22.953 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:22.953 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.010 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.097 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:23.097 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:23.097 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337127 s, 31.1 MB/s 2023-11-26T07:23:23.099 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:23.099 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.157 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.233 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:23.233 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:23.233 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201204 s, 52.1 MB/s 2023-11-26T07:23:23.235 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:23.235 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.290 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.365 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:23.365 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:23.365 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230078 s, 45.6 MB/s 2023-11-26T07:23:23.366 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:23.367 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.424 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.505 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:23.505 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:23.505 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266005 s, 39.4 MB/s 2023-11-26T07:23:23.506 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:23.506 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.563 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.647 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:23.647 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:23.647 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313591 s, 33.4 MB/s 2023-11-26T07:23:23.648 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:23.648 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.707 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.788 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:23.788 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:23.788 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280782 s, 37.3 MB/s 2023-11-26T07:23:23.790 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:23.790 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.848 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.924 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:23.925 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236722 s, 44.3 MB/s 2023-11-26T07:23:23.927 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:23.927 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.986 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.061 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:24.061 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:24.061 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212657 s, 49.3 MB/s 2023-11-26T07:23:24.063 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:24.063 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.113 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.236 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:24.237 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:24.237 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231909 s, 45.2 MB/s 2023-11-26T07:23:24.238 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:24.238 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.291 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.366 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:24.366 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:24.366 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207726 s, 50.5 MB/s 2023-11-26T07:23:24.368 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:24.368 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.423 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.501 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:24.502 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:24.502 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238822 s, 43.9 MB/s 2023-11-26T07:23:24.503 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:24.503 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.560 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.633 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:24.633 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:24.633 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218729 s, 47.9 MB/s 2023-11-26T07:23:24.635 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:24.635 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.683 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.811 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:24.811 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:24.811 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284964 s, 36.8 MB/s 2023-11-26T07:23:24.813 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:24.813 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.868 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.942 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:24.942 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:24.942 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02343 s, 44.8 MB/s 2023-11-26T07:23:24.943 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:24.943 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.993 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.069 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:25.069 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:25.069 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244442 s, 42.9 MB/s 2023-11-26T07:23:25.071 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:25.071 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.127 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.200 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:25.200 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:25.200 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205846 s, 50.9 MB/s 2023-11-26T07:23:25.202 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:25.202 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.260 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.335 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:25.335 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:25.335 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197683 s, 53.0 MB/s 2023-11-26T07:23:25.335 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:25.336 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.391 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263623 s, 39.8 MB/s 2023-11-26T07:23:25.473 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:25.473 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.525 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.598 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225337 s, 46.5 MB/s 2023-11-26T07:23:25.600 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:25.600 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.656 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.736 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:25.737 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:25.737 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306515 s, 34.2 MB/s 2023-11-26T07:23:25.738 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:25.738 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.793 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.873 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:25.873 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:25.873 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253707 s, 41.3 MB/s 2023-11-26T07:23:25.875 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:25.875 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.934 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.015 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:26.015 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:26.015 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306738 s, 34.2 MB/s 2023-11-26T07:23:26.017 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:26.017 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.067 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.199 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:26.199 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:26.200 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252552 s, 41.5 MB/s 2023-11-26T07:23:26.201 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:26.202 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.262 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.339 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:26.339 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:26.339 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217976 s, 48.1 MB/s 2023-11-26T07:23:26.341 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:26.341 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.398 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0369469 s, 28.4 MB/s 2023-11-26T07:23:26.493 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:26.493 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.547 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.621 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:26.621 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:26.621 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231711 s, 45.3 MB/s 2023-11-26T07:23:26.623 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:26.623 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.681 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.767 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:26.768 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:26.768 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284595 s, 36.8 MB/s 2023-11-26T07:23:26.769 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:26.769 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.824 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.902 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:26.903 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:26.903 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243859 s, 43.0 MB/s 2023-11-26T07:23:26.904 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:26.904 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.963 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.044 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:27.044 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:27.044 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242126 s, 43.3 MB/s 2023-11-26T07:23:27.046 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:27.046 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.105 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.182 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:27.182 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:27.182 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219399 s, 47.8 MB/s 2023-11-26T07:23:27.183 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:27.183 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.240 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.315 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:27.315 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:27.315 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233024 s, 45.0 MB/s 2023-11-26T07:23:27.316 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:27.316 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.374 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.454 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:27.454 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:27.455 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267184 s, 39.2 MB/s 2023-11-26T07:23:27.456 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:27.456 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.515 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.596 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:27.596 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:27.596 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259002 s, 40.5 MB/s 2023-11-26T07:23:27.598 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:27.598 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.657 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.730 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:27.730 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:27.730 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222981 s, 47.0 MB/s 2023-11-26T07:23:27.731 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:27.731 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.784 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.854 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:27.854 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:27.855 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214464 s, 48.9 MB/s 2023-11-26T07:23:27.856 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:27.856 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.907 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.977 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:27.977 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:27.978 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200642 s, 52.3 MB/s 2023-11-26T07:23:27.979 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:27.979 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.037 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346243 s, 30.3 MB/s 2023-11-26T07:23:28.128 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:28.128 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.147 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:23:28.184 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:23:28.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.186 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.291 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:28.291 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:28.291 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180111 s, 58.2 MB/s 2023-11-26T07:23:28.293 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:28.293 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.389 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.470 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:28.471 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:28.471 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269189 s, 39.0 MB/s 2023-11-26T07:23:28.472 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:28.472 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.530 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205606 s, 51.0 MB/s 2023-11-26T07:23:28.604 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:28.604 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.656 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.726 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:28.726 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:28.726 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198782 s, 52.8 MB/s 2023-11-26T07:23:28.728 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:28.728 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.779 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.845 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:28.845 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:28.845 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015254 s, 68.7 MB/s 2023-11-26T07:23:28.846 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:28.847 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.902 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.976 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:28.977 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:28.977 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227156 s, 46.2 MB/s 2023-11-26T07:23:28.979 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:28.979 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.038 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.110 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:29.110 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:29.110 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216926 s, 48.3 MB/s 2023-11-26T07:23:29.111 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:29.111 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.169 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.242 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:29.242 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:29.242 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217882 s, 48.1 MB/s 2023-11-26T07:23:29.244 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:29.244 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.301 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276532 s, 37.9 MB/s 2023-11-26T07:23:29.385 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:29.385 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.444 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.520 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:29.520 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:29.520 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238476 s, 44.0 MB/s 2023-11-26T07:23:29.522 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:29.522 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.578 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.664 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:29.664 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:29.665 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293232 s, 35.8 MB/s 2023-11-26T07:23:29.666 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:29.666 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.722 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.795 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:29.796 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:29.796 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218423 s, 48.0 MB/s 2023-11-26T07:23:29.797 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:29.797 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.852 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.931 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:29.932 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:29.932 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269484 s, 38.9 MB/s 2023-11-26T07:23:29.933 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:29.933 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.988 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.064 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:30.064 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:30.064 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023739 s, 44.2 MB/s 2023-11-26T07:23:30.066 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:30.066 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.121 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.194 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:30.194 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204068 s, 51.4 MB/s 2023-11-26T07:23:30.196 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:30.196 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.251 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.334 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:30.334 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:30.334 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297009 s, 35.3 MB/s 2023-11-26T07:23:30.336 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:30.336 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.393 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.469 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:30.470 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:30.470 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229968 s, 45.6 MB/s 2023-11-26T07:23:30.472 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:30.472 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.529 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.606 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:30.606 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:30.606 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235854 s, 44.5 MB/s 2023-11-26T07:23:30.607 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:30.607 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.663 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.737 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:30.737 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:30.737 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222987 s, 47.0 MB/s 2023-11-26T07:23:30.739 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:30.739 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.799 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.881 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:30.881 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:30.881 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028176 s, 37.2 MB/s 2023-11-26T07:23:30.883 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:30.883 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.939 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.015 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:31.015 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:31.015 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240215 s, 43.7 MB/s 2023-11-26T07:23:31.017 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:31.017 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.072 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.151 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:31.151 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:31.151 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216829 s, 48.4 MB/s 2023-11-26T07:23:31.153 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:31.153 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.211 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172867 s, 60.7 MB/s 2023-11-26T07:23:31.283 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:31.283 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.331 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.465 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:31.466 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:31.466 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334287 s, 31.4 MB/s 2023-11-26T07:23:31.467 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:31.467 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.523 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.601 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:31.601 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257076 s, 40.8 MB/s 2023-11-26T07:23:31.603 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:31.603 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.658 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.727 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:31.727 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:31.727 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171114 s, 61.3 MB/s 2023-11-26T07:23:31.728 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:31.728 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.778 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.904 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:31.905 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:31.905 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256493 s, 40.9 MB/s 2023-11-26T07:23:31.906 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:31.907 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.964 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.041 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:32.041 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:32.041 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226806 s, 46.2 MB/s 2023-11-26T07:23:32.043 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:32.043 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.099 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.175 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:32.175 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:32.175 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233391 s, 44.9 MB/s 2023-11-26T07:23:32.176 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:32.177 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.233 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.313 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:32.313 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:32.313 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235253 s, 44.6 MB/s 2023-11-26T07:23:32.314 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:32.314 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.373 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.455 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:32.455 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:32.455 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286376 s, 36.6 MB/s 2023-11-26T07:23:32.457 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:32.457 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.517 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.595 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:32.595 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:32.595 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254534 s, 41.2 MB/s 2023-11-26T07:23:32.597 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:32.597 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.651 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.729 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:32.729 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:32.729 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228021 s, 46.0 MB/s 2023-11-26T07:23:32.731 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:32.731 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.788 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217822 s, 48.1 MB/s 2023-11-26T07:23:32.866 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:32.866 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.922 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.002 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:33.002 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:33.002 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228318 s, 45.9 MB/s 2023-11-26T07:23:33.004 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:33.004 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.063 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.144 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:33.144 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:33.145 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256618 s, 40.9 MB/s 2023-11-26T07:23:33.146 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:33.146 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.205 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.284 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:33.284 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:33.284 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024892 s, 42.1 MB/s 2023-11-26T07:23:33.286 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:33.286 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.343 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.420 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:33.420 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:33.420 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258608 s, 40.5 MB/s 2023-11-26T07:23:33.422 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:33.422 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.479 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.563 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:33.563 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:33.563 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290209 s, 36.1 MB/s 2023-11-26T07:23:33.564 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:33.565 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.620 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.692 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:33.692 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:33.692 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207294 s, 50.6 MB/s 2023-11-26T07:23:33.694 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:33.694 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.750 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.823 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:33.823 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:33.823 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219583 s, 47.8 MB/s 2023-11-26T07:23:33.824 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:33.825 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.877 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.000 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:34.000 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:34.000 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202754 s, 51.7 MB/s 2023-11-26T07:23:34.002 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:34.002 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.058 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236902 s, 44.3 MB/s 2023-11-26T07:23:34.141 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:34.141 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.199 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.272 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:34.272 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:34.273 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216374 s, 48.5 MB/s 2023-11-26T07:23:34.274 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:34.274 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.331 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307209 s, 34.1 MB/s 2023-11-26T07:23:34.416 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:34.417 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.472 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.549 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:34.549 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:34.550 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236697 s, 44.3 MB/s 2023-11-26T07:23:34.551 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:34.551 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.606 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.680 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:34.681 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:34.681 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193774 s, 54.1 MB/s 2023-11-26T07:23:34.682 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:34.682 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.735 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.813 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:34.813 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:34.813 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291101 s, 36.0 MB/s 2023-11-26T07:23:34.814 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:34.815 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.868 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.943 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:34.943 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:34.943 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238119 s, 44.0 MB/s 2023-11-26T07:23:34.945 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:34.945 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.001 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.071 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:35.072 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:35.072 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221193 s, 47.4 MB/s 2023-11-26T07:23:35.073 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:35.073 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.125 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.199 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:35.200 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:35.201 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232869 s, 45.0 MB/s 2023-11-26T07:23:35.202 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:35.202 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.256 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.327 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:35.327 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:35.328 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192847 s, 54.4 MB/s 2023-11-26T07:23:35.329 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:35.329 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.387 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.466 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:35.466 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:35.466 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270341 s, 38.8 MB/s 2023-11-26T07:23:35.468 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:35.468 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.524 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.600 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:35.600 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:35.600 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231687 s, 45.3 MB/s 2023-11-26T07:23:35.602 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:35.602 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.658 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.731 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:35.731 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:35.732 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203551 s, 51.5 MB/s 2023-11-26T07:23:35.733 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:35.733 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.791 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203177 s, 51.6 MB/s 2023-11-26T07:23:35.861 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:35.861 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.917 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.989 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:35.989 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:35.989 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221251 s, 47.4 MB/s 2023-11-26T07:23:35.991 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:35.991 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.044 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.111 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:36.111 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:36.111 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193035 s, 54.3 MB/s 2023-11-26T07:23:36.113 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:36.113 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.167 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.246 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:36.246 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:36.246 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265116 s, 39.6 MB/s 2023-11-26T07:23:36.248 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:36.248 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.305 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.382 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:36.382 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:36.382 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240121 s, 43.7 MB/s 2023-11-26T07:23:36.383 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:36.384 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.442 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.522 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:36.522 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:36.522 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261255 s, 40.1 MB/s 2023-11-26T07:23:36.524 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:36.524 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.581 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.653 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:36.653 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:36.653 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191309 s, 54.8 MB/s 2023-11-26T07:23:36.655 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:36.655 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.705 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.780 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:36.780 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:36.780 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252887 s, 41.5 MB/s 2023-11-26T07:23:36.782 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:36.782 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.833 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.910 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:36.910 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:36.910 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238807 s, 43.9 MB/s 2023-11-26T07:23:36.912 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:36.912 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.969 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.049 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:37.049 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:37.049 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255506 s, 41.0 MB/s 2023-11-26T07:23:37.051 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:37.051 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.109 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.183 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:37.183 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:37.183 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207462 s, 50.5 MB/s 2023-11-26T07:23:37.185 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:37.185 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.241 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.322 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:37.322 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:37.322 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262676 s, 39.9 MB/s 2023-11-26T07:23:37.323 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:37.323 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.381 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.457 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:37.457 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:37.457 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231014 s, 45.4 MB/s 2023-11-26T07:23:37.459 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:37.459 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.514 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.587 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:37.587 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:37.587 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232945 s, 45.0 MB/s 2023-11-26T07:23:37.589 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:37.589 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.645 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.727 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:37.727 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:37.727 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303621 s, 34.5 MB/s 2023-11-26T07:23:37.729 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:37.729 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.788 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.868 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:37.868 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:37.868 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250648 s, 41.8 MB/s 2023-11-26T07:23:37.870 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:37.870 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.925 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.001 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:38.001 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:38.001 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209317 s, 50.1 MB/s 2023-11-26T07:23:38.003 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:38.003 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.057 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.126 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:38.126 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:38.126 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198983 s, 52.7 MB/s 2023-11-26T07:23:38.127 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:38.127 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.180 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.257 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:38.257 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:38.257 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249155 s, 42.1 MB/s 2023-11-26T07:23:38.258 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:38.258 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.311 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.382 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:38.382 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:38.382 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194073 s, 54.0 MB/s 2023-11-26T07:23:38.384 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:38.384 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.434 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.556 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:38.557 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:38.557 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200824 s, 52.2 MB/s 2023-11-26T07:23:38.558 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:38.558 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.614 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.685 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:38.685 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:38.685 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199341 s, 52.6 MB/s 2023-11-26T07:23:38.687 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:38.687 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.748 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.828 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:38.828 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:38.828 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248862 s, 42.1 MB/s 2023-11-26T07:23:38.830 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:38.830 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.884 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.953 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:38.954 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:38.954 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196112 s, 53.5 MB/s 2023-11-26T07:23:38.955 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:38.955 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.009 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.081 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:39.081 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:39.081 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02134 s, 49.1 MB/s 2023-11-26T07:23:39.083 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:39.083 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.140 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.222 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:39.222 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:39.222 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274383 s, 38.2 MB/s 2023-11-26T07:23:39.224 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:39.224 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.281 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.365 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:39.365 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:39.365 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02989 s, 35.1 MB/s 2023-11-26T07:23:39.367 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:39.367 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.421 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.495 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:39.496 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240259 s, 43.6 MB/s 2023-11-26T07:23:39.497 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:39.497 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.552 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.629 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:39.630 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:39.630 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223657 s, 46.9 MB/s 2023-11-26T07:23:39.632 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:39.632 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.688 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.761 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:39.761 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:39.761 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234669 s, 44.7 MB/s 2023-11-26T07:23:39.763 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:39.763 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.818 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.892 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:39.893 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:39.893 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223875 s, 46.8 MB/s 2023-11-26T07:23:39.894 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:39.894 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.947 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.023 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:40.023 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:40.023 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242143 s, 43.3 MB/s 2023-11-26T07:23:40.025 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:40.025 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.082 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.160 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:40.160 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:40.160 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236987 s, 44.2 MB/s 2023-11-26T07:23:40.161 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:40.161 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.219 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.295 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:40.295 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:40.295 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021332 s, 49.2 MB/s 2023-11-26T07:23:40.296 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:40.296 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.353 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.432 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:40.432 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:40.433 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02329 s, 45.0 MB/s 2023-11-26T07:23:40.434 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:40.434 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.491 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.566 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:40.566 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:40.566 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188009 s, 55.8 MB/s 2023-11-26T07:23:40.567 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:40.567 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.625 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.702 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:40.702 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:40.702 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192787 s, 54.4 MB/s 2023-11-26T07:23:40.704 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:40.704 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.758 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180291 s, 58.2 MB/s 2023-11-26T07:23:40.831 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:40.831 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.883 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.014 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:41.014 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:41.014 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029177 s, 35.9 MB/s 2023-11-26T07:23:41.016 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:41.016 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.074 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.152 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:41.152 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:41.152 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248377 s, 42.2 MB/s 2023-11-26T07:23:41.154 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:41.154 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.204 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.330 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:41.330 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:41.330 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238309 s, 44.0 MB/s 2023-11-26T07:23:41.332 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:41.332 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.391 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.468 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:41.468 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:41.468 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233998 s, 44.8 MB/s 2023-11-26T07:23:41.470 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:41.470 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.529 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.608 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:41.608 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:41.608 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241414 s, 43.4 MB/s 2023-11-26T07:23:41.610 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:41.610 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.668 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.746 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:41.746 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:41.746 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219547 s, 47.8 MB/s 2023-11-26T07:23:41.747 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:41.747 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.804 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.886 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:41.886 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:41.886 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262654 s, 39.9 MB/s 2023-11-26T07:23:41.888 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:41.888 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.945 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.024 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:42.024 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:42.024 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237845 s, 44.1 MB/s 2023-11-26T07:23:42.025 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:42.025 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.080 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.156 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:42.156 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:42.156 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251437 s, 41.7 MB/s 2023-11-26T07:23:42.157 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:42.158 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.215 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.295 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:42.295 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:42.295 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286433 s, 36.6 MB/s 2023-11-26T07:23:42.297 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:42.297 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.355 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.430 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:42.430 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:42.430 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022978 s, 45.6 MB/s 2023-11-26T07:23:42.431 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:42.431 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.486 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.559 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:42.560 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:42.560 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214669 s, 48.8 MB/s 2023-11-26T07:23:42.561 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:42.561 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.615 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.693 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:42.693 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:42.693 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255141 s, 41.1 MB/s 2023-11-26T07:23:42.695 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:42.695 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.751 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.823 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:42.824 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:42.824 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022103 s, 47.4 MB/s 2023-11-26T07:23:42.825 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:42.825 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.881 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.950 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:42.950 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:42.950 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176459 s, 59.4 MB/s 2023-11-26T07:23:42.951 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:42.952 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.005 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.130 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:43.130 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:43.130 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233624 s, 44.9 MB/s 2023-11-26T07:23:43.131 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:43.131 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.185 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.262 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:43.262 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:43.262 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222034 s, 47.2 MB/s 2023-11-26T07:23:43.264 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:43.264 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.322 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.400 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:43.400 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:43.400 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263994 s, 39.7 MB/s 2023-11-26T07:23:43.402 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:43.402 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.458 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270507 s, 38.8 MB/s 2023-11-26T07:23:43.540 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:43.540 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.597 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.673 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:43.673 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:43.673 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237078 s, 44.2 MB/s 2023-11-26T07:23:43.675 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:43.675 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.734 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.811 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:43.811 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:43.811 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216591 s, 48.4 MB/s 2023-11-26T07:23:43.813 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:43.813 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.867 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.940 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:43.940 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:43.940 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024384 s, 43.0 MB/s 2023-11-26T07:23:43.942 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:43.942 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.997 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.072 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:44.072 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:44.072 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217286 s, 48.3 MB/s 2023-11-26T07:23:44.074 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:44.074 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.127 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.203 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:44.203 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:44.203 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024127 s, 43.5 MB/s 2023-11-26T07:23:44.204 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:44.204 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.261 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.343 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:44.343 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:44.343 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274106 s, 38.3 MB/s 2023-11-26T07:23:44.345 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:44.345 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.399 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.473 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:44.473 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:44.473 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217519 s, 48.2 MB/s 2023-11-26T07:23:44.475 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:44.475 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.529 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.610 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:44.610 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:44.610 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282978 s, 37.1 MB/s 2023-11-26T07:23:44.612 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:44.612 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.671 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.738 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:44.738 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:44.738 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204137 s, 51.4 MB/s 2023-11-26T07:23:44.739 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:44.739 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.796 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.872 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:44.872 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:44.872 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248593 s, 42.2 MB/s 2023-11-26T07:23:44.873 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:23:44.873 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.923 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55430/5f1b9a44-ca70-47cf-bca9-db43049e5d3c/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.995 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-26T07:23:44.995 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-26T07:23:44.996 INFO:teuthology.orchestra.run.smithi077.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226762 s, 46.2 MB/s 2023-11-26T07:23:44.997 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol55430 subvol_snap6600 2023-11-26T07:23:45.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.219+0000 7f06dac15640 1 Processor -- start 2023-11-26T07:23:45.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.219+0000 7f06dac15640 1 -- start start 2023-11-26T07:23:45.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.220+0000 7f06dac15640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f06d4157c70 0x7f06d4161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.220+0000 7f06dac15640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d40ce0b0 con 0x7f06d40cf450 2023-11-26T07:23:45.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.221+0000 7f06dac15640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d4161960 con 0x7f06d415e390 2023-11-26T07:23:45.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.221+0000 7f06dac15640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d415e8d0 con 0x7f06d4157c70 2023-11-26T07:23:45.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.221+0000 7f06d3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f06d40cf450 0x7f06d415dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46828/0 (socket says 172.21.15.77:46828) 2023-11-26T07:23:45.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.221+0000 7f06d3fff640 1 -- 172.21.15.77:0/171922591 learned_addr learned my addr 172.21.15.77:0/171922591 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:45.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.221+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220594196 0 0) 0x7f06d40ce0b0 con 0x7f06d40cf450 2023-11-26T07:23:45.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.221+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c4003520 con 0x7f06d40cf450 2023-11-26T07:23:45.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.221+0000 7f06d89b1640 1 --2- 172.21.15.77:0/171922591 >> v2:172.21.15.159:3300/0 conn(0x7f06d4157c70 0x7f06d4161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3572172109 0 0) 0x7f06c4003520 con 0x7f06d40cf450 2023-11-26T07:23:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 >> v2:172.21.15.159:3300/0 conn(0x7f06d4157c70 msgr2=0x7f06d4161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 --2- 172.21.15.77:0/171922591 >> v2:172.21.15.159:3300/0 conn(0x7f06d4157c70 0x7f06d4161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 >> v1:172.21.15.159:6789/0 conn(0x7f06d415e390 legacy=0x7f06d40b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d415ebb0 con 0x7f06d40cf450 2023-11-26T07:23:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f06c0001670 con 0x7f06d40cf450 2023-11-26T07:23:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 >> v1:172.21.15.77:6789/0 conn(0x7f06d40cf450 legacy=0x7f06d415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 0x7f06c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06c40047c0 0x7f06c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06c40052a0 0x7f06c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d415e8d0 con 0x7f06c40039c0 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c400c1c0 con 0x7f06c40052a0 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c400c380 con 0x7f06c40047c0 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.222+0000 7f06d89b1640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 0x7f06c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.223+0000 7f06d3fff640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06c40047c0 0x7f06c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.223+0000 7f06d91b2640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06c40052a0 0x7f06c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.223+0000 7f06d89b1640 1 -- 172.21.15.77:0/171922591 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06c40047c0 msgr2=0x7f06c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.223+0000 7f06d89b1640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06c40047c0 0x7f06c4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.223+0000 7f06d89b1640 1 -- 172.21.15.77:0/171922591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06c40052a0 msgr2=0x7f06c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.223+0000 7f06d89b1640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06c40052a0 0x7f06c400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.223+0000 7f06d89b1640 1 -- 172.21.15.77:0/171922591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c4003520 con 0x7f06c40039c0 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.223+0000 7f06d91b2640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06c40052a0 0x7f06c400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.223+0000 7f06d91b2640 1 -- 172.21.15.77:0/171922591 reap_dead start 2023-11-26T07:23:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.224+0000 7f06d89b1640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 0x7f06c4003de0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f06c800ba30 tx=0x7f06c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b60204f1a5369cf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.225+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8032640 con 0x7f06c40039c0 2023-11-26T07:23:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.225+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c80327a0 con 0x7f06c40039c0 2023-11-26T07:23:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.225+0000 7f06d37fe640 1 -- 172.21.15.77:0/171922591 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8032b30 con 0x7f06c40039c0 2023-11-26T07:23:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.225+0000 7f06dac15640 1 -- 172.21.15.77:0/171922591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 msgr2=0x7f06c4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.225+0000 7f06dac15640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 0x7f06c4003de0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f06c800ba30 tx=0x7f06c40057f0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.225+0000 7f06dac15640 1 -- 172.21.15.77:0/171922591 shutdown_connections 2023-11-26T07:23:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.225+0000 7f06dac15640 1 --2- 172.21.15.77:0/171922591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 0x7f06c4003de0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.225+0000 7f06dac15640 1 -- 172.21.15.77:0/171922591 >> 172.21.15.77:0/171922591 conn(0x7f06d406a920 msgr2=0x7f06d406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.226+0000 7f06dac15640 1 -- 172.21.15.77:0/171922591 shutdown_connections 2023-11-26T07:23:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.226+0000 7f06dac15640 1 -- 172.21.15.77:0/171922591 wait complete. 2023-11-26T07:23:45.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.227+0000 7f06dac15640 1 Processor -- start 2023-11-26T07:23:45.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.228+0000 7f06dac15640 1 -- start start 2023-11-26T07:23:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.228+0000 7f06dac15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 0x7f06d4146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06dac15640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06d40ad520 0x7f06d40ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06dac15640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06d409bc00 0x7f06d409c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06dac15640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40c9d90 con 0x7f06c40039c0 2023-11-26T07:23:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06dac15640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40c9a80 con 0x7f06d40ad520 2023-11-26T07:23:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06dac15640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40adee0 con 0x7f06d409bc00 2023-11-26T07:23:45.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06d89b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 0x7f06d4146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06d89b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 0x7f06d4146440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42818/0 (socket says 172.21.15.77:42818) 2023-11-26T07:23:45.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06d89b1640 1 -- 172.21.15.77:0/2071703289 learned_addr learned my addr 172.21.15.77:0/2071703289 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06d89b1640 1 -- 172.21.15.77:0/2071703289 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06d409bc00 msgr2=0x7f06d409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06d89b1640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06d409bc00 0x7f06d409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06d89b1640 1 -- 172.21.15.77:0/2071703289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06d40ad520 msgr2=0x7f06d40ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06d89b1640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06d40ad520 0x7f06d40ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.229+0000 7f06d89b1640 1 -- 172.21.15.77:0/2071703289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d4146980 con 0x7f06c40039c0 2023-11-26T07:23:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.230+0000 7f06d89b1640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 0x7f06d4146440 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f06c802bec0 tx=0x7f06c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.230+0000 7f06d17fa640 1 -- 172.21.15.77:0/2071703289 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8004220 con 0x7f06c40039c0 2023-11-26T07:23:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.230+0000 7f06d17fa640 1 -- 172.21.15.77:0/2071703289 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c80043a0 con 0x7f06c40039c0 2023-11-26T07:23:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.230+0000 7f06d17fa640 1 -- 172.21.15.77:0/2071703289 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c803ca80 con 0x7f06c40039c0 2023-11-26T07:23:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.230+0000 7f06dac15640 1 -- 172.21.15.77:0/2071703289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d409c8f0 con 0x7f06c40039c0 2023-11-26T07:23:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.230+0000 7f06dac15640 1 -- 172.21.15.77:0/2071703289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d409ceb0 con 0x7f06c40039c0 2023-11-26T07:23:45.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.231+0000 7f06dac15640 1 -- 172.21.15.77:0/2071703289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d4067470 con 0x7f06c40039c0 2023-11-26T07:23:45.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.232+0000 7f06d17fa640 1 -- 172.21.15.77:0/2071703289 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) v1 ==== 90047+0+0 (secure 0 0 0) 0x7f06c803cbe0 con 0x7f06c40039c0 2023-11-26T07:23:45.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.234+0000 7f06d17fa640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f06b806b770 0x7f06b806dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.234+0000 7f06d17fa640 1 -- 172.21.15.77:0/2071703289 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f06c80aa870 con 0x7f06c40039c0 2023-11-26T07:23:45.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.234+0000 7f06d3fff640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f06b806b770 0x7f06b806dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.234+0000 7f06d3fff640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f06b806b770 0x7f06b806dc30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f06c00017a0 tx=0x7f06c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:45.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.238+0000 7f06d17fa640 1 -- 172.21.15.77:0/2071703289 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06c8077340 con 0x7f06c40039c0 2023-11-26T07:23:45.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.457+0000 7f06dac15640 1 -- 172.21.15.77:0/2071703289 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol55430", "snap_name": "subvol_snap6600", "target": ["mon-mgr", ""]}) v1 -- 0x7f06d4158050 con 0x7f06b806b770 2023-11-26T07:23:45.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.488+0000 7f06d17fa640 1 -- 172.21.15.77:0/2071703289 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f06c0001d10 con 0x7f06b806b770 2023-11-26T07:23:45.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.492+0000 7f06dac15640 1 -- 172.21.15.77:0/2071703289 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f06b806b770 msgr2=0x7f06b806dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.492+0000 7f06dac15640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f06b806b770 0x7f06b806dc30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f06c00017a0 tx=0x7f06c0009040 comp rx=0 tx=0).stop 2023-11-26T07:23:45.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.492+0000 7f06dac15640 1 -- 172.21.15.77:0/2071703289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 msgr2=0x7f06d4146440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.492+0000 7f06dac15640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 0x7f06d4146440 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f06c802bec0 tx=0x7f06c8004730 comp rx=0 tx=0).stop 2023-11-26T07:23:45.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.492+0000 7f06dac15640 1 -- 172.21.15.77:0/2071703289 shutdown_connections 2023-11-26T07:23:45.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.492+0000 7f06dac15640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f06b806b770 0x7f06b806dc30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.492+0000 7f06dac15640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f06d409bc00 0x7f06d409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.492+0000 7f06dac15640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06d40ad520 0x7f06d40ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.492+0000 7f06dac15640 1 --2- 172.21.15.77:0/2071703289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c40039c0 0x7f06d4146440 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.492+0000 7f06dac15640 1 -- 172.21.15.77:0/2071703289 >> 172.21.15.77:0/2071703289 conn(0x7f06d406a920 msgr2=0x7f06d40aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:45.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.493+0000 7f06dac15640 1 -- 172.21.15.77:0/2071703289 shutdown_connections 2023-11-26T07:23:45.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.493+0000 7f06dac15640 1 -- 172.21.15.77:0/2071703289 wait complete. 2023-11-26T07:23:45.518 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:23:45.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.721+0000 7f5d3a49b640 1 Processor -- start 2023-11-26T07:23:45.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.721+0000 7f5d3a49b640 1 -- start start 2023-11-26T07:23:45.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.723+0000 7f5d3a49b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5d340cf430 0x7f5d340aef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.723+0000 7f5d3a49b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d340b3c00 0x7f5d3406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.723+0000 7f5d3a49b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3415aef0 con 0x7f5d3406e6c0 2023-11-26T07:23:45.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.723+0000 7f5d3a49b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3406e2a0 con 0x7f5d340cf430 2023-11-26T07:23:45.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.723+0000 7f5d3a49b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d34159d70 con 0x7f5d340b3c00 2023-11-26T07:23:45.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.724+0000 7f5d38a38640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d340b3c00 0x7f5d3406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.724+0000 7f5d337fe640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f5d3406e6c0 0x7f5d340b34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:41240/0 (socket says 172.21.15.77:41240) 2023-11-26T07:23:45.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.724+0000 7f5d33fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5d340cf430 0x7f5d340aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.724+0000 7f5d337fe640 1 -- 172.21.15.77:0/4150169241 learned_addr learned my addr 172.21.15.77:0/4150169241 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:45.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.725+0000 7f5d33fff640 1 -- 172.21.15.77:0/4150169241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d340b3c00 msgr2=0x7f5d3406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:45.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.725+0000 7f5d33fff640 1 --2- 172.21.15.77:0/4150169241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d340b3c00 0x7f5d3406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.725+0000 7f5d33fff640 1 -- 172.21.15.77:0/4150169241 >> v1:172.21.15.159:6789/0 conn(0x7f5d3406e6c0 legacy=0x7f5d340b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.725+0000 7f5d33fff640 1 -- 172.21.15.77:0/4150169241 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3406d900 con 0x7f5d340cf430 2023-11-26T07:23:45.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.726+0000 7f5d33fff640 1 --2- 172.21.15.77:0/4150169241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d340cf430 0x7f5d340aef10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009d90 tx=0x7f5d2402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5983c4684d99a220 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:45.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.727+0000 7f5d32ffd640 1 -- 172.21.15.77:0/4150169241 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2402cb30 con 0x7f5d340cf430 2023-11-26T07:23:45.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.727+0000 7f5d32ffd640 1 -- 172.21.15.77:0/4150169241 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2402cc90 con 0x7f5d340cf430 2023-11-26T07:23:45.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.727+0000 7f5d32ffd640 1 -- 172.21.15.77:0/4150169241 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24034440 con 0x7f5d340cf430 2023-11-26T07:23:45.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.728+0000 7f5d3a49b640 1 -- 172.21.15.77:0/4150169241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d340cf430 msgr2=0x7f5d340aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.728+0000 7f5d3a49b640 1 --2- 172.21.15.77:0/4150169241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d340cf430 0x7f5d340aef10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009d90 tx=0x7f5d2402bd80 comp rx=0 tx=0).stop 2023-11-26T07:23:45.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.728+0000 7f5d3a49b640 1 -- 172.21.15.77:0/4150169241 shutdown_connections 2023-11-26T07:23:45.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.728+0000 7f5d3a49b640 1 --2- 172.21.15.77:0/4150169241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d340b3c00 0x7f5d3406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.728+0000 7f5d3a49b640 1 --2- 172.21.15.77:0/4150169241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d340cf430 0x7f5d340aef10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.728+0000 7f5d3a49b640 1 -- 172.21.15.77:0/4150169241 >> 172.21.15.77:0/4150169241 conn(0x7f5d340cf900 msgr2=0x7f5d340cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:45.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.728+0000 7f5d3a49b640 1 -- 172.21.15.77:0/4150169241 shutdown_connections 2023-11-26T07:23:45.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.728+0000 7f5d3a49b640 1 -- 172.21.15.77:0/4150169241 wait complete. 2023-11-26T07:23:45.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.730+0000 7f5d3a49b640 1 Processor -- start 2023-11-26T07:23:45.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.730+0000 7f5d3a49b640 1 -- start start 2023-11-26T07:23:45.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.732+0000 7f5d3a49b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3406e6c0 0x7f5d34144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.732+0000 7f5d3a49b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d340b3c00 0x7f5d3414da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.732+0000 7f5d3a49b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d340cf430 0x7f5d3414b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.732+0000 7f5d3a49b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d34144920 con 0x7f5d340cf430 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.732+0000 7f5d3a49b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d340cd2c0 con 0x7f5d3406e6c0 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.732+0000 7f5d3a49b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3414e3c0 con 0x7f5d340b3c00 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.732+0000 7f5d38a38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d340cf430 0x7f5d3414b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.732+0000 7f5d38a38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d340cf430 0x7f5d3414b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42826/0 (socket says 172.21.15.77:42826) 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.732+0000 7f5d38a38640 1 -- 172.21.15.77:0/521635675 learned_addr learned my addr 172.21.15.77:0/521635675 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.732+0000 7f5d33fff640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3406e6c0 0x7f5d34144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.732+0000 7f5d337fe640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d340b3c00 0x7f5d3414da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d38a38640 1 -- 172.21.15.77:0/521635675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d340b3c00 msgr2=0x7f5d3414da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d38a38640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d340b3c00 0x7f5d3414da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d38a38640 1 -- 172.21.15.77:0/521635675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3406e6c0 msgr2=0x7f5d34144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d38a38640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3406e6c0 0x7f5d34144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d38a38640 1 -- 172.21.15.77:0/521635675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d24009a70 con 0x7f5d340cf430 2023-11-26T07:23:45.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d337fe640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d340b3c00 0x7f5d3414da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:45.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d38a38640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d340cf430 0x7f5d3414b890 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e850 tx=0x7f5d2c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:45.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d30ff9640 1 -- 172.21.15.77:0/521635675 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c009630 con 0x7f5d340cf430 2023-11-26T07:23:45.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d30ff9640 1 -- 172.21.15.77:0/521635675 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c00c940 con 0x7f5d340cf430 2023-11-26T07:23:45.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d30ff9640 1 -- 172.21.15.77:0/521635675 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c00ccf0 con 0x7f5d340cf430 2023-11-26T07:23:45.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d3a49b640 1 -- 172.21.15.77:0/521635675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3414e0e0 con 0x7f5d340cf430 2023-11-26T07:23:45.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.733+0000 7f5d3a49b640 1 -- 172.21.15.77:0/521635675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d340ccf50 con 0x7f5d340cf430 2023-11-26T07:23:45.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.734+0000 7f5d3a49b640 1 -- 172.21.15.77:0/521635675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3415a960 con 0x7f5d340cf430 2023-11-26T07:23:45.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.735+0000 7f5d30ff9640 1 -- 172.21.15.77:0/521635675 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) v1 ==== 90047+0+0 (secure 0 0 0) 0x7f5d2c013470 con 0x7f5d340cf430 2023-11-26T07:23:45.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.736+0000 7f5d30ff9640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d1406b740 0x7f5d1406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:45.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.736+0000 7f5d30ff9640 1 -- 172.21.15.77:0/521635675 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5d2c088680 con 0x7f5d340cf430 2023-11-26T07:23:45.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.737+0000 7f5d33fff640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d1406b740 0x7f5d1406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:45.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.737+0000 7f5d33fff640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d1406b740 0x7f5d1406dc00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5d24036000 tx=0x7f5d24030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:45.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.742+0000 7f5d30ff9640 1 -- 172.21.15.77:0/521635675 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d3415a960 con 0x7f5d340cf430 2023-11-26T07:23:45.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.937+0000 7f5d3a49b640 1 -- 172.21.15.77:0/521635675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f5d3415a960 con 0x7f5d340cf430 2023-11-26T07:23:45.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.942+0000 7f5d30ff9640 1 -- 172.21.15.77:0/521635675 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v23)=0 v23) v1 ==== 130+0+0 (secure 0 0 0) 0x7f5d3415a960 con 0x7f5d340cf430 2023-11-26T07:23:45.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 -- 172.21.15.77:0/521635675 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d1406b740 msgr2=0x7f5d1406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d1406b740 0x7f5d1406dc00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5d24036000 tx=0x7f5d24030000 comp rx=0 tx=0).stop 2023-11-26T07:23:45.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 -- 172.21.15.77:0/521635675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d340cf430 msgr2=0x7f5d3414b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:45.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d340cf430 0x7f5d3414b890 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e850 tx=0x7f5d2c00ed10 comp rx=0 tx=0).stop 2023-11-26T07:23:45.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 -- 172.21.15.77:0/521635675 shutdown_connections 2023-11-26T07:23:45.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5d1406b740 0x7f5d1406dc00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d340cf430 0x7f5d3414b890 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d340b3c00 0x7f5d3414da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 --2- 172.21.15.77:0/521635675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3406e6c0 0x7f5d34144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:45.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 -- 172.21.15.77:0/521635675 >> 172.21.15.77:0/521635675 conn(0x7f5d340cf900 msgr2=0x7f5d3415b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:45.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 -- 172.21.15.77:0/521635675 shutdown_connections 2023-11-26T07:23:45.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:45.945+0000 7f5d3a49b640 1 -- 172.21.15.77:0/521635675 wait complete. 2023-11-26T07:23:45.958 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:45.956+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:45.958 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:45.956+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:45.958 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:45.956+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:45.958 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:45.956+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:45.958 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:45.956+0000 7f59b4dfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:45.967 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol55430 subvol_snap6600 subvol_clone77330 2023-11-26T07:23:46.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.158+0000 7f6072933640 1 Processor -- start 2023-11-26T07:23:46.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.158+0000 7f6072933640 1 -- start start 2023-11-26T07:23:46.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.159+0000 7f6072933640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f606c0cc0f0 0x7f606c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.159+0000 7f6072933640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606c15eea0 con 0x7f606c15b440 2023-11-26T07:23:46.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.159+0000 7f6072933640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606c0abf30 con 0x7f606c0c57e0 2023-11-26T07:23:46.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.159+0000 7f6072933640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606c15b820 con 0x7f606c0cc0f0 2023-11-26T07:23:46.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.160+0000 7f6063fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f606c0cc0f0 0x7f606c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.160+0000 7f6063fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f606c0cc0f0 0x7f606c0c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41162/0 (socket says 172.21.15.77:41162) 2023-11-26T07:23:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.160+0000 7f606bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f606c15b440 0x7f606c0cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51496/0 (socket says 172.21.15.77:51496) 2023-11-26T07:23:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.160+0000 7f6063fff640 1 -- 172.21.15.77:0/2201190883 learned_addr learned my addr 172.21.15.77:0/2201190883 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.160+0000 7f6063fff640 1 -- 172.21.15.77:0/2201190883 >> v1:172.21.15.159:6789/0 conn(0x7f606c0c57e0 legacy=0x7f606c06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.160+0000 7f6063fff640 1 -- 172.21.15.77:0/2201190883 >> v1:172.21.15.77:6789/0 conn(0x7f606c15b440 legacy=0x7f606c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.160+0000 7f6063fff640 1 -- 172.21.15.77:0/2201190883 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c15f0f0 con 0x7f606c0cc0f0 2023-11-26T07:23:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.160+0000 7f606b7fe640 1 -- 172.21.15.77:0/2201190883 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808135261 0 0) 0x7f606c15eea0 con 0x7f606c15b440 2023-11-26T07:23:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.161+0000 7f6063fff640 1 --2- 172.21.15.77:0/2201190883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606c0cc0f0 0x7f606c0c52a0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6054009870 tx=0x7f605402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e667121d5bcc7e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.162+0000 7f606b7fe640 1 -- 172.21.15.77:0/2201190883 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054031870 con 0x7f606c0cc0f0 2023-11-26T07:23:46.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.162+0000 7f606b7fe640 1 -- 172.21.15.77:0/2201190883 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60540319d0 con 0x7f606c0cc0f0 2023-11-26T07:23:46.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.162+0000 7f606b7fe640 1 -- 172.21.15.77:0/2201190883 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054031d60 con 0x7f606c0cc0f0 2023-11-26T07:23:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.162+0000 7f6072933640 1 -- 172.21.15.77:0/2201190883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606c0cc0f0 msgr2=0x7f606c0c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.162+0000 7f6072933640 1 --2- 172.21.15.77:0/2201190883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606c0cc0f0 0x7f606c0c52a0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6054009870 tx=0x7f605402b910 comp rx=0 tx=0).stop 2023-11-26T07:23:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.163+0000 7f6072933640 1 -- 172.21.15.77:0/2201190883 shutdown_connections 2023-11-26T07:23:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.163+0000 7f6072933640 1 --2- 172.21.15.77:0/2201190883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606c0cc0f0 0x7f606c0c52a0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.163+0000 7f6072933640 1 -- 172.21.15.77:0/2201190883 >> 172.21.15.77:0/2201190883 conn(0x7f606c0b0c50 msgr2=0x7f606c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.163+0000 7f6072933640 1 -- 172.21.15.77:0/2201190883 shutdown_connections 2023-11-26T07:23:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.163+0000 7f6072933640 1 -- 172.21.15.77:0/2201190883 wait complete. 2023-11-26T07:23:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.165+0000 7f6072933640 1 Processor -- start 2023-11-26T07:23:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.165+0000 7f6072933640 1 -- start start 2023-11-26T07:23:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.166+0000 7f6072933640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f606c0c57e0 0x7f606c15c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.166+0000 7f6072933640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c0cc0f0 0x7f606c159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.166+0000 7f6072933640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606c15b440 0x7f606c070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.166+0000 7f6072933640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c15da60 con 0x7f606c15b440 2023-11-26T07:23:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.166+0000 7f6072933640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c15cc00 con 0x7f606c0c57e0 2023-11-26T07:23:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.166+0000 7f6072933640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c159e70 con 0x7f606c0cc0f0 2023-11-26T07:23:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.166+0000 7f6070ed0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606c15b440 0x7f606c070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.166+0000 7f6070ed0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606c15b440 0x7f606c070bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41164/0 (socket says 172.21.15.77:41164) 2023-11-26T07:23:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.166+0000 7f6070ed0640 1 -- 172.21.15.77:0/3830058949 learned_addr learned my addr 172.21.15.77:0/3830058949 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f6063fff640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c0cc0f0 0x7f606c159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f606bfff640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f606c0c57e0 0x7f606c15c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f6070ed0640 1 -- 172.21.15.77:0/3830058949 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c0cc0f0 msgr2=0x7f606c159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f6070ed0640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c0cc0f0 0x7f606c159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f6070ed0640 1 -- 172.21.15.77:0/3830058949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f606c0c57e0 msgr2=0x7f606c15c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f6070ed0640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f606c0c57e0 0x7f606c15c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f6070ed0640 1 -- 172.21.15.77:0/3830058949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60540094d0 con 0x7f606c15b440 2023-11-26T07:23:46.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f6070ed0640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606c15b440 0x7f606c070bb0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f606400c7e0 tx=0x7f606400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f60697fa640 1 -- 172.21.15.77:0/3830058949 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064004b60 con 0x7f606c15b440 2023-11-26T07:23:46.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f60697fa640 1 -- 172.21.15.77:0/3830058949 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064004cc0 con 0x7f606c15b440 2023-11-26T07:23:46.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f60697fa640 1 -- 172.21.15.77:0/3830058949 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606400aa90 con 0x7f606c15b440 2023-11-26T07:23:46.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.167+0000 7f6072933640 1 -- 172.21.15.77:0/3830058949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606c15ce50 con 0x7f606c15b440 2023-11-26T07:23:46.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.168+0000 7f6072933640 1 -- 172.21.15.77:0/3830058949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c15d410 con 0x7f606c15b440 2023-11-26T07:23:46.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.169+0000 7f6072933640 1 -- 172.21.15.77:0/3830058949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606c04e8b0 con 0x7f606c15b440 2023-11-26T07:23:46.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.170+0000 7f60697fa640 1 -- 172.21.15.77:0/3830058949 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) v1 ==== 90047+0+0 (secure 0 0 0) 0x7f606400abf0 con 0x7f606c15b440 2023-11-26T07:23:46.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.170+0000 7f60697fa640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604c06b740 0x7f604c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.171+0000 7f60697fa640 1 -- 172.21.15.77:0/3830058949 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6064088070 con 0x7f606c15b440 2023-11-26T07:23:46.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.171+0000 7f606bfff640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604c06b740 0x7f604c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.171+0000 7f606bfff640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604c06b740 0x7f604c06dc00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f605c000f60 tx=0x7f605c007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.175+0000 7f60697fa640 1 -- 172.21.15.77:0/3830058949 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6064054b70 con 0x7f606c15b440 2023-11-26T07:23:46.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.405+0000 7f6072933640 1 -- 172.21.15.77:0/3830058949 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol55430", "snap_name": "subvol_snap6600", "target_sub_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7f606c0c99f0 con 0x7f604c06b740 2023-11-26T07:23:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.560+0000 7f60697fa640 1 -- 172.21.15.77:0/3830058949 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f606c0c99f0 con 0x7f604c06b740 2023-11-26T07:23:46.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 -- 172.21.15.77:0/3830058949 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604c06b740 msgr2=0x7f604c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604c06b740 0x7f604c06dc00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f605c000f60 tx=0x7f605c007c00 comp rx=0 tx=0).stop 2023-11-26T07:23:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 -- 172.21.15.77:0/3830058949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606c15b440 msgr2=0x7f606c070bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606c15b440 0x7f606c070bb0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f606400c7e0 tx=0x7f606400cca0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 -- 172.21.15.77:0/3830058949 shutdown_connections 2023-11-26T07:23:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f604c06b740 0x7f604c06dc00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f606c15b440 0x7f606c070bb0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c0cc0f0 0x7f606c159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 --2- 172.21.15.77:0/3830058949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f606c0c57e0 0x7f606c15c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 -- 172.21.15.77:0/3830058949 >> 172.21.15.77:0/3830058949 conn(0x7f606c0b0c50 msgr2=0x7f606c0ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 -- 172.21.15.77:0/3830058949 shutdown_connections 2023-11-26T07:23:46.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.564+0000 7f6072933640 1 -- 172.21.15.77:0/3830058949 wait complete. 2023-11-26T07:23:46.571 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:46.569+0000 7f59b7e02640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:46.571 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:46.569+0000 7f59b7e02640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:46.571 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:46.569+0000 7f59b7e02640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:46.571 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:46.569+0000 7f59b7e02640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:46.571 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:46.569+0000 7f59b7e02640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:46.590 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:46.588+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:46.590 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:46.588+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:46.590 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:46.588+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:46.590 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:46.588+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:46.590 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:23:46.588+0000 7f59b7601640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:46.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:23:46.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.780+0000 7fc38923d640 1 Processor -- start 2023-11-26T07:23:46.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.780+0000 7fc38923d640 1 -- start start 2023-11-26T07:23:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.781+0000 7fc38923d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc38415b440 0x7fc3840cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.781+0000 7fc38923d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3840cbf20 0x7fc3840c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.782+0000 7fc38923d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3840cc3a0 con 0x7fc3840c57e0 2023-11-26T07:23:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.782+0000 7fc38923d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38415b820 con 0x7fc3840cbf20 2023-11-26T07:23:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.782+0000 7fc38923d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38415eea0 con 0x7fc38415b440 2023-11-26T07:23:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.782+0000 7fc38359e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc3840c57e0 0x7fc3840c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51508/0 (socket says 172.21.15.77:51508) 2023-11-26T07:23:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.782+0000 7fc38359e640 1 -- 172.21.15.77:0/1071986832 learned_addr learned my addr 172.21.15.77:0/1071986832 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.782+0000 7fc37bfff640 1 --2- 172.21.15.77:0/1071986832 >> v2:172.21.15.77:3300/0 conn(0x7fc3840cbf20 0x7fc3840c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.782+0000 7fc382d9d640 1 --2- 172.21.15.77:0/1071986832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc38415b440 0x7fc3840cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.782+0000 7fc38259c640 1 -- 172.21.15.77:0/1071986832 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076264987 0 0) 0x7fc37c001490 con 0x7fc3840c57e0 2023-11-26T07:23:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.782+0000 7fc38259c640 1 -- 172.21.15.77:0/1071986832 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc370003520 con 0x7fc3840c57e0 2023-11-26T07:23:46.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.783+0000 7fc37bfff640 1 -- 172.21.15.77:0/1071986832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc38415b440 msgr2=0x7fc3840cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:46.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.783+0000 7fc37bfff640 1 --2- 172.21.15.77:0/1071986832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc38415b440 0x7fc3840cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.783+0000 7fc38259c640 1 -- 172.21.15.77:0/1071986832 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 373125392 0 0) 0x7fc370003520 con 0x7fc3840c57e0 2023-11-26T07:23:46.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.783+0000 7fc37bfff640 1 -- 172.21.15.77:0/1071986832 >> v1:172.21.15.77:6789/0 conn(0x7fc3840c57e0 legacy=0x7fc3840c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.783+0000 7fc37bfff640 1 -- 172.21.15.77:0/1071986832 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38406d600 con 0x7fc3840cbf20 2023-11-26T07:23:46.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.784+0000 7fc37bfff640 1 --2- 172.21.15.77:0/1071986832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3840cbf20 0x7fc3840c52a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0097a0 tx=0x7fc36c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a89b1caa1f22da server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.784+0000 7fc38259c640 1 -- 172.21.15.77:0/1071986832 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c001b80 con 0x7fc3840cbf20 2023-11-26T07:23:46.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.784+0000 7fc38259c640 1 -- 172.21.15.77:0/1071986832 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c02e050 con 0x7fc3840cbf20 2023-11-26T07:23:46.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.784+0000 7fc38259c640 1 -- 172.21.15.77:0/1071986832 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c030730 con 0x7fc3840cbf20 2023-11-26T07:23:46.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.785+0000 7fc38923d640 1 -- 172.21.15.77:0/1071986832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3840cbf20 msgr2=0x7fc3840c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.785+0000 7fc38923d640 1 --2- 172.21.15.77:0/1071986832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3840cbf20 0x7fc3840c52a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0097a0 tx=0x7fc36c02b710 comp rx=0 tx=0).stop 2023-11-26T07:23:46.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.785+0000 7fc38923d640 1 -- 172.21.15.77:0/1071986832 shutdown_connections 2023-11-26T07:23:46.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.785+0000 7fc38923d640 1 --2- 172.21.15.77:0/1071986832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3840cbf20 0x7fc3840c52a0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.785+0000 7fc38923d640 1 --2- 172.21.15.77:0/1071986832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc38415b440 0x7fc3840cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.785+0000 7fc38923d640 1 -- 172.21.15.77:0/1071986832 >> 172.21.15.77:0/1071986832 conn(0x7fc3840b0c50 msgr2=0x7fc3840b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:46.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.785+0000 7fc38923d640 1 -- 172.21.15.77:0/1071986832 shutdown_connections 2023-11-26T07:23:46.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.785+0000 7fc38923d640 1 -- 172.21.15.77:0/1071986832 wait complete. 2023-11-26T07:23:46.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.787+0000 7fc38923d640 1 Processor -- start 2023-11-26T07:23:46.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.787+0000 7fc38923d640 1 -- start start 2023-11-26T07:23:46.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.788+0000 7fc38923d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3840c57e0 0x7fc3840ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.788+0000 7fc38923d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3840cbf20 0x7fc3840afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.788+0000 7fc38923d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc38415b440 0x7fc3841f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.788+0000 7fc38923d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3841f31c0 con 0x7fc3840c57e0 2023-11-26T07:23:46.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.788+0000 7fc38923d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3841f7320 con 0x7fc38415b440 2023-11-26T07:23:46.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.788+0000 7fc38923d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840c6170 con 0x7fc3840cbf20 2023-11-26T07:23:46.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.788+0000 7fc382d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3840c57e0 0x7fc3840ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.788+0000 7fc382d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3840c57e0 0x7fc3840ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41214/0 (socket says 172.21.15.77:41214) 2023-11-26T07:23:46.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.788+0000 7fc382d9d640 1 -- 172.21.15.77:0/2203618300 learned_addr learned my addr 172.21.15.77:0/2203618300 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:46.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.789+0000 7fc382d9d640 1 -- 172.21.15.77:0/2203618300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3840cbf20 msgr2=0x7fc3840afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.789+0000 7fc382d9d640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3840cbf20 0x7fc3840afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.789+0000 7fc382d9d640 1 -- 172.21.15.77:0/2203618300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc38415b440 msgr2=0x7fc3841f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.789+0000 7fc382d9d640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc38415b440 0x7fc3841f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.789+0000 7fc382d9d640 1 -- 172.21.15.77:0/2203618300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c009400 con 0x7fc3840c57e0 2023-11-26T07:23:46.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.789+0000 7fc382d9d640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3840c57e0 0x7fc3840ce4f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc37400e870 tx=0x7fc37400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.789+0000 7fc37b7fe640 1 -- 172.21.15.77:0/2203618300 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3740094f0 con 0x7fc3840c57e0 2023-11-26T07:23:46.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.789+0000 7fc37b7fe640 1 -- 172.21.15.77:0/2203618300 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37400c940 con 0x7fc3840c57e0 2023-11-26T07:23:46.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.789+0000 7fc37b7fe640 1 -- 172.21.15.77:0/2203618300 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400ccf0 con 0x7fc3840c57e0 2023-11-26T07:23:46.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.789+0000 7fc38923d640 1 -- 172.21.15.77:0/2203618300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3840c6450 con 0x7fc3840c57e0 2023-11-26T07:23:46.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.789+0000 7fc38923d640 1 -- 172.21.15.77:0/2203618300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38415a4f0 con 0x7fc3840c57e0 2023-11-26T07:23:46.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.790+0000 7fc38923d640 1 -- 172.21.15.77:0/2203618300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3841f2f20 con 0x7fc3840c57e0 2023-11-26T07:23:46.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.791+0000 7fc37b7fe640 1 -- 172.21.15.77:0/2203618300 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) v1 ==== 90047+0+0 (secure 0 0 0) 0x7fc374013470 con 0x7fc3840c57e0 2023-11-26T07:23:46.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.792+0000 7fc37b7fe640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc36406b740 0x7fc36406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.792+0000 7fc37b7fe640 1 -- 172.21.15.77:0/2203618300 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc374088200 con 0x7fc3840c57e0 2023-11-26T07:23:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.793+0000 7fc37bfff640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc36406b740 0x7fc36406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.793+0000 7fc37bfff640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc36406b740 0x7fc36406dc00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc36c034000 tx=0x7fc36c02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:46.797+0000 7fc37b7fe640 1 -- 172.21.15.77:0/2203618300 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3841f2f20 con 0x7fc3840c57e0 2023-11-26T07:23:47.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.024+0000 7fc38923d640 1 -- 172.21.15.77:0/2203618300 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7fc38415f3d0 con 0x7fc36406b740 2023-11-26T07:23:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.034+0000 7fc37b7fe640 1 -- 172.21.15.77:0/2203618300 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+164 (secure 0 0 0) 0x7fc36c030740 con 0x7fc36406b740 2023-11-26T07:23:47.036 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:23:47.036 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:23:47.037 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "pending", 2023-11-26T07:23:47.037 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:23:47.037 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:23:47.037 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol55430", 2023-11-26T07:23:47.037 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap6600" 2023-11-26T07:23:47.037 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:47.037 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:47.037 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:23:47.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 -- 172.21.15.77:0/2203618300 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc36406b740 msgr2=0x7fc36406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc36406b740 0x7fc36406dc00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc36c034000 tx=0x7fc36c02f000 comp rx=0 tx=0).stop 2023-11-26T07:23:47.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 -- 172.21.15.77:0/2203618300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3840c57e0 msgr2=0x7fc3840ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3840c57e0 0x7fc3840ce4f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc37400e870 tx=0x7fc37400ed30 comp rx=0 tx=0).stop 2023-11-26T07:23:47.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 -- 172.21.15.77:0/2203618300 shutdown_connections 2023-11-26T07:23:47.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc36406b740 0x7fc36406dc00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc38415b440 0x7fc3841f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3840cbf20 0x7fc3840afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 --2- 172.21.15.77:0/2203618300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3840c57e0 0x7fc3840ce4f0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 -- 172.21.15.77:0/2203618300 >> 172.21.15.77:0/2203618300 conn(0x7fc3840b0c50 msgr2=0x7fc3840ac2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:47.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 -- 172.21.15.77:0/2203618300 shutdown_connections 2023-11-26T07:23:47.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.037+0000 7fc38923d640 1 -- 172.21.15.77:0/2203618300 wait complete. 2023-11-26T07:23:47.056 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:23:47.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.263+0000 7f60cc3de640 1 Processor -- start 2023-11-26T07:23:47.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.263+0000 7f60cc3de640 1 -- start start 2023-11-26T07:23:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.265+0000 7f60cc3de640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f60c4072160 0x7f60c415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.265+0000 7f60cc3de640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c415ec90 con 0x7f60c406de10 2023-11-26T07:23:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.265+0000 7f60cc3de640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c40cd530 con 0x7f60c40c49f0 2023-11-26T07:23:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.265+0000 7f60cc3de640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c40c4ed0 con 0x7f60c4072160 2023-11-26T07:23:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.265+0000 7f60ca97b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f60c406de10 0x7f60c40705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51510/0 (socket says 172.21.15.77:51510) 2023-11-26T07:23:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.265+0000 7f60ca97b640 1 -- 172.21.15.77:0/2122479090 learned_addr learned my addr 172.21.15.77:0/2122479090 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.265+0000 7f60ca17a640 1 --2- 172.21.15.77:0/2122479090 >> v2:172.21.15.77:3300/0 conn(0x7f60c4072160 0x7f60c415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.266+0000 7f60ca17a640 1 -- 172.21.15.77:0/2122479090 >> v1:172.21.15.159:6789/0 conn(0x7f60c40c49f0 legacy=0x7f60c406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.266+0000 7f60c9178640 1 -- 172.21.15.77:0/2122479090 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359415031 0 0) 0x7f60bc001490 con 0x7f60c406de10 2023-11-26T07:23:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.266+0000 7f60ca17a640 1 -- 172.21.15.77:0/2122479090 >> v1:172.21.15.77:6789/0 conn(0x7f60c406de10 legacy=0x7f60c40705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.266+0000 7f60ca17a640 1 -- 172.21.15.77:0/2122479090 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c40c51b0 con 0x7f60c4072160 2023-11-26T07:23:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.267+0000 7f60ca17a640 1 --2- 172.21.15.77:0/2122479090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c4072160 0x7f60c415e750 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f60c00097a0 tx=0x7f60c002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f817e50bf1212a16 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.267+0000 7f60c9178640 1 -- 172.21.15.77:0/2122479090 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c0030610 con 0x7f60c4072160 2023-11-26T07:23:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.267+0000 7f60c9178640 1 -- 172.21.15.77:0/2122479090 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c0030770 con 0x7f60c4072160 2023-11-26T07:23:47.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.267+0000 7f60c9178640 1 -- 172.21.15.77:0/2122479090 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c0030b00 con 0x7f60c4072160 2023-11-26T07:23:47.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.268+0000 7f60cc3de640 1 -- 172.21.15.77:0/2122479090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c4072160 msgr2=0x7f60c415e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.268+0000 7f60cc3de640 1 --2- 172.21.15.77:0/2122479090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c4072160 0x7f60c415e750 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f60c00097a0 tx=0x7f60c002b960 comp rx=0 tx=0).stop 2023-11-26T07:23:47.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.268+0000 7f60cc3de640 1 -- 172.21.15.77:0/2122479090 shutdown_connections 2023-11-26T07:23:47.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.268+0000 7f60cc3de640 1 --2- 172.21.15.77:0/2122479090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c4072160 0x7f60c415e750 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.268+0000 7f60cc3de640 1 -- 172.21.15.77:0/2122479090 >> 172.21.15.77:0/2122479090 conn(0x7f60c40b0c50 msgr2=0x7f60c40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.268+0000 7f60cc3de640 1 -- 172.21.15.77:0/2122479090 shutdown_connections 2023-11-26T07:23:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.268+0000 7f60cc3de640 1 -- 172.21.15.77:0/2122479090 wait complete. 2023-11-26T07:23:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.270+0000 7f60cc3de640 1 Processor -- start 2023-11-26T07:23:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.270+0000 7f60cc3de640 1 -- start start 2023-11-26T07:23:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60cc3de640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60c406de10 0x7f60c40b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60cc3de640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c4072160 0x7f60c409c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60cc3de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c40c49f0 0x7f60c40ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60cc3de640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40b35e0 con 0x7f60c40c49f0 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60cc3de640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40b4df0 con 0x7f60c4072160 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60cc3de640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40b3810 con 0x7f60c406de10 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60ca97b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c40c49f0 0x7f60c40ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60ca97b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c40c49f0 0x7f60c40ad1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41224/0 (socket says 172.21.15.77:41224) 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60ca97b640 1 -- 172.21.15.77:0/778320393 learned_addr learned my addr 172.21.15.77:0/778320393 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60ca17a640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60c406de10 0x7f60c40b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60ca97b640 1 -- 172.21.15.77:0/778320393 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60c406de10 msgr2=0x7f60c40b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60c9979640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c4072160 0x7f60c409c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.271+0000 7f60ca97b640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60c406de10 0x7f60c40b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.272+0000 7f60ca97b640 1 -- 172.21.15.77:0/778320393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c4072160 msgr2=0x7f60c409c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.272+0000 7f60ca97b640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c4072160 0x7f60c409c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.272+0000 7f60ca97b640 1 -- 172.21.15.77:0/778320393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0009400 con 0x7f60c40c49f0 2023-11-26T07:23:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.272+0000 7f60ca17a640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60c406de10 0x7f60c40b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.272+0000 7f60ca97b640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c40c49f0 0x7f60c40ad1e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00c7f0 tx=0x7f60bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.272+0000 7f60baffd640 1 -- 172.21.15.77:0/778320393 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00a5e0 con 0x7f60c40c49f0 2023-11-26T07:23:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.272+0000 7f60baffd640 1 -- 172.21.15.77:0/778320393 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc00a760 con 0x7f60c40c49f0 2023-11-26T07:23:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.272+0000 7f60baffd640 1 -- 172.21.15.77:0/778320393 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00ab10 con 0x7f60c40c49f0 2023-11-26T07:23:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.272+0000 7f60cc3de640 1 -- 172.21.15.77:0/778320393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c40b3af0 con 0x7f60c40c49f0 2023-11-26T07:23:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.272+0000 7f60cc3de640 1 -- 172.21.15.77:0/778320393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c40b40b0 con 0x7f60c40c49f0 2023-11-26T07:23:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.273+0000 7f60cc3de640 1 -- 172.21.15.77:0/778320393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c404e8b0 con 0x7f60c40c49f0 2023-11-26T07:23:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.274+0000 7f60baffd640 1 -- 172.21.15.77:0/778320393 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) v1 ==== 90047+0+0 (secure 0 0 0) 0x7f60bc00ac70 con 0x7f60c40c49f0 2023-11-26T07:23:47.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.275+0000 7f60baffd640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f60a806b770 0x7f60a806dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.275+0000 7f60baffd640 1 -- 172.21.15.77:0/778320393 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f60bc0871b0 con 0x7f60c40c49f0 2023-11-26T07:23:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.276+0000 7f60ca17a640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f60a806b770 0x7f60a806dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.276+0000 7f60ca17a640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f60a806b770 0x7f60a806dc30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f60c0036000 tx=0x7f60c003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:47.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.280+0000 7f60baffd640 1 -- 172.21.15.77:0/778320393 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f60bc053c20 con 0x7f60c40c49f0 2023-11-26T07:23:47.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.506+0000 7f60cc3de640 1 -- 172.21.15.77:0/778320393 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7f60c40c5a50 con 0x7f60a806b770 2023-11-26T07:23:47.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.521+0000 7f60baffd640 1 -- 172.21.15.77:0/778320393 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+164 (secure 0 0 0) 0x7f60c00309e0 con 0x7f60a806b770 2023-11-26T07:23:47.523 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:23:47.523 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:23:47.523 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "pending", 2023-11-26T07:23:47.523 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:23:47.523 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:23:47.523 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol55430", 2023-11-26T07:23:47.523 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap6600" 2023-11-26T07:23:47.524 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:47.524 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:47.524 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:23:47.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 -- 172.21.15.77:0/778320393 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f60a806b770 msgr2=0x7f60a806dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f60a806b770 0x7f60a806dc30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f60c0036000 tx=0x7f60c003b040 comp rx=0 tx=0).stop 2023-11-26T07:23:47.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 -- 172.21.15.77:0/778320393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c40c49f0 msgr2=0x7f60c40ad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c40c49f0 0x7f60c40ad1e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00c7f0 tx=0x7f60bc00ccb0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 -- 172.21.15.77:0/778320393 shutdown_connections 2023-11-26T07:23:47.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f60a806b770 0x7f60a806dc30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c40c49f0 0x7f60c40ad1e0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c4072160 0x7f60c409c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 --2- 172.21.15.77:0/778320393 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60c406de10 0x7f60c40b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 -- 172.21.15.77:0/778320393 >> 172.21.15.77:0/778320393 conn(0x7f60c40b0c50 msgr2=0x7f60c40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:47.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 -- 172.21.15.77:0/778320393 shutdown_connections 2023-11-26T07:23:47.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:47.523+0000 7f60cc3de640 1 -- 172.21.15.77:0/778320393 wait complete. 2023-11-26T07:23:48.545 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:23:48.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.764+0000 7f543d0e7640 1 Processor -- start 2023-11-26T07:23:48.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.764+0000 7f543d0e7640 1 -- start start 2023-11-26T07:23:48.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.766+0000 7f543d0e7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54380c49f0 0x7f543815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:48.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.766+0000 7f543d0e7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543815ec90 con 0x7f5438072160 2023-11-26T07:23:48.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.766+0000 7f543d0e7640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54380cd530 con 0x7f543806de10 2023-11-26T07:23:48.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.766+0000 7f543d0e7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54380c4ed0 con 0x7f54380c49f0 2023-11-26T07:23:48.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.766+0000 7f5436d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5438072160 0x7f543806d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51516/0 (socket says 172.21.15.77:51516) 2023-11-26T07:23:48.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.766+0000 7f5436d9d640 1 -- 172.21.15.77:0/1283385550 learned_addr learned my addr 172.21.15.77:0/1283385550 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:48.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772827767 0 0) 0x7f5428001110 con 0x7f5438072160 2023-11-26T07:23:48.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5424005730 con 0x7f5438072160 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543759e640 1 --2- 172.21.15.77:0/1283385550 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54380c49f0 0x7f543815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 101170802 0 0) 0x7f5424005730 con 0x7f5438072160 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54380c49f0 msgr2=0x7f543815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 --2- 172.21.15.77:0/1283385550 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54380c49f0 0x7f543815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 >> v1:172.21.15.159:6789/0 conn(0x7f543806de10 legacy=0x7f54380705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380c51b0 con 0x7f5438072160 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f5428001800 con 0x7f5438072160 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 >> v1:172.21.15.77:6789/0 conn(0x7f5438072160 legacy=0x7f543806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 --2- 172.21.15.77:0/1283385550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5424005bb0 0x7f5424005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 --2- 172.21.15.77:0/1283385550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54240069d0 0x7f5424006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 --2- 172.21.15.77:0/1283385550 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54380c49f0 0x7f5424007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54380c4ed0 con 0x7f5424005bb0 2023-11-26T07:23:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542400dd20 con 0x7f54240069d0 2023-11-26T07:23:48.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.767+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542400dee0 con 0x7f54380c49f0 2023-11-26T07:23:48.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.768+0000 7f5436d9d640 1 --2- 172.21.15.77:0/1283385550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5424005bb0 0x7f5424005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:48.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.768+0000 7f5436d9d640 1 -- 172.21.15.77:0/1283385550 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54380c49f0 msgr2=0x7f5424007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:48.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.768+0000 7f5436d9d640 1 --2- 172.21.15.77:0/1283385550 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54380c49f0 0x7f5424007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:48.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.768+0000 7f5436d9d640 1 -- 172.21.15.77:0/1283385550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54240069d0 msgr2=0x7f5424006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:48.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.768+0000 7f5436d9d640 1 --2- 172.21.15.77:0/1283385550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54240069d0 0x7f5424006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:48.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.768+0000 7f5436d9d640 1 -- 172.21.15.77:0/1283385550 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5424005730 con 0x7f5424005bb0 2023-11-26T07:23:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.769+0000 7f5436d9d640 1 --2- 172.21.15.77:0/1283385550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5424005bb0 0x7f5424005fd0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f5428007fd0 tx=0x7f5424007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68234a6d294afd92 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.769+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428005ad0 con 0x7f5424005bb0 2023-11-26T07:23:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.769+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5428005c30 con 0x7f5424005bb0 2023-11-26T07:23:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.769+0000 7f543659c640 1 -- 172.21.15.77:0/1283385550 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542802c7c0 con 0x7f5424005bb0 2023-11-26T07:23:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.770+0000 7f543d0e7640 1 -- 172.21.15.77:0/1283385550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5424005bb0 msgr2=0x7f5424005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.770+0000 7f543d0e7640 1 --2- 172.21.15.77:0/1283385550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5424005bb0 0x7f5424005fd0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f5428007fd0 tx=0x7f5424007a00 comp rx=0 tx=0).stop 2023-11-26T07:23:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.770+0000 7f543759e640 1 -- 172.21.15.77:0/1283385550 reap_dead start 2023-11-26T07:23:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.770+0000 7f543d0e7640 1 -- 172.21.15.77:0/1283385550 shutdown_connections 2023-11-26T07:23:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.770+0000 7f543d0e7640 1 -- 172.21.15.77:0/1283385550 >> 172.21.15.77:0/1283385550 conn(0x7f54380b0c50 msgr2=0x7f54380b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.770+0000 7f543d0e7640 1 -- 172.21.15.77:0/1283385550 shutdown_connections 2023-11-26T07:23:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.770+0000 7f543d0e7640 1 -- 172.21.15.77:0/1283385550 wait complete. 2023-11-26T07:23:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.772+0000 7f543d0e7640 1 Processor -- start 2023-11-26T07:23:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.772+0000 7f543d0e7640 1 -- start start 2023-11-26T07:23:48.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.773+0000 7f543d0e7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5424005bb0 0x7f54380ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:48.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.773+0000 7f543d0e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54381f30e0 0x7f54381f3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:48.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.773+0000 7f543d0e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543815a470 0x7f543815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:48.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.773+0000 7f543d0e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543815ae30 con 0x7f543815a470 2023-11-26T07:23:48.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.773+0000 7f543d0e7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54380caec0 con 0x7f54381f30e0 2023-11-26T07:23:48.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.773+0000 7f543d0e7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54380cb1a0 con 0x7f5424005bb0 2023-11-26T07:23:48.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.773+0000 7f543759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543815a470 0x7f543815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:48.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.773+0000 7f543759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543815a470 0x7f543815a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41240/0 (socket says 172.21.15.77:41240) 2023-11-26T07:23:48.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.773+0000 7f543759e640 1 -- 172.21.15.77:0/970977662 learned_addr learned my addr 172.21.15.77:0/970977662 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:48.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.773+0000 7f5436d9d640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5424005bb0 0x7f54380ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:48.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.773+0000 7f542e59c640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54381f30e0 0x7f54381f3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:48.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.774+0000 7f543759e640 1 -- 172.21.15.77:0/970977662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5424005bb0 msgr2=0x7f54380ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:48.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.774+0000 7f543759e640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5424005bb0 0x7f54380ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:48.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.774+0000 7f543759e640 1 -- 172.21.15.77:0/970977662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54381f30e0 msgr2=0x7f54381f3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:48.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.774+0000 7f543759e640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54381f30e0 0x7f54381f3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:48.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.774+0000 7f543759e640 1 -- 172.21.15.77:0/970977662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380cb480 con 0x7f543815a470 2023-11-26T07:23:48.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.774+0000 7f543759e640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543815a470 0x7f543815a8f0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f54380c4e00 tx=0x7f543000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:48.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.774+0000 7f542ffff640 1 -- 172.21.15.77:0/970977662 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543000ed90 con 0x7f543815a470 2023-11-26T07:23:48.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.774+0000 7f542ffff640 1 -- 172.21.15.77:0/970977662 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5430003990 con 0x7f543815a470 2023-11-26T07:23:48.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.774+0000 7f542ffff640 1 -- 172.21.15.77:0/970977662 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430003d40 con 0x7f543815a470 2023-11-26T07:23:48.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.774+0000 7f543d0e7640 1 -- 172.21.15.77:0/970977662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54380cb760 con 0x7f543815a470 2023-11-26T07:23:48.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.775+0000 7f543d0e7640 1 -- 172.21.15.77:0/970977662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54380caaf0 con 0x7f543815a470 2023-11-26T07:23:48.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.776+0000 7f543d0e7640 1 -- 172.21.15.77:0/970977662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54380cac80 con 0x7f543815a470 2023-11-26T07:23:48.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.777+0000 7f542ffff640 1 -- 172.21.15.77:0/970977662 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f5430004030 con 0x7f543815a470 2023-11-26T07:23:48.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.777+0000 7f542ffff640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f541806b8b0 0x7f541806dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:48.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.778+0000 7f542ffff640 1 -- 172.21.15.77:0/970977662 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5430087c00 con 0x7f543815a470 2023-11-26T07:23:48.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.778+0000 7f5436d9d640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f541806b8b0 0x7f541806dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:48.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.778+0000 7f5436d9d640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f541806b8b0 0x7f541806dd70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5428007fd0 tx=0x7f5428009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:48.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:48.782+0000 7f542ffff640 1 -- 172.21.15.77:0/970977662 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f54380cac80 con 0x7f543815a470 2023-11-26T07:23:49.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.008+0000 7f543d0e7640 1 -- 172.21.15.77:0/970977662 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7f54380cb310 con 0x7f541806b8b0 2023-11-26T07:23:49.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.016+0000 7f542ffff640 1 -- 172.21.15.77:0/970977662 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+164 (secure 0 0 0) 0x7f54380cb310 con 0x7f541806b8b0 2023-11-26T07:23:49.019 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:23:49.019 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:23:49.019 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "pending", 2023-11-26T07:23:49.019 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:23:49.019 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:23:49.019 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol55430", 2023-11-26T07:23:49.019 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap6600" 2023-11-26T07:23:49.020 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:49.020 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:49.020 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:23:49.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 -- 172.21.15.77:0/970977662 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f541806b8b0 msgr2=0x7f541806dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:49.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f541806b8b0 0x7f541806dd70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5428007fd0 tx=0x7f5428009030 comp rx=0 tx=0).stop 2023-11-26T07:23:49.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 -- 172.21.15.77:0/970977662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543815a470 msgr2=0x7f543815a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:49.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543815a470 0x7f543815a8f0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f54380c4e00 tx=0x7f543000e4b0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 -- 172.21.15.77:0/970977662 shutdown_connections 2023-11-26T07:23:49.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f541806b8b0 0x7f541806dd70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543815a470 0x7f543815a8f0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54381f30e0 0x7f54381f3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 --2- 172.21.15.77:0/970977662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5424005bb0 0x7f54380ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 -- 172.21.15.77:0/970977662 >> 172.21.15.77:0/970977662 conn(0x7f54380b0c50 msgr2=0x7f54380b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:49.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 -- 172.21.15.77:0/970977662 shutdown_connections 2023-11-26T07:23:49.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:49.019+0000 7f543d0e7640 1 -- 172.21.15.77:0/970977662 wait complete. 2023-11-26T07:23:50.040 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:23:50.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.261+0000 7ff78ad61640 1 Processor -- start 2023-11-26T07:23:50.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.261+0000 7ff78ad61640 1 -- start start 2023-11-26T07:23:50.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.263+0000 7ff78ad61640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff784072160 0x7ff78415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.263+0000 7ff78ad61640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7840c49f0 0x7ff78406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.263+0000 7ff78ad61640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff78406dc40 0x7ff7840cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.263+0000 7ff78ad61640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78406e0d0 con 0x7ff7840c49f0 2023-11-26T07:23:50.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.263+0000 7ff78ad61640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78415ec90 con 0x7ff784072160 2023-11-26T07:23:50.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.263+0000 7ff78ad61640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840cd530 con 0x7ff78406dc40 2023-11-26T07:23:50.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.263+0000 7ff77bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7840c49f0 0x7ff78406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:50.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.263+0000 7ff77bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7840c49f0 0x7ff78406d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41256/0 (socket says 172.21.15.77:41256) 2023-11-26T07:23:50.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.263+0000 7ff77bfff640 1 -- 172.21.15.77:0/1393104119 learned_addr learned my addr 172.21.15.77:0/1393104119 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:50.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.264+0000 7ff7892fe640 1 --2- 172.21.15.77:0/1393104119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff78406dc40 0x7ff7840cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:50.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.264+0000 7ff788afd640 1 --2- 172.21.15.77:0/1393104119 >> v2:172.21.15.159:3300/0 conn(0x7ff784072160 0x7ff78415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:50.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.264+0000 7ff77bfff640 1 -- 172.21.15.77:0/1393104119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff78406dc40 msgr2=0x7ff7840cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:50.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.264+0000 7ff77bfff640 1 --2- 172.21.15.77:0/1393104119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff78406dc40 0x7ff7840cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.264+0000 7ff77bfff640 1 -- 172.21.15.77:0/1393104119 >> v2:172.21.15.159:3300/0 conn(0x7ff784072160 msgr2=0x7ff78415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:50.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.264+0000 7ff77bfff640 1 --2- 172.21.15.77:0/1393104119 >> v2:172.21.15.159:3300/0 conn(0x7ff784072160 0x7ff78415e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.264+0000 7ff77bfff640 1 -- 172.21.15.77:0/1393104119 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7840c4ed0 con 0x7ff7840c49f0 2023-11-26T07:23:50.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.264+0000 7ff7892fe640 1 --2- 172.21.15.77:0/1393104119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff78406dc40 0x7ff7840cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:50.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.264+0000 7ff788afd640 1 --2- 172.21.15.77:0/1393104119 >> v2:172.21.15.159:3300/0 conn(0x7ff784072160 0x7ff78415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:50.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.265+0000 7ff77bfff640 1 --2- 172.21.15.77:0/1393104119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7840c49f0 0x7ff78406d700 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7ff7840ccae0 tx=0x7ff77402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fec6970745f8fe server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:50.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.265+0000 7ff77b7fe640 1 -- 172.21.15.77:0/1393104119 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774031870 con 0x7ff7840c49f0 2023-11-26T07:23:50.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.265+0000 7ff77b7fe640 1 -- 172.21.15.77:0/1393104119 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7740319d0 con 0x7ff7840c49f0 2023-11-26T07:23:50.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.265+0000 7ff77b7fe640 1 -- 172.21.15.77:0/1393104119 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774031d60 con 0x7ff7840c49f0 2023-11-26T07:23:50.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.266+0000 7ff78ad61640 1 -- 172.21.15.77:0/1393104119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7840c49f0 msgr2=0x7ff78406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.266+0000 7ff78ad61640 1 --2- 172.21.15.77:0/1393104119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7840c49f0 0x7ff78406d700 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7ff7840ccae0 tx=0x7ff77402b910 comp rx=0 tx=0).stop 2023-11-26T07:23:50.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.266+0000 7ff78ad61640 1 -- 172.21.15.77:0/1393104119 shutdown_connections 2023-11-26T07:23:50.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.266+0000 7ff78ad61640 1 --2- 172.21.15.77:0/1393104119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff78406dc40 0x7ff7840cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.266+0000 7ff78ad61640 1 --2- 172.21.15.77:0/1393104119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7840c49f0 0x7ff78406d700 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.266+0000 7ff78ad61640 1 --2- 172.21.15.77:0/1393104119 >> v2:172.21.15.159:3300/0 conn(0x7ff784072160 0x7ff78415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.266+0000 7ff78ad61640 1 -- 172.21.15.77:0/1393104119 >> 172.21.15.77:0/1393104119 conn(0x7ff7840b0c50 msgr2=0x7ff7840b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:50.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.266+0000 7ff78ad61640 1 -- 172.21.15.77:0/1393104119 shutdown_connections 2023-11-26T07:23:50.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.266+0000 7ff78ad61640 1 -- 172.21.15.77:0/1393104119 wait complete. 2023-11-26T07:23:50.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.268+0000 7ff78ad61640 1 Processor -- start 2023-11-26T07:23:50.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.268+0000 7ff78ad61640 1 -- start start 2023-11-26T07:23:50.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.269+0000 7ff78ad61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff78406dc40 0x7ff7840999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.269+0000 7ff78ad61640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff784072160 0x7ff78415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.269+0000 7ff78ad61640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7840c49f0 0x7ff78414c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.269+0000 7ff78ad61640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78409b130 con 0x7ff78406dc40 2023-11-26T07:23:50.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.269+0000 7ff78ad61640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78415d300 con 0x7ff784072160 2023-11-26T07:23:50.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.269+0000 7ff78ad61640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78409aca0 con 0x7ff7840c49f0 2023-11-26T07:23:50.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.270+0000 7ff788afd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff78406dc40 0x7ff7840999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:50.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.270+0000 7ff788afd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff78406dc40 0x7ff7840999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41268/0 (socket says 172.21.15.77:41268) 2023-11-26T07:23:50.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.270+0000 7ff788afd640 1 -- 172.21.15.77:0/2527614596 learned_addr learned my addr 172.21.15.77:0/2527614596 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:50.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.270+0000 7ff788afd640 1 -- 172.21.15.77:0/2527614596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7840c49f0 msgr2=0x7ff78414c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.270+0000 7ff788afd640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7840c49f0 0x7ff78414c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.270+0000 7ff788afd640 1 -- 172.21.15.77:0/2527614596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff784072160 msgr2=0x7ff78415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.270+0000 7ff788afd640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff784072160 0x7ff78415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.270+0000 7ff788afd640 1 -- 172.21.15.77:0/2527614596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7740094d0 con 0x7ff78406dc40 2023-11-26T07:23:50.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.270+0000 7ff788afd640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff78406dc40 0x7ff7840999d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c820 tx=0x7ff78000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:50.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.271+0000 7ff7797fa640 1 -- 172.21.15.77:0/2527614596 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7800079d0 con 0x7ff78406dc40 2023-11-26T07:23:50.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.271+0000 7ff7797fa640 1 -- 172.21.15.77:0/2527614596 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff780007b30 con 0x7ff78406dc40 2023-11-26T07:23:50.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.271+0000 7ff7797fa640 1 -- 172.21.15.77:0/2527614596 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78000ce70 con 0x7ff78406dc40 2023-11-26T07:23:50.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.271+0000 7ff78ad61640 1 -- 172.21.15.77:0/2527614596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78409a090 con 0x7ff78406dc40 2023-11-26T07:23:50.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.271+0000 7ff78ad61640 1 -- 172.21.15.77:0/2527614596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78409a650 con 0x7ff78406dc40 2023-11-26T07:23:50.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.272+0000 7ff78ad61640 1 -- 172.21.15.77:0/2527614596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78404e8b0 con 0x7ff78406dc40 2023-11-26T07:23:50.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.273+0000 7ff7797fa640 1 -- 172.21.15.77:0/2527614596 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7ff7800113f0 con 0x7ff78406dc40 2023-11-26T07:23:50.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.274+0000 7ff7797fa640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff77006b8f0 0x7ff77006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.274+0000 7ff7797fa640 1 -- 172.21.15.77:0/2527614596 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff780088110 con 0x7ff78406dc40 2023-11-26T07:23:50.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.275+0000 7ff77bfff640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff77006b8f0 0x7ff77006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:50.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.275+0000 7ff77bfff640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff77006b8f0 0x7ff77006ddb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff774036000 tx=0x7ff774030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:50.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.279+0000 7ff7797fa640 1 -- 172.21.15.77:0/2527614596 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff780054b80 con 0x7ff78406dc40 2023-11-26T07:23:50.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.508+0000 7ff78ad61640 1 -- 172.21.15.77:0/2527614596 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7ff78415eac0 con 0x7ff77006b8f0 2023-11-26T07:23:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.519+0000 7ff7797fa640 1 -- 172.21.15.77:0/2527614596 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+164 (secure 0 0 0) 0x7ff78415eac0 con 0x7ff77006b8f0 2023-11-26T07:23:50.522 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:23:50.522 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:23:50.522 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "pending", 2023-11-26T07:23:50.522 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:23:50.522 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:23:50.522 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol55430", 2023-11-26T07:23:50.522 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap6600" 2023-11-26T07:23:50.522 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:50.522 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:50.522 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:23:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 -- 172.21.15.77:0/2527614596 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff77006b8f0 msgr2=0x7ff77006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff77006b8f0 0x7ff77006ddb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff774036000 tx=0x7ff774030000 comp rx=0 tx=0).stop 2023-11-26T07:23:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 -- 172.21.15.77:0/2527614596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff78406dc40 msgr2=0x7ff7840999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff78406dc40 0x7ff7840999d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c820 tx=0x7ff78000cc20 comp rx=0 tx=0).stop 2023-11-26T07:23:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 -- 172.21.15.77:0/2527614596 shutdown_connections 2023-11-26T07:23:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff77006b8f0 0x7ff77006ddb0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7840c49f0 0x7ff78414c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff784072160 0x7ff78415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 --2- 172.21.15.77:0/2527614596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff78406dc40 0x7ff7840999d0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 -- 172.21.15.77:0/2527614596 >> 172.21.15.77:0/2527614596 conn(0x7ff7840b0c50 msgr2=0x7ff78415e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 -- 172.21.15.77:0/2527614596 shutdown_connections 2023-11-26T07:23:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:50.522+0000 7ff78ad61640 1 -- 172.21.15.77:0/2527614596 wait complete. 2023-11-26T07:23:51.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:23:51.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.784+0000 7fc9e36ad640 1 Processor -- start 2023-11-26T07:23:51.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.785+0000 7fc9e36ad640 1 -- start start 2023-11-26T07:23:51.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.786+0000 7fc9e36ad640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc9dc0c4220 0x7fc9dc0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:51.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.786+0000 7fc9e36ad640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9dc15d7f0 0x7fc9dc0cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:51.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.786+0000 7fc9e36ad640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9dc15e400 con 0x7fc9dc15dc50 2023-11-26T07:23:51.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.786+0000 7fc9e36ad640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9dc0ce880 con 0x7fc9dc0c4220 2023-11-26T07:23:51.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.786+0000 7fc9e36ad640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0c5ed0 con 0x7fc9dc15d7f0 2023-11-26T07:23:51.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.787+0000 7fc9e0c48640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9dc15d7f0 0x7fc9dc0cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:51.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.787+0000 7fc9e1c4a640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fc9dc15dc50 0x7fc9dc0cb0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:57738/0 (socket says 172.21.15.77:57738) 2023-11-26T07:23:51.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.787+0000 7fc9e1c4a640 1 -- 172.21.15.77:0/1631108698 learned_addr learned my addr 172.21.15.77:0/1631108698 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:51.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.787+0000 7fc9e1449640 1 --2- 172.21.15.77:0/1631108698 >> v2:172.21.15.159:3300/0 conn(0x7fc9dc0c4220 0x7fc9dc0c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:51.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.788+0000 7fc9e1449640 1 -- 172.21.15.77:0/1631108698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9dc15d7f0 msgr2=0x7fc9dc0cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:51.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.788+0000 7fc9e1449640 1 --2- 172.21.15.77:0/1631108698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9dc15d7f0 0x7fc9dc0cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:51.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.788+0000 7fc9e1449640 1 -- 172.21.15.77:0/1631108698 >> v1:172.21.15.159:6789/0 conn(0x7fc9dc15dc50 legacy=0x7fc9dc0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:51.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.788+0000 7fc9e1449640 1 -- 172.21.15.77:0/1631108698 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0c46e0 con 0x7fc9dc0c4220 2023-11-26T07:23:51.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.789+0000 7fc9e1449640 1 --2- 172.21.15.77:0/1631108698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9dc0c4220 0x7fc9dc0c5990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc9d80097a0 tx=0x7fc9d802dac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=945ed5fb6aebf0ef server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:51.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.790+0000 7fc9d3fff640 1 -- 172.21.15.77:0/1631108698 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d802f880 con 0x7fc9dc0c4220 2023-11-26T07:23:51.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.790+0000 7fc9d3fff640 1 -- 172.21.15.77:0/1631108698 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d802f9e0 con 0x7fc9dc0c4220 2023-11-26T07:23:51.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.790+0000 7fc9d3fff640 1 -- 172.21.15.77:0/1631108698 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d802fd70 con 0x7fc9dc0c4220 2023-11-26T07:23:51.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.791+0000 7fc9e36ad640 1 -- 172.21.15.77:0/1631108698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9dc0c4220 msgr2=0x7fc9dc0c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:51.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.791+0000 7fc9e36ad640 1 --2- 172.21.15.77:0/1631108698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9dc0c4220 0x7fc9dc0c5990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc9d80097a0 tx=0x7fc9d802dac0 comp rx=0 tx=0).stop 2023-11-26T07:23:51.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.791+0000 7fc9e36ad640 1 -- 172.21.15.77:0/1631108698 shutdown_connections 2023-11-26T07:23:51.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.791+0000 7fc9e36ad640 1 --2- 172.21.15.77:0/1631108698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9dc15d7f0 0x7fc9dc0cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:51.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.791+0000 7fc9e36ad640 1 --2- 172.21.15.77:0/1631108698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9dc0c4220 0x7fc9dc0c5990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:51.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.791+0000 7fc9e36ad640 1 -- 172.21.15.77:0/1631108698 >> 172.21.15.77:0/1631108698 conn(0x7fc9dc0b0c50 msgr2=0x7fc9dc0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:51.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.791+0000 7fc9e36ad640 1 -- 172.21.15.77:0/1631108698 shutdown_connections 2023-11-26T07:23:51.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.791+0000 7fc9e36ad640 1 -- 172.21.15.77:0/1631108698 wait complete. 2023-11-26T07:23:51.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.794+0000 7fc9e36ad640 1 Processor -- start 2023-11-26T07:23:51.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.794+0000 7fc9e36ad640 1 -- start start 2023-11-26T07:23:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.795+0000 7fc9e36ad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9dc0c4220 0x7fc9dc158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.795+0000 7fc9e36ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9dc15d7f0 0x7fc9dc0c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.795+0000 7fc9e36ad640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9dc15dc50 0x7fc9dc0704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.795+0000 7fc9e36ad640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc1f6a50 con 0x7fc9dc15d7f0 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.795+0000 7fc9e36ad640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0c7db0 con 0x7fc9dc0c4220 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.795+0000 7fc9e36ad640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc1f3980 con 0x7fc9dc15dc50 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e0c48640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9dc15d7f0 0x7fc9dc0c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e0c48640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9dc15d7f0 0x7fc9dc0c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41284/0 (socket says 172.21.15.77:41284) 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e0c48640 1 -- 172.21.15.77:0/3766212203 learned_addr learned my addr 172.21.15.77:0/3766212203 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e1449640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9dc0c4220 0x7fc9dc158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e1c4a640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9dc15dc50 0x7fc9dc0704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e0c48640 1 -- 172.21.15.77:0/3766212203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9dc15dc50 msgr2=0x7fc9dc0704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e0c48640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9dc15dc50 0x7fc9dc0704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e0c48640 1 -- 172.21.15.77:0/3766212203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9dc0c4220 msgr2=0x7fc9dc158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e0c48640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9dc0c4220 0x7fc9dc158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:51.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e0c48640 1 -- 172.21.15.77:0/3766212203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d8009400 con 0x7fc9dc15d7f0 2023-11-26T07:23:51.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e1449640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9dc0c4220 0x7fc9dc158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:51.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.796+0000 7fc9e0c48640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9dc15d7f0 0x7fc9dc0c8140 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00e9b0 tx=0x7fc9cc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:51.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.797+0000 7fc9d1ffb640 1 -- 172.21.15.77:0/3766212203 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc009670 con 0x7fc9dc15d7f0 2023-11-26T07:23:51.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.797+0000 7fc9d1ffb640 1 -- 172.21.15.77:0/3766212203 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc00c9a0 con 0x7fc9dc15d7f0 2023-11-26T07:23:51.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.797+0000 7fc9d1ffb640 1 -- 172.21.15.77:0/3766212203 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00cd50 con 0x7fc9dc15d7f0 2023-11-26T07:23:51.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.797+0000 7fc9e36ad640 1 -- 172.21.15.77:0/3766212203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc1f3c60 con 0x7fc9dc15d7f0 2023-11-26T07:23:51.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.797+0000 7fc9e36ad640 1 -- 172.21.15.77:0/3766212203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc1f4220 con 0x7fc9dc15d7f0 2023-11-26T07:23:51.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.798+0000 7fc9e36ad640 1 -- 172.21.15.77:0/3766212203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9dc04e8b0 con 0x7fc9dc15d7f0 2023-11-26T07:23:51.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.799+0000 7fc9d1ffb640 1 -- 172.21.15.77:0/3766212203 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fc9cc013470 con 0x7fc9dc15d7f0 2023-11-26T07:23:51.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.800+0000 7fc9d1ffb640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc9c006b8f0 0x7fc9c006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:51.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.801+0000 7fc9d1ffb640 1 -- 172.21.15.77:0/3766212203 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc9cc088240 con 0x7fc9dc15d7f0 2023-11-26T07:23:51.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.801+0000 7fc9e1449640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc9c006b8f0 0x7fc9c006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:51.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.801+0000 7fc9e1449640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc9c006b8f0 0x7fc9c006ddb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8038000 tx=0x7fc9d8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:51.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:51.805+0000 7fc9d1ffb640 1 -- 172.21.15.77:0/3766212203 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9cc054d40 con 0x7fc9dc15d7f0 2023-11-26T07:23:52.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:52.041+0000 7fc9e36ad640 1 -- 172.21.15.77:0/3766212203 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9dc0c4f80 con 0x7fc9c006b8f0 2023-11-26T07:23:54.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.667+0000 7fc9d1ffb640 1 -- 172.21.15.77:0/3766212203 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+168 (secure 0 0 0) 0x7fc9d802fb50 con 0x7fc9c006b8f0 2023-11-26T07:23:54.670 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:23:54.670 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:23:54.670 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "in-progress", 2023-11-26T07:23:54.670 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:23:54.671 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:23:54.671 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol55430", 2023-11-26T07:23:54.671 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap6600" 2023-11-26T07:23:54.671 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:54.671 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:54.671 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:23:54.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.671+0000 7fc9e36ad640 1 -- 172.21.15.77:0/3766212203 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc9c006b8f0 msgr2=0x7fc9c006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.671+0000 7fc9e36ad640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc9c006b8f0 0x7fc9c006ddb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8038000 tx=0x7fc9d8008030 comp rx=0 tx=0).stop 2023-11-26T07:23:54.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.671+0000 7fc9e36ad640 1 -- 172.21.15.77:0/3766212203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9dc15d7f0 msgr2=0x7fc9dc0c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.671+0000 7fc9e36ad640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9dc15d7f0 0x7fc9dc0c8140 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00e9b0 tx=0x7fc9cc00ee70 comp rx=0 tx=0).stop 2023-11-26T07:23:54.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.671+0000 7fc9e36ad640 1 -- 172.21.15.77:0/3766212203 shutdown_connections 2023-11-26T07:23:54.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.671+0000 7fc9e36ad640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc9c006b8f0 0x7fc9c006ddb0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.671+0000 7fc9e36ad640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9dc15dc50 0x7fc9dc0704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.671+0000 7fc9e36ad640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9dc15d7f0 0x7fc9dc0c8140 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.671+0000 7fc9e36ad640 1 --2- 172.21.15.77:0/3766212203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9dc0c4220 0x7fc9dc158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.671+0000 7fc9e36ad640 1 -- 172.21.15.77:0/3766212203 >> 172.21.15.77:0/3766212203 conn(0x7fc9dc0b0c50 msgr2=0x7fc9dc158920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:54.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.672+0000 7fc9e36ad640 1 -- 172.21.15.77:0/3766212203 shutdown_connections 2023-11-26T07:23:54.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.672+0000 7fc9e36ad640 1 -- 172.21.15.77:0/3766212203 wait complete. 2023-11-26T07:23:54.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:23:54.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.913+0000 7fba25cd1640 1 Processor -- start 2023-11-26T07:23:54.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.913+0000 7fba25cd1640 1 -- start start 2023-11-26T07:23:54.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.914+0000 7fba25cd1640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fba200b0b40 0x7fba200b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.914+0000 7fba25cd1640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 0x7fba2006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.914+0000 7fba25cd1640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2015ed20 con 0x7fba2015b260 2023-11-26T07:23:54.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.915+0000 7fba25cd1640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2015b640 con 0x7fba200b0b40 2023-11-26T07:23:54.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.915+0000 7fba25cd1640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba200b14f0 con 0x7fba2006c5b0 2023-11-26T07:23:54.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.915+0000 7fba254d0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 0x7fba2006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.915+0000 7fba254d0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 0x7fba2006ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:50366/0 (socket says 172.21.15.77:50366) 2023-11-26T07:23:54.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.915+0000 7fba254d0640 1 -- 172.21.15.77:0/988434822 learned_addr learned my addr 172.21.15.77:0/988434822 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:54.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.915+0000 7fba1ffff640 1 --2- 172.21.15.77:0/988434822 >> v2:172.21.15.159:3300/0 conn(0x7fba200b0b40 0x7fba200b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.916+0000 7fba254d0640 1 -- 172.21.15.77:0/988434822 >> v2:172.21.15.159:3300/0 conn(0x7fba200b0b40 msgr2=0x7fba200b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:54.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.916+0000 7fba254d0640 1 --2- 172.21.15.77:0/988434822 >> v2:172.21.15.159:3300/0 conn(0x7fba200b0b40 0x7fba200b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.916+0000 7fba254d0640 1 -- 172.21.15.77:0/988434822 >> v1:172.21.15.159:6789/0 conn(0x7fba2015b260 legacy=0x7fba2006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.916+0000 7fba254d0640 1 -- 172.21.15.77:0/988434822 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2015f8a0 con 0x7fba2006c5b0 2023-11-26T07:23:54.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.918+0000 7fba254d0640 1 --2- 172.21.15.77:0/988434822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 0x7fba2006ca40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba18009e50 tx=0x7fba1802be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d8eaabb4c9d15bc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:54.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.918+0000 7fba1f7fe640 1 -- 172.21.15.77:0/988434822 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1802c9f0 con 0x7fba2006c5b0 2023-11-26T07:23:54.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.918+0000 7fba1f7fe640 1 -- 172.21.15.77:0/988434822 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1802cb50 con 0x7fba2006c5b0 2023-11-26T07:23:54.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.918+0000 7fba1f7fe640 1 -- 172.21.15.77:0/988434822 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba180343f0 con 0x7fba2006c5b0 2023-11-26T07:23:54.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.919+0000 7fba25cd1640 1 -- 172.21.15.77:0/988434822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 msgr2=0x7fba2006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.919+0000 7fba25cd1640 1 --2- 172.21.15.77:0/988434822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 0x7fba2006ca40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba18009e50 tx=0x7fba1802be50 comp rx=0 tx=0).stop 2023-11-26T07:23:54.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.919+0000 7fba25cd1640 1 -- 172.21.15.77:0/988434822 shutdown_connections 2023-11-26T07:23:54.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.919+0000 7fba25cd1640 1 --2- 172.21.15.77:0/988434822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 0x7fba2006ca40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.919+0000 7fba25cd1640 1 --2- 172.21.15.77:0/988434822 >> v2:172.21.15.159:3300/0 conn(0x7fba200b0b40 0x7fba200b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.919+0000 7fba25cd1640 1 -- 172.21.15.77:0/988434822 >> 172.21.15.77:0/988434822 conn(0x7fba200cbb40 msgr2=0x7fba200cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:54.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.919+0000 7fba25cd1640 1 -- 172.21.15.77:0/988434822 shutdown_connections 2023-11-26T07:23:54.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.920+0000 7fba25cd1640 1 -- 172.21.15.77:0/988434822 wait complete. 2023-11-26T07:23:54.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.921+0000 7fba25cd1640 1 Processor -- start 2023-11-26T07:23:54.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.921+0000 7fba25cd1640 1 -- start start 2023-11-26T07:23:54.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.922+0000 7fba25cd1640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 0x7fba2015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.922+0000 7fba25cd1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba200b0b40 0x7fba2009a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.922+0000 7fba25cd1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba2015b260 0x7fba200b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.922+0000 7fba25cd1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2009bc60 con 0x7fba200b0b40 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.922+0000 7fba25cd1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2009a920 con 0x7fba2015b260 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.922+0000 7fba25cd1640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2009abc0 con 0x7fba2006c5b0 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.923+0000 7fba1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba200b0b40 0x7fba2009a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.923+0000 7fba1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba200b0b40 0x7fba2009a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41288/0 (socket says 172.21.15.77:41288) 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.923+0000 7fba1ffff640 1 -- 172.21.15.77:0/3366450799 learned_addr learned my addr 172.21.15.77:0/3366450799 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.923+0000 7fba24ccf640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 0x7fba2015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.923+0000 7fba254d0640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba2015b260 0x7fba200b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.923+0000 7fba1ffff640 1 -- 172.21.15.77:0/3366450799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 msgr2=0x7fba2015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.923+0000 7fba1ffff640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 0x7fba2015dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.923+0000 7fba1ffff640 1 -- 172.21.15.77:0/3366450799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba2015b260 msgr2=0x7fba200b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.923+0000 7fba1ffff640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba2015b260 0x7fba200b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.923+0000 7fba1ffff640 1 -- 172.21.15.77:0/3366450799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba18009b30 con 0x7fba200b0b40 2023-11-26T07:23:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.923+0000 7fba1ffff640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba200b0b40 0x7fba2009a3e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00e870 tx=0x7fba0c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.924+0000 7fba1d7fa640 1 -- 172.21.15.77:0/3366450799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0094f0 con 0x7fba200b0b40 2023-11-26T07:23:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.924+0000 7fba1d7fa640 1 -- 172.21.15.77:0/3366450799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c00c940 con 0x7fba200b0b40 2023-11-26T07:23:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.924+0000 7fba25cd1640 1 -- 172.21.15.77:0/3366450799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2009aea0 con 0x7fba200b0b40 2023-11-26T07:23:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.924+0000 7fba1d7fa640 1 -- 172.21.15.77:0/3366450799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00ccf0 con 0x7fba200b0b40 2023-11-26T07:23:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.924+0000 7fba25cd1640 1 -- 172.21.15.77:0/3366450799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2009b740 con 0x7fba200b0b40 2023-11-26T07:23:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.925+0000 7fba25cd1640 1 -- 172.21.15.77:0/3366450799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2009b2a0 con 0x7fba200b0b40 2023-11-26T07:23:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.926+0000 7fba1d7fa640 1 -- 172.21.15.77:0/3366450799 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fba0c013470 con 0x7fba200b0b40 2023-11-26T07:23:54.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.927+0000 7fba1d7fa640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fba0406b8f0 0x7fba0406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.928+0000 7fba1d7fa640 1 -- 172.21.15.77:0/3366450799 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fba0c0880f0 con 0x7fba200b0b40 2023-11-26T07:23:54.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.928+0000 7fba24ccf640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fba0406b8f0 0x7fba0406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.929+0000 7fba24ccf640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fba0406b8f0 0x7fba0406ddb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fba14000f60 tx=0x7fba14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:54.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:54.932+0000 7fba1d7fa640 1 -- 172.21.15.77:0/3366450799 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba0c054bb0 con 0x7fba200b0b40 2023-11-26T07:23:55.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.199+0000 7fba25cd1640 1 -- 172.21.15.77:0/3366450799 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7fba20067de0 con 0x7fba0406b8f0 2023-11-26T07:23:55.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.218+0000 7fba1d7fa640 1 -- 172.21.15.77:0/3366450799 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+168 (secure 0 0 0) 0x7fba20067de0 con 0x7fba0406b8f0 2023-11-26T07:23:55.221 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:23:55.221 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:23:55.221 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "in-progress", 2023-11-26T07:23:55.221 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:23:55.221 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:23:55.221 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol55430", 2023-11-26T07:23:55.221 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap6600" 2023-11-26T07:23:55.221 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:55.221 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:55.221 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:23:55.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.221+0000 7fba25cd1640 1 -- 172.21.15.77:0/3366450799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fba0406b8f0 msgr2=0x7fba0406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.221+0000 7fba25cd1640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fba0406b8f0 0x7fba0406ddb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fba14000f60 tx=0x7fba14009040 comp rx=0 tx=0).stop 2023-11-26T07:23:55.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.221+0000 7fba25cd1640 1 -- 172.21.15.77:0/3366450799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba200b0b40 msgr2=0x7fba2009a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.221+0000 7fba25cd1640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba200b0b40 0x7fba2009a3e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00e870 tx=0x7fba0c00ed30 comp rx=0 tx=0).stop 2023-11-26T07:23:55.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.221+0000 7fba25cd1640 1 -- 172.21.15.77:0/3366450799 shutdown_connections 2023-11-26T07:23:55.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.221+0000 7fba25cd1640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fba0406b8f0 0x7fba0406ddb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.222+0000 7fba25cd1640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba2015b260 0x7fba200b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.222+0000 7fba25cd1640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba200b0b40 0x7fba2009a3e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.222+0000 7fba25cd1640 1 --2- 172.21.15.77:0/3366450799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba2006c5b0 0x7fba2015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.222+0000 7fba25cd1640 1 -- 172.21.15.77:0/3366450799 >> 172.21.15.77:0/3366450799 conn(0x7fba200cbb40 msgr2=0x7fba200af420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:55.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.222+0000 7fba25cd1640 1 -- 172.21.15.77:0/3366450799 shutdown_connections 2023-11-26T07:23:55.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.222+0000 7fba25cd1640 1 -- 172.21.15.77:0/3366450799 wait complete. 2023-11-26T07:23:55.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:23:55.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.456+0000 7f517dc02640 1 Processor -- start 2023-11-26T07:23:55.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.456+0000 7f517dc02640 1 -- start start 2023-11-26T07:23:55.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.458+0000 7f517dc02640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5178072160 0x7f517815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.458+0000 7f517dc02640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51780c49f0 0x7f517806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.458+0000 7f517dc02640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517815ec90 con 0x7f517806dc40 2023-11-26T07:23:55.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.458+0000 7f517dc02640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517806e090 con 0x7f51780c49f0 2023-11-26T07:23:55.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.458+0000 7f517dc02640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51780cd530 con 0x7f5178072160 2023-11-26T07:23:55.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.458+0000 7f5176ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51780c49f0 0x7f517806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:55.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.458+0000 7f5177fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f517806dc40 0x7f51780cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51528/0 (socket says 172.21.15.77:51528) 2023-11-26T07:23:55.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.458+0000 7f5177fff640 1 -- 172.21.15.77:0/2790952580 learned_addr learned my addr 172.21.15.77:0/2790952580 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:23:55.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.458+0000 7f5176ffd640 1 -- 172.21.15.77:0/2790952580 >> v2:172.21.15.159:3300/0 conn(0x7f5178072160 msgr2=0x7f517815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:55.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.458+0000 7f51777fe640 1 --2- 172.21.15.77:0/2790952580 >> v2:172.21.15.159:3300/0 conn(0x7f5178072160 0x7f517815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:55.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.459+0000 7f5176ffd640 1 --2- 172.21.15.77:0/2790952580 >> v2:172.21.15.159:3300/0 conn(0x7f5178072160 0x7f517815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.459+0000 7f5176ffd640 1 -- 172.21.15.77:0/2790952580 >> v1:172.21.15.77:6789/0 conn(0x7f517806dc40 legacy=0x7f51780cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.459+0000 7f5176ffd640 1 -- 172.21.15.77:0/2790952580 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51780c4ed0 con 0x7f51780c49f0 2023-11-26T07:23:55.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.459+0000 7f51767fc640 1 -- 172.21.15.77:0/2790952580 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352562832 0 0) 0x7f5170001490 con 0x7f517806dc40 2023-11-26T07:23:55.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.459+0000 7f51777fe640 1 --2- 172.21.15.77:0/2790952580 >> v2:172.21.15.159:3300/0 conn(0x7f5178072160 0x7f517815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:55.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.460+0000 7f5176ffd640 1 --2- 172.21.15.77:0/2790952580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51780c49f0 0x7f517806d700 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f51780ccae0 tx=0x7f516c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874b3d1b9c0712c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:55.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.460+0000 7f51767fc640 1 -- 172.21.15.77:0/2790952580 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c031830 con 0x7f51780c49f0 2023-11-26T07:23:55.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.460+0000 7f51767fc640 1 -- 172.21.15.77:0/2790952580 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c031990 con 0x7f51780c49f0 2023-11-26T07:23:55.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.460+0000 7f51767fc640 1 -- 172.21.15.77:0/2790952580 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c031d20 con 0x7f51780c49f0 2023-11-26T07:23:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.461+0000 7f517dc02640 1 -- 172.21.15.77:0/2790952580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51780c49f0 msgr2=0x7f517806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.461+0000 7f517dc02640 1 --2- 172.21.15.77:0/2790952580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51780c49f0 0x7f517806d700 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f51780ccae0 tx=0x7f516c02b8d0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.461+0000 7f517dc02640 1 -- 172.21.15.77:0/2790952580 shutdown_connections 2023-11-26T07:23:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.461+0000 7f517dc02640 1 --2- 172.21.15.77:0/2790952580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51780c49f0 0x7f517806d700 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.461+0000 7f517dc02640 1 --2- 172.21.15.77:0/2790952580 >> v2:172.21.15.159:3300/0 conn(0x7f5178072160 0x7f517815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.461+0000 7f517dc02640 1 -- 172.21.15.77:0/2790952580 >> 172.21.15.77:0/2790952580 conn(0x7f51780b0c50 msgr2=0x7f51780b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.461+0000 7f517dc02640 1 -- 172.21.15.77:0/2790952580 shutdown_connections 2023-11-26T07:23:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.461+0000 7f517dc02640 1 -- 172.21.15.77:0/2790952580 wait complete. 2023-11-26T07:23:55.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.463+0000 7f517dc02640 1 Processor -- start 2023-11-26T07:23:55.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.463+0000 7f517dc02640 1 -- start start 2023-11-26T07:23:55.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.464+0000 7f517dc02640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f517806dc40 0x7f517814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.464+0000 7f517dc02640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5178072160 0x7f517815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.464+0000 7f517dc02640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51780c49f0 0x7f517809a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.464+0000 7f517dc02640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517814e760 con 0x7f5178072160 2023-11-26T07:23:55.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.464+0000 7f517dc02640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5178157c20 con 0x7f51780c49f0 2023-11-26T07:23:55.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.464+0000 7f517dc02640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5178157f00 con 0x7f517806dc40 2023-11-26T07:23:55.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.465+0000 7f5176ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5178072160 0x7f517815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:55.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.465+0000 7f5176ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5178072160 0x7f517815b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41294/0 (socket says 172.21.15.77:41294) 2023-11-26T07:23:55.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.465+0000 7f5176ffd640 1 -- 172.21.15.77:0/1902468711 learned_addr learned my addr 172.21.15.77:0/1902468711 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.465+0000 7f5176ffd640 1 -- 172.21.15.77:0/1902468711 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f517806dc40 msgr2=0x7f517814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.465+0000 7f5176ffd640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f517806dc40 0x7f517814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.465+0000 7f5176ffd640 1 -- 172.21.15.77:0/1902468711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51780c49f0 msgr2=0x7f517809a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.465+0000 7f5176ffd640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51780c49f0 0x7f517809a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.465+0000 7f5176ffd640 1 -- 172.21.15.77:0/1902468711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c009400 con 0x7f5178072160 2023-11-26T07:23:55.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.466+0000 7f5176ffd640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5178072160 0x7f517815b280 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f516c009890 tx=0x7f516c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:55.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.466+0000 7f515ffff640 1 -- 172.21.15.77:0/1902468711 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c03ba70 con 0x7f5178072160 2023-11-26T07:23:55.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.466+0000 7f515ffff640 1 -- 172.21.15.77:0/1902468711 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c03bbf0 con 0x7f5178072160 2023-11-26T07:23:55.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.466+0000 7f517dc02640 1 -- 172.21.15.77:0/1902468711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51781581e0 con 0x7f5178072160 2023-11-26T07:23:55.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.466+0000 7f515ffff640 1 -- 172.21.15.77:0/1902468711 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c045400 con 0x7f5178072160 2023-11-26T07:23:55.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.466+0000 7f517dc02640 1 -- 172.21.15.77:0/1902468711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51781587a0 con 0x7f5178072160 2023-11-26T07:23:55.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.467+0000 7f517dc02640 1 -- 172.21.15.77:0/1902468711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5178158990 con 0x7f5178072160 2023-11-26T07:23:55.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.468+0000 7f515ffff640 1 -- 172.21.15.77:0/1902468711 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f516c04e440 con 0x7f5178072160 2023-11-26T07:23:55.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.469+0000 7f515ffff640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f516406b8f0 0x7f516406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.469+0000 7f515ffff640 1 -- 172.21.15.77:0/1902468711 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f516c0aa2f0 con 0x7f5178072160 2023-11-26T07:23:55.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.469+0000 7f51777fe640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f516406b8f0 0x7f516406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:55.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.470+0000 7f51777fe640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f516406b8f0 0x7f516406ddb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5168006fd0 tx=0x7f5168008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:55.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.474+0000 7f515ffff640 1 -- 172.21.15.77:0/1902468711 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f516c076df0 con 0x7f5178072160 2023-11-26T07:23:55.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.758+0000 7f517dc02640 1 -- 172.21.15.77:0/1902468711 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7f51780c5770 con 0x7f516406b8f0 2023-11-26T07:23:55.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.768+0000 7f515ffff640 1 -- 172.21.15.77:0/1902468711 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+168 (secure 0 0 0) 0x7f516800ae40 con 0x7f516406b8f0 2023-11-26T07:23:55.771 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:23:55.771 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:23:55.771 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "in-progress", 2023-11-26T07:23:55.771 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:23:55.771 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:23:55.771 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol55430", 2023-11-26T07:23:55.771 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap6600" 2023-11-26T07:23:55.771 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:55.772 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:55.772 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:23:55.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 -- 172.21.15.77:0/1902468711 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f516406b8f0 msgr2=0x7f516406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f516406b8f0 0x7f516406ddb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5168006fd0 tx=0x7f5168008040 comp rx=0 tx=0).stop 2023-11-26T07:23:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 -- 172.21.15.77:0/1902468711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5178072160 msgr2=0x7f517815b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5178072160 0x7f517815b280 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f516c009890 tx=0x7f516c0046c0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 -- 172.21.15.77:0/1902468711 shutdown_connections 2023-11-26T07:23:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f516406b8f0 0x7f516406ddb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51780c49f0 0x7f517809a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5178072160 0x7f517815b280 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 --2- 172.21.15.77:0/1902468711 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f517806dc40 0x7f517814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 -- 172.21.15.77:0/1902468711 >> 172.21.15.77:0/1902468711 conn(0x7f51780b0c50 msgr2=0x7f5178070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 -- 172.21.15.77:0/1902468711 shutdown_connections 2023-11-26T07:23:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:55.771+0000 7f517dc02640 1 -- 172.21.15.77:0/1902468711 wait complete. 2023-11-26T07:23:56.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:23:57.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.031+0000 7f15111ea640 1 Processor -- start 2023-11-26T07:23:57.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.031+0000 7f15111ea640 1 -- start start 2023-11-26T07:23:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.032+0000 7f15111ea640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f150c0cfb90 0x7f150c161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.032+0000 7f15111ea640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f150c161fa0 0x7f150c06ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.032+0000 7f15111ea640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c1612f0 con 0x7f150c0b2400 2023-11-26T07:23:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.032+0000 7f15111ea640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150c0cff70 con 0x7f150c0cfb90 2023-11-26T07:23:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.032+0000 7f15111ea640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0afb20 con 0x7f150c161fa0 2023-11-26T07:23:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.033+0000 7f150ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f150c0cfb90 0x7f150c161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.033+0000 7f150ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f150c0cfb90 0x7f150c161a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60682/0 (socket says 172.21.15.77:60682) 2023-11-26T07:23:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.033+0000 7f150ad9d640 1 -- 172.21.15.77:0/1679422387 learned_addr learned my addr 172.21.15.77:0/1679422387 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.033+0000 7f150ad9d640 1 -- 172.21.15.77:0/1679422387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f150c161fa0 msgr2=0x7f150c06ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.033+0000 7f1503fff640 1 --2- 172.21.15.77:0/1679422387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f150c161fa0 0x7f150c06ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.033+0000 7f150ad9d640 1 --2- 172.21.15.77:0/1679422387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f150c161fa0 0x7f150c06ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.033+0000 7f150ad9d640 1 -- 172.21.15.77:0/1679422387 >> v1:172.21.15.159:6789/0 conn(0x7f150c0b2400 legacy=0x7f150c0cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.033+0000 7f150ad9d640 1 -- 172.21.15.77:0/1679422387 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c06a850 con 0x7f150c0cfb90 2023-11-26T07:23:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.033+0000 7f1503fff640 1 --2- 172.21.15.77:0/1679422387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f150c161fa0 0x7f150c06ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:57.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.034+0000 7f150ad9d640 1 --2- 172.21.15.77:0/1679422387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150c0cfb90 0x7f150c161a60 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0098a0 tx=0x7f14fc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99b9738a55f6197 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:57.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.035+0000 7f150a59c640 1 -- 172.21.15.77:0/1679422387 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc030840 con 0x7f150c0cfb90 2023-11-26T07:23:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.035+0000 7f150a59c640 1 -- 172.21.15.77:0/1679422387 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc0309a0 con 0x7f150c0cfb90 2023-11-26T07:23:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.035+0000 7f150a59c640 1 -- 172.21.15.77:0/1679422387 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc030d30 con 0x7f150c0cfb90 2023-11-26T07:23:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.035+0000 7f15111ea640 1 -- 172.21.15.77:0/1679422387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150c0cfb90 msgr2=0x7f150c161a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.035+0000 7f15111ea640 1 --2- 172.21.15.77:0/1679422387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150c0cfb90 0x7f150c161a60 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0098a0 tx=0x7f14fc02b980 comp rx=0 tx=0).stop 2023-11-26T07:23:57.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.036+0000 7f15111ea640 1 -- 172.21.15.77:0/1679422387 shutdown_connections 2023-11-26T07:23:57.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.036+0000 7f15111ea640 1 --2- 172.21.15.77:0/1679422387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f150c161fa0 0x7f150c06ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.036+0000 7f15111ea640 1 --2- 172.21.15.77:0/1679422387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150c0cfb90 0x7f150c161a60 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.036+0000 7f15111ea640 1 -- 172.21.15.77:0/1679422387 >> 172.21.15.77:0/1679422387 conn(0x7f150c0999d0 msgr2=0x7f150c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:57.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.036+0000 7f15111ea640 1 -- 172.21.15.77:0/1679422387 shutdown_connections 2023-11-26T07:23:57.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.036+0000 7f15111ea640 1 -- 172.21.15.77:0/1679422387 wait complete. 2023-11-26T07:23:57.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.038+0000 7f15111ea640 1 Processor -- start 2023-11-26T07:23:57.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.038+0000 7f15111ea640 1 -- start start 2023-11-26T07:23:57.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.039+0000 7f15111ea640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f150c0b2400 0x7f150c160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.039+0000 7f15111ea640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f150c0cfb90 0x7f150c159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.039+0000 7f15111ea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150c15e800 0x7f150c14b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.039+0000 7f15111ea640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c1490b0 con 0x7f150c15e800 2023-11-26T07:23:57.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.039+0000 7f15111ea640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c15f8b0 con 0x7f150c0cfb90 2023-11-26T07:23:57.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.039+0000 7f15111ea640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c15f010 con 0x7f150c0b2400 2023-11-26T07:23:57.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f150b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150c15e800 0x7f150c14b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f150b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150c15e800 0x7f150c14b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60696/0 (socket says 172.21.15.77:60696) 2023-11-26T07:23:57.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f150b59e640 1 -- 172.21.15.77:0/3310237658 learned_addr learned my addr 172.21.15.77:0/3310237658 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:57.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f150ad9d640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f150c0b2400 0x7f150c160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f1503fff640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f150c0cfb90 0x7f150c159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f150b59e640 1 -- 172.21.15.77:0/3310237658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f150c0b2400 msgr2=0x7f150c160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f150b59e640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f150c0b2400 0x7f150c160c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f150b59e640 1 -- 172.21.15.77:0/3310237658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f150c0cfb90 msgr2=0x7f150c159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f150b59e640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f150c0cfb90 0x7f150c159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f150b59e640 1 -- 172.21.15.77:0/3310237658 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc0094d0 con 0x7f150c15e800 2023-11-26T07:23:57.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f1503fff640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f150c0cfb90 0x7f150c159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:57.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.040+0000 7f150b59e640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150c15e800 0x7f150c14b3d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f150400ba10 tx=0x7f150400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:57.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.041+0000 7f15037fe640 1 -- 172.21.15.77:0/3310237658 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150400cb40 con 0x7f150c15e800 2023-11-26T07:23:57.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.041+0000 7f15037fe640 1 -- 172.21.15.77:0/3310237658 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150400cca0 con 0x7f150c15e800 2023-11-26T07:23:57.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.041+0000 7f15037fe640 1 -- 172.21.15.77:0/3310237658 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504014680 con 0x7f150c15e800 2023-11-26T07:23:57.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.041+0000 7f15111ea640 1 -- 172.21.15.77:0/3310237658 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c15f2f0 con 0x7f150c15e800 2023-11-26T07:23:57.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.041+0000 7f15111ea640 1 -- 172.21.15.77:0/3310237658 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c0b2ef0 con 0x7f150c15e800 2023-11-26T07:23:57.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.042+0000 7f15111ea640 1 -- 172.21.15.77:0/3310237658 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c04e8b0 con 0x7f150c15e800 2023-11-26T07:23:57.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.043+0000 7f15037fe640 1 -- 172.21.15.77:0/3310237658 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f150401d3b0 con 0x7f150c15e800 2023-11-26T07:23:57.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.044+0000 7f15037fe640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f14ec06b8f0 0x7f14ec06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.044+0000 7f15037fe640 1 -- 172.21.15.77:0/3310237658 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1504087e50 con 0x7f150c15e800 2023-11-26T07:23:57.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.044+0000 7f150ad9d640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f14ec06b8f0 0x7f14ec06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.045+0000 7f150ad9d640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f14ec06b8f0 0x7f14ec06ddb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f14fc036000 tx=0x7f14fc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:57.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.049+0000 7f15037fe640 1 -- 172.21.15.77:0/3310237658 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1504054990 con 0x7f150c15e800 2023-11-26T07:23:57.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.319+0000 7f15111ea640 1 -- 172.21.15.77:0/3310237658 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7f150c161540 con 0x7f14ec06b8f0 2023-11-26T07:23:57.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.327+0000 7f15037fe640 1 -- 172.21.15.77:0/3310237658 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+168 (secure 0 0 0) 0x7f14fc0307e0 con 0x7f14ec06b8f0 2023-11-26T07:23:57.331 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:23:57.331 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:23:57.331 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "in-progress", 2023-11-26T07:23:57.331 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:23:57.331 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:23:57.332 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol55430", 2023-11-26T07:23:57.332 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap6600" 2023-11-26T07:23:57.332 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:57.332 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:57.332 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:23:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.330+0000 7f15111ea640 1 -- 172.21.15.77:0/3310237658 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f14ec06b8f0 msgr2=0x7f14ec06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.330+0000 7f15111ea640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f14ec06b8f0 0x7f14ec06ddb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f14fc036000 tx=0x7f14fc008030 comp rx=0 tx=0).stop 2023-11-26T07:23:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.330+0000 7f15111ea640 1 -- 172.21.15.77:0/3310237658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150c15e800 msgr2=0x7f150c14b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.330+0000 7f15111ea640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150c15e800 0x7f150c14b3d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f150400ba10 tx=0x7f150400bed0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.330+0000 7f15111ea640 1 -- 172.21.15.77:0/3310237658 shutdown_connections 2023-11-26T07:23:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.331+0000 7f15111ea640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f14ec06b8f0 0x7f14ec06ddb0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.331+0000 7f15111ea640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150c15e800 0x7f150c14b3d0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.331+0000 7f15111ea640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f150c0cfb90 0x7f150c159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.331+0000 7f15111ea640 1 --2- 172.21.15.77:0/3310237658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f150c0b2400 0x7f150c160c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.331+0000 7f15111ea640 1 -- 172.21.15.77:0/3310237658 >> 172.21.15.77:0/3310237658 conn(0x7f150c0999d0 msgr2=0x7f150c0ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.331+0000 7f15111ea640 1 -- 172.21.15.77:0/3310237658 shutdown_connections 2023-11-26T07:23:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:57.331+0000 7f15111ea640 1 -- 172.21.15.77:0/3310237658 wait complete. 2023-11-26T07:23:58.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:23:58.321 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:23:58.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:23:58.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.574+0000 7f8ca8516640 1 Processor -- start 2023-11-26T07:23:58.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.574+0000 7f8ca8516640 1 -- start start 2023-11-26T07:23:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.575+0000 7f8ca8516640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ca00d3a40 0x7f8ca006ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.575+0000 7f8ca8516640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8ca00b1ed0 0x7f8ca006bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.575+0000 7f8ca8516640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca015db00 con 0x7f8ca015d720 2023-11-26T07:23:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.575+0000 7f8ca8516640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca00d0ce0 con 0x7f8ca00d3a40 2023-11-26T07:23:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.575+0000 7f8ca8516640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca006d400 con 0x7f8ca00b1ed0 2023-11-26T07:23:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.576+0000 7f8ca5ab1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ca00d3a40 0x7f8ca006ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.576+0000 7f8ca5ab1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ca00d3a40 0x7f8ca006ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60702/0 (socket says 172.21.15.77:60702) 2023-11-26T07:23:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.576+0000 7f8ca5ab1640 1 -- 172.21.15.77:0/2206629977 learned_addr learned my addr 172.21.15.77:0/2206629977 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.576+0000 7f8ca6ab3640 1 --2- 172.21.15.77:0/2206629977 >> v2:172.21.15.159:3300/0 conn(0x7f8ca00b1ed0 0x7f8ca006bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.576+0000 7f8ca5ab1640 1 -- 172.21.15.77:0/2206629977 >> v2:172.21.15.159:3300/0 conn(0x7f8ca00b1ed0 msgr2=0x7f8ca006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.576+0000 7f8ca5ab1640 1 --2- 172.21.15.77:0/2206629977 >> v2:172.21.15.159:3300/0 conn(0x7f8ca00b1ed0 0x7f8ca006bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.576+0000 7f8ca5ab1640 1 -- 172.21.15.77:0/2206629977 >> v1:172.21.15.159:6789/0 conn(0x7f8ca015d720 legacy=0x7f8ca00d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.576+0000 7f8ca5ab1640 1 -- 172.21.15.77:0/2206629977 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca00b0100 con 0x7f8ca00d3a40 2023-11-26T07:23:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.576+0000 7f8ca6ab3640 1 --2- 172.21.15.77:0/2206629977 >> v2:172.21.15.159:3300/0 conn(0x7f8ca00b1ed0 0x7f8ca006bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:58.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.578+0000 7f8ca5ab1640 1 --2- 172.21.15.77:0/2206629977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca00d3a40 0x7f8ca006ba80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8ca008b750 tx=0x7f8c9002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31626ea5251320a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:58.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.578+0000 7f8ca52b0640 1 -- 172.21.15.77:0/2206629977 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c900317e0 con 0x7f8ca00d3a40 2023-11-26T07:23:58.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.578+0000 7f8ca52b0640 1 -- 172.21.15.77:0/2206629977 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c90031940 con 0x7f8ca00d3a40 2023-11-26T07:23:58.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.578+0000 7f8ca52b0640 1 -- 172.21.15.77:0/2206629977 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90031cd0 con 0x7f8ca00d3a40 2023-11-26T07:23:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.579+0000 7f8ca8516640 1 -- 172.21.15.77:0/2206629977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca00d3a40 msgr2=0x7f8ca006ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.579+0000 7f8ca8516640 1 --2- 172.21.15.77:0/2206629977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca00d3a40 0x7f8ca006ba80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8ca008b750 tx=0x7f8c9002b880 comp rx=0 tx=0).stop 2023-11-26T07:23:58.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.579+0000 7f8ca8516640 1 -- 172.21.15.77:0/2206629977 shutdown_connections 2023-11-26T07:23:58.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.579+0000 7f8ca8516640 1 --2- 172.21.15.77:0/2206629977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca00d3a40 0x7f8ca006ba80 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.579+0000 7f8ca8516640 1 --2- 172.21.15.77:0/2206629977 >> v2:172.21.15.159:3300/0 conn(0x7f8ca00b1ed0 0x7f8ca006bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.579+0000 7f8ca8516640 1 -- 172.21.15.77:0/2206629977 >> 172.21.15.77:0/2206629977 conn(0x7f8ca008af60 msgr2=0x7f8ca009c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:58.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.579+0000 7f8ca8516640 1 -- 172.21.15.77:0/2206629977 shutdown_connections 2023-11-26T07:23:58.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.579+0000 7f8ca8516640 1 -- 172.21.15.77:0/2206629977 wait complete. 2023-11-26T07:23:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.581+0000 7f8ca8516640 1 Processor -- start 2023-11-26T07:23:58.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.582+0000 7f8ca8516640 1 -- start start 2023-11-26T07:23:58.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca8516640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ca00b1ed0 0x7f8ca00b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca8516640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca00d3a40 0x7f8ca0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca8516640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ca015d720 0x7f8ca00b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca8516640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00c8230 con 0x7f8ca00d3a40 2023-11-26T07:23:58.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca8516640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00c7ec0 con 0x7f8ca015d720 2023-11-26T07:23:58.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca8516640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00b64a0 con 0x7f8ca00b1ed0 2023-11-26T07:23:58.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca5ab1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca00d3a40 0x7f8ca0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca5ab1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca00d3a40 0x7f8ca0159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60704/0 (socket says 172.21.15.77:60704) 2023-11-26T07:23:58.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca5ab1640 1 -- 172.21.15.77:0/960068017 learned_addr learned my addr 172.21.15.77:0/960068017 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:23:58.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca62b2640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ca00b1ed0 0x7f8ca00b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca6ab3640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ca015d720 0x7f8ca00b85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca5ab1640 1 -- 172.21.15.77:0/960068017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ca00b1ed0 msgr2=0x7f8ca00b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.583+0000 7f8ca5ab1640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ca00b1ed0 0x7f8ca00b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.584+0000 7f8ca5ab1640 1 -- 172.21.15.77:0/960068017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ca015d720 msgr2=0x7f8ca00b85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.584+0000 7f8ca5ab1640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ca015d720 0x7f8ca00b85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.584+0000 7f8ca5ab1640 1 -- 172.21.15.77:0/960068017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c900094d0 con 0x7f8ca00d3a40 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.584+0000 7f8ca5ab1640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca00d3a40 0x7f8ca0159aa0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8c9002b8c0 tx=0x7f8c900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:58.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.584+0000 7f8c96ffd640 1 -- 172.21.15.77:0/960068017 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c900329c0 con 0x7f8ca00d3a40 2023-11-26T07:23:58.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.584+0000 7f8c96ffd640 1 -- 172.21.15.77:0/960068017 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c90032b40 con 0x7f8ca00d3a40 2023-11-26T07:23:58.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.584+0000 7f8ca8516640 1 -- 172.21.15.77:0/960068017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca0159fe0 con 0x7f8ca00d3a40 2023-11-26T07:23:58.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.584+0000 7f8c96ffd640 1 -- 172.21.15.77:0/960068017 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c900453f0 con 0x7f8ca00d3a40 2023-11-26T07:23:58.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.584+0000 7f8ca8516640 1 -- 172.21.15.77:0/960068017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca00b6d30 con 0x7f8ca00d3a40 2023-11-26T07:23:58.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.585+0000 7f8ca8516640 1 -- 172.21.15.77:0/960068017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca00d1870 con 0x7f8ca00d3a40 2023-11-26T07:23:58.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.586+0000 7f8c96ffd640 1 -- 172.21.15.77:0/960068017 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f8c9004e450 con 0x7f8ca00d3a40 2023-11-26T07:23:58.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.587+0000 7f8c96ffd640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8c8406b8f0 0x7f8c8406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.587+0000 7f8c96ffd640 1 -- 172.21.15.77:0/960068017 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8c900aa2b0 con 0x7f8ca00d3a40 2023-11-26T07:23:58.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.588+0000 7f8ca62b2640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8c8406b8f0 0x7f8c8406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.588+0000 7f8ca62b2640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8c8406b8f0 0x7f8c8406ddb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c006fd0 tx=0x7f8c9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:58.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.592+0000 7f8c96ffd640 1 -- 172.21.15.77:0/960068017 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c90076db0 con 0x7f8ca00d3a40 2023-11-26T07:23:58.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.873+0000 7f8ca8516640 1 -- 172.21.15.77:0/960068017 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ca00b09a0 con 0x7f8c8406b8f0 2023-11-26T07:23:58.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.885+0000 7f8c96ffd640 1 -- 172.21.15.77:0/960068017 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+168 (secure 0 0 0) 0x7f8c9c00bd80 con 0x7f8c8406b8f0 2023-11-26T07:23:58.888 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:23:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:23:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "in-progress", 2023-11-26T07:23:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:23:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:23:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol55430", 2023-11-26T07:23:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap6600" 2023-11-26T07:23:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:23:58.888 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:23:58.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 -- 172.21.15.77:0/960068017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8c8406b8f0 msgr2=0x7f8c8406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8c8406b8f0 0x7f8c8406ddb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c006fd0 tx=0x7f8c9c008040 comp rx=0 tx=0).stop 2023-11-26T07:23:58.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 -- 172.21.15.77:0/960068017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca00d3a40 msgr2=0x7f8ca0159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca00d3a40 0x7f8ca0159aa0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8c9002b8c0 tx=0x7f8c900046c0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 -- 172.21.15.77:0/960068017 shutdown_connections 2023-11-26T07:23:58.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f8c8406b8f0 0x7f8c8406ddb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ca015d720 0x7f8ca00b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca00d3a40 0x7f8ca0159aa0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 --2- 172.21.15.77:0/960068017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ca00b1ed0 0x7f8ca00b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 -- 172.21.15.77:0/960068017 >> 172.21.15.77:0/960068017 conn(0x7f8ca008af60 msgr2=0x7f8ca00b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:58.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 -- 172.21.15.77:0/960068017 shutdown_connections 2023-11-26T07:23:58.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:23:58.888+0000 7f8ca8516640 1 -- 172.21.15.77:0/960068017 wait complete. 2023-11-26T07:23:59.910 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:24:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.135+0000 7f5f7104b640 1 Processor -- start 2023-11-26T07:24:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.135+0000 7f5f7104b640 1 -- start start 2023-11-26T07:24:00.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.137+0000 7f5f7104b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5f6c072160 0x7f5f6c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.137+0000 7f5f7104b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5f6c0c49f0 0x7f5f6c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.137+0000 7f5f7104b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f6c06dc40 0x7f5f6c0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.137+0000 7f5f7104b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c06e0d0 con 0x7f5f6c072160 2023-11-26T07:24:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.137+0000 7f5f7104b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c15ec90 con 0x7f5f6c0c49f0 2023-11-26T07:24:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.137+0000 7f5f7104b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0cd530 con 0x7f5f6c06dc40 2023-11-26T07:24:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.137+0000 7f5f6ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5f6c072160 0x7f5f6c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.137+0000 7f5f6ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5f6c072160 0x7f5f6c15e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60716/0 (socket says 172.21.15.77:60716) 2023-11-26T07:24:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.137+0000 7f5f6ad9d640 1 -- 172.21.15.77:0/1067059942 learned_addr learned my addr 172.21.15.77:0/1067059942 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.138+0000 7f5f6a59c640 1 --2- 172.21.15.77:0/1067059942 >> v2:172.21.15.159:3300/0 conn(0x7f5f6c0c49f0 0x7f5f6c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.138+0000 7f5f6b59e640 1 --2- 172.21.15.77:0/1067059942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f6c06dc40 0x7f5f6c0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.138+0000 7f5f6ad9d640 1 -- 172.21.15.77:0/1067059942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f6c06dc40 msgr2=0x7f5f6c0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.138+0000 7f5f6ad9d640 1 --2- 172.21.15.77:0/1067059942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f6c06dc40 0x7f5f6c0cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.138+0000 7f5f6ad9d640 1 -- 172.21.15.77:0/1067059942 >> v2:172.21.15.159:3300/0 conn(0x7f5f6c0c49f0 msgr2=0x7f5f6c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:00.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.138+0000 7f5f6ad9d640 1 --2- 172.21.15.77:0/1067059942 >> v2:172.21.15.159:3300/0 conn(0x7f5f6c0c49f0 0x7f5f6c06d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.138+0000 7f5f6ad9d640 1 -- 172.21.15.77:0/1067059942 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0c4ed0 con 0x7f5f6c072160 2023-11-26T07:24:00.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.139+0000 7f5f6ad9d640 1 --2- 172.21.15.77:0/1067059942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6c072160 0x7f5f6c15e750 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0cef60 tx=0x7f5f5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30e4d3293a6f38c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:00.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.139+0000 7f5f69d9b640 1 -- 172.21.15.77:0/1067059942 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c031870 con 0x7f5f6c072160 2023-11-26T07:24:00.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.139+0000 7f5f69d9b640 1 -- 172.21.15.77:0/1067059942 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c0319d0 con 0x7f5f6c072160 2023-11-26T07:24:00.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.139+0000 7f5f69d9b640 1 -- 172.21.15.77:0/1067059942 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c031d60 con 0x7f5f6c072160 2023-11-26T07:24:00.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.140+0000 7f5f7104b640 1 -- 172.21.15.77:0/1067059942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6c072160 msgr2=0x7f5f6c15e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.140+0000 7f5f7104b640 1 --2- 172.21.15.77:0/1067059942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6c072160 0x7f5f6c15e750 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0cef60 tx=0x7f5f5c02b910 comp rx=0 tx=0).stop 2023-11-26T07:24:00.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.140+0000 7f5f7104b640 1 -- 172.21.15.77:0/1067059942 shutdown_connections 2023-11-26T07:24:00.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.140+0000 7f5f7104b640 1 --2- 172.21.15.77:0/1067059942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f6c06dc40 0x7f5f6c0cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.140+0000 7f5f7104b640 1 --2- 172.21.15.77:0/1067059942 >> v2:172.21.15.159:3300/0 conn(0x7f5f6c0c49f0 0x7f5f6c06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.140+0000 7f5f7104b640 1 --2- 172.21.15.77:0/1067059942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6c072160 0x7f5f6c15e750 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.140+0000 7f5f7104b640 1 -- 172.21.15.77:0/1067059942 >> 172.21.15.77:0/1067059942 conn(0x7f5f6c0b0c50 msgr2=0x7f5f6c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:00.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.140+0000 7f5f7104b640 1 -- 172.21.15.77:0/1067059942 shutdown_connections 2023-11-26T07:24:00.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.140+0000 7f5f7104b640 1 -- 172.21.15.77:0/1067059942 wait complete. 2023-11-26T07:24:00.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.142+0000 7f5f7104b640 1 Processor -- start 2023-11-26T07:24:00.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.142+0000 7f5f7104b640 1 -- start start 2023-11-26T07:24:00.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.143+0000 7f5f7104b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f6c06dc40 0x7f5f6c146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.143+0000 7f5f7104b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6c072160 0x7f5f6c146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.143+0000 7f5f7104b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f6c0c49f0 0x7f5f6c0ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.143+0000 7f5f7104b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c15b230 con 0x7f5f6c072160 2023-11-26T07:24:00.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.143+0000 7f5f7104b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c15c0d0 con 0x7f5f6c0c49f0 2023-11-26T07:24:00.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.143+0000 7f5f7104b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c146790 con 0x7f5f6c06dc40 2023-11-26T07:24:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.143+0000 7f5f6a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6c072160 0x7f5f6c146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.143+0000 7f5f6a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6c072160 0x7f5f6c146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60732/0 (socket says 172.21.15.77:60732) 2023-11-26T07:24:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.143+0000 7f5f6a59c640 1 -- 172.21.15.77:0/2101947695 learned_addr learned my addr 172.21.15.77:0/2101947695 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f6ad9d640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f6c06dc40 0x7f5f6c146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f6a59c640 1 -- 172.21.15.77:0/2101947695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f6c06dc40 msgr2=0x7f5f6c146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f6a59c640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f6c06dc40 0x7f5f6c146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f6b59e640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f6c0c49f0 0x7f5f6c0ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f6a59c640 1 -- 172.21.15.77:0/2101947695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f6c0c49f0 msgr2=0x7f5f6c0ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f6a59c640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f6c0c49f0 0x7f5f6c0ad000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f6a59c640 1 -- 172.21.15.77:0/2101947695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c0094d0 con 0x7f5f6c072160 2023-11-26T07:24:00.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f6ad9d640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f6c06dc40 0x7f5f6c146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:00.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f6a59c640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6c072160 0x7f5f6c146250 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d5f0 tx=0x7f5f6000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:00.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f537fe640 1 -- 172.21.15.77:0/2101947695 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600125f0 con 0x7f5f6c072160 2023-11-26T07:24:00.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f537fe640 1 -- 172.21.15.77:0/2101947695 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f60012750 con 0x7f5f6c072160 2023-11-26T07:24:00.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f7104b640 1 -- 172.21.15.77:0/2101947695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c159e90 con 0x7f5f6c072160 2023-11-26T07:24:00.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.144+0000 7f5f537fe640 1 -- 172.21.15.77:0/2101947695 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60012b00 con 0x7f5f6c072160 2023-11-26T07:24:00.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.145+0000 7f5f7104b640 1 -- 172.21.15.77:0/2101947695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c0c7fe0 con 0x7f5f6c072160 2023-11-26T07:24:00.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.146+0000 7f5f7104b640 1 -- 172.21.15.77:0/2101947695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6c15c260 con 0x7f5f6c072160 2023-11-26T07:24:00.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.146+0000 7f5f537fe640 1 -- 172.21.15.77:0/2101947695 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f5f60012c60 con 0x7f5f6c072160 2023-11-26T07:24:00.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.147+0000 7f5f537fe640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f5806b8f0 0x7f5f5806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.147+0000 7f5f537fe640 1 -- 172.21.15.77:0/2101947695 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5f60088470 con 0x7f5f6c072160 2023-11-26T07:24:00.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.148+0000 7f5f6ad9d640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f5806b8f0 0x7f5f5806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.148+0000 7f5f6ad9d640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f5806b8f0 0x7f5f5806ddb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c036000 tx=0x7f5f5c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:00.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.152+0000 7f5f537fe640 1 -- 172.21.15.77:0/2101947695 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f60054f70 con 0x7f5f6c072160 2023-11-26T07:24:00.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.411+0000 7f5f7104b640 1 -- 172.21.15.77:0/2101947695 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f6c071980 con 0x7f5f5806b8f0 2023-11-26T07:24:00.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.428+0000 7f5f537fe640 1 -- 172.21.15.77:0/2101947695 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+168 (secure 0 0 0) 0x7f5f6c071980 con 0x7f5f5806b8f0 2023-11-26T07:24:00.431 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:00.431 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:24:00.431 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "in-progress", 2023-11-26T07:24:00.431 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:24:00.431 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:24:00.431 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol55430", 2023-11-26T07:24:00.431 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap6600" 2023-11-26T07:24:00.431 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:24:00.431 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:24:00.432 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:00.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 -- 172.21.15.77:0/2101947695 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f5806b8f0 msgr2=0x7f5f5806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f5806b8f0 0x7f5f5806ddb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c036000 tx=0x7f5f5c03c040 comp rx=0 tx=0).stop 2023-11-26T07:24:00.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 -- 172.21.15.77:0/2101947695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6c072160 msgr2=0x7f5f6c146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6c072160 0x7f5f6c146250 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d5f0 tx=0x7f5f6000dab0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 -- 172.21.15.77:0/2101947695 shutdown_connections 2023-11-26T07:24:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5f5806b8f0 0x7f5f5806ddb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f6c0c49f0 0x7f5f6c0ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6c072160 0x7f5f6c146250 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 --2- 172.21.15.77:0/2101947695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f6c06dc40 0x7f5f6c146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 -- 172.21.15.77:0/2101947695 >> 172.21.15.77:0/2101947695 conn(0x7f5f6c0b0c50 msgr2=0x7f5f6c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 -- 172.21.15.77:0/2101947695 shutdown_connections 2023-11-26T07:24:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:00.431+0000 7f5f7104b640 1 -- 172.21.15.77:0/2101947695 wait complete. 2023-11-26T07:24:01.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:24:01.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.698+0000 7f8105361640 1 Processor -- start 2023-11-26T07:24:01.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.699+0000 7f8105361640 1 -- start start 2023-11-26T07:24:01.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.700+0000 7f8105361640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8100072160 0x7f810015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.700+0000 7f8105361640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f81000c49f0 0x7f810006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.700+0000 7f8105361640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810015ec90 con 0x7f810006dc40 2023-11-26T07:24:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.700+0000 7f8105361640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810006e090 con 0x7f8100072160 2023-11-26T07:24:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.700+0000 7f8105361640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81000cd530 con 0x7f81000c49f0 2023-11-26T07:24:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.700+0000 7f80feffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8100072160 0x7f810015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.700+0000 7f80ff7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f810006dc40 0x7f81000cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41672/0 (socket says 172.21.15.77:41672) 2023-11-26T07:24:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.700+0000 7f80ff7fe640 1 -- 172.21.15.77:0/3149036362 learned_addr learned my addr 172.21.15.77:0/3149036362 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:01.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.701+0000 7f80fe7fc640 1 --2- 172.21.15.77:0/3149036362 >> v2:172.21.15.159:3300/0 conn(0x7f81000c49f0 0x7f810006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.701+0000 7f80feffd640 1 -- 172.21.15.77:0/3149036362 >> v2:172.21.15.159:3300/0 conn(0x7f81000c49f0 msgr2=0x7f810006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:01.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.701+0000 7f80feffd640 1 --2- 172.21.15.77:0/3149036362 >> v2:172.21.15.159:3300/0 conn(0x7f81000c49f0 0x7f810006d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.701+0000 7f80feffd640 1 -- 172.21.15.77:0/3149036362 >> v1:172.21.15.77:6789/0 conn(0x7f810006dc40 legacy=0x7f81000cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.701+0000 7f80feffd640 1 -- 172.21.15.77:0/3149036362 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81000c4ed0 con 0x7f8100072160 2023-11-26T07:24:01.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.702+0000 7f80feffd640 1 --2- 172.21.15.77:0/3149036362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100072160 0x7f810015e750 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f81000cef60 tx=0x7f80f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c1edef6ed21ade server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.703+0000 7f80fdffb640 1 -- 172.21.15.77:0/3149036362 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0031830 con 0x7f8100072160 2023-11-26T07:24:01.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.703+0000 7f80fdffb640 1 -- 172.21.15.77:0/3149036362 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0031990 con 0x7f8100072160 2023-11-26T07:24:01.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.703+0000 7f80fdffb640 1 -- 172.21.15.77:0/3149036362 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0031d20 con 0x7f8100072160 2023-11-26T07:24:01.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.703+0000 7f8105361640 1 -- 172.21.15.77:0/3149036362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100072160 msgr2=0x7f810015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.703+0000 7f8105361640 1 --2- 172.21.15.77:0/3149036362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100072160 0x7f810015e750 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f81000cef60 tx=0x7f80f002b8d0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.704+0000 7f8105361640 1 -- 172.21.15.77:0/3149036362 shutdown_connections 2023-11-26T07:24:01.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.704+0000 7f8105361640 1 --2- 172.21.15.77:0/3149036362 >> v2:172.21.15.159:3300/0 conn(0x7f81000c49f0 0x7f810006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.704+0000 7f8105361640 1 --2- 172.21.15.77:0/3149036362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8100072160 0x7f810015e750 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.704+0000 7f8105361640 1 -- 172.21.15.77:0/3149036362 >> 172.21.15.77:0/3149036362 conn(0x7f81000b0c50 msgr2=0x7f81000b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:01.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.704+0000 7f8105361640 1 -- 172.21.15.77:0/3149036362 shutdown_connections 2023-11-26T07:24:01.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.704+0000 7f8105361640 1 -- 172.21.15.77:0/3149036362 wait complete. 2023-11-26T07:24:01.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.706+0000 7f8105361640 1 Processor -- start 2023-11-26T07:24:01.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.706+0000 7f8105361640 1 -- start start 2023-11-26T07:24:01.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.707+0000 7f8105361640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810006dc40 0x7f81001543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.707+0000 7f8105361640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8100072160 0x7f81000cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.707+0000 7f8105361640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81000c49f0 0x7f8100152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.707+0000 7f8105361640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81001548e0 con 0x7f81000c49f0 2023-11-26T07:24:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.707+0000 7f8105361640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81000cb700 con 0x7f810006dc40 2023-11-26T07:24:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.707+0000 7f8105361640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8100153030 con 0x7f8100072160 2023-11-26T07:24:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.707+0000 7f80ff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81000c49f0 0x7f8100152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.707+0000 7f80ff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81000c49f0 0x7f8100152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60740/0 (socket says 172.21.15.77:60740) 2023-11-26T07:24:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.707+0000 7f80ff7fe640 1 -- 172.21.15.77:0/2985179148 learned_addr learned my addr 172.21.15.77:0/2985179148 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.707+0000 7f80feffd640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810006dc40 0x7f81001543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f80fe7fc640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8100072160 0x7f81000cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f80ff7fe640 1 -- 172.21.15.77:0/2985179148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8100072160 msgr2=0x7f81000cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8100072160 0x7f81000cb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f80ff7fe640 1 -- 172.21.15.77:0/2985179148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810006dc40 msgr2=0x7f81001543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810006dc40 0x7f81001543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f80ff7fe640 1 -- 172.21.15.77:0/2985179148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0009400 con 0x7f81000c49f0 2023-11-26T07:24:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f80ff7fe640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81000c49f0 0x7f8100152af0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f80f800cbc0 tx=0x7f80f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f80e77fe640 1 -- 172.21.15.77:0/2985179148 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800ad40 con 0x7f81000c49f0 2023-11-26T07:24:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f80e77fe640 1 -- 172.21.15.77:0/2985179148 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f8012400 con 0x7f81000c49f0 2023-11-26T07:24:01.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f8105361640 1 -- 172.21.15.77:0/2985179148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8100153300 con 0x7f81000c49f0 2023-11-26T07:24:01.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f80e77fe640 1 -- 172.21.15.77:0/2985179148 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800aea0 con 0x7f81000c49f0 2023-11-26T07:24:01.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.708+0000 7f8105361640 1 -- 172.21.15.77:0/2985179148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81001538c0 con 0x7f81000c49f0 2023-11-26T07:24:01.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.710+0000 7f8105361640 1 -- 172.21.15.77:0/2985179148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810004e8b0 con 0x7f81000c49f0 2023-11-26T07:24:01.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.710+0000 7f80e77fe640 1 -- 172.21.15.77:0/2985179148 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f80f8007070 con 0x7f81000c49f0 2023-11-26T07:24:01.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.711+0000 7f80e77fe640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f80ec06b8f0 0x7f80ec06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.712+0000 7f80e77fe640 1 -- 172.21.15.77:0/2985179148 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f80f8087f80 con 0x7f81000c49f0 2023-11-26T07:24:01.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.712+0000 7f80feffd640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f80ec06b8f0 0x7f80ec06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.713+0000 7f80feffd640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f80ec06b8f0 0x7f80ec06ddb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f80f0036000 tx=0x7f80f003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.718+0000 7f80e77fe640 1 -- 172.21.15.77:0/2985179148 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80f8054870 con 0x7f81000c49f0 2023-11-26T07:24:01.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:01.986+0000 7f8105361640 1 -- 172.21.15.77:0/2985179148 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7f81000c5770 con 0x7f80ec06b8f0 2023-11-26T07:24:02.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.004+0000 7f80e77fe640 1 -- 172.21.15.77:0/2985179148 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+168 (secure 0 0 0) 0x7f80f003a420 con 0x7f80ec06b8f0 2023-11-26T07:24:02.007 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:24:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "in-progress", 2023-11-26T07:24:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "source": { 2023-11-26T07:24:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "volume": "cephfs", 2023-11-26T07:24:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "subvolume": "subvol55430", 2023-11-26T07:24:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot": "subvol_snap6600" 2023-11-26T07:24:02.008 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:24:02.008 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:24:02.008 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.007+0000 7f8105361640 1 -- 172.21.15.77:0/2985179148 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f80ec06b8f0 msgr2=0x7f80ec06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.007+0000 7f8105361640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f80ec06b8f0 0x7f80ec06ddb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f80f0036000 tx=0x7f80f003c040 comp rx=0 tx=0).stop 2023-11-26T07:24:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.007+0000 7f8105361640 1 -- 172.21.15.77:0/2985179148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81000c49f0 msgr2=0x7f8100152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.007+0000 7f8105361640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81000c49f0 0x7f8100152af0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f80f800cbc0 tx=0x7f80f800a430 comp rx=0 tx=0).stop 2023-11-26T07:24:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.008+0000 7f8105361640 1 -- 172.21.15.77:0/2985179148 shutdown_connections 2023-11-26T07:24:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.008+0000 7f8105361640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f80ec06b8f0 0x7f80ec06ddb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.008+0000 7f8105361640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81000c49f0 0x7f8100152af0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.008+0000 7f8105361640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8100072160 0x7f81000cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.008+0000 7f8105361640 1 --2- 172.21.15.77:0/2985179148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810006dc40 0x7f81001543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.008+0000 7f8105361640 1 -- 172.21.15.77:0/2985179148 >> 172.21.15.77:0/2985179148 conn(0x7f81000b0c50 msgr2=0x7f8100071040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:02.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.008+0000 7f8105361640 1 -- 172.21.15.77:0/2985179148 shutdown_connections 2023-11-26T07:24:02.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:02.008+0000 7f8105361640 1 -- 172.21.15.77:0/2985179148 wait complete. 2023-11-26T07:24:03.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:24:03.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.243+0000 7f5253290640 1 Processor -- start 2023-11-26T07:24:03.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.243+0000 7f5253290640 1 -- start start 2023-11-26T07:24:03.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f5253290640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f524c161060 0x7f524c161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f5253290640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f524c0b3330 0x7f524c15da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f5253290640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524c06dcf0 con 0x7f524c0b3790 2023-11-26T07:24:03.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f5253290640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524c06ec10 con 0x7f524c161060 2023-11-26T07:24:03.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f5253290640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524c161980 con 0x7f524c0b3330 2023-11-26T07:24:03.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f525102c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f524c161060 0x7f524c161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f525102c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f524c161060 0x7f524c161440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60746/0 (socket says 172.21.15.77:60746) 2023-11-26T07:24:03.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f525102c640 1 -- 172.21.15.77:0/1370145075 learned_addr learned my addr 172.21.15.77:0/1370145075 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:03.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f525102c640 1 -- 172.21.15.77:0/1370145075 >> v2:172.21.15.159:3300/0 conn(0x7f524c0b3330 msgr2=0x7f524c15da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:03.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f525102c640 1 --2- 172.21.15.77:0/1370145075 >> v2:172.21.15.159:3300/0 conn(0x7f524c0b3330 0x7f524c15da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f525102c640 1 -- 172.21.15.77:0/1370145075 >> v1:172.21.15.159:6789/0 conn(0x7f524c0b3790 legacy=0x7f524c15dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:03.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.245+0000 7f525102c640 1 -- 172.21.15.77:0/1370145075 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c161ec0 con 0x7f524c161060 2023-11-26T07:24:03.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.247+0000 7f525102c640 1 --2- 172.21.15.77:0/1370145075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f524c161060 0x7f524c161440 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f524c061190 tx=0x7f524802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281ccdd2d5a6e2ca server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.247+0000 7f5243fff640 1 -- 172.21.15.77:0/1370145075 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480317e0 con 0x7f524c161060 2023-11-26T07:24:03.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.247+0000 7f5243fff640 1 -- 172.21.15.77:0/1370145075 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248031940 con 0x7f524c161060 2023-11-26T07:24:03.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.247+0000 7f5243fff640 1 -- 172.21.15.77:0/1370145075 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248031cd0 con 0x7f524c161060 2023-11-26T07:24:03.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.247+0000 7f5253290640 1 -- 172.21.15.77:0/1370145075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f524c161060 msgr2=0x7f524c161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.247+0000 7f5253290640 1 --2- 172.21.15.77:0/1370145075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f524c161060 0x7f524c161440 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f524c061190 tx=0x7f524802b880 comp rx=0 tx=0).stop 2023-11-26T07:24:03.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.248+0000 7f5253290640 1 -- 172.21.15.77:0/1370145075 shutdown_connections 2023-11-26T07:24:03.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.248+0000 7f5253290640 1 --2- 172.21.15.77:0/1370145075 >> v2:172.21.15.159:3300/0 conn(0x7f524c0b3330 0x7f524c15da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.248+0000 7f5253290640 1 --2- 172.21.15.77:0/1370145075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f524c161060 0x7f524c161440 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.248+0000 7f5253290640 1 -- 172.21.15.77:0/1370145075 >> 172.21.15.77:0/1370145075 conn(0x7f524c0cf900 msgr2=0x7f524c0cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:03.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.248+0000 7f5253290640 1 -- 172.21.15.77:0/1370145075 shutdown_connections 2023-11-26T07:24:03.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.248+0000 7f5253290640 1 -- 172.21.15.77:0/1370145075 wait complete. 2023-11-26T07:24:03.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.249+0000 7f5253290640 1 Processor -- start 2023-11-26T07:24:03.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.250+0000 7f5253290640 1 -- start start 2023-11-26T07:24:03.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f5253290640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f524c0b3330 0x7f524c1458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f5253290640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f524c0b3790 0x7f524c1435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f5253290640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f524c161060 0x7f524c143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f5253290640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c145460 con 0x7f524c161060 2023-11-26T07:24:03.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f5253290640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c143b30 con 0x7f524c0b3790 2023-11-26T07:24:03.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f5253290640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c144850 con 0x7f524c0b3330 2023-11-26T07:24:03.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f525182d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f524c161060 0x7f524c143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f525182d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f524c161060 0x7f524c143e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60762/0 (socket says 172.21.15.77:60762) 2023-11-26T07:24:03.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f525182d640 1 -- 172.21.15.77:0/2729104803 learned_addr learned my addr 172.21.15.77:0/2729104803 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:03.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f525082b640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f524c0b3790 0x7f524c1435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f525102c640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f524c0b3330 0x7f524c1458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f525182d640 1 -- 172.21.15.77:0/2729104803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f524c0b3330 msgr2=0x7f524c1458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f525182d640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f524c0b3330 0x7f524c1458f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f525182d640 1 -- 172.21.15.77:0/2729104803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f524c0b3790 msgr2=0x7f524c1435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f525182d640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f524c0b3790 0x7f524c1435f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.251+0000 7f525182d640 1 -- 172.21.15.77:0/2729104803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480094d0 con 0x7f524c161060 2023-11-26T07:24:03.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.252+0000 7f525182d640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f524c161060 0x7f524c143e40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f524400b990 tx=0x7f524400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.252+0000 7f5241ffb640 1 -- 172.21.15.77:0/2729104803 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524400cba0 con 0x7f524c161060 2023-11-26T07:24:03.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.252+0000 7f5241ffb640 1 -- 172.21.15.77:0/2729104803 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524400cd00 con 0x7f524c161060 2023-11-26T07:24:03.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.252+0000 7f5241ffb640 1 -- 172.21.15.77:0/2729104803 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5244014680 con 0x7f524c161060 2023-11-26T07:24:03.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.252+0000 7f5253290640 1 -- 172.21.15.77:0/2729104803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524c144b30 con 0x7f524c161060 2023-11-26T07:24:03.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.252+0000 7f5253290640 1 -- 172.21.15.77:0/2729104803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524c1450f0 con 0x7f524c161060 2023-11-26T07:24:03.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.253+0000 7f5253290640 1 -- 172.21.15.77:0/2729104803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524c067990 con 0x7f524c161060 2023-11-26T07:24:03.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.254+0000 7f5241ffb640 1 -- 172.21.15.77:0/2729104803 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f524401d3b0 con 0x7f524c161060 2023-11-26T07:24:03.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.255+0000 7f5241ffb640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523006b920 0x7f523006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.255+0000 7f5241ffb640 1 -- 172.21.15.77:0/2729104803 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5244087f30 con 0x7f524c161060 2023-11-26T07:24:03.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.255+0000 7f525102c640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523006b920 0x7f523006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.256+0000 7f525102c640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523006b920 0x7f523006dde0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5248036000 tx=0x7f524803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.260+0000 7f5241ffb640 1 -- 172.21.15.77:0/2729104803 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52440549e0 con 0x7f524c161060 2023-11-26T07:24:03.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.485+0000 7f5253290640 1 -- 172.21.15.77:0/2729104803 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7f524c06e550 con 0x7f523006b920 2023-11-26T07:24:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.504+0000 7f5241ffb640 1 -- 172.21.15.77:0/2729104803 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f5248031c30 con 0x7f523006b920 2023-11-26T07:24:03.507 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:03.507 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:24:03.507 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "complete" 2023-11-26T07:24:03.507 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:24:03.507 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 -- 172.21.15.77:0/2729104803 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523006b920 msgr2=0x7f523006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523006b920 0x7f523006dde0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5248036000 tx=0x7f524803d040 comp rx=0 tx=0).stop 2023-11-26T07:24:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 -- 172.21.15.77:0/2729104803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f524c161060 msgr2=0x7f524c143e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f524c161060 0x7f524c143e40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f524400b990 tx=0x7f524400be50 comp rx=0 tx=0).stop 2023-11-26T07:24:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 -- 172.21.15.77:0/2729104803 shutdown_connections 2023-11-26T07:24:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f523006b920 0x7f523006dde0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f524c161060 0x7f524c143e40 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f524c0b3790 0x7f524c1435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 --2- 172.21.15.77:0/2729104803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f524c0b3330 0x7f524c1458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 -- 172.21.15.77:0/2729104803 >> 172.21.15.77:0/2729104803 conn(0x7f524c0cf900 msgr2=0x7f524c06a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 -- 172.21.15.77:0/2729104803 shutdown_connections 2023-11-26T07:24:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.507+0000 7f5253290640 1 -- 172.21.15.77:0/2729104803 wait complete. 2023-11-26T07:24:03.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone77330 2023-11-26T07:24:03.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.747+0000 7f22626e6640 1 Processor -- start 2023-11-26T07:24:03.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.747+0000 7f22626e6640 1 -- start start 2023-11-26T07:24:03.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.748+0000 7f22626e6640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c0b0b40 0x7f225c0b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.748+0000 7f22626e6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c06d430 con 0x7f225c15a1c0 2023-11-26T07:24:03.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.748+0000 7f22626e6640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c0b14e0 con 0x7f225c15ded0 2023-11-26T07:24:03.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.748+0000 7f22626e6640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c15ea70 con 0x7f225c0b0b40 2023-11-26T07:24:03.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.749+0000 7f22616e4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f225c15a1c0 0x7f225c06d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41676/0 (socket says 172.21.15.77:41676) 2023-11-26T07:24:03.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.749+0000 7f22616e4640 1 -- 172.21.15.77:0/3844203278 learned_addr learned my addr 172.21.15.77:0/3844203278 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:03.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.749+0000 7f2260ee3640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c0b0b40 0x7f225c0b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.749+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042522587 0 0) 0x7f225c06d430 con 0x7f225c15a1c0 2023-11-26T07:24:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.749+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2248003520 con 0x7f225c15a1c0 2023-11-26T07:24:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.749+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 341190404 0 0) 0x7f2248003520 con 0x7f225c15a1c0 2023-11-26T07:24:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.749+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c0b0b40 msgr2=0x7f225c0b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.749+0000 7f2253fff640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c0b0b40 0x7f225c0b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.749+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 >> v1:172.21.15.159:6789/0 conn(0x7f225c15ded0 legacy=0x7f225c15e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.749+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c15ec50 con 0x7f225c15a1c0 2023-11-26T07:24:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.749+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f2258001670 con 0x7f225c15a1c0 2023-11-26T07:24:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 >> v1:172.21.15.77:6789/0 conn(0x7f225c15a1c0 legacy=0x7f225c06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2253fff640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22480039a0 0x7f2248003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2253fff640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c0b0b40 0x7f22480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2253fff640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2248004d00 0x7f2248005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c15ea70 con 0x7f2248004d00 2023-11-26T07:24:03.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224800bb10 con 0x7f22480039a0 2023-11-26T07:24:03.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224800deb0 con 0x7f225c0b0b40 2023-11-26T07:24:03.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2261ee5640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2248004d00 0x7f2248005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f22616e4640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22480039a0 0x7f2248003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2260ee3640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c0b0b40 0x7f22480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2261ee5640 1 -- 172.21.15.77:0/3844203278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c0b0b40 msgr2=0x7f22480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2261ee5640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c0b0b40 0x7f22480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2261ee5640 1 -- 172.21.15.77:0/3844203278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22480039a0 msgr2=0x7f2248003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.750+0000 7f2261ee5640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22480039a0 0x7f2248003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.751+0000 7f2261ee5640 1 -- 172.21.15.77:0/3844203278 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248003520 con 0x7f2248004d00 2023-11-26T07:24:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.752+0000 7f2261ee5640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2248004d00 0x7f2248005180 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2254001e80 tx=0x7f22480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304666767ac8f692 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.752+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254003b70 con 0x7f2248004d00 2023-11-26T07:24:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.752+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2254003cd0 con 0x7f2248004d00 2023-11-26T07:24:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.752+0000 7f2253fff640 1 -- 172.21.15.77:0/3844203278 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254005310 con 0x7f2248004d00 2023-11-26T07:24:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.752+0000 7f22626e6640 1 -- 172.21.15.77:0/3844203278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2248004d00 msgr2=0x7f2248005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.752+0000 7f22626e6640 1 --2- 172.21.15.77:0/3844203278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2248004d00 0x7f2248005180 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2254001e80 tx=0x7f22480057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.752+0000 7f2261ee5640 1 -- 172.21.15.77:0/3844203278 reap_dead start 2023-11-26T07:24:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.752+0000 7f22626e6640 1 -- 172.21.15.77:0/3844203278 shutdown_connections 2023-11-26T07:24:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.752+0000 7f22626e6640 1 -- 172.21.15.77:0/3844203278 >> 172.21.15.77:0/3844203278 conn(0x7f225c0cbb40 msgr2=0x7f225c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.753+0000 7f22626e6640 1 -- 172.21.15.77:0/3844203278 shutdown_connections 2023-11-26T07:24:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.753+0000 7f22626e6640 1 -- 172.21.15.77:0/3844203278 wait complete. 2023-11-26T07:24:03.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.754+0000 7f22626e6640 1 Processor -- start 2023-11-26T07:24:03.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.754+0000 7f22626e6640 1 -- start start 2023-11-26T07:24:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.755+0000 7f22626e6640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c159670 0x7f225c0c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.755+0000 7f22626e6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f225c0c4020 0x7f225c09bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.755+0000 7f22626e6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f225c09c270 0x7f225c1f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.755+0000 7f22626e6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c09c6f0 con 0x7f225c0c4020 2023-11-26T07:24:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.755+0000 7f22626e6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0c45f0 con 0x7f225c09c270 2023-11-26T07:24:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.755+0000 7f22626e6640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c099a70 con 0x7f225c159670 2023-11-26T07:24:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.756+0000 7f2260ee3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f225c0c4020 0x7f225c09bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.756+0000 7f2260ee3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f225c0c4020 0x7f225c09bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60788/0 (socket says 172.21.15.77:60788) 2023-11-26T07:24:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.756+0000 7f2260ee3640 1 -- 172.21.15.77:0/358963991 learned_addr learned my addr 172.21.15.77:0/358963991 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.756+0000 7f2260ee3640 1 -- 172.21.15.77:0/358963991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c159670 msgr2=0x7f225c0c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.756+0000 7f2260ee3640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c159670 0x7f225c0c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.756+0000 7f2260ee3640 1 -- 172.21.15.77:0/358963991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f225c09c270 msgr2=0x7f225c1f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.756+0000 7f2260ee3640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f225c09c270 0x7f225c1f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.756+0000 7f2260ee3640 1 -- 172.21.15.77:0/358963991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c099d50 con 0x7f225c0c4020 2023-11-26T07:24:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.756+0000 7f2260ee3640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f225c0c4020 0x7f225c09bd30 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f224c00f580 tx=0x7f224c00fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.756+0000 7f2251ffb640 1 -- 172.21.15.77:0/358963991 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c014870 con 0x7f225c0c4020 2023-11-26T07:24:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.757+0000 7f2251ffb640 1 -- 172.21.15.77:0/358963991 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c0149d0 con 0x7f225c0c4020 2023-11-26T07:24:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.757+0000 7f2251ffb640 1 -- 172.21.15.77:0/358963991 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c014d80 con 0x7f225c0c4020 2023-11-26T07:24:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.757+0000 7f22626e6640 1 -- 172.21.15.77:0/358963991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c09a030 con 0x7f225c0c4020 2023-11-26T07:24:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.757+0000 7f22626e6640 1 -- 172.21.15.77:0/358963991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c0c48d0 con 0x7f225c0c4020 2023-11-26T07:24:03.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.758+0000 7f22626e6640 1 -- 172.21.15.77:0/358963991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c0b5040 con 0x7f225c0c4020 2023-11-26T07:24:03.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.759+0000 7f2251ffb640 1 -- 172.21.15.77:0/358963991 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f224c015410 con 0x7f225c0c4020 2023-11-26T07:24:03.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.760+0000 7f2251ffb640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f224006b920 0x7f224006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.760+0000 7f2251ffb640 1 -- 172.21.15.77:0/358963991 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f224c0889a0 con 0x7f225c0c4020 2023-11-26T07:24:03.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.761+0000 7f22616e4640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f224006b920 0x7f224006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.761+0000 7f22616e4640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f224006b920 0x7f224006dde0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2258005a50 tx=0x7f2258000ff0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.765+0000 7f2251ffb640 1 -- 172.21.15.77:0/358963991 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f224c055420 con 0x7f225c0c4020 2023-11-26T07:24:03.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:03.995+0000 7f22626e6640 1 -- 172.21.15.77:0/358963991 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone77330", "target": ["mon-mgr", ""]}) v1 -- 0x7f225c06d0c0 con 0x7f224006b920 2023-11-26T07:24:04.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.007+0000 7f2251ffb640 1 -- 172.21.15.77:0/358963991 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f2258001550 con 0x7f224006b920 2023-11-26T07:24:04.009 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:04.009 INFO:teuthology.orchestra.run.smithi077.stdout: "status": { 2023-11-26T07:24:04.009 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "complete" 2023-11-26T07:24:04.009 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-26T07:24:04.009 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:04.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.009+0000 7f22626e6640 1 -- 172.21.15.77:0/358963991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f224006b920 msgr2=0x7f224006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.009+0000 7f22626e6640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f224006b920 0x7f224006dde0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2258005a50 tx=0x7f2258000ff0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.009+0000 7f22626e6640 1 -- 172.21.15.77:0/358963991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f225c0c4020 msgr2=0x7f225c09bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.009+0000 7f22626e6640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f225c0c4020 0x7f225c09bd30 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f224c00f580 tx=0x7f224c00fa40 comp rx=0 tx=0).stop 2023-11-26T07:24:04.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.009+0000 7f22626e6640 1 -- 172.21.15.77:0/358963991 shutdown_connections 2023-11-26T07:24:04.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.009+0000 7f22626e6640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f224006b920 0x7f224006dde0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.009+0000 7f22626e6640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f225c09c270 0x7f225c1f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.009+0000 7f22626e6640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f225c0c4020 0x7f225c09bd30 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.009+0000 7f22626e6640 1 --2- 172.21.15.77:0/358963991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f225c159670 0x7f225c0c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.009+0000 7f22626e6640 1 -- 172.21.15.77:0/358963991 >> 172.21.15.77:0/358963991 conn(0x7f225c0cbb40 msgr2=0x7f225c071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:04.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.010+0000 7f22626e6640 1 -- 172.21.15.77:0/358963991 shutdown_connections 2023-11-26T07:24:04.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.010+0000 7f22626e6640 1 -- 172.21.15.77:0/358963991 wait complete. 2023-11-26T07:24:04.029 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol55430 subvol_snap6600 2023-11-26T07:24:04.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.238+0000 7f4c73bec640 1 Processor -- start 2023-11-26T07:24:04.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.238+0000 7f4c73bec640 1 -- start start 2023-11-26T07:24:04.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.240+0000 7f4c73bec640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c6c0b2250 0x7f4c6c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.240+0000 7f4c73bec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c6c0b2a70 0x7f4c6c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.240+0000 7f4c73bec640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6c15ab80 con 0x7f4c6c0b2630 2023-11-26T07:24:04.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.240+0000 7f4c73bec640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6c15a990 con 0x7f4c6c0b2a70 2023-11-26T07:24:04.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.240+0000 7f4c73bec640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c15e680 con 0x7f4c6c0b2250 2023-11-26T07:24:04.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.240+0000 7f4c72189640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c6c0b2a70 0x7f4c6c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.240+0000 7f4c72189640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c6c0b2a70 0x7f4c6c15b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60800/0 (socket says 172.21.15.77:60800) 2023-11-26T07:24:04.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.240+0000 7f4c72189640 1 -- 172.21.15.77:0/1345460457 learned_addr learned my addr 172.21.15.77:0/1345460457 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:04.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.241+0000 7f4c71988640 1 --2- 172.21.15.77:0/1345460457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c6c0b2250 0x7f4c6c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.241+0000 7f4c72189640 1 -- 172.21.15.77:0/1345460457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c6c0b2250 msgr2=0x7f4c6c15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:04.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.241+0000 7f4c72189640 1 --2- 172.21.15.77:0/1345460457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c6c0b2250 0x7f4c6c15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.241+0000 7f4c72189640 1 -- 172.21.15.77:0/1345460457 >> v1:172.21.15.159:6789/0 conn(0x7f4c6c0b2630 legacy=0x7f4c6c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:04.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.241+0000 7f4c72189640 1 -- 172.21.15.77:0/1345460457 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c15e960 con 0x7f4c6c0b2a70 2023-11-26T07:24:04.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.241+0000 7f4c71988640 1 --2- 172.21.15.77:0/1345460457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c6c0b2250 0x7f4c6c15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:04.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.242+0000 7f4c72189640 1 --2- 172.21.15.77:0/1345460457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c6c0b2a70 0x7f4c6c15b080 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009e50 tx=0x7f4c6402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382f7df20b2dfae2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.242+0000 7f4c70986640 1 -- 172.21.15.77:0/1345460457 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6402ca80 con 0x7f4c6c0b2a70 2023-11-26T07:24:04.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.242+0000 7f4c70986640 1 -- 172.21.15.77:0/1345460457 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6402cbe0 con 0x7f4c6c0b2a70 2023-11-26T07:24:04.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.242+0000 7f4c70986640 1 -- 172.21.15.77:0/1345460457 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c640343f0 con 0x7f4c6c0b2a70 2023-11-26T07:24:04.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.243+0000 7f4c73bec640 1 -- 172.21.15.77:0/1345460457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c6c0b2a70 msgr2=0x7f4c6c15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.243+0000 7f4c73bec640 1 --2- 172.21.15.77:0/1345460457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c6c0b2a70 0x7f4c6c15b080 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009e50 tx=0x7f4c6402bee0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.243+0000 7f4c73bec640 1 -- 172.21.15.77:0/1345460457 shutdown_connections 2023-11-26T07:24:04.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.243+0000 7f4c73bec640 1 --2- 172.21.15.77:0/1345460457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c6c0b2a70 0x7f4c6c15b080 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.243+0000 7f4c73bec640 1 --2- 172.21.15.77:0/1345460457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c6c0b2250 0x7f4c6c15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.243+0000 7f4c73bec640 1 -- 172.21.15.77:0/1345460457 >> 172.21.15.77:0/1345460457 conn(0x7f4c6c06a920 msgr2=0x7f4c6c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:04.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.243+0000 7f4c73bec640 1 -- 172.21.15.77:0/1345460457 shutdown_connections 2023-11-26T07:24:04.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.243+0000 7f4c73bec640 1 -- 172.21.15.77:0/1345460457 wait complete. 2023-11-26T07:24:04.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.245+0000 7f4c73bec640 1 Processor -- start 2023-11-26T07:24:04.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.245+0000 7f4c73bec640 1 -- start start 2023-11-26T07:24:04.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.246+0000 7f4c73bec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c6c0b2250 0x7f4c6c0b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.246+0000 7f4c73bec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c6c0b2630 0x7f4c6c1442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.246+0000 7f4c73bec640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c6c0b2a70 0x7f4c6c15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.246+0000 7f4c73bec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c0b0570 con 0x7f4c6c0b2250 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.246+0000 7f4c73bec640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c0af8f0 con 0x7f4c6c0b2630 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.246+0000 7f4c73bec640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c0afbd0 con 0x7f4c6c0b2a70 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.246+0000 7f4c71988640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c6c0b2250 0x7f4c6c0b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.246+0000 7f4c71988640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c6c0b2250 0x7f4c6c0b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60814/0 (socket says 172.21.15.77:60814) 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.246+0000 7f4c71988640 1 -- 172.21.15.77:0/1146084415 learned_addr learned my addr 172.21.15.77:0/1146084415 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.247+0000 7f4c71988640 1 -- 172.21.15.77:0/1146084415 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c6c0b2a70 msgr2=0x7f4c6c15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.247+0000 7f4c71988640 1 --2- 172.21.15.77:0/1146084415 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c6c0b2a70 0x7f4c6c15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.247+0000 7f4c71988640 1 -- 172.21.15.77:0/1146084415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c6c0b2630 msgr2=0x7f4c6c1442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.247+0000 7f4c71988640 1 --2- 172.21.15.77:0/1146084415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c6c0b2630 0x7f4c6c1442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.247+0000 7f4c71988640 1 -- 172.21.15.77:0/1146084415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c64009b30 con 0x7f4c6c0b2250 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.247+0000 7f4c71988640 1 --2- 172.21.15.77:0/1146084415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c6c0b2250 0x7f4c6c0b0990 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800c7f0 tx=0x7f4c6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.247+0000 7f4c627fc640 1 -- 172.21.15.77:0/1146084415 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68007a30 con 0x7f4c6c0b2250 2023-11-26T07:24:04.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.247+0000 7f4c627fc640 1 -- 172.21.15.77:0/1146084415 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c68007b90 con 0x7f4c6c0b2250 2023-11-26T07:24:04.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.247+0000 7f4c73bec640 1 -- 172.21.15.77:0/1146084415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6c0cd7c0 con 0x7f4c6c0b2250 2023-11-26T07:24:04.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.247+0000 7f4c627fc640 1 -- 172.21.15.77:0/1146084415 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800ce40 con 0x7f4c6c0b2250 2023-11-26T07:24:04.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.247+0000 7f4c73bec640 1 -- 172.21.15.77:0/1146084415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6c0b0190 con 0x7f4c6c0b2250 2023-11-26T07:24:04.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.249+0000 7f4c73bec640 1 -- 172.21.15.77:0/1146084415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6c067470 con 0x7f4c6c0b2250 2023-11-26T07:24:04.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.250+0000 7f4c627fc640 1 -- 172.21.15.77:0/1146084415 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f4c680113f0 con 0x7f4c6c0b2250 2023-11-26T07:24:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.250+0000 7f4c627fc640 1 --2- 172.21.15.77:0/1146084415 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4c5006b8f0 0x7f4c5006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.251+0000 7f4c627fc640 1 -- 172.21.15.77:0/1146084415 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4c680881c0 con 0x7f4c6c0b2250 2023-11-26T07:24:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.251+0000 7f4c71187640 1 --2- 172.21.15.77:0/1146084415 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4c5006b8f0 0x7f4c5006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.251+0000 7f4c71187640 1 --2- 172.21.15.77:0/1146084415 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f4c5006b8f0 0x7f4c5006ddb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c144ca0 tx=0x7f4c5c0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.255+0000 7f4c627fc640 1 -- 172.21.15.77:0/1146084415 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c68054c30 con 0x7f4c6c0b2250 2023-11-26T07:24:04.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.481+0000 7f4c73bec640 1 -- 172.21.15.77:0/1146084415 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol55430", "snap_name": "subvol_snap6600", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c6c15ddc0 con 0x7f4c5006b8f0 2023-11-26T07:24:04.499 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-26T07:24:04.497+0000 7f59b2df8640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'subvol_snap6600' has pending clones 2023-11-26T07:24:04.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:04.497+0000 7f4c627fc640 1 -- 172.21.15.77:0/1146084415 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: -11 snapshot 'subvol_snap6600' has pending clones) v1 ==== 53+0+0 (secure 0 0 0) 0x7f4c6c15ddc0 con 0x7f4c5006b8f0 2023-11-26T07:24:04.499 INFO:teuthology.orchestra.run.smithi077.stderr:Error EAGAIN: snapshot 'subvol_snap6600' has pending clones 2023-11-26T07:24:04.512 DEBUG:teuthology.orchestra.run:got remote process result: 11 2023-11-26T07:24:04.512 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:24:04.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:24:04.637 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:24:04.763 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:24:04.764 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:24:04.764 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:04.821 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:24:04.822 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:04.868 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:24:05.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.121+0000 7fd50b59e640 1 Processor -- start 2023-11-26T07:24:05.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.121+0000 7fd50b59e640 1 -- start start 2023-11-26T07:24:05.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50b59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd50c15c410 0x7fd50c15f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50b59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd50c0b1de0 0x7fd50c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50b59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c15bf80 con 0x7fd50c144b30 2023-11-26T07:24:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50b59e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50c0b27b0 con 0x7fd50c0b1de0 2023-11-26T07:24:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50b59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50c0b1560 con 0x7fd50c15c410 2023-11-26T07:24:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd50c0b1de0 0x7fd50c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd50c0b1de0 0x7fd50c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60822/0 (socket says 172.21.15.77:60822) 2023-11-26T07:24:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50ad9d640 1 -- 172.21.15.77:0/1832597950 learned_addr learned my addr 172.21.15.77:0/1832597950 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:05.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50ad9d640 1 -- 172.21.15.77:0/1832597950 >> v2:172.21.15.159:3300/0 conn(0x7fd50c15c410 msgr2=0x7fd50c15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50ad9d640 1 --2- 172.21.15.77:0/1832597950 >> v2:172.21.15.159:3300/0 conn(0x7fd50c15c410 0x7fd50c15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50ad9d640 1 -- 172.21.15.77:0/1832597950 >> v1:172.21.15.159:6789/0 conn(0x7fd50c144b30 legacy=0x7fd50c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.123+0000 7fd50ad9d640 1 -- 172.21.15.77:0/1832597950 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c0b1280 con 0x7fd50c0b1de0 2023-11-26T07:24:05.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.125+0000 7fd50ad9d640 1 --2- 172.21.15.77:0/1832597950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd50c0b1de0 0x7fd50c0b2270 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0cc7a0 tx=0x7fd50402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5a17ed164ce6b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.125+0000 7fd509d9b640 1 -- 172.21.15.77:0/1832597950 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504031870 con 0x7fd50c0b1de0 2023-11-26T07:24:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.125+0000 7fd509d9b640 1 -- 172.21.15.77:0/1832597950 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5040319d0 con 0x7fd50c0b1de0 2023-11-26T07:24:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.125+0000 7fd509d9b640 1 -- 172.21.15.77:0/1832597950 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504031d60 con 0x7fd50c0b1de0 2023-11-26T07:24:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.125+0000 7fd50b59e640 1 -- 172.21.15.77:0/1832597950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd50c0b1de0 msgr2=0x7fd50c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.125+0000 7fd50b59e640 1 --2- 172.21.15.77:0/1832597950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd50c0b1de0 0x7fd50c0b2270 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0cc7a0 tx=0x7fd50402b910 comp rx=0 tx=0).stop 2023-11-26T07:24:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.126+0000 7fd50b59e640 1 -- 172.21.15.77:0/1832597950 shutdown_connections 2023-11-26T07:24:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.126+0000 7fd50b59e640 1 --2- 172.21.15.77:0/1832597950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd50c0b1de0 0x7fd50c0b2270 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.126+0000 7fd50b59e640 1 --2- 172.21.15.77:0/1832597950 >> v2:172.21.15.159:3300/0 conn(0x7fd50c15c410 0x7fd50c15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.126+0000 7fd50b59e640 1 -- 172.21.15.77:0/1832597950 >> 172.21.15.77:0/1832597950 conn(0x7fd50c0cb830 msgr2=0x7fd50c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.126+0000 7fd50b59e640 1 -- 172.21.15.77:0/1832597950 shutdown_connections 2023-11-26T07:24:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.126+0000 7fd50b59e640 1 -- 172.21.15.77:0/1832597950 wait complete. 2023-11-26T07:24:05.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.127+0000 7fd50b59e640 1 Processor -- start 2023-11-26T07:24:05.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.127+0000 7fd50b59e640 1 -- start start 2023-11-26T07:24:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.128+0000 7fd50b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd50c0b1de0 0x7fd50c071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.128+0000 7fd50b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd50c144b30 0x7fd50c0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.128+0000 7fd50b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd50c15c410 0x7fd50c139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.128+0000 7fd50b59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c071e90 con 0x7fd50c144b30 2023-11-26T07:24:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.128+0000 7fd50b59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0708b0 con 0x7fd50c15c410 2023-11-26T07:24:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.128+0000 7fd50b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c070b90 con 0x7fd50c0b1de0 2023-11-26T07:24:05.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.129+0000 7fd501d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd50c144b30 0x7fd50c0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.129+0000 7fd501d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd50c144b30 0x7fd50c0c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60828/0 (socket says 172.21.15.77:60828) 2023-11-26T07:24:05.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.129+0000 7fd501d9b640 1 -- 172.21.15.77:0/1395785558 learned_addr learned my addr 172.21.15.77:0/1395785558 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.129+0000 7fd50ad9d640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd50c15c410 0x7fd50c139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.129+0000 7fd501d9b640 1 -- 172.21.15.77:0/1395785558 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd50c0b1de0 msgr2=0x7fd50c071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.129+0000 7fd501d9b640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd50c0b1de0 0x7fd50c071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.129+0000 7fd501d9b640 1 -- 172.21.15.77:0/1395785558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd50c15c410 msgr2=0x7fd50c139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.129+0000 7fd501d9b640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd50c15c410 0x7fd50c139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.129+0000 7fd501d9b640 1 -- 172.21.15.77:0/1395785558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5040094d0 con 0x7fd50c144b30 2023-11-26T07:24:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.129+0000 7fd50ad9d640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd50c15c410 0x7fd50c139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:05.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.129+0000 7fd501d9b640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd50c144b30 0x7fd50c0c83d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400b410 tx=0x7fd4f400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.130+0000 7fd5037fe640 1 -- 172.21.15.77:0/1395785558 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4011830 con 0x7fd50c144b30 2023-11-26T07:24:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.130+0000 7fd5037fe640 1 -- 172.21.15.77:0/1395785558 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f40119b0 con 0x7fd50c144b30 2023-11-26T07:24:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.130+0000 7fd5037fe640 1 -- 172.21.15.77:0/1395785558 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4011d60 con 0x7fd50c144b30 2023-11-26T07:24:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.130+0000 7fd50b59e640 1 -- 172.21.15.77:0/1395785558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c070e70 con 0x7fd50c144b30 2023-11-26T07:24:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.130+0000 7fd50b59e640 1 -- 172.21.15.77:0/1395785558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c071430 con 0x7fd50c144b30 2023-11-26T07:24:05.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.131+0000 7fd50b59e640 1 -- 172.21.15.77:0/1395785558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50c04e840 con 0x7fd50c144b30 2023-11-26T07:24:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.132+0000 7fd5037fe640 1 -- 172.21.15.77:0/1395785558 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fd4f401a400 con 0x7fd50c144b30 2023-11-26T07:24:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.133+0000 7fd5037fe640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd4ec06b8f0 0x7fd4ec06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.133+0000 7fd5037fe640 1 -- 172.21.15.77:0/1395785558 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd4f40880b0 con 0x7fd50c144b30 2023-11-26T07:24:05.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.133+0000 7fd50a59c640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd4ec06b8f0 0x7fd4ec06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.134+0000 7fd50a59c640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd4ec06b8f0 0x7fd4ec06ddb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc001c60 tx=0x7fd4fc007d10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.137+0000 7fd5037fe640 1 -- 172.21.15.77:0/1395785558 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4f4054c10 con 0x7fd50c144b30 2023-11-26T07:24:05.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.332+0000 7fd50b59e640 1 -- 172.21.15.77:0/1395785558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd50c06d860 con 0x7fd50c144b30 2023-11-26T07:24:05.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.334+0000 7fd5037fe640 1 -- 172.21.15.77:0/1395785558 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16642 (secure 0 0 0) 0x7fd4f4015020 con 0x7fd50c144b30 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":77,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:23:18.390879+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:02.276143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:03.495874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 -- 172.21.15.77:0/1395785558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd4ec06b8f0 msgr2=0x7fd4ec06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd4ec06b8f0 0x7fd4ec06ddb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc001c60 tx=0x7fd4fc007d10 comp rx=0 tx=0).stop 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 -- 172.21.15.77:0/1395785558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd50c144b30 msgr2=0x7fd50c0c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd50c144b30 0x7fd50c0c83d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400b410 tx=0x7fd4f400b8d0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 -- 172.21.15.77:0/1395785558 shutdown_connections 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd4ec06b8f0 0x7fd4ec06ddb0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd50c15c410 0x7fd50c139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd50c144b30 0x7fd50c0c83d0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 --2- 172.21.15.77:0/1395785558 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd50c0b1de0 0x7fd50c071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 -- 172.21.15.77:0/1395785558 >> 172.21.15.77:0/1395785558 conn(0x7fd50c0cb830 msgr2=0x7fd50c15dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:05.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 -- 172.21.15.77:0/1395785558 shutdown_connections 2023-11-26T07:24:05.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.337+0000 7fd50b59e640 1 -- 172.21.15.77:0/1395785558 wait complete. 2023-11-26T07:24:05.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:23:02.276143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:23:03.495874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:24:05.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:24:05.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.578+0000 7fd2130bb640 1 Processor -- start 2023-11-26T07:24:05.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.578+0000 7fd2130bb640 1 -- start start 2023-11-26T07:24:05.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.580+0000 7fd2130bb640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd20c0b0fb0 0x7fd20c06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.580+0000 7fd2130bb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c15ed20 con 0x7fd20c0b0b40 2023-11-26T07:24:05.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.580+0000 7fd2130bb640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c15f8a0 con 0x7fd20c15b260 2023-11-26T07:24:05.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.580+0000 7fd2130bb640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c15b640 con 0x7fd20c0b0fb0 2023-11-26T07:24:05.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.580+0000 7fd2118b8640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd20c0b0b40 0x7fd20c06c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41688/0 (socket says 172.21.15.77:41688) 2023-11-26T07:24:05.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.580+0000 7fd2118b8640 1 -- 172.21.15.77:0/4126425889 learned_addr learned my addr 172.21.15.77:0/4126425889 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:05.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.580+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920088044 0 0) 0x7fd20c15ed20 con 0x7fd20c0b0b40 2023-11-26T07:24:05.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.580+0000 7fd2128ba640 1 --2- 172.21.15.77:0/4126425889 >> v2:172.21.15.159:3300/0 conn(0x7fd20c0b0fb0 0x7fd20c06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.580+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f8003520 con 0x7fd20c0b0b40 2023-11-26T07:24:05.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 572594878 0 0) 0x7fd1f8003520 con 0x7fd20c0b0b40 2023-11-26T07:24:05.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 >> v2:172.21.15.159:3300/0 conn(0x7fd20c0b0fb0 msgr2=0x7fd20c06ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:05.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 --2- 172.21.15.77:0/4126425889 >> v2:172.21.15.159:3300/0 conn(0x7fd20c0b0fb0 0x7fd20c06ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 >> v1:172.21.15.159:6789/0 conn(0x7fd20c15b260 legacy=0x7fd20c06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c06e750 con 0x7fd20c0b0b40 2023-11-26T07:24:05.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fd1fc001670 con 0x7fd20c0b0b40 2023-11-26T07:24:05.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 >> v1:172.21.15.77:6789/0 conn(0x7fd20c0b0b40 legacy=0x7fd20c06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 --2- 172.21.15.77:0/4126425889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f80039c0 0x7fd1f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 --2- 172.21.15.77:0/4126425889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f80047c0 0x7fd1f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 --2- 172.21.15.77:0/4126425889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1f80052a0 0x7fd1f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c15b640 con 0x7fd1f80047c0 2023-11-26T07:24:05.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f800c1a0 con 0x7fd1f80052a0 2023-11-26T07:24:05.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f800c360 con 0x7fd1f80039c0 2023-11-26T07:24:05.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.581+0000 7fd2118b8640 1 --2- 172.21.15.77:0/4126425889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f80047c0 0x7fd1f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.582+0000 7fd2120b9640 1 --2- 172.21.15.77:0/4126425889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f80039c0 0x7fd1f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.582+0000 7fd2128ba640 1 --2- 172.21.15.77:0/4126425889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1f80052a0 0x7fd1f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.582+0000 7fd2118b8640 1 -- 172.21.15.77:0/4126425889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f80039c0 msgr2=0x7fd1f8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:05.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.582+0000 7fd2118b8640 1 --2- 172.21.15.77:0/4126425889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f80039c0 0x7fd1f8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.582+0000 7fd2118b8640 1 -- 172.21.15.77:0/4126425889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1f80052a0 msgr2=0x7fd1f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:05.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.582+0000 7fd2118b8640 1 --2- 172.21.15.77:0/4126425889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1f80052a0 0x7fd1f800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.582+0000 7fd2128ba640 1 -- 172.21.15.77:0/4126425889 reap_dead start 2023-11-26T07:24:05.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.582+0000 7fd2118b8640 1 -- 172.21.15.77:0/4126425889 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f8003520 con 0x7fd1f80047c0 2023-11-26T07:24:05.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.583+0000 7fd2118b8640 1 --2- 172.21.15.77:0/4126425889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f80047c0 0x7fd1f8004c40 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00c0e0 tx=0x7fd1f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86226cb963986d9b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.583+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc005ad0 con 0x7fd1f80047c0 2023-11-26T07:24:05.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.583+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc005c50 con 0x7fd1f80047c0 2023-11-26T07:24:05.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.583+0000 7fd2110b7640 1 -- 172.21.15.77:0/4126425889 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc02c7c0 con 0x7fd1f80047c0 2023-11-26T07:24:05.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.584+0000 7fd2130bb640 1 -- 172.21.15.77:0/4126425889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f80047c0 msgr2=0x7fd1f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.584+0000 7fd2130bb640 1 --2- 172.21.15.77:0/4126425889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f80047c0 0x7fd1f8004c40 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00c0e0 tx=0x7fd1f80057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.584+0000 7fd2130bb640 1 -- 172.21.15.77:0/4126425889 shutdown_connections 2023-11-26T07:24:05.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.584+0000 7fd2130bb640 1 --2- 172.21.15.77:0/4126425889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f80047c0 0x7fd1f8004c40 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.584+0000 7fd2130bb640 1 -- 172.21.15.77:0/4126425889 >> 172.21.15.77:0/4126425889 conn(0x7fd20c0cbb40 msgr2=0x7fd20c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:05.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.584+0000 7fd2130bb640 1 -- 172.21.15.77:0/4126425889 shutdown_connections 2023-11-26T07:24:05.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.584+0000 7fd2130bb640 1 -- 172.21.15.77:0/4126425889 wait complete. 2023-11-26T07:24:05.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.586+0000 7fd2130bb640 1 Processor -- start 2023-11-26T07:24:05.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.586+0000 7fd2130bb640 1 -- start start 2023-11-26T07:24:05.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.587+0000 7fd2130bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f80047c0 0x7fd20c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.587+0000 7fd2130bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd20c1567d0 0x7fd20c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.587+0000 7fd2130bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20c0acd50 0x7fd20c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.587+0000 7fd2130bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0ad740 con 0x7fd20c0acd50 2023-11-26T07:24:05.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.587+0000 7fd2130bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1f6380 con 0x7fd20c1567d0 2023-11-26T07:24:05.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.587+0000 7fd2130bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1f6660 con 0x7fd1f80047c0 2023-11-26T07:24:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.587+0000 7fd2128ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20c0acd50 0x7fd20c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.587+0000 7fd2128ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20c0acd50 0x7fd20c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60840/0 (socket says 172.21.15.77:60840) 2023-11-26T07:24:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.587+0000 7fd2128ba640 1 -- 172.21.15.77:0/702074349 learned_addr learned my addr 172.21.15.77:0/702074349 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.587+0000 7fd2118b8640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd20c1567d0 0x7fd20c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.587+0000 7fd2120b9640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f80047c0 0x7fd20c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.588+0000 7fd2128ba640 1 -- 172.21.15.77:0/702074349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f80047c0 msgr2=0x7fd20c15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.588+0000 7fd2128ba640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f80047c0 0x7fd20c15dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.588+0000 7fd2128ba640 1 -- 172.21.15.77:0/702074349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd20c1567d0 msgr2=0x7fd20c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.588+0000 7fd2128ba640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd20c1567d0 0x7fd20c157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.588+0000 7fd2128ba640 1 -- 172.21.15.77:0/702074349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c1f6940 con 0x7fd20c0acd50 2023-11-26T07:24:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.588+0000 7fd2128ba640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20c0acd50 0x7fd20c0ad200 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0b1750 tx=0x7fd2040115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.588+0000 7fd202ffd640 1 -- 172.21.15.77:0/702074349 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400e070 con 0x7fd20c0acd50 2023-11-26T07:24:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.588+0000 7fd202ffd640 1 -- 172.21.15.77:0/702074349 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd204011e10 con 0x7fd20c0acd50 2023-11-26T07:24:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.588+0000 7fd2130bb640 1 -- 172.21.15.77:0/702074349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c1f6c20 con 0x7fd20c0acd50 2023-11-26T07:24:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.588+0000 7fd202ffd640 1 -- 172.21.15.77:0/702074349 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204003990 con 0x7fd20c0acd50 2023-11-26T07:24:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.588+0000 7fd2130bb640 1 -- 172.21.15.77:0/702074349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c158210 con 0x7fd20c0acd50 2023-11-26T07:24:05.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.589+0000 7fd2130bb640 1 -- 172.21.15.77:0/702074349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c04e840 con 0x7fd20c0acd50 2023-11-26T07:24:05.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.591+0000 7fd202ffd640 1 -- 172.21.15.77:0/702074349 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fd204003af0 con 0x7fd20c0acd50 2023-11-26T07:24:05.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.591+0000 7fd202ffd640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1f006b920 0x7fd1f006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.592+0000 7fd202ffd640 1 -- 172.21.15.77:0/702074349 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd204088840 con 0x7fd20c0acd50 2023-11-26T07:24:05.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.592+0000 7fd2120b9640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1f006b920 0x7fd1f006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.592+0000 7fd2120b9640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1f006b920 0x7fd1f006dde0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd20c06e430 tx=0x7fd208009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.596+0000 7fd202ffd640 1 -- 172.21.15.77:0/702074349 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd204058e30 con 0x7fd20c0acd50 2023-11-26T07:24:05.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.787+0000 7fd2130bb640 1 -- 172.21.15.77:0/702074349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd20c0ce610 con 0x7fd20c0acd50 2023-11-26T07:24:05.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.788+0000 7fd202ffd640 1 -- 172.21.15.77:0/702074349 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2040589c0 con 0x7fd20c0acd50 2023-11-26T07:24:05.790 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:24:05.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.790+0000 7fd2130bb640 1 -- 172.21.15.77:0/702074349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1f006b920 msgr2=0x7fd1f006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.790+0000 7fd2130bb640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1f006b920 0x7fd1f006dde0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd20c06e430 tx=0x7fd208009040 comp rx=0 tx=0).stop 2023-11-26T07:24:05.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.790+0000 7fd2130bb640 1 -- 172.21.15.77:0/702074349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20c0acd50 msgr2=0x7fd20c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.790+0000 7fd2130bb640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20c0acd50 0x7fd20c0ad200 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0b1750 tx=0x7fd2040115a0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.790+0000 7fd2130bb640 1 -- 172.21.15.77:0/702074349 shutdown_connections 2023-11-26T07:24:05.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.790+0000 7fd2130bb640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1f006b920 0x7fd1f006dde0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.790+0000 7fd2130bb640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20c0acd50 0x7fd20c0ad200 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.790+0000 7fd2130bb640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd20c1567d0 0x7fd20c157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.790+0000 7fd2130bb640 1 --2- 172.21.15.77:0/702074349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f80047c0 0x7fd20c15dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.790+0000 7fd2130bb640 1 -- 172.21.15.77:0/702074349 >> 172.21.15.77:0/702074349 conn(0x7fd20c0cbb40 msgr2=0x7fd20c0ac570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:05.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.791+0000 7fd2130bb640 1 -- 172.21.15.77:0/702074349 shutdown_connections 2023-11-26T07:24:05.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:05.791+0000 7fd2130bb640 1 -- 172.21.15.77:0/702074349 wait complete. 2023-11-26T07:24:05.812 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.028+0000 7faeb0c67640 1 Processor -- start 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.029+0000 7faeb0c67640 1 -- start start 2023-11-26T07:24:06.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.030+0000 7faeb0c67640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7faeac1608f0 0x7faeac0d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.030+0000 7faeb0c67640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac160cd0 con 0x7faeac0ce260 2023-11-26T07:24:06.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.030+0000 7faeb0c67640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac0cdcb0 con 0x7faeac0d3890 2023-11-26T07:24:06.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.030+0000 7faeb0c67640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeac0b8f60 con 0x7faeac1608f0 2023-11-26T07:24:06.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.030+0000 7faeaaffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7faeac0ce260 0x7faeac0d3180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49932/0 (socket says 172.21.15.77:49932) 2023-11-26T07:24:06.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.030+0000 7faeaaffd640 1 -- 172.21.15.77:0/1902233224 learned_addr learned my addr 172.21.15.77:0/1902233224 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeab7fe640 1 --2- 172.21.15.77:0/1902233224 >> v2:172.21.15.159:3300/0 conn(0x7faeac1608f0 0x7faeac0d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563657868 0 0) 0x7faeac160cd0 con 0x7faeac0ce260 2023-11-26T07:24:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae98003520 con 0x7faeac0ce260 2023-11-26T07:24:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3205644806 0 0) 0x7fae98003520 con 0x7faeac0ce260 2023-11-26T07:24:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 >> v2:172.21.15.159:3300/0 conn(0x7faeac1608f0 msgr2=0x7faeac0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 --2- 172.21.15.77:0/1902233224 >> v2:172.21.15.159:3300/0 conn(0x7faeac1608f0 0x7faeac0d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 >> v1:172.21.15.159:6789/0 conn(0x7faeac0d3890 legacy=0x7faeac0b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0cdf90 con 0x7faeac0ce260 2023-11-26T07:24:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fae94001670 con 0x7faeac0ce260 2023-11-26T07:24:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 >> v1:172.21.15.77:6789/0 conn(0x7faeac0ce260 legacy=0x7faeac0d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 --2- 172.21.15.77:0/1902233224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae980039c0 0x7fae98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 --2- 172.21.15.77:0/1902233224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae980047c0 0x7fae98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 --2- 172.21.15.77:0/1902233224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae98005180 0x7fae9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0b8f60 con 0x7fae980047c0 2023-11-26T07:24:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9800c080 con 0x7fae980039c0 2023-11-26T07:24:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.031+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9800c240 con 0x7fae98005180 2023-11-26T07:24:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.032+0000 7faeaaffd640 1 --2- 172.21.15.77:0/1902233224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae980047c0 0x7fae98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.032+0000 7faeab7fe640 1 --2- 172.21.15.77:0/1902233224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae980039c0 0x7fae98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.032+0000 7faeaaffd640 1 -- 172.21.15.77:0/1902233224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae98005180 msgr2=0x7fae9800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:06.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.032+0000 7faeaaffd640 1 --2- 172.21.15.77:0/1902233224 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae98005180 0x7fae9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.032+0000 7faeaaffd640 1 -- 172.21.15.77:0/1902233224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae980039c0 msgr2=0x7fae98003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:06.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.032+0000 7faeaaffd640 1 --2- 172.21.15.77:0/1902233224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae980039c0 0x7fae98003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.032+0000 7faeaaffd640 1 -- 172.21.15.77:0/1902233224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae98003520 con 0x7fae980047c0 2023-11-26T07:24:06.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.032+0000 7faeabfff640 1 -- 172.21.15.77:0/1902233224 reap_dead start 2023-11-26T07:24:06.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.033+0000 7faeaaffd640 1 --2- 172.21.15.77:0/1902233224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae980047c0 0x7fae98004c40 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fae9400c0e0 tx=0x7fae980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c46eaaad6ced45 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.033+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94005ad0 con 0x7fae980047c0 2023-11-26T07:24:06.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.033+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae94005c30 con 0x7fae980047c0 2023-11-26T07:24:06.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.033+0000 7faeaa7fc640 1 -- 172.21.15.77:0/1902233224 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9402ca50 con 0x7fae980047c0 2023-11-26T07:24:06.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.034+0000 7faeb0c67640 1 -- 172.21.15.77:0/1902233224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae980047c0 msgr2=0x7fae98004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.034+0000 7faeb0c67640 1 --2- 172.21.15.77:0/1902233224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae980047c0 0x7fae98004c40 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fae9400c0e0 tx=0x7fae980057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.034+0000 7faeb0c67640 1 -- 172.21.15.77:0/1902233224 shutdown_connections 2023-11-26T07:24:06.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.034+0000 7faeb0c67640 1 --2- 172.21.15.77:0/1902233224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae980047c0 0x7fae98004c40 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.034+0000 7faeb0c67640 1 -- 172.21.15.77:0/1902233224 >> 172.21.15.77:0/1902233224 conn(0x7faeac061340 msgr2=0x7faeac061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:06.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.034+0000 7faeb0c67640 1 -- 172.21.15.77:0/1902233224 shutdown_connections 2023-11-26T07:24:06.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.034+0000 7faeb0c67640 1 -- 172.21.15.77:0/1902233224 wait complete. 2023-11-26T07:24:06.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.036+0000 7faeb0c67640 1 Processor -- start 2023-11-26T07:24:06.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.036+0000 7faeb0c67640 1 -- start start 2023-11-26T07:24:06.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.037+0000 7faeb0c67640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae980047c0 0x7faeac0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.037+0000 7faeb0c67640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeac0b7c80 0x7faeac1f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.037+0000 7faeb0c67640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faeac1f6270 0x7faeac13f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.037+0000 7faeb0c67640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1f66f0 con 0x7faeac0b7c80 2023-11-26T07:24:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.037+0000 7faeb0c67640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0c6630 con 0x7fae980047c0 2023-11-26T07:24:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.037+0000 7faeb0c67640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0b77f0 con 0x7faeac1f6270 2023-11-26T07:24:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.037+0000 7faeaaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeac0b7c80 0x7faeac1f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.037+0000 7faeaaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeac0b7c80 0x7faeac1f5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40058/0 (socket says 172.21.15.77:40058) 2023-11-26T07:24:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.037+0000 7faeaaffd640 1 -- 172.21.15.77:0/1715749831 learned_addr learned my addr 172.21.15.77:0/1715749831 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faeab7fe640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae980047c0 0x7faeac0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faeaaffd640 1 -- 172.21.15.77:0/1715749831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faeac1f6270 msgr2=0x7faeac13f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faeaaffd640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faeac1f6270 0x7faeac13f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faeaaffd640 1 -- 172.21.15.77:0/1715749831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae980047c0 msgr2=0x7faeac0b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faeaaffd640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae980047c0 0x7faeac0b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faeaaffd640 1 -- 172.21.15.77:0/1715749831 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0b6910 con 0x7faeac0b7c80 2023-11-26T07:24:06.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faeaaffd640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeac0b7c80 0x7faeac1f5d30 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fae9400c0e0 tx=0x7fae9402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faea3fff640 1 -- 172.21.15.77:0/1715749831 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9403c040 con 0x7faeac0b7c80 2023-11-26T07:24:06.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faea3fff640 1 -- 172.21.15.77:0/1715749831 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9402cd80 con 0x7faeac0b7c80 2023-11-26T07:24:06.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faeb0c67640 1 -- 172.21.15.77:0/1715749831 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac0b6be0 con 0x7faeac0b7c80 2023-11-26T07:24:06.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faea3fff640 1 -- 172.21.15.77:0/1715749831 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae940072b0 con 0x7faeac0b7c80 2023-11-26T07:24:06.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.038+0000 7faeb0c67640 1 -- 172.21.15.77:0/1715749831 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac0b71a0 con 0x7faeac0b7c80 2023-11-26T07:24:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.040+0000 7faeb0c67640 1 -- 172.21.15.77:0/1715749831 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac067990 con 0x7faeac0b7c80 2023-11-26T07:24:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.041+0000 7faea3fff640 1 -- 172.21.15.77:0/1715749831 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fae94032070 con 0x7faeac0b7c80 2023-11-26T07:24:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.041+0000 7faea3fff640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae8c06b8f0 0x7fae8c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.042+0000 7faea3fff640 1 -- 172.21.15.77:0/1715749831 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fae940a9670 con 0x7faeac0b7c80 2023-11-26T07:24:06.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.042+0000 7faeab7fe640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae8c06b8f0 0x7fae8c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.042+0000 7faeab7fe640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae8c06b8f0 0x7fae8c06ddb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fae9c007380 tx=0x7fae9c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.046+0000 7faea3fff640 1 -- 172.21.15.77:0/1715749831 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fae94075f40 con 0x7faeac0b7c80 2023-11-26T07:24:06.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.235+0000 7faeb0c67640 1 -- 172.21.15.77:0/1715749831 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faeac0d2b80 con 0x7faeac0b7c80 2023-11-26T07:24:06.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.236+0000 7faea3fff640 1 -- 172.21.15.77:0/1715749831 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae94079560 con 0x7faeac0b7c80 2023-11-26T07:24:06.239 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:24:06.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.238+0000 7faeb0c67640 1 -- 172.21.15.77:0/1715749831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae8c06b8f0 msgr2=0x7fae8c06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.238+0000 7faeb0c67640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae8c06b8f0 0x7fae8c06ddb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fae9c007380 tx=0x7fae9c00b040 comp rx=0 tx=0).stop 2023-11-26T07:24:06.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.238+0000 7faeb0c67640 1 -- 172.21.15.77:0/1715749831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeac0b7c80 msgr2=0x7faeac1f5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.238+0000 7faeb0c67640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeac0b7c80 0x7faeac1f5d30 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fae9400c0e0 tx=0x7fae9402e070 comp rx=0 tx=0).stop 2023-11-26T07:24:06.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.239+0000 7faeb0c67640 1 -- 172.21.15.77:0/1715749831 shutdown_connections 2023-11-26T07:24:06.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.239+0000 7faeb0c67640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fae8c06b8f0 0x7fae8c06ddb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.239+0000 7faeb0c67640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faeac1f6270 0x7faeac13f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.239+0000 7faeb0c67640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeac0b7c80 0x7faeac1f5d30 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.239+0000 7faeb0c67640 1 --2- 172.21.15.77:0/1715749831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae980047c0 0x7faeac0b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.239+0000 7faeb0c67640 1 -- 172.21.15.77:0/1715749831 >> 172.21.15.77:0/1715749831 conn(0x7faeac061340 msgr2=0x7faeac0b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:06.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.239+0000 7faeb0c67640 1 -- 172.21.15.77:0/1715749831 shutdown_connections 2023-11-26T07:24:06.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.239+0000 7faeb0c67640 1 -- 172.21.15.77:0/1715749831 wait complete. 2023-11-26T07:24:06.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:24:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.460+0000 7fdc1be5c640 1 Processor -- start 2023-11-26T07:24:06.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.460+0000 7fdc1be5c640 1 -- start start 2023-11-26T07:24:06.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.461+0000 7fdc1be5c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc14161060 0x7fdc14161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.461+0000 7fdc1be5c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdc1406b6c0 0x7fdc1415e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.461+0000 7fdc1be5c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1406dcf0 con 0x7fdc140b3330 2023-11-26T07:24:06.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.461+0000 7fdc1be5c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1406ec10 con 0x7fdc1406b6c0 2023-11-26T07:24:06.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.461+0000 7fdc1be5c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14161980 con 0x7fdc14161060 2023-11-26T07:24:06.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.462+0000 7fdc19bf8640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc14161060 0x7fdc14161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.462+0000 7fdc19bf8640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc14161060 0x7fdc14161440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:44150/0 (socket says 172.21.15.77:44150) 2023-11-26T07:24:06.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.462+0000 7fdc19bf8640 1 -- 172.21.15.77:0/2384121029 learned_addr learned my addr 172.21.15.77:0/2384121029 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:06.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.462+0000 7fdc1a3f9640 1 --2- 172.21.15.77:0/2384121029 >> v2:172.21.15.159:3300/0 conn(0x7fdc1406b6c0 0x7fdc1415e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.463+0000 7fdc19bf8640 1 -- 172.21.15.77:0/2384121029 >> v2:172.21.15.159:3300/0 conn(0x7fdc1406b6c0 msgr2=0x7fdc1415e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:06.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.463+0000 7fdc19bf8640 1 --2- 172.21.15.77:0/2384121029 >> v2:172.21.15.159:3300/0 conn(0x7fdc1406b6c0 0x7fdc1415e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.463+0000 7fdc19bf8640 1 -- 172.21.15.77:0/2384121029 >> v1:172.21.15.159:6789/0 conn(0x7fdc140b3330 legacy=0x7fdc1415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.463+0000 7fdc19bf8640 1 -- 172.21.15.77:0/2384121029 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc14161ec0 con 0x7fdc14161060 2023-11-26T07:24:06.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.463+0000 7fdc1a3f9640 1 --2- 172.21.15.77:0/2384121029 >> v2:172.21.15.159:3300/0 conn(0x7fdc1406b6c0 0x7fdc1415e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:06.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.464+0000 7fdc19bf8640 1 --2- 172.21.15.77:0/2384121029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc14161060 0x7fdc14161440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009870 tx=0x7fdc1002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa1ba2054fe79ce server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.465+0000 7fdc18bf6640 1 -- 172.21.15.77:0/2384121029 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10031640 con 0x7fdc14161060 2023-11-26T07:24:06.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.465+0000 7fdc18bf6640 1 -- 172.21.15.77:0/2384121029 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc100317a0 con 0x7fdc14161060 2023-11-26T07:24:06.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.465+0000 7fdc18bf6640 1 -- 172.21.15.77:0/2384121029 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10031b30 con 0x7fdc14161060 2023-11-26T07:24:06.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.465+0000 7fdc1be5c640 1 -- 172.21.15.77:0/2384121029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc14161060 msgr2=0x7fdc14161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.465+0000 7fdc1be5c640 1 --2- 172.21.15.77:0/2384121029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc14161060 0x7fdc14161440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009870 tx=0x7fdc1002b8f0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.465+0000 7fdc1be5c640 1 -- 172.21.15.77:0/2384121029 shutdown_connections 2023-11-26T07:24:06.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.465+0000 7fdc1be5c640 1 --2- 172.21.15.77:0/2384121029 >> v2:172.21.15.159:3300/0 conn(0x7fdc1406b6c0 0x7fdc1415e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.465+0000 7fdc1be5c640 1 --2- 172.21.15.77:0/2384121029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc14161060 0x7fdc14161440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.465+0000 7fdc1be5c640 1 -- 172.21.15.77:0/2384121029 >> 172.21.15.77:0/2384121029 conn(0x7fdc140cf900 msgr2=0x7fdc140cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:06.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.465+0000 7fdc1be5c640 1 -- 172.21.15.77:0/2384121029 shutdown_connections 2023-11-26T07:24:06.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.465+0000 7fdc1be5c640 1 -- 172.21.15.77:0/2384121029 wait complete. 2023-11-26T07:24:06.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.467+0000 7fdc1be5c640 1 Processor -- start 2023-11-26T07:24:06.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.467+0000 7fdc1be5c640 1 -- start start 2023-11-26T07:24:06.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.468+0000 7fdc1be5c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc1406b6c0 0x7fdc14150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.468+0000 7fdc1be5c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc140b3330 0x7fdc141563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.468+0000 7fdc1be5c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc14161060 0x7fdc14156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.468+0000 7fdc1be5c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc141f4390 con 0x7fdc1406b6c0 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.468+0000 7fdc1be5c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc141f3780 con 0x7fdc14161060 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.468+0000 7fdc1be5c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc141f3a60 con 0x7fdc140b3330 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.469+0000 7fdc19bf8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc1406b6c0 0x7fdc14150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.469+0000 7fdc19bf8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc1406b6c0 0x7fdc14150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40070/0 (socket says 172.21.15.77:40070) 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.469+0000 7fdc19bf8640 1 -- 172.21.15.77:0/1483964128 learned_addr learned my addr 172.21.15.77:0/1483964128 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.469+0000 7fdc193f7640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc140b3330 0x7fdc141563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.469+0000 7fdc1a3f9640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc14161060 0x7fdc14156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.469+0000 7fdc19bf8640 1 -- 172.21.15.77:0/1483964128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc140b3330 msgr2=0x7fdc141563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.469+0000 7fdc19bf8640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc140b3330 0x7fdc141563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.469+0000 7fdc19bf8640 1 -- 172.21.15.77:0/1483964128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc14161060 msgr2=0x7fdc14156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.469+0000 7fdc19bf8640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc14161060 0x7fdc14156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.469+0000 7fdc19bf8640 1 -- 172.21.15.77:0/1483964128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100094d0 con 0x7fdc1406b6c0 2023-11-26T07:24:06.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.469+0000 7fdc19bf8640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc1406b6c0 0x7fdc14150c10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdc10000c00 tx=0x7fdc100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.470+0000 7fdc0a7fc640 1 -- 172.21.15.77:0/1483964128 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1003ac60 con 0x7fdc1406b6c0 2023-11-26T07:24:06.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.470+0000 7fdc0a7fc640 1 -- 172.21.15.77:0/1483964128 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1003adc0 con 0x7fdc1406b6c0 2023-11-26T07:24:06.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.470+0000 7fdc0a7fc640 1 -- 172.21.15.77:0/1483964128 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10044630 con 0x7fdc1406b6c0 2023-11-26T07:24:06.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.470+0000 7fdc1be5c640 1 -- 172.21.15.77:0/1483964128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc141f3d40 con 0x7fdc1406b6c0 2023-11-26T07:24:06.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.470+0000 7fdc1be5c640 1 -- 172.21.15.77:0/1483964128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc141f32f0 con 0x7fdc1406b6c0 2023-11-26T07:24:06.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.471+0000 7fdc1be5c640 1 -- 172.21.15.77:0/1483964128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc141f34e0 con 0x7fdc1406b6c0 2023-11-26T07:24:06.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.472+0000 7fdc0a7fc640 1 -- 172.21.15.77:0/1483964128 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fdc1002f050 con 0x7fdc1406b6c0 2023-11-26T07:24:06.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.473+0000 7fdc0a7fc640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbf806b8f0 0x7fdbf806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.473+0000 7fdc0a7fc640 1 -- 172.21.15.77:0/1483964128 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdc100a9de0 con 0x7fdc1406b6c0 2023-11-26T07:24:06.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.473+0000 7fdc193f7640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbf806b8f0 0x7fdbf806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.474+0000 7fdc193f7640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbf806b8f0 0x7fdbf806ddb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdc1415c350 tx=0x7fdc04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.477+0000 7fdc0a7fc640 1 -- 172.21.15.77:0/1483964128 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc10076940 con 0x7fdc1406b6c0 2023-11-26T07:24:06.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.669+0000 7fdc1be5c640 1 -- 172.21.15.77:0/1483964128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc1404e8b0 con 0x7fdc1406b6c0 2023-11-26T07:24:06.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.670+0000 7fdc0a7fc640 1 -- 172.21.15.77:0/1483964128 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc10035020 con 0x7fdc1406b6c0 2023-11-26T07:24:06.672 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:24:06.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.672+0000 7fdc1be5c640 1 -- 172.21.15.77:0/1483964128 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbf806b8f0 msgr2=0x7fdbf806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.672+0000 7fdc1be5c640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbf806b8f0 0x7fdbf806ddb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdc1415c350 tx=0x7fdc04009040 comp rx=0 tx=0).stop 2023-11-26T07:24:06.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.672+0000 7fdc1be5c640 1 -- 172.21.15.77:0/1483964128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc1406b6c0 msgr2=0x7fdc14150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.672+0000 7fdc1be5c640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc1406b6c0 0x7fdc14150c10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdc10000c00 tx=0x7fdc100046c0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.672+0000 7fdc1be5c640 1 -- 172.21.15.77:0/1483964128 shutdown_connections 2023-11-26T07:24:06.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.672+0000 7fdc1be5c640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdbf806b8f0 0x7fdbf806ddb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.672+0000 7fdc1be5c640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc14161060 0x7fdc14156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.672+0000 7fdc1be5c640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc140b3330 0x7fdc141563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.672+0000 7fdc1be5c640 1 --2- 172.21.15.77:0/1483964128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc1406b6c0 0x7fdc14150c10 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.673+0000 7fdc1be5c640 1 -- 172.21.15.77:0/1483964128 >> 172.21.15.77:0/1483964128 conn(0x7fdc140cf900 msgr2=0x7fdc140b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:06.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.673+0000 7fdc1be5c640 1 -- 172.21.15.77:0/1483964128 shutdown_connections 2023-11-26T07:24:06.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.673+0000 7fdc1be5c640 1 -- 172.21.15.77:0/1483964128 wait complete. 2023-11-26T07:24:06.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:24:06.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.906+0000 7ff13e061640 1 Processor -- start 2023-11-26T07:24:06.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.906+0000 7ff13e061640 1 -- start start 2023-11-26T07:24:06.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.907+0000 7ff13e061640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1381660b0 0x7ff138162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.907+0000 7ff13e061640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff138166510 con 0x7ff138162540 2023-11-26T07:24:06.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.907+0000 7ff13e061640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1381655f0 con 0x7ff1380ccbd0 2023-11-26T07:24:06.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.907+0000 7ff13e061640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1380cc380 con 0x7ff1381660b0 2023-11-26T07:24:06.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.908+0000 7ff137fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff138162540 0x7ff1380c9650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49948/0 (socket says 172.21.15.77:49948) 2023-11-26T07:24:06.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.908+0000 7ff137fff640 1 -- 172.21.15.77:0/1110168897 learned_addr learned my addr 172.21.15.77:0/1110168897 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:06.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.908+0000 7ff12ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1381660b0 0x7ff138162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.908+0000 7ff136ffd640 1 -- 172.21.15.77:0/1110168897 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412134250 0 0) 0x7ff130001490 con 0x7ff138162540 2023-11-26T07:24:06.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.908+0000 7ff136ffd640 1 -- 172.21.15.77:0/1110168897 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff124003520 con 0x7ff138162540 2023-11-26T07:24:06.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.908+0000 7ff12ffff640 1 -- 172.21.15.77:0/1110168897 >> v1:172.21.15.159:6789/0 conn(0x7ff1380ccbd0 legacy=0x7ff1380ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:06.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.908+0000 7ff12ffff640 1 -- 172.21.15.77:0/1110168897 >> v1:172.21.15.77:6789/0 conn(0x7ff138162540 legacy=0x7ff1380c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.908+0000 7ff12ffff640 1 -- 172.21.15.77:0/1110168897 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138162b30 con 0x7ff1381660b0 2023-11-26T07:24:06.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.910+0000 7ff12ffff640 1 --2- 172.21.15.77:0/1110168897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1381660b0 0x7ff138162000 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff1200097a0 tx=0x7ff12002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3474c97aed05ef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.910+0000 7ff136ffd640 1 -- 172.21.15.77:0/1110168897 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120030610 con 0x7ff1381660b0 2023-11-26T07:24:06.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.910+0000 7ff136ffd640 1 -- 172.21.15.77:0/1110168897 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff120030770 con 0x7ff1381660b0 2023-11-26T07:24:06.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.910+0000 7ff136ffd640 1 -- 172.21.15.77:0/1110168897 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120030b00 con 0x7ff1381660b0 2023-11-26T07:24:06.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.910+0000 7ff13e061640 1 -- 172.21.15.77:0/1110168897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1381660b0 msgr2=0x7ff138162000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.910+0000 7ff13e061640 1 --2- 172.21.15.77:0/1110168897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1381660b0 0x7ff138162000 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff1200097a0 tx=0x7ff12002b960 comp rx=0 tx=0).stop 2023-11-26T07:24:06.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.911+0000 7ff13e061640 1 -- 172.21.15.77:0/1110168897 shutdown_connections 2023-11-26T07:24:06.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.911+0000 7ff13e061640 1 --2- 172.21.15.77:0/1110168897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1381660b0 0x7ff138162000 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.911+0000 7ff13e061640 1 -- 172.21.15.77:0/1110168897 >> 172.21.15.77:0/1110168897 conn(0x7ff1380b0c50 msgr2=0x7ff1380b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:06.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.911+0000 7ff13e061640 1 -- 172.21.15.77:0/1110168897 shutdown_connections 2023-11-26T07:24:06.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.911+0000 7ff13e061640 1 -- 172.21.15.77:0/1110168897 wait complete. 2023-11-26T07:24:06.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.912+0000 7ff13e061640 1 Processor -- start 2023-11-26T07:24:06.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.913+0000 7ff13e061640 1 -- start start 2023-11-26T07:24:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.913+0000 7ff13e061640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1380ccbd0 0x7ff1380adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.913+0000 7ff13e061640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff138162540 0x7ff1380c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.913+0000 7ff13e061640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1381660b0 0x7ff13814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.913+0000 7ff13e061640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1380ac040 con 0x7ff138162540 2023-11-26T07:24:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.913+0000 7ff13e061640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1380ac320 con 0x7ff1381660b0 2023-11-26T07:24:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.913+0000 7ff13e061640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1380ac600 con 0x7ff1380ccbd0 2023-11-26T07:24:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff138162540 0x7ff1380c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff138162540 0x7ff1380c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40088/0 (socket says 172.21.15.77:40088) 2023-11-26T07:24:06.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff12ffff640 1 -- 172.21.15.77:0/1234712319 learned_addr learned my addr 172.21.15.77:0/1234712319 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff137fff640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1381660b0 0x7ff13814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff1377fe640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1380ccbd0 0x7ff1380adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff12ffff640 1 -- 172.21.15.77:0/1234712319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1380ccbd0 msgr2=0x7ff1380adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff12ffff640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1380ccbd0 0x7ff1380adec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff12ffff640 1 -- 172.21.15.77:0/1234712319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1381660b0 msgr2=0x7ff13814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff12ffff640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1381660b0 0x7ff13814e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff12ffff640 1 -- 172.21.15.77:0/1234712319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff120009400 con 0x7ff138162540 2023-11-26T07:24:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff137fff640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1381660b0 0x7ff13814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.914+0000 7ff1377fe640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1380ccbd0 0x7ff1380adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.915+0000 7ff12ffff640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff138162540 0x7ff1380c60d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ff1200098c0 tx=0x7ff120004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.915+0000 7ff134ff9640 1 -- 172.21.15.77:0/1234712319 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12003e040 con 0x7ff138162540 2023-11-26T07:24:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.915+0000 7ff134ff9640 1 -- 172.21.15.77:0/1234712319 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff120039c90 con 0x7ff138162540 2023-11-26T07:24:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.915+0000 7ff134ff9640 1 -- 172.21.15.77:0/1234712319 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120030e10 con 0x7ff138162540 2023-11-26T07:24:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.915+0000 7ff13e061640 1 -- 172.21.15.77:0/1234712319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1380ac8e0 con 0x7ff138162540 2023-11-26T07:24:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.915+0000 7ff13e061640 1 -- 172.21.15.77:0/1234712319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1380ad0e0 con 0x7ff138162540 2023-11-26T07:24:06.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.916+0000 7ff13e061640 1 -- 172.21.15.77:0/1234712319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1380ace00 con 0x7ff138162540 2023-11-26T07:24:06.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.917+0000 7ff134ff9640 1 -- 172.21.15.77:0/1234712319 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7ff120043390 con 0x7ff138162540 2023-11-26T07:24:06.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.918+0000 7ff134ff9640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff11806b920 0x7ff11806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.918+0000 7ff134ff9640 1 -- 172.21.15.77:0/1234712319 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff1200aa340 con 0x7ff138162540 2023-11-26T07:24:06.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.918+0000 7ff1377fe640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff11806b920 0x7ff11806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.919+0000 7ff1377fe640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff11806b920 0x7ff11806dde0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff128000f60 tx=0x7ff128009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:06.923+0000 7ff134ff9640 1 -- 172.21.15.77:0/1234712319 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1380ace00 con 0x7ff138162540 2023-11-26T07:24:07.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.128+0000 7ff13e061640 1 -- 172.21.15.77:0/1234712319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff1380ace00 con 0x7ff138162540 2023-11-26T07:24:07.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.128+0000 7ff134ff9640 1 -- 172.21.15.77:0/1234712319 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v77) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff1380ace00 con 0x7ff138162540 2023-11-26T07:24:07.131 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:24:07.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 -- 172.21.15.77:0/1234712319 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff11806b920 msgr2=0x7ff11806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff11806b920 0x7ff11806dde0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff128000f60 tx=0x7ff128009040 comp rx=0 tx=0).stop 2023-11-26T07:24:07.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 -- 172.21.15.77:0/1234712319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff138162540 msgr2=0x7ff1380c60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff138162540 0x7ff1380c60d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ff1200098c0 tx=0x7ff120004730 comp rx=0 tx=0).stop 2023-11-26T07:24:07.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 -- 172.21.15.77:0/1234712319 shutdown_connections 2023-11-26T07:24:07.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff11806b920 0x7ff11806dde0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1381660b0 0x7ff13814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff138162540 0x7ff1380c60d0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 --2- 172.21.15.77:0/1234712319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1380ccbd0 0x7ff1380adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 -- 172.21.15.77:0/1234712319 >> 172.21.15.77:0/1234712319 conn(0x7ff1380b0c50 msgr2=0x7ff1380aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:07.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 -- 172.21.15.77:0/1234712319 shutdown_connections 2023-11-26T07:24:07.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.131+0000 7ff13e061640 1 -- 172.21.15.77:0/1234712319 wait complete. 2023-11-26T07:24:07.150 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-26T07:24:07.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:07.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-26T07:24:07.333 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:24:07.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:07.333 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:24:07.379 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:24:07.379 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:07.420 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:24:07.420 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:07.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:24:07.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.720+0000 7fbeba0da640 1 Processor -- start 2023-11-26T07:24:07.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.720+0000 7fbeba0da640 1 -- start start 2023-11-26T07:24:07.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeba0da640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb415c7f0 0x7fbeb406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeba0da640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbeb40ce6c0 0x7fbeb40cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeba0da640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb40cece0 con 0x7fbeb40cf450 2023-11-26T07:24:07.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeba0da640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb4156010 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeba0da640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb406ce30 con 0x7fbeb415c7f0 2023-11-26T07:24:07.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeb3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbeb40ce6c0 0x7fbeb40cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:07.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeb3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbeb40ce6c0 0x7fbeb40cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40096/0 (socket says 172.21.15.77:40096) 2023-11-26T07:24:07.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeb3fff640 1 -- 172.21.15.77:0/938822992 learned_addr learned my addr 172.21.15.77:0/938822992 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:07.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeb37fe640 1 --2- 172.21.15.77:0/938822992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb415c7f0 0x7fbeb406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:07.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeb3fff640 1 -- 172.21.15.77:0/938822992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb415c7f0 msgr2=0x7fbeb406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:07.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeb3fff640 1 --2- 172.21.15.77:0/938822992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb415c7f0 0x7fbeb406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeb3fff640 1 -- 172.21.15.77:0/938822992 >> v1:172.21.15.159:6789/0 conn(0x7fbeb40cf450 legacy=0x7fbeb40cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:07.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeb3fff640 1 -- 172.21.15.77:0/938822992 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb406d040 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.722+0000 7fbeb37fe640 1 --2- 172.21.15.77:0/938822992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb415c7f0 0x7fbeb406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:07.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.724+0000 7fbeb3fff640 1 --2- 172.21.15.77:0/938822992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbeb40ce6c0 0x7fbeb40cf8d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009e50 tx=0x7fbeac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a287b3ea6c4e7a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:07.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.724+0000 7fbeb2ffd640 1 -- 172.21.15.77:0/938822992 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac02ca70 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.724+0000 7fbeb2ffd640 1 -- 172.21.15.77:0/938822992 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac02cbd0 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.724+0000 7fbeb2ffd640 1 -- 172.21.15.77:0/938822992 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac0343f0 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.724+0000 7fbeba0da640 1 -- 172.21.15.77:0/938822992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbeb40ce6c0 msgr2=0x7fbeb40cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.724+0000 7fbeba0da640 1 --2- 172.21.15.77:0/938822992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbeb40ce6c0 0x7fbeb40cf8d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009e50 tx=0x7fbeac02bed0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.725+0000 7fbeba0da640 1 -- 172.21.15.77:0/938822992 shutdown_connections 2023-11-26T07:24:07.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.725+0000 7fbeba0da640 1 --2- 172.21.15.77:0/938822992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbeb40ce6c0 0x7fbeb40cf8d0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.725+0000 7fbeba0da640 1 --2- 172.21.15.77:0/938822992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb415c7f0 0x7fbeb406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.725+0000 7fbeba0da640 1 -- 172.21.15.77:0/938822992 >> 172.21.15.77:0/938822992 conn(0x7fbeb406a920 msgr2=0x7fbeb406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:07.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.725+0000 7fbeba0da640 1 -- 172.21.15.77:0/938822992 shutdown_connections 2023-11-26T07:24:07.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.725+0000 7fbeba0da640 1 -- 172.21.15.77:0/938822992 wait complete. 2023-11-26T07:24:07.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.726+0000 7fbeba0da640 1 Processor -- start 2023-11-26T07:24:07.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.727+0000 7fbeba0da640 1 -- start start 2023-11-26T07:24:07.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.727+0000 7fbeba0da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbeb40ce6c0 0x7fbeb4149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.727+0000 7fbeba0da640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb40cf450 0x7fbeb40ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.727+0000 7fbeba0da640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeb415c7f0 0x7fbeb40aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.727+0000 7fbeba0da640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40ad3a0 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.727+0000 7fbeba0da640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40ae410 con 0x7fbeb415c7f0 2023-11-26T07:24:07.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.727+0000 7fbeba0da640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40ac9d0 con 0x7fbeb40cf450 2023-11-26T07:24:07.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeb37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbeb40ce6c0 0x7fbeb4149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:07.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeb37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbeb40ce6c0 0x7fbeb4149500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40106/0 (socket says 172.21.15.77:40106) 2023-11-26T07:24:07.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeb37fe640 1 -- 172.21.15.77:0/3433095741 learned_addr learned my addr 172.21.15.77:0/3433095741 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:07.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeb3fff640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeb415c7f0 0x7fbeb40aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:07.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeabfff640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb40cf450 0x7fbeb40ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:07.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeb37fe640 1 -- 172.21.15.77:0/3433095741 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb40cf450 msgr2=0x7fbeb40ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeb37fe640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb40cf450 0x7fbeb40ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeb37fe640 1 -- 172.21.15.77:0/3433095741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeb415c7f0 msgr2=0x7fbeb40aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeb37fe640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeb415c7f0 0x7fbeb40aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeb37fe640 1 -- 172.21.15.77:0/3433095741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac009b30 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeabfff640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb40cf450 0x7fbeb40ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:07.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.728+0000 7fbeb3fff640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeb415c7f0 0x7fbeb40aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:07.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.729+0000 7fbeb37fe640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbeb40ce6c0 0x7fbeb4149500 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c820 tx=0x7fbea400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:07.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.729+0000 7fbeb0ff9640 1 -- 172.21.15.77:0/3433095741 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea40079d0 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.729+0000 7fbeb0ff9640 1 -- 172.21.15.77:0/3433095741 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea4007b30 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.729+0000 7fbeb0ff9640 1 -- 172.21.15.77:0/3433095741 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4007ea0 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.729+0000 7fbeba0da640 1 -- 172.21.15.77:0/3433095741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb414a3d0 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.729+0000 7fbeba0da640 1 -- 172.21.15.77:0/3433095741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb415fa00 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.730+0000 7fbeba0da640 1 -- 172.21.15.77:0/3433095741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb4061a50 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.731+0000 7fbeb0ff9640 1 -- 172.21.15.77:0/3433095741 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fbea40113f0 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.732+0000 7fbeb0ff9640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbe9406b920 0x7fbe9406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.733+0000 7fbeb0ff9640 1 -- 172.21.15.77:0/3433095741 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbea4087fa0 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.733+0000 7fbeabfff640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbe9406b920 0x7fbe9406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:07.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.733+0000 7fbeabfff640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbe9406b920 0x7fbe9406dde0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbeb41554c0 tx=0x7fbe9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:07.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.737+0000 7fbeb0ff9640 1 -- 172.21.15.77:0/3433095741 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbea4054b00 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.929+0000 7fbeba0da640 1 -- 172.21.15.77:0/3433095741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbeb4067470 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.932+0000 7fbeb0ff9640 1 -- 172.21.15.77:0/3433095741 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16642 (secure 0 0 0) 0x7fbea4058120 con 0x7fbeb40ce6c0 2023-11-26T07:24:07.935 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:07.935 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":77,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:23:18.390879+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:02.276143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:03.495874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:24:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 -- 172.21.15.77:0/3433095741 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbe9406b920 msgr2=0x7fbe9406dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbe9406b920 0x7fbe9406dde0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbeb41554c0 tx=0x7fbe9c009040 comp rx=0 tx=0).stop 2023-11-26T07:24:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 -- 172.21.15.77:0/3433095741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbeb40ce6c0 msgr2=0x7fbeb4149500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbeb40ce6c0 0x7fbeb4149500 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c820 tx=0x7fbea400cce0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 -- 172.21.15.77:0/3433095741 shutdown_connections 2023-11-26T07:24:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbe9406b920 0x7fbe9406dde0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeb415c7f0 0x7fbeb40aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbeb40cf450 0x7fbeb40ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 --2- 172.21.15.77:0/3433095741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbeb40ce6c0 0x7fbeb4149500 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 -- 172.21.15.77:0/3433095741 >> 172.21.15.77:0/3433095741 conn(0x7fbeb406a920 msgr2=0x7fbeb40718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 -- 172.21.15.77:0/3433095741 shutdown_connections 2023-11-26T07:24:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:07.935+0000 7fbeba0da640 1 -- 172.21.15.77:0/3433095741 wait complete. 2023-11-26T07:24:07.956 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:23:02.276143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:23:03.495874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:24:07.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:24:08.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.167+0000 7f0ff2bde640 1 Processor -- start 2023-11-26T07:24:08.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.167+0000 7f0ff2bde640 1 -- start start 2023-11-26T07:24:08.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.169+0000 7f0ff2bde640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fec15b440 0x7f0fec0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.169+0000 7f0ff2bde640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0fec0cbf20 0x7f0fec0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.169+0000 7f0ff2bde640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec0cc3a0 con 0x7f0fec0c57e0 2023-11-26T07:24:08.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.169+0000 7f0ff2bde640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fec15b820 con 0x7f0fec0cbf20 2023-11-26T07:24:08.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.169+0000 7f0ff2bde640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec15eea0 con 0x7f0fec15b440 2023-11-26T07:24:08.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.170+0000 7f0ff097a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fec15b440 0x7f0fec0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.170+0000 7f0febfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0fec0cbf20 0x7f0fec0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.170+0000 7f0febfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0fec0cbf20 0x7f0fec0c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:43180/0 (socket says 172.21.15.77:43180) 2023-11-26T07:24:08.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.170+0000 7f0febfff640 1 -- 172.21.15.77:0/2247995716 learned_addr learned my addr 172.21.15.77:0/2247995716 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:08.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.170+0000 7f0ff097a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fec15b440 0x7f0fec0cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:44190/0 (socket says 172.21.15.77:44190) 2023-11-26T07:24:08.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.170+0000 7f0ff117b640 1 --1- 172.21.15.77:0/2247995716 >> v1:172.21.15.159:6789/0 conn(0x7f0fec0c57e0 0x7f0fec0c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.77:51812/0 (socket says 172.21.15.77:51812) 2023-11-26T07:24:08.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.170+0000 7f0febfff640 1 -- 172.21.15.77:0/2247995716 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fec15b440 msgr2=0x7f0fec0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:08.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.170+0000 7f0febfff640 1 --2- 172.21.15.77:0/2247995716 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fec15b440 0x7f0fec0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.170+0000 7f0febfff640 1 -- 172.21.15.77:0/2247995716 >> v1:172.21.15.159:6789/0 conn(0x7f0fec0c57e0 legacy=0x7f0fec0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.170+0000 7f0febfff640 1 -- 172.21.15.77:0/2247995716 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec06d600 con 0x7f0fec0cbf20 2023-11-26T07:24:08.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.172+0000 7f0febfff640 1 --2- 172.21.15.77:0/2247995716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fec0cbf20 0x7f0fec0c52a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009870 tx=0x7f0fdc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e87f1d26c0ace13f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:08.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.172+0000 7f0feb7fe640 1 -- 172.21.15.77:0/2247995716 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc031640 con 0x7f0fec0cbf20 2023-11-26T07:24:08.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.172+0000 7f0feb7fe640 1 -- 172.21.15.77:0/2247995716 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc0317a0 con 0x7f0fec0cbf20 2023-11-26T07:24:08.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.172+0000 7f0feb7fe640 1 -- 172.21.15.77:0/2247995716 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc031b30 con 0x7f0fec0cbf20 2023-11-26T07:24:08.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.173+0000 7f0ff2bde640 1 -- 172.21.15.77:0/2247995716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fec0cbf20 msgr2=0x7f0fec0c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.173+0000 7f0ff2bde640 1 --2- 172.21.15.77:0/2247995716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fec0cbf20 0x7f0fec0c52a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009870 tx=0x7f0fdc02b8f0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.173+0000 7f0ff2bde640 1 -- 172.21.15.77:0/2247995716 shutdown_connections 2023-11-26T07:24:08.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.173+0000 7f0ff2bde640 1 --2- 172.21.15.77:0/2247995716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fec0cbf20 0x7f0fec0c52a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.173+0000 7f0ff2bde640 1 --2- 172.21.15.77:0/2247995716 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fec15b440 0x7f0fec0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.173+0000 7f0ff2bde640 1 -- 172.21.15.77:0/2247995716 >> 172.21.15.77:0/2247995716 conn(0x7f0fec0b0c50 msgr2=0x7f0fec0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:08.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.173+0000 7f0ff2bde640 1 -- 172.21.15.77:0/2247995716 shutdown_connections 2023-11-26T07:24:08.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.173+0000 7f0ff2bde640 1 -- 172.21.15.77:0/2247995716 wait complete. 2023-11-26T07:24:08.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.175+0000 7f0ff2bde640 1 Processor -- start 2023-11-26T07:24:08.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.175+0000 7f0ff2bde640 1 -- start start 2023-11-26T07:24:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.176+0000 7f0ff2bde640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fec0c57e0 0x7f0fec0c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.176+0000 7f0ff2bde640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fec0cbf20 0x7f0fec0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.176+0000 7f0ff2bde640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fec15b440 0x7f0fec0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.176+0000 7f0ff2bde640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec158a30 con 0x7f0fec15b440 2023-11-26T07:24:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.176+0000 7f0ff2bde640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec158d10 con 0x7f0fec0cbf20 2023-11-26T07:24:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.176+0000 7f0ff2bde640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec0cd490 con 0x7f0fec0c57e0 2023-11-26T07:24:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.177+0000 7f0ff117b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fec15b440 0x7f0fec0ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.177+0000 7f0ff117b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fec15b440 0x7f0fec0ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40118/0 (socket says 172.21.15.77:40118) 2023-11-26T07:24:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.177+0000 7f0ff117b640 1 -- 172.21.15.77:0/1866098894 learned_addr learned my addr 172.21.15.77:0/1866098894 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.177+0000 7f0ff097a640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fec0c57e0 0x7f0fec0c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.177+0000 7f0febfff640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fec0cbf20 0x7f0fec0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.177+0000 7f0ff117b640 1 -- 172.21.15.77:0/1866098894 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fec0c57e0 msgr2=0x7f0fec0c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.177+0000 7f0ff117b640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fec0c57e0 0x7f0fec0c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.177+0000 7f0ff117b640 1 -- 172.21.15.77:0/1866098894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fec0cbf20 msgr2=0x7f0fec0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.177+0000 7f0ff117b640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fec0cbf20 0x7f0fec0ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.177+0000 7f0ff117b640 1 -- 172.21.15.77:0/1866098894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc0094d0 con 0x7f0fec15b440 2023-11-26T07:24:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.177+0000 7f0ff117b640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fec15b440 0x7f0fec0ad1a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c7b0 tx=0x7f0fe400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.178+0000 7f0fe97fa640 1 -- 172.21.15.77:0/1866098894 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe400a640 con 0x7f0fec15b440 2023-11-26T07:24:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.178+0000 7f0fe97fa640 1 -- 172.21.15.77:0/1866098894 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe400a7a0 con 0x7f0fec15b440 2023-11-26T07:24:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.178+0000 7f0ff2bde640 1 -- 172.21.15.77:0/1866098894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec0cd770 con 0x7f0fec15b440 2023-11-26T07:24:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.178+0000 7f0fe97fa640 1 -- 172.21.15.77:0/1866098894 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe400ab10 con 0x7f0fec15b440 2023-11-26T07:24:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.178+0000 7f0ff2bde640 1 -- 172.21.15.77:0/1866098894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec0c6ab0 con 0x7f0fec15b440 2023-11-26T07:24:08.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.179+0000 7f0ff2bde640 1 -- 172.21.15.77:0/1866098894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec04e8b0 con 0x7f0fec15b440 2023-11-26T07:24:08.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.180+0000 7f0fe97fa640 1 -- 172.21.15.77:0/1866098894 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f0fe400ac70 con 0x7f0fec15b440 2023-11-26T07:24:08.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.181+0000 7f0fe97fa640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0fd806b920 0x7f0fd806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.181+0000 7f0fe97fa640 1 -- 172.21.15.77:0/1866098894 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0fe4087710 con 0x7f0fec15b440 2023-11-26T07:24:08.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.181+0000 7f0ff097a640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0fd806b920 0x7f0fd806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.182+0000 7f0ff097a640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0fd806b920 0x7f0fd806dde0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009a30 tx=0x7f0fe0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:08.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.185+0000 7f0fe97fa640 1 -- 172.21.15.77:0/1866098894 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0fe4054090 con 0x7f0fec15b440 2023-11-26T07:24:08.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.384+0000 7f0ff2bde640 1 -- 172.21.15.77:0/1866098894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0fec0cc3a0 con 0x7f0fec15b440 2023-11-26T07:24:08.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.385+0000 7f0fe97fa640 1 -- 172.21.15.77:0/1866098894 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0fec0cc3a0 con 0x7f0fec15b440 2023-11-26T07:24:08.387 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:24:08.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.387+0000 7f0ff2bde640 1 -- 172.21.15.77:0/1866098894 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0fd806b920 msgr2=0x7f0fd806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.387+0000 7f0ff2bde640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0fd806b920 0x7f0fd806dde0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009a30 tx=0x7f0fe0008040 comp rx=0 tx=0).stop 2023-11-26T07:24:08.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.387+0000 7f0ff2bde640 1 -- 172.21.15.77:0/1866098894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fec15b440 msgr2=0x7f0fec0ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.387+0000 7f0ff2bde640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fec15b440 0x7f0fec0ad1a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c7b0 tx=0x7f0fe400cc70 comp rx=0 tx=0).stop 2023-11-26T07:24:08.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.387+0000 7f0ff2bde640 1 -- 172.21.15.77:0/1866098894 shutdown_connections 2023-11-26T07:24:08.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.387+0000 7f0ff2bde640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0fd806b920 0x7f0fd806dde0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.387+0000 7f0ff2bde640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fec15b440 0x7f0fec0ad1a0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.387+0000 7f0ff2bde640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fec0cbf20 0x7f0fec0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.387+0000 7f0ff2bde640 1 --2- 172.21.15.77:0/1866098894 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fec0c57e0 0x7f0fec0c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.387+0000 7f0ff2bde640 1 -- 172.21.15.77:0/1866098894 >> 172.21.15.77:0/1866098894 conn(0x7f0fec0b0c50 msgr2=0x7f0fec0cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:08.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.388+0000 7f0ff2bde640 1 -- 172.21.15.77:0/1866098894 shutdown_connections 2023-11-26T07:24:08.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.388+0000 7f0ff2bde640 1 -- 172.21.15.77:0/1866098894 wait complete. 2023-11-26T07:24:08.409 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:24:08.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.610+0000 7f892dd97640 1 Processor -- start 2023-11-26T07:24:08.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.610+0000 7f892dd97640 1 -- start start 2023-11-26T07:24:08.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.612+0000 7f892dd97640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f89281660b0 0x7f8928162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.612+0000 7f892dd97640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8928166510 con 0x7f89280ccbd0 2023-11-26T07:24:08.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.612+0000 7f892dd97640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89281655f0 con 0x7f8928162540 2023-11-26T07:24:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.612+0000 7f892dd97640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89280cc380 con 0x7f89281660b0 2023-11-26T07:24:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.612+0000 7f89277fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f89280ccbd0 0x7f89280ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49952/0 (socket says 172.21.15.77:49952) 2023-11-26T07:24:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.612+0000 7f89277fe640 1 -- 172.21.15.77:0/1608183545 learned_addr learned my addr 172.21.15.77:0/1608183545 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:08.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f891ffff640 1 --2- 172.21.15.77:0/1608183545 >> v2:172.21.15.159:3300/0 conn(0x7f89281660b0 0x7f8928162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388000720 0 0) 0x7f8918001110 con 0x7f89280ccbd0 2023-11-26T07:24:08.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8914003520 con 0x7f89280ccbd0 2023-11-26T07:24:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1454980985 0 0) 0x7f8914003520 con 0x7f89280ccbd0 2023-11-26T07:24:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 >> v2:172.21.15.159:3300/0 conn(0x7f89281660b0 msgr2=0x7f8928162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 --2- 172.21.15.77:0/1608183545 >> v2:172.21.15.159:3300/0 conn(0x7f89281660b0 0x7f8928162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 >> v1:172.21.15.159:6789/0 conn(0x7f8928162540 legacy=0x7f89280c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928162b30 con 0x7f89280ccbd0 2023-11-26T07:24:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f8918001800 con 0x7f89280ccbd0 2023-11-26T07:24:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 >> v1:172.21.15.77:6789/0 conn(0x7f89280ccbd0 legacy=0x7f89280ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 --2- 172.21.15.77:0/1608183545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89140039c0 0x7f8914003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 --2- 172.21.15.77:0/1608183545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140047c0 0x7f8914004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 --2- 172.21.15.77:0/1608183545 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89140051d0 0x7f891400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280cc380 con 0x7f89140039c0 2023-11-26T07:24:08.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891400c120 con 0x7f89140047c0 2023-11-26T07:24:08.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891400c2e0 con 0x7f89140051d0 2023-11-26T07:24:08.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.613+0000 7f891ffff640 1 --2- 172.21.15.77:0/1608183545 >> v2:172.21.15.159:3300/0 conn(0x7f89281660b0 0x7f8928162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:08.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.614+0000 7f89277fe640 1 --2- 172.21.15.77:0/1608183545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89140039c0 0x7f8914003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.614+0000 7f89277fe640 1 -- 172.21.15.77:0/1608183545 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89140051d0 msgr2=0x7f891400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:08.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.614+0000 7f8927fff640 1 --2- 172.21.15.77:0/1608183545 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89140051d0 0x7f891400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.614+0000 7f89277fe640 1 --2- 172.21.15.77:0/1608183545 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89140051d0 0x7f891400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.614+0000 7f89277fe640 1 -- 172.21.15.77:0/1608183545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140047c0 msgr2=0x7f8914004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:08.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.614+0000 7f89277fe640 1 --2- 172.21.15.77:0/1608183545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140047c0 0x7f8914004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.614+0000 7f89277fe640 1 -- 172.21.15.77:0/1608183545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8914003520 con 0x7f89140039c0 2023-11-26T07:24:08.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.614+0000 7f8927fff640 1 --2- 172.21.15.77:0/1608183545 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89140051d0 0x7f891400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:08.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.614+0000 7f8927fff640 1 -- 172.21.15.77:0/1608183545 reap_dead start 2023-11-26T07:24:08.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.615+0000 7f89277fe640 1 --2- 172.21.15.77:0/1608183545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89140039c0 0x7f8914003de0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8918007fc0 tx=0x7f89140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc1fe36b32a6599 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:08.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.616+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918005ad0 con 0x7f89140039c0 2023-11-26T07:24:08.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.616+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8918005c50 con 0x7f89140039c0 2023-11-26T07:24:08.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.616+0000 7f8926ffd640 1 -- 172.21.15.77:0/1608183545 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891802c7e0 con 0x7f89140039c0 2023-11-26T07:24:08.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.617+0000 7f892dd97640 1 -- 172.21.15.77:0/1608183545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89140039c0 msgr2=0x7f8914003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.617+0000 7f892dd97640 1 --2- 172.21.15.77:0/1608183545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89140039c0 0x7f8914003de0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8918007fc0 tx=0x7f89140057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.617+0000 7f892dd97640 1 -- 172.21.15.77:0/1608183545 shutdown_connections 2023-11-26T07:24:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.617+0000 7f892dd97640 1 --2- 172.21.15.77:0/1608183545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89140039c0 0x7f8914003de0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.617+0000 7f892dd97640 1 -- 172.21.15.77:0/1608183545 >> 172.21.15.77:0/1608183545 conn(0x7f89280b0c50 msgr2=0x7f89280b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.617+0000 7f892dd97640 1 -- 172.21.15.77:0/1608183545 shutdown_connections 2023-11-26T07:24:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.617+0000 7f892dd97640 1 -- 172.21.15.77:0/1608183545 wait complete. 2023-11-26T07:24:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.619+0000 7f892dd97640 1 Processor -- start 2023-11-26T07:24:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.619+0000 7f892dd97640 1 -- start start 2023-11-26T07:24:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.620+0000 7f892dd97640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140039c0 0x7f8928163e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.620+0000 7f892dd97640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928164df0 0x7f89280b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.620+0000 7f892dd97640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8928154590 0x7f89281609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.620+0000 7f892dd97640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8928163a40 con 0x7f8928164df0 2023-11-26T07:24:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.620+0000 7f892dd97640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280b2280 con 0x7f89140039c0 2023-11-26T07:24:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.620+0000 7f892dd97640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8928163130 con 0x7f8928154590 2023-11-26T07:24:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.620+0000 7f891ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928164df0 0x7f89280b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.620+0000 7f891ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928164df0 0x7f89280b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40140/0 (socket says 172.21.15.77:40140) 2023-11-26T07:24:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.620+0000 7f891ffff640 1 -- 172.21.15.77:0/1137844990 learned_addr learned my addr 172.21.15.77:0/1137844990 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.620+0000 7f89277fe640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140039c0 0x7f8928163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f8927fff640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8928154590 0x7f89281609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f891ffff640 1 -- 172.21.15.77:0/1137844990 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8928154590 msgr2=0x7f89281609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f891ffff640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8928154590 0x7f89281609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f891ffff640 1 -- 172.21.15.77:0/1137844990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140039c0 msgr2=0x7f8928163e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f891ffff640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140039c0 0x7f8928163e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f891ffff640 1 -- 172.21.15.77:0/1137844990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928165280 con 0x7f8928164df0 2023-11-26T07:24:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f8927fff640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8928154590 0x7f89281609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f891ffff640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928164df0 0x7f89280b1d40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f891000e810 tx=0x7f891000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f8924ff9640 1 -- 172.21.15.77:0/1137844990 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910004230 con 0x7f8928164df0 2023-11-26T07:24:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f8924ff9640 1 -- 172.21.15.77:0/1137844990 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8910004390 con 0x7f8928164df0 2023-11-26T07:24:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f8924ff9640 1 -- 172.21.15.77:0/1137844990 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000c910 con 0x7f8928164df0 2023-11-26T07:24:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.621+0000 7f892dd97640 1 -- 172.21.15.77:0/1137844990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8928163380 con 0x7f8928164df0 2023-11-26T07:24:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.622+0000 7f892dd97640 1 -- 172.21.15.77:0/1137844990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8928158570 con 0x7f8928164df0 2023-11-26T07:24:08.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.623+0000 7f892dd97640 1 -- 172.21.15.77:0/1137844990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89280ae2f0 con 0x7f8928164df0 2023-11-26T07:24:08.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.624+0000 7f8924ff9640 1 -- 172.21.15.77:0/1137844990 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f891000ca70 con 0x7f8928164df0 2023-11-26T07:24:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.625+0000 7f8924ff9640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b8f0 0x7f890806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.625+0000 7f8924ff9640 1 -- 172.21.15.77:0/1137844990 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8910087b20 con 0x7f8928164df0 2023-11-26T07:24:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.625+0000 7f89277fe640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b8f0 0x7f890806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.625+0000 7f89277fe640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b8f0 0x7f890806ddb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8918034000 tx=0x7f8918009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.629+0000 7f8924ff9640 1 -- 172.21.15.77:0/1137844990 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8910054620 con 0x7f8928164df0 2023-11-26T07:24:08.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.820+0000 7f892dd97640 1 -- 172.21.15.77:0/1137844990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f892804e8b0 con 0x7f8928164df0 2023-11-26T07:24:08.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.821+0000 7f8924ff9640 1 -- 172.21.15.77:0/1137844990 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7f891005e020 con 0x7f8928164df0 2023-11-26T07:24:08.824 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:24:08.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.823+0000 7f892dd97640 1 -- 172.21.15.77:0/1137844990 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b8f0 msgr2=0x7f890806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.823+0000 7f892dd97640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b8f0 0x7f890806ddb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8918034000 tx=0x7f8918009030 comp rx=0 tx=0).stop 2023-11-26T07:24:08.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.824+0000 7f892dd97640 1 -- 172.21.15.77:0/1137844990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928164df0 msgr2=0x7f89280b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.824+0000 7f892dd97640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928164df0 0x7f89280b1d40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f891000e810 tx=0x7f891000ecd0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.824+0000 7f892dd97640 1 -- 172.21.15.77:0/1137844990 shutdown_connections 2023-11-26T07:24:08.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.824+0000 7f892dd97640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f890806b8f0 0x7f890806ddb0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.824+0000 7f892dd97640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8928154590 0x7f89281609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.824+0000 7f892dd97640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8928164df0 0x7f89280b1d40 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.824+0000 7f892dd97640 1 --2- 172.21.15.77:0/1137844990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89140039c0 0x7f8928163e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.824+0000 7f892dd97640 1 -- 172.21.15.77:0/1137844990 >> 172.21.15.77:0/1137844990 conn(0x7f89280b0c50 msgr2=0x7f89280ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:08.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.824+0000 7f892dd97640 1 -- 172.21.15.77:0/1137844990 shutdown_connections 2023-11-26T07:24:08.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:08.824+0000 7f892dd97640 1 -- 172.21.15.77:0/1137844990 wait complete. 2023-11-26T07:24:08.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:24:09.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.058+0000 7f7e350ff640 1 Processor -- start 2023-11-26T07:24:09.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.058+0000 7f7e350ff640 1 -- start start 2023-11-26T07:24:09.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.059+0000 7f7e350ff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7e3015d3f0 0x7f7e300d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.060+0000 7f7e350ff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e300d0e40 0x7f7e300d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.060+0000 7f7e350ff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e300d15e0 con 0x7f7e3015d7d0 2023-11-26T07:24:09.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.060+0000 7f7e350ff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e300d0280 con 0x7f7e300d0e40 2023-11-26T07:24:09.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.060+0000 7f7e350ff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e300d1300 con 0x7f7e3015d3f0 2023-11-26T07:24:09.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.060+0000 7f7e348fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e300d0e40 0x7f7e300d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.060+0000 7f7e348fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e300d0e40 0x7f7e300d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40154/0 (socket says 172.21.15.77:40154) 2023-11-26T07:24:09.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.060+0000 7f7e348fe640 1 -- 172.21.15.77:0/519810735 learned_addr learned my addr 172.21.15.77:0/519810735 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:09.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.060+0000 7f7e348fe640 1 -- 172.21.15.77:0/519810735 >> v2:172.21.15.159:3300/0 conn(0x7f7e3015d3f0 msgr2=0x7f7e300d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:09.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.060+0000 7f7e348fe640 1 --2- 172.21.15.77:0/519810735 >> v2:172.21.15.159:3300/0 conn(0x7f7e3015d3f0 0x7f7e300d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.060+0000 7f7e348fe640 1 -- 172.21.15.77:0/519810735 >> v1:172.21.15.159:6789/0 conn(0x7f7e3015d7d0 legacy=0x7f7e300afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:09.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.060+0000 7f7e348fe640 1 -- 172.21.15.77:0/519810735 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e300cfc30 con 0x7f7e300d0e40 2023-11-26T07:24:09.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.061+0000 7f7e348fe640 1 --2- 172.21.15.77:0/519810735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e300d0e40 0x7f7e300d1d70 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f7e30067c60 tx=0x7f7e2802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c40d76e98fddac9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.062+0000 7f7e2effd640 1 -- 172.21.15.77:0/519810735 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2802ca80 con 0x7f7e300d0e40 2023-11-26T07:24:09.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.062+0000 7f7e2effd640 1 -- 172.21.15.77:0/519810735 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2802cbe0 con 0x7f7e300d0e40 2023-11-26T07:24:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.062+0000 7f7e2effd640 1 -- 172.21.15.77:0/519810735 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280343f0 con 0x7f7e300d0e40 2023-11-26T07:24:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.062+0000 7f7e350ff640 1 -- 172.21.15.77:0/519810735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e300d0e40 msgr2=0x7f7e300d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.062+0000 7f7e350ff640 1 --2- 172.21.15.77:0/519810735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e300d0e40 0x7f7e300d1d70 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f7e30067c60 tx=0x7f7e2802bee0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.062+0000 7f7e350ff640 1 -- 172.21.15.77:0/519810735 shutdown_connections 2023-11-26T07:24:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.062+0000 7f7e350ff640 1 --2- 172.21.15.77:0/519810735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e300d0e40 0x7f7e300d1d70 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.062+0000 7f7e350ff640 1 --2- 172.21.15.77:0/519810735 >> v2:172.21.15.159:3300/0 conn(0x7f7e3015d3f0 0x7f7e300d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.062+0000 7f7e350ff640 1 -- 172.21.15.77:0/519810735 >> 172.21.15.77:0/519810735 conn(0x7f7e3009c5b0 msgr2=0x7f7e300d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.062+0000 7f7e350ff640 1 -- 172.21.15.77:0/519810735 shutdown_connections 2023-11-26T07:24:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.062+0000 7f7e350ff640 1 -- 172.21.15.77:0/519810735 wait complete. 2023-11-26T07:24:09.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.064+0000 7f7e350ff640 1 Processor -- start 2023-11-26T07:24:09.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.064+0000 7f7e350ff640 1 -- start start 2023-11-26T07:24:09.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.065+0000 7f7e350ff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e300d0e40 0x7f7e3015afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.065+0000 7f7e350ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e3015d3f0 0x7f7e300b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.065+0000 7f7e350ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e3015d7d0 0x7f7e300b8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.065+0000 7f7e350ff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3015b510 con 0x7f7e3015d3f0 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.065+0000 7f7e350ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e300b5790 con 0x7f7e3015d7d0 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.065+0000 7f7e350ff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e300b4c10 con 0x7f7e300d0e40 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.065+0000 7f7e2f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e3015d3f0 0x7f7e300b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.065+0000 7f7e2f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e3015d3f0 0x7f7e300b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40170/0 (socket says 172.21.15.77:40170) 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.065+0000 7f7e2f7fe640 1 -- 172.21.15.77:0/2313361412 learned_addr learned my addr 172.21.15.77:0/2313361412 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e2f7fe640 1 -- 172.21.15.77:0/2313361412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e300d0e40 msgr2=0x7f7e3015afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e2f7fe640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e300d0e40 0x7f7e3015afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e348fe640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e3015d7d0 0x7f7e300b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e2f7fe640 1 -- 172.21.15.77:0/2313361412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e3015d7d0 msgr2=0x7f7e300b8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e2f7fe640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e3015d7d0 0x7f7e300b8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e2f7fe640 1 -- 172.21.15.77:0/2313361412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28009b30 con 0x7f7e3015d3f0 2023-11-26T07:24:09.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e348fe640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e3015d7d0 0x7f7e300b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:09.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e2f7fe640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e3015d3f0 0x7f7e300b3ec0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400b3c0 tx=0x7f7e2400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e2cff9640 1 -- 172.21.15.77:0/2313361412 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24011830 con 0x7f7e3015d3f0 2023-11-26T07:24:09.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e2cff9640 1 -- 172.21.15.77:0/2313361412 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e24011990 con 0x7f7e3015d3f0 2023-11-26T07:24:09.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e2cff9640 1 -- 172.21.15.77:0/2313361412 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24011d60 con 0x7f7e3015d3f0 2023-11-26T07:24:09.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e350ff640 1 -- 172.21.15.77:0/2313361412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e300b4ef0 con 0x7f7e3015d3f0 2023-11-26T07:24:09.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.066+0000 7f7e350ff640 1 -- 172.21.15.77:0/2313361412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e300b54b0 con 0x7f7e3015d3f0 2023-11-26T07:24:09.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.068+0000 7f7e350ff640 1 -- 172.21.15.77:0/2313361412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3004e840 con 0x7f7e3015d3f0 2023-11-26T07:24:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.069+0000 7f7e2cff9640 1 -- 172.21.15.77:0/2313361412 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f7e2401b460 con 0x7f7e3015d3f0 2023-11-26T07:24:09.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.070+0000 7f7e2cff9640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e1c06b8f0 0x7f7e1c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.070+0000 7f7e2cff9640 1 -- 172.21.15.77:0/2313361412 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7e24087d40 con 0x7f7e3015d3f0 2023-11-26T07:24:09.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.070+0000 7f7e2ffff640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e1c06b8f0 0x7f7e1c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.071+0000 7f7e2ffff640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e1c06b8f0 0x7f7e1c06ddb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7e3008d480 tx=0x7f7e20006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.074+0000 7f7e2cff9640 1 -- 172.21.15.77:0/2313361412 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e240548a0 con 0x7f7e3015d3f0 2023-11-26T07:24:09.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.266+0000 7f7e350ff640 1 -- 172.21.15.77:0/2313361412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e30072700 con 0x7f7e3015d3f0 2023-11-26T07:24:09.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.267+0000 7f7e2cff9640 1 -- 172.21.15.77:0/2313361412 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e24057ec0 con 0x7f7e3015d3f0 2023-11-26T07:24:09.270 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:24:09.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 -- 172.21.15.77:0/2313361412 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e1c06b8f0 msgr2=0x7f7e1c06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e1c06b8f0 0x7f7e1c06ddb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7e3008d480 tx=0x7f7e20006c90 comp rx=0 tx=0).stop 2023-11-26T07:24:09.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 -- 172.21.15.77:0/2313361412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e3015d3f0 msgr2=0x7f7e300b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e3015d3f0 0x7f7e300b3ec0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400b3c0 tx=0x7f7e2400b880 comp rx=0 tx=0).stop 2023-11-26T07:24:09.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 -- 172.21.15.77:0/2313361412 shutdown_connections 2023-11-26T07:24:09.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e1c06b8f0 0x7f7e1c06ddb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e3015d7d0 0x7f7e300b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e3015d3f0 0x7f7e300b3ec0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 --2- 172.21.15.77:0/2313361412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e300d0e40 0x7f7e3015afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 -- 172.21.15.77:0/2313361412 >> 172.21.15.77:0/2313361412 conn(0x7f7e3009c5b0 msgr2=0x7f7e300d1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:09.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 -- 172.21.15.77:0/2313361412 shutdown_connections 2023-11-26T07:24:09.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.270+0000 7f7e350ff640 1 -- 172.21.15.77:0/2313361412 wait complete. 2023-11-26T07:24:09.291 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:24:09.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.485+0000 7f1a6672c640 1 Processor -- start 2023-11-26T07:24:09.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.485+0000 7f1a6672c640 1 -- start start 2023-11-26T07:24:09.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.487+0000 7f1a6672c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1a600c59b0 0x7f1a60166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.487+0000 7f1a6672c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a600c5dc0 con 0x7f1a600cc0f0 2023-11-26T07:24:09.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.487+0000 7f1a6672c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6015eea0 con 0x7f1a6015b440 2023-11-26T07:24:09.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.487+0000 7f1a6672c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6015b820 con 0x7f1a600c59b0 2023-11-26T07:24:09.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.487+0000 7f1a5f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1a600cc0f0 0x7f1a600c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49956/0 (socket says 172.21.15.77:49956) 2023-11-26T07:24:09.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.487+0000 7f1a5f7fe640 1 -- 172.21.15.77:0/86813387 learned_addr learned my addr 172.21.15.77:0/86813387 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:09.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a64cc9640 1 --2- 172.21.15.77:0/86813387 >> v2:172.21.15.159:3300/0 conn(0x7f1a600c59b0 0x7f1a60166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.487+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705106690 0 0) 0x7f1a600c5dc0 con 0x7f1a600cc0f0 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a48003520 con 0x7f1a600cc0f0 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1867297259 0 0) 0x7f1a48003520 con 0x7f1a600cc0f0 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 >> v2:172.21.15.159:3300/0 conn(0x7f1a600c59b0 msgr2=0x7f1a60166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 --2- 172.21.15.77:0/86813387 >> v2:172.21.15.159:3300/0 conn(0x7f1a600c59b0 0x7f1a60166230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 >> v1:172.21.15.159:6789/0 conn(0x7f1a6015b440 legacy=0x7f1a600cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6006d600 con 0x7f1a600cc0f0 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f1a54001670 con 0x7f1a600cc0f0 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 >> v1:172.21.15.77:6789/0 conn(0x7f1a600cc0f0 legacy=0x7f1a600c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 --2- 172.21.15.77:0/86813387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a480039c0 0x7f1a48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 --2- 172.21.15.77:0/86813387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a480047c0 0x7f1a48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 --2- 172.21.15.77:0/86813387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a480052a0 0x7f1a4800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6015b820 con 0x7f1a480052a0 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4800c1c0 con 0x7f1a480039c0 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4800c380 con 0x7f1a480047c0 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.488+0000 7f1a64cc9640 1 --2- 172.21.15.77:0/86813387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a480052a0 0x7f1a4800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.489+0000 7f1a5ffff640 1 --2- 172.21.15.77:0/86813387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a480039c0 0x7f1a48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.489+0000 7f1a64cc9640 1 -- 172.21.15.77:0/86813387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a480047c0 msgr2=0x7f1a48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.489+0000 7f1a64cc9640 1 --2- 172.21.15.77:0/86813387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a480047c0 0x7f1a48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.489+0000 7f1a64cc9640 1 -- 172.21.15.77:0/86813387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a480039c0 msgr2=0x7f1a48003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.489+0000 7f1a64cc9640 1 --2- 172.21.15.77:0/86813387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a480039c0 0x7f1a48003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.489+0000 7f1a64cc9640 1 -- 172.21.15.77:0/86813387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a48003520 con 0x7f1a480052a0 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.489+0000 7f1a5ffff640 1 --2- 172.21.15.77:0/86813387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a480039c0 0x7f1a48003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.490+0000 7f1a64cc9640 1 -- 172.21.15.77:0/86813387 reap_dead start 2023-11-26T07:24:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.490+0000 7f1a64cc9640 1 --2- 172.21.15.77:0/86813387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a480052a0 0x7f1a4800b980 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f1a58007360 tx=0x7f1a480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881d82307228caaf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.490+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5802ccf0 con 0x7f1a480052a0 2023-11-26T07:24:09.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.490+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5802ce90 con 0x7f1a480052a0 2023-11-26T07:24:09.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.490+0000 7f1a5effd640 1 -- 172.21.15.77:0/86813387 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58003bd0 con 0x7f1a480052a0 2023-11-26T07:24:09.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.491+0000 7f1a6672c640 1 -- 172.21.15.77:0/86813387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a480052a0 msgr2=0x7f1a4800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.491+0000 7f1a6672c640 1 --2- 172.21.15.77:0/86813387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a480052a0 0x7f1a4800b980 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f1a58007360 tx=0x7f1a480057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.491+0000 7f1a6672c640 1 -- 172.21.15.77:0/86813387 shutdown_connections 2023-11-26T07:24:09.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.491+0000 7f1a6672c640 1 --2- 172.21.15.77:0/86813387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a480052a0 0x7f1a4800b980 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.491+0000 7f1a6672c640 1 -- 172.21.15.77:0/86813387 >> 172.21.15.77:0/86813387 conn(0x7f1a600b0c50 msgr2=0x7f1a600b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:09.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.491+0000 7f1a6672c640 1 -- 172.21.15.77:0/86813387 shutdown_connections 2023-11-26T07:24:09.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.491+0000 7f1a6672c640 1 -- 172.21.15.77:0/86813387 wait complete. 2023-11-26T07:24:09.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.493+0000 7f1a6672c640 1 Processor -- start 2023-11-26T07:24:09.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.493+0000 7f1a6672c640 1 -- start start 2023-11-26T07:24:09.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a6672c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a480052a0 0x7f1a600b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a6672c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a6015c150 0x7f1a60156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a6672c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a600c82a0 0x7f1a600c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a6672c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600c8c60 con 0x7f1a6015c150 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a6672c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600b31d0 con 0x7f1a480052a0 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a6672c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600b3af0 con 0x7f1a600c82a0 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a5f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a6015c150 0x7f1a60156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a5f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a6015c150 0x7f1a60156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40186/0 (socket says 172.21.15.77:40186) 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a5f7fe640 1 -- 172.21.15.77:0/1940556864 learned_addr learned my addr 172.21.15.77:0/1940556864 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a5f7fe640 1 -- 172.21.15.77:0/1940556864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a600c82a0 msgr2=0x7f1a600c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a5ffff640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a480052a0 0x7f1a600b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a5f7fe640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a600c82a0 0x7f1a600c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a5f7fe640 1 -- 172.21.15.77:0/1940556864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a480052a0 msgr2=0x7f1a600b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.494+0000 7f1a5f7fe640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a480052a0 0x7f1a600b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.495+0000 7f1a5f7fe640 1 -- 172.21.15.77:0/1940556864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a600b3dd0 con 0x7f1a6015c150 2023-11-26T07:24:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.495+0000 7f1a5ffff640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a480052a0 0x7f1a600b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.495+0000 7f1a5f7fe640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a6015c150 0x7f1a60156a60 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c730 tx=0x7f1a5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.495+0000 7f1a5cff9640 1 -- 172.21.15.77:0/1940556864 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540072d0 con 0x7f1a6015c150 2023-11-26T07:24:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.495+0000 7f1a5cff9640 1 -- 172.21.15.77:0/1940556864 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54007430 con 0x7f1a6015c150 2023-11-26T07:24:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.495+0000 7f1a5cff9640 1 -- 172.21.15.77:0/1940556864 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540047e0 con 0x7f1a6015c150 2023-11-26T07:24:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.495+0000 7f1a6672c640 1 -- 172.21.15.77:0/1940556864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a600b40b0 con 0x7f1a6015c150 2023-11-26T07:24:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.495+0000 7f1a6672c640 1 -- 172.21.15.77:0/1940556864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a600b4670 con 0x7f1a6015c150 2023-11-26T07:24:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.496+0000 7f1a6672c640 1 -- 172.21.15.77:0/1940556864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6004e8b0 con 0x7f1a6015c150 2023-11-26T07:24:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.497+0000 7f1a5cff9640 1 -- 172.21.15.77:0/1940556864 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f1a54004940 con 0x7f1a6015c150 2023-11-26T07:24:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.498+0000 7f1a5cff9640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a4c06b920 0x7f1a4c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.498+0000 7f1a5cff9640 1 -- 172.21.15.77:0/1940556864 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1a54087560 con 0x7f1a6015c150 2023-11-26T07:24:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.499+0000 7f1a5ffff640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a4c06b920 0x7f1a4c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.499+0000 7f1a5ffff640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a4c06b920 0x7f1a4c06dde0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1a50007fd0 tx=0x7f1a50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.503+0000 7f1a5cff9640 1 -- 172.21.15.77:0/1940556864 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a54053e30 con 0x7f1a6015c150 2023-11-26T07:24:09.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.710+0000 7f1a6672c640 1 -- 172.21.15.77:0/1940556864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1a6006dc80 con 0x7f1a6015c150 2023-11-26T07:24:09.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.711+0000 7f1a5cff9640 1 -- 172.21.15.77:0/1940556864 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v77) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1a54018020 con 0x7f1a6015c150 2023-11-26T07:24:09.713 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-26T07:24:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.713+0000 7f1a6672c640 1 -- 172.21.15.77:0/1940556864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a4c06b920 msgr2=0x7f1a4c06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.713+0000 7f1a6672c640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a4c06b920 0x7f1a4c06dde0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1a50007fd0 tx=0x7f1a50009040 comp rx=0 tx=0).stop 2023-11-26T07:24:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.713+0000 7f1a6672c640 1 -- 172.21.15.77:0/1940556864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a6015c150 msgr2=0x7f1a60156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.713+0000 7f1a6672c640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a6015c150 0x7f1a60156a60 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c730 tx=0x7f1a5400cbf0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.713+0000 7f1a6672c640 1 -- 172.21.15.77:0/1940556864 shutdown_connections 2023-11-26T07:24:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.713+0000 7f1a6672c640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f1a4c06b920 0x7f1a4c06dde0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.713+0000 7f1a6672c640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a600c82a0 0x7f1a600c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.713+0000 7f1a6672c640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a6015c150 0x7f1a60156a60 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.713+0000 7f1a6672c640 1 --2- 172.21.15.77:0/1940556864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a480052a0 0x7f1a600b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.713+0000 7f1a6672c640 1 -- 172.21.15.77:0/1940556864 >> 172.21.15.77:0/1940556864 conn(0x7f1a600b0c50 msgr2=0x7f1a600c4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.714+0000 7f1a6672c640 1 -- 172.21.15.77:0/1940556864 shutdown_connections 2023-11-26T07:24:09.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:09.714+0000 7f1a6672c640 1 -- 172.21.15.77:0/1940556864 wait complete. 2023-11-26T07:24:09.735 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-26T07:24:09.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:09.735 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-26T07:24:09.848 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:24:09.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:09.848 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:24:09.898 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:24:09.898 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:09.958 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:24:09.958 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:24:09.958 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:10.017 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:24:10.017 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:24:10.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.235+0000 7f7c5cabb640 1 Processor -- start 2023-11-26T07:24:10.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.235+0000 7f7c5cabb640 1 -- start start 2023-11-26T07:24:10.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.237+0000 7f7c5cabb640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7c580d1740 0x7f7c580ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.237+0000 7f7c5cabb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580cecc0 con 0x7f7c580d0f40 2023-11-26T07:24:10.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.237+0000 7f7c5cabb640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580cef60 con 0x7f7c580b3880 2023-11-26T07:24:10.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.237+0000 7f7c5cabb640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c580b2ac0 con 0x7f7c580d1740 2023-11-26T07:24:10.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.237+0000 7f7c4ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7c580d0f40 0x7f7c580d1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49966/0 (socket says 172.21.15.77:49966) 2023-11-26T07:24:10.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.237+0000 7f7c4ffff640 1 -- 172.21.15.77:0/560504461 learned_addr learned my addr 172.21.15.77:0/560504461 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:10.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c577fe640 1 --2- 172.21.15.77:0/560504461 >> v2:172.21.15.159:3300/0 conn(0x7f7c580d1740 0x7f7c580ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590662432 0 0) 0x7f7c580cecc0 con 0x7f7c580d0f40 2023-11-26T07:24:10.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c44003520 con 0x7f7c580d0f40 2023-11-26T07:24:10.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1372767898 0 0) 0x7f7c44003520 con 0x7f7c580d0f40 2023-11-26T07:24:10.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 >> v2:172.21.15.159:3300/0 conn(0x7f7c580d1740 msgr2=0x7f7c580ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:10.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 --2- 172.21.15.77:0/560504461 >> v2:172.21.15.159:3300/0 conn(0x7f7c580d1740 0x7f7c580ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 >> v1:172.21.15.159:6789/0 conn(0x7f7c580b3880 legacy=0x7f7c580b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580b2da0 con 0x7f7c580d0f40 2023-11-26T07:24:10.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f7c40001670 con 0x7f7c580d0f40 2023-11-26T07:24:10.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c577fe640 1 --2- 172.21.15.77:0/560504461 >> v2:172.21.15.159:3300/0 conn(0x7f7c580d1740 0x7f7c580ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:10.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 >> v1:172.21.15.77:6789/0 conn(0x7f7c580d0f40 legacy=0x7f7c580d1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c440039c0 0x7f7c44003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c440047c0 0x7f7c44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c440051d0 0x7f7c4400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580b2ac0 con 0x7f7c440039c0 2023-11-26T07:24:10.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4400c110 con 0x7f7c440051d0 2023-11-26T07:24:10.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.238+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4400c2d0 con 0x7f7c440047c0 2023-11-26T07:24:10.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.239+0000 7f7c577fe640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c440039c0 0x7f7c44003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.239+0000 7f7c577fe640 1 -- 172.21.15.77:0/560504461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c440047c0 msgr2=0x7f7c44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:10.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.239+0000 7f7c4ffff640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c440047c0 0x7f7c44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.239+0000 7f7c57fff640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c440051d0 0x7f7c4400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.239+0000 7f7c577fe640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c440047c0 0x7f7c44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.239+0000 7f7c577fe640 1 -- 172.21.15.77:0/560504461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c440051d0 msgr2=0x7f7c4400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:10.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.239+0000 7f7c577fe640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c440051d0 0x7f7c4400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.239+0000 7f7c577fe640 1 -- 172.21.15.77:0/560504461 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c44003520 con 0x7f7c440039c0 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.239+0000 7f7c4ffff640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c440047c0 0x7f7c44004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.239+0000 7f7c57fff640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c440051d0 0x7f7c4400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.239+0000 7f7c57fff640 1 -- 172.21.15.77:0/560504461 reap_dead start 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.240+0000 7f7c577fe640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c440039c0 0x7f7c44003de0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f7c480098a0 tx=0x7f7c440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e89dc087fa77aa server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.241+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48004230 con 0x7f7c440039c0 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.241+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c48004390 con 0x7f7c440039c0 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.241+0000 7f7c56ffd640 1 -- 172.21.15.77:0/560504461 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48003830 con 0x7f7c440039c0 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.241+0000 7f7c5cabb640 1 -- 172.21.15.77:0/560504461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c440039c0 msgr2=0x7f7c44003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.241+0000 7f7c5cabb640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c440039c0 0x7f7c44003de0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f7c480098a0 tx=0x7f7c440057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.241+0000 7f7c5cabb640 1 -- 172.21.15.77:0/560504461 shutdown_connections 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.241+0000 7f7c5cabb640 1 --2- 172.21.15.77:0/560504461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c440039c0 0x7f7c44003de0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.241+0000 7f7c5cabb640 1 -- 172.21.15.77:0/560504461 >> 172.21.15.77:0/560504461 conn(0x7f7c5809c500 msgr2=0x7f7c580d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:10.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.241+0000 7f7c5cabb640 1 -- 172.21.15.77:0/560504461 shutdown_connections 2023-11-26T07:24:10.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.241+0000 7f7c5cabb640 1 -- 172.21.15.77:0/560504461 wait complete. 2023-11-26T07:24:10.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.243+0000 7f7c5cabb640 1 Processor -- start 2023-11-26T07:24:10.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.243+0000 7f7c5cabb640 1 -- start start 2023-11-26T07:24:10.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.244+0000 7f7c5cabb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c440039c0 0x7f7c581600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.244+0000 7f7c5cabb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c580cba70 0x7f7c580cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.244+0000 7f7c5cabb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c5815de50 0x7f7c5815e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.244+0000 7f7c5cabb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580cc410 con 0x7f7c580cba70 2023-11-26T07:24:10.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.244+0000 7f7c5cabb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c581f2bc0 con 0x7f7c440039c0 2023-11-26T07:24:10.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.244+0000 7f7c5cabb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5815ebf0 con 0x7f7c5815de50 2023-11-26T07:24:10.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.244+0000 7f7c4ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c580cba70 0x7f7c580cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.244+0000 7f7c4ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c580cba70 0x7f7c580cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40206/0 (socket says 172.21.15.77:40206) 2023-11-26T07:24:10.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.245+0000 7f7c4ffff640 1 -- 172.21.15.77:0/383610315 learned_addr learned my addr 172.21.15.77:0/383610315 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.245+0000 7f7c577fe640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c440039c0 0x7f7c581600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.245+0000 7f7c57fff640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c5815de50 0x7f7c5815e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.245+0000 7f7c4ffff640 1 -- 172.21.15.77:0/383610315 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c5815de50 msgr2=0x7f7c5815e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.245+0000 7f7c4ffff640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c5815de50 0x7f7c5815e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.245+0000 7f7c4ffff640 1 -- 172.21.15.77:0/383610315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c440039c0 msgr2=0x7f7c581600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.245+0000 7f7c4ffff640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c440039c0 0x7f7c581600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.245+0000 7f7c4ffff640 1 -- 172.21.15.77:0/383610315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5815eed0 con 0x7f7c580cba70 2023-11-26T07:24:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.245+0000 7f7c577fe640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c440039c0 0x7f7c581600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.245+0000 7f7c4ffff640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c580cba70 0x7f7c580cbed0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000d770 tx=0x7f7c4000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:10.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.245+0000 7f7c54ff9640 1 -- 172.21.15.77:0/383610315 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400072d0 con 0x7f7c580cba70 2023-11-26T07:24:10.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.246+0000 7f7c54ff9640 1 -- 172.21.15.77:0/383610315 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c40007430 con 0x7f7c580cba70 2023-11-26T07:24:10.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.246+0000 7f7c5cabb640 1 -- 172.21.15.77:0/383610315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5815f1b0 con 0x7f7c580cba70 2023-11-26T07:24:10.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.246+0000 7f7c54ff9640 1 -- 172.21.15.77:0/383610315 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400047e0 con 0x7f7c580cba70 2023-11-26T07:24:10.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.246+0000 7f7c5cabb640 1 -- 172.21.15.77:0/383610315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c581605e0 con 0x7f7c580cba70 2023-11-26T07:24:10.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.247+0000 7f7c5cabb640 1 -- 172.21.15.77:0/383610315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c581f2d70 con 0x7f7c580cba70 2023-11-26T07:24:10.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.248+0000 7f7c54ff9640 1 -- 172.21.15.77:0/383610315 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f7c40004940 con 0x7f7c580cba70 2023-11-26T07:24:10.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.249+0000 7f7c54ff9640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c3806b8f0 0x7f7c3806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.249+0000 7f7c54ff9640 1 -- 172.21.15.77:0/383610315 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7c40087d40 con 0x7f7c580cba70 2023-11-26T07:24:10.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.250+0000 7f7c577fe640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c3806b8f0 0x7f7c3806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.250+0000 7f7c577fe640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c3806b8f0 0x7f7c3806ddb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7c48035000 tx=0x7f7c4803a040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:10.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.254+0000 7f7c54ff9640 1 -- 172.21.15.77:0/383610315 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c581f2d70 con 0x7f7c580cba70 2023-11-26T07:24:10.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.492+0000 7f7c5cabb640 1 -- 172.21.15.77:0/383610315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c581f2d30 con 0x7f7c580cba70 2023-11-26T07:24:10.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.494+0000 7f7c54ff9640 1 -- 172.21.15.77:0/383610315 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f7c40019090 con 0x7f7c580cba70 2023-11-26T07:24:10.496 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/277058454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":277058454},{"type":"v1","addr":"172.21.15.159:6835","nonce":277058454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4120615192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4120615192},{"type":"v1","addr":"172.21.15.77:6835","nonce":4120615192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/52209425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":52209425},{"type":"v1","addr":"172.21.15.159:6834","nonce":52209425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:04.464261+0000","modified":"2023-11-26T07:23:07.539892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/3837428408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3837428408},{"type":"v1","addr":"172.21.15.77:6837","nonce":3837428408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:24:10.497 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 45 2023-11-26T07:24:10.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.496+0000 7f7c5cabb640 1 -- 172.21.15.77:0/383610315 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c3806b8f0 msgr2=0x7f7c3806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.496+0000 7f7c5cabb640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c3806b8f0 0x7f7c3806ddb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7c48035000 tx=0x7f7c4803a040 comp rx=0 tx=0).stop 2023-11-26T07:24:10.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.496+0000 7f7c5cabb640 1 -- 172.21.15.77:0/383610315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c580cba70 msgr2=0x7f7c580cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.496+0000 7f7c5cabb640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c580cba70 0x7f7c580cbed0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000d770 tx=0x7f7c4000db70 comp rx=0 tx=0).stop 2023-11-26T07:24:10.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.497+0000 7f7c5cabb640 1 -- 172.21.15.77:0/383610315 shutdown_connections 2023-11-26T07:24:10.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.497+0000 7f7c5cabb640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7c3806b8f0 0x7f7c3806ddb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.497+0000 7f7c5cabb640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7c5815de50 0x7f7c5815e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.497+0000 7f7c5cabb640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c580cba70 0x7f7c580cbed0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.497+0000 7f7c5cabb640 1 --2- 172.21.15.77:0/383610315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c440039c0 0x7f7c581600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.497+0000 7f7c5cabb640 1 -- 172.21.15.77:0/383610315 >> 172.21.15.77:0/383610315 conn(0x7f7c5809c500 msgr2=0x7f7c580cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:10.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.497+0000 7f7c5cabb640 1 -- 172.21.15.77:0/383610315 shutdown_connections 2023-11-26T07:24:10.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.497+0000 7f7c5cabb640 1 -- 172.21.15.77:0/383610315 wait complete. 2023-11-26T07:24:10.518 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:24:10.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.723+0000 7f3768e9b640 1 Processor -- start 2023-11-26T07:24:10.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.723+0000 7f3768e9b640 1 -- start start 2023-11-26T07:24:10.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.724+0000 7f3768e9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37640ce6c0 0x7f37640cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.724+0000 7f3768e9b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37640cece0 con 0x7f37640cf450 2023-11-26T07:24:10.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.724+0000 7f3768e9b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376406d040 con 0x7f376415c7f0 2023-11-26T07:24:10.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.724+0000 7f3768e9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37640cfe40 con 0x7f37640ce6c0 2023-11-26T07:24:10.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.724+0000 7f375bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f37640cf450 0x7f37640cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49978/0 (socket says 172.21.15.77:49978) 2023-11-26T07:24:10.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.724+0000 7f375bfff640 1 -- 172.21.15.77:0/1406125223 learned_addr learned my addr 172.21.15.77:0/1406125223 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:10.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3762d9d640 1 --2- 172.21.15.77:0/1406125223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37640ce6c0 0x7f37640cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432802748 0 0) 0x7f37640cece0 con 0x7f37640cf450 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3750003520 con 0x7f37640cf450 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4232061923 0 0) 0x7f3750003520 con 0x7f37640cf450 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37640ce6c0 msgr2=0x7f37640cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 --2- 172.21.15.77:0/1406125223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37640ce6c0 0x7f37640cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 >> v1:172.21.15.159:6789/0 conn(0x7f376415c7f0 legacy=0x7f376406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376406d320 con 0x7f37640cf450 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f374c001670 con 0x7f37640cf450 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 >> v1:172.21.15.77:6789/0 conn(0x7f37640cf450 legacy=0x7f37640cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 --2- 172.21.15.77:0/1406125223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 0x7f3750003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 --2- 172.21.15.77:0/1406125223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37640ce6c0 0x7f37500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 --2- 172.21.15.77:0/1406125223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3750004d00 0x7f3750005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37640cfe40 con 0x7f37500039a0 2023-11-26T07:24:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375000ba30 con 0x7f3750004d00 2023-11-26T07:24:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.725+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375000bbf0 con 0x7f37640ce6c0 2023-11-26T07:24:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.726+0000 7f376259c640 1 --2- 172.21.15.77:0/1406125223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 0x7f3750003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.726+0000 7f3762d9d640 1 --2- 172.21.15.77:0/1406125223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3750004d00 0x7f3750005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.726+0000 7f376259c640 1 -- 172.21.15.77:0/1406125223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37640ce6c0 msgr2=0x7f37500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.726+0000 7f376259c640 1 --2- 172.21.15.77:0/1406125223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37640ce6c0 0x7f37500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.726+0000 7f376259c640 1 -- 172.21.15.77:0/1406125223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3750004d00 msgr2=0x7f3750005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.726+0000 7f376259c640 1 --2- 172.21.15.77:0/1406125223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3750004d00 0x7f3750005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.726+0000 7f376259c640 1 -- 172.21.15.77:0/1406125223 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750003520 con 0x7f37500039a0 2023-11-26T07:24:10.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.727+0000 7f376259c640 1 --2- 172.21.15.77:0/1406125223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 0x7f3750003dc0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f3754001720 tx=0x7f37500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776a9bbc92843cb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:10.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.727+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540052d0 con 0x7f37500039a0 2023-11-26T07:24:10.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.727+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375402e050 con 0x7f37500039a0 2023-11-26T07:24:10.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.727+0000 7f3761d9b640 1 -- 172.21.15.77:0/1406125223 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540035f0 con 0x7f37500039a0 2023-11-26T07:24:10.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.728+0000 7f3768e9b640 1 -- 172.21.15.77:0/1406125223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 msgr2=0x7f3750003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.728+0000 7f3768e9b640 1 --2- 172.21.15.77:0/1406125223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 0x7f3750003dc0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f3754001720 tx=0x7f37500057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.728+0000 7f3762d9d640 1 -- 172.21.15.77:0/1406125223 reap_dead start 2023-11-26T07:24:10.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.728+0000 7f3768e9b640 1 -- 172.21.15.77:0/1406125223 shutdown_connections 2023-11-26T07:24:10.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.728+0000 7f3768e9b640 1 -- 172.21.15.77:0/1406125223 >> 172.21.15.77:0/1406125223 conn(0x7f376406a920 msgr2=0x7f376406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:10.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.728+0000 7f3768e9b640 1 -- 172.21.15.77:0/1406125223 shutdown_connections 2023-11-26T07:24:10.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.728+0000 7f3768e9b640 1 -- 172.21.15.77:0/1406125223 wait complete. 2023-11-26T07:24:10.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.730+0000 7f3768e9b640 1 Processor -- start 2023-11-26T07:24:10.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.730+0000 7f3768e9b640 1 -- start start 2023-11-26T07:24:10.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.731+0000 7f3768e9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 0x7f376414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.731+0000 7f3768e9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3764153070 0x7f3764149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.731+0000 7f3768e9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f376415ddb0 0x7f376415e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.731+0000 7f3768e9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3764153bb0 con 0x7f37500039a0 2023-11-26T07:24:10.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.731+0000 7f3768e9b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376415e770 con 0x7f3764153070 2023-11-26T07:24:10.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.731+0000 7f3768e9b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37640b2b40 con 0x7f376415ddb0 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.731+0000 7f376259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 0x7f376414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.731+0000 7f376259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 0x7f376414a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40236/0 (socket says 172.21.15.77:40236) 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.731+0000 7f376259c640 1 -- 172.21.15.77:0/3993931756 learned_addr learned my addr 172.21.15.77:0/3993931756 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.731+0000 7f376259c640 1 -- 172.21.15.77:0/3993931756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f376415ddb0 msgr2=0x7f376415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.731+0000 7f375bfff640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3764153070 0x7f3764149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.732+0000 7f3762d9d640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f376415ddb0 0x7f376415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.732+0000 7f376259c640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f376415ddb0 0x7f376415e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.732+0000 7f376259c640 1 -- 172.21.15.77:0/3993931756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3764153070 msgr2=0x7f3764149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.732+0000 7f376259c640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3764153070 0x7f3764149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.732+0000 7f376259c640 1 -- 172.21.15.77:0/3993931756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376414a4e0 con 0x7f37500039a0 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.732+0000 7f375bfff640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3764153070 0x7f3764149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:10.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.732+0000 7f376259c640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 0x7f376414a730 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f3754008fd0 tx=0x7f3754001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.732+0000 7f375affd640 1 -- 172.21.15.77:0/3993931756 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540076c0 con 0x7f37500039a0 2023-11-26T07:24:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.732+0000 7f375affd640 1 -- 172.21.15.77:0/3993931756 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3754007a30 con 0x7f37500039a0 2023-11-26T07:24:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.732+0000 7f375affd640 1 -- 172.21.15.77:0/3993931756 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754006be0 con 0x7f37500039a0 2023-11-26T07:24:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.732+0000 7f3768e9b640 1 -- 172.21.15.77:0/3993931756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376414a200 con 0x7f37500039a0 2023-11-26T07:24:10.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.733+0000 7f3768e9b640 1 -- 172.21.15.77:0/3993931756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37641537d0 con 0x7f37500039a0 2023-11-26T07:24:10.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.734+0000 7f3768e9b640 1 -- 172.21.15.77:0/3993931756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3764067470 con 0x7f37500039a0 2023-11-26T07:24:10.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.735+0000 7f375affd640 1 -- 172.21.15.77:0/3993931756 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f3754006d40 con 0x7f37500039a0 2023-11-26T07:24:10.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.736+0000 7f375affd640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f374406b8b0 0x7f374406dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.736+0000 7f375affd640 1 -- 172.21.15.77:0/3993931756 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f37540aa0f0 con 0x7f37500039a0 2023-11-26T07:24:10.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.736+0000 7f375bfff640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f374406b8b0 0x7f374406dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.737+0000 7f375bfff640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f374406b8b0 0x7f374406dd70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3764155760 tx=0x7f374c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:10.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.741+0000 7f375affd640 1 -- 172.21.15.77:0/3993931756 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3754076bf0 con 0x7f37500039a0 2023-11-26T07:24:10.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.930+0000 7f3768e9b640 1 -- 172.21.15.77:0/3993931756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37640cd730 con 0x7f37500039a0 2023-11-26T07:24:10.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.933+0000 7f375affd640 1 -- 172.21.15.77:0/3993931756 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16642 (secure 0 0 0) 0x7f375404b090 con 0x7f37500039a0 2023-11-26T07:24:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:10.936 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":77,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:23:18.390879+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:02.276143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:03.495874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:24:10.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.935+0000 7f3768e9b640 1 -- 172.21.15.77:0/3993931756 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f374406b8b0 msgr2=0x7f374406dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.935+0000 7f3768e9b640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f374406b8b0 0x7f374406dd70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3764155760 tx=0x7f374c009040 comp rx=0 tx=0).stop 2023-11-26T07:24:10.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.935+0000 7f3768e9b640 1 -- 172.21.15.77:0/3993931756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 msgr2=0x7f376414a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.935+0000 7f3768e9b640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 0x7f376414a730 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f3754008fd0 tx=0x7f3754001120 comp rx=0 tx=0).stop 2023-11-26T07:24:10.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.935+0000 7f3768e9b640 1 -- 172.21.15.77:0/3993931756 shutdown_connections 2023-11-26T07:24:10.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.935+0000 7f3768e9b640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f374406b8b0 0x7f374406dd70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.935+0000 7f3768e9b640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f376415ddb0 0x7f376415e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.935+0000 7f3768e9b640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3764153070 0x7f3764149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.936+0000 7f3768e9b640 1 --2- 172.21.15.77:0/3993931756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37500039a0 0x7f376414a730 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.936+0000 7f3768e9b640 1 -- 172.21.15.77:0/3993931756 >> 172.21.15.77:0/3993931756 conn(0x7f376406a920 msgr2=0x7f376415cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:10.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.936+0000 7f3768e9b640 1 -- 172.21.15.77:0/3993931756 shutdown_connections 2023-11-26T07:24:10.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:10.936+0000 7f3768e9b640 1 -- 172.21.15.77:0/3993931756 wait complete. 2023-11-26T07:24:10.956 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:23.676498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:23:02.276143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:23:03.495874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:24:10.957 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:24:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.175+0000 7fd1d9ed0640 1 Processor -- start 2023-11-26T07:24:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.175+0000 7fd1d9ed0640 1 -- start start 2023-11-26T07:24:11.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.177+0000 7fd1d9ed0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1d415b440 0x7fd1d40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.177+0000 7fd1d9ed0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d40c5dc0 con 0x7fd1d40c59b0 2023-11-26T07:24:11.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.177+0000 7fd1d9ed0640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d415eea0 con 0x7fd1d40cbf20 2023-11-26T07:24:11.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.177+0000 7fd1d9ed0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d40cc3d0 con 0x7fd1d415b440 2023-11-26T07:24:11.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.177+0000 7fd1d37fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1d415b440 0x7fd1d40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:11.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.177+0000 7fd1d3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd1d40c59b0 0x7fd1d406c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49986/0 (socket says 172.21.15.77:49986) 2023-11-26T07:24:11.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.177+0000 7fd1d3fff640 1 -- 172.21.15.77:0/1038392636 learned_addr learned my addr 172.21.15.77:0/1038392636 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:11.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.178+0000 7fd1d37fe640 1 -- 172.21.15.77:0/1038392636 >> v1:172.21.15.159:6789/0 conn(0x7fd1d40cbf20 legacy=0x7fd1d40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:11.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.178+0000 7fd1d37fe640 1 -- 172.21.15.77:0/1038392636 >> v1:172.21.15.77:6789/0 conn(0x7fd1d40c59b0 legacy=0x7fd1d406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.178+0000 7fd1d37fe640 1 -- 172.21.15.77:0/1038392636 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40abf30 con 0x7fd1d415b440 2023-11-26T07:24:11.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.178+0000 7fd1d27fc640 1 -- 172.21.15.77:0/1038392636 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014600340 0 0) 0x7fd1d40c5dc0 con 0x7fd1d40c59b0 2023-11-26T07:24:11.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.179+0000 7fd1d37fe640 1 --2- 172.21.15.77:0/1038392636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d415b440 0x7fd1d40cb9e0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40097a0 tx=0x7fd1c402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889ce848c83a9621 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:11.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.179+0000 7fd1d27fc640 1 -- 172.21.15.77:0/1038392636 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c402e070 con 0x7fd1d415b440 2023-11-26T07:24:11.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.179+0000 7fd1d27fc640 1 -- 172.21.15.77:0/1038392636 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c40315a0 con 0x7fd1d415b440 2023-11-26T07:24:11.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.179+0000 7fd1d27fc640 1 -- 172.21.15.77:0/1038392636 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4031930 con 0x7fd1d415b440 2023-11-26T07:24:11.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.180+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1038392636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d415b440 msgr2=0x7fd1d40cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.180+0000 7fd1d9ed0640 1 --2- 172.21.15.77:0/1038392636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d415b440 0x7fd1d40cb9e0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40097a0 tx=0x7fd1c402b840 comp rx=0 tx=0).stop 2023-11-26T07:24:11.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.180+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1038392636 shutdown_connections 2023-11-26T07:24:11.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.180+0000 7fd1d9ed0640 1 --2- 172.21.15.77:0/1038392636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d415b440 0x7fd1d40cb9e0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.180+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1038392636 >> 172.21.15.77:0/1038392636 conn(0x7fd1d40b0c50 msgr2=0x7fd1d40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:11.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.180+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1038392636 shutdown_connections 2023-11-26T07:24:11.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.180+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1038392636 wait complete. 2023-11-26T07:24:11.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.182+0000 7fd1d9ed0640 1 Processor -- start 2023-11-26T07:24:11.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.182+0000 7fd1d9ed0640 1 -- start start 2023-11-26T07:24:11.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.183+0000 7fd1d9ed0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1d40c59b0 0x7fd1d40b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.183+0000 7fd1d9ed0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40cbf20 0x7fd1d4156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.183+0000 7fd1d9ed0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d415b440 0x7fd1d409b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.183+0000 7fd1d9ed0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d409caf0 con 0x7fd1d415b440 2023-11-26T07:24:11.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.183+0000 7fd1d9ed0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d409ac30 con 0x7fd1d40cbf20 2023-11-26T07:24:11.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.183+0000 7fd1d9ed0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d409af10 con 0x7fd1d40c59b0 2023-11-26T07:24:11.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.183+0000 7fd1d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d415b440 0x7fd1d409b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:11.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.183+0000 7fd1d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d415b440 0x7fd1d409b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40246/0 (socket says 172.21.15.77:40246) 2023-11-26T07:24:11.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.183+0000 7fd1d3fff640 1 -- 172.21.15.77:0/1671857284 learned_addr learned my addr 172.21.15.77:0/1671857284 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:11.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.183+0000 7fd1d2ffd640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40cbf20 0x7fd1d4156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:11.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.183+0000 7fd1d37fe640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1d40c59b0 0x7fd1d40b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:11.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1d3fff640 1 -- 172.21.15.77:0/1671857284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1d40c59b0 msgr2=0x7fd1d40b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1d3fff640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1d40c59b0 0x7fd1d40b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1d3fff640 1 -- 172.21.15.77:0/1671857284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40cbf20 msgr2=0x7fd1d4156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1d3fff640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40cbf20 0x7fd1d4156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1d3fff640 1 -- 172.21.15.77:0/1671857284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c4009400 con 0x7fd1d415b440 2023-11-26T07:24:11.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1d2ffd640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40cbf20 0x7fd1d4156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:11.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1d3fff640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d415b440 0x7fd1d409b9f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c7e0 tx=0x7fd1cc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:11.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1bbfff640 1 -- 172.21.15.77:0/1671857284 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00a640 con 0x7fd1d415b440 2023-11-26T07:24:11.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1bbfff640 1 -- 172.21.15.77:0/1671857284 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc00a7c0 con 0x7fd1d415b440 2023-11-26T07:24:11.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1bbfff640 1 -- 172.21.15.77:0/1671857284 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00ab70 con 0x7fd1d415b440 2023-11-26T07:24:11.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1671857284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d409b1f0 con 0x7fd1d415b440 2023-11-26T07:24:11.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.184+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1671857284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d409bf30 con 0x7fd1d415b440 2023-11-26T07:24:11.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.185+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1671857284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d409b710 con 0x7fd1d415b440 2023-11-26T07:24:11.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.186+0000 7fd1bbfff640 1 -- 172.21.15.77:0/1671857284 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fd1cc00acd0 con 0x7fd1d415b440 2023-11-26T07:24:11.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.187+0000 7fd1bbfff640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1c006b8f0 0x7fd1c006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.187+0000 7fd1bbfff640 1 -- 172.21.15.77:0/1671857284 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd1cc0877a0 con 0x7fd1d415b440 2023-11-26T07:24:11.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.188+0000 7fd1d37fe640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1c006b8f0 0x7fd1c006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:11.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.188+0000 7fd1d37fe640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1c006b8f0 0x7fd1c006ddb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4036000 tx=0x7fd1c403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:11.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.192+0000 7fd1bbfff640 1 -- 172.21.15.77:0/1671857284 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1d409b710 con 0x7fd1d415b440 2023-11-26T07:24:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.383+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1671857284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1d409b710 con 0x7fd1d415b440 2023-11-26T07:24:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.383+0000 7fd1bbfff640 1 -- 172.21.15.77:0/1671857284 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1cc018020 con 0x7fd1d415b440 2023-11-26T07:24:11.385 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-26T07:24:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1671857284 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1c006b8f0 msgr2=0x7fd1c006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1c006b8f0 0x7fd1c006ddb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4036000 tx=0x7fd1c403d040 comp rx=0 tx=0).stop 2023-11-26T07:24:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1671857284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d415b440 msgr2=0x7fd1d409b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d415b440 0x7fd1d409b9f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c7e0 tx=0x7fd1cc00cca0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1671857284 shutdown_connections 2023-11-26T07:24:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fd1c006b8f0 0x7fd1c006ddb0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d415b440 0x7fd1d409b9f0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d40cbf20 0x7fd1d4156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 --2- 172.21.15.77:0/1671857284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1d40c59b0 0x7fd1d40b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1671857284 >> 172.21.15.77:0/1671857284 conn(0x7fd1d40b0c50 msgr2=0x7fd1d40ac570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1671857284 shutdown_connections 2023-11-26T07:24:11.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.385+0000 7fd1d9ed0640 1 -- 172.21.15.77:0/1671857284 wait complete. 2023-11-26T07:24:11.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:24:11.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.623+0000 7efd91d97640 1 Processor -- start 2023-11-26T07:24:11.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.623+0000 7efd91d97640 1 -- start start 2023-11-26T07:24:11.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.624+0000 7efd91d97640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd8c072160 0x7efd8c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.624+0000 7efd91d97640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efd8c06de10 0x7efd8c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.624+0000 7efd91d97640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8c15ec90 con 0x7efd8c0c49f0 2023-11-26T07:24:11.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.624+0000 7efd91d97640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c0cd530 con 0x7efd8c06de10 2023-11-26T07:24:11.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.624+0000 7efd91d97640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0c4ed0 con 0x7efd8c072160 2023-11-26T07:24:11.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.624+0000 7efd8affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efd8c0c49f0 0x7efd8c06d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49992/0 (socket says 172.21.15.77:49992) 2023-11-26T07:24:11.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.624+0000 7efd8affd640 1 -- 172.21.15.77:0/2538530762 learned_addr learned my addr 172.21.15.77:0/2538530762 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:11.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8b7fe640 1 --2- 172.21.15.77:0/2538530762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd8c072160 0x7efd8c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065268039 0 0) 0x7efd80001110 con 0x7efd8c0c49f0 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd74003520 con 0x7efd8c0c49f0 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8bfff640 1 --2- 172.21.15.77:0/2538530762 >> v2:172.21.15.159:3300/0 conn(0x7efd8c06de10 0x7efd8c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1093619356 0 0) 0x7efd74003520 con 0x7efd8c0c49f0 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd8c072160 msgr2=0x7efd8c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 --2- 172.21.15.77:0/2538530762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd8c072160 0x7efd8c15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 >> v2:172.21.15.159:3300/0 conn(0x7efd8c06de10 msgr2=0x7efd8c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 --2- 172.21.15.77:0/2538530762 >> v2:172.21.15.159:3300/0 conn(0x7efd8c06de10 0x7efd8c0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c0c51b0 con 0x7efd8c0c49f0 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7efd80001800 con 0x7efd8c0c49f0 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 >> v1:172.21.15.77:6789/0 conn(0x7efd8c0c49f0 legacy=0x7efd8c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 --2- 172.21.15.77:0/2538530762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd74003970 0x7efd74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 --2- 172.21.15.77:0/2538530762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd8c072160 0x7efd740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 --2- 172.21.15.77:0/2538530762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd74004d00 0x7efd74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0cd530 con 0x7efd74003970 2023-11-26T07:24:11.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0c4ed0 con 0x7efd74004d00 2023-11-26T07:24:11.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.625+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7400b980 con 0x7efd8c072160 2023-11-26T07:24:11.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.626+0000 7efd8b7fe640 1 --2- 172.21.15.77:0/2538530762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd74003970 0x7efd74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:11.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.626+0000 7efd8b7fe640 1 -- 172.21.15.77:0/2538530762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd8c072160 msgr2=0x7efd740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:11.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.626+0000 7efd8b7fe640 1 --2- 172.21.15.77:0/2538530762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd8c072160 0x7efd740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.626+0000 7efd8b7fe640 1 -- 172.21.15.77:0/2538530762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd74004d00 msgr2=0x7efd74005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:11.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.626+0000 7efd8b7fe640 1 --2- 172.21.15.77:0/2538530762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd74004d00 0x7efd74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.626+0000 7efd8b7fe640 1 -- 172.21.15.77:0/2538530762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74003520 con 0x7efd74003970 2023-11-26T07:24:11.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.627+0000 7efd8b7fe640 1 --2- 172.21.15.77:0/2538530762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd74003970 0x7efd74003d90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009af0 tx=0x7efd740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4930ecf5343be2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:11.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.628+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c02c710 con 0x7efd74003970 2023-11-26T07:24:11.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.628+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c02c870 con 0x7efd74003970 2023-11-26T07:24:11.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.628+0000 7efd8a7fc640 1 -- 172.21.15.77:0/2538530762 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c02cc00 con 0x7efd74003970 2023-11-26T07:24:11.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.628+0000 7efd91d97640 1 -- 172.21.15.77:0/2538530762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd74003970 msgr2=0x7efd74003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.628+0000 7efd91d97640 1 --2- 172.21.15.77:0/2538530762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd74003970 0x7efd74003d90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009af0 tx=0x7efd740057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.628+0000 7efd8bfff640 1 -- 172.21.15.77:0/2538530762 reap_dead start 2023-11-26T07:24:11.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.628+0000 7efd91d97640 1 -- 172.21.15.77:0/2538530762 shutdown_connections 2023-11-26T07:24:11.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.628+0000 7efd91d97640 1 -- 172.21.15.77:0/2538530762 >> 172.21.15.77:0/2538530762 conn(0x7efd8c0b0c50 msgr2=0x7efd8c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:11.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.628+0000 7efd91d97640 1 -- 172.21.15.77:0/2538530762 shutdown_connections 2023-11-26T07:24:11.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.628+0000 7efd91d97640 1 -- 172.21.15.77:0/2538530762 wait complete. 2023-11-26T07:24:11.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.630+0000 7efd91d97640 1 Processor -- start 2023-11-26T07:24:11.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.630+0000 7efd91d97640 1 -- start start 2023-11-26T07:24:11.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.631+0000 7efd91d97640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd74003970 0x7efd8c159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.631+0000 7efd91d97640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd8c155390 0x7efd8c155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.631+0000 7efd91d97640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd8c144180 0x7efd8c144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.631+0000 7efd91d97640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c163240 con 0x7efd8c155390 2023-11-26T07:24:11.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.631+0000 7efd91d97640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c144b40 con 0x7efd8c144180 2023-11-26T07:24:11.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.631+0000 7efd91d97640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c155e30 con 0x7efd74003970 2023-11-26T07:24:11.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.631+0000 7efd8affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd8c155390 0x7efd8c155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:11.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.632+0000 7efd8affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd8c155390 0x7efd8c155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40270/0 (socket says 172.21.15.77:40270) 2023-11-26T07:24:11.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.632+0000 7efd8affd640 1 -- 172.21.15.77:0/3890816399 learned_addr learned my addr 172.21.15.77:0/3890816399 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:11.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.632+0000 7efd8bfff640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd8c144180 0x7efd8c144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:11.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.632+0000 7efd8affd640 1 -- 172.21.15.77:0/3890816399 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd74003970 msgr2=0x7efd8c159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.632+0000 7efd8affd640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd74003970 0x7efd8c159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.632+0000 7efd8affd640 1 -- 172.21.15.77:0/3890816399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd8c144180 msgr2=0x7efd8c144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.632+0000 7efd8affd640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd8c144180 0x7efd8c144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.632+0000 7efd8affd640 1 -- 172.21.15.77:0/3890816399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c156110 con 0x7efd8c155390 2023-11-26T07:24:11.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.632+0000 7efd8affd640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd8c155390 0x7efd8c155810 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7efd80000f60 tx=0x7efd8000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:11.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.633+0000 7efd73fff640 1 -- 172.21.15.77:0/3890816399 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd800074e0 con 0x7efd8c155390 2023-11-26T07:24:11.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.633+0000 7efd73fff640 1 -- 172.21.15.77:0/3890816399 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd80007640 con 0x7efd8c155390 2023-11-26T07:24:11.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.633+0000 7efd73fff640 1 -- 172.21.15.77:0/3890816399 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80004a00 con 0x7efd8c155390 2023-11-26T07:24:11.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.633+0000 7efd91d97640 1 -- 172.21.15.77:0/3890816399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8c1563f0 con 0x7efd8c155390 2023-11-26T07:24:11.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.633+0000 7efd91d97640 1 -- 172.21.15.77:0/3890816399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c144fa0 con 0x7efd8c155390 2023-11-26T07:24:11.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.634+0000 7efd91d97640 1 -- 172.21.15.77:0/3890816399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8c0ce6c0 con 0x7efd8c155390 2023-11-26T07:24:11.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.635+0000 7efd73fff640 1 -- 172.21.15.77:0/3890816399 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7efd80004b60 con 0x7efd8c155390 2023-11-26T07:24:11.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.636+0000 7efd73fff640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efd7806b920 0x7efd7806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:11.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.636+0000 7efd73fff640 1 -- 172.21.15.77:0/3890816399 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efd80087400 con 0x7efd8c155390 2023-11-26T07:24:11.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.636+0000 7efd8b7fe640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efd7806b920 0x7efd7806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:11.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.637+0000 7efd8b7fe640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efd7806b920 0x7efd7806dde0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efd7c036000 tx=0x7efd7c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:11.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.640+0000 7efd73fff640 1 -- 172.21.15.77:0/3890816399 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd80053d30 con 0x7efd8c155390 2023-11-26T07:24:11.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.833+0000 7efd91d97640 1 -- 172.21.15.77:0/3890816399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd8c15ec90 con 0x7efd8c155390 2023-11-26T07:24:11.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.834+0000 7efd73fff640 1 -- 172.21.15.77:0/3890816399 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd8c15ec90 con 0x7efd8c155390 2023-11-26T07:24:11.835 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-26T07:24:11.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.836+0000 7efd91d97640 1 -- 172.21.15.77:0/3890816399 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efd7806b920 msgr2=0x7efd7806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.837+0000 7efd91d97640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efd7806b920 0x7efd7806dde0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efd7c036000 tx=0x7efd7c02e000 comp rx=0 tx=0).stop 2023-11-26T07:24:11.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.837+0000 7efd91d97640 1 -- 172.21.15.77:0/3890816399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd8c155390 msgr2=0x7efd8c155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.837+0000 7efd91d97640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd8c155390 0x7efd8c155810 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7efd80000f60 tx=0x7efd8000ccd0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.837+0000 7efd91d97640 1 -- 172.21.15.77:0/3890816399 shutdown_connections 2023-11-26T07:24:11.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.837+0000 7efd91d97640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7efd7806b920 0x7efd7806dde0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.837+0000 7efd91d97640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd8c144180 0x7efd8c144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.837+0000 7efd91d97640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd8c155390 0x7efd8c155810 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.837+0000 7efd91d97640 1 --2- 172.21.15.77:0/3890816399 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd74003970 0x7efd8c159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.837+0000 7efd91d97640 1 -- 172.21.15.77:0/3890816399 >> 172.21.15.77:0/3890816399 conn(0x7efd8c0b0c50 msgr2=0x7efd8c0ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:11.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.837+0000 7efd91d97640 1 -- 172.21.15.77:0/3890816399 shutdown_connections 2023-11-26T07:24:11.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:11.837+0000 7efd91d97640 1 -- 172.21.15.77:0/3890816399 wait complete. 2023-11-26T07:24:11.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:24:12.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.063+0000 7fbcc907c640 1 Processor -- start 2023-11-26T07:24:12.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.063+0000 7fbcc907c640 1 -- start start 2023-11-26T07:24:12.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.065+0000 7fbcc907c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbcc406de10 0x7fbcc415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.065+0000 7fbcc907c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbcc40c49f0 0x7fbcc40705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.065+0000 7fbcc907c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc415ec90 con 0x7fbcc4072160 2023-11-26T07:24:12.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.065+0000 7fbcc907c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc40cd530 con 0x7fbcc40c49f0 2023-11-26T07:24:12.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.065+0000 7fbcc907c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc40c4ed0 con 0x7fbcc406de10 2023-11-26T07:24:12.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.066+0000 7fbcc359e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbcc40c49f0 0x7fbcc40705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.066+0000 7fbcc359e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbcc40c49f0 0x7fbcc40705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40278/0 (socket says 172.21.15.77:40278) 2023-11-26T07:24:12.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.066+0000 7fbcc359e640 1 -- 172.21.15.77:0/71648968 learned_addr learned my addr 172.21.15.77:0/71648968 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:12.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.066+0000 7fbcc359e640 1 -- 172.21.15.77:0/71648968 >> v2:172.21.15.159:3300/0 conn(0x7fbcc406de10 msgr2=0x7fbcc415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:12.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.066+0000 7fbcc359e640 1 --2- 172.21.15.77:0/71648968 >> v2:172.21.15.159:3300/0 conn(0x7fbcc406de10 0x7fbcc415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.066+0000 7fbcc359e640 1 -- 172.21.15.77:0/71648968 >> v1:172.21.15.159:6789/0 conn(0x7fbcc4072160 legacy=0x7fbcc406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:12.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.066+0000 7fbcc359e640 1 -- 172.21.15.77:0/71648968 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc40c51b0 con 0x7fbcc40c49f0 2023-11-26T07:24:12.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.067+0000 7fbcc359e640 1 --2- 172.21.15.77:0/71648968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc40c49f0 0x7fbcc40705c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40cef60 tx=0x7fbcbc02e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e64a8dc2b83c14 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.067+0000 7fbcc259c640 1 -- 172.21.15.77:0/71648968 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc02ea90 con 0x7fbcc40c49f0 2023-11-26T07:24:12.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.067+0000 7fbcc259c640 1 -- 172.21.15.77:0/71648968 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc02ebf0 con 0x7fbcc40c49f0 2023-11-26T07:24:12.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.067+0000 7fbcc259c640 1 -- 172.21.15.77:0/71648968 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc009600 con 0x7fbcc40c49f0 2023-11-26T07:24:12.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.068+0000 7fbcc907c640 1 -- 172.21.15.77:0/71648968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc40c49f0 msgr2=0x7fbcc40705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.068+0000 7fbcc907c640 1 --2- 172.21.15.77:0/71648968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc40c49f0 0x7fbcc40705c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40cef60 tx=0x7fbcbc02e0f0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.068+0000 7fbcc907c640 1 -- 172.21.15.77:0/71648968 shutdown_connections 2023-11-26T07:24:12.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.068+0000 7fbcc907c640 1 --2- 172.21.15.77:0/71648968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc40c49f0 0x7fbcc40705c0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.068+0000 7fbcc907c640 1 --2- 172.21.15.77:0/71648968 >> v2:172.21.15.159:3300/0 conn(0x7fbcc406de10 0x7fbcc415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.068+0000 7fbcc907c640 1 -- 172.21.15.77:0/71648968 >> 172.21.15.77:0/71648968 conn(0x7fbcc40b0c50 msgr2=0x7fbcc40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:12.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.068+0000 7fbcc907c640 1 -- 172.21.15.77:0/71648968 shutdown_connections 2023-11-26T07:24:12.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.068+0000 7fbcc907c640 1 -- 172.21.15.77:0/71648968 wait complete. 2023-11-26T07:24:12.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.070+0000 7fbcc907c640 1 Processor -- start 2023-11-26T07:24:12.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.070+0000 7fbcc907c640 1 -- start start 2023-11-26T07:24:12.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.071+0000 7fbcc907c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc406de10 0x7fbcc414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.071+0000 7fbcc907c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4072160 0x7fbcc40c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.071+0000 7fbcc907c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcc40c49f0 0x7fbcc40c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.071+0000 7fbcc907c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40c7ed0 con 0x7fbcc406de10 2023-11-26T07:24:12.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.071+0000 7fbcc907c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40c7250 con 0x7fbcc4072160 2023-11-26T07:24:12.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.071+0000 7fbcc907c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40c7530 con 0x7fbcc40c49f0 2023-11-26T07:24:12.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.071+0000 7fbcc2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc406de10 0x7fbcc414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.071+0000 7fbcc2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc406de10 0x7fbcc414ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40290/0 (socket says 172.21.15.77:40290) 2023-11-26T07:24:12.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.071+0000 7fbcc2d9d640 1 -- 172.21.15.77:0/2479655099 learned_addr learned my addr 172.21.15.77:0/2479655099 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:12.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.072+0000 7fbcc2d9d640 1 -- 172.21.15.77:0/2479655099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcc40c49f0 msgr2=0x7fbcc40c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.072+0000 7fbcc2d9d640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcc40c49f0 0x7fbcc40c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.072+0000 7fbcc2d9d640 1 -- 172.21.15.77:0/2479655099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4072160 msgr2=0x7fbcc40c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.072+0000 7fbcc2d9d640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4072160 0x7fbcc40c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.072+0000 7fbcc2d9d640 1 -- 172.21.15.77:0/2479655099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc00bd40 con 0x7fbcc406de10 2023-11-26T07:24:12.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.072+0000 7fbcc2d9d640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc406de10 0x7fbcc414ce70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400c430 tx=0x7fbcb400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.072+0000 7fbcbb7fe640 1 -- 172.21.15.77:0/2479655099 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4011790 con 0x7fbcc406de10 2023-11-26T07:24:12.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.072+0000 7fbcbb7fe640 1 -- 172.21.15.77:0/2479655099 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb40118f0 con 0x7fbcc406de10 2023-11-26T07:24:12.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.072+0000 7fbcbb7fe640 1 -- 172.21.15.77:0/2479655099 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4011ce0 con 0x7fbcc406de10 2023-11-26T07:24:12.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.072+0000 7fbcc907c640 1 -- 172.21.15.77:0/2479655099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc40c7810 con 0x7fbcc406de10 2023-11-26T07:24:12.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.072+0000 7fbcc907c640 1 -- 172.21.15.77:0/2479655099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc414d3b0 con 0x7fbcc406de10 2023-11-26T07:24:12.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.073+0000 7fbcc907c640 1 -- 172.21.15.77:0/2479655099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc404e8b0 con 0x7fbcc406de10 2023-11-26T07:24:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.074+0000 7fbcbb7fe640 1 -- 172.21.15.77:0/2479655099 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fbcb401c460 con 0x7fbcc406de10 2023-11-26T07:24:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.075+0000 7fbcbb7fe640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbca406b8f0 0x7fbca406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.075+0000 7fbcbb7fe640 1 -- 172.21.15.77:0/2479655099 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbcb4087f40 con 0x7fbcc406de10 2023-11-26T07:24:12.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.075+0000 7fbcbbfff640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbca406b8f0 0x7fbca406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.076+0000 7fbcbbfff640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbca406b8f0 0x7fbca406ddb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4153510 tx=0x7fbcac006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.079+0000 7fbcbb7fe640 1 -- 172.21.15.77:0/2479655099 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbcb4054a40 con 0x7fbcc406de10 2023-11-26T07:24:12.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.271+0000 7fbcc907c640 1 -- 172.21.15.77:0/2479655099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbcc415dab0 con 0x7fbcc406de10 2023-11-26T07:24:12.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.272+0000 7fbcbb7fe640 1 -- 172.21.15.77:0/2479655099 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbcb4058060 con 0x7fbcc406de10 2023-11-26T07:24:12.273 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-26T07:24:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 -- 172.21.15.77:0/2479655099 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbca406b8f0 msgr2=0x7fbca406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbca406b8f0 0x7fbca406ddb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4153510 tx=0x7fbcac006c90 comp rx=0 tx=0).stop 2023-11-26T07:24:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 -- 172.21.15.77:0/2479655099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc406de10 msgr2=0x7fbcc414ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc406de10 0x7fbcc414ce70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400c430 tx=0x7fbcb400c8f0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 -- 172.21.15.77:0/2479655099 shutdown_connections 2023-11-26T07:24:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fbca406b8f0 0x7fbca406ddb0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcc40c49f0 0x7fbcc40c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4072160 0x7fbcc40c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 --2- 172.21.15.77:0/2479655099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcc406de10 0x7fbcc414ce70 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 -- 172.21.15.77:0/2479655099 >> 172.21.15.77:0/2479655099 conn(0x7fbcc40b0c50 msgr2=0x7fbcc40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:12.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 -- 172.21.15.77:0/2479655099 shutdown_connections 2023-11-26T07:24:12.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.274+0000 7fbcc907c640 1 -- 172.21.15.77:0/2479655099 wait complete. 2023-11-26T07:24:12.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:24:12.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.483+0000 7fb5605b0640 1 Processor -- start 2023-11-26T07:24:12.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.483+0000 7fb5605b0640 1 -- start start 2023-11-26T07:24:12.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.485+0000 7fb5605b0640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb558159ce0 0x7fb55806de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.485+0000 7fb5605b0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 0x7fb5580cba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.485+0000 7fb5605b0640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5580b3a40 con 0x7fb5580cbf80 2023-11-26T07:24:12.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.485+0000 7fb5605b0640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580cc410 con 0x7fb558159ce0 2023-11-26T07:24:12.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.485+0000 7fb5605b0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580cdfa0 con 0x7fb5580b21d0 2023-11-26T07:24:12.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.486+0000 7fb55db4b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 0x7fb5580cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.486+0000 7fb55db4b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 0x7fb5580cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:44378/0 (socket says 172.21.15.77:44378) 2023-11-26T07:24:12.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.486+0000 7fb55db4b640 1 -- 172.21.15.77:0/3241675175 learned_addr learned my addr 172.21.15.77:0/3241675175 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:12.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.486+0000 7fb55e34c640 1 --2- 172.21.15.77:0/3241675175 >> v2:172.21.15.159:3300/0 conn(0x7fb558159ce0 0x7fb55806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.486+0000 7fb55db4b640 1 -- 172.21.15.77:0/3241675175 >> v2:172.21.15.159:3300/0 conn(0x7fb558159ce0 msgr2=0x7fb55806de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:12.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.486+0000 7fb55db4b640 1 --2- 172.21.15.77:0/3241675175 >> v2:172.21.15.159:3300/0 conn(0x7fb558159ce0 0x7fb55806de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.486+0000 7fb55db4b640 1 -- 172.21.15.77:0/3241675175 >> v1:172.21.15.159:6789/0 conn(0x7fb5580cbf80 legacy=0x7fb55815d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.486+0000 7fb55db4b640 1 -- 172.21.15.77:0/3241675175 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5580cd9e0 con 0x7fb5580b21d0 2023-11-26T07:24:12.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.488+0000 7fb55db4b640 1 --2- 172.21.15.77:0/3241675175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 0x7fb5580cba40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb548009870 tx=0x7fb54802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4bb0f4256e4ebd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.488+0000 7fb55d34a640 1 -- 172.21.15.77:0/3241675175 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548030840 con 0x7fb5580b21d0 2023-11-26T07:24:12.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.488+0000 7fb55d34a640 1 -- 172.21.15.77:0/3241675175 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5480309a0 con 0x7fb5580b21d0 2023-11-26T07:24:12.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.488+0000 7fb55d34a640 1 -- 172.21.15.77:0/3241675175 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548030d30 con 0x7fb5580b21d0 2023-11-26T07:24:12.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.489+0000 7fb5605b0640 1 -- 172.21.15.77:0/3241675175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 msgr2=0x7fb5580cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.489+0000 7fb5605b0640 1 --2- 172.21.15.77:0/3241675175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 0x7fb5580cba40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb548009870 tx=0x7fb54802b980 comp rx=0 tx=0).stop 2023-11-26T07:24:12.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.489+0000 7fb5605b0640 1 -- 172.21.15.77:0/3241675175 shutdown_connections 2023-11-26T07:24:12.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.489+0000 7fb5605b0640 1 --2- 172.21.15.77:0/3241675175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 0x7fb5580cba40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.489+0000 7fb5605b0640 1 --2- 172.21.15.77:0/3241675175 >> v2:172.21.15.159:3300/0 conn(0x7fb558159ce0 0x7fb55806de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.489+0000 7fb5605b0640 1 -- 172.21.15.77:0/3241675175 >> 172.21.15.77:0/3241675175 conn(0x7fb55806a920 msgr2=0x7fb55806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:12.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.489+0000 7fb5605b0640 1 -- 172.21.15.77:0/3241675175 shutdown_connections 2023-11-26T07:24:12.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.489+0000 7fb5605b0640 1 -- 172.21.15.77:0/3241675175 wait complete. 2023-11-26T07:24:12.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.491+0000 7fb5605b0640 1 Processor -- start 2023-11-26T07:24:12.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.491+0000 7fb5605b0640 1 -- start start 2023-11-26T07:24:12.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb5605b0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 0x7fb558153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb5605b0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5580cbf80 0x7fb55814c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb5605b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558159ce0 0x7fb55814c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb5605b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580c8360 con 0x7fb558159ce0 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb5605b0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558158ed0 con 0x7fb5580cbf80 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb5605b0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5581585e0 con 0x7fb5580b21d0 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55eb4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558159ce0 0x7fb55814c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55eb4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558159ce0 0x7fb55814c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40302/0 (socket says 172.21.15.77:40302) 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55eb4d640 1 -- 172.21.15.77:0/2091774692 learned_addr learned my addr 172.21.15.77:0/2091774692 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55e34c640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 0x7fb558153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55db4b640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5580cbf80 0x7fb55814c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55eb4d640 1 -- 172.21.15.77:0/2091774692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 msgr2=0x7fb558153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55eb4d640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 0x7fb558153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55eb4d640 1 -- 172.21.15.77:0/2091774692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5580cbf80 msgr2=0x7fb55814c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55eb4d640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5580cbf80 0x7fb55814c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55eb4d640 1 -- 172.21.15.77:0/2091774692 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5480094d0 con 0x7fb558159ce0 2023-11-26T07:24:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55e34c640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 0x7fb558153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.492+0000 7fb55db4b640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5580cbf80 0x7fb55814c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.493+0000 7fb55eb4d640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558159ce0 0x7fb55814c6d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb55000c730 tx=0x7fb55000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.493+0000 7fb54effd640 1 -- 172.21.15.77:0/2091774692 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550003b70 con 0x7fb558159ce0 2023-11-26T07:24:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.493+0000 7fb54effd640 1 -- 172.21.15.77:0/2091774692 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb550003cf0 con 0x7fb558159ce0 2023-11-26T07:24:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.493+0000 7fb54effd640 1 -- 172.21.15.77:0/2091774692 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550003ea0 con 0x7fb558159ce0 2023-11-26T07:24:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.493+0000 7fb5605b0640 1 -- 172.21.15.77:0/2091774692 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55814e2c0 con 0x7fb558159ce0 2023-11-26T07:24:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.493+0000 7fb5605b0640 1 -- 172.21.15.77:0/2091774692 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb558158b60 con 0x7fb558159ce0 2023-11-26T07:24:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.494+0000 7fb5605b0640 1 -- 172.21.15.77:0/2091774692 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb558067470 con 0x7fb558159ce0 2023-11-26T07:24:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.495+0000 7fb54effd640 1 -- 172.21.15.77:0/2091774692 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fb550005520 con 0x7fb558159ce0 2023-11-26T07:24:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.496+0000 7fb54effd640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb53c06b8f0 0x7fb53c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.496+0000 7fb54effd640 1 -- 172.21.15.77:0/2091774692 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb550087f90 con 0x7fb558159ce0 2023-11-26T07:24:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.496+0000 7fb55e34c640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb53c06b8f0 0x7fb53c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.497+0000 7fb55e34c640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb53c06b8f0 0x7fb53c06ddb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb554006fd0 tx=0x7fb554008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.500+0000 7fb54effd640 1 -- 172.21.15.77:0/2091774692 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb550054a10 con 0x7fb558159ce0 2023-11-26T07:24:12.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.726+0000 7fb5605b0640 1 -- 172.21.15.77:0/2091774692 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5580b1fb0 con 0x7fb558159ce0 2023-11-26T07:24:12.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.727+0000 7fb54effd640 1 -- 172.21.15.77:0/2091774692 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fb550058030 con 0x7fb558159ce0 2023-11-26T07:24:12.728 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:12.728 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/277058454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":277058454},{"type":"v1","addr":"172.21.15.159:6835","nonce":277058454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4120615192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4120615192},{"type":"v1","addr":"172.21.15.77:6835","nonce":4120615192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/52209425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":52209425},{"type":"v1","addr":"172.21.15.159:6834","nonce":52209425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:04.464261+0000","modified":"2023-11-26T07:23:07.539892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/3837428408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3837428408},{"type":"v1","addr":"172.21.15.77:6837","nonce":3837428408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:24:12.728 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 45 2023-11-26T07:24:12.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 -- 172.21.15.77:0/2091774692 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb53c06b8f0 msgr2=0x7fb53c06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb53c06b8f0 0x7fb53c06ddb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb554006fd0 tx=0x7fb554008040 comp rx=0 tx=0).stop 2023-11-26T07:24:12.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 -- 172.21.15.77:0/2091774692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558159ce0 msgr2=0x7fb55814c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558159ce0 0x7fb55814c6d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb55000c730 tx=0x7fb55000cbf0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 -- 172.21.15.77:0/2091774692 shutdown_connections 2023-11-26T07:24:12.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fb53c06b8f0 0x7fb53c06ddb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb558159ce0 0x7fb55814c6d0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5580cbf80 0x7fb55814c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 --2- 172.21.15.77:0/2091774692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5580b21d0 0x7fb558153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 -- 172.21.15.77:0/2091774692 >> 172.21.15.77:0/2091774692 conn(0x7fb55806a920 msgr2=0x7fb55806c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:12.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 -- 172.21.15.77:0/2091774692 shutdown_connections 2023-11-26T07:24:12.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.729+0000 7fb5605b0640 1 -- 172.21.15.77:0/2091774692 wait complete. 2023-11-26T07:24:12.748 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:24:12.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.942+0000 7fee7284b640 1 Processor -- start 2023-11-26T07:24:12.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.942+0000 7fee7284b640 1 -- start start 2023-11-26T07:24:12.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.943+0000 7fee7284b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee6c0cf450 0x7fee6c0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.943+0000 7fee7284b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c0cece0 con 0x7fee6c0cdfb0 2023-11-26T07:24:12.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.943+0000 7fee7284b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c06d040 con 0x7fee6c15c7f0 2023-11-26T07:24:12.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.943+0000 7fee7284b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c156010 con 0x7fee6c0cf450 2023-11-26T07:24:12.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.944+0000 7fee70de8640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fee6c0cdfb0 0x7fee6c0ce440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50000/0 (socket says 172.21.15.77:50000) 2023-11-26T07:24:12.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.944+0000 7fee70de8640 1 -- 172.21.15.77:0/3626251149 learned_addr learned my addr 172.21.15.77:0/3626251149 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:12.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.944+0000 7fee63fff640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee6c0cf450 0x7fee6c0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.944+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706905239 0 0) 0x7fee6c0cece0 con 0x7fee6c0cdfb0 2023-11-26T07:24:12.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.944+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee58003520 con 0x7fee6c0cdfb0 2023-11-26T07:24:12.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.944+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1054218811 0 0) 0x7fee58003520 con 0x7fee6c0cdfb0 2023-11-26T07:24:12.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee6c0cf450 msgr2=0x7fee6c0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:12.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee6c0cf450 0x7fee6c0cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 >> v1:172.21.15.159:6789/0 conn(0x7fee6c15c7f0 legacy=0x7fee6c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c06d320 con 0x7fee6c0cdfb0 2023-11-26T07:24:12.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fee640019f0 con 0x7fee6c0cdfb0 2023-11-26T07:24:12.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 >> v1:172.21.15.77:6789/0 conn(0x7fee6c0cdfb0 legacy=0x7fee6c0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee580039a0 0x7fee58003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee580047c0 0x7fee58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee6c0cf450 0x7fee58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c156010 con 0x7fee580047c0 2023-11-26T07:24:12.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5800ba90 con 0x7fee580039a0 2023-11-26T07:24:12.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5800bc50 con 0x7fee6c0cf450 2023-11-26T07:24:12.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee63fff640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee580047c0 0x7fee58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee6bfff640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee580039a0 0x7fee58003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee63fff640 1 -- 172.21.15.77:0/3626251149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee6c0cf450 msgr2=0x7fee58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:12.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee63fff640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee6c0cf450 0x7fee58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee63fff640 1 -- 172.21.15.77:0/3626251149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee580039a0 msgr2=0x7fee58003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:12.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.945+0000 7fee63fff640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee580039a0 0x7fee58003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.946+0000 7fee63fff640 1 -- 172.21.15.77:0/3626251149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee58003520 con 0x7fee580047c0 2023-11-26T07:24:12.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.946+0000 7fee6bfff640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee580039a0 0x7fee58003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:12.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.947+0000 7fee63fff640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee580047c0 0x7fee58004c40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fee54009a90 tx=0x7fee580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0be069c54900c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.947+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5402c6b0 con 0x7fee580047c0 2023-11-26T07:24:12.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.947+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5402c810 con 0x7fee580047c0 2023-11-26T07:24:12.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.947+0000 7fee6b7fe640 1 -- 172.21.15.77:0/3626251149 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5402cba0 con 0x7fee580047c0 2023-11-26T07:24:12.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.947+0000 7fee7284b640 1 -- 172.21.15.77:0/3626251149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee580047c0 msgr2=0x7fee58004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.947+0000 7fee7284b640 1 --2- 172.21.15.77:0/3626251149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee580047c0 0x7fee58004c40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fee54009a90 tx=0x7fee580057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.947+0000 7fee70de8640 1 -- 172.21.15.77:0/3626251149 reap_dead start 2023-11-26T07:24:12.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.948+0000 7fee7284b640 1 -- 172.21.15.77:0/3626251149 shutdown_connections 2023-11-26T07:24:12.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.948+0000 7fee7284b640 1 -- 172.21.15.77:0/3626251149 >> 172.21.15.77:0/3626251149 conn(0x7fee6c06a920 msgr2=0x7fee6c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:12.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.948+0000 7fee7284b640 1 -- 172.21.15.77:0/3626251149 shutdown_connections 2023-11-26T07:24:12.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.948+0000 7fee7284b640 1 -- 172.21.15.77:0/3626251149 wait complete. 2023-11-26T07:24:12.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.949+0000 7fee7284b640 1 Processor -- start 2023-11-26T07:24:12.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.950+0000 7fee7284b640 1 -- start start 2023-11-26T07:24:12.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.950+0000 7fee7284b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee580047c0 0x7fee6c1f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.950+0000 7fee7284b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee6c0b1290 0x7fee6c1f0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.950+0000 7fee7284b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee6c1f6e60 0x7fee6c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.951+0000 7fee7284b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c1f69d0 con 0x7fee6c0b1290 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.951+0000 7fee7284b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c1f6680 con 0x7fee6c1f6e60 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.951+0000 7fee7284b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c1f38e0 con 0x7fee580047c0 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.951+0000 7fee63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee6c0b1290 0x7fee6c1f0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.951+0000 7fee63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee6c0b1290 0x7fee6c1f0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40318/0 (socket says 172.21.15.77:40318) 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.951+0000 7fee63fff640 1 -- 172.21.15.77:0/184820524 learned_addr learned my addr 172.21.15.77:0/184820524 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.951+0000 7fee63fff640 1 -- 172.21.15.77:0/184820524 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee580047c0 msgr2=0x7fee6c1f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.951+0000 7fee63fff640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee580047c0 0x7fee6c1f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.951+0000 7fee63fff640 1 -- 172.21.15.77:0/184820524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee6c1f6e60 msgr2=0x7fee6c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.951+0000 7fee63fff640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee6c1f6e60 0x7fee6c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.951+0000 7fee63fff640 1 -- 172.21.15.77:0/184820524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c1f3bc0 con 0x7fee6c0b1290 2023-11-26T07:24:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.952+0000 7fee63fff640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee6c0b1290 0x7fee6c1f0430 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fee5402c250 tx=0x7fee54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.952+0000 7fee697fa640 1 -- 172.21.15.77:0/184820524 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54003810 con 0x7fee6c0b1290 2023-11-26T07:24:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.952+0000 7fee697fa640 1 -- 172.21.15.77:0/184820524 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54003970 con 0x7fee6c0b1290 2023-11-26T07:24:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.952+0000 7fee697fa640 1 -- 172.21.15.77:0/184820524 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54003d00 con 0x7fee6c0b1290 2023-11-26T07:24:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.952+0000 7fee7284b640 1 -- 172.21.15.77:0/184820524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c1f3ea0 con 0x7fee6c0b1290 2023-11-26T07:24:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.952+0000 7fee7284b640 1 -- 172.21.15.77:0/184820524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6c1f0970 con 0x7fee6c0b1290 2023-11-26T07:24:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.953+0000 7fee7284b640 1 -- 172.21.15.77:0/184820524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6c067470 con 0x7fee6c0b1290 2023-11-26T07:24:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.954+0000 7fee697fa640 1 -- 172.21.15.77:0/184820524 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fee54040450 con 0x7fee6c0b1290 2023-11-26T07:24:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.955+0000 7fee697fa640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fee4c06b920 0x7fee4c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.955+0000 7fee697fa640 1 -- 172.21.15.77:0/184820524 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fee540a9e20 con 0x7fee6c0b1290 2023-11-26T07:24:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.955+0000 7fee6bfff640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fee4c06b920 0x7fee4c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.956+0000 7fee6bfff640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fee4c06b920 0x7fee4c06dde0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fee5c000f60 tx=0x7fee5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:12.960+0000 7fee697fa640 1 -- 172.21.15.77:0/184820524 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee54076980 con 0x7fee6c0b1290 2023-11-26T07:24:13.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.154+0000 7fee7284b640 1 -- 172.21.15.77:0/184820524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee6c0cd730 con 0x7fee6c0b1290 2023-11-26T07:24:13.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.157+0000 7fee697fa640 1 -- 172.21.15.77:0/184820524 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16642 (secure 0 0 0) 0x7fee54003e60 con 0x7fee6c0b1290 2023-11-26T07:24:13.159 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:13.159 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":77,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:23:18.390879+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:02.276143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:03.495874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:24:13.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 -- 172.21.15.77:0/184820524 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fee4c06b920 msgr2=0x7fee4c06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fee4c06b920 0x7fee4c06dde0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fee5c000f60 tx=0x7fee5c009040 comp rx=0 tx=0).stop 2023-11-26T07:24:13.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 -- 172.21.15.77:0/184820524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee6c0b1290 msgr2=0x7fee6c1f0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee6c0b1290 0x7fee6c1f0430 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fee5402c250 tx=0x7fee54004730 comp rx=0 tx=0).stop 2023-11-26T07:24:13.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 -- 172.21.15.77:0/184820524 shutdown_connections 2023-11-26T07:24:13.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fee4c06b920 0x7fee4c06dde0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee6c1f6e60 0x7fee6c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee6c0b1290 0x7fee6c1f0430 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 --2- 172.21.15.77:0/184820524 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee580047c0 0x7fee6c1f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 -- 172.21.15.77:0/184820524 >> 172.21.15.77:0/184820524 conn(0x7fee6c06a920 msgr2=0x7fee6c0abfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:13.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 -- 172.21.15.77:0/184820524 shutdown_connections 2023-11-26T07:24:13.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.160+0000 7fee7284b640 1 -- 172.21.15.77:0/184820524 wait complete. 2023-11-26T07:24:13.181 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:24:13.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:24:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.392+0000 7f5b688ff640 1 Processor -- start 2023-11-26T07:24:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.393+0000 7f5b688ff640 1 -- start start 2023-11-26T07:24:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.394+0000 7f5b688ff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b6415d4e0 0x7f5b640d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.394+0000 7f5b688ff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5b640d38e0 0x7f5b640cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.394+0000 7f5b688ff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b640ce990 con 0x7f5b640d0070 2023-11-26T07:24:13.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.394+0000 7f5b688ff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b640d4110 con 0x7f5b6415d4e0 2023-11-26T07:24:13.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.394+0000 7f5b688ff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b640d04e0 con 0x7f5b640d38e0 2023-11-26T07:24:13.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.394+0000 7f5b637fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b6415d4e0 0x7f5b640d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.394+0000 7f5b637fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b6415d4e0 0x7f5b640d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40320/0 (socket says 172.21.15.77:40320) 2023-11-26T07:24:13.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.394+0000 7f5b637fe640 1 -- 172.21.15.77:0/294355717 learned_addr learned my addr 172.21.15.77:0/294355717 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:13.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.395+0000 7f5b637fe640 1 -- 172.21.15.77:0/294355717 >> v2:172.21.15.159:3300/0 conn(0x7f5b640d38e0 msgr2=0x7f5b640cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:13.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.395+0000 7f5b62ffd640 1 --2- 172.21.15.77:0/294355717 >> v2:172.21.15.159:3300/0 conn(0x7f5b640d38e0 0x7f5b640cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.395+0000 7f5b637fe640 1 --2- 172.21.15.77:0/294355717 >> v2:172.21.15.159:3300/0 conn(0x7f5b640d38e0 0x7f5b640cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.395+0000 7f5b627fc640 1 -- 172.21.15.77:0/294355717 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108845125 0 0) 0x7f5b640ce990 con 0x7f5b640d0070 2023-11-26T07:24:13.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.395+0000 7f5b637fe640 1 -- 172.21.15.77:0/294355717 >> v1:172.21.15.77:6789/0 conn(0x7f5b640d0070 legacy=0x7f5b640d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.395+0000 7f5b637fe640 1 -- 172.21.15.77:0/294355717 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b640cec70 con 0x7f5b6415d4e0 2023-11-26T07:24:13.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.395+0000 7f5b62ffd640 1 --2- 172.21.15.77:0/294355717 >> v2:172.21.15.159:3300/0 conn(0x7f5b640d38e0 0x7f5b640cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.396+0000 7f5b637fe640 1 --2- 172.21.15.77:0/294355717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b6415d4e0 0x7f5b640d1e20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5b640b9280 tx=0x7f5b5402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c3211a585a98c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.397+0000 7f5b627fc640 1 -- 172.21.15.77:0/294355717 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5402cb20 con 0x7f5b6415d4e0 2023-11-26T07:24:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.397+0000 7f5b627fc640 1 -- 172.21.15.77:0/294355717 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5402cc80 con 0x7f5b6415d4e0 2023-11-26T07:24:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.397+0000 7f5b627fc640 1 -- 172.21.15.77:0/294355717 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b540343f0 con 0x7f5b6415d4e0 2023-11-26T07:24:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.397+0000 7f5b688ff640 1 -- 172.21.15.77:0/294355717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b6415d4e0 msgr2=0x7f5b640d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.397+0000 7f5b688ff640 1 --2- 172.21.15.77:0/294355717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b6415d4e0 0x7f5b640d1e20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5b640b9280 tx=0x7f5b5402bf80 comp rx=0 tx=0).stop 2023-11-26T07:24:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.397+0000 7f5b688ff640 1 -- 172.21.15.77:0/294355717 shutdown_connections 2023-11-26T07:24:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.397+0000 7f5b688ff640 1 --2- 172.21.15.77:0/294355717 >> v2:172.21.15.159:3300/0 conn(0x7f5b640d38e0 0x7f5b640cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.397+0000 7f5b688ff640 1 --2- 172.21.15.77:0/294355717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b6415d4e0 0x7f5b640d1e20 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.397+0000 7f5b688ff640 1 -- 172.21.15.77:0/294355717 >> 172.21.15.77:0/294355717 conn(0x7f5b6409c510 msgr2=0x7f5b640d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.397+0000 7f5b688ff640 1 -- 172.21.15.77:0/294355717 shutdown_connections 2023-11-26T07:24:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.397+0000 7f5b688ff640 1 -- 172.21.15.77:0/294355717 wait complete. 2023-11-26T07:24:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.399+0000 7f5b688ff640 1 Processor -- start 2023-11-26T07:24:13.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.399+0000 7f5b688ff640 1 -- start start 2023-11-26T07:24:13.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.400+0000 7f5b688ff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b640d0070 0x7f5b640b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.400+0000 7f5b688ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b640d38e0 0x7f5b6415da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.400+0000 7f5b688ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b6415d4e0 0x7f5b6415fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.400+0000 7f5b688ff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6415e7e0 con 0x7f5b640d38e0 2023-11-26T07:24:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.400+0000 7f5b688ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6415e500 con 0x7f5b6415d4e0 2023-11-26T07:24:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.400+0000 7f5b688ff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640c7730 con 0x7f5b640d0070 2023-11-26T07:24:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.400+0000 7f5b62ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b640d38e0 0x7f5b6415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b62ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b640d38e0 0x7f5b6415da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40322/0 (socket says 172.21.15.77:40322) 2023-11-26T07:24:13.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b62ffd640 1 -- 172.21.15.77:0/3448232552 learned_addr learned my addr 172.21.15.77:0/3448232552 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b62ffd640 1 -- 172.21.15.77:0/3448232552 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b640d0070 msgr2=0x7f5b640b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b637fe640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b640d0070 0x7f5b640b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b63fff640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b6415d4e0 0x7f5b6415fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b62ffd640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b640d0070 0x7f5b640b82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b62ffd640 1 -- 172.21.15.77:0/3448232552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b6415d4e0 msgr2=0x7f5b6415fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b62ffd640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b6415d4e0 0x7f5b6415fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b62ffd640 1 -- 172.21.15.77:0/3448232552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b54009b30 con 0x7f5b640d38e0 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b637fe640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b640d0070 0x7f5b640b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b62ffd640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b640d38e0 0x7f5b6415da40 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00c7f0 tx=0x7f5b4c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.401+0000 7f5b5bfff640 1 -- 172.21.15.77:0/3448232552 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c007a30 con 0x7f5b640d38e0 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.402+0000 7f5b5bfff640 1 -- 172.21.15.77:0/3448232552 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c007b90 con 0x7f5b640d38e0 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.402+0000 7f5b688ff640 1 -- 172.21.15.77:0/3448232552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b640c7a10 con 0x7f5b640d38e0 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.402+0000 7f5b5bfff640 1 -- 172.21.15.77:0/3448232552 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c00ce40 con 0x7f5b640d38e0 2023-11-26T07:24:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.402+0000 7f5b688ff640 1 -- 172.21.15.77:0/3448232552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b640b87f0 con 0x7f5b640d38e0 2023-11-26T07:24:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.403+0000 7f5b688ff640 1 -- 172.21.15.77:0/3448232552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6404e840 con 0x7f5b640d38e0 2023-11-26T07:24:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.404+0000 7f5b5bfff640 1 -- 172.21.15.77:0/3448232552 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f5b4c0113f0 con 0x7f5b640d38e0 2023-11-26T07:24:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.404+0000 7f5b5bfff640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5b4406b8f0 0x7f5b4406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.405+0000 7f5b5bfff640 1 -- 172.21.15.77:0/3448232552 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5b4c0880e0 con 0x7f5b640d38e0 2023-11-26T07:24:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.405+0000 7f5b637fe640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5b4406b8f0 0x7f5b4406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.406+0000 7f5b637fe640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5b4406b8f0 0x7f5b4406ddb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5b54035000 tx=0x7f5b54030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.409+0000 7f5b5bfff640 1 -- 172.21.15.77:0/3448232552 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b4c054be0 con 0x7f5b640d38e0 2023-11-26T07:24:13.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.636+0000 7f5b688ff640 1 -- 172.21.15.77:0/3448232552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b640ccd10 con 0x7f5b640d38e0 2023-11-26T07:24:13.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.638+0000 7f5b5bfff640 1 -- 172.21.15.77:0/3448232552 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f5b4c01f090 con 0x7f5b640d38e0 2023-11-26T07:24:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:13.639 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/277058454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":277058454},{"type":"v1","addr":"172.21.15.159:6835","nonce":277058454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4120615192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4120615192},{"type":"v1","addr":"172.21.15.77:6835","nonce":4120615192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/52209425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":52209425},{"type":"v1","addr":"172.21.15.159:6834","nonce":52209425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:04.464261+0000","modified":"2023-11-26T07:23:07.539892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/3837428408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3837428408},{"type":"v1","addr":"172.21.15.77:6837","nonce":3837428408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:24:13.640 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 45 2023-11-26T07:24:13.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.640+0000 7f5b688ff640 1 -- 172.21.15.77:0/3448232552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5b4406b8f0 msgr2=0x7f5b4406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.640+0000 7f5b688ff640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5b4406b8f0 0x7f5b4406ddb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5b54035000 tx=0x7f5b54030000 comp rx=0 tx=0).stop 2023-11-26T07:24:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.640+0000 7f5b688ff640 1 -- 172.21.15.77:0/3448232552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b640d38e0 msgr2=0x7f5b6415da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.641+0000 7f5b688ff640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b640d38e0 0x7f5b6415da40 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00c7f0 tx=0x7f5b4c00cbf0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.641+0000 7f5b688ff640 1 -- 172.21.15.77:0/3448232552 shutdown_connections 2023-11-26T07:24:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.641+0000 7f5b688ff640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5b4406b8f0 0x7f5b4406ddb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.641+0000 7f5b688ff640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b6415d4e0 0x7f5b6415fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.641+0000 7f5b688ff640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b640d38e0 0x7f5b6415da40 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.641+0000 7f5b688ff640 1 --2- 172.21.15.77:0/3448232552 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b640d0070 0x7f5b640b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.641+0000 7f5b688ff640 1 -- 172.21.15.77:0/3448232552 >> 172.21.15.77:0/3448232552 conn(0x7f5b6409c510 msgr2=0x7f5b640b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.641+0000 7f5b688ff640 1 -- 172.21.15.77:0/3448232552 shutdown_connections 2023-11-26T07:24:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.641+0000 7f5b688ff640 1 -- 172.21.15.77:0/3448232552 wait complete. 2023-11-26T07:24:13.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:24:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.869+0000 7fe314378640 1 Processor -- start 2023-11-26T07:24:13.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.869+0000 7fe314378640 1 -- start start 2023-11-26T07:24:13.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.871+0000 7fe314378640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe30c15eaf0 0x7fe30c0b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.871+0000 7fe314378640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe30c0b3890 0x7fe30c167110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.871+0000 7fe314378640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c06d180 con 0x7fe30c1461d0 2023-11-26T07:24:13.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.871+0000 7fe314378640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c0b3ce0 con 0x7fe30c0b3890 2023-11-26T07:24:13.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.871+0000 7fe314378640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c06ba70 con 0x7fe30c15eaf0 2023-11-26T07:24:13.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.871+0000 7fe312915640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe30c0b3890 0x7fe30c167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.871+0000 7fe312915640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe30c0b3890 0x7fe30c167110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40336/0 (socket says 172.21.15.77:40336) 2023-11-26T07:24:13.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.871+0000 7fe312915640 1 -- 172.21.15.77:0/2672588051 learned_addr learned my addr 172.21.15.77:0/2672588051 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:13.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.872+0000 7fe311913640 1 --2- 172.21.15.77:0/2672588051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe30c15eaf0 0x7fe30c0b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.872+0000 7fe312915640 1 -- 172.21.15.77:0/2672588051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe30c15eaf0 msgr2=0x7fe30c0b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:13.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.872+0000 7fe312915640 1 --2- 172.21.15.77:0/2672588051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe30c15eaf0 0x7fe30c0b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.872+0000 7fe312915640 1 -- 172.21.15.77:0/2672588051 >> v1:172.21.15.159:6789/0 conn(0x7fe30c1461d0 legacy=0x7fe30c0b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.872+0000 7fe312915640 1 -- 172.21.15.77:0/2672588051 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c06bd50 con 0x7fe30c0b3890 2023-11-26T07:24:13.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.873+0000 7fe312915640 1 --2- 172.21.15.77:0/2672588051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0b3890 0x7fe30c167110 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe304009e50 tx=0x7fe30402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca84cbac7eaf2a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.873+0000 7fe311112640 1 -- 172.21.15.77:0/2672588051 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30402cb00 con 0x7fe30c0b3890 2023-11-26T07:24:13.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.873+0000 7fe311112640 1 -- 172.21.15.77:0/2672588051 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30402cc60 con 0x7fe30c0b3890 2023-11-26T07:24:13.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.873+0000 7fe311112640 1 -- 172.21.15.77:0/2672588051 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3040343f0 con 0x7fe30c0b3890 2023-11-26T07:24:13.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.874+0000 7fe314378640 1 -- 172.21.15.77:0/2672588051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0b3890 msgr2=0x7fe30c167110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.874+0000 7fe314378640 1 --2- 172.21.15.77:0/2672588051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0b3890 0x7fe30c167110 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe304009e50 tx=0x7fe30402bf60 comp rx=0 tx=0).stop 2023-11-26T07:24:13.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.874+0000 7fe314378640 1 -- 172.21.15.77:0/2672588051 shutdown_connections 2023-11-26T07:24:13.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.874+0000 7fe314378640 1 --2- 172.21.15.77:0/2672588051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0b3890 0x7fe30c167110 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.874+0000 7fe314378640 1 --2- 172.21.15.77:0/2672588051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe30c15eaf0 0x7fe30c0b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.874+0000 7fe314378640 1 -- 172.21.15.77:0/2672588051 >> 172.21.15.77:0/2672588051 conn(0x7fe30c061340 msgr2=0x7fe30c061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:13.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.874+0000 7fe314378640 1 -- 172.21.15.77:0/2672588051 shutdown_connections 2023-11-26T07:24:13.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.874+0000 7fe314378640 1 -- 172.21.15.77:0/2672588051 wait complete. 2023-11-26T07:24:13.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.876+0000 7fe314378640 1 Processor -- start 2023-11-26T07:24:13.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.876+0000 7fe314378640 1 -- start start 2023-11-26T07:24:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe314378640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe30c0b3890 0x7fe30c15c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe314378640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c1461d0 0x7fe30c0a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe314378640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe30c15eaf0 0x7fe30c142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe314378640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c1f3e20 con 0x7fe30c1461d0 2023-11-26T07:24:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe314378640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c1f4100 con 0x7fe30c15eaf0 2023-11-26T07:24:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe314378640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c1f43e0 con 0x7fe30c0b3890 2023-11-26T07:24:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe311913640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c1461d0 0x7fe30c0a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe311913640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c1461d0 0x7fe30c0a9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40342/0 (socket says 172.21.15.77:40342) 2023-11-26T07:24:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe311913640 1 -- 172.21.15.77:0/2225589918 learned_addr learned my addr 172.21.15.77:0/2225589918 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe312114640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe30c0b3890 0x7fe30c15c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe312915640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe30c15eaf0 0x7fe30c142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe311913640 1 -- 172.21.15.77:0/2225589918 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe30c0b3890 msgr2=0x7fe30c15c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe311913640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe30c0b3890 0x7fe30c15c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe311913640 1 -- 172.21.15.77:0/2225589918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe30c15eaf0 msgr2=0x7fe30c142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.877+0000 7fe311913640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe30c15eaf0 0x7fe30c142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.878+0000 7fe311913640 1 -- 172.21.15.77:0/2225589918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe304009b30 con 0x7fe30c1461d0 2023-11-26T07:24:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.878+0000 7fe311913640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c1461d0 0x7fe30c0a9270 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00d5f0 tx=0x7fe2fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.878+0000 7fe302ffd640 1 -- 172.21.15.77:0/2225589918 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0125f0 con 0x7fe30c1461d0 2023-11-26T07:24:13.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.878+0000 7fe302ffd640 1 -- 172.21.15.77:0/2225589918 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc012750 con 0x7fe30c1461d0 2023-11-26T07:24:13.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.878+0000 7fe302ffd640 1 -- 172.21.15.77:0/2225589918 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc012b00 con 0x7fe30c1461d0 2023-11-26T07:24:13.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.878+0000 7fe314378640 1 -- 172.21.15.77:0/2225589918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c1f46c0 con 0x7fe30c1461d0 2023-11-26T07:24:13.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.878+0000 7fe314378640 1 -- 172.21.15.77:0/2225589918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c1f0800 con 0x7fe30c1461d0 2023-11-26T07:24:13.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.879+0000 7fe314378640 1 -- 172.21.15.77:0/2225589918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c070a90 con 0x7fe30c1461d0 2023-11-26T07:24:13.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.880+0000 7fe302ffd640 1 -- 172.21.15.77:0/2225589918 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fe2fc012c60 con 0x7fe30c1461d0 2023-11-26T07:24:13.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.881+0000 7fe302ffd640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006b8f0 0x7fe2f006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.881+0000 7fe302ffd640 1 -- 172.21.15.77:0/2225589918 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe2fc088440 con 0x7fe30c1461d0 2023-11-26T07:24:13.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.881+0000 7fe312114640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006b8f0 0x7fe2f006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.882+0000 7fe312114640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006b8f0 0x7fe2f006ddb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe308000f60 tx=0x7fe308009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:13.885+0000 7fe302ffd640 1 -- 172.21.15.77:0/2225589918 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2fc054f80 con 0x7fe30c1461d0 2023-11-26T07:24:14.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.116+0000 7fe314378640 1 -- 172.21.15.77:0/2225589918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe30c067470 con 0x7fe30c1461d0 2023-11-26T07:24:14.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.118+0000 7fe302ffd640 1 -- 172.21.15.77:0/2225589918 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fe2fc0585a0 con 0x7fe30c1461d0 2023-11-26T07:24:14.119 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:14.120 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/277058454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":277058454},{"type":"v1","addr":"172.21.15.159:6835","nonce":277058454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4120615192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4120615192},{"type":"v1","addr":"172.21.15.77:6835","nonce":4120615192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/52209425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":52209425},{"type":"v1","addr":"172.21.15.159:6834","nonce":52209425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:04.464261+0000","modified":"2023-11-26T07:23:07.539892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/3837428408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3837428408},{"type":"v1","addr":"172.21.15.77:6837","nonce":3837428408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:24:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 45 2023-11-26T07:24:14.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.120+0000 7fe314378640 1 -- 172.21.15.77:0/2225589918 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006b8f0 msgr2=0x7fe2f006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.120+0000 7fe314378640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006b8f0 0x7fe2f006ddb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe308000f60 tx=0x7fe308009040 comp rx=0 tx=0).stop 2023-11-26T07:24:14.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.120+0000 7fe314378640 1 -- 172.21.15.77:0/2225589918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c1461d0 msgr2=0x7fe30c0a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.120+0000 7fe314378640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c1461d0 0x7fe30c0a9270 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00d5f0 tx=0x7fe2fc00dab0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.120+0000 7fe314378640 1 -- 172.21.15.77:0/2225589918 shutdown_connections 2023-11-26T07:24:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.120+0000 7fe314378640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe2f006b8f0 0x7fe2f006ddb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.120+0000 7fe314378640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe30c15eaf0 0x7fe30c142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.120+0000 7fe314378640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c1461d0 0x7fe30c0a9270 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.120+0000 7fe314378640 1 --2- 172.21.15.77:0/2225589918 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe30c0b3890 0x7fe30c15c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.120+0000 7fe314378640 1 -- 172.21.15.77:0/2225589918 >> 172.21.15.77:0/2225589918 conn(0x7fe30c061340 msgr2=0x7fe30c0b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:14.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.121+0000 7fe314378640 1 -- 172.21.15.77:0/2225589918 shutdown_connections 2023-11-26T07:24:14.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.121+0000 7fe314378640 1 -- 172.21.15.77:0/2225589918 wait complete. 2023-11-26T07:24:14.142 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:24:14.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.356+0000 7f7e30648640 1 Processor -- start 2023-11-26T07:24:14.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.356+0000 7f7e30648640 1 -- start start 2023-11-26T07:24:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.357+0000 7f7e30648640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e2815c7f0 0x7f7e2806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.357+0000 7f7e30648640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e280ce6c0 0x7f7e280cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.357+0000 7f7e30648640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e280cece0 con 0x7f7e280cf450 2023-11-26T07:24:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.357+0000 7f7e30648640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e28156010 con 0x7f7e280ce6c0 2023-11-26T07:24:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.358+0000 7f7e30648640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2806ce30 con 0x7f7e2815c7f0 2023-11-26T07:24:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.358+0000 7f7e2ebe5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e280ce6c0 0x7f7e280cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.358+0000 7f7e2ebe5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e280ce6c0 0x7f7e280cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40348/0 (socket says 172.21.15.77:40348) 2023-11-26T07:24:14.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.358+0000 7f7e2ebe5640 1 -- 172.21.15.77:0/3273319714 learned_addr learned my addr 172.21.15.77:0/3273319714 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:14.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.358+0000 7f7e2e3e4640 1 --2- 172.21.15.77:0/3273319714 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e2815c7f0 0x7f7e2806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.358+0000 7f7e2ebe5640 1 -- 172.21.15.77:0/3273319714 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e2815c7f0 msgr2=0x7f7e2806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:14.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.358+0000 7f7e2ebe5640 1 --2- 172.21.15.77:0/3273319714 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e2815c7f0 0x7f7e2806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.358+0000 7f7e2ebe5640 1 -- 172.21.15.77:0/3273319714 >> v1:172.21.15.159:6789/0 conn(0x7f7e280cf450 legacy=0x7f7e280cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:14.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.358+0000 7f7e2ebe5640 1 -- 172.21.15.77:0/3273319714 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2806d040 con 0x7f7e280ce6c0 2023-11-26T07:24:14.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.358+0000 7f7e2e3e4640 1 --2- 172.21.15.77:0/3273319714 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e2815c7f0 0x7f7e2806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:14.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.359+0000 7f7e2ebe5640 1 --2- 172.21.15.77:0/3273319714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e280ce6c0 0x7f7e280cf8d0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009e50 tx=0x7f7e2002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f2c01786794d7f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.360+0000 7f7e2d3e2640 1 -- 172.21.15.77:0/3273319714 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2002ca80 con 0x7f7e280ce6c0 2023-11-26T07:24:14.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.360+0000 7f7e2d3e2640 1 -- 172.21.15.77:0/3273319714 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2002cbe0 con 0x7f7e280ce6c0 2023-11-26T07:24:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.360+0000 7f7e2d3e2640 1 -- 172.21.15.77:0/3273319714 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e200343f0 con 0x7f7e280ce6c0 2023-11-26T07:24:14.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.360+0000 7f7e30648640 1 -- 172.21.15.77:0/3273319714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e280ce6c0 msgr2=0x7f7e280cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.360+0000 7f7e30648640 1 --2- 172.21.15.77:0/3273319714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e280ce6c0 0x7f7e280cf8d0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009e50 tx=0x7f7e2002bee0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.361+0000 7f7e30648640 1 -- 172.21.15.77:0/3273319714 shutdown_connections 2023-11-26T07:24:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.361+0000 7f7e30648640 1 --2- 172.21.15.77:0/3273319714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e280ce6c0 0x7f7e280cf8d0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.361+0000 7f7e30648640 1 --2- 172.21.15.77:0/3273319714 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e2815c7f0 0x7f7e2806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.361+0000 7f7e30648640 1 -- 172.21.15.77:0/3273319714 >> 172.21.15.77:0/3273319714 conn(0x7f7e2806a920 msgr2=0x7f7e2806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.361+0000 7f7e30648640 1 -- 172.21.15.77:0/3273319714 shutdown_connections 2023-11-26T07:24:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.361+0000 7f7e30648640 1 -- 172.21.15.77:0/3273319714 wait complete. 2023-11-26T07:24:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.362+0000 7f7e30648640 1 Processor -- start 2023-11-26T07:24:14.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.362+0000 7f7e30648640 1 -- start start 2023-11-26T07:24:14.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.363+0000 7f7e30648640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e280ce6c0 0x7f7e28151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.363+0000 7f7e30648640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e280cf450 0x7f7e280ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.363+0000 7f7e30648640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e2815c7f0 0x7f7e281f68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.363+0000 7f7e30648640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280ac0f0 con 0x7f7e280ce6c0 2023-11-26T07:24:14.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.363+0000 7f7e30648640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280ac3d0 con 0x7f7e280cf450 2023-11-26T07:24:14.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.363+0000 7f7e30648640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280ac6b0 con 0x7f7e2815c7f0 2023-11-26T07:24:14.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.364+0000 7f7e2e3e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e280ce6c0 0x7f7e28151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.364+0000 7f7e2e3e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e280ce6c0 0x7f7e28151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40360/0 (socket says 172.21.15.77:40360) 2023-11-26T07:24:14.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.364+0000 7f7e2e3e4640 1 -- 172.21.15.77:0/1739986134 learned_addr learned my addr 172.21.15.77:0/1739986134 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:14.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.364+0000 7f7e2e3e4640 1 -- 172.21.15.77:0/1739986134 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e2815c7f0 msgr2=0x7f7e281f68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.364+0000 7f7e2e3e4640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e2815c7f0 0x7f7e281f68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.364+0000 7f7e2e3e4640 1 -- 172.21.15.77:0/1739986134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e280cf450 msgr2=0x7f7e280ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.364+0000 7f7e2e3e4640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e280cf450 0x7f7e280ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.364+0000 7f7e2e3e4640 1 -- 172.21.15.77:0/1739986134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20009b30 con 0x7f7e280ce6c0 2023-11-26T07:24:14.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.364+0000 7f7e2e3e4640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e280ce6c0 0x7f7e28151460 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400c7f0 tx=0x7f7e2400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.365+0000 7f7e1effd640 1 -- 172.21.15.77:0/1739986134 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24007820 con 0x7f7e280ce6c0 2023-11-26T07:24:14.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.365+0000 7f7e1effd640 1 -- 172.21.15.77:0/1739986134 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e24007980 con 0x7f7e280ce6c0 2023-11-26T07:24:14.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.365+0000 7f7e1effd640 1 -- 172.21.15.77:0/1739986134 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24007d10 con 0x7f7e280ce6c0 2023-11-26T07:24:14.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.365+0000 7f7e30648640 1 -- 172.21.15.77:0/1739986134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e28159a40 con 0x7f7e280ce6c0 2023-11-26T07:24:14.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.365+0000 7f7e30648640 1 -- 172.21.15.77:0/1739986134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e281519a0 con 0x7f7e280ce6c0 2023-11-26T07:24:14.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.366+0000 7f7e30648640 1 -- 172.21.15.77:0/1739986134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e28067470 con 0x7f7e280ce6c0 2023-11-26T07:24:14.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.367+0000 7f7e1effd640 1 -- 172.21.15.77:0/1739986134 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f7e240113f0 con 0x7f7e280ce6c0 2023-11-26T07:24:14.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.368+0000 7f7e1effd640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e0c06b8f0 0x7f7e0c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.368+0000 7f7e1effd640 1 -- 172.21.15.77:0/1739986134 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7e240882e0 con 0x7f7e280ce6c0 2023-11-26T07:24:14.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.368+0000 7f7e2dbe3640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e0c06b8f0 0x7f7e0c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.369+0000 7f7e2dbe3640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e0c06b8f0 0x7f7e0c06ddb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7e281f6820 tx=0x7f7e180079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.372+0000 7f7e1effd640 1 -- 172.21.15.77:0/1739986134 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e24054de0 con 0x7f7e280ce6c0 2023-11-26T07:24:14.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.562+0000 7f7e30648640 1 -- 172.21.15.77:0/1739986134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e280cd730 con 0x7f7e280ce6c0 2023-11-26T07:24:14.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.565+0000 7f7e1effd640 1 -- 172.21.15.77:0/1739986134 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16642 (secure 0 0 0) 0x7f7e2401f090 con 0x7f7e280ce6c0 2023-11-26T07:24:14.566 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:14.567 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":77,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:23:18.390879+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:02.276143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:03.495874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:24:14.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.567+0000 7f7e30648640 1 -- 172.21.15.77:0/1739986134 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e0c06b8f0 msgr2=0x7f7e0c06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.567+0000 7f7e30648640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e0c06b8f0 0x7f7e0c06ddb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7e281f6820 tx=0x7f7e180079b0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.567+0000 7f7e30648640 1 -- 172.21.15.77:0/1739986134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e280ce6c0 msgr2=0x7f7e28151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.567+0000 7f7e30648640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e280ce6c0 0x7f7e28151460 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400c7f0 tx=0x7f7e2400ccb0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.568+0000 7f7e30648640 1 -- 172.21.15.77:0/1739986134 shutdown_connections 2023-11-26T07:24:14.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.568+0000 7f7e30648640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f7e0c06b8f0 0x7f7e0c06ddb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.568+0000 7f7e30648640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e2815c7f0 0x7f7e281f68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.568+0000 7f7e30648640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e280cf450 0x7f7e280ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.568+0000 7f7e30648640 1 --2- 172.21.15.77:0/1739986134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e280ce6c0 0x7f7e28151460 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.568+0000 7f7e30648640 1 -- 172.21.15.77:0/1739986134 >> 172.21.15.77:0/1739986134 conn(0x7f7e2806a920 msgr2=0x7f7e280cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:14.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.568+0000 7f7e30648640 1 -- 172.21.15.77:0/1739986134 shutdown_connections 2023-11-26T07:24:14.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.568+0000 7f7e30648640 1 -- 172.21.15.77:0/1739986134 wait complete. 2023-11-26T07:24:14.587 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:24:14.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.790+0000 7f3cad961640 1 Processor -- start 2023-11-26T07:24:14.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.790+0000 7f3cad961640 1 -- start start 2023-11-26T07:24:14.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.791+0000 7f3cad961640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3ca815d720 0x7f3ca80d3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.791+0000 7f3cad961640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ca80d3870 0x7f3ca80b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.791+0000 7f3cad961640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ca80b1400 0x7f3ca80b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.791+0000 7f3cad961640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca80d3d20 con 0x7f3ca80b1400 2023-11-26T07:24:14.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.791+0000 7f3cad961640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca815db00 con 0x7f3ca815d720 2023-11-26T07:24:14.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.791+0000 7f3cad961640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80d0ce0 con 0x7f3ca80d3870 2023-11-26T07:24:14.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.792+0000 7f3ca77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ca80b1400 0x7f3ca80b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.792+0000 7f3ca77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ca80b1400 0x7f3ca80b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40368/0 (socket says 172.21.15.77:40368) 2023-11-26T07:24:14.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.792+0000 7f3ca77fe640 1 -- 172.21.15.77:0/3270067476 learned_addr learned my addr 172.21.15.77:0/3270067476 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:14.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.792+0000 7f3ca67fc640 1 --2- 172.21.15.77:0/3270067476 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ca80d3870 0x7f3ca80b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.792+0000 7f3ca6ffd640 1 --2- 172.21.15.77:0/3270067476 >> v2:172.21.15.159:3300/0 conn(0x7f3ca815d720 0x7f3ca80d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.792+0000 7f3ca77fe640 1 -- 172.21.15.77:0/3270067476 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ca80d3870 msgr2=0x7f3ca80b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:14.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.792+0000 7f3ca77fe640 1 --2- 172.21.15.77:0/3270067476 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ca80d3870 0x7f3ca80b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.792+0000 7f3ca77fe640 1 -- 172.21.15.77:0/3270067476 >> v2:172.21.15.159:3300/0 conn(0x7f3ca815d720 msgr2=0x7f3ca80d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:14.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.792+0000 7f3ca77fe640 1 --2- 172.21.15.77:0/3270067476 >> v2:172.21.15.159:3300/0 conn(0x7f3ca815d720 0x7f3ca80d3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.792+0000 7f3ca77fe640 1 -- 172.21.15.77:0/3270067476 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca806d400 con 0x7f3ca80b1400 2023-11-26T07:24:14.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.792+0000 7f3ca6ffd640 1 --2- 172.21.15.77:0/3270067476 >> v2:172.21.15.159:3300/0 conn(0x7f3ca815d720 0x7f3ca80d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:14.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.793+0000 7f3ca77fe640 1 --2- 172.21.15.77:0/3270067476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca80b1400 0x7f3ca80b1870 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f3ca808b890 tx=0x7f3ca002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98fae8809dbcd06 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3ca5ffb640 1 -- 172.21.15.77:0/3270067476 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00317e0 con 0x7f3ca80b1400 2023-11-26T07:24:14.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3ca5ffb640 1 -- 172.21.15.77:0/3270067476 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca0031940 con 0x7f3ca80b1400 2023-11-26T07:24:14.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3ca5ffb640 1 -- 172.21.15.77:0/3270067476 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0031cd0 con 0x7f3ca80b1400 2023-11-26T07:24:14.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3cad961640 1 -- 172.21.15.77:0/3270067476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca80b1400 msgr2=0x7f3ca80b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3cad961640 1 --2- 172.21.15.77:0/3270067476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca80b1400 0x7f3ca80b1870 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f3ca808b890 tx=0x7f3ca002b880 comp rx=0 tx=0).stop 2023-11-26T07:24:14.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3cad961640 1 -- 172.21.15.77:0/3270067476 shutdown_connections 2023-11-26T07:24:14.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3cad961640 1 --2- 172.21.15.77:0/3270067476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca80b1400 0x7f3ca80b1870 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3cad961640 1 --2- 172.21.15.77:0/3270067476 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ca80d3870 0x7f3ca80b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3cad961640 1 --2- 172.21.15.77:0/3270067476 >> v2:172.21.15.159:3300/0 conn(0x7f3ca815d720 0x7f3ca80d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3cad961640 1 -- 172.21.15.77:0/3270067476 >> 172.21.15.77:0/3270067476 conn(0x7f3ca808af60 msgr2=0x7f3ca809c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:14.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3cad961640 1 -- 172.21.15.77:0/3270067476 shutdown_connections 2023-11-26T07:24:14.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.794+0000 7f3cad961640 1 -- 172.21.15.77:0/3270067476 wait complete. 2023-11-26T07:24:14.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.796+0000 7f3cad961640 1 Processor -- start 2023-11-26T07:24:14.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.796+0000 7f3cad961640 1 -- start start 2023-11-26T07:24:14.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.797+0000 7f3cad961640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca80b1400 0x7f3ca8146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.797+0000 7f3cad961640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ca80d3870 0x7f3ca8146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.797+0000 7f3cad961640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca815d720 0x7f3ca8147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.797+0000 7f3cad961640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca81f3100 con 0x7f3ca815d720 2023-11-26T07:24:14.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.797+0000 7f3cad961640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80c7c20 con 0x7f3ca80b1400 2023-11-26T07:24:14.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.797+0000 7f3cad961640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80c7f00 con 0x7f3ca80d3870 2023-11-26T07:24:14.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca815d720 0x7f3ca8147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca815d720 0x7f3ca8147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40380/0 (socket says 172.21.15.77:40380) 2023-11-26T07:24:14.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca77fe640 1 -- 172.21.15.77:0/3726346322 learned_addr learned my addr 172.21.15.77:0/3726346322 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:14.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca6ffd640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca80b1400 0x7f3ca8146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca67fc640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ca80d3870 0x7f3ca8146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca77fe640 1 -- 172.21.15.77:0/3726346322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ca80d3870 msgr2=0x7f3ca8146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca77fe640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ca80d3870 0x7f3ca8146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca77fe640 1 -- 172.21.15.77:0/3726346322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca80b1400 msgr2=0x7f3ca8146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca77fe640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca80b1400 0x7f3ca8146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca77fe640 1 -- 172.21.15.77:0/3726346322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca00094d0 con 0x7f3ca815d720 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca6ffd640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca80b1400 0x7f3ca8146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.798+0000 7f3ca77fe640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca815d720 0x7f3ca8147090 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00090b0 tx=0x7f3ca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.799+0000 7f3c9ffff640 1 -- 172.21.15.77:0/3726346322 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0032880 con 0x7f3ca815d720 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.799+0000 7f3c9ffff640 1 -- 172.21.15.77:0/3726346322 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca0032a00 con 0x7f3ca815d720 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.799+0000 7f3c9ffff640 1 -- 172.21.15.77:0/3726346322 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0032db0 con 0x7f3ca815d720 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.799+0000 7f3cad961640 1 -- 172.21.15.77:0/3726346322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca80c81e0 con 0x7f3ca815d720 2023-11-26T07:24:14.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.799+0000 7f3cad961640 1 -- 172.21.15.77:0/3726346322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca80c87a0 con 0x7f3ca815d720 2023-11-26T07:24:14.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.800+0000 7f3cad961640 1 -- 172.21.15.77:0/3726346322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca80b4cc0 con 0x7f3ca815d720 2023-11-26T07:24:14.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.801+0000 7f3c9ffff640 1 -- 172.21.15.77:0/3726346322 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f3ca004d3f0 con 0x7f3ca815d720 2023-11-26T07:24:14.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.802+0000 7f3c9ffff640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c8806b8f0 0x7f3c8806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.802+0000 7f3c9ffff640 1 -- 172.21.15.77:0/3726346322 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3ca00a9cb0 con 0x7f3ca815d720 2023-11-26T07:24:14.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.802+0000 7f3ca6ffd640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c8806b8f0 0x7f3c8806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.803+0000 7f3ca6ffd640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c8806b8f0 0x7f3c8806ddb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3c98007f70 tx=0x7f3c980074c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:14.806+0000 7f3c9ffff640 1 -- 172.21.15.77:0/3726346322 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3ca0076870 con 0x7f3ca815d720 2023-11-26T07:24:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.037+0000 7f3cad961640 1 -- 172.21.15.77:0/3726346322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3ca804e8b0 con 0x7f3ca815d720 2023-11-26T07:24:15.039 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-26T07:24:15.038+0000 7f36d32f9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:24:15.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.041+0000 7f3c9ffff640 1 -- 172.21.15.77:0/3726346322 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v46) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3ca0079e90 con 0x7f3ca815d720 2023-11-26T07:24:15.043 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:24:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.045+0000 7f3cad961640 1 -- 172.21.15.77:0/3726346322 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c8806b8f0 msgr2=0x7f3c8806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.045+0000 7f3cad961640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c8806b8f0 0x7f3c8806ddb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3c98007f70 tx=0x7f3c980074c0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.046+0000 7f3cad961640 1 -- 172.21.15.77:0/3726346322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca815d720 msgr2=0x7f3ca8147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.046+0000 7f3cad961640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca815d720 0x7f3ca8147090 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00090b0 tx=0x7f3ca00046c0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.046+0000 7f3cad961640 1 -- 172.21.15.77:0/3726346322 shutdown_connections 2023-11-26T07:24:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.046+0000 7f3cad961640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f3c8806b8f0 0x7f3c8806ddb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.046+0000 7f3cad961640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca815d720 0x7f3ca8147090 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.046+0000 7f3cad961640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ca80d3870 0x7f3ca8146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.046+0000 7f3cad961640 1 --2- 172.21.15.77:0/3726346322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ca80b1400 0x7f3ca8146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.046+0000 7f3cad961640 1 -- 172.21.15.77:0/3726346322 >> 172.21.15.77:0/3726346322 conn(0x7f3ca808af60 msgr2=0x7f3ca806cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.046+0000 7f3cad961640 1 -- 172.21.15.77:0/3726346322 shutdown_connections 2023-11-26T07:24:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.047+0000 7f3cad961640 1 -- 172.21.15.77:0/3726346322 wait complete. 2023-11-26T07:24:15.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:24:15.176 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-26T07:24:15.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.268+0000 7ff995f16640 1 Processor -- start 2023-11-26T07:24:15.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.268+0000 7ff995f16640 1 -- start start 2023-11-26T07:24:15.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff995f16640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff990161060 0x7ff990161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff995f16640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff99006b6c0 0x7ff99015e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff995f16640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99006dcf0 con 0x7ff9900b3330 2023-11-26T07:24:15.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff995f16640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99006ec10 con 0x7ff990161060 2023-11-26T07:24:15.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff995f16640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff990161980 con 0x7ff99006b6c0 2023-11-26T07:24:15.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff98f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff990161060 0x7ff990161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff98f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff990161060 0x7ff990161440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40394/0 (socket says 172.21.15.77:40394) 2023-11-26T07:24:15.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff98f7fe640 1 -- 172.21.15.77:0/1429328958 learned_addr learned my addr 172.21.15.77:0/1429328958 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:15.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff98f7fe640 1 -- 172.21.15.77:0/1429328958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff99006b6c0 msgr2=0x7ff99015e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:15.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff98ffff640 1 --2- 172.21.15.77:0/1429328958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff99006b6c0 0x7ff99015e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff98f7fe640 1 --2- 172.21.15.77:0/1429328958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff99006b6c0 0x7ff99015e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff98f7fe640 1 -- 172.21.15.77:0/1429328958 >> v1:172.21.15.159:6789/0 conn(0x7ff9900b3330 legacy=0x7ff99015da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:15.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.270+0000 7ff98f7fe640 1 -- 172.21.15.77:0/1429328958 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff990161ec0 con 0x7ff990161060 2023-11-26T07:24:15.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.271+0000 7ff98ffff640 1 --2- 172.21.15.77:0/1429328958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff99006b6c0 0x7ff99015e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:15.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.272+0000 7ff98f7fe640 1 --2- 172.21.15.77:0/1429328958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff990161060 0x7ff990161440 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7ff980009870 tx=0x7ff98002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36aeeb1cd0e088c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.272+0000 7ff98effd640 1 -- 172.21.15.77:0/1429328958 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9800317c0 con 0x7ff990161060 2023-11-26T07:24:15.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.272+0000 7ff98effd640 1 -- 172.21.15.77:0/1429328958 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff980031920 con 0x7ff990161060 2023-11-26T07:24:15.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.272+0000 7ff98effd640 1 -- 172.21.15.77:0/1429328958 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980031cb0 con 0x7ff990161060 2023-11-26T07:24:15.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.272+0000 7ff995f16640 1 -- 172.21.15.77:0/1429328958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff990161060 msgr2=0x7ff990161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.272+0000 7ff995f16640 1 --2- 172.21.15.77:0/1429328958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff990161060 0x7ff990161440 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7ff980009870 tx=0x7ff98002b860 comp rx=0 tx=0).stop 2023-11-26T07:24:15.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.273+0000 7ff995f16640 1 -- 172.21.15.77:0/1429328958 shutdown_connections 2023-11-26T07:24:15.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.273+0000 7ff995f16640 1 --2- 172.21.15.77:0/1429328958 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff99006b6c0 0x7ff99015e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.273+0000 7ff995f16640 1 --2- 172.21.15.77:0/1429328958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff990161060 0x7ff990161440 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.273+0000 7ff995f16640 1 -- 172.21.15.77:0/1429328958 >> 172.21.15.77:0/1429328958 conn(0x7ff9900cf900 msgr2=0x7ff9900cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:15.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.273+0000 7ff995f16640 1 -- 172.21.15.77:0/1429328958 shutdown_connections 2023-11-26T07:24:15.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.273+0000 7ff995f16640 1 -- 172.21.15.77:0/1429328958 wait complete. 2023-11-26T07:24:15.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.274+0000 7ff995f16640 1 Processor -- start 2023-11-26T07:24:15.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.275+0000 7ff995f16640 1 -- start start 2023-11-26T07:24:15.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.275+0000 7ff995f16640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99006b6c0 0x7ff990151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff995f16640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900b3330 0x7ff9900cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff995f16640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff990161060 0x7ff9901532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff995f16640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff990157420 con 0x7ff9900b3330 2023-11-26T07:24:15.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff995f16640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff990156810 con 0x7ff99006b6c0 2023-11-26T07:24:15.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff995f16640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff990156af0 con 0x7ff990161060 2023-11-26T07:24:15.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff987fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900b3330 0x7ff9900cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff987fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900b3330 0x7ff9900cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40402/0 (socket says 172.21.15.77:40402) 2023-11-26T07:24:15.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff987fff640 1 -- 172.21.15.77:0/2102820457 learned_addr learned my addr 172.21.15.77:0/2102820457 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:15.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff98ffff640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff990161060 0x7ff9901532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff98f7fe640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99006b6c0 0x7ff990151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff987fff640 1 -- 172.21.15.77:0/2102820457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff990161060 msgr2=0x7ff9901532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff987fff640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff990161060 0x7ff9901532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff987fff640 1 -- 172.21.15.77:0/2102820457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99006b6c0 msgr2=0x7ff990151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff987fff640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99006b6c0 0x7ff990151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff987fff640 1 -- 172.21.15.77:0/2102820457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9800094d0 con 0x7ff9900b3330 2023-11-26T07:24:15.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.276+0000 7ff98f7fe640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99006b6c0 0x7ff990151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:15.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.277+0000 7ff987fff640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900b3330 0x7ff9900cbb00 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7ff97800b3e0 tx=0x7ff97800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.277+0000 7ff98cff9640 1 -- 172.21.15.77:0/2102820457 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978011830 con 0x7ff9900b3330 2023-11-26T07:24:15.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.277+0000 7ff98cff9640 1 -- 172.21.15.77:0/2102820457 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9780119b0 con 0x7ff9900b3330 2023-11-26T07:24:15.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.277+0000 7ff995f16640 1 -- 172.21.15.77:0/2102820457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff990156dd0 con 0x7ff9900b3330 2023-11-26T07:24:15.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.277+0000 7ff98cff9640 1 -- 172.21.15.77:0/2102820457 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978011d60 con 0x7ff9900b3330 2023-11-26T07:24:15.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.277+0000 7ff995f16640 1 -- 172.21.15.77:0/2102820457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9901e9ad0 con 0x7ff9900b3330 2023-11-26T07:24:15.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.278+0000 7ff995f16640 1 -- 172.21.15.77:0/2102820457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff990067990 con 0x7ff9900b3330 2023-11-26T07:24:15.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.279+0000 7ff98cff9640 1 -- 172.21.15.77:0/2102820457 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7ff97801a410 con 0x7ff9900b3330 2023-11-26T07:24:15.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.280+0000 7ff98cff9640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff97006b920 0x7ff97006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.280+0000 7ff98cff9640 1 -- 172.21.15.77:0/2102820457 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff978087f80 con 0x7ff9900b3330 2023-11-26T07:24:15.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.280+0000 7ff98f7fe640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff97006b920 0x7ff97006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.281+0000 7ff98f7fe640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff97006b920 0x7ff97006dde0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff980036000 tx=0x7ff98003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.285+0000 7ff98cff9640 1 -- 172.21.15.77:0/2102820457 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9780549f0 con 0x7ff9900b3330 2023-11-26T07:24:15.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:15.512+0000 7ff995f16640 1 -- 172.21.15.77:0/2102820457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff9901e9cf0 con 0x7ff9900b3330 2023-11-26T07:24:16.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.045+0000 7ff98cff9640 1 -- 172.21.15.77:0/2102820457 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v47) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff978015020 con 0x7ff9900b3330 2023-11-26T07:24:16.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.049+0000 7ff995f16640 1 -- 172.21.15.77:0/2102820457 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff97006b920 msgr2=0x7ff97006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.049+0000 7ff995f16640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff97006b920 0x7ff97006dde0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff980036000 tx=0x7ff98003d040 comp rx=0 tx=0).stop 2023-11-26T07:24:16.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.049+0000 7ff995f16640 1 -- 172.21.15.77:0/2102820457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900b3330 msgr2=0x7ff9900cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.049+0000 7ff995f16640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900b3330 0x7ff9900cbb00 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7ff97800b3e0 tx=0x7ff97800b8a0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.049+0000 7ff995f16640 1 -- 172.21.15.77:0/2102820457 shutdown_connections 2023-11-26T07:24:16.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.049+0000 7ff995f16640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff97006b920 0x7ff97006dde0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.049+0000 7ff995f16640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff990161060 0x7ff9901532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.049+0000 7ff995f16640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900b3330 0x7ff9900cbb00 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.049+0000 7ff995f16640 1 --2- 172.21.15.77:0/2102820457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99006b6c0 0x7ff990151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.049+0000 7ff995f16640 1 -- 172.21.15.77:0/2102820457 >> 172.21.15.77:0/2102820457 conn(0x7ff9900cf900 msgr2=0x7ff9900734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.050+0000 7ff995f16640 1 -- 172.21.15.77:0/2102820457 shutdown_connections 2023-11-26T07:24:16.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.050+0000 7ff995f16640 1 -- 172.21.15.77:0/2102820457 wait complete. 2023-11-26T07:24:16.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:24:16.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.289+0000 7f19b992e640 1 Processor -- start 2023-11-26T07:24:16.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.289+0000 7f19b992e640 1 -- start start 2023-11-26T07:24:16.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.290+0000 7f19b992e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f19b415d490 0x7f19b40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.290+0000 7f19b992e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f19b40d2780 0x7f19b40b5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.290+0000 7f19b992e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b415d870 con 0x7f19b40b57c0 2023-11-26T07:24:16.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.290+0000 7f19b992e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b40d3010 con 0x7f19b40d2780 2023-11-26T07:24:16.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.290+0000 7f19b992e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b40d22f0 con 0x7f19b415d490 2023-11-26T07:24:16.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.291+0000 7f19b3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f19b40d2780 0x7f19b40b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.291+0000 7f19b3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f19b40d2780 0x7f19b40b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53038/0 (socket says 172.21.15.77:53038) 2023-11-26T07:24:16.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.291+0000 7f19b3fff640 1 -- 172.21.15.77:0/804590681 learned_addr learned my addr 172.21.15.77:0/804590681 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:16.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.291+0000 7f19b3fff640 1 -- 172.21.15.77:0/804590681 >> v2:172.21.15.159:3300/0 conn(0x7f19b415d490 msgr2=0x7f19b40b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:16.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.291+0000 7f19b3fff640 1 --2- 172.21.15.77:0/804590681 >> v2:172.21.15.159:3300/0 conn(0x7f19b415d490 0x7f19b40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.291+0000 7f19b3fff640 1 -- 172.21.15.77:0/804590681 >> v1:172.21.15.159:6789/0 conn(0x7f19b40b57c0 legacy=0x7f19b40d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:16.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.291+0000 7f19b3fff640 1 -- 172.21.15.77:0/804590681 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b40b5bf0 con 0x7f19b40d2780 2023-11-26T07:24:16.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.292+0000 7f19b3fff640 1 --2- 172.21.15.77:0/804590681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b40d2780 0x7f19b40b5280 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f19b40cfd40 tx=0x7f19a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6d5ea65b0d4edc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.293+0000 7f19b37fe640 1 -- 172.21.15.77:0/804590681 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0031870 con 0x7f19b40d2780 2023-11-26T07:24:16.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.293+0000 7f19b37fe640 1 -- 172.21.15.77:0/804590681 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a00319d0 con 0x7f19b40d2780 2023-11-26T07:24:16.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.293+0000 7f19b37fe640 1 -- 172.21.15.77:0/804590681 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0031d60 con 0x7f19b40d2780 2023-11-26T07:24:16.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.293+0000 7f19b992e640 1 -- 172.21.15.77:0/804590681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b40d2780 msgr2=0x7f19b40b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.293+0000 7f19b992e640 1 --2- 172.21.15.77:0/804590681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b40d2780 0x7f19b40b5280 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f19b40cfd40 tx=0x7f19a002b910 comp rx=0 tx=0).stop 2023-11-26T07:24:16.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.293+0000 7f19b992e640 1 -- 172.21.15.77:0/804590681 shutdown_connections 2023-11-26T07:24:16.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.293+0000 7f19b992e640 1 --2- 172.21.15.77:0/804590681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b40d2780 0x7f19b40b5280 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.293+0000 7f19b992e640 1 --2- 172.21.15.77:0/804590681 >> v2:172.21.15.159:3300/0 conn(0x7f19b415d490 0x7f19b40b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.293+0000 7f19b992e640 1 -- 172.21.15.77:0/804590681 >> 172.21.15.77:0/804590681 conn(0x7f19b4061340 msgr2=0x7f19b4061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:16.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.293+0000 7f19b992e640 1 -- 172.21.15.77:0/804590681 shutdown_connections 2023-11-26T07:24:16.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.293+0000 7f19b992e640 1 -- 172.21.15.77:0/804590681 wait complete. 2023-11-26T07:24:16.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.295+0000 7f19b992e640 1 Processor -- start 2023-11-26T07:24:16.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.295+0000 7f19b992e640 1 -- start start 2023-11-26T07:24:16.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.296+0000 7f19b992e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19b40b57c0 0x7f19b4158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.296+0000 7f19b992e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b40d2780 0x7f19b4141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.296+0000 7f19b992e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19b415d490 0x7f19b4155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.296+0000 7f19b992e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b4141dc0 con 0x7f19b40d2780 2023-11-26T07:24:16.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.296+0000 7f19b992e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b4155790 con 0x7f19b40b57c0 2023-11-26T07:24:16.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.296+0000 7f19b992e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b41415d0 con 0x7f19b415d490 2023-11-26T07:24:16.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.297+0000 7f19b3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b40d2780 0x7f19b4141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.297+0000 7f19b3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b40d2780 0x7f19b4141880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53054/0 (socket says 172.21.15.77:53054) 2023-11-26T07:24:16.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.297+0000 7f19b3fff640 1 -- 172.21.15.77:0/469212874 learned_addr learned my addr 172.21.15.77:0/469212874 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:16.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.297+0000 7f19b3fff640 1 -- 172.21.15.77:0/469212874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19b415d490 msgr2=0x7f19b4155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.297+0000 7f19b3fff640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19b415d490 0x7f19b4155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.297+0000 7f19b3fff640 1 -- 172.21.15.77:0/469212874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19b40b57c0 msgr2=0x7f19b4158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.297+0000 7f19b892c640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19b40b57c0 0x7f19b4158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.297+0000 7f19b3fff640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19b40b57c0 0x7f19b4158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.297+0000 7f19b3fff640 1 -- 172.21.15.77:0/469212874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00094d0 con 0x7f19b40d2780 2023-11-26T07:24:16.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.297+0000 7f19b892c640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19b40b57c0 0x7f19b4158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:16.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.297+0000 7f19b3fff640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b40d2780 0x7f19b4141880 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f19a002b950 tx=0x7f19a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.298+0000 7f19b17fa640 1 -- 172.21.15.77:0/469212874 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a003ad10 con 0x7f19b40d2780 2023-11-26T07:24:16.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.298+0000 7f19b17fa640 1 -- 172.21.15.77:0/469212874 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a003ae70 con 0x7f19b40d2780 2023-11-26T07:24:16.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.298+0000 7f19b17fa640 1 -- 172.21.15.77:0/469212874 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0044610 con 0x7f19b40d2780 2023-11-26T07:24:16.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.298+0000 7f19b992e640 1 -- 172.21.15.77:0/469212874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b40ca890 con 0x7f19b40d2780 2023-11-26T07:24:16.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.298+0000 7f19b992e640 1 -- 172.21.15.77:0/469212874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b40cae10 con 0x7f19b40d2780 2023-11-26T07:24:16.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.299+0000 7f19b992e640 1 -- 172.21.15.77:0/469212874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b404e840 con 0x7f19b40d2780 2023-11-26T07:24:16.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.300+0000 7f19b17fa640 1 -- 172.21.15.77:0/469212874 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f19a0044770 con 0x7f19b40d2780 2023-11-26T07:24:16.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.301+0000 7f19b17fa640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f199806b8f0 0x7f199806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.301+0000 7f19b17fa640 1 -- 172.21.15.77:0/469212874 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f19a002d040 con 0x7f19b40d2780 2023-11-26T07:24:16.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.301+0000 7f19b892c640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f199806b8f0 0x7f199806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.302+0000 7f19b892c640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f199806b8f0 0x7f199806ddb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f19a800a870 tx=0x7f19a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.306+0000 7f19b17fa640 1 -- 172.21.15.77:0/469212874 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19a0077360 con 0x7f19b40d2780 2023-11-26T07:24:16.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:16.498+0000 7f19b992e640 1 -- 172.21.15.77:0/469212874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f19b4061c10 con 0x7f19b40d2780 2023-11-26T07:24:17.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.058+0000 7f19b17fa640 1 -- 172.21.15.77:0/469212874 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) v1 ==== 181+0+0 (secure 0 0 0) 0x7f19a007a980 con 0x7f19b40d2780 2023-11-26T07:24:17.060 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:24:17.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.063+0000 7f19b992e640 1 -- 172.21.15.77:0/469212874 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f199806b8f0 msgr2=0x7f199806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.063+0000 7f19b992e640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f199806b8f0 0x7f199806ddb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f19a800a870 tx=0x7f19a8008040 comp rx=0 tx=0).stop 2023-11-26T07:24:17.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.063+0000 7f19b992e640 1 -- 172.21.15.77:0/469212874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b40d2780 msgr2=0x7f19b4141880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.063+0000 7f19b992e640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b40d2780 0x7f19b4141880 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f19a002b950 tx=0x7f19a00046c0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.064+0000 7f19b992e640 1 -- 172.21.15.77:0/469212874 shutdown_connections 2023-11-26T07:24:17.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.064+0000 7f19b992e640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f199806b8f0 0x7f199806ddb0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.064+0000 7f19b992e640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19b415d490 0x7f19b4155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.064+0000 7f19b992e640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b40d2780 0x7f19b4141880 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.064+0000 7f19b992e640 1 --2- 172.21.15.77:0/469212874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19b40b57c0 0x7f19b4158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.064+0000 7f19b992e640 1 -- 172.21.15.77:0/469212874 >> 172.21.15.77:0/469212874 conn(0x7f19b4061340 msgr2=0x7f19b40c86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:17.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.064+0000 7f19b992e640 1 -- 172.21.15.77:0/469212874 shutdown_connections 2023-11-26T07:24:17.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.064+0000 7f19b992e640 1 -- 172.21.15.77:0/469212874 wait complete. 2023-11-26T07:24:17.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:24:17.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.299+0000 7f5839fba640 1 Processor -- start 2023-11-26T07:24:17.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.299+0000 7f5839fba640 1 -- start start 2023-11-26T07:24:17.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.301+0000 7f5839fba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f58341431f0 0x7f583415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.301+0000 7f5839fba640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f583406ddb0 0x7f5834071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.301+0000 7f5839fba640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583415ec20 con 0x7f58340b2ad0 2023-11-26T07:24:17.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.301+0000 7f5839fba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58340b4fd0 con 0x7f58341431f0 2023-11-26T07:24:17.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.301+0000 7f5839fba640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5834143c10 con 0x7f583406ddb0 2023-11-26T07:24:17.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.301+0000 7f5838fb8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f58341431f0 0x7f583415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.301+0000 7f5838fb8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f58341431f0 0x7f583415e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53058/0 (socket says 172.21.15.77:53058) 2023-11-26T07:24:17.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.301+0000 7f5838fb8640 1 -- 172.21.15.77:0/2241993412 learned_addr learned my addr 172.21.15.77:0/2241993412 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:17.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.302+0000 7f5838fb8640 1 -- 172.21.15.77:0/2241993412 >> v2:172.21.15.159:3300/0 conn(0x7f583406ddb0 msgr2=0x7f5834071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:17.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.302+0000 7f5838fb8640 1 --2- 172.21.15.77:0/2241993412 >> v2:172.21.15.159:3300/0 conn(0x7f583406ddb0 0x7f5834071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.302+0000 7f5838fb8640 1 -- 172.21.15.77:0/2241993412 >> v1:172.21.15.159:6789/0 conn(0x7f58340b2ad0 legacy=0x7f583406d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:17.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.302+0000 7f5838fb8640 1 -- 172.21.15.77:0/2241993412 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58340705b0 con 0x7f58341431f0 2023-11-26T07:24:17.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.303+0000 7f5838fb8640 1 --2- 172.21.15.77:0/2241993412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58341431f0 0x7f583415e6e0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f58340b5110 tx=0x7f582802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97504a1bd35ac60 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.303+0000 7f58337fe640 1 -- 172.21.15.77:0/2241993412 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280317e0 con 0x7f58341431f0 2023-11-26T07:24:17.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.303+0000 7f58337fe640 1 -- 172.21.15.77:0/2241993412 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5828031940 con 0x7f58341431f0 2023-11-26T07:24:17.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.303+0000 7f58337fe640 1 -- 172.21.15.77:0/2241993412 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5828031cd0 con 0x7f58341431f0 2023-11-26T07:24:17.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.304+0000 7f5839fba640 1 -- 172.21.15.77:0/2241993412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58341431f0 msgr2=0x7f583415e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.304+0000 7f5839fba640 1 --2- 172.21.15.77:0/2241993412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58341431f0 0x7f583415e6e0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f58340b5110 tx=0x7f582802b880 comp rx=0 tx=0).stop 2023-11-26T07:24:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.304+0000 7f5839fba640 1 -- 172.21.15.77:0/2241993412 shutdown_connections 2023-11-26T07:24:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.304+0000 7f5839fba640 1 --2- 172.21.15.77:0/2241993412 >> v2:172.21.15.159:3300/0 conn(0x7f583406ddb0 0x7f5834071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.304+0000 7f5839fba640 1 --2- 172.21.15.77:0/2241993412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58341431f0 0x7f583415e6e0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.304+0000 7f5839fba640 1 -- 172.21.15.77:0/2241993412 >> 172.21.15.77:0/2241993412 conn(0x7f58340cb8a0 msgr2=0x7f58340cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.304+0000 7f5839fba640 1 -- 172.21.15.77:0/2241993412 shutdown_connections 2023-11-26T07:24:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.304+0000 7f5839fba640 1 -- 172.21.15.77:0/2241993412 wait complete. 2023-11-26T07:24:17.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.306+0000 7f5839fba640 1 Processor -- start 2023-11-26T07:24:17.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.306+0000 7f5839fba640 1 -- start start 2023-11-26T07:24:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.307+0000 7f5839fba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f583406ddb0 0x7f58341f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5839fba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58340b2ad0 0x7f583413a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5839fba640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58341431f0 0x7f58340cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5839fba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58341f4620 con 0x7f583406ddb0 2023-11-26T07:24:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5839fba640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583413a570 con 0x7f58340b2ad0 2023-11-26T07:24:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5839fba640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58341392b0 con 0x7f58341431f0 2023-11-26T07:24:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5838fb8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f583406ddb0 0x7f58341f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5838fb8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f583406ddb0 0x7f58341f2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53068/0 (socket says 172.21.15.77:53068) 2023-11-26T07:24:17.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5838fb8640 1 -- 172.21.15.77:0/4031575534 learned_addr learned my addr 172.21.15.77:0/4031575534 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:17.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5838fb8640 1 -- 172.21.15.77:0/4031575534 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58341431f0 msgr2=0x7f58340cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5838fb8640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58341431f0 0x7f58340cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5833fff640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58340b2ad0 0x7f583413a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5838fb8640 1 -- 172.21.15.77:0/4031575534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58340b2ad0 msgr2=0x7f583413a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5838fb8640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58340b2ad0 0x7f583413a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5838fb8640 1 -- 172.21.15.77:0/4031575534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280094d0 con 0x7f583406ddb0 2023-11-26T07:24:17.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.308+0000 7f5833fff640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58340b2ad0 0x7f583413a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:17.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.309+0000 7f5838fb8640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f583406ddb0 0x7f58341f2ef0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f5828000c00 tx=0x7f58280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.309+0000 7f58317fa640 1 -- 172.21.15.77:0/4031575534 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5828032880 con 0x7f583406ddb0 2023-11-26T07:24:17.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.309+0000 7f58317fa640 1 -- 172.21.15.77:0/4031575534 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58280329e0 con 0x7f583406ddb0 2023-11-26T07:24:17.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.309+0000 7f5839fba640 1 -- 172.21.15.77:0/4031575534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58341f4340 con 0x7f583406ddb0 2023-11-26T07:24:17.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.309+0000 7f58317fa640 1 -- 172.21.15.77:0/4031575534 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5828032d90 con 0x7f583406ddb0 2023-11-26T07:24:17.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.309+0000 7f5839fba640 1 -- 172.21.15.77:0/4031575534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5834139830 con 0x7f583406ddb0 2023-11-26T07:24:17.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.310+0000 7f5839fba640 1 -- 172.21.15.77:0/4031575534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5834067990 con 0x7f583406ddb0 2023-11-26T07:24:17.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.311+0000 7f58317fa640 1 -- 172.21.15.77:0/4031575534 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f582804d3f0 con 0x7f583406ddb0 2023-11-26T07:24:17.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.313+0000 7f58317fa640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f581806b8f0 0x7f581806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.313+0000 7f58317fa640 1 -- 172.21.15.77:0/4031575534 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f58280a9ef0 con 0x7f583406ddb0 2023-11-26T07:24:17.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.313+0000 7f5833fff640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f581806b8f0 0x7f581806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.314+0000 7f5833fff640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f581806b8f0 0x7f581806ddb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5834142710 tx=0x7f5820009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.317+0000 7f58317fa640 1 -- 172.21.15.77:0/4031575534 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f58280769f0 con 0x7f583406ddb0 2023-11-26T07:24:17.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:17.506+0000 7f5839fba640 1 -- 172.21.15.77:0/4031575534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5834071130 con 0x7f583406ddb0 2023-11-26T07:24:18.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.074+0000 7f58317fa640 1 -- 172.21.15.77:0/4031575534 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5834071130 con 0x7f583406ddb0 2023-11-26T07:24:18.075 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-11-26T07:24:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.077+0000 7f5839fba640 1 -- 172.21.15.77:0/4031575534 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f581806b8f0 msgr2=0x7f581806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.077+0000 7f5839fba640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f581806b8f0 0x7f581806ddb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5834142710 tx=0x7f5820009040 comp rx=0 tx=0).stop 2023-11-26T07:24:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.077+0000 7f5839fba640 1 -- 172.21.15.77:0/4031575534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f583406ddb0 msgr2=0x7f58341f2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.077+0000 7f5839fba640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f583406ddb0 0x7f58341f2ef0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f5828000c00 tx=0x7f58280046c0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.079+0000 7f5839fba640 1 -- 172.21.15.77:0/4031575534 shutdown_connections 2023-11-26T07:24:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.079+0000 7f5839fba640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f581806b8f0 0x7f581806ddb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.079+0000 7f5839fba640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58341431f0 0x7f58340cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.079+0000 7f5839fba640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58340b2ad0 0x7f583413a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.079+0000 7f5839fba640 1 --2- 172.21.15.77:0/4031575534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f583406ddb0 0x7f58341f2ef0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.079+0000 7f5839fba640 1 -- 172.21.15.77:0/4031575534 >> 172.21.15.77:0/4031575534 conn(0x7f58340cb8a0 msgr2=0x7f58341427c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.080+0000 7f5839fba640 1 -- 172.21.15.77:0/4031575534 shutdown_connections 2023-11-26T07:24:18.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.080+0000 7f5839fba640 1 -- 172.21.15.77:0/4031575534 wait complete. 2023-11-26T07:24:18.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:24:18.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.295+0000 7f36c7953640 1 Processor -- start 2023-11-26T07:24:18.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.295+0000 7f36c7953640 1 -- start start 2023-11-26T07:24:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.296+0000 7f36c7953640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f36c015b440 0x7f36c00cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.296+0000 7f36c7953640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00c59b0 0x7f36c006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.296+0000 7f36c7953640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c015eea0 con 0x7f36c00cbf20 2023-11-26T07:24:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.296+0000 7f36c7953640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c00c5e00 con 0x7f36c015b440 2023-11-26T07:24:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.296+0000 7f36c7953640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c00cc3d0 con 0x7f36c00c59b0 2023-11-26T07:24:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.297+0000 7f36c5ef0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00c59b0 0x7f36c006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.297+0000 7f36c5ef0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00c59b0 0x7f36c006c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:32878/0 (socket says 172.21.15.77:32878) 2023-11-26T07:24:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.297+0000 7f36c5ef0640 1 -- 172.21.15.77:0/3579581437 learned_addr learned my addr 172.21.15.77:0/3579581437 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.297+0000 7f36c56ef640 1 --2- 172.21.15.77:0/3579581437 >> v2:172.21.15.159:3300/0 conn(0x7f36c015b440 0x7f36c00cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.298+0000 7f36c5ef0640 1 -- 172.21.15.77:0/3579581437 >> v2:172.21.15.159:3300/0 conn(0x7f36c015b440 msgr2=0x7f36c00cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.298+0000 7f36c5ef0640 1 --2- 172.21.15.77:0/3579581437 >> v2:172.21.15.159:3300/0 conn(0x7f36c015b440 0x7f36c00cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.298+0000 7f36c5ef0640 1 -- 172.21.15.77:0/3579581437 >> v1:172.21.15.159:6789/0 conn(0x7f36c00cbf20 legacy=0x7f36c00c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.298+0000 7f36c5ef0640 1 -- 172.21.15.77:0/3579581437 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c00abf30 con 0x7f36c00c59b0 2023-11-26T07:24:18.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.300+0000 7f36c5ef0640 1 --2- 172.21.15.77:0/3579581437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00c59b0 0x7f36c006c5f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009e50 tx=0x7f36b802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a99f6e761d9f0b4a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.300+0000 7f36b7fff640 1 -- 172.21.15.77:0/3579581437 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b802ca80 con 0x7f36c00c59b0 2023-11-26T07:24:18.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.300+0000 7f36b7fff640 1 -- 172.21.15.77:0/3579581437 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b802cbe0 con 0x7f36c00c59b0 2023-11-26T07:24:18.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.300+0000 7f36b7fff640 1 -- 172.21.15.77:0/3579581437 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b80343f0 con 0x7f36c00c59b0 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.301+0000 7f36c7953640 1 -- 172.21.15.77:0/3579581437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00c59b0 msgr2=0x7f36c006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.301+0000 7f36c7953640 1 --2- 172.21.15.77:0/3579581437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00c59b0 0x7f36c006c5f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009e50 tx=0x7f36b802bee0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.301+0000 7f36c7953640 1 -- 172.21.15.77:0/3579581437 shutdown_connections 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.301+0000 7f36c7953640 1 --2- 172.21.15.77:0/3579581437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00c59b0 0x7f36c006c5f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.301+0000 7f36c7953640 1 --2- 172.21.15.77:0/3579581437 >> v2:172.21.15.159:3300/0 conn(0x7f36c015b440 0x7f36c00cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.301+0000 7f36c7953640 1 -- 172.21.15.77:0/3579581437 >> 172.21.15.77:0/3579581437 conn(0x7f36c00b0c50 msgr2=0x7f36c00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.301+0000 7f36c7953640 1 -- 172.21.15.77:0/3579581437 shutdown_connections 2023-11-26T07:24:18.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.301+0000 7f36c7953640 1 -- 172.21.15.77:0/3579581437 wait complete. 2023-11-26T07:24:18.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.303+0000 7f36c7953640 1 Processor -- start 2023-11-26T07:24:18.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.303+0000 7f36c7953640 1 -- start start 2023-11-26T07:24:18.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.304+0000 7f36c7953640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36c00c59b0 0x7f36c01564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.304+0000 7f36c7953640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00cbf20 0x7f36c01538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.304+0000 7f36c7953640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015b440 0x7f36c009a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.304+0000 7f36c7953640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c0153df0 con 0x7f36c015b440 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.304+0000 7f36c7953640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c009ca50 con 0x7f36c00c59b0 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.304+0000 7f36c7953640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c015a9d0 con 0x7f36c00cbf20 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.304+0000 7f36c5ef0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015b440 0x7f36c009a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.304+0000 7f36c5ef0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015b440 0x7f36c009a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53076/0 (socket says 172.21.15.77:53076) 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.304+0000 7f36c5ef0640 1 -- 172.21.15.77:0/2158916309 learned_addr learned my addr 172.21.15.77:0/2158916309 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.304+0000 7f36c4eee640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00cbf20 0x7f36c01538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36c5ef0640 1 -- 172.21.15.77:0/2158916309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00cbf20 msgr2=0x7f36c01538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36c5ef0640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00cbf20 0x7f36c01538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36c5ef0640 1 -- 172.21.15.77:0/2158916309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36c00c59b0 msgr2=0x7f36c01564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36c56ef640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36c00c59b0 0x7f36c01564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36c5ef0640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36c00c59b0 0x7f36c01564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36c5ef0640 1 -- 172.21.15.77:0/2158916309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b8009b30 con 0x7f36c015b440 2023-11-26T07:24:18.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36c56ef640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36c00c59b0 0x7f36c01564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:18.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36c5ef0640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015b440 0x7f36c009a970 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f36b8036040 tx=0x7f36b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36b5ffb640 1 -- 172.21.15.77:0/2158916309 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8009510 con 0x7f36c015b440 2023-11-26T07:24:18.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36b5ffb640 1 -- 172.21.15.77:0/2158916309 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b803e450 con 0x7f36c015b440 2023-11-26T07:24:18.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36b5ffb640 1 -- 172.21.15.77:0/2158916309 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b803e800 con 0x7f36c015b440 2023-11-26T07:24:18.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.305+0000 7f36c7953640 1 -- 172.21.15.77:0/2158916309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c0154230 con 0x7f36c015b440 2023-11-26T07:24:18.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.306+0000 7f36c7953640 1 -- 172.21.15.77:0/2158916309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c0159c10 con 0x7f36c015b440 2023-11-26T07:24:18.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.307+0000 7f36c7953640 1 -- 172.21.15.77:0/2158916309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c004e8b0 con 0x7f36c015b440 2023-11-26T07:24:18.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.307+0000 7f36b5ffb640 1 -- 172.21.15.77:0/2158916309 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f36b802cd50 con 0x7f36c015b440 2023-11-26T07:24:18.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.308+0000 7f36b5ffb640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a406b8f0 0x7f36a406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.308+0000 7f36b5ffb640 1 -- 172.21.15.77:0/2158916309 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f36b80aa9a0 con 0x7f36c015b440 2023-11-26T07:24:18.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.309+0000 7f36c56ef640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a406b8f0 0x7f36a406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.309+0000 7f36c56ef640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a406b8f0 0x7f36a406ddb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009a20 tx=0x7f36bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.313+0000 7f36b5ffb640 1 -- 172.21.15.77:0/2158916309 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36b8077500 con 0x7f36c015b440 2023-11-26T07:24:18.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.500+0000 7f36c7953640 1 -- 172.21.15.77:0/2158916309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f36c006dc80 con 0x7f36c015b440 2023-11-26T07:24:18.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.506+0000 7f36b5ffb640 1 -- 172.21.15.77:0/2158916309 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v24) v1 ==== 115+0+0 (secure 0 0 0) 0x7f36b807ab20 con 0x7f36c015b440 2023-11-26T07:24:18.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.510+0000 7f36c7953640 1 -- 172.21.15.77:0/2158916309 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a406b8f0 msgr2=0x7f36a406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.510+0000 7f36c7953640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a406b8f0 0x7f36a406ddb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009a20 tx=0x7f36bc008040 comp rx=0 tx=0).stop 2023-11-26T07:24:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.510+0000 7f36c7953640 1 -- 172.21.15.77:0/2158916309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015b440 msgr2=0x7f36c009a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.510+0000 7f36c7953640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015b440 0x7f36c009a970 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f36b8036040 tx=0x7f36b8004a40 comp rx=0 tx=0).stop 2023-11-26T07:24:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.510+0000 7f36c7953640 1 -- 172.21.15.77:0/2158916309 shutdown_connections 2023-11-26T07:24:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.510+0000 7f36c7953640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f36a406b8f0 0x7f36a406ddb0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.510+0000 7f36c7953640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36c015b440 0x7f36c009a970 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.510+0000 7f36c7953640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36c00cbf20 0x7f36c01538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.510+0000 7f36c7953640 1 --2- 172.21.15.77:0/2158916309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36c00c59b0 0x7f36c01564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.510+0000 7f36c7953640 1 -- 172.21.15.77:0/2158916309 >> 172.21.15.77:0/2158916309 conn(0x7f36c00b0c50 msgr2=0x7f36c006cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.511+0000 7f36c7953640 1 -- 172.21.15.77:0/2158916309 shutdown_connections 2023-11-26T07:24:18.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.511+0000 7f36c7953640 1 -- 172.21.15.77:0/2158916309 wait complete. 2023-11-26T07:24:18.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:24:18.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.729+0000 7f04a181c640 1 Processor -- start 2023-11-26T07:24:18.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.730+0000 7f04a181c640 1 -- start start 2023-11-26T07:24:18.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.731+0000 7f04a181c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f049c072160 0x7f049c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.731+0000 7f04a181c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f049c06de10 0x7f049c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.731+0000 7f04a181c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c15ec90 con 0x7f049c0c49f0 2023-11-26T07:24:18.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.731+0000 7f04a181c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0cd530 con 0x7f049c06de10 2023-11-26T07:24:18.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.731+0000 7f04a181c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0c4ed0 con 0x7f049c072160 2023-11-26T07:24:18.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.731+0000 7f049b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f049c06de10 0x7f049c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.732+0000 7f049b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f049c06de10 0x7f049c0705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53084/0 (socket says 172.21.15.77:53084) 2023-11-26T07:24:18.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.732+0000 7f049b7fe640 1 -- 172.21.15.77:0/2673639180 learned_addr learned my addr 172.21.15.77:0/2673639180 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:18.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.732+0000 7f049b7fe640 1 -- 172.21.15.77:0/2673639180 >> v2:172.21.15.159:3300/0 conn(0x7f049c072160 msgr2=0x7f049c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:18.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.732+0000 7f049b7fe640 1 --2- 172.21.15.77:0/2673639180 >> v2:172.21.15.159:3300/0 conn(0x7f049c072160 0x7f049c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.732+0000 7f049b7fe640 1 -- 172.21.15.77:0/2673639180 >> v1:172.21.15.159:6789/0 conn(0x7f049c0c49f0 legacy=0x7f049c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:18.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.732+0000 7f049b7fe640 1 -- 172.21.15.77:0/2673639180 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0c51b0 con 0x7f049c06de10 2023-11-26T07:24:18.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.733+0000 7f049b7fe640 1 --2- 172.21.15.77:0/2673639180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f049c06de10 0x7f049c0705c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f049c0ccae0 tx=0x7f049402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cc2e16669b9390 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.733+0000 7f049a7fc640 1 -- 172.21.15.77:0/2673639180 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049402ec90 con 0x7f049c06de10 2023-11-26T07:24:18.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.733+0000 7f049a7fc640 1 -- 172.21.15.77:0/2673639180 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049402edf0 con 0x7f049c06de10 2023-11-26T07:24:18.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.733+0000 7f049a7fc640 1 -- 172.21.15.77:0/2673639180 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494036610 con 0x7f049c06de10 2023-11-26T07:24:18.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.734+0000 7f04a181c640 1 -- 172.21.15.77:0/2673639180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f049c06de10 msgr2=0x7f049c0705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.734+0000 7f04a181c640 1 --2- 172.21.15.77:0/2673639180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f049c06de10 0x7f049c0705c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f049c0ccae0 tx=0x7f049402e0f0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.734+0000 7f04a181c640 1 -- 172.21.15.77:0/2673639180 shutdown_connections 2023-11-26T07:24:18.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.734+0000 7f04a181c640 1 --2- 172.21.15.77:0/2673639180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f049c06de10 0x7f049c0705c0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.734+0000 7f04a181c640 1 --2- 172.21.15.77:0/2673639180 >> v2:172.21.15.159:3300/0 conn(0x7f049c072160 0x7f049c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.734+0000 7f04a181c640 1 -- 172.21.15.77:0/2673639180 >> 172.21.15.77:0/2673639180 conn(0x7f049c0b0c50 msgr2=0x7f049c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.734+0000 7f04a181c640 1 -- 172.21.15.77:0/2673639180 shutdown_connections 2023-11-26T07:24:18.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.734+0000 7f04a181c640 1 -- 172.21.15.77:0/2673639180 wait complete. 2023-11-26T07:24:18.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.736+0000 7f04a181c640 1 Processor -- start 2023-11-26T07:24:18.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.736+0000 7f04a181c640 1 -- start start 2023-11-26T07:24:18.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.737+0000 7f04a181c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f049c06de10 0x7f049c159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.737+0000 7f04a181c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f049c072160 0x7f049c09c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.737+0000 7f04a181c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f049c0c49f0 0x7f049c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.737+0000 7f04a181c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c6fc0 con 0x7f049c0c49f0 2023-11-26T07:24:18.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.737+0000 7f04a181c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c60d0 con 0x7f049c072160 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.737+0000 7f04a181c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c63b0 con 0x7f049c06de10 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.737+0000 7f049b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f049c0c49f0 0x7f049c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.737+0000 7f049b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f049c0c49f0 0x7f049c15c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53090/0 (socket says 172.21.15.77:53090) 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.737+0000 7f049b7fe640 1 -- 172.21.15.77:0/2225151212 learned_addr learned my addr 172.21.15.77:0/2225151212 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.738+0000 7f04927fc640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f049c072160 0x7f049c09c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.738+0000 7f049affd640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f049c06de10 0x7f049c159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.738+0000 7f049b7fe640 1 -- 172.21.15.77:0/2225151212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f049c06de10 msgr2=0x7f049c159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.738+0000 7f049b7fe640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f049c06de10 0x7f049c159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.738+0000 7f049b7fe640 1 -- 172.21.15.77:0/2225151212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f049c072160 msgr2=0x7f049c09c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.738+0000 7f049b7fe640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f049c072160 0x7f049c09c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.738+0000 7f049b7fe640 1 -- 172.21.15.77:0/2225151212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494009b30 con 0x7f049c0c49f0 2023-11-26T07:24:18.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.738+0000 7f04927fc640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f049c072160 0x7f049c09c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:18.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.738+0000 7f049b7fe640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f049c0c49f0 0x7f049c15c8d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0494038040 tx=0x7f0494004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.739+0000 7f0498ff9640 1 -- 172.21.15.77:0/2225151212 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049402ec90 con 0x7f049c0c49f0 2023-11-26T07:24:18.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.739+0000 7f0498ff9640 1 -- 172.21.15.77:0/2225151212 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049403f470 con 0x7f049c0c49f0 2023-11-26T07:24:18.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.739+0000 7f0498ff9640 1 -- 172.21.15.77:0/2225151212 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049403f800 con 0x7f049c0c49f0 2023-11-26T07:24:18.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.739+0000 7f04a181c640 1 -- 172.21.15.77:0/2225151212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c0c6690 con 0x7f049c0c49f0 2023-11-26T07:24:18.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.739+0000 7f04a181c640 1 -- 172.21.15.77:0/2225151212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c0c6c50 con 0x7f049c0c49f0 2023-11-26T07:24:18.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.740+0000 7f04a181c640 1 -- 172.21.15.77:0/2225151212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c0c7170 con 0x7f049c0c49f0 2023-11-26T07:24:18.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.741+0000 7f0498ff9640 1 -- 172.21.15.77:0/2225151212 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f049403f960 con 0x7f049c0c49f0 2023-11-26T07:24:18.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.742+0000 7f0498ff9640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047c06b8f0 0x7f047c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.742+0000 7f0498ff9640 1 -- 172.21.15.77:0/2225151212 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f04940aa6a0 con 0x7f049c0c49f0 2023-11-26T07:24:18.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.743+0000 7f049affd640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047c06b8f0 0x7f047c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.743+0000 7f049affd640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047c06b8f0 0x7f047c06ddb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f049c0cfc70 tx=0x7f048c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.747+0000 7f0498ff9640 1 -- 172.21.15.77:0/2225151212 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f049c0c7170 con 0x7f049c0c49f0 2023-11-26T07:24:18.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.935+0000 7f04a181c640 1 -- 172.21.15.77:0/2225151212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f049c15ec90 con 0x7f049c0c49f0 2023-11-26T07:24:18.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.942+0000 7f0498ff9640 1 -- 172.21.15.77:0/2225151212 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f049c15ec90 con 0x7f049c0c49f0 2023-11-26T07:24:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.944+0000 7f04a181c640 1 -- 172.21.15.77:0/2225151212 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047c06b8f0 msgr2=0x7f047c06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.944+0000 7f04a181c640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047c06b8f0 0x7f047c06ddb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f049c0cfc70 tx=0x7f048c008040 comp rx=0 tx=0).stop 2023-11-26T07:24:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.944+0000 7f04a181c640 1 -- 172.21.15.77:0/2225151212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f049c0c49f0 msgr2=0x7f049c15c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.944+0000 7f04a181c640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f049c0c49f0 0x7f049c15c8d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0494038040 tx=0x7f0494004a40 comp rx=0 tx=0).stop 2023-11-26T07:24:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.944+0000 7f04a181c640 1 -- 172.21.15.77:0/2225151212 shutdown_connections 2023-11-26T07:24:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.944+0000 7f04a181c640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f047c06b8f0 0x7f047c06ddb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.944+0000 7f04a181c640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f049c0c49f0 0x7f049c15c8d0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.944+0000 7f04a181c640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f049c072160 0x7f049c09c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.944+0000 7f04a181c640 1 --2- 172.21.15.77:0/2225151212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f049c06de10 0x7f049c159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.944+0000 7f04a181c640 1 -- 172.21.15.77:0/2225151212 >> 172.21.15.77:0/2225151212 conn(0x7f049c0b0c50 msgr2=0x7f049c06c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.945+0000 7f04a181c640 1 -- 172.21.15.77:0/2225151212 shutdown_connections 2023-11-26T07:24:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:18.945+0000 7f04a181c640 1 -- 172.21.15.77:0/2225151212 wait complete. 2023-11-26T07:24:18.964 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete' 2023-11-26T07:24:19.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.175+0000 7ff95249b640 1 Processor -- start 2023-11-26T07:24:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.175+0000 7ff95249b640 1 -- start start 2023-11-26T07:24:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.177+0000 7ff95249b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff94c159990 0x7ff94c0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.177+0000 7ff95249b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 0x7ff94c0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.177+0000 7ff95249b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c0b08c0 con 0x7ff94c0b1130 2023-11-26T07:24:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.177+0000 7ff95249b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c0cc970 con 0x7ff94c159990 2023-11-26T07:24:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.177+0000 7ff95249b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0cc3b0 con 0x7ff94c0ce120 2023-11-26T07:24:19.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.178+0000 7ff950a38640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff94c0b1130 0x7ff94c0aeab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45112/0 (socket says 172.21.15.77:45112) 2023-11-26T07:24:19.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.178+0000 7ff950a38640 1 -- 172.21.15.77:0/1165046048 learned_addr learned my addr 172.21.15.77:0/1165046048 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:19.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.178+0000 7ff94b7fe640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 0x7ff94c0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:19.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.178+0000 7ff94bfff640 1 --2- 172.21.15.77:0/1165046048 >> v2:172.21.15.159:3300/0 conn(0x7ff94c159990 0x7ff94c0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:19.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.179+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098450299 0 0) 0x7ff94c0b08c0 con 0x7ff94c0b1130 2023-11-26T07:24:19.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.179+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff934003520 con 0x7ff94c0b1130 2023-11-26T07:24:19.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1681060098 0 0) 0x7ff934003520 con 0x7ff94c0b1130 2023-11-26T07:24:19.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 msgr2=0x7ff94c0b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:19.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 0x7ff94c0b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:19.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 >> v2:172.21.15.159:3300/0 conn(0x7ff94c159990 msgr2=0x7ff94c0cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:19.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 --2- 172.21.15.77:0/1165046048 >> v2:172.21.15.159:3300/0 conn(0x7ff94c159990 0x7ff94c0cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:19.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c0cc690 con 0x7ff94c0b1130 2023-11-26T07:24:19.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7ff944001670 con 0x7ff94c0b1130 2023-11-26T07:24:19.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 >> v1:172.21.15.77:6789/0 conn(0x7ff94c0b1130 legacy=0x7ff94c0aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:19.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 0x7ff934003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:19.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff934003f40 0x7ff9340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:19.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff934004d00 0x7ff934005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:19.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0cc3b0 con 0x7ff934003f40 2023-11-26T07:24:19.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93400dbc0 con 0x7ff934004d00 2023-11-26T07:24:19.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.180+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93400dd80 con 0x7ff94c0ce120 2023-11-26T07:24:19.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.181+0000 7ff94bfff640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 0x7ff934003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:19.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.181+0000 7ff94b7fe640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff934003f40 0x7ff9340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:19.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.181+0000 7ff950a38640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff934004d00 0x7ff934005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:19.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.182+0000 7ff94bfff640 1 -- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff934004d00 msgr2=0x7ff934005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:19.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.182+0000 7ff94bfff640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff934004d00 0x7ff934005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:19.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.182+0000 7ff94bfff640 1 -- 172.21.15.77:0/1165046048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff934003f40 msgr2=0x7ff9340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:19.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.182+0000 7ff94bfff640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff934003f40 0x7ff9340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:19.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.182+0000 7ff94bfff640 1 -- 172.21.15.77:0/1165046048 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934003520 con 0x7ff94c0ce120 2023-11-26T07:24:19.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.185+0000 7ff94bfff640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 0x7ff934003970 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009fc0 tx=0x7ff9340057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baa30599df003926 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.186+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c02cc60 con 0x7ff94c0ce120 2023-11-26T07:24:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.186+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00f040 con 0x7ff94c0ce120 2023-11-26T07:24:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.186+0000 7ff94affd640 1 -- 172.21.15.77:0/1165046048 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c034440 con 0x7ff94c0ce120 2023-11-26T07:24:19.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.187+0000 7ff95249b640 1 -- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 msgr2=0x7ff934003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:19.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.187+0000 7ff95249b640 1 --2- 172.21.15.77:0/1165046048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 0x7ff934003970 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009fc0 tx=0x7ff9340057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:19.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.187+0000 7ff950a38640 1 -- 172.21.15.77:0/1165046048 reap_dead start 2023-11-26T07:24:19.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.187+0000 7ff95249b640 1 -- 172.21.15.77:0/1165046048 shutdown_connections 2023-11-26T07:24:19.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.187+0000 7ff95249b640 1 -- 172.21.15.77:0/1165046048 >> 172.21.15.77:0/1165046048 conn(0x7ff94c0b4500 msgr2=0x7ff94c0b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:19.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.187+0000 7ff95249b640 1 -- 172.21.15.77:0/1165046048 shutdown_connections 2023-11-26T07:24:19.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.187+0000 7ff95249b640 1 -- 172.21.15.77:0/1165046048 wait complete. 2023-11-26T07:24:19.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.189+0000 7ff95249b640 1 Processor -- start 2023-11-26T07:24:19.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.190+0000 7ff95249b640 1 -- start start 2023-11-26T07:24:19.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.191+0000 7ff95249b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 0x7ff94c09b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:19.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.191+0000 7ff95249b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff94c09cbf0 0x7ff94c0aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:19.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.191+0000 7ff95249b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c1e4610 0x7ff94c14aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:19.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.191+0000 7ff95249b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c09d070 con 0x7ff94c1e4610 2023-11-26T07:24:19.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.191+0000 7ff95249b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c09bb50 con 0x7ff94c09cbf0 2023-11-26T07:24:19.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.191+0000 7ff95249b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c09be30 con 0x7ff94c0ce120 2023-11-26T07:24:19.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.191+0000 7ff950a38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c1e4610 0x7ff94c14aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:19.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.191+0000 7ff950a38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c1e4610 0x7ff94c14aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53116/0 (socket says 172.21.15.77:53116) 2023-11-26T07:24:19.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.191+0000 7ff950a38640 1 -- 172.21.15.77:0/4112510486 learned_addr learned my addr 172.21.15.77:0/4112510486 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:19.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.191+0000 7ff94b7fe640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff94c09cbf0 0x7ff94c0aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:19.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.191+0000 7ff950a38640 1 -- 172.21.15.77:0/4112510486 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 msgr2=0x7ff94c09b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:19.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.192+0000 7ff950a38640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 0x7ff94c09b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:19.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.192+0000 7ff950a38640 1 -- 172.21.15.77:0/4112510486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff94c09cbf0 msgr2=0x7ff94c0aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:19.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.192+0000 7ff950a38640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff94c09cbf0 0x7ff94c0aca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:19.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.192+0000 7ff950a38640 1 -- 172.21.15.77:0/4112510486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c09c110 con 0x7ff94c1e4610 2023-11-26T07:24:19.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.192+0000 7ff950a38640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c1e4610 0x7ff94c14aef0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff94c071600 tx=0x7ff94400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:19.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.192+0000 7ff948ff9640 1 -- 172.21.15.77:0/4112510486 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400eed0 con 0x7ff94c1e4610 2023-11-26T07:24:19.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.192+0000 7ff948ff9640 1 -- 172.21.15.77:0/4112510486 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400c610 con 0x7ff94c1e4610 2023-11-26T07:24:19.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.192+0000 7ff95249b640 1 -- 172.21.15.77:0/4112510486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94c09c3f0 con 0x7ff94c1e4610 2023-11-26T07:24:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.192+0000 7ff948ff9640 1 -- 172.21.15.77:0/4112510486 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400c9c0 con 0x7ff94c1e4610 2023-11-26T07:24:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.192+0000 7ff95249b640 1 -- 172.21.15.77:0/4112510486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c0acf80 con 0x7ff94c1e4610 2023-11-26T07:24:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.193+0000 7ff95249b640 1 -- 172.21.15.77:0/4112510486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c09c910 con 0x7ff94c1e4610 2023-11-26T07:24:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.194+0000 7ff948ff9640 1 -- 172.21.15.77:0/4112510486 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7ff94400cb20 con 0x7ff94c1e4610 2023-11-26T07:24:19.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.195+0000 7ff948ff9640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff93806b8f0 0x7ff93806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:19.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.195+0000 7ff948ff9640 1 -- 172.21.15.77:0/4112510486 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff944087ca0 con 0x7ff94c1e4610 2023-11-26T07:24:19.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.195+0000 7ff94bfff640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff93806b8f0 0x7ff93806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:19.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.196+0000 7ff94bfff640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff93806b8f0 0x7ff93806ddb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff93c036000 tx=0x7ff93c02e070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:19.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.200+0000 7ff948ff9640 1 -- 172.21.15.77:0/4112510486 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff94c09c910 con 0x7ff94c1e4610 2023-11-26T07:24:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:19.461+0000 7ff95249b640 1 -- 172.21.15.77:0/4112510486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]} v 0) v1 -- 0x7ff94c09c910 con 0x7ff94c1e4610 2023-11-26T07:24:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.087+0000 7ff948ff9640 1 -- 172.21.15.77:0/4112510486 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]}]=0 v343) v1 ==== 187+0+0 (secure 0 0 0) 0x7ff94c09c910 con 0x7ff94c1e4610 2023-11-26T07:24:20.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.090+0000 7ff95249b640 1 -- 172.21.15.77:0/4112510486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff93806b8f0 msgr2=0x7ff93806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:20.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.090+0000 7ff95249b640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff93806b8f0 0x7ff93806ddb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff93c036000 tx=0x7ff93c02e070 comp rx=0 tx=0).stop 2023-11-26T07:24:20.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.090+0000 7ff95249b640 1 -- 172.21.15.77:0/4112510486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c1e4610 msgr2=0x7ff94c14aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:20.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.090+0000 7ff95249b640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c1e4610 0x7ff94c14aef0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff94c071600 tx=0x7ff94400eb90 comp rx=0 tx=0).stop 2023-11-26T07:24:20.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.091+0000 7ff95249b640 1 -- 172.21.15.77:0/4112510486 shutdown_connections 2023-11-26T07:24:20.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.091+0000 7ff95249b640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff93806b8f0 0x7ff93806ddb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:20.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.091+0000 7ff95249b640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c1e4610 0x7ff94c14aef0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:20.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.091+0000 7ff95249b640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff94c09cbf0 0x7ff94c0aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:20.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.091+0000 7ff95249b640 1 --2- 172.21.15.77:0/4112510486 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff94c0ce120 0x7ff94c09b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:20.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.091+0000 7ff95249b640 1 -- 172.21.15.77:0/4112510486 >> 172.21.15.77:0/4112510486 conn(0x7ff94c0b4500 msgr2=0x7ff94c06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:20.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.091+0000 7ff95249b640 1 -- 172.21.15.77:0/4112510486 shutdown_connections 2023-11-26T07:24:20.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:20.091+0000 7ff95249b640 1 -- 172.21.15.77:0/4112510486 wait complete. 2023-11-26T07:24:20.114 INFO:tasks.cephfs_test_runner:ensure failure status is not shown when clone is not in failed/cancelled state ... ERROR 2023-11-26T07:24:20.115 INFO:tasks.cephfs_test_runner: 2023-11-26T07:24:20.115 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-26T07:24:20.115 INFO:tasks.cephfs_test_runner:ERROR: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:24:20.115 INFO:tasks.cephfs_test_runner:ensure failure status is not shown when clone is not in failed/cancelled state 2023-11-26T07:24:20.115 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-26T07:24:20.115 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-26T07:24:20.115 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 6589, in test_clone_failure_status_pending_in_progress_complete 2023-11-26T07:24:20.115 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "snapshot", "rm", self.volname, subvolume, snapshot) 2023-11-26T07:24:20.115 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2023-11-26T07:24:20.115 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol55430 subvol_snap6600' 2023-11-26T07:24:20.116 INFO:tasks.cephfs_test_runner: 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner:Ran 4 tests in 367.164s 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner: 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner: 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner:ERROR: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner:ensure failure status is not shown when clone is not in failed/cancelled state 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 6589, in test_clone_failure_status_pending_in_progress_complete 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "snapshot", "rm", self.volname, subvolume, snapshot) 2023-11-26T07:24:20.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol55430 subvol_snap6600' 2023-11-26T07:24:20.118 INFO:tasks.cephfs_test_runner: 2023-11-26T07:24:20.119 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:24:20.184 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9e40e613a9c94bfba5fd4921795118e3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:24:20.185 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-26T07:24:20.194 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-26T07:24:20.232 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-26T07:24:20.232 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:24:20.232 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:20.296 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:24:20.297 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-26T07:24:20.297 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:20.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:24:20.350 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:24:20.350 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:20.412 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:24:20.412 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-11-26T07:24:20.412 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:20.464 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:24:20.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:20.464 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-26T07:24:20.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:24:20.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:24:20.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:20.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:24:20.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:20.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:24:20.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:20.716 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2023-11-26T07:24:20.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:20.862 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-26T07:24:20.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:20.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2023-11-26T07:24:21.050 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2023-11-26T07:24:21.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:24:21.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:21.054 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-11-26T07:24:21.113 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:24:21.113 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:24:21.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:21.114 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:24:21.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:21.212 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:24:21.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:21.301 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2023-11-26T07:24:21.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:21.451 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-11-26T07:24:21.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:21.497 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2023-11-26T07:24:21.633 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2023-11-26T07:24:21.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:24:21.637 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-26T07:24:21.647 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-26T07:24:21.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:24:21.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.859+0000 7f0ef267c640 1 Processor -- start 2023-11-26T07:24:21.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.860+0000 7f0ef267c640 1 -- start start 2023-11-26T07:24:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.861+0000 7f0ef267c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0eec0cf450 0x7f0eec0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.861+0000 7f0ef267c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0eec0cdfb0 0x7f0eec0ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.861+0000 7f0ef267c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec0cece0 con 0x7f0eec15c7f0 2023-11-26T07:24:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.861+0000 7f0ef267c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec0cfe40 con 0x7f0eec0cf450 2023-11-26T07:24:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.861+0000 7f0ef267c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec156010 con 0x7f0eec0cdfb0 2023-11-26T07:24:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.861+0000 7f0eeb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0eec0cf450 0x7f0eec0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.862+0000 7f0eeb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0eec0cf450 0x7f0eec0cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53118/0 (socket says 172.21.15.77:53118) 2023-11-26T07:24:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.862+0000 7f0eeb7fe640 1 -- 172.21.15.77:0/431843466 learned_addr learned my addr 172.21.15.77:0/431843466 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.862+0000 7f0eeb7fe640 1 -- 172.21.15.77:0/431843466 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0eec0cdfb0 msgr2=0x7f0eec0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:21.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.862+0000 7f0eeb7fe640 1 --2- 172.21.15.77:0/431843466 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0eec0cdfb0 0x7f0eec0ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:21.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.862+0000 7f0eeb7fe640 1 -- 172.21.15.77:0/431843466 >> v1:172.21.15.159:6789/0 conn(0x7f0eec15c7f0 legacy=0x7f0eec06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:21.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.862+0000 7f0eeb7fe640 1 -- 172.21.15.77:0/431843466 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec06d040 con 0x7f0eec0cf450 2023-11-26T07:24:21.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.863+0000 7f0eeb7fe640 1 --2- 172.21.15.77:0/431843466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eec0cf450 0x7f0eec0cf900 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009e50 tx=0x7f0ed402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291f8eef09444b91 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:21.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.863+0000 7f0eeaffd640 1 -- 172.21.15.77:0/431843466 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed402ca80 con 0x7f0eec0cf450 2023-11-26T07:24:21.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.863+0000 7f0eeaffd640 1 -- 172.21.15.77:0/431843466 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed402cbe0 con 0x7f0eec0cf450 2023-11-26T07:24:21.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.863+0000 7f0eeaffd640 1 -- 172.21.15.77:0/431843466 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40343f0 con 0x7f0eec0cf450 2023-11-26T07:24:21.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.864+0000 7f0ef267c640 1 -- 172.21.15.77:0/431843466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eec0cf450 msgr2=0x7f0eec0cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:21.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.864+0000 7f0ef267c640 1 --2- 172.21.15.77:0/431843466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eec0cf450 0x7f0eec0cf900 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009e50 tx=0x7f0ed402bee0 comp rx=0 tx=0).stop 2023-11-26T07:24:21.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.864+0000 7f0ef267c640 1 -- 172.21.15.77:0/431843466 shutdown_connections 2023-11-26T07:24:21.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.864+0000 7f0ef267c640 1 --2- 172.21.15.77:0/431843466 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0eec0cdfb0 0x7f0eec0ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:21.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.864+0000 7f0ef267c640 1 --2- 172.21.15.77:0/431843466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eec0cf450 0x7f0eec0cf900 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:21.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.864+0000 7f0ef267c640 1 -- 172.21.15.77:0/431843466 >> 172.21.15.77:0/431843466 conn(0x7f0eec06a920 msgr2=0x7f0eec06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:21.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.864+0000 7f0ef267c640 1 -- 172.21.15.77:0/431843466 shutdown_connections 2023-11-26T07:24:21.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.864+0000 7f0ef267c640 1 -- 172.21.15.77:0/431843466 wait complete. 2023-11-26T07:24:21.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.866+0000 7f0ef267c640 1 Processor -- start 2023-11-26T07:24:21.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.866+0000 7f0ef267c640 1 -- start start 2023-11-26T07:24:21.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.867+0000 7f0ef267c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eec0cdfb0 0x7f0eec098820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:21.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.867+0000 7f0ef267c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0eec0cf450 0x7f0eec1e58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:21.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.867+0000 7f0ef267c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eec15c7f0 0x7f0eec152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:21.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.867+0000 7f0ef267c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec15b2b0 con 0x7f0eec0cdfb0 2023-11-26T07:24:21.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.867+0000 7f0ef267c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec15a630 con 0x7f0eec15c7f0 2023-11-26T07:24:21.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.867+0000 7f0ef267c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec15a910 con 0x7f0eec0cf450 2023-11-26T07:24:21.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.867+0000 7f0eebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eec0cdfb0 0x7f0eec098820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:21.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0eebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eec0cdfb0 0x7f0eec098820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53120/0 (socket says 172.21.15.77:53120) 2023-11-26T07:24:21.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0eebfff640 1 -- 172.21.15.77:0/665250823 learned_addr learned my addr 172.21.15.77:0/665250823 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:21.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0eeb7fe640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0eec0cf450 0x7f0eec1e58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:21.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0ef0c19640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eec15c7f0 0x7f0eec152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:21.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0eebfff640 1 -- 172.21.15.77:0/665250823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0eec0cf450 msgr2=0x7f0eec1e58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:21.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0eebfff640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0eec0cf450 0x7f0eec1e58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:21.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0eebfff640 1 -- 172.21.15.77:0/665250823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eec15c7f0 msgr2=0x7f0eec152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:21.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0eebfff640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eec15c7f0 0x7f0eec152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:21.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0eebfff640 1 -- 172.21.15.77:0/665250823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4009b30 con 0x7f0eec0cdfb0 2023-11-26T07:24:21.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0eebfff640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eec0cdfb0 0x7f0eec098820 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00b3e0 tx=0x7f0edc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:21.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0ee8ff9640 1 -- 172.21.15.77:0/665250823 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc011830 con 0x7f0eec0cdfb0 2023-11-26T07:24:21.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0ee8ff9640 1 -- 172.21.15.77:0/665250823 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc0119b0 con 0x7f0eec0cdfb0 2023-11-26T07:24:21.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.868+0000 7f0ee8ff9640 1 -- 172.21.15.77:0/665250823 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc011d60 con 0x7f0eec0cdfb0 2023-11-26T07:24:21.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.869+0000 7f0ef267c640 1 -- 172.21.15.77:0/665250823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec15abf0 con 0x7f0eec0cdfb0 2023-11-26T07:24:21.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.869+0000 7f0ef267c640 1 -- 172.21.15.77:0/665250823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec098d60 con 0x7f0eec0cdfb0 2023-11-26T07:24:21.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.870+0000 7f0ef267c640 1 -- 172.21.15.77:0/665250823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec06ef30 con 0x7f0eec0cdfb0 2023-11-26T07:24:21.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.871+0000 7f0ee8ff9640 1 -- 172.21.15.77:0/665250823 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f0edc01a400 con 0x7f0eec0cdfb0 2023-11-26T07:24:21.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.871+0000 7f0ee8ff9640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ecc06b8f0 0x7f0ecc06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:21.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.872+0000 7f0ee8ff9640 1 -- 172.21.15.77:0/665250823 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0edc088140 con 0x7f0eec0cdfb0 2023-11-26T07:24:21.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.872+0000 7f0eeb7fe640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ecc06b8f0 0x7f0ecc06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:21.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.872+0000 7f0eeb7fe640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ecc06b8f0 0x7f0ecc06ddb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4035000 tx=0x7f0ed4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:21.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:21.876+0000 7f0ee8ff9640 1 -- 172.21.15.77:0/665250823 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0edc054c40 con 0x7f0eec0cdfb0 2023-11-26T07:24:22.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.063+0000 7f0ef267c640 1 -- 172.21.15.77:0/665250823 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0eec0ce960 con 0x7f0ecc06b8f0 2023-11-26T07:24:22.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.069+0000 7f0ee8ff9640 1 -- 172.21.15.77:0/665250823 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48498 (secure 0 0 0) 0x7f0ed4034470 con 0x7f0ecc06b8f0 2023-11-26T07:24:22.071 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:22.071 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:24:22.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.071+0000 7f0ef267c640 1 -- 172.21.15.77:0/665250823 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ecc06b8f0 msgr2=0x7f0ecc06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:22.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.071+0000 7f0ef267c640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ecc06b8f0 0x7f0ecc06ddb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4035000 tx=0x7f0ed4030000 comp rx=0 tx=0).stop 2023-11-26T07:24:22.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.071+0000 7f0ef267c640 1 -- 172.21.15.77:0/665250823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eec0cdfb0 msgr2=0x7f0eec098820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:22.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.071+0000 7f0ef267c640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eec0cdfb0 0x7f0eec098820 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00b3e0 tx=0x7f0edc00b8a0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.071+0000 7f0ef267c640 1 -- 172.21.15.77:0/665250823 shutdown_connections 2023-11-26T07:24:22.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.071+0000 7f0ef267c640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f0ecc06b8f0 0x7f0ecc06ddb0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.071+0000 7f0ef267c640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0eec15c7f0 0x7f0eec152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.071+0000 7f0ef267c640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0eec0cf450 0x7f0eec1e58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.071+0000 7f0ef267c640 1 --2- 172.21.15.77:0/665250823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eec0cdfb0 0x7f0eec098820 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.071+0000 7f0ef267c640 1 -- 172.21.15.77:0/665250823 >> 172.21.15.77:0/665250823 conn(0x7f0eec06a920 msgr2=0x7f0eec06c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:22.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.071+0000 7f0ef267c640 1 -- 172.21.15.77:0/665250823 shutdown_connections 2023-11-26T07:24:22.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.072+0000 7f0ef267c640 1 -- 172.21.15.77:0/665250823 wait complete. 2023-11-26T07:24:22.091 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2023-11-26T07:24:21.737162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":875760,"kb_used_data":617992,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754098960,"statfs":{"total":773094113280,"available":772197335040,"internally_reserved":0,"allocated":632823808,"data_stored":628357645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-422513665,"num_objects":-427,"num_object_clones":-1,"num_object_copies":-854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-427,"num_whiteouts":-1,"num_read":-209,"num_read_kb":-204809,"num_write":-959,"num_write_kb":-412925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.693404"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:24:15.048822+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:24:15.048822+0000","last_peered":"2023-11-26T07:24:15.048822+0000","last_clean":"2023-11-26T07:24:15.048822+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:24:15.048822+0000","last_undegraded":"2023-11-26T07:24:15.048822+0000","last_fullsized":"2023-11-26T07:24:15.048822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134088,"kb_used_data":102908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94237752,"statfs":{"total":96636764160,"available":96499458048,"internally_reserved":0,"allocated":105377792,"data_stored":104814724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0629999999999999,"15min":1.038},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6739999999999999,"5min":1.768,"15min":1.768},"last":1.377},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.103,"15min":1.079},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.514,"5min":2.298,"15min":2.298},"last":1.347}]},{"osd":1,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.085,"15min":1.0589999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.171,"15min":1.2090000000000001},"min":{"1min":0.76400000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.9650000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.2190000000000001,"15min":1.175},"min":{"1min":0.81100000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6100000000000001,"5min":1.9239999999999999,"15min":2.0760000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.173,"15min":1.262},"min":{"1min":0.81899999999999995,"5min":0.73599999999999999,"15min":0.70399999999999996},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.5339999999999998},"last":1.258}]},{"osd":3,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.177,"15min":1.2230000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6359999999999999,"5min":1.694,"15min":1.9299999999999999},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3400000000000001,"15min":1.3580000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":2.2389999999999999},"last":0.876}]},{"osd":4,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.3140000000000001,"15min":1.347},"min":{"1min":0.63,"5min":0.63,"15min":0.60599999999999998},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.774},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4279999999999999,"15min":1.4530000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.57399999999999995},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.3780000000000001},"last":1.5589999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.448,"15min":1.4870000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.65900000000000003},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.8330000000000002},"last":1.446},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3640000000000001,"15min":1.446},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.54600000000000004},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":2.149},"last":1.6759999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.5720000000000001,"15min":1.6539999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.75},"max":{"1min":2.258,"5min":2.258,"15min":2.7280000000000002},"last":1.615},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5509999999999999,"15min":1.619},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.56299999999999994},"max":{"1min":2.008,"5min":2.1349999999999998,"15min":2.4590000000000001},"last":1.7410000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":170368,"kb_used_data":139188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94201472,"statfs":{"total":96636764160,"available":96462307328,"internally_reserved":0,"allocated":142528512,"data_stored":141972971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.103,"15min":1.117},"min":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":3.2029999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.101,"15min":1.2330000000000001},"min":{"1min":0.70599999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.306,"5min":2.4279999999999999,"15min":3.169},"last":1.1519999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1839999999999999,"15min":1.1859999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.661,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.113,"5min":1.2070000000000001,"15min":1.149},"min":{"1min":0.85799999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5620000000000001,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":0.999}]},{"osd":2,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1200000000000001,"15min":1.121},"min":{"1min":0.81399999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5029999999999999,"5min":1.71,"15min":1.71},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.282,"15min":1.3600000000000001},"min":{"1min":0.94799999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":3.1110000000000002},"last":1.0649999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3009999999999999,"15min":1.2789999999999999},"min":{"1min":0.84599999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.9730000000000001,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.268,"15min":1.2629999999999999},"min":{"1min":1.0289999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.3080000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3959999999999999,"15min":1.3779999999999999},"min":{"1min":0.746,"5min":0.69099999999999995,"15min":0.56200000000000006},"max":{"1min":3.0070000000000001,"5min":4.6539999999999999,"15min":4.6539999999999999},"last":1.454},{"interface":"front","average":{"1min":1.419,"5min":1.4319999999999999,"15min":1.3879999999999999},"min":{"1min":0.96899999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.841,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":1.4339999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.391,"15min":1.403},"min":{"1min":0.72199999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.752,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.204},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5509999999999999,"15min":1.542},"min":{"1min":1.089,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":3.1230000000000002,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":1.569}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.577,"15min":1.556},"min":{"1min":1.2190000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.5600000000000001,"5min":4.202,"15min":4.202},"last":1.365},{"interface":"front","average":{"1min":1.508,"5min":1.554,"15min":1.5660000000000001},"min":{"1min":0.91600000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.9119999999999999,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.4019999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0740000000000001,"15min":1.0309999999999999},"min":{"1min":0.82999999999999996,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4199999999999999,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.228,"5min":1.1579999999999999,"15min":1.048},"min":{"1min":0.72399999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.736,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.871}]},{"osd":1,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1659999999999999,"15min":1.0880000000000001},"min":{"1min":0.82999999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5149999999999999,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":1.069},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.171,"15min":1.1679999999999999},"min":{"1min":0.73799999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.589,"5min":4.7859999999999996,"15min":4.7859999999999996},"last":0.73899999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1240000000000001,"15min":1.0640000000000001},"min":{"1min":0.79200000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.609,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.254,"15min":1.288},"min":{"1min":0.92700000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4179999999999999,"5min":3.77,"15min":3.77},"last":0.92200000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2569999999999999,"15min":1.2949999999999999},"min":{"1min":0.80000000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7450000000000001,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.254,"15min":1.2130000000000001},"min":{"1min":0.81399999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6879999999999999,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.286}]},{"osd":4,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3899999999999999,"15min":1.4470000000000001},"min":{"1min":0.80700000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7030000000000001,"5min":3.835,"15min":3.835},"last":1.76},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.415,"15min":1.4550000000000001},"min":{"1min":1.2549999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.8520000000000001,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":1.226}]},{"osd":6,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.498,"15min":1.538},"min":{"1min":0.97699999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.988,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4159999999999999,"15min":1.452},"min":{"1min":0.94499999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.734,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":1.5349999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.5289999999999999,"15min":1.589},"min":{"1min":1.3089999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.9399999999999999,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":1.331},{"interface":"front","average":{"1min":1.544,"5min":1.5409999999999999,"15min":1.591},"min":{"1min":1.2569999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.819,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":1.593}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115068,"kb_used_data":83888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94256772,"statfs":{"total":96636764160,"available":96518934528,"internally_reserved":0,"allocated":85901312,"data_stored":85349658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.012,"15min":1.1100000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.385,"5min":1.6040000000000001,"15min":2.7440000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0940000000000001,"15min":1.028},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.458,"5min":2.04,"15min":2.04},"last":1.72}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.78500000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.587,"5min":1.7509999999999999,"15min":2.2850000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.23,"5min":1.244,"15min":1.2410000000000001},"min":{"1min":0.80700000000000005,"5min":0.749,"15min":0.67800000000000005},"max":{"1min":1.673,"5min":1.79,"15min":1.79},"last":0.85899999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.2110000000000001,"15min":1.268},"min":{"1min":0.76400000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.595,"5min":1.964,"15min":2.3109999999999999},"last":1.036},{"interface":"front","average":{"1min":1.157,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.90000000000000002,"5min":0.72099999999999997,"15min":0.68500000000000005},"max":{"1min":1.8620000000000001,"5min":1.944,"15min":1.944},"last":1.3340000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.28,"15min":1.3089999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5049999999999999,"5min":2.2010000000000001,"15min":2.4159999999999999},"last":1.411},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3149999999999999,"15min":1.341},"min":{"1min":0.94699999999999995,"5min":0.93999999999999995,"15min":0.88900000000000001},"max":{"1min":1.6739999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.454}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.331,"15min":1.3540000000000001},"min":{"1min":0.79800000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7609999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.9359999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.448,"15min":1.494},"min":{"1min":0.98699999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.738,"5min":2.3319999999999999,"15min":2.899},"last":1.8360000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.448,"15min":1.494},"min":{"1min":1.0449999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9239999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.5660000000000001,"15min":1.6240000000000001},"min":{"1min":1.123,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.7170000000000001,"5min":2.4239999999999999,"15min":3.008},"last":1.8979999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.6319999999999999,"15min":1.7270000000000001},"min":{"1min":1.2170000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.982,"5min":2.4460000000000002,"15min":2.6059999999999999},"last":2.222},{"interface":"front","average":{"1min":1.488,"5min":1.5960000000000001,"15min":1.6819999999999999},"min":{"1min":1.0409999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0640000000000001,"5min":2.343,"15min":3.085},"last":2.0489999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78100000000000003,"15min":0.84699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.377},"max":{"1min":1.3999999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.02},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.878,"15min":0.90000000000000002},"min":{"1min":0.55400000000000005,"5min":0.41499999999999998,"15min":0.35199999999999998},"max":{"1min":1.452,"5min":1.5920000000000001,"15min":1.764},"last":0.91400000000000003}]},{"osd":1,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76600000000000001,"15min":0.83399999999999996},"min":{"1min":0.436,"5min":0.371,"15min":0.371},"max":{"1min":1.4550000000000001,"5min":1.508,"15min":1.784},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.97199999999999998},"min":{"1min":0.505,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3480000000000001,"5min":1.5649999999999999,"15min":2.2749999999999999},"last":1.123}]},{"osd":2,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.99299999999999999,"15min":1.0609999999999999},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.643,"5min":1.6559999999999999,"15min":2.7109999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.0349999999999999,"15min":1.099},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.44600000000000001},"max":{"1min":1.413,"5min":1.599,"15min":2.379},"last":0.81100000000000005}]},{"osd":4,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0820000000000001,"15min":1.121},"min":{"1min":0.76600000000000001,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4199999999999999,"5min":1.5529999999999999,"15min":2.0209999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.1839999999999999,"15min":1.3169999999999999},"min":{"1min":0.79100000000000004,"5min":0.77500000000000002,"15min":0.72999999999999998},"max":{"1min":1.645,"5min":1.766,"15min":2.859},"last":1.151}]},{"osd":5,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2090000000000001,"15min":1.331},"min":{"1min":0.86299999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.498,"5min":1.9350000000000001,"15min":2.504},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.155,"15min":1.2310000000000001},"min":{"1min":0.83999999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5189999999999999,"5min":1.8280000000000001,"15min":2.1709999999999998},"last":1.3440000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2410000000000001,"15min":1.403},"min":{"1min":0.84799999999999998,"5min":0.80400000000000005,"15min":0.79100000000000004},"max":{"1min":1.746,"5min":1.899,"15min":3.8540000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.29,"15min":1.4119999999999999},"min":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.73199999999999998},"max":{"1min":1.589,"5min":1.903,"15min":3.226},"last":1.357}]},{"osd":7,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2250000000000001,"15min":1.278},"min":{"1min":0.82899999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.605,"5min":2.129,"15min":2.1509999999999998},"last":1.391},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3580000000000001,"15min":1.482},"min":{"1min":0.86599999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.853,"5min":2.089,"15min":3.956},"last":1.591}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166332,"kb_used_data":130992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94205508,"statfs":{"total":96636764160,"available":96466440192,"internally_reserved":0,"allocated":134135808,"data_stored":133584154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78700000000000003,"15min":0.93500000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.827,"5min":1.827,"15min":2.7799999999999998},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.002,"5min":0.90200000000000002,"15min":1.044},"min":{"1min":0.505,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.972,"5min":2.0459999999999998,"15min":2.8300000000000001},"last":0.64500000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79700000000000004,"15min":0.93899999999999995},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2470000000000001,"5min":1.5229999999999999,"15min":1.645},"last":1.464},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.877,"15min":1.0009999999999999},"min":{"1min":0.55300000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.304,"5min":1.6990000000000001,"15min":1.901},"last":0.94099999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.877,"15min":1.028},"min":{"1min":0.44700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.9039999999999999,"5min":2.2240000000000002,"15min":2.4100000000000001},"last":1.145},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0529999999999999,"15min":1.2070000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.7490000000000001,"5min":1.8939999999999999,"15min":2.5619999999999998},"last":2.04}]},{"osd":4,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1859999999999999,"15min":1.264},"min":{"1min":0.91800000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.677,"5min":1.8939999999999999,"15min":2.0129999999999999},"last":1.8560000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1679999999999999,"15min":1.268},"min":{"1min":0.81000000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.849,"5min":1.849,"15min":2.3359999999999999},"last":1.3979999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.135,"15min":1.2270000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.901},"last":1.54},{"interface":"front","average":{"1min":1.228,"5min":1.206,"15min":1.3540000000000001},"min":{"1min":0.84599999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.796,"5min":1.796,"15min":2.395},"last":2.1349999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3180000000000001,"15min":1.4279999999999999},"min":{"1min":0.93600000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.5329999999999999},"last":1.9119999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.266,"15min":1.3300000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.6579999999999999,"5min":2.0750000000000002,"15min":2.2280000000000002},"last":1.6990000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.327,"15min":1.4590000000000001},"min":{"1min":0.94299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.0760000000000001,"5min":2.1309999999999998,"15min":2.4710000000000001},"last":2.0939999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.3240000000000001,"15min":1.409},"min":{"1min":0.90200000000000002,"5min":0.86099999999999999,"15min":0.73399999999999999},"max":{"1min":1.74,"5min":2.1320000000000001,"15min":2.4009999999999998},"last":1.8260000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122252,"kb_used_data":86912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94249588,"statfs":{"total":96636764160,"available":96511578112,"internally_reserved":0,"allocated":88997888,"data_stored":88437622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.749,"15min":0.80500000000000005},"min":{"1min":0.45500000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.23,"5min":1.589,"15min":1.589},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.83999999999999997,"15min":0.93600000000000005},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.722,"5min":2.2909999999999999,"15min":2.6960000000000002},"last":1.6120000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.85899999999999999},"min":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.93899999999999995,"15min":0.98799999999999999},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.8480000000000001},"last":0.94899999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0349999999999999,"15min":1.069},"min":{"1min":0.45000000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.726,"5min":1.895,"15min":1.9710000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.93799999999999994,"15min":1.0329999999999999},"min":{"1min":0.499,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.5700000000000001,"5min":2.319,"15min":2.319},"last":1.024}]},{"osd":4,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.153,"15min":1.2230000000000001},"min":{"1min":0.77600000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.635,"5min":1.7210000000000001,"15min":2.294},"last":1.427},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1379999999999999,"15min":1.2350000000000001},"min":{"1min":0.83499999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.663,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.1160000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.224,"15min":1.3440000000000001},"min":{"1min":0.751,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.7609999999999999,"5min":2.1509999999999998,"15min":2.5819999999999999},"last":1.23},{"interface":"front","average":{"1min":1.393,"5min":1.359,"15min":1.3799999999999999},"min":{"1min":1.046,"5min":0.83899999999999997,"15min":0.76700000000000002},"max":{"1min":1.9450000000000001,"5min":1.9650000000000001,"15min":2.4569999999999999},"last":1.5489999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2509999999999999,"15min":1.355},"min":{"1min":0.82199999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5569999999999999,"5min":2.198,"15min":3.2389999999999999},"last":1.782},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.25,"15min":1.337},"min":{"1min":0.82299999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.839,"5min":1.992,"15min":2.2810000000000001},"last":1.5760000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.331,"15min":1.367},"min":{"1min":0.78700000000000003,"5min":0.755,"15min":0.755},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.3690000000000002},"last":1.3},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.325,"15min":1.466},"min":{"1min":0.86099999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.845,"5min":1.9630000000000001,"15min":3.3500000000000001},"last":1.8640000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103368,"kb_used_data":72184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94268472,"statfs":{"total":96636764160,"available":96530915328,"internally_reserved":0,"allocated":73916416,"data_stored":73357314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.35899999999999999},"max":{"1min":1.2969999999999999,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.78900000000000003,"15min":0.86799999999999999},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5720000000000001,"5min":1.593,"15min":1.593},"last":1.2509999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.86699999999999999,"15min":0.93999999999999995},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1080000000000001,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":1.3540000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.90200000000000002,"15min":0.99099999999999999},"min":{"1min":0.49099999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.83599999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.97899999999999998,"15min":0.94499999999999995},"min":{"1min":0.46100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.0289999999999999,"5min":9.4939999999999998,"15min":9.4939999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0589999999999999,"15min":1.133},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6060000000000001,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":1.837}]},{"osd":4,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3169999999999999,"15min":1.3089999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.753},"max":{"1min":2.081,"5min":4.9290000000000003,"15min":4.9290000000000003},"last":1.726},{"interface":"front","average":{"1min":1.141,"5min":1.3140000000000001,"15min":1.2589999999999999},"min":{"1min":0.83999999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.738,"5min":9.7240000000000002,"15min":9.7240000000000002},"last":1.6859999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.288,"15min":1.278},"min":{"1min":0.76000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.8280000000000001,"5min":9.6039999999999992,"15min":9.6039999999999992},"last":1.296},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3400000000000001,"15min":1.375},"min":{"1min":0.95399999999999996,"5min":0.754,"15min":0.754},"max":{"1min":1.9670000000000001,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":1.9410000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.327,"15min":1.387},"min":{"1min":0.81000000000000005,"5min":0.77300000000000002,"15min":0.76900000000000002},"max":{"1min":2.1240000000000001,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":1.992},{"interface":"front","average":{"1min":1.2,"5min":1.242,"15min":1.337},"min":{"1min":0.86399999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.9319999999999999,"5min":2.0590000000000002,"15min":2.6709999999999998},"last":1.413}]},{"osd":7,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.357,"15min":1.421},"min":{"1min":0.91200000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.1669999999999998,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3580000000000001,"15min":1.347},"min":{"1min":0.78200000000000003,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.3639999999999999,"5min":9.9320000000000004,"15min":9.9320000000000004},"last":1.532}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:24:22.093 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:24:22.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.301+0000 7f5abd353640 1 Processor -- start 2023-11-26T07:24:22.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.301+0000 7f5abd353640 1 -- start start 2023-11-26T07:24:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.302+0000 7f5abd353640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ab815c7f0 0x7f5ab806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.302+0000 7f5abd353640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5ab80cf450 0x7f5ab80cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5abd353640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ab80cdfb0 0x7f5ab80ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5abd353640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab8156010 con 0x7f5ab80cdfb0 2023-11-26T07:24:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5abd353640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab806ce30 con 0x7f5ab80cf450 2023-11-26T07:24:22.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5abd353640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80cfe10 con 0x7f5ab815c7f0 2023-11-26T07:24:22.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5ab77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ab80cdfb0 0x7f5ab80ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:22.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5ab77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ab80cdfb0 0x7f5ab80ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53124/0 (socket says 172.21.15.77:53124) 2023-11-26T07:24:22.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5ab77fe640 1 -- 172.21.15.77:0/2045436848 learned_addr learned my addr 172.21.15.77:0/2045436848 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:22.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5ab6ffd640 1 --2- 172.21.15.77:0/2045436848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ab815c7f0 0x7f5ab806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5ab67fc640 1 --2- 172.21.15.77:0/2045436848 >> v2:172.21.15.159:3300/0 conn(0x7f5ab80cf450 0x7f5ab80cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5ab77fe640 1 -- 172.21.15.77:0/2045436848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ab815c7f0 msgr2=0x7f5ab806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5ab77fe640 1 --2- 172.21.15.77:0/2045436848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ab815c7f0 0x7f5ab806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5ab77fe640 1 -- 172.21.15.77:0/2045436848 >> v2:172.21.15.159:3300/0 conn(0x7f5ab80cf450 msgr2=0x7f5ab80cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:22.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5ab77fe640 1 --2- 172.21.15.77:0/2045436848 >> v2:172.21.15.159:3300/0 conn(0x7f5ab80cf450 0x7f5ab80cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.303+0000 7f5ab77fe640 1 -- 172.21.15.77:0/2045436848 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab80cece0 con 0x7f5ab80cdfb0 2023-11-26T07:24:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.305+0000 7f5ab77fe640 1 --2- 172.21.15.77:0/2045436848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80cdfb0 0x7f5ab80ce440 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f5ab806b550 tx=0x7f5ab002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596762d9bf8bfb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.305+0000 7f5ab5ffb640 1 -- 172.21.15.77:0/2045436848 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab002ca80 con 0x7f5ab80cdfb0 2023-11-26T07:24:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.305+0000 7f5ab5ffb640 1 -- 172.21.15.77:0/2045436848 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab002cbe0 con 0x7f5ab80cdfb0 2023-11-26T07:24:22.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.305+0000 7f5ab5ffb640 1 -- 172.21.15.77:0/2045436848 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab00343f0 con 0x7f5ab80cdfb0 2023-11-26T07:24:22.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.305+0000 7f5abd353640 1 -- 172.21.15.77:0/2045436848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80cdfb0 msgr2=0x7f5ab80ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:22.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.305+0000 7f5abd353640 1 --2- 172.21.15.77:0/2045436848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80cdfb0 0x7f5ab80ce440 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f5ab806b550 tx=0x7f5ab002bee0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.306+0000 7f5abd353640 1 -- 172.21.15.77:0/2045436848 shutdown_connections 2023-11-26T07:24:22.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.306+0000 7f5abd353640 1 --2- 172.21.15.77:0/2045436848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80cdfb0 0x7f5ab80ce440 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.306+0000 7f5abd353640 1 --2- 172.21.15.77:0/2045436848 >> v2:172.21.15.159:3300/0 conn(0x7f5ab80cf450 0x7f5ab80cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.306+0000 7f5abd353640 1 --2- 172.21.15.77:0/2045436848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ab815c7f0 0x7f5ab806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.306+0000 7f5abd353640 1 -- 172.21.15.77:0/2045436848 >> 172.21.15.77:0/2045436848 conn(0x7f5ab806a920 msgr2=0x7f5ab806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:22.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.306+0000 7f5abd353640 1 -- 172.21.15.77:0/2045436848 shutdown_connections 2023-11-26T07:24:22.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.306+0000 7f5abd353640 1 -- 172.21.15.77:0/2045436848 wait complete. 2023-11-26T07:24:22.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.307+0000 7f5abd353640 1 Processor -- start 2023-11-26T07:24:22.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.308+0000 7f5abd353640 1 -- start start 2023-11-26T07:24:22.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.308+0000 7f5abd353640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ab80cdfb0 0x7f5ab8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.308+0000 7f5abd353640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ab80cf450 0x7f5ab8149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5abd353640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab815c7f0 0x7f5ab8156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5abd353640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8156c30 con 0x7f5ab815c7f0 2023-11-26T07:24:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5abd353640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8156f10 con 0x7f5ab80cdfb0 2023-11-26T07:24:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5abd353640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab81571f0 con 0x7f5ab80cf450 2023-11-26T07:24:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5ab77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab815c7f0 0x7f5ab8156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5ab77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab815c7f0 0x7f5ab8156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53130/0 (socket says 172.21.15.77:53130) 2023-11-26T07:24:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5ab77fe640 1 -- 172.21.15.77:0/110429111 learned_addr learned my addr 172.21.15.77:0/110429111 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5ab6ffd640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ab80cdfb0 0x7f5ab8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5ab67fc640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ab80cf450 0x7f5ab8149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5ab77fe640 1 -- 172.21.15.77:0/110429111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ab80cf450 msgr2=0x7f5ab8149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5ab77fe640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ab80cf450 0x7f5ab8149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5ab77fe640 1 -- 172.21.15.77:0/110429111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ab80cdfb0 msgr2=0x7f5ab8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5ab77fe640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ab80cdfb0 0x7f5ab8157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.309+0000 7f5ab77fe640 1 -- 172.21.15.77:0/110429111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0009b30 con 0x7f5ab815c7f0 2023-11-26T07:24:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.310+0000 7f5ab77fe640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab815c7f0 0x7f5ab8156170 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0036040 tx=0x7f5ab0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.310+0000 7f5a9f7fe640 1 -- 172.21.15.77:0/110429111 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0009510 con 0x7f5ab815c7f0 2023-11-26T07:24:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.310+0000 7f5a9f7fe640 1 -- 172.21.15.77:0/110429111 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab003e450 con 0x7f5ab815c7f0 2023-11-26T07:24:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.310+0000 7f5abd353640 1 -- 172.21.15.77:0/110429111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab81574d0 con 0x7f5ab815c7f0 2023-11-26T07:24:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.310+0000 7f5a9f7fe640 1 -- 172.21.15.77:0/110429111 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab003e7e0 con 0x7f5ab815c7f0 2023-11-26T07:24:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.310+0000 7f5abd353640 1 -- 172.21.15.77:0/110429111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab8154a10 con 0x7f5ab815c7f0 2023-11-26T07:24:22.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.311+0000 7f5abd353640 1 -- 172.21.15.77:0/110429111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab81579f0 con 0x7f5ab815c7f0 2023-11-26T07:24:22.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.312+0000 7f5a9f7fe640 1 -- 172.21.15.77:0/110429111 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f5ab002cd50 con 0x7f5ab815c7f0 2023-11-26T07:24:22.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.314+0000 7f5a9f7fe640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa406b920 0x7f5aa406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:22.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.314+0000 7f5a9f7fe640 1 -- 172.21.15.77:0/110429111 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5ab00aa700 con 0x7f5ab815c7f0 2023-11-26T07:24:22.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.314+0000 7f5ab6ffd640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa406b920 0x7f5aa406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:22.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.314+0000 7f5ab6ffd640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa406b920 0x7f5aa406dde0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8006fd0 tx=0x7f5aa8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:22.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.318+0000 7f5a9f7fe640 1 -- 172.21.15.77:0/110429111 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ab0077200 con 0x7f5ab815c7f0 2023-11-26T07:24:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.504+0000 7f5abd353640 1 -- 172.21.15.77:0/110429111 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ab806d600 con 0x7f5aa406b920 2023-11-26T07:24:22.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.507+0000 7f5a9f7fe640 1 -- 172.21.15.77:0/110429111 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48498 (secure 0 0 0) 0x7f5aa800b200 con 0x7f5aa406b920 2023-11-26T07:24:22.578 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:22.580 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:24:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 -- 172.21.15.77:0/110429111 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa406b920 msgr2=0x7f5aa406dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:22.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa406b920 0x7f5aa406dde0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8006fd0 tx=0x7f5aa8008040 comp rx=0 tx=0).stop 2023-11-26T07:24:22.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 -- 172.21.15.77:0/110429111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab815c7f0 msgr2=0x7f5ab8156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:22.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab815c7f0 0x7f5ab8156170 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0036040 tx=0x7f5ab0004a40 comp rx=0 tx=0).stop 2023-11-26T07:24:22.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 -- 172.21.15.77:0/110429111 shutdown_connections 2023-11-26T07:24:22.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f5aa406b920 0x7f5aa406dde0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab815c7f0 0x7f5ab8156170 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ab80cf450 0x7f5ab8149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 --2- 172.21.15.77:0/110429111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ab80cdfb0 0x7f5ab8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:22.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 -- 172.21.15.77:0/110429111 >> 172.21.15.77:0/110429111 conn(0x7f5ab806a920 msgr2=0x7f5ab806db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:22.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 -- 172.21.15.77:0/110429111 shutdown_connections 2023-11-26T07:24:22.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:22.510+0000 7f5abd353640 1 -- 172.21.15.77:0/110429111 wait complete. 2023-11-26T07:24:22.912 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2023-11-26T07:24:21.737162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":875760,"kb_used_data":617992,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754098960,"statfs":{"total":773094113280,"available":772197335040,"internally_reserved":0,"allocated":632823808,"data_stored":628357645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-422513665,"num_objects":-427,"num_object_clones":-1,"num_object_copies":-854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-427,"num_whiteouts":-1,"num_read":-209,"num_read_kb":-204809,"num_write":-959,"num_write_kb":-412925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.693404"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:24:15.048822+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:24:15.048822+0000","last_peered":"2023-11-26T07:24:15.048822+0000","last_clean":"2023-11-26T07:24:15.048822+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:24:15.048822+0000","last_undegraded":"2023-11-26T07:24:15.048822+0000","last_fullsized":"2023-11-26T07:24:15.048822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134088,"kb_used_data":102908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94237752,"statfs":{"total":96636764160,"available":96499458048,"internally_reserved":0,"allocated":105377792,"data_stored":104814724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0629999999999999,"15min":1.038},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6739999999999999,"5min":1.768,"15min":1.768},"last":1.377},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.103,"15min":1.079},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.514,"5min":2.298,"15min":2.298},"last":1.347}]},{"osd":1,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.085,"15min":1.0589999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.171,"15min":1.2090000000000001},"min":{"1min":0.76400000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.9650000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.2190000000000001,"15min":1.175},"min":{"1min":0.81100000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6100000000000001,"5min":1.9239999999999999,"15min":2.0760000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.173,"15min":1.262},"min":{"1min":0.81899999999999995,"5min":0.73599999999999999,"15min":0.70399999999999996},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.5339999999999998},"last":1.258}]},{"osd":3,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.177,"15min":1.2230000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6359999999999999,"5min":1.694,"15min":1.9299999999999999},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3400000000000001,"15min":1.3580000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":2.2389999999999999},"last":0.876}]},{"osd":4,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.3140000000000001,"15min":1.347},"min":{"1min":0.63,"5min":0.63,"15min":0.60599999999999998},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.774},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4279999999999999,"15min":1.4530000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.57399999999999995},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.3780000000000001},"last":1.5589999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.448,"15min":1.4870000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.65900000000000003},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.8330000000000002},"last":1.446},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3640000000000001,"15min":1.446},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.54600000000000004},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":2.149},"last":1.6759999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.5720000000000001,"15min":1.6539999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.75},"max":{"1min":2.258,"5min":2.258,"15min":2.7280000000000002},"last":1.615},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5509999999999999,"15min":1.619},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.56299999999999994},"max":{"1min":2.008,"5min":2.1349999999999998,"15min":2.4590000000000001},"last":1.7410000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":170368,"kb_used_data":139188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94201472,"statfs":{"total":96636764160,"available":96462307328,"internally_reserved":0,"allocated":142528512,"data_stored":141972971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.103,"15min":1.117},"min":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":3.2029999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.101,"15min":1.2330000000000001},"min":{"1min":0.70599999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.306,"5min":2.4279999999999999,"15min":3.169},"last":1.1519999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1839999999999999,"15min":1.1859999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.661,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.113,"5min":1.2070000000000001,"15min":1.149},"min":{"1min":0.85799999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5620000000000001,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":0.999}]},{"osd":2,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1200000000000001,"15min":1.121},"min":{"1min":0.81399999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5029999999999999,"5min":1.71,"15min":1.71},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.282,"15min":1.3600000000000001},"min":{"1min":0.94799999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":3.1110000000000002},"last":1.0649999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3009999999999999,"15min":1.2789999999999999},"min":{"1min":0.84599999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.9730000000000001,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.268,"15min":1.2629999999999999},"min":{"1min":1.0289999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.3080000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3959999999999999,"15min":1.3779999999999999},"min":{"1min":0.746,"5min":0.69099999999999995,"15min":0.56200000000000006},"max":{"1min":3.0070000000000001,"5min":4.6539999999999999,"15min":4.6539999999999999},"last":1.454},{"interface":"front","average":{"1min":1.419,"5min":1.4319999999999999,"15min":1.3879999999999999},"min":{"1min":0.96899999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.841,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":1.4339999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.391,"15min":1.403},"min":{"1min":0.72199999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.752,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.204},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5509999999999999,"15min":1.542},"min":{"1min":1.089,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":3.1230000000000002,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":1.569}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.577,"15min":1.556},"min":{"1min":1.2190000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.5600000000000001,"5min":4.202,"15min":4.202},"last":1.365},{"interface":"front","average":{"1min":1.508,"5min":1.554,"15min":1.5660000000000001},"min":{"1min":0.91600000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.9119999999999999,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.4019999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0740000000000001,"15min":1.0309999999999999},"min":{"1min":0.82999999999999996,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4199999999999999,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.228,"5min":1.1579999999999999,"15min":1.048},"min":{"1min":0.72399999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.736,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.871}]},{"osd":1,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1659999999999999,"15min":1.0880000000000001},"min":{"1min":0.82999999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5149999999999999,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":1.069},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.171,"15min":1.1679999999999999},"min":{"1min":0.73799999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.589,"5min":4.7859999999999996,"15min":4.7859999999999996},"last":0.73899999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1240000000000001,"15min":1.0640000000000001},"min":{"1min":0.79200000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.609,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.254,"15min":1.288},"min":{"1min":0.92700000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4179999999999999,"5min":3.77,"15min":3.77},"last":0.92200000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2569999999999999,"15min":1.2949999999999999},"min":{"1min":0.80000000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7450000000000001,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.254,"15min":1.2130000000000001},"min":{"1min":0.81399999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6879999999999999,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.286}]},{"osd":4,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3899999999999999,"15min":1.4470000000000001},"min":{"1min":0.80700000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7030000000000001,"5min":3.835,"15min":3.835},"last":1.76},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.415,"15min":1.4550000000000001},"min":{"1min":1.2549999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.8520000000000001,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":1.226}]},{"osd":6,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.498,"15min":1.538},"min":{"1min":0.97699999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.988,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4159999999999999,"15min":1.452},"min":{"1min":0.94499999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.734,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":1.5349999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.5289999999999999,"15min":1.589},"min":{"1min":1.3089999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.9399999999999999,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":1.331},{"interface":"front","average":{"1min":1.544,"5min":1.5409999999999999,"15min":1.591},"min":{"1min":1.2569999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.819,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":1.593}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115068,"kb_used_data":83888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94256772,"statfs":{"total":96636764160,"available":96518934528,"internally_reserved":0,"allocated":85901312,"data_stored":85349658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.012,"15min":1.1100000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.385,"5min":1.6040000000000001,"15min":2.7440000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0940000000000001,"15min":1.028},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.458,"5min":2.04,"15min":2.04},"last":1.72}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.78500000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.587,"5min":1.7509999999999999,"15min":2.2850000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.23,"5min":1.244,"15min":1.2410000000000001},"min":{"1min":0.80700000000000005,"5min":0.749,"15min":0.67800000000000005},"max":{"1min":1.673,"5min":1.79,"15min":1.79},"last":0.85899999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.2110000000000001,"15min":1.268},"min":{"1min":0.76400000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.595,"5min":1.964,"15min":2.3109999999999999},"last":1.036},{"interface":"front","average":{"1min":1.157,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.90000000000000002,"5min":0.72099999999999997,"15min":0.68500000000000005},"max":{"1min":1.8620000000000001,"5min":1.944,"15min":1.944},"last":1.3340000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.28,"15min":1.3089999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5049999999999999,"5min":2.2010000000000001,"15min":2.4159999999999999},"last":1.411},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3149999999999999,"15min":1.341},"min":{"1min":0.94699999999999995,"5min":0.93999999999999995,"15min":0.88900000000000001},"max":{"1min":1.6739999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.454}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.331,"15min":1.3540000000000001},"min":{"1min":0.79800000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7609999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.9359999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.448,"15min":1.494},"min":{"1min":0.98699999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.738,"5min":2.3319999999999999,"15min":2.899},"last":1.8360000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.448,"15min":1.494},"min":{"1min":1.0449999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9239999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.5660000000000001,"15min":1.6240000000000001},"min":{"1min":1.123,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.7170000000000001,"5min":2.4239999999999999,"15min":3.008},"last":1.8979999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.6319999999999999,"15min":1.7270000000000001},"min":{"1min":1.2170000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.982,"5min":2.4460000000000002,"15min":2.6059999999999999},"last":2.222},{"interface":"front","average":{"1min":1.488,"5min":1.5960000000000001,"15min":1.6819999999999999},"min":{"1min":1.0409999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0640000000000001,"5min":2.343,"15min":3.085},"last":2.0489999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78100000000000003,"15min":0.84699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.377},"max":{"1min":1.3999999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.02},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.878,"15min":0.90000000000000002},"min":{"1min":0.55400000000000005,"5min":0.41499999999999998,"15min":0.35199999999999998},"max":{"1min":1.452,"5min":1.5920000000000001,"15min":1.764},"last":0.91400000000000003}]},{"osd":1,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76600000000000001,"15min":0.83399999999999996},"min":{"1min":0.436,"5min":0.371,"15min":0.371},"max":{"1min":1.4550000000000001,"5min":1.508,"15min":1.784},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.97199999999999998},"min":{"1min":0.505,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3480000000000001,"5min":1.5649999999999999,"15min":2.2749999999999999},"last":1.123}]},{"osd":2,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.99299999999999999,"15min":1.0609999999999999},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.643,"5min":1.6559999999999999,"15min":2.7109999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.0349999999999999,"15min":1.099},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.44600000000000001},"max":{"1min":1.413,"5min":1.599,"15min":2.379},"last":0.81100000000000005}]},{"osd":4,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0820000000000001,"15min":1.121},"min":{"1min":0.76600000000000001,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4199999999999999,"5min":1.5529999999999999,"15min":2.0209999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.1839999999999999,"15min":1.3169999999999999},"min":{"1min":0.79100000000000004,"5min":0.77500000000000002,"15min":0.72999999999999998},"max":{"1min":1.645,"5min":1.766,"15min":2.859},"last":1.151}]},{"osd":5,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2090000000000001,"15min":1.331},"min":{"1min":0.86299999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.498,"5min":1.9350000000000001,"15min":2.504},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.155,"15min":1.2310000000000001},"min":{"1min":0.83999999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5189999999999999,"5min":1.8280000000000001,"15min":2.1709999999999998},"last":1.3440000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2410000000000001,"15min":1.403},"min":{"1min":0.84799999999999998,"5min":0.80400000000000005,"15min":0.79100000000000004},"max":{"1min":1.746,"5min":1.899,"15min":3.8540000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.29,"15min":1.4119999999999999},"min":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.73199999999999998},"max":{"1min":1.589,"5min":1.903,"15min":3.226},"last":1.357}]},{"osd":7,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2250000000000001,"15min":1.278},"min":{"1min":0.82899999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.605,"5min":2.129,"15min":2.1509999999999998},"last":1.391},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3580000000000001,"15min":1.482},"min":{"1min":0.86599999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.853,"5min":2.089,"15min":3.956},"last":1.591}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166332,"kb_used_data":130992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94205508,"statfs":{"total":96636764160,"available":96466440192,"internally_reserved":0,"allocated":134135808,"data_stored":133584154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78700000000000003,"15min":0.93500000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.827,"5min":1.827,"15min":2.7799999999999998},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.002,"5min":0.90200000000000002,"15min":1.044},"min":{"1min":0.505,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.972,"5min":2.0459999999999998,"15min":2.8300000000000001},"last":0.64500000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79700000000000004,"15min":0.93899999999999995},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2470000000000001,"5min":1.5229999999999999,"15min":1.645},"last":1.464},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.877,"15min":1.0009999999999999},"min":{"1min":0.55300000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.304,"5min":1.6990000000000001,"15min":1.901},"last":0.94099999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.877,"15min":1.028},"min":{"1min":0.44700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.9039999999999999,"5min":2.2240000000000002,"15min":2.4100000000000001},"last":1.145},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0529999999999999,"15min":1.2070000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.7490000000000001,"5min":1.8939999999999999,"15min":2.5619999999999998},"last":2.04}]},{"osd":4,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1859999999999999,"15min":1.264},"min":{"1min":0.91800000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.677,"5min":1.8939999999999999,"15min":2.0129999999999999},"last":1.8560000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1679999999999999,"15min":1.268},"min":{"1min":0.81000000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.849,"5min":1.849,"15min":2.3359999999999999},"last":1.3979999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.135,"15min":1.2270000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.901},"last":1.54},{"interface":"front","average":{"1min":1.228,"5min":1.206,"15min":1.3540000000000001},"min":{"1min":0.84599999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.796,"5min":1.796,"15min":2.395},"last":2.1349999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3180000000000001,"15min":1.4279999999999999},"min":{"1min":0.93600000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.5329999999999999},"last":1.9119999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.266,"15min":1.3300000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.6579999999999999,"5min":2.0750000000000002,"15min":2.2280000000000002},"last":1.6990000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.327,"15min":1.4590000000000001},"min":{"1min":0.94299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.0760000000000001,"5min":2.1309999999999998,"15min":2.4710000000000001},"last":2.0939999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.3240000000000001,"15min":1.409},"min":{"1min":0.90200000000000002,"5min":0.86099999999999999,"15min":0.73399999999999999},"max":{"1min":1.74,"5min":2.1320000000000001,"15min":2.4009999999999998},"last":1.8260000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122252,"kb_used_data":86912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94249588,"statfs":{"total":96636764160,"available":96511578112,"internally_reserved":0,"allocated":88997888,"data_stored":88437622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.749,"15min":0.80500000000000005},"min":{"1min":0.45500000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.23,"5min":1.589,"15min":1.589},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.83999999999999997,"15min":0.93600000000000005},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.722,"5min":2.2909999999999999,"15min":2.6960000000000002},"last":1.6120000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.85899999999999999},"min":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.93899999999999995,"15min":0.98799999999999999},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.8480000000000001},"last":0.94899999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0349999999999999,"15min":1.069},"min":{"1min":0.45000000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.726,"5min":1.895,"15min":1.9710000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.93799999999999994,"15min":1.0329999999999999},"min":{"1min":0.499,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.5700000000000001,"5min":2.319,"15min":2.319},"last":1.024}]},{"osd":4,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.153,"15min":1.2230000000000001},"min":{"1min":0.77600000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.635,"5min":1.7210000000000001,"15min":2.294},"last":1.427},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1379999999999999,"15min":1.2350000000000001},"min":{"1min":0.83499999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.663,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.1160000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.224,"15min":1.3440000000000001},"min":{"1min":0.751,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.7609999999999999,"5min":2.1509999999999998,"15min":2.5819999999999999},"last":1.23},{"interface":"front","average":{"1min":1.393,"5min":1.359,"15min":1.3799999999999999},"min":{"1min":1.046,"5min":0.83899999999999997,"15min":0.76700000000000002},"max":{"1min":1.9450000000000001,"5min":1.9650000000000001,"15min":2.4569999999999999},"last":1.5489999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2509999999999999,"15min":1.355},"min":{"1min":0.82199999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5569999999999999,"5min":2.198,"15min":3.2389999999999999},"last":1.782},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.25,"15min":1.337},"min":{"1min":0.82299999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.839,"5min":1.992,"15min":2.2810000000000001},"last":1.5760000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.331,"15min":1.367},"min":{"1min":0.78700000000000003,"5min":0.755,"15min":0.755},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.3690000000000002},"last":1.3},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.325,"15min":1.466},"min":{"1min":0.86099999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.845,"5min":1.9630000000000001,"15min":3.3500000000000001},"last":1.8640000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103368,"kb_used_data":72184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94268472,"statfs":{"total":96636764160,"available":96530915328,"internally_reserved":0,"allocated":73916416,"data_stored":73357314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.35899999999999999},"max":{"1min":1.2969999999999999,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.78900000000000003,"15min":0.86799999999999999},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5720000000000001,"5min":1.593,"15min":1.593},"last":1.2509999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.86699999999999999,"15min":0.93999999999999995},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1080000000000001,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":1.3540000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.90200000000000002,"15min":0.99099999999999999},"min":{"1min":0.49099999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.83599999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.97899999999999998,"15min":0.94499999999999995},"min":{"1min":0.46100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.0289999999999999,"5min":9.4939999999999998,"15min":9.4939999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0589999999999999,"15min":1.133},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6060000000000001,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":1.837}]},{"osd":4,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3169999999999999,"15min":1.3089999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.753},"max":{"1min":2.081,"5min":4.9290000000000003,"15min":4.9290000000000003},"last":1.726},{"interface":"front","average":{"1min":1.141,"5min":1.3140000000000001,"15min":1.2589999999999999},"min":{"1min":0.83999999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.738,"5min":9.7240000000000002,"15min":9.7240000000000002},"last":1.6859999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.288,"15min":1.278},"min":{"1min":0.76000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.8280000000000001,"5min":9.6039999999999992,"15min":9.6039999999999992},"last":1.296},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3400000000000001,"15min":1.375},"min":{"1min":0.95399999999999996,"5min":0.754,"15min":0.754},"max":{"1min":1.9670000000000001,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":1.9410000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.327,"15min":1.387},"min":{"1min":0.81000000000000005,"5min":0.77300000000000002,"15min":0.76900000000000002},"max":{"1min":2.1240000000000001,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":1.992},{"interface":"front","average":{"1min":1.2,"5min":1.242,"15min":1.337},"min":{"1min":0.86399999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.9319999999999999,"5min":2.0590000000000002,"15min":2.6709999999999998},"last":1.413}]},{"osd":7,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.357,"15min":1.421},"min":{"1min":0.91200000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.1669999999999998,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3580000000000001,"15min":1.347},"min":{"1min":0.78200000000000003,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.3639999999999999,"5min":9.9320000000000004,"15min":9.9320000000000004},"last":1.532}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:24:22.914 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-26T07:24:22.914 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:24:23.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.125+0000 7faa819d0640 1 Processor -- start 2023-11-26T07:24:23.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.125+0000 7faa819d0640 1 -- start start 2023-11-26T07:24:23.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.127+0000 7faa819d0640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7faa7c06db20 0x7faa7c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.127+0000 7faa819d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c13f9e0 con 0x7faa7c13d120 2023-11-26T07:24:23.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.127+0000 7faa819d0640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c13fcc0 con 0x7faa7c06d6c0 2023-11-26T07:24:23.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.127+0000 7faa819d0640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c13ffa0 con 0x7faa7c06db20 2023-11-26T07:24:23.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.127+0000 7faa809ce640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7faa7c13d120 0x7faa7c15af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45128/0 (socket says 172.21.15.77:45128) 2023-11-26T07:24:23.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.127+0000 7faa809ce640 1 -- 172.21.15.77:0/529129382 learned_addr learned my addr 172.21.15.77:0/529129382 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:23.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178473338 0 0) 0x7faa7c13f9e0 con 0x7faa7c13d120 2023-11-26T07:24:23.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa6c005730 con 0x7faa7c13d120 2023-11-26T07:24:23.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa811cf640 1 --2- 172.21.15.77:0/529129382 >> v2:172.21.15.159:3300/0 conn(0x7faa7c06db20 0x7faa7c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 895197785 0 0) 0x7faa6c005730 con 0x7faa7c13d120 2023-11-26T07:24:23.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 >> v2:172.21.15.159:3300/0 conn(0x7faa7c06db20 msgr2=0x7faa7c0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:23.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 --2- 172.21.15.77:0/529129382 >> v2:172.21.15.159:3300/0 conn(0x7faa7c06db20 0x7faa7c0ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 >> v1:172.21.15.159:6789/0 conn(0x7faa7c06d6c0 legacy=0x7faa7c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c140280 con 0x7faa7c13d120 2023-11-26T07:24:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7faa70001670 con 0x7faa7c13d120 2023-11-26T07:24:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 >> v1:172.21.15.77:6789/0 conn(0x7faa7c13d120 legacy=0x7faa7c15af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 --2- 172.21.15.77:0/529129382 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa6c005b80 0x7faa6c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 --2- 172.21.15.77:0/529129382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa6c0069d0 0x7faa6c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 --2- 172.21.15.77:0/529129382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 0x7faa6c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c13ffa0 con 0x7faa6c0074b0 2023-11-26T07:24:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c00e380 con 0x7faa6c0069d0 2023-11-26T07:24:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.128+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c00e540 con 0x7faa6c005b80 2023-11-26T07:24:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.129+0000 7faa811cf640 1 --2- 172.21.15.77:0/529129382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 0x7faa6c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.129+0000 7faa809ce640 1 --2- 172.21.15.77:0/529129382 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa6c005b80 0x7faa6c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.129+0000 7faa7bfff640 1 --2- 172.21.15.77:0/529129382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa6c0069d0 0x7faa6c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.129+0000 7faa811cf640 1 -- 172.21.15.77:0/529129382 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa6c005b80 msgr2=0x7faa6c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.129+0000 7faa811cf640 1 --2- 172.21.15.77:0/529129382 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa6c005b80 0x7faa6c005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.129+0000 7faa811cf640 1 -- 172.21.15.77:0/529129382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa6c0069d0 msgr2=0x7faa6c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.129+0000 7faa811cf640 1 --2- 172.21.15.77:0/529129382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa6c0069d0 0x7faa6c006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.129+0000 7faa811cf640 1 -- 172.21.15.77:0/529129382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c005730 con 0x7faa6c0074b0 2023-11-26T07:24:23.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.130+0000 7faa811cf640 1 -- 172.21.15.77:0/529129382 reap_dead start 2023-11-26T07:24:23.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.130+0000 7faa811cf640 1 --2- 172.21.15.77:0/529129382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 0x7faa6c00db90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7faa74007330 tx=0x7faa6c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a1b2c31d3b4689 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:23.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.131+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7402ccd0 con 0x7faa6c0074b0 2023-11-26T07:24:23.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.131+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7402ce30 con 0x7faa6c0074b0 2023-11-26T07:24:23.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.131+0000 7faa7b7fe640 1 -- 172.21.15.77:0/529129382 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74003bd0 con 0x7faa6c0074b0 2023-11-26T07:24:23.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.131+0000 7faa819d0640 1 -- 172.21.15.77:0/529129382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 msgr2=0x7faa6c00db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.131+0000 7faa819d0640 1 --2- 172.21.15.77:0/529129382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 0x7faa6c00db90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7faa74007330 tx=0x7faa6c007a00 comp rx=0 tx=0).stop 2023-11-26T07:24:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.131+0000 7faa819d0640 1 -- 172.21.15.77:0/529129382 shutdown_connections 2023-11-26T07:24:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.131+0000 7faa819d0640 1 --2- 172.21.15.77:0/529129382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 0x7faa6c00db90 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.131+0000 7faa819d0640 1 -- 172.21.15.77:0/529129382 >> 172.21.15.77:0/529129382 conn(0x7faa7c0cb830 msgr2=0x7faa7c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.131+0000 7faa819d0640 1 -- 172.21.15.77:0/529129382 shutdown_connections 2023-11-26T07:24:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.131+0000 7faa819d0640 1 -- 172.21.15.77:0/529129382 wait complete. 2023-11-26T07:24:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.133+0000 7faa819d0640 1 Processor -- start 2023-11-26T07:24:23.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.133+0000 7faa819d0640 1 -- start start 2023-11-26T07:24:23.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.134+0000 7faa819d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 0x7faa7c0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.134+0000 7faa819d0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa7c13bb30 0x7faa7c13c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.134+0000 7faa819d0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa7c13c830 0x7faa7c152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.134+0000 7faa819d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c152220 con 0x7faa6c0074b0 2023-11-26T07:24:23.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.134+0000 7faa819d0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c15d110 con 0x7faa7c13c830 2023-11-26T07:24:23.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.134+0000 7faa819d0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c15ce30 con 0x7faa7c13bb30 2023-11-26T07:24:23.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.135+0000 7faa809ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 0x7faa7c0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.135+0000 7faa809ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 0x7faa7c0cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53154/0 (socket says 172.21.15.77:53154) 2023-11-26T07:24:23.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.135+0000 7faa809ce640 1 -- 172.21.15.77:0/1316226220 learned_addr learned my addr 172.21.15.77:0/1316226220 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:23.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.135+0000 7faa809ce640 1 -- 172.21.15.77:0/1316226220 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa7c13bb30 msgr2=0x7faa7c13c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.135+0000 7faa809ce640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa7c13bb30 0x7faa7c13c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.135+0000 7faa809ce640 1 -- 172.21.15.77:0/1316226220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa7c13c830 msgr2=0x7faa7c152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.135+0000 7faa809ce640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa7c13c830 0x7faa7c152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.135+0000 7faa809ce640 1 -- 172.21.15.77:0/1316226220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c15a9d0 con 0x7faa6c0074b0 2023-11-26T07:24:23.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.135+0000 7faa809ce640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 0x7faa7c0cf010 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7faa7000e700 tx=0x7faa7000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:23.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.136+0000 7faa797fa640 1 -- 172.21.15.77:0/1316226220 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000c6c0 con 0x7faa6c0074b0 2023-11-26T07:24:23.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.136+0000 7faa797fa640 1 -- 172.21.15.77:0/1316226220 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7000c840 con 0x7faa6c0074b0 2023-11-26T07:24:23.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.136+0000 7faa797fa640 1 -- 172.21.15.77:0/1316226220 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000cbf0 con 0x7faa6c0074b0 2023-11-26T07:24:23.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.136+0000 7faa819d0640 1 -- 172.21.15.77:0/1316226220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c0ce530 con 0x7faa6c0074b0 2023-11-26T07:24:23.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.136+0000 7faa819d0640 1 -- 172.21.15.77:0/1316226220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c0ceaf0 con 0x7faa6c0074b0 2023-11-26T07:24:23.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.137+0000 7faa819d0640 1 -- 172.21.15.77:0/1316226220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c04e840 con 0x7faa6c0074b0 2023-11-26T07:24:23.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.138+0000 7faa797fa640 1 -- 172.21.15.77:0/1316226220 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7faa7000cd50 con 0x7faa6c0074b0 2023-11-26T07:24:23.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.139+0000 7faa797fa640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7faa6006b8f0 0x7faa6006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.139+0000 7faa797fa640 1 -- 172.21.15.77:0/1316226220 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faa70087df0 con 0x7faa6c0074b0 2023-11-26T07:24:23.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.139+0000 7faa7bfff640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7faa6006b8f0 0x7faa6006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.140+0000 7faa7bfff640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7faa6006b8f0 0x7faa6006ddb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faa68000f60 tx=0x7faa68009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:23.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.143+0000 7faa797fa640 1 -- 172.21.15.77:0/1316226220 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa700548f0 con 0x7faa6c0074b0 2023-11-26T07:24:23.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.331+0000 7faa819d0640 1 -- 172.21.15.77:0/1316226220 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa7c13ee90 con 0x7faa6006b8f0 2023-11-26T07:24:23.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.335+0000 7faa797fa640 1 -- 172.21.15.77:0/1316226220 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48498 (secure 0 0 0) 0x7faa7c13ee90 con 0x7faa6006b8f0 2023-11-26T07:24:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:24:23.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 -- 172.21.15.77:0/1316226220 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7faa6006b8f0 msgr2=0x7faa6006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7faa6006b8f0 0x7faa6006ddb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faa68000f60 tx=0x7faa68009040 comp rx=0 tx=0).stop 2023-11-26T07:24:23.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 -- 172.21.15.77:0/1316226220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 msgr2=0x7faa7c0cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 0x7faa7c0cf010 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7faa7000e700 tx=0x7faa7000ebc0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 -- 172.21.15.77:0/1316226220 shutdown_connections 2023-11-26T07:24:23.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7faa6006b8f0 0x7faa6006ddb0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa7c13c830 0x7faa7c152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa7c13bb30 0x7faa7c13c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 --2- 172.21.15.77:0/1316226220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0074b0 0x7faa7c0cf010 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 -- 172.21.15.77:0/1316226220 >> 172.21.15.77:0/1316226220 conn(0x7faa7c0cb830 msgr2=0x7faa7c158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:23.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 -- 172.21.15.77:0/1316226220 shutdown_connections 2023-11-26T07:24:23.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.338+0000 7faa819d0640 1 -- 172.21.15.77:0/1316226220 wait complete. 2023-11-26T07:24:23.359 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2023-11-26T07:24:21.737162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":875760,"kb_used_data":617992,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754098960,"statfs":{"total":773094113280,"available":772197335040,"internally_reserved":0,"allocated":632823808,"data_stored":628357645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-422513665,"num_objects":-427,"num_object_clones":-1,"num_object_copies":-854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-427,"num_whiteouts":-1,"num_read":-209,"num_read_kb":-204809,"num_write":-959,"num_write_kb":-412925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.693404"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:24:15.048822+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:24:15.048822+0000","last_peered":"2023-11-26T07:24:15.048822+0000","last_clean":"2023-11-26T07:24:15.048822+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:24:15.048822+0000","last_undegraded":"2023-11-26T07:24:15.048822+0000","last_fullsized":"2023-11-26T07:24:15.048822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134088,"kb_used_data":102908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94237752,"statfs":{"total":96636764160,"available":96499458048,"internally_reserved":0,"allocated":105377792,"data_stored":104814724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0629999999999999,"15min":1.038},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6739999999999999,"5min":1.768,"15min":1.768},"last":1.377},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.103,"15min":1.079},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.514,"5min":2.298,"15min":2.298},"last":1.347}]},{"osd":1,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.085,"15min":1.0589999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.171,"15min":1.2090000000000001},"min":{"1min":0.76400000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.9650000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.2190000000000001,"15min":1.175},"min":{"1min":0.81100000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6100000000000001,"5min":1.9239999999999999,"15min":2.0760000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.173,"15min":1.262},"min":{"1min":0.81899999999999995,"5min":0.73599999999999999,"15min":0.70399999999999996},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.5339999999999998},"last":1.258}]},{"osd":3,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.177,"15min":1.2230000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6359999999999999,"5min":1.694,"15min":1.9299999999999999},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3400000000000001,"15min":1.3580000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":2.2389999999999999},"last":0.876}]},{"osd":4,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.3140000000000001,"15min":1.347},"min":{"1min":0.63,"5min":0.63,"15min":0.60599999999999998},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.774},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4279999999999999,"15min":1.4530000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.57399999999999995},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.3780000000000001},"last":1.5589999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.448,"15min":1.4870000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.65900000000000003},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.8330000000000002},"last":1.446},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3640000000000001,"15min":1.446},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.54600000000000004},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":2.149},"last":1.6759999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.5720000000000001,"15min":1.6539999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.75},"max":{"1min":2.258,"5min":2.258,"15min":2.7280000000000002},"last":1.615},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5509999999999999,"15min":1.619},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.56299999999999994},"max":{"1min":2.008,"5min":2.1349999999999998,"15min":2.4590000000000001},"last":1.7410000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":170368,"kb_used_data":139188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94201472,"statfs":{"total":96636764160,"available":96462307328,"internally_reserved":0,"allocated":142528512,"data_stored":141972971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.103,"15min":1.117},"min":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":3.2029999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.101,"15min":1.2330000000000001},"min":{"1min":0.70599999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.306,"5min":2.4279999999999999,"15min":3.169},"last":1.1519999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1839999999999999,"15min":1.1859999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.661,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.113,"5min":1.2070000000000001,"15min":1.149},"min":{"1min":0.85799999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5620000000000001,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":0.999}]},{"osd":2,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1200000000000001,"15min":1.121},"min":{"1min":0.81399999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5029999999999999,"5min":1.71,"15min":1.71},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.282,"15min":1.3600000000000001},"min":{"1min":0.94799999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":3.1110000000000002},"last":1.0649999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3009999999999999,"15min":1.2789999999999999},"min":{"1min":0.84599999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.9730000000000001,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.268,"15min":1.2629999999999999},"min":{"1min":1.0289999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.3080000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3959999999999999,"15min":1.3779999999999999},"min":{"1min":0.746,"5min":0.69099999999999995,"15min":0.56200000000000006},"max":{"1min":3.0070000000000001,"5min":4.6539999999999999,"15min":4.6539999999999999},"last":1.454},{"interface":"front","average":{"1min":1.419,"5min":1.4319999999999999,"15min":1.3879999999999999},"min":{"1min":0.96899999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.841,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":1.4339999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.391,"15min":1.403},"min":{"1min":0.72199999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.752,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.204},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5509999999999999,"15min":1.542},"min":{"1min":1.089,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":3.1230000000000002,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":1.569}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.577,"15min":1.556},"min":{"1min":1.2190000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.5600000000000001,"5min":4.202,"15min":4.202},"last":1.365},{"interface":"front","average":{"1min":1.508,"5min":1.554,"15min":1.5660000000000001},"min":{"1min":0.91600000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.9119999999999999,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.4019999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0740000000000001,"15min":1.0309999999999999},"min":{"1min":0.82999999999999996,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4199999999999999,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.228,"5min":1.1579999999999999,"15min":1.048},"min":{"1min":0.72399999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.736,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.871}]},{"osd":1,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1659999999999999,"15min":1.0880000000000001},"min":{"1min":0.82999999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5149999999999999,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":1.069},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.171,"15min":1.1679999999999999},"min":{"1min":0.73799999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.589,"5min":4.7859999999999996,"15min":4.7859999999999996},"last":0.73899999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1240000000000001,"15min":1.0640000000000001},"min":{"1min":0.79200000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.609,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.254,"15min":1.288},"min":{"1min":0.92700000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4179999999999999,"5min":3.77,"15min":3.77},"last":0.92200000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2569999999999999,"15min":1.2949999999999999},"min":{"1min":0.80000000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7450000000000001,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.254,"15min":1.2130000000000001},"min":{"1min":0.81399999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6879999999999999,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.286}]},{"osd":4,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3899999999999999,"15min":1.4470000000000001},"min":{"1min":0.80700000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7030000000000001,"5min":3.835,"15min":3.835},"last":1.76},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.415,"15min":1.4550000000000001},"min":{"1min":1.2549999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.8520000000000001,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":1.226}]},{"osd":6,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.498,"15min":1.538},"min":{"1min":0.97699999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.988,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4159999999999999,"15min":1.452},"min":{"1min":0.94499999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.734,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":1.5349999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.5289999999999999,"15min":1.589},"min":{"1min":1.3089999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.9399999999999999,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":1.331},{"interface":"front","average":{"1min":1.544,"5min":1.5409999999999999,"15min":1.591},"min":{"1min":1.2569999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.819,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":1.593}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115068,"kb_used_data":83888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94256772,"statfs":{"total":96636764160,"available":96518934528,"internally_reserved":0,"allocated":85901312,"data_stored":85349658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.012,"15min":1.1100000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.385,"5min":1.6040000000000001,"15min":2.7440000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0940000000000001,"15min":1.028},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.458,"5min":2.04,"15min":2.04},"last":1.72}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.78500000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.587,"5min":1.7509999999999999,"15min":2.2850000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.23,"5min":1.244,"15min":1.2410000000000001},"min":{"1min":0.80700000000000005,"5min":0.749,"15min":0.67800000000000005},"max":{"1min":1.673,"5min":1.79,"15min":1.79},"last":0.85899999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.2110000000000001,"15min":1.268},"min":{"1min":0.76400000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.595,"5min":1.964,"15min":2.3109999999999999},"last":1.036},{"interface":"front","average":{"1min":1.157,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.90000000000000002,"5min":0.72099999999999997,"15min":0.68500000000000005},"max":{"1min":1.8620000000000001,"5min":1.944,"15min":1.944},"last":1.3340000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.28,"15min":1.3089999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5049999999999999,"5min":2.2010000000000001,"15min":2.4159999999999999},"last":1.411},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3149999999999999,"15min":1.341},"min":{"1min":0.94699999999999995,"5min":0.93999999999999995,"15min":0.88900000000000001},"max":{"1min":1.6739999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.454}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.331,"15min":1.3540000000000001},"min":{"1min":0.79800000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7609999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.9359999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.448,"15min":1.494},"min":{"1min":0.98699999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.738,"5min":2.3319999999999999,"15min":2.899},"last":1.8360000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.448,"15min":1.494},"min":{"1min":1.0449999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9239999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.5660000000000001,"15min":1.6240000000000001},"min":{"1min":1.123,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.7170000000000001,"5min":2.4239999999999999,"15min":3.008},"last":1.8979999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.6319999999999999,"15min":1.7270000000000001},"min":{"1min":1.2170000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.982,"5min":2.4460000000000002,"15min":2.6059999999999999},"last":2.222},{"interface":"front","average":{"1min":1.488,"5min":1.5960000000000001,"15min":1.6819999999999999},"min":{"1min":1.0409999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0640000000000001,"5min":2.343,"15min":3.085},"last":2.0489999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78100000000000003,"15min":0.84699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.377},"max":{"1min":1.3999999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.02},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.878,"15min":0.90000000000000002},"min":{"1min":0.55400000000000005,"5min":0.41499999999999998,"15min":0.35199999999999998},"max":{"1min":1.452,"5min":1.5920000000000001,"15min":1.764},"last":0.91400000000000003}]},{"osd":1,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76600000000000001,"15min":0.83399999999999996},"min":{"1min":0.436,"5min":0.371,"15min":0.371},"max":{"1min":1.4550000000000001,"5min":1.508,"15min":1.784},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.97199999999999998},"min":{"1min":0.505,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3480000000000001,"5min":1.5649999999999999,"15min":2.2749999999999999},"last":1.123}]},{"osd":2,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.99299999999999999,"15min":1.0609999999999999},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.643,"5min":1.6559999999999999,"15min":2.7109999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.0349999999999999,"15min":1.099},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.44600000000000001},"max":{"1min":1.413,"5min":1.599,"15min":2.379},"last":0.81100000000000005}]},{"osd":4,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0820000000000001,"15min":1.121},"min":{"1min":0.76600000000000001,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4199999999999999,"5min":1.5529999999999999,"15min":2.0209999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.1839999999999999,"15min":1.3169999999999999},"min":{"1min":0.79100000000000004,"5min":0.77500000000000002,"15min":0.72999999999999998},"max":{"1min":1.645,"5min":1.766,"15min":2.859},"last":1.151}]},{"osd":5,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2090000000000001,"15min":1.331},"min":{"1min":0.86299999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.498,"5min":1.9350000000000001,"15min":2.504},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.155,"15min":1.2310000000000001},"min":{"1min":0.83999999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5189999999999999,"5min":1.8280000000000001,"15min":2.1709999999999998},"last":1.3440000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2410000000000001,"15min":1.403},"min":{"1min":0.84799999999999998,"5min":0.80400000000000005,"15min":0.79100000000000004},"max":{"1min":1.746,"5min":1.899,"15min":3.8540000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.29,"15min":1.4119999999999999},"min":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.73199999999999998},"max":{"1min":1.589,"5min":1.903,"15min":3.226},"last":1.357}]},{"osd":7,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2250000000000001,"15min":1.278},"min":{"1min":0.82899999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.605,"5min":2.129,"15min":2.1509999999999998},"last":1.391},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3580000000000001,"15min":1.482},"min":{"1min":0.86599999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.853,"5min":2.089,"15min":3.956},"last":1.591}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166332,"kb_used_data":130992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94205508,"statfs":{"total":96636764160,"available":96466440192,"internally_reserved":0,"allocated":134135808,"data_stored":133584154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78700000000000003,"15min":0.93500000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.827,"5min":1.827,"15min":2.7799999999999998},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.002,"5min":0.90200000000000002,"15min":1.044},"min":{"1min":0.505,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.972,"5min":2.0459999999999998,"15min":2.8300000000000001},"last":0.64500000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79700000000000004,"15min":0.93899999999999995},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2470000000000001,"5min":1.5229999999999999,"15min":1.645},"last":1.464},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.877,"15min":1.0009999999999999},"min":{"1min":0.55300000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.304,"5min":1.6990000000000001,"15min":1.901},"last":0.94099999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.877,"15min":1.028},"min":{"1min":0.44700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.9039999999999999,"5min":2.2240000000000002,"15min":2.4100000000000001},"last":1.145},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0529999999999999,"15min":1.2070000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.7490000000000001,"5min":1.8939999999999999,"15min":2.5619999999999998},"last":2.04}]},{"osd":4,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1859999999999999,"15min":1.264},"min":{"1min":0.91800000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.677,"5min":1.8939999999999999,"15min":2.0129999999999999},"last":1.8560000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1679999999999999,"15min":1.268},"min":{"1min":0.81000000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.849,"5min":1.849,"15min":2.3359999999999999},"last":1.3979999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.135,"15min":1.2270000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.901},"last":1.54},{"interface":"front","average":{"1min":1.228,"5min":1.206,"15min":1.3540000000000001},"min":{"1min":0.84599999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.796,"5min":1.796,"15min":2.395},"last":2.1349999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3180000000000001,"15min":1.4279999999999999},"min":{"1min":0.93600000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.5329999999999999},"last":1.9119999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.266,"15min":1.3300000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.6579999999999999,"5min":2.0750000000000002,"15min":2.2280000000000002},"last":1.6990000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.327,"15min":1.4590000000000001},"min":{"1min":0.94299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.0760000000000001,"5min":2.1309999999999998,"15min":2.4710000000000001},"last":2.0939999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.3240000000000001,"15min":1.409},"min":{"1min":0.90200000000000002,"5min":0.86099999999999999,"15min":0.73399999999999999},"max":{"1min":1.74,"5min":2.1320000000000001,"15min":2.4009999999999998},"last":1.8260000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122252,"kb_used_data":86912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94249588,"statfs":{"total":96636764160,"available":96511578112,"internally_reserved":0,"allocated":88997888,"data_stored":88437622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.749,"15min":0.80500000000000005},"min":{"1min":0.45500000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.23,"5min":1.589,"15min":1.589},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.83999999999999997,"15min":0.93600000000000005},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.722,"5min":2.2909999999999999,"15min":2.6960000000000002},"last":1.6120000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.85899999999999999},"min":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.93899999999999995,"15min":0.98799999999999999},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.8480000000000001},"last":0.94899999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0349999999999999,"15min":1.069},"min":{"1min":0.45000000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.726,"5min":1.895,"15min":1.9710000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.93799999999999994,"15min":1.0329999999999999},"min":{"1min":0.499,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.5700000000000001,"5min":2.319,"15min":2.319},"last":1.024}]},{"osd":4,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.153,"15min":1.2230000000000001},"min":{"1min":0.77600000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.635,"5min":1.7210000000000001,"15min":2.294},"last":1.427},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1379999999999999,"15min":1.2350000000000001},"min":{"1min":0.83499999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.663,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.1160000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.224,"15min":1.3440000000000001},"min":{"1min":0.751,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.7609999999999999,"5min":2.1509999999999998,"15min":2.5819999999999999},"last":1.23},{"interface":"front","average":{"1min":1.393,"5min":1.359,"15min":1.3799999999999999},"min":{"1min":1.046,"5min":0.83899999999999997,"15min":0.76700000000000002},"max":{"1min":1.9450000000000001,"5min":1.9650000000000001,"15min":2.4569999999999999},"last":1.5489999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2509999999999999,"15min":1.355},"min":{"1min":0.82199999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5569999999999999,"5min":2.198,"15min":3.2389999999999999},"last":1.782},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.25,"15min":1.337},"min":{"1min":0.82299999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.839,"5min":1.992,"15min":2.2810000000000001},"last":1.5760000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.331,"15min":1.367},"min":{"1min":0.78700000000000003,"5min":0.755,"15min":0.755},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.3690000000000002},"last":1.3},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.325,"15min":1.466},"min":{"1min":0.86099999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.845,"5min":1.9630000000000001,"15min":3.3500000000000001},"last":1.8640000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103368,"kb_used_data":72184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94268472,"statfs":{"total":96636764160,"available":96530915328,"internally_reserved":0,"allocated":73916416,"data_stored":73357314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.35899999999999999},"max":{"1min":1.2969999999999999,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.78900000000000003,"15min":0.86799999999999999},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5720000000000001,"5min":1.593,"15min":1.593},"last":1.2509999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.86699999999999999,"15min":0.93999999999999995},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1080000000000001,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":1.3540000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.90200000000000002,"15min":0.99099999999999999},"min":{"1min":0.49099999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.83599999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.97899999999999998,"15min":0.94499999999999995},"min":{"1min":0.46100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.0289999999999999,"5min":9.4939999999999998,"15min":9.4939999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0589999999999999,"15min":1.133},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6060000000000001,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":1.837}]},{"osd":4,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3169999999999999,"15min":1.3089999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.753},"max":{"1min":2.081,"5min":4.9290000000000003,"15min":4.9290000000000003},"last":1.726},{"interface":"front","average":{"1min":1.141,"5min":1.3140000000000001,"15min":1.2589999999999999},"min":{"1min":0.83999999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.738,"5min":9.7240000000000002,"15min":9.7240000000000002},"last":1.6859999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.288,"15min":1.278},"min":{"1min":0.76000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.8280000000000001,"5min":9.6039999999999992,"15min":9.6039999999999992},"last":1.296},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3400000000000001,"15min":1.375},"min":{"1min":0.95399999999999996,"5min":0.754,"15min":0.754},"max":{"1min":1.9670000000000001,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":1.9410000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.327,"15min":1.387},"min":{"1min":0.81000000000000005,"5min":0.77300000000000002,"15min":0.76900000000000002},"max":{"1min":2.1240000000000001,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":1.992},{"interface":"front","average":{"1min":1.2,"5min":1.242,"15min":1.337},"min":{"1min":0.86399999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.9319999999999999,"5min":2.0590000000000002,"15min":2.6709999999999998},"last":1.413}]},{"osd":7,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.357,"15min":1.421},"min":{"1min":0.91200000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.1669999999999998,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3580000000000001,"15min":1.347},"min":{"1min":0.78200000000000003,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.3639999999999999,"5min":9.9320000000000004,"15min":9.9320000000000004},"last":1.532}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:24:23.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:24:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.569+0000 7f6cadcbb640 1 Processor -- start 2023-11-26T07:24:23.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.569+0000 7f6cadcbb640 1 -- start start 2023-11-26T07:24:23.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6cadcbb640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6ca814b100 0x7f6ca8162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6cadcbb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ca80cd160 0x7f6ca80cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6cadcbb640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca8162eb0 con 0x7f6ca80703f0 2023-11-26T07:24:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6cadcbb640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca81654a0 con 0x7f6ca814b100 2023-11-26T07:24:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6cadcbb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80ccf00 con 0x7f6ca80cd160 2023-11-26T07:24:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6caccb9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6ca814b100 0x7f6ca8162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6caccb9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6ca814b100 0x7f6ca8162970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53166/0 (socket says 172.21.15.77:53166) 2023-11-26T07:24:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6caccb9640 1 -- 172.21.15.77:0/2976263096 learned_addr learned my addr 172.21.15.77:0/2976263096 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:23.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6cad4ba640 1 --2- 172.21.15.77:0/2976263096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ca80cd160 0x7f6ca80cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6caccb9640 1 -- 172.21.15.77:0/2976263096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ca80cd160 msgr2=0x7f6ca80cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:23.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6caccb9640 1 --2- 172.21.15.77:0/2976263096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ca80cd160 0x7f6ca80cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6caccb9640 1 -- 172.21.15.77:0/2976263096 >> v1:172.21.15.159:6789/0 conn(0x7f6ca80703f0 legacy=0x7f6ca8165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:23.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.571+0000 7f6caccb9640 1 -- 172.21.15.77:0/2976263096 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8166320 con 0x7f6ca814b100 2023-11-26T07:24:23.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.572+0000 7f6caccb9640 1 --2- 172.21.15.77:0/2976263096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca814b100 0x7f6ca8162970 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009870 tx=0x7f6c9802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2706df824c5ccce8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.573+0000 7f6ca77fe640 1 -- 172.21.15.77:0/2976263096 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c980317c0 con 0x7f6ca814b100 2023-11-26T07:24:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.573+0000 7f6ca77fe640 1 -- 172.21.15.77:0/2976263096 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98031920 con 0x7f6ca814b100 2023-11-26T07:24:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.573+0000 7f6ca77fe640 1 -- 172.21.15.77:0/2976263096 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98031cb0 con 0x7f6ca814b100 2023-11-26T07:24:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.573+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2976263096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca814b100 msgr2=0x7f6ca8162970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.573+0000 7f6cadcbb640 1 --2- 172.21.15.77:0/2976263096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca814b100 0x7f6ca8162970 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009870 tx=0x7f6c9802b860 comp rx=0 tx=0).stop 2023-11-26T07:24:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.573+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2976263096 shutdown_connections 2023-11-26T07:24:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.573+0000 7f6cadcbb640 1 --2- 172.21.15.77:0/2976263096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ca80cd160 0x7f6ca80cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.573+0000 7f6cadcbb640 1 --2- 172.21.15.77:0/2976263096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca814b100 0x7f6ca8162970 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.573+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2976263096 >> 172.21.15.77:0/2976263096 conn(0x7f6ca80cb830 msgr2=0x7f6ca80cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.574+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2976263096 shutdown_connections 2023-11-26T07:24:23.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.574+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2976263096 wait complete. 2023-11-26T07:24:23.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.575+0000 7f6cadcbb640 1 Processor -- start 2023-11-26T07:24:23.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.575+0000 7f6cadcbb640 1 -- start start 2023-11-26T07:24:23.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.576+0000 7f6cadcbb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ca80703f0 0x7f6ca80afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.576+0000 7f6cadcbb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80cd160 0x7f6ca80b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.576+0000 7f6cadcbb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca814b100 0x7f6ca8153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.576+0000 7f6cadcbb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80b2140 con 0x7f6ca80cd160 2023-11-26T07:24:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.576+0000 7f6cadcbb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80b50a0 con 0x7f6ca814b100 2023-11-26T07:24:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.576+0000 7f6cadcbb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80b4dc0 con 0x7f6ca80703f0 2023-11-26T07:24:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6ca7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80cd160 0x7f6ca80b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6ca7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80cd160 0x7f6ca80b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53176/0 (socket says 172.21.15.77:53176) 2023-11-26T07:24:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6ca7fff640 1 -- 172.21.15.77:0/2745790998 learned_addr learned my addr 172.21.15.77:0/2745790998 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6cad4ba640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca814b100 0x7f6ca8153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6ca7fff640 1 -- 172.21.15.77:0/2745790998 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ca80703f0 msgr2=0x7f6ca80afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6caccb9640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ca80703f0 0x7f6ca80afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6ca7fff640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ca80703f0 0x7f6ca80afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6ca7fff640 1 -- 172.21.15.77:0/2745790998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca814b100 msgr2=0x7f6ca8153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6ca7fff640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca814b100 0x7f6ca8153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6ca7fff640 1 -- 172.21.15.77:0/2745790998 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980094d0 con 0x7f6ca80cd160 2023-11-26T07:24:23.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6cad4ba640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca814b100 0x7f6ca8153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:23.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.577+0000 7f6caccb9640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ca80703f0 0x7f6ca80afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:23.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.578+0000 7f6ca7fff640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80cd160 0x7f6ca80b03f0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400c400 tx=0x7f6c9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:23.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.578+0000 7f6ca57fa640 1 -- 172.21.15.77:0/2745790998 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94011790 con 0x7f6ca80cd160 2023-11-26T07:24:23.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.578+0000 7f6ca57fa640 1 -- 172.21.15.77:0/2745790998 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c94011930 con 0x7f6ca80cd160 2023-11-26T07:24:23.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.578+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2745790998 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca8150ea0 con 0x7f6ca80cd160 2023-11-26T07:24:23.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.578+0000 7f6ca57fa640 1 -- 172.21.15.77:0/2745790998 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94011ce0 con 0x7f6ca80cd160 2023-11-26T07:24:23.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.578+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2745790998 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca8151460 con 0x7f6ca80cd160 2023-11-26T07:24:23.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.579+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2745790998 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca8150d00 con 0x7f6ca80cd160 2023-11-26T07:24:23.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.580+0000 7f6ca57fa640 1 -- 172.21.15.77:0/2745790998 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f6c9401c460 con 0x7f6ca80cd160 2023-11-26T07:24:23.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.581+0000 7f6ca57fa640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6c9006b8f0 0x7f6c9006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:23.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.581+0000 7f6ca57fa640 1 -- 172.21.15.77:0/2745790998 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6c94087e30 con 0x7f6ca80cd160 2023-11-26T07:24:23.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.582+0000 7f6caccb9640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6c9006b8f0 0x7f6c9006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:23.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.582+0000 7f6caccb9640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6c9006b8f0 0x7f6c9006ddb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6c98036000 tx=0x7f6c9803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:23.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.585+0000 7f6ca57fa640 1 -- 172.21.15.77:0/2745790998 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ca8150d00 con 0x7f6ca80cd160 2023-11-26T07:24:23.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.776+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2745790998 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ca8150d00 con 0x7f6ca80cd160 2023-11-26T07:24:23.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.777+0000 7f6ca57fa640 1 -- 172.21.15.77:0/2745790998 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+12963 (secure 0 0 0) 0x7f6ca8150d00 con 0x7f6ca80cd160 2023-11-26T07:24:23.778 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:23.779 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":80,"fsid":"957368bd-e942-499b-9938-86266ae9bafb","created":"2023-11-26T07:17:10.562568+0000","modified":"2023-11-26T07:24:18.058950+0000","last_up_change":"2023-11-26T07:17:22.873185+0000","last_in_change":"2023-11-26T07:17:13.966900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:23.676498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"52fc69a9-f720-4f47-9380-45380d7cd6cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6801","nonce":2431818917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6803","nonce":2431818917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6807","nonce":2431818917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2431818917},{"type":"v1","addr":"172.21.15.77:6805","nonce":2431818917}]},"public_addr":"172.21.15.77:6801/2431818917","cluster_addr":"172.21.15.77:6803/2431818917","heartbeat_back_addr":"172.21.15.77:6807/2431818917","heartbeat_front_addr":"172.21.15.77:6805/2431818917","state":["exists","up"]},{"osd":1,"uuid":"58ed8820-6e20-42a4-9aa1-777a3a87f8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6820","nonce":674756385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6823","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6826","nonce":674756385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6831","nonce":674756385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":674756385},{"type":"v1","addr":"172.21.15.77:6829","nonce":674756385}]},"public_addr":"172.21.15.77:6820/674756385","cluster_addr":"172.21.15.77:6826/674756385","heartbeat_back_addr":"172.21.15.77:6831/674756385","heartbeat_front_addr":"172.21.15.77:6829/674756385","state":["exists","up"]},{"osd":2,"uuid":"be52fac4-d4a7-4134-9604-4cc522f1825b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6810","nonce":2586530941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6814","nonce":2586530941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6824","nonce":2586530941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2586530941},{"type":"v1","addr":"172.21.15.77:6819","nonce":2586530941}]},"public_addr":"172.21.15.77:6810/2586530941","cluster_addr":"172.21.15.77:6814/2586530941","heartbeat_back_addr":"172.21.15.77:6824/2586530941","heartbeat_front_addr":"172.21.15.77:6819/2586530941","state":["exists","up"]},{"osd":3,"uuid":"b1dba02d-31b2-4897-924b-47b8d3ef925f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6811","nonce":243154578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6815","nonce":243154578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6825","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6827","nonce":243154578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":243154578},{"type":"v1","addr":"172.21.15.77:6821","nonce":243154578}]},"public_addr":"172.21.15.77:6811/243154578","cluster_addr":"172.21.15.77:6815/243154578","heartbeat_back_addr":"172.21.15.77:6827/243154578","heartbeat_front_addr":"172.21.15.77:6821/243154578","state":["exists","up"]},{"osd":4,"uuid":"89943722-64a8-4ff2-ad1a-21dd42e10ddc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6818","nonce":3986384485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6821","nonce":3986384485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6828","nonce":3986384485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":3986384485},{"type":"v1","addr":"172.21.15.159:6825","nonce":3986384485}]},"public_addr":"172.21.15.159:6818/3986384485","cluster_addr":"172.21.15.159:6821/3986384485","heartbeat_back_addr":"172.21.15.159:6828/3986384485","heartbeat_front_addr":"172.21.15.159:6825/3986384485","state":["exists","up"]},{"osd":5,"uuid":"61449b27-a919-4e28-8afd-3284ef0ab3ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6801","nonce":3212169486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6803","nonce":3212169486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6807","nonce":3212169486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3212169486},{"type":"v1","addr":"172.21.15.159:6805","nonce":3212169486}]},"public_addr":"172.21.15.159:6801/3212169486","cluster_addr":"172.21.15.159:6803/3212169486","heartbeat_back_addr":"172.21.15.159:6807/3212169486","heartbeat_front_addr":"172.21.15.159:6805/3212169486","state":["exists","up"]},{"osd":6,"uuid":"f40f87f7-a3b9-4185-baa0-d44d356c0493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6809","nonce":4233966301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6811","nonce":4233966301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6815","nonce":4233966301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4233966301},{"type":"v1","addr":"172.21.15.159:6813","nonce":4233966301}]},"public_addr":"172.21.15.159:6809/4233966301","cluster_addr":"172.21.15.159:6811/4233966301","heartbeat_back_addr":"172.21.15.159:6815/4233966301","heartbeat_front_addr":"172.21.15.159:6813/4233966301","state":["exists","up"]},{"osd":7,"uuid":"ef2b712e-4b9f-4810-a090-2c70819ac313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6817","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6820","nonce":162809389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6824","nonce":162809389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6831","nonce":162809389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6827","nonce":162809389},{"type":"v1","addr":"172.21.15.159:6829","nonce":162809389}]},"public_addr":"172.21.15.159:6820/162809389","cluster_addr":"172.21.15.159:6824/162809389","heartbeat_back_addr":"172.21.15.159:6831/162809389","heartbeat_front_addr":"172.21.15.159:6829/162809389","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.325142+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.343582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.327423+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.373227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.301986+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.308477+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.577703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:19.593377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/3837428408":"2023-11-27T07:24:15.038297+0000","172.21.15.77:6836/3837428408":"2023-11-27T07:24:15.038297+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:24:23.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.779+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2745790998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6c9006b8f0 msgr2=0x7f6c9006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.779+0000 7f6cadcbb640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6c9006b8f0 0x7f6c9006ddb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6c98036000 tx=0x7f6c9803d040 comp rx=0 tx=0).stop 2023-11-26T07:24:23.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.779+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2745790998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80cd160 msgr2=0x7f6ca80b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:23.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.779+0000 7f6cadcbb640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80cd160 0x7f6ca80b03f0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400c400 tx=0x7f6c9400c8c0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.779+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2745790998 shutdown_connections 2023-11-26T07:24:23.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.779+0000 7f6cadcbb640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6c9006b8f0 0x7f6c9006ddb0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.779+0000 7f6cadcbb640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca814b100 0x7f6ca8153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.779+0000 7f6cadcbb640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80cd160 0x7f6ca80b03f0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.779+0000 7f6cadcbb640 1 --2- 172.21.15.77:0/2745790998 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ca80703f0 0x7f6ca80afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:23.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.779+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2745790998 >> 172.21.15.77:0/2745790998 conn(0x7f6ca80cb830 msgr2=0x7f6ca80cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:23.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.780+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2745790998 shutdown_connections 2023-11-26T07:24:23.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:23.780+0000 7f6cadcbb640 1 -- 172.21.15.77:0/2745790998 wait complete. 2023-11-26T07:24:24.801 INFO:tasks.ceph:Scrubbing osd.0 2023-11-26T07:24:24.802 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:25.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.031+0000 7f2ed3905640 1 Processor -- start 2023-11-26T07:24:25.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.032+0000 7f2ed3905640 1 -- start start 2023-11-26T07:24:25.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.033+0000 7f2ed3905640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2ecc15c7f0 0x7f2ecc06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.033+0000 7f2ed3905640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc0cf450 0x7f2ecc0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.033+0000 7f2ed3905640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ecc0cece0 con 0x7f2ecc0cdfb0 2023-11-26T07:24:25.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.033+0000 7f2ed3905640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc156010 con 0x7f2ecc15c7f0 2023-11-26T07:24:25.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.033+0000 7f2ed3905640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc06ce30 con 0x7f2ecc0cf450 2023-11-26T07:24:25.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.034+0000 7f2ed0ea0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc0cf450 0x7f2ecc0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.034+0000 7f2ed0ea0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc0cf450 0x7f2ecc0cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:33030/0 (socket says 172.21.15.77:33030) 2023-11-26T07:24:25.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.034+0000 7f2ed0ea0640 1 -- 172.21.15.77:0/1914470398 learned_addr learned my addr 172.21.15.77:0/1914470398 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:25.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.034+0000 7f2ed16a1640 1 --2- 172.21.15.77:0/1914470398 >> v2:172.21.15.159:3300/0 conn(0x7f2ecc15c7f0 0x7f2ecc06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.035+0000 7f2ed0ea0640 1 -- 172.21.15.77:0/1914470398 >> v2:172.21.15.159:3300/0 conn(0x7f2ecc15c7f0 msgr2=0x7f2ecc06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:25.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.035+0000 7f2ed0ea0640 1 --2- 172.21.15.77:0/1914470398 >> v2:172.21.15.159:3300/0 conn(0x7f2ecc15c7f0 0x7f2ecc06db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.035+0000 7f2ed0ea0640 1 -- 172.21.15.77:0/1914470398 >> v1:172.21.15.159:6789/0 conn(0x7f2ecc0cdfb0 legacy=0x7f2ecc0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.035+0000 7f2ebffff640 1 -- 172.21.15.77:0/1914470398 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330870900 0 0) 0x7f2ecc0cece0 con 0x7f2ecc0cdfb0 2023-11-26T07:24:25.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.035+0000 7f2ed0ea0640 1 -- 172.21.15.77:0/1914470398 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc06d040 con 0x7f2ecc0cf450 2023-11-26T07:24:25.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.036+0000 7f2ed0ea0640 1 --2- 172.21.15.77:0/1914470398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc0cf450 0x7f2ecc0cf8d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009e50 tx=0x7f2ec002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43b1628156afc852 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:25.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.037+0000 7f2ebffff640 1 -- 172.21.15.77:0/1914470398 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec002cb00 con 0x7f2ecc0cf450 2023-11-26T07:24:25.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.037+0000 7f2ebffff640 1 -- 172.21.15.77:0/1914470398 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec002cc60 con 0x7f2ecc0cf450 2023-11-26T07:24:25.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.037+0000 7f2ebffff640 1 -- 172.21.15.77:0/1914470398 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00343f0 con 0x7f2ecc0cf450 2023-11-26T07:24:25.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.038+0000 7f2ed3905640 1 -- 172.21.15.77:0/1914470398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc0cf450 msgr2=0x7f2ecc0cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.038+0000 7f2ed3905640 1 --2- 172.21.15.77:0/1914470398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc0cf450 0x7f2ecc0cf8d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009e50 tx=0x7f2ec002bf60 comp rx=0 tx=0).stop 2023-11-26T07:24:25.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.038+0000 7f2ed3905640 1 -- 172.21.15.77:0/1914470398 shutdown_connections 2023-11-26T07:24:25.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.038+0000 7f2ed3905640 1 --2- 172.21.15.77:0/1914470398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc0cf450 0x7f2ecc0cf8d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.038+0000 7f2ed3905640 1 --2- 172.21.15.77:0/1914470398 >> v2:172.21.15.159:3300/0 conn(0x7f2ecc15c7f0 0x7f2ecc06db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.038+0000 7f2ed3905640 1 -- 172.21.15.77:0/1914470398 >> 172.21.15.77:0/1914470398 conn(0x7f2ecc06a920 msgr2=0x7f2ecc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:25.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.038+0000 7f2ed3905640 1 -- 172.21.15.77:0/1914470398 shutdown_connections 2023-11-26T07:24:25.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.038+0000 7f2ed3905640 1 -- 172.21.15.77:0/1914470398 wait complete. 2023-11-26T07:24:25.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.040+0000 7f2ed3905640 1 Processor -- start 2023-11-26T07:24:25.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.040+0000 7f2ed3905640 1 -- start start 2023-11-26T07:24:25.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.041+0000 7f2ed3905640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ecc0cdfb0 0x7f2ecc157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.041+0000 7f2ed3905640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ecc0cf450 0x7f2ecc1494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.041+0000 7f2ed3905640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc15c7f0 0x7f2ecc0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.041+0000 7f2ed3905640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0b3bb0 con 0x7f2ecc0cf450 2023-11-26T07:24:25.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.041+0000 7f2ed3905640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc149a20 con 0x7f2ecc0cdfb0 2023-11-26T07:24:25.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.041+0000 7f2ed3905640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc156b60 con 0x7f2ecc15c7f0 2023-11-26T07:24:25.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.041+0000 7f2ed0ea0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ecc0cf450 0x7f2ecc1494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.041+0000 7f2ed0ea0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ecc0cf450 0x7f2ecc1494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53186/0 (socket says 172.21.15.77:53186) 2023-11-26T07:24:25.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.041+0000 7f2ed0ea0640 1 -- 172.21.15.77:0/2390569346 learned_addr learned my addr 172.21.15.77:0/2390569346 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:25.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ed16a1640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ecc0cdfb0 0x7f2ecc157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ed1ea2640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc15c7f0 0x7f2ecc0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ed0ea0640 1 -- 172.21.15.77:0/2390569346 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc15c7f0 msgr2=0x7f2ecc0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ed0ea0640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc15c7f0 0x7f2ecc0b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ed0ea0640 1 -- 172.21.15.77:0/2390569346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ecc0cdfb0 msgr2=0x7f2ecc157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ed0ea0640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ecc0cdfb0 0x7f2ecc157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ed0ea0640 1 -- 172.21.15.77:0/2390569346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0009b30 con 0x7f2ecc0cf450 2023-11-26T07:24:25.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ed1ea2640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ecc15c7f0 0x7f2ecc0b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:25.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ed0ea0640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ecc0cf450 0x7f2ecc1494e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0000f80 tx=0x7f2ec0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:25.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ebdffb640 1 -- 172.21.15.77:0/2390569346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0009510 con 0x7f2ecc0cf450 2023-11-26T07:24:25.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ebdffb640 1 -- 172.21.15.77:0/2390569346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec003e450 con 0x7f2ecc0cf450 2023-11-26T07:24:25.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ed3905640 1 -- 172.21.15.77:0/2390569346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc156e40 con 0x7f2ecc0cf450 2023-11-26T07:24:25.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ebdffb640 1 -- 172.21.15.77:0/2390569346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec003e800 con 0x7f2ecc0cf450 2023-11-26T07:24:25.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.042+0000 7f2ed3905640 1 -- 172.21.15.77:0/2390569346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc157400 con 0x7f2ecc0cf450 2023-11-26T07:24:25.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.043+0000 7f2ed3905640 1 -- 172.21.15.77:0/2390569346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ecc06e060 con 0x7f2ecc0cf450 2023-11-26T07:24:25.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.044+0000 7f2ebdffb640 1 -- 172.21.15.77:0/2390569346 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f2ec003e960 con 0x7f2ecc0cf450 2023-11-26T07:24:25.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.045+0000 7f2ebdffb640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2eb006b8f0 0x7f2eb006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.045+0000 7f2ebdffb640 1 -- 172.21.15.77:0/2390569346 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2ec00aad40 con 0x7f2ecc0cf450 2023-11-26T07:24:25.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.046+0000 7f2ed16a1640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2eb006b8f0 0x7f2eb006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.046+0000 7f2ebdffb640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] conn(0x7f2eb0071750 0x7f2eb0073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.046+0000 7f2ebdffb640 1 -- 172.21.15.77:0/2390569346 --> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2eb0074220 con 0x7f2eb0071750 2023-11-26T07:24:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.046+0000 7f2ebdffb640 1 -- 172.21.15.77:0/2390569346 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ec00af970 con 0x7f2ecc0cf450 2023-11-26T07:24:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.046+0000 7f2ed1ea2640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] conn(0x7f2eb0071750 0x7f2eb0073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.046+0000 7f2ed16a1640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2eb006b8f0 0x7f2eb006ddb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0cc010 tx=0x7f2ec8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.047+0000 7f2ed1ea2640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] conn(0x7f2eb0071750 0x7f2eb0073b70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.047+0000 7f2ebdffb640 1 -- 172.21.15.77:0/2390569346 <== osd.0 v2:172.21.15.77:6800/2431818917 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2eb0074220 con 0x7f2eb0071750 2023-11-26T07:24:25.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.062+0000 7f2ed3905640 1 -- 172.21.15.77:0/2390569346 --> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2ecc06d600 con 0x7f2eb0071750 2023-11-26T07:24:25.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.062+0000 7f2ebdffb640 1 -- 172.21.15.77:0/2390569346 <== osd.0 v2:172.21.15.77:6800/2431818917 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2ec40050e0 con 0x7f2eb0071750 2023-11-26T07:24:25.064 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:25.064 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:25.064 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:25.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.063+0000 7f2ed3905640 1 -- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] conn(0x7f2eb0071750 msgr2=0x7f2eb0073b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.063+0000 7f2ed3905640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:6800/2431818917,v1:172.21.15.77:6801/2431818917] conn(0x7f2eb0071750 0x7f2eb0073b70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.063+0000 7f2ed3905640 1 -- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2eb006b8f0 msgr2=0x7f2eb006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.063+0000 7f2ed3905640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2eb006b8f0 0x7f2eb006ddb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0cc010 tx=0x7f2ec8008040 comp rx=0 tx=0).stop 2023-11-26T07:24:25.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.063+0000 7f2ed3905640 1 -- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ecc0cf450 msgr2=0x7f2ecc1494e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.063+0000 7f2ed3905640 1 --2- 172.21.15.77:0/2390569346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ecc0cf450 0x7f2ecc1494e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0000f80 tx=0x7f2ec0004a40 comp rx=0 tx=0).stop 2023-11-26T07:24:25.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.063+0000 7f2ed1ea2640 1 -- 172.21.15.77:0/2390569346 reap_dead start 2023-11-26T07:24:25.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.063+0000 7f2ed3905640 1 -- 172.21.15.77:0/2390569346 shutdown_connections 2023-11-26T07:24:25.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.063+0000 7f2ed3905640 1 -- 172.21.15.77:0/2390569346 >> 172.21.15.77:0/2390569346 conn(0x7f2ecc06a920 msgr2=0x7f2ecc0734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:25.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.063+0000 7f2ed3905640 1 -- 172.21.15.77:0/2390569346 shutdown_connections 2023-11-26T07:24:25.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.063+0000 7f2ed3905640 1 -- 172.21.15.77:0/2390569346 wait complete. 2023-11-26T07:24:25.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-26T07:24:25.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.289+0000 7fe80b716640 1 Processor -- start 2023-11-26T07:24:25.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.290+0000 7fe80b716640 1 -- start start 2023-11-26T07:24:25.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.291+0000 7fe80b716640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe804157c70 0x7fe804161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.291+0000 7fe80b716640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe80415e390 0x7fe8040cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.291+0000 7fe80b716640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8040ce0b0 con 0x7fe8040cf450 2023-11-26T07:24:25.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.291+0000 7fe80b716640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8040cfe40 con 0x7fe804157c70 2023-11-26T07:24:25.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.291+0000 7fe80b716640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe804161960 con 0x7fe80415e390 2023-11-26T07:24:25.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.291+0000 7fe8094b2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe804157c70 0x7fe804161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.291+0000 7fe8094b2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe804157c70 0x7fe804161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53192/0 (socket says 172.21.15.77:53192) 2023-11-26T07:24:25.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.292+0000 7fe8094b2640 1 -- 172.21.15.77:0/3091957040 learned_addr learned my addr 172.21.15.77:0/3091957040 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:25.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.292+0000 7fe8094b2640 1 -- 172.21.15.77:0/3091957040 >> v2:172.21.15.159:3300/0 conn(0x7fe80415e390 msgr2=0x7fe8040cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:25.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.292+0000 7fe8094b2640 1 --2- 172.21.15.77:0/3091957040 >> v2:172.21.15.159:3300/0 conn(0x7fe80415e390 0x7fe8040cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.292+0000 7fe8094b2640 1 -- 172.21.15.77:0/3091957040 >> v1:172.21.15.159:6789/0 conn(0x7fe8040cf450 legacy=0x7fe80415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:25.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.292+0000 7fe8094b2640 1 -- 172.21.15.77:0/3091957040 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80415e8d0 con 0x7fe804157c70 2023-11-26T07:24:25.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.293+0000 7fe8094b2640 1 --2- 172.21.15.77:0/3091957040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe804157c70 0x7fe804161df0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe8040d0100 tx=0x7fe80002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0988d6a7cb65c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:25.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.293+0000 7fe7fbfff640 1 -- 172.21.15.77:0/3091957040 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8000317e0 con 0x7fe804157c70 2023-11-26T07:24:25.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.293+0000 7fe7fbfff640 1 -- 172.21.15.77:0/3091957040 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe800031940 con 0x7fe804157c70 2023-11-26T07:24:25.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.293+0000 7fe7fbfff640 1 -- 172.21.15.77:0/3091957040 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800031cd0 con 0x7fe804157c70 2023-11-26T07:24:25.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.294+0000 7fe80b716640 1 -- 172.21.15.77:0/3091957040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe804157c70 msgr2=0x7fe804161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.294+0000 7fe80b716640 1 --2- 172.21.15.77:0/3091957040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe804157c70 0x7fe804161df0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe8040d0100 tx=0x7fe80002b880 comp rx=0 tx=0).stop 2023-11-26T07:24:25.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.294+0000 7fe80b716640 1 -- 172.21.15.77:0/3091957040 shutdown_connections 2023-11-26T07:24:25.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.294+0000 7fe80b716640 1 --2- 172.21.15.77:0/3091957040 >> v2:172.21.15.159:3300/0 conn(0x7fe80415e390 0x7fe8040cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.294+0000 7fe80b716640 1 --2- 172.21.15.77:0/3091957040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe804157c70 0x7fe804161df0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.294+0000 7fe80b716640 1 -- 172.21.15.77:0/3091957040 >> 172.21.15.77:0/3091957040 conn(0x7fe80406a920 msgr2=0x7fe80406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:25.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.294+0000 7fe80b716640 1 -- 172.21.15.77:0/3091957040 shutdown_connections 2023-11-26T07:24:25.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.294+0000 7fe80b716640 1 -- 172.21.15.77:0/3091957040 wait complete. 2023-11-26T07:24:25.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.296+0000 7fe80b716640 1 Processor -- start 2023-11-26T07:24:25.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.296+0000 7fe80b716640 1 -- start start 2023-11-26T07:24:25.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.297+0000 7fe80b716640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8040cf450 0x7fe8040ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.297+0000 7fe80b716640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe804157c70 0x7fe80413c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.297+0000 7fe80b716640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe80415e390 0x7fe8041f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.297+0000 7fe80b716640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe804150740 con 0x7fe8040cf450 2023-11-26T07:24:25.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.297+0000 7fe80b716640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe804154220 con 0x7fe80415e390 2023-11-26T07:24:25.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.297+0000 7fe80b716640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80414c5e0 con 0x7fe804157c70 2023-11-26T07:24:25.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.297+0000 7fe8094b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8040cf450 0x7fe8040ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.297+0000 7fe8094b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8040cf450 0x7fe8040ae960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53198/0 (socket says 172.21.15.77:53198) 2023-11-26T07:24:25.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.297+0000 7fe8094b2640 1 -- 172.21.15.77:0/4104250562 learned_addr learned my addr 172.21.15.77:0/4104250562 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:25.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.298+0000 7fe8094b2640 1 -- 172.21.15.77:0/4104250562 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe804157c70 msgr2=0x7fe80413c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.298+0000 7fe8094b2640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe804157c70 0x7fe80413c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.298+0000 7fe8094b2640 1 -- 172.21.15.77:0/4104250562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe80415e390 msgr2=0x7fe8041f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.298+0000 7fe8094b2640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe80415e390 0x7fe8041f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.298+0000 7fe8094b2640 1 -- 172.21.15.77:0/4104250562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8000094d0 con 0x7fe8040cf450 2023-11-26T07:24:25.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.298+0000 7fe8094b2640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8040cf450 0x7fe8040ae960 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe800000c00 tx=0x7fe8000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:25.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.298+0000 7fe7f9ffb640 1 -- 172.21.15.77:0/4104250562 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800032940 con 0x7fe8040cf450 2023-11-26T07:24:25.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.298+0000 7fe7f9ffb640 1 -- 172.21.15.77:0/4104250562 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe800032aa0 con 0x7fe8040cf450 2023-11-26T07:24:25.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.298+0000 7fe7f9ffb640 1 -- 172.21.15.77:0/4104250562 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800032e50 con 0x7fe8040cf450 2023-11-26T07:24:25.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.299+0000 7fe80b716640 1 -- 172.21.15.77:0/4104250562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8041538f0 con 0x7fe8040cf450 2023-11-26T07:24:25.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.299+0000 7fe80b716640 1 -- 172.21.15.77:0/4104250562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe804153eb0 con 0x7fe8040cf450 2023-11-26T07:24:25.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.300+0000 7fe80b716640 1 -- 172.21.15.77:0/4104250562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe804067470 con 0x7fe8040cf450 2023-11-26T07:24:25.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.301+0000 7fe7f9ffb640 1 -- 172.21.15.77:0/4104250562 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fe8000453f0 con 0x7fe8040cf450 2023-11-26T07:24:25.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.302+0000 7fe7f9ffb640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7e806b8f0 0x7fe7e806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.302+0000 7fe7f9ffb640 1 -- 172.21.15.77:0/4104250562 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe8000aa230 con 0x7fe8040cf450 2023-11-26T07:24:25.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.302+0000 7fe808cb1640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7e806b8f0 0x7fe7e806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.303+0000 7fe808cb1640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7e806b8f0 0x7fe7e806ddb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe804072a40 tx=0x7fe7f4006ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:25.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.306+0000 7fe7f9ffb640 1 -- 172.21.15.77:0/4104250562 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe800076e50 con 0x7fe8040cf450 2023-11-26T07:24:25.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.497+0000 7fe80b716640 1 -- 172.21.15.77:0/4104250562 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8041615f0 con 0x7fe7e806b8f0 2023-11-26T07:24:25.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.498+0000 7fe7f9ffb640 1 -- 172.21.15.77:0/4104250562 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe7f4013430 con 0x7fe7e806b8f0 2023-11-26T07:24:25.499 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 0 to deep-scrub 2023-11-26T07:24:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 -- 172.21.15.77:0/4104250562 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7e806b8f0 msgr2=0x7fe7e806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7e806b8f0 0x7fe7e806ddb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe804072a40 tx=0x7fe7f4006ba0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 -- 172.21.15.77:0/4104250562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8040cf450 msgr2=0x7fe8040ae960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8040cf450 0x7fe8040ae960 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe800000c00 tx=0x7fe8000046c0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 -- 172.21.15.77:0/4104250562 shutdown_connections 2023-11-26T07:24:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe7e806b8f0 0x7fe7e806ddb0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe80415e390 0x7fe8041f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe804157c70 0x7fe80413c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 --2- 172.21.15.77:0/4104250562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8040cf450 0x7fe8040ae960 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 -- 172.21.15.77:0/4104250562 >> 172.21.15.77:0/4104250562 conn(0x7fe80406a920 msgr2=0x7fe80406c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:25.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 -- 172.21.15.77:0/4104250562 shutdown_connections 2023-11-26T07:24:25.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.501+0000 7fe80b716640 1 -- 172.21.15.77:0/4104250562 wait complete. 2023-11-26T07:24:25.520 INFO:tasks.ceph:Scrubbing osd.1 2023-11-26T07:24:25.520 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.742+0000 7fe215ed4640 1 Processor -- start 2023-11-26T07:24:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.743+0000 7fe215ed4640 1 -- start start 2023-11-26T07:24:25.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.744+0000 7fe215ed4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2100d19f0 0x7fe2100d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.744+0000 7fe215ed4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2100b1010 con 0x7fe2100b2700 2023-11-26T07:24:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.744+0000 7fe215ed4640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2100d1230 con 0x7fe2100d0680 2023-11-26T07:24:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.744+0000 7fe215ed4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2100d2310 con 0x7fe2100d19f0 2023-11-26T07:24:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe2100b2700 0x7fe2100cdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45144/0 (socket says 172.21.15.77:45144) 2023-11-26T07:24:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20effd640 1 -- 172.21.15.77:0/430371213 learned_addr learned my addr 172.21.15.77:0/430371213 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:25.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20f7fe640 1 --2- 172.21.15.77:0/430371213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2100d19f0 0x7fe2100d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905575924 0 0) 0x7fe2100b1010 con 0x7fe2100b2700 2023-11-26T07:24:25.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1fc003520 con 0x7fe2100b2700 2023-11-26T07:24:25.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3573166488 0 0) 0x7fe1fc003520 con 0x7fe2100b2700 2023-11-26T07:24:25.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2100d19f0 msgr2=0x7fe2100d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:25.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20e7fc640 1 --2- 172.21.15.77:0/430371213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2100d19f0 0x7fe2100d1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 >> v1:172.21.15.159:6789/0 conn(0x7fe2100d0680 legacy=0x7fe2100ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2100d3b40 con 0x7fe2100b2700 2023-11-26T07:24:25.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fe1f8001670 con 0x7fe2100b2700 2023-11-26T07:24:25.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 >> v1:172.21.15.77:6789/0 conn(0x7fe2100b2700 legacy=0x7fe2100cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.745+0000 7fe20e7fc640 1 --2- 172.21.15.77:0/430371213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1fc0039a0 0x7fe1fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.746+0000 7fe20e7fc640 1 --2- 172.21.15.77:0/430371213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1fc0047c0 0x7fe1fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.746+0000 7fe20e7fc640 1 --2- 172.21.15.77:0/430371213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2100d19f0 0x7fe1fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.746+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2100d2310 con 0x7fe1fc0047c0 2023-11-26T07:24:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.746+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc00ba30 con 0x7fe1fc0039a0 2023-11-26T07:24:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.746+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc00bbf0 con 0x7fe2100d19f0 2023-11-26T07:24:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.746+0000 7fe20effd640 1 --2- 172.21.15.77:0/430371213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1fc0047c0 0x7fe1fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.746+0000 7fe20effd640 1 -- 172.21.15.77:0/430371213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2100d19f0 msgr2=0x7fe1fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.746+0000 7fe20effd640 1 --2- 172.21.15.77:0/430371213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2100d19f0 0x7fe1fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.746+0000 7fe20effd640 1 -- 172.21.15.77:0/430371213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1fc0039a0 msgr2=0x7fe1fc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.746+0000 7fe20effd640 1 --2- 172.21.15.77:0/430371213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1fc0039a0 0x7fe1fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.746+0000 7fe20effd640 1 -- 172.21.15.77:0/430371213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc003520 con 0x7fe1fc0047c0 2023-11-26T07:24:25.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.747+0000 7fe20effd640 1 --2- 172.21.15.77:0/430371213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1fc0047c0 0x7fe1fc004c40 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800c210 tx=0x7fe1fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df5ed6cc1962b5d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:25.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.747+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8005ad0 con 0x7fe1fc0047c0 2023-11-26T07:24:25.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.747+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f8005c30 con 0x7fe1fc0047c0 2023-11-26T07:24:25.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.747+0000 7fe20e7fc640 1 -- 172.21.15.77:0/430371213 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f802c870 con 0x7fe1fc0047c0 2023-11-26T07:24:25.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.748+0000 7fe215ed4640 1 -- 172.21.15.77:0/430371213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1fc0047c0 msgr2=0x7fe1fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.748+0000 7fe215ed4640 1 --2- 172.21.15.77:0/430371213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1fc0047c0 0x7fe1fc004c40 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800c210 tx=0x7fe1fc0057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.748+0000 7fe20ffff640 1 -- 172.21.15.77:0/430371213 reap_dead start 2023-11-26T07:24:25.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.748+0000 7fe215ed4640 1 -- 172.21.15.77:0/430371213 shutdown_connections 2023-11-26T07:24:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.748+0000 7fe215ed4640 1 -- 172.21.15.77:0/430371213 >> 172.21.15.77:0/430371213 conn(0x7fe21008af60 msgr2=0x7fe2100d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.748+0000 7fe215ed4640 1 -- 172.21.15.77:0/430371213 shutdown_connections 2023-11-26T07:24:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.748+0000 7fe215ed4640 1 -- 172.21.15.77:0/430371213 wait complete. 2023-11-26T07:24:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.750+0000 7fe215ed4640 1 Processor -- start 2023-11-26T07:24:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.750+0000 7fe215ed4640 1 -- start start 2023-11-26T07:24:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.751+0000 7fe215ed4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1fc0047c0 0x7fe2100cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.751+0000 7fe215ed4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2100b7f50 0x7fe2100c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.751+0000 7fe215ed4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2100c8510 0x7fe2101f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.751+0000 7fe215ed4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2100b2ae0 con 0x7fe2100b7f50 2023-11-26T07:24:25.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.751+0000 7fe215ed4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2100b44b0 con 0x7fe2100c8510 2023-11-26T07:24:25.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.751+0000 7fe215ed4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2100c8a00 con 0x7fe1fc0047c0 2023-11-26T07:24:25.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.751+0000 7fe20effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2100b7f50 0x7fe2100c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.751+0000 7fe20effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2100b7f50 0x7fe2100c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53214/0 (socket says 172.21.15.77:53214) 2023-11-26T07:24:25.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.751+0000 7fe20effd640 1 -- 172.21.15.77:0/613665285 learned_addr learned my addr 172.21.15.77:0/613665285 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:25.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.752+0000 7fe20effd640 1 -- 172.21.15.77:0/613665285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1fc0047c0 msgr2=0x7fe2100cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.752+0000 7fe20effd640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1fc0047c0 0x7fe2100cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.752+0000 7fe20effd640 1 -- 172.21.15.77:0/613665285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2100c8510 msgr2=0x7fe2101f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.752+0000 7fe20effd640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2100c8510 0x7fe2101f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.752+0000 7fe20effd640 1 -- 172.21.15.77:0/613665285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2100c8ce0 con 0x7fe2100b7f50 2023-11-26T07:24:25.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.752+0000 7fe20effd640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2100b7f50 0x7fe2100c7fd0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe1f802c410 tx=0x7fe1f8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:25.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.752+0000 7fe207fff640 1 -- 172.21.15.77:0/613665285 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8039030 con 0x7fe2100b7f50 2023-11-26T07:24:25.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.752+0000 7fe207fff640 1 -- 172.21.15.77:0/613665285 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f802cc80 con 0x7fe2100b7f50 2023-11-26T07:24:25.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.752+0000 7fe207fff640 1 -- 172.21.15.77:0/613665285 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f803c040 con 0x7fe2100b7f50 2023-11-26T07:24:25.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.752+0000 7fe215ed4640 1 -- 172.21.15.77:0/613665285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2100c8fc0 con 0x7fe2100b7f50 2023-11-26T07:24:25.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.753+0000 7fe215ed4640 1 -- 172.21.15.77:0/613665285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2100cccc0 con 0x7fe2100b7f50 2023-11-26T07:24:25.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.753+0000 7fe215ed4640 1 -- 172.21.15.77:0/613665285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2100ced60 con 0x7fe2100b7f50 2023-11-26T07:24:25.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.754+0000 7fe207fff640 1 -- 172.21.15.77:0/613665285 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fe1f8032070 con 0x7fe2100b7f50 2023-11-26T07:24:25.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.755+0000 7fe207fff640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe1f006b8f0 0x7fe1f006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.755+0000 7fe207fff640 1 -- 172.21.15.77:0/613665285 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe1f80a9610 con 0x7fe2100b7f50 2023-11-26T07:24:25.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.756+0000 7fe207fff640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] conn(0x7fe1f0071750 0x7fe1f0073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.756+0000 7fe20f7fe640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe1f006b8f0 0x7fe1f006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.756+0000 7fe207fff640 1 -- 172.21.15.77:0/613665285 --> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1f0074220 con 0x7fe1f0071750 2023-11-26T07:24:25.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.756+0000 7fe207fff640 1 -- 172.21.15.77:0/613665285 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1f80ae250 con 0x7fe2100b7f50 2023-11-26T07:24:25.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.756+0000 7fe20ffff640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] conn(0x7fe1f0071750 0x7fe1f0073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:25.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.756+0000 7fe20f7fe640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe1f006b8f0 0x7fe1f006ddb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe2000070b0 tx=0x7fe20000d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:25.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.757+0000 7fe20ffff640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] conn(0x7fe1f0071750 0x7fe1f0073b70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:25.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.757+0000 7fe207fff640 1 -- 172.21.15.77:0/613665285 <== osd.1 v2:172.21.15.77:6817/674756385 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe1f0074220 con 0x7fe1f0071750 2023-11-26T07:24:25.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.772+0000 7fe215ed4640 1 -- 172.21.15.77:0/613665285 --> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe2100d4100 con 0x7fe1f0071750 2023-11-26T07:24:25.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.773+0000 7fe207fff640 1 -- 172.21.15.77:0/613665285 <== osd.1 v2:172.21.15.77:6817/674756385 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe208007e80 con 0x7fe1f0071750 2023-11-26T07:24:25.774 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:25.774 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:25.775 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:25.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.773+0000 7fe215ed4640 1 -- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] conn(0x7fe1f0071750 msgr2=0x7fe1f0073b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.773+0000 7fe215ed4640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:6817/674756385,v1:172.21.15.77:6820/674756385] conn(0x7fe1f0071750 0x7fe1f0073b70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:25.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.773+0000 7fe215ed4640 1 -- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe1f006b8f0 msgr2=0x7fe1f006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.773+0000 7fe215ed4640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fe1f006b8f0 0x7fe1f006ddb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe2000070b0 tx=0x7fe20000d040 comp rx=0 tx=0).stop 2023-11-26T07:24:25.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.774+0000 7fe215ed4640 1 -- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2100b7f50 msgr2=0x7fe2100c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:25.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.774+0000 7fe215ed4640 1 --2- 172.21.15.77:0/613665285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2100b7f50 0x7fe2100c7fd0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe1f802c410 tx=0x7fe1f8001a00 comp rx=0 tx=0).stop 2023-11-26T07:24:25.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.774+0000 7fe20ffff640 1 -- 172.21.15.77:0/613665285 reap_dead start 2023-11-26T07:24:25.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.774+0000 7fe215ed4640 1 -- 172.21.15.77:0/613665285 shutdown_connections 2023-11-26T07:24:25.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.774+0000 7fe215ed4640 1 -- 172.21.15.77:0/613665285 >> 172.21.15.77:0/613665285 conn(0x7fe21008af60 msgr2=0x7fe21006ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:25.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.774+0000 7fe215ed4640 1 -- 172.21.15.77:0/613665285 shutdown_connections 2023-11-26T07:24:25.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.774+0000 7fe215ed4640 1 -- 172.21.15.77:0/613665285 wait complete. 2023-11-26T07:24:25.792 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-26T07:24:25.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.996+0000 7fa86ff4c640 1 Processor -- start 2023-11-26T07:24:25.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.996+0000 7fa86ff4c640 1 -- start start 2023-11-26T07:24:25.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.997+0000 7fa86ff4c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8680ce290 0x7fa8680ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.997+0000 7fa86ff4c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa86806c4f0 0x7fa8680ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:25.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.998+0000 7fa86ff4c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86815bcb0 con 0x7fa8680abec0 2023-11-26T07:24:25.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.998+0000 7fa86ff4c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8680ce670 con 0x7fa86806c4f0 2023-11-26T07:24:26.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.998+0000 7fa86ff4c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86815bf90 con 0x7fa8680ce290 2023-11-26T07:24:26.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.998+0000 7fa86e4e9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa8680abec0 0x7fa868070aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55408/0 (socket says 172.21.15.77:55408) 2023-11-26T07:24:26.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.998+0000 7fa86e4e9640 1 -- 172.21.15.77:0/2476920542 learned_addr learned my addr 172.21.15.77:0/2476920542 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:26.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.998+0000 7fa86d4e7640 1 --2- 172.21.15.77:0/2476920542 >> v2:172.21.15.159:3300/0 conn(0x7fa86806c4f0 0x7fa8680ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.998+0000 7fa86dce8640 1 --2- 172.21.15.77:0/2476920542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8680ce290 0x7fa8680ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.998+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493667523 0 0) 0x7fa86815bcb0 con 0x7fa8680abec0 2023-11-26T07:24:26.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.998+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa854003520 con 0x7fa8680abec0 2023-11-26T07:24:26.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2635331012 0 0) 0x7fa854003520 con 0x7fa8680abec0 2023-11-26T07:24:26.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8680ce290 msgr2=0x7fa8680ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:26.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 --2- 172.21.15.77:0/2476920542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8680ce290 0x7fa8680ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 >> v2:172.21.15.159:3300/0 conn(0x7fa86806c4f0 msgr2=0x7fa8680ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:26.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 --2- 172.21.15.77:0/2476920542 >> v2:172.21.15.159:3300/0 conn(0x7fa86806c4f0 0x7fa8680ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86815c270 con 0x7fa8680abec0 2023-11-26T07:24:26.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fa8600019f0 con 0x7fa8680abec0 2023-11-26T07:24:26.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 >> v1:172.21.15.77:6789/0 conn(0x7fa8680abec0 legacy=0x7fa868070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 --2- 172.21.15.77:0/2476920542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa854003970 0x7fa854003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 --2- 172.21.15.77:0/2476920542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8540047c0 0x7fa854004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 --2- 172.21.15.77:0/2476920542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8680ce290 0x7fa854005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8680ce670 con 0x7fa8540047c0 2023-11-26T07:24:26.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86815bf90 con 0x7fa854003970 2023-11-26T07:24:26.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85400fd90 con 0x7fa8680ce290 2023-11-26T07:24:26.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:25.999+0000 7fa86d4e7640 1 --2- 172.21.15.77:0/2476920542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8540047c0 0x7fa854004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.000+0000 7fa86dce8640 1 --2- 172.21.15.77:0/2476920542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa854003970 0x7fa854003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.000+0000 7fa86d4e7640 1 -- 172.21.15.77:0/2476920542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8680ce290 msgr2=0x7fa854005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:26.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.000+0000 7fa86d4e7640 1 --2- 172.21.15.77:0/2476920542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8680ce290 0x7fa854005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.000+0000 7fa86d4e7640 1 -- 172.21.15.77:0/2476920542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa854003970 msgr2=0x7fa854003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:26.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.000+0000 7fa86d4e7640 1 --2- 172.21.15.77:0/2476920542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa854003970 0x7fa854003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.000+0000 7fa86d4e7640 1 -- 172.21.15.77:0/2476920542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa854003520 con 0x7fa8540047c0 2023-11-26T07:24:26.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.001+0000 7fa86d4e7640 1 --2- 172.21.15.77:0/2476920542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8540047c0 0x7fa854004c40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa858009ac0 tx=0x7fa8540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9238e8ab63ba3a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.001+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85802c710 con 0x7fa8540047c0 2023-11-26T07:24:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.001+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85802c870 con 0x7fa8540047c0 2023-11-26T07:24:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.001+0000 7fa86cce6640 1 -- 172.21.15.77:0/2476920542 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85802cc00 con 0x7fa8540047c0 2023-11-26T07:24:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.002+0000 7fa86ff4c640 1 -- 172.21.15.77:0/2476920542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8540047c0 msgr2=0x7fa854004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.002+0000 7fa86ff4c640 1 --2- 172.21.15.77:0/2476920542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8540047c0 0x7fa854004c40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa858009ac0 tx=0x7fa8540057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.002+0000 7fa86e4e9640 1 -- 172.21.15.77:0/2476920542 reap_dead start 2023-11-26T07:24:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.002+0000 7fa86ff4c640 1 -- 172.21.15.77:0/2476920542 shutdown_connections 2023-11-26T07:24:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.002+0000 7fa86ff4c640 1 -- 172.21.15.77:0/2476920542 >> 172.21.15.77:0/2476920542 conn(0x7fa8680b0be0 msgr2=0x7fa8680b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.002+0000 7fa86ff4c640 1 -- 172.21.15.77:0/2476920542 shutdown_connections 2023-11-26T07:24:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.002+0000 7fa86ff4c640 1 -- 172.21.15.77:0/2476920542 wait complete. 2023-11-26T07:24:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.004+0000 7fa86ff4c640 1 Processor -- start 2023-11-26T07:24:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.004+0000 7fa86ff4c640 1 -- start start 2023-11-26T07:24:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86ff4c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8540047c0 0x7fa868147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86ff4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa868148600 0x7fa86815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86ff4c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa86815cef0 0x7fa86815d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86ff4c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8681550a0 con 0x7fa868148600 2023-11-26T07:24:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86ff4c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8680b2b00 con 0x7fa86815cef0 2023-11-26T07:24:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86ff4c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8680b2540 con 0x7fa8540047c0 2023-11-26T07:24:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86d4e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa868148600 0x7fa86815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86d4e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa868148600 0x7fa86815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53184/0 (socket says 172.21.15.77:53184) 2023-11-26T07:24:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86d4e7640 1 -- 172.21.15.77:0/986305533 learned_addr learned my addr 172.21.15.77:0/986305533 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86dce8640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8540047c0 0x7fa868147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86e4e9640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa86815cef0 0x7fa86815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86d4e7640 1 -- 172.21.15.77:0/986305533 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8540047c0 msgr2=0x7fa868147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86d4e7640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8540047c0 0x7fa868147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86d4e7640 1 -- 172.21.15.77:0/986305533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa86815cef0 msgr2=0x7fa86815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86d4e7640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa86815cef0 0x7fa86815d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.005+0000 7fa86d4e7640 1 -- 172.21.15.77:0/986305533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8680b2820 con 0x7fa868148600 2023-11-26T07:24:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.006+0000 7fa86d4e7640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa868148600 0x7fa86815c9b0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa85802c2b0 tx=0x7fa858004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.006+0000 7fa85e7fc640 1 -- 172.21.15.77:0/986305533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858003810 con 0x7fa868148600 2023-11-26T07:24:26.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.006+0000 7fa85e7fc640 1 -- 172.21.15.77:0/986305533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85802de90 con 0x7fa868148600 2023-11-26T07:24:26.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.006+0000 7fa86ff4c640 1 -- 172.21.15.77:0/986305533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa868159540 con 0x7fa868148600 2023-11-26T07:24:26.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.006+0000 7fa85e7fc640 1 -- 172.21.15.77:0/986305533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858003b70 con 0x7fa868148600 2023-11-26T07:24:26.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.006+0000 7fa86ff4c640 1 -- 172.21.15.77:0/986305533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa868153de0 con 0x7fa868148600 2023-11-26T07:24:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.007+0000 7fa86ff4c640 1 -- 172.21.15.77:0/986305533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8680b2680 con 0x7fa868148600 2023-11-26T07:24:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.009+0000 7fa85e7fc640 1 -- 172.21.15.77:0/986305533 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fa858003cd0 con 0x7fa868148600 2023-11-26T07:24:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.010+0000 7fa85e7fc640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa84c06b8f0 0x7fa84c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.010+0000 7fa85e7fc640 1 -- 172.21.15.77:0/986305533 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa8580a9f90 con 0x7fa868148600 2023-11-26T07:24:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.010+0000 7fa86dce8640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa84c06b8f0 0x7fa84c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.011+0000 7fa86dce8640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa84c06b8f0 0x7fa84c06ddb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa864006fd0 tx=0x7fa864008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:26.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.014+0000 7fa85e7fc640 1 -- 172.21.15.77:0/986305533 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8680b2680 con 0x7fa868148600 2023-11-26T07:24:26.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.203+0000 7fa86ff4c640 1 -- 172.21.15.77:0/986305533 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa86815b960 con 0x7fa84c06b8f0 2023-11-26T07:24:26.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.203+0000 7fa85e7fc640 1 -- 172.21.15.77:0/986305533 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa8640105c0 con 0x7fa84c06b8f0 2023-11-26T07:24:26.205 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 1 to deep-scrub 2023-11-26T07:24:26.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 -- 172.21.15.77:0/986305533 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa84c06b8f0 msgr2=0x7fa84c06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa84c06b8f0 0x7fa84c06ddb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa864006fd0 tx=0x7fa864008040 comp rx=0 tx=0).stop 2023-11-26T07:24:26.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 -- 172.21.15.77:0/986305533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa868148600 msgr2=0x7fa86815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa868148600 0x7fa86815c9b0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa85802c2b0 tx=0x7fa858004730 comp rx=0 tx=0).stop 2023-11-26T07:24:26.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 -- 172.21.15.77:0/986305533 shutdown_connections 2023-11-26T07:24:26.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fa84c06b8f0 0x7fa84c06ddb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa86815cef0 0x7fa86815d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa868148600 0x7fa86815c9b0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 --2- 172.21.15.77:0/986305533 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8540047c0 0x7fa868147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 -- 172.21.15.77:0/986305533 >> 172.21.15.77:0/986305533 conn(0x7fa8680b0be0 msgr2=0x7fa8680ac350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:26.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 -- 172.21.15.77:0/986305533 shutdown_connections 2023-11-26T07:24:26.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.206+0000 7fa86ff4c640 1 -- 172.21.15.77:0/986305533 wait complete. 2023-11-26T07:24:26.224 INFO:tasks.ceph:Scrubbing osd.2 2023-11-26T07:24:26.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:26.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.433+0000 7ff2fab43640 1 Processor -- start 2023-11-26T07:24:26.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.434+0000 7ff2fab43640 1 -- start start 2023-11-26T07:24:26.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.435+0000 7ff2fab43640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff2f40cfb60 0x7ff2f40abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.435+0000 7ff2fab43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2f40ce640 0x7ff2f40b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.435+0000 7ff2fab43640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f40ce270 con 0x7ff2f40cc470 2023-11-26T07:24:26.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.435+0000 7ff2fab43640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f406c560 con 0x7ff2f40cfb60 2023-11-26T07:24:26.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.435+0000 7ff2fab43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f406d0a0 con 0x7ff2f40ce640 2023-11-26T07:24:26.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.435+0000 7ff2f88df640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff2f40cc470 0x7ff2f40cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55422/0 (socket says 172.21.15.77:55422) 2023-11-26T07:24:26.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.435+0000 7ff2f88df640 1 -- 172.21.15.77:0/3450930152 learned_addr learned my addr 172.21.15.77:0/3450930152 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:26.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f3fff640 1 --2- 172.21.15.77:0/3450930152 >> v2:172.21.15.159:3300/0 conn(0x7ff2f40cfb60 0x7ff2f40abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993258406 0 0) 0x7ff2f40ce270 con 0x7ff2f40cc470 2023-11-26T07:24:26.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2dc003520 con 0x7ff2f40cc470 2023-11-26T07:24:26.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f90e0640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2f40ce640 0x7ff2f40b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 858111727 0 0) 0x7ff2dc003520 con 0x7ff2f40cc470 2023-11-26T07:24:26.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2f40ce640 msgr2=0x7ff2f40b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:26.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2f40ce640 0x7ff2f40b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 >> v2:172.21.15.159:3300/0 conn(0x7ff2f40cfb60 msgr2=0x7ff2f40abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:26.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 --2- 172.21.15.77:0/3450930152 >> v2:172.21.15.159:3300/0 conn(0x7ff2f40cfb60 0x7ff2f40abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f40b4200 con 0x7ff2f40cc470 2023-11-26T07:24:26.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7ff2e4001670 con 0x7ff2f40cc470 2023-11-26T07:24:26.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 >> v1:172.21.15.77:6789/0 conn(0x7ff2f40cc470 legacy=0x7ff2f40cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2dc003970 0x7ff2dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2dc0047c0 0x7ff2dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2f40ce640 0x7ff2dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f406c560 con 0x7ff2dc0047c0 2023-11-26T07:24:26.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f406d0a0 con 0x7ff2dc003970 2023-11-26T07:24:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.436+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc00b9d0 con 0x7ff2f40ce640 2023-11-26T07:24:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.437+0000 7ff2f3fff640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2dc0047c0 0x7ff2dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.437+0000 7ff2f3fff640 1 -- 172.21.15.77:0/3450930152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2f40ce640 msgr2=0x7ff2dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.437+0000 7ff2f3fff640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2f40ce640 0x7ff2dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.437+0000 7ff2f3fff640 1 -- 172.21.15.77:0/3450930152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2dc003970 msgr2=0x7ff2dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.437+0000 7ff2f88df640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2dc003970 0x7ff2dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.437+0000 7ff2f3fff640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2dc003970 0x7ff2dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.437+0000 7ff2f3fff640 1 -- 172.21.15.77:0/3450930152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc003520 con 0x7ff2dc0047c0 2023-11-26T07:24:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.437+0000 7ff2f88df640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2dc003970 0x7ff2dc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.438+0000 7ff2f3fff640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2dc0047c0 0x7ff2dc004c40 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009ac0 tx=0x7ff2dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1564e6bcd21ea7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:26.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.439+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e802c710 con 0x7ff2dc0047c0 2023-11-26T07:24:26.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.439+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e802c870 con 0x7ff2dc0047c0 2023-11-26T07:24:26.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.439+0000 7ff2f37fe640 1 -- 172.21.15.77:0/3450930152 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e802cc00 con 0x7ff2dc0047c0 2023-11-26T07:24:26.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.439+0000 7ff2fab43640 1 -- 172.21.15.77:0/3450930152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2dc0047c0 msgr2=0x7ff2dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.439+0000 7ff2fab43640 1 --2- 172.21.15.77:0/3450930152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2dc0047c0 0x7ff2dc004c40 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009ac0 tx=0x7ff2dc0057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.439+0000 7ff2f90e0640 1 -- 172.21.15.77:0/3450930152 reap_dead start 2023-11-26T07:24:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.439+0000 7ff2fab43640 1 -- 172.21.15.77:0/3450930152 shutdown_connections 2023-11-26T07:24:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.439+0000 7ff2fab43640 1 -- 172.21.15.77:0/3450930152 >> 172.21.15.77:0/3450930152 conn(0x7ff2f406a920 msgr2=0x7ff2f406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.439+0000 7ff2fab43640 1 -- 172.21.15.77:0/3450930152 shutdown_connections 2023-11-26T07:24:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.439+0000 7ff2fab43640 1 -- 172.21.15.77:0/3450930152 wait complete. 2023-11-26T07:24:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.441+0000 7ff2fab43640 1 Processor -- start 2023-11-26T07:24:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.441+0000 7ff2fab43640 1 -- start start 2023-11-26T07:24:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.442+0000 7ff2fab43640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2dc0047c0 0x7ff2f4071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.442+0000 7ff2fab43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f40705c0 0x7ff2f41f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.442+0000 7ff2fab43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2f41f6de0 0x7ff2f4147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.442+0000 7ff2fab43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40717e0 con 0x7ff2f40705c0 2023-11-26T07:24:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.442+0000 7ff2fab43640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f414bfc0 con 0x7ff2dc0047c0 2023-11-26T07:24:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.442+0000 7ff2fab43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f41f7260 con 0x7ff2f41f6de0 2023-11-26T07:24:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.442+0000 7ff2f3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f40705c0 0x7ff2f41f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.443+0000 7ff2f3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f40705c0 0x7ff2f41f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53202/0 (socket says 172.21.15.77:53202) 2023-11-26T07:24:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.443+0000 7ff2f3fff640 1 -- 172.21.15.77:0/86833844 learned_addr learned my addr 172.21.15.77:0/86833844 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.443+0000 7ff2f88df640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2dc0047c0 0x7ff2f4071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.443+0000 7ff2f90e0640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2f41f6de0 0x7ff2f4147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.443+0000 7ff2f3fff640 1 -- 172.21.15.77:0/86833844 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2f41f6de0 msgr2=0x7ff2f4147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.443+0000 7ff2f3fff640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2f41f6de0 0x7ff2f4147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.443+0000 7ff2f3fff640 1 -- 172.21.15.77:0/86833844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2dc0047c0 msgr2=0x7ff2f4071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.443+0000 7ff2f3fff640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2dc0047c0 0x7ff2f4071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.443+0000 7ff2f3fff640 1 -- 172.21.15.77:0/86833844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f4070b60 con 0x7ff2f40705c0 2023-11-26T07:24:26.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.443+0000 7ff2f3fff640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f40705c0 0x7ff2f41f68a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff2e802c2b0 tx=0x7ff2e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:26.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.444+0000 7ff2f17fa640 1 -- 172.21.15.77:0/86833844 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8003810 con 0x7ff2f40705c0 2023-11-26T07:24:26.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.444+0000 7ff2f17fa640 1 -- 172.21.15.77:0/86833844 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e802de90 con 0x7ff2f40705c0 2023-11-26T07:24:26.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.444+0000 7ff2f17fa640 1 -- 172.21.15.77:0/86833844 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8003b70 con 0x7ff2f40705c0 2023-11-26T07:24:26.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.444+0000 7ff2fab43640 1 -- 172.21.15.77:0/86833844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f4070e40 con 0x7ff2f40705c0 2023-11-26T07:24:26.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.444+0000 7ff2fab43640 1 -- 172.21.15.77:0/86833844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f4071400 con 0x7ff2f40705c0 2023-11-26T07:24:26.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.445+0000 7ff2fab43640 1 -- 172.21.15.77:0/86833844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2f406cd30 con 0x7ff2f40705c0 2023-11-26T07:24:26.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.446+0000 7ff2f17fa640 1 -- 172.21.15.77:0/86833844 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7ff2e8003cd0 con 0x7ff2f40705c0 2023-11-26T07:24:26.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.447+0000 7ff2f17fa640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2e006b8f0 0x7ff2e006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.447+0000 7ff2f17fa640 1 -- 172.21.15.77:0/86833844 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff2e80a9ee0 con 0x7ff2f40705c0 2023-11-26T07:24:26.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.447+0000 7ff2f88df640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2e006b8f0 0x7ff2e006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.447+0000 7ff2f17fa640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] conn(0x7ff2e0071750 0x7ff2e0073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.447+0000 7ff2f17fa640 1 -- 172.21.15.77:0/86833844 --> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2e0074220 con 0x7ff2e0071750 2023-11-26T07:24:26.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.447+0000 7ff2f17fa640 1 -- 172.21.15.77:0/86833844 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2e80aeba0 con 0x7ff2f40705c0 2023-11-26T07:24:26.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.448+0000 7ff2f90e0640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] conn(0x7ff2e0071750 0x7ff2e0073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.448+0000 7ff2f88df640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2e006b8f0 0x7ff2e006ddb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4001eb0 tx=0x7ff2e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:26.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.448+0000 7ff2f90e0640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] conn(0x7ff2e0071750 0x7ff2e0073b70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:26.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.449+0000 7ff2f17fa640 1 -- 172.21.15.77:0/86833844 <== osd.2 v2:172.21.15.77:6808/2586530941 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff2e0074220 con 0x7ff2e0071750 2023-11-26T07:24:26.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.463+0000 7ff2fab43640 1 -- 172.21.15.77:0/86833844 --> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff2f406ca50 con 0x7ff2e0071750 2023-11-26T07:24:26.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.464+0000 7ff2f17fa640 1 -- 172.21.15.77:0/86833844 <== osd.2 v2:172.21.15.77:6808/2586530941 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff2ec009c50 con 0x7ff2e0071750 2023-11-26T07:24:26.466 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:26.467 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:26.467 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:26.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.464+0000 7ff2fab43640 1 -- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] conn(0x7ff2e0071750 msgr2=0x7ff2e0073b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.464+0000 7ff2fab43640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:6808/2586530941,v1:172.21.15.77:6810/2586530941] conn(0x7ff2e0071750 0x7ff2e0073b70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.464+0000 7ff2fab43640 1 -- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2e006b8f0 msgr2=0x7ff2e006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.464+0000 7ff2fab43640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ff2e006b8f0 0x7ff2e006ddb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4001eb0 tx=0x7ff2e4009040 comp rx=0 tx=0).stop 2023-11-26T07:24:26.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.464+0000 7ff2fab43640 1 -- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f40705c0 msgr2=0x7ff2f41f68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.464+0000 7ff2fab43640 1 --2- 172.21.15.77:0/86833844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f40705c0 0x7ff2f41f68a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff2e802c2b0 tx=0x7ff2e8004730 comp rx=0 tx=0).stop 2023-11-26T07:24:26.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.464+0000 7ff2f90e0640 1 -- 172.21.15.77:0/86833844 reap_dead start 2023-11-26T07:24:26.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.464+0000 7ff2fab43640 1 -- 172.21.15.77:0/86833844 shutdown_connections 2023-11-26T07:24:26.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.464+0000 7ff2fab43640 1 -- 172.21.15.77:0/86833844 >> 172.21.15.77:0/86833844 conn(0x7ff2f406a920 msgr2=0x7ff2f40ad330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:26.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.465+0000 7ff2fab43640 1 -- 172.21.15.77:0/86833844 shutdown_connections 2023-11-26T07:24:26.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.465+0000 7ff2fab43640 1 -- 172.21.15.77:0/86833844 wait complete. 2023-11-26T07:24:26.484 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-26T07:24:26.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.685+0000 7f2151b43640 1 Processor -- start 2023-11-26T07:24:26.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.685+0000 7f2151b43640 1 -- start start 2023-11-26T07:24:26.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.686+0000 7f2151b43640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f214c0cf450 0x7f214c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.686+0000 7f2151b43640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f214c0cdfb0 0x7f214c0ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.686+0000 7f2151b43640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0cece0 con 0x7f214c15c7f0 2023-11-26T07:24:26.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.686+0000 7f2151b43640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c0cfe40 con 0x7f214c0cf450 2023-11-26T07:24:26.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.686+0000 7f2151b43640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c156010 con 0x7f214c0cdfb0 2023-11-26T07:24:26.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.687+0000 7f2143fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f214c0cf450 0x7f214c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.687+0000 7f2143fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f214c0cf450 0x7f214c0cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53204/0 (socket says 172.21.15.77:53204) 2023-11-26T07:24:26.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.687+0000 7f2143fff640 1 -- 172.21.15.77:0/1801808170 learned_addr learned my addr 172.21.15.77:0/1801808170 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:26.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.687+0000 7f2143fff640 1 -- 172.21.15.77:0/1801808170 >> v2:172.21.15.159:3300/0 conn(0x7f214c0cdfb0 msgr2=0x7f214c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:26.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.687+0000 7f2143fff640 1 --2- 172.21.15.77:0/1801808170 >> v2:172.21.15.159:3300/0 conn(0x7f214c0cdfb0 0x7f214c0ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.687+0000 7f2143fff640 1 -- 172.21.15.77:0/1801808170 >> v1:172.21.15.159:6789/0 conn(0x7f214c15c7f0 legacy=0x7f214c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:26.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.687+0000 7f2143fff640 1 -- 172.21.15.77:0/1801808170 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c06d040 con 0x7f214c0cf450 2023-11-26T07:24:26.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.688+0000 7f2143fff640 1 --2- 172.21.15.77:0/1801808170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f214c0cf450 0x7f214c0cf900 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f214c0d00e0 tx=0x7f213402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9a8578ecf8d420 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:26.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.689+0000 7f214affd640 1 -- 172.21.15.77:0/1801808170 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134031870 con 0x7f214c0cf450 2023-11-26T07:24:26.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.689+0000 7f214affd640 1 -- 172.21.15.77:0/1801808170 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21340319d0 con 0x7f214c0cf450 2023-11-26T07:24:26.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.689+0000 7f214affd640 1 -- 172.21.15.77:0/1801808170 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134031d60 con 0x7f214c0cf450 2023-11-26T07:24:26.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.689+0000 7f2151b43640 1 -- 172.21.15.77:0/1801808170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f214c0cf450 msgr2=0x7f214c0cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.689+0000 7f2151b43640 1 --2- 172.21.15.77:0/1801808170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f214c0cf450 0x7f214c0cf900 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f214c0d00e0 tx=0x7f213402b910 comp rx=0 tx=0).stop 2023-11-26T07:24:26.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.690+0000 7f2151b43640 1 -- 172.21.15.77:0/1801808170 shutdown_connections 2023-11-26T07:24:26.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.690+0000 7f2151b43640 1 --2- 172.21.15.77:0/1801808170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f214c0cf450 0x7f214c0cf900 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.690+0000 7f2151b43640 1 --2- 172.21.15.77:0/1801808170 >> v2:172.21.15.159:3300/0 conn(0x7f214c0cdfb0 0x7f214c0ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.690+0000 7f2151b43640 1 -- 172.21.15.77:0/1801808170 >> 172.21.15.77:0/1801808170 conn(0x7f214c06a920 msgr2=0x7f214c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:26.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.690+0000 7f2151b43640 1 -- 172.21.15.77:0/1801808170 shutdown_connections 2023-11-26T07:24:26.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.690+0000 7f2151b43640 1 -- 172.21.15.77:0/1801808170 wait complete. 2023-11-26T07:24:26.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.691+0000 7f2151b43640 1 Processor -- start 2023-11-26T07:24:26.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.692+0000 7f2151b43640 1 -- start start 2023-11-26T07:24:26.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2151b43640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c0cdfb0 0x7f214c071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2151b43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f214c0cf450 0x7f214c0ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2151b43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f214c15c7f0 0x7f214c0ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2151b43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c1e68c0 con 0x7f214c0cf450 2023-11-26T07:24:26.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2151b43640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c1e5cb0 con 0x7f214c0cdfb0 2023-11-26T07:24:26.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2151b43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c1e5f90 con 0x7f214c15c7f0 2023-11-26T07:24:26.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2143fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f214c0cf450 0x7f214c0ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2143fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f214c0cf450 0x7f214c0ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53216/0 (socket says 172.21.15.77:53216) 2023-11-26T07:24:26.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2143fff640 1 -- 172.21.15.77:0/1057449660 learned_addr learned my addr 172.21.15.77:0/1057449660 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:26.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2143fff640 1 -- 172.21.15.77:0/1057449660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f214c15c7f0 msgr2=0x7f214c0ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2143fff640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f214c15c7f0 0x7f214c0ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f214b7fe640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c0cdfb0 0x7f214c071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2143fff640 1 -- 172.21.15.77:0/1057449660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c0cdfb0 msgr2=0x7f214c071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2143fff640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c0cdfb0 0x7f214c071740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f2143fff640 1 -- 172.21.15.77:0/1057449660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340094d0 con 0x7f214c0cf450 2023-11-26T07:24:26.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.693+0000 7f214b7fe640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c0cdfb0 0x7f214c071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:26.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.694+0000 7f2143fff640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f214c0cf450 0x7f214c0ad180 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f2134000c00 tx=0x7f21340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:26.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.694+0000 7f2148ff9640 1 -- 172.21.15.77:0/1057449660 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134031840 con 0x7f214c0cf450 2023-11-26T07:24:26.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.694+0000 7f2148ff9640 1 -- 172.21.15.77:0/1057449660 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21340443f0 con 0x7f214c0cf450 2023-11-26T07:24:26.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.694+0000 7f2148ff9640 1 -- 172.21.15.77:0/1057449660 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21340447a0 con 0x7f214c0cf450 2023-11-26T07:24:26.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.694+0000 7f2151b43640 1 -- 172.21.15.77:0/1057449660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c1e6270 con 0x7f214c0cf450 2023-11-26T07:24:26.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.694+0000 7f2151b43640 1 -- 172.21.15.77:0/1057449660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c1e5960 con 0x7f214c0cf450 2023-11-26T07:24:26.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.695+0000 7f2151b43640 1 -- 172.21.15.77:0/1057449660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c1e6a30 con 0x7f214c0cf450 2023-11-26T07:24:26.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.697+0000 7f2148ff9640 1 -- 172.21.15.77:0/1057449660 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f213404d450 con 0x7f214c0cf450 2023-11-26T07:24:26.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.698+0000 7f2148ff9640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f212c06b8f0 0x7f212c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:26.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.698+0000 7f2148ff9640 1 -- 172.21.15.77:0/1057449660 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f213402d040 con 0x7f214c0cf450 2023-11-26T07:24:26.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.698+0000 7f214b7fe640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f212c06b8f0 0x7f212c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:26.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.699+0000 7f214b7fe640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f212c06b8f0 0x7f212c06ddb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f214c0afbe0 tx=0x7f213c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.702+0000 7f2148ff9640 1 -- 172.21.15.77:0/1057449660 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21340772d0 con 0x7f214c0cf450 2023-11-26T07:24:26.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.894+0000 7f2151b43640 1 -- 172.21.15.77:0/1057449660 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f214c06d600 con 0x7f212c06b8f0 2023-11-26T07:24:26.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.894+0000 7f2148ff9640 1 -- 172.21.15.77:0/1057449660 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f213c00ad80 con 0x7f212c06b8f0 2023-11-26T07:24:26.897 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 2 to deep-scrub 2023-11-26T07:24:26.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.897+0000 7f2151b43640 1 -- 172.21.15.77:0/1057449660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f212c06b8f0 msgr2=0x7f212c06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.897+0000 7f2151b43640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f212c06b8f0 0x7f212c06ddb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f214c0afbe0 tx=0x7f213c008040 comp rx=0 tx=0).stop 2023-11-26T07:24:26.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.897+0000 7f2151b43640 1 -- 172.21.15.77:0/1057449660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f214c0cf450 msgr2=0x7f214c0ad180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:26.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.897+0000 7f2151b43640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f214c0cf450 0x7f214c0ad180 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f2134000c00 tx=0x7f21340046c0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.897+0000 7f2151b43640 1 -- 172.21.15.77:0/1057449660 shutdown_connections 2023-11-26T07:24:26.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.897+0000 7f2151b43640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f212c06b8f0 0x7f212c06ddb0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.897+0000 7f2151b43640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f214c15c7f0 0x7f214c0ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.897+0000 7f2151b43640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f214c0cf450 0x7f214c0ad180 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.897+0000 7f2151b43640 1 --2- 172.21.15.77:0/1057449660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c0cdfb0 0x7f214c071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:26.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.897+0000 7f2151b43640 1 -- 172.21.15.77:0/1057449660 >> 172.21.15.77:0/1057449660 conn(0x7f214c06a920 msgr2=0x7f214c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:26.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.898+0000 7f2151b43640 1 -- 172.21.15.77:0/1057449660 shutdown_connections 2023-11-26T07:24:26.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:26.898+0000 7f2151b43640 1 -- 172.21.15.77:0/1057449660 wait complete. 2023-11-26T07:24:26.919 INFO:tasks.ceph:Scrubbing osd.3 2023-11-26T07:24:26.919 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:27.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.133+0000 7f6ec0646640 1 Processor -- start 2023-11-26T07:24:27.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.133+0000 7f6ec0646640 1 -- start start 2023-11-26T07:24:27.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.134+0000 7f6ec0646640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 0x7f6eb80ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.134+0000 7f6ec0646640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6eb80ae650 0x7f6eb80aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.135+0000 7f6ec0646640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb80b4ef0 con 0x7f6eb815d4f0 2023-11-26T07:24:27.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.135+0000 7f6ec0646640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb80af000 con 0x7f6eb80ae650 2023-11-26T07:24:27.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.135+0000 7f6ec0646640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80b4040 con 0x7f6eb80ac840 2023-11-26T07:24:27.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.135+0000 7f6ebdbe1640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 0x7f6eb80ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.135+0000 7f6ebdbe1640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 0x7f6eb80ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:57560/0 (socket says 172.21.15.77:57560) 2023-11-26T07:24:27.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.135+0000 7f6ebdbe1640 1 -- 172.21.15.77:0/1445419662 learned_addr learned my addr 172.21.15.77:0/1445419662 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:27.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.136+0000 7f6ebebe3640 1 --2- 172.21.15.77:0/1445419662 >> v2:172.21.15.159:3300/0 conn(0x7f6eb80ae650 0x7f6eb80aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.136+0000 7f6ebdbe1640 1 -- 172.21.15.77:0/1445419662 >> v2:172.21.15.159:3300/0 conn(0x7f6eb80ae650 msgr2=0x7f6eb80aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:27.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.136+0000 7f6ebdbe1640 1 --2- 172.21.15.77:0/1445419662 >> v2:172.21.15.159:3300/0 conn(0x7f6eb80ae650 0x7f6eb80aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.136+0000 7f6ebdbe1640 1 -- 172.21.15.77:0/1445419662 >> v1:172.21.15.159:6789/0 conn(0x7f6eb815d4f0 legacy=0x7f6eb80b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.136+0000 7f6ebdbe1640 1 -- 172.21.15.77:0/1445419662 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb815d8d0 con 0x7f6eb80ac840 2023-11-26T07:24:27.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.138+0000 7f6ebdbe1640 1 --2- 172.21.15.77:0/1445419662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 0x7f6eb80ad730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009870 tx=0x7f6ea802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d13d93597e36cb7d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:27.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.138+0000 7f6ebd3e0640 1 -- 172.21.15.77:0/1445419662 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8030840 con 0x7f6eb80ac840 2023-11-26T07:24:27.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.138+0000 7f6ebd3e0640 1 -- 172.21.15.77:0/1445419662 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea80309a0 con 0x7f6eb80ac840 2023-11-26T07:24:27.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.138+0000 7f6ebd3e0640 1 -- 172.21.15.77:0/1445419662 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8030d30 con 0x7f6eb80ac840 2023-11-26T07:24:27.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.139+0000 7f6ec0646640 1 -- 172.21.15.77:0/1445419662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 msgr2=0x7f6eb80ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.139+0000 7f6ec0646640 1 --2- 172.21.15.77:0/1445419662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 0x7f6eb80ad730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009870 tx=0x7f6ea802b980 comp rx=0 tx=0).stop 2023-11-26T07:24:27.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.139+0000 7f6ec0646640 1 -- 172.21.15.77:0/1445419662 shutdown_connections 2023-11-26T07:24:27.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.139+0000 7f6ec0646640 1 --2- 172.21.15.77:0/1445419662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 0x7f6eb80ad730 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.139+0000 7f6ec0646640 1 --2- 172.21.15.77:0/1445419662 >> v2:172.21.15.159:3300/0 conn(0x7f6eb80ae650 0x7f6eb80aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.139+0000 7f6ec0646640 1 -- 172.21.15.77:0/1445419662 >> 172.21.15.77:0/1445419662 conn(0x7f6eb8071d40 msgr2=0x7f6eb806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:27.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.139+0000 7f6ec0646640 1 -- 172.21.15.77:0/1445419662 shutdown_connections 2023-11-26T07:24:27.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.139+0000 7f6ec0646640 1 -- 172.21.15.77:0/1445419662 wait complete. 2023-11-26T07:24:27.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.141+0000 7f6ec0646640 1 Processor -- start 2023-11-26T07:24:27.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.141+0000 7f6ec0646640 1 -- start start 2023-11-26T07:24:27.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.142+0000 7f6ec0646640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 0x7f6eb80ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.142+0000 7f6ec0646640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6eb80ae650 0x7f6eb80cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.142+0000 7f6ec0646640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815d4f0 0x7f6eb8159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.142+0000 7f6ec0646640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb815a3e0 con 0x7f6eb815d4f0 2023-11-26T07:24:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.142+0000 7f6ec0646640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80cf010 con 0x7f6eb80ae650 2023-11-26T07:24:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.142+0000 7f6ec0646640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb815e5b0 con 0x7f6eb80ac840 2023-11-26T07:24:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.142+0000 7f6ebebe3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815d4f0 0x7f6eb8159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.142+0000 7f6ebebe3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815d4f0 0x7f6eb8159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53226/0 (socket says 172.21.15.77:53226) 2023-11-26T07:24:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.142+0000 7f6ebebe3640 1 -- 172.21.15.77:0/2460436571 learned_addr learned my addr 172.21.15.77:0/2460436571 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:27.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.142+0000 7f6ebdbe1640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6eb80ae650 0x7f6eb80cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.142+0000 7f6ebe3e2640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 0x7f6eb80ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6ebebe3640 1 -- 172.21.15.77:0/2460436571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 msgr2=0x7f6eb80ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6ebebe3640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 0x7f6eb80ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6ebebe3640 1 -- 172.21.15.77:0/2460436571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6eb80ae650 msgr2=0x7f6eb80cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6ebebe3640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6eb80ae650 0x7f6eb80cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6ebebe3640 1 -- 172.21.15.77:0/2460436571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea80094d0 con 0x7f6eb815d4f0 2023-11-26T07:24:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6ebe3e2640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6eb80ac840 0x7f6eb80ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6ebdbe1640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6eb80ae650 0x7f6eb80cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6ebebe3640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815d4f0 0x7f6eb8159690 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009d30 tx=0x7f6eb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6eaeffd640 1 -- 172.21.15.77:0/2460436571 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0009ba0 con 0x7f6eb815d4f0 2023-11-26T07:24:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6eaeffd640 1 -- 172.21.15.77:0/2460436571 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb000f040 con 0x7f6eb815d4f0 2023-11-26T07:24:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6eaeffd640 1 -- 172.21.15.77:0/2460436571 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00146c0 con 0x7f6eb815d4f0 2023-11-26T07:24:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6ec0646640 1 -- 172.21.15.77:0/2460436571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb815dc80 con 0x7f6eb815d4f0 2023-11-26T07:24:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.143+0000 7f6ec0646640 1 -- 172.21.15.77:0/2460436571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb815e240 con 0x7f6eb815d4f0 2023-11-26T07:24:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.144+0000 7f6ec0646640 1 -- 172.21.15.77:0/2460436571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6eb80b48a0 con 0x7f6eb815d4f0 2023-11-26T07:24:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.145+0000 7f6eaeffd640 1 -- 172.21.15.77:0/2460436571 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f6eb0014820 con 0x7f6eb815d4f0 2023-11-26T07:24:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.146+0000 7f6eaeffd640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6e9c06b8f0 0x7f6e9c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.146+0000 7f6eaeffd640 1 -- 172.21.15.77:0/2460436571 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6eb0088da0 con 0x7f6eb815d4f0 2023-11-26T07:24:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.147+0000 7f6ebe3e2640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6e9c06b8f0 0x7f6e9c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.147+0000 7f6eaeffd640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] conn(0x7f6e9c071750 0x7f6e9c073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.147+0000 7f6eaeffd640 1 -- 172.21.15.77:0/2460436571 --> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e9c074220 con 0x7f6e9c071750 2023-11-26T07:24:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.147+0000 7f6eaeffd640 1 -- 172.21.15.77:0/2460436571 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6eb008d6d0 con 0x7f6eb815d4f0 2023-11-26T07:24:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.147+0000 7f6ebdbe1640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] conn(0x7f6e9c071750 0x7f6e9c073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.147+0000 7f6ebe3e2640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6e9c06b8f0 0x7f6e9c06ddb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4000f60 tx=0x7f6eb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.148+0000 7f6ebdbe1640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] conn(0x7f6e9c071750 0x7f6e9c073b70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.148+0000 7f6eaeffd640 1 -- 172.21.15.77:0/2460436571 <== osd.3 v2:172.21.15.77:6809/243154578 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6e9c074220 con 0x7f6e9c071750 2023-11-26T07:24:27.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.162+0000 7f6ec0646640 1 -- 172.21.15.77:0/2460436571 --> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6eb80b45c0 con 0x7f6e9c071750 2023-11-26T07:24:27.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.163+0000 7f6eaeffd640 1 -- 172.21.15.77:0/2460436571 <== osd.3 v2:172.21.15.77:6809/243154578 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6ea8030b90 con 0x7f6e9c071750 2023-11-26T07:24:27.165 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:27.165 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:27.166 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:27.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.163+0000 7f6ec0646640 1 -- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] conn(0x7f6e9c071750 msgr2=0x7f6e9c073b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.163+0000 7f6ec0646640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:6809/243154578,v1:172.21.15.77:6811/243154578] conn(0x7f6e9c071750 0x7f6e9c073b70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.163+0000 7f6ec0646640 1 -- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6e9c06b8f0 msgr2=0x7f6e9c06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.163+0000 7f6ec0646640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f6e9c06b8f0 0x7f6e9c06ddb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4000f60 tx=0x7f6eb4009040 comp rx=0 tx=0).stop 2023-11-26T07:24:27.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.163+0000 7f6ec0646640 1 -- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815d4f0 msgr2=0x7f6eb8159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.163+0000 7f6ec0646640 1 --2- 172.21.15.77:0/2460436571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815d4f0 0x7f6eb8159690 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009d30 tx=0x7f6eb000c490 comp rx=0 tx=0).stop 2023-11-26T07:24:27.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.163+0000 7f6ebebe3640 1 -- 172.21.15.77:0/2460436571 reap_dead start 2023-11-26T07:24:27.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.163+0000 7f6ec0646640 1 -- 172.21.15.77:0/2460436571 shutdown_connections 2023-11-26T07:24:27.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.163+0000 7f6ec0646640 1 -- 172.21.15.77:0/2460436571 >> 172.21.15.77:0/2460436571 conn(0x7f6eb8071d40 msgr2=0x7f6eb806e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:27.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.164+0000 7f6ec0646640 1 -- 172.21.15.77:0/2460436571 shutdown_connections 2023-11-26T07:24:27.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.164+0000 7f6ec0646640 1 -- 172.21.15.77:0/2460436571 wait complete. 2023-11-26T07:24:27.183 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-26T07:24:27.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.394+0000 7fed22094640 1 Processor -- start 2023-11-26T07:24:27.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.395+0000 7fed22094640 1 -- start start 2023-11-26T07:24:27.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.396+0000 7fed22094640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed1c06aa30 0x7fed1c0cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.396+0000 7fed22094640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1c0b2690 con 0x7fed1c0cf420 2023-11-26T07:24:27.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.396+0000 7fed22094640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1c06ed00 con 0x7fed1c0b28d0 2023-11-26T07:24:27.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.396+0000 7fed22094640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0cc7f0 con 0x7fed1c06aa30 2023-11-26T07:24:27.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.396+0000 7fed1bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fed1c0cf420 0x7fed1c1616d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55426/0 (socket says 172.21.15.77:55426) 2023-11-26T07:24:27.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.396+0000 7fed1bfff640 1 -- 172.21.15.77:0/4147323703 learned_addr learned my addr 172.21.15.77:0/4147323703 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:27.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.397+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745265473 0 0) 0x7fed1c0b2690 con 0x7fed1c0cf420 2023-11-26T07:24:27.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.397+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed08003520 con 0x7fed1c0cf420 2023-11-26T07:24:27.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.397+0000 7fed1b7fe640 1 --2- 172.21.15.77:0/4147323703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed1c06aa30 0x7fed1c0cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.397+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279595759 0 0) 0x7fed08003520 con 0x7fed1c0cf420 2023-11-26T07:24:27.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.397+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed1c06aa30 msgr2=0x7fed1c0cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:27.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.397+0000 7fed1a7fc640 1 --2- 172.21.15.77:0/4147323703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed1c06aa30 0x7fed1c0cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.397+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 >> v1:172.21.15.159:6789/0 conn(0x7fed1c0b28d0 legacy=0x7fed1c0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.397+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c06efe0 con 0x7fed1c0cf420 2023-11-26T07:24:27.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.397+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fed14001670 con 0x7fed1c0cf420 2023-11-26T07:24:27.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.397+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 >> v1:172.21.15.77:6789/0 conn(0x7fed1c0cf420 legacy=0x7fed1c1616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.397+0000 7fed1a7fc640 1 --2- 172.21.15.77:0/4147323703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed080039a0 0x7fed08003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.398+0000 7fed1a7fc640 1 --2- 172.21.15.77:0/4147323703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 0x7fed08004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.398+0000 7fed1a7fc640 1 --2- 172.21.15.77:0/4147323703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed1c06aa30 0x7fed08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.398+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0cc7f0 con 0x7fed080047c0 2023-11-26T07:24:27.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.398+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0800bac0 con 0x7fed080039a0 2023-11-26T07:24:27.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.398+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0800bc80 con 0x7fed1c06aa30 2023-11-26T07:24:27.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.398+0000 7fed1affd640 1 --2- 172.21.15.77:0/4147323703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 0x7fed08004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.398+0000 7fed1affd640 1 -- 172.21.15.77:0/4147323703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed1c06aa30 msgr2=0x7fed08005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:27.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.398+0000 7fed1affd640 1 --2- 172.21.15.77:0/4147323703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed1c06aa30 0x7fed08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.398+0000 7fed1affd640 1 -- 172.21.15.77:0/4147323703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed080039a0 msgr2=0x7fed08003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:27.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.398+0000 7fed1affd640 1 --2- 172.21.15.77:0/4147323703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed080039a0 0x7fed08003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.398+0000 7fed1affd640 1 -- 172.21.15.77:0/4147323703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08003520 con 0x7fed080047c0 2023-11-26T07:24:27.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.399+0000 7fed1affd640 1 --2- 172.21.15.77:0/4147323703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 0x7fed08004c40 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fed04001720 tx=0x7fed080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874cc614659015c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:27.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.400+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed040052d0 con 0x7fed080047c0 2023-11-26T07:24:27.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.400+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0402e050 con 0x7fed080047c0 2023-11-26T07:24:27.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.400+0000 7fed1a7fc640 1 -- 172.21.15.77:0/4147323703 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed040035f0 con 0x7fed080047c0 2023-11-26T07:24:27.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.400+0000 7fed22094640 1 -- 172.21.15.77:0/4147323703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 msgr2=0x7fed08004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.400+0000 7fed22094640 1 --2- 172.21.15.77:0/4147323703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 0x7fed08004c40 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fed04001720 tx=0x7fed080057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.400+0000 7fed1bfff640 1 -- 172.21.15.77:0/4147323703 reap_dead start 2023-11-26T07:24:27.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.400+0000 7fed22094640 1 -- 172.21.15.77:0/4147323703 shutdown_connections 2023-11-26T07:24:27.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.400+0000 7fed22094640 1 -- 172.21.15.77:0/4147323703 >> 172.21.15.77:0/4147323703 conn(0x7fed1c0999d0 msgr2=0x7fed1c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:27.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.400+0000 7fed22094640 1 -- 172.21.15.77:0/4147323703 shutdown_connections 2023-11-26T07:24:27.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.401+0000 7fed22094640 1 -- 172.21.15.77:0/4147323703 wait complete. 2023-11-26T07:24:27.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.402+0000 7fed22094640 1 Processor -- start 2023-11-26T07:24:27.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.402+0000 7fed22094640 1 -- start start 2023-11-26T07:24:27.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.403+0000 7fed22094640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 0x7fed1c155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.403+0000 7fed22094640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed1c15b1b0 0x7fed1c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.403+0000 7fed22094640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed1c15ed70 0x7fed1c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.403+0000 7fed22094640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c15f730 con 0x7fed080047c0 2023-11-26T07:24:27.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.403+0000 7fed22094640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c15c780 con 0x7fed1c15ed70 2023-11-26T07:24:27.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.403+0000 7fed22094640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c15b6e0 con 0x7fed1c15b1b0 2023-11-26T07:24:27.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.404+0000 7fed1b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 0x7fed1c155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.404+0000 7fed1b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 0x7fed1c155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53248/0 (socket says 172.21.15.77:53248) 2023-11-26T07:24:27.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.404+0000 7fed1b7fe640 1 -- 172.21.15.77:0/1782394264 learned_addr learned my addr 172.21.15.77:0/1782394264 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:27.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.404+0000 7fed1b7fe640 1 -- 172.21.15.77:0/1782394264 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed1c15b1b0 msgr2=0x7fed1c158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.404+0000 7fed1b7fe640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed1c15b1b0 0x7fed1c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.404+0000 7fed1b7fe640 1 -- 172.21.15.77:0/1782394264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed1c15ed70 msgr2=0x7fed1c15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.404+0000 7fed1b7fe640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed1c15ed70 0x7fed1c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.404+0000 7fed1b7fe640 1 -- 172.21.15.77:0/1782394264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c15b9c0 con 0x7fed080047c0 2023-11-26T07:24:27.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.404+0000 7fed1b7fe640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 0x7fed1c155f80 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00ef40 tx=0x7fed0c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:27.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.405+0000 7fed13fff640 1 -- 172.21.15.77:0/1782394264 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c010040 con 0x7fed080047c0 2023-11-26T07:24:27.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.405+0000 7fed13fff640 1 -- 172.21.15.77:0/1782394264 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c014400 con 0x7fed080047c0 2023-11-26T07:24:27.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.405+0000 7fed22094640 1 -- 172.21.15.77:0/1782394264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1c15bca0 con 0x7fed080047c0 2023-11-26T07:24:27.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.405+0000 7fed13fff640 1 -- 172.21.15.77:0/1782394264 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c009c20 con 0x7fed080047c0 2023-11-26T07:24:27.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.405+0000 7fed22094640 1 -- 172.21.15.77:0/1782394264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c15c260 con 0x7fed080047c0 2023-11-26T07:24:27.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.406+0000 7fed22094640 1 -- 172.21.15.77:0/1782394264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c067470 con 0x7fed080047c0 2023-11-26T07:24:27.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.407+0000 7fed13fff640 1 -- 172.21.15.77:0/1782394264 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fed0c0147b0 con 0x7fed080047c0 2023-11-26T07:24:27.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.408+0000 7fed13fff640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fecfc06b920 0x7fecfc06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.408+0000 7fed13fff640 1 -- 172.21.15.77:0/1782394264 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fed0c088920 con 0x7fed080047c0 2023-11-26T07:24:27.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.408+0000 7fed1affd640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fecfc06b920 0x7fecfc06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.409+0000 7fed1affd640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fecfc06b920 0x7fecfc06dde0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fed04033000 tx=0x7fed0402f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:27.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.412+0000 7fed13fff640 1 -- 172.21.15.77:0/1782394264 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed0c0551f0 con 0x7fed080047c0 2023-11-26T07:24:27.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.601+0000 7fed22094640 1 -- 172.21.15.77:0/1782394264 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fed1c06f5a0 con 0x7fecfc06b920 2023-11-26T07:24:27.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.602+0000 7fed13fff640 1 -- 172.21.15.77:0/1782394264 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fed04005330 con 0x7fecfc06b920 2023-11-26T07:24:27.605 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 3 to deep-scrub 2023-11-26T07:24:27.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 -- 172.21.15.77:0/1782394264 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fecfc06b920 msgr2=0x7fecfc06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fecfc06b920 0x7fecfc06dde0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fed04033000 tx=0x7fed0402f000 comp rx=0 tx=0).stop 2023-11-26T07:24:27.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 -- 172.21.15.77:0/1782394264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 msgr2=0x7fed1c155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 0x7fed1c155f80 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00ef40 tx=0x7fed0c00b480 comp rx=0 tx=0).stop 2023-11-26T07:24:27.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 -- 172.21.15.77:0/1782394264 shutdown_connections 2023-11-26T07:24:27.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fecfc06b920 0x7fecfc06dde0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed1c15ed70 0x7fed1c15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed1c15b1b0 0x7fed1c158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 --2- 172.21.15.77:0/1782394264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080047c0 0x7fed1c155f80 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 -- 172.21.15.77:0/1782394264 >> 172.21.15.77:0/1782394264 conn(0x7fed1c0999d0 msgr2=0x7fed1c0addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:27.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 -- 172.21.15.77:0/1782394264 shutdown_connections 2023-11-26T07:24:27.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.605+0000 7fed22094640 1 -- 172.21.15.77:0/1782394264 wait complete. 2023-11-26T07:24:27.627 INFO:tasks.ceph:Scrubbing osd.4 2023-11-26T07:24:27.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:27.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.843+0000 7fc3d759e640 1 Processor -- start 2023-11-26T07:24:27.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.844+0000 7fc3d759e640 1 -- start start 2023-11-26T07:24:27.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.845+0000 7fc3d759e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3d815e7c0 0x7fc3d80d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.845+0000 7fc3d759e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d80d21f0 con 0x7fc3d8160a50 2023-11-26T07:24:27.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.845+0000 7fc3d759e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d815ec10 con 0x7fc3d80cff80 2023-11-26T07:24:27.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.845+0000 7fc3d759e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d80d1480 con 0x7fc3d815e7c0 2023-11-26T07:24:27.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.845+0000 7fc3d6d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3d815e7c0 0x7fc3d80d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.846+0000 7fc3d6d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3d815e7c0 0x7fc3d80d0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53258/0 (socket says 172.21.15.77:53258) 2023-11-26T07:24:27.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.846+0000 7fc3d6d9d640 1 -- 172.21.15.77:0/4036038944 learned_addr learned my addr 172.21.15.77:0/4036038944 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:27.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.846+0000 7fc3d6d9d640 1 -- 172.21.15.77:0/4036038944 >> v1:172.21.15.159:6789/0 conn(0x7fc3d80cff80 legacy=0x7fc3d815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:27.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.846+0000 7fc3d6d9d640 1 -- 172.21.15.77:0/4036038944 >> v1:172.21.15.77:6789/0 conn(0x7fc3d8160a50 legacy=0x7fc3d80cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.846+0000 7fc3d6d9d640 1 -- 172.21.15.77:0/4036038944 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d80cdce0 con 0x7fc3d815e7c0 2023-11-26T07:24:27.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.847+0000 7fc3d6d9d640 1 --2- 172.21.15.77:0/4036038944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d815e7c0 0x7fc3d80d0f40 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009870 tx=0x7fc3d002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dff5991f6a64caf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:27.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.847+0000 7fc3d559a640 1 -- 172.21.15.77:0/4036038944 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0030850 con 0x7fc3d815e7c0 2023-11-26T07:24:27.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.847+0000 7fc3d559a640 1 -- 172.21.15.77:0/4036038944 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d00309b0 con 0x7fc3d815e7c0 2023-11-26T07:24:27.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.847+0000 7fc3d559a640 1 -- 172.21.15.77:0/4036038944 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0030d40 con 0x7fc3d815e7c0 2023-11-26T07:24:27.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.848+0000 7fc3d759e640 1 -- 172.21.15.77:0/4036038944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d815e7c0 msgr2=0x7fc3d80d0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.848+0000 7fc3d759e640 1 --2- 172.21.15.77:0/4036038944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d815e7c0 0x7fc3d80d0f40 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009870 tx=0x7fc3d002b990 comp rx=0 tx=0).stop 2023-11-26T07:24:27.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.848+0000 7fc3d759e640 1 -- 172.21.15.77:0/4036038944 shutdown_connections 2023-11-26T07:24:27.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.848+0000 7fc3d759e640 1 --2- 172.21.15.77:0/4036038944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d815e7c0 0x7fc3d80d0f40 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.848+0000 7fc3d759e640 1 -- 172.21.15.77:0/4036038944 >> 172.21.15.77:0/4036038944 conn(0x7fc3d809c500 msgr2=0x7fc3d80d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:27.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.848+0000 7fc3d759e640 1 -- 172.21.15.77:0/4036038944 shutdown_connections 2023-11-26T07:24:27.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.848+0000 7fc3d759e640 1 -- 172.21.15.77:0/4036038944 wait complete. 2023-11-26T07:24:27.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.850+0000 7fc3d759e640 1 Processor -- start 2023-11-26T07:24:27.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.850+0000 7fc3d759e640 1 -- start start 2023-11-26T07:24:27.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.851+0000 7fc3d759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d80cff80 0x7fc3d80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.851+0000 7fc3d759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3d815e7c0 0x7fc3d81f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.851+0000 7fc3d759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d8160a50 0x7fc3d815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.851+0000 7fc3d759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d815a160 con 0x7fc3d8160a50 2023-11-26T07:24:27.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.851+0000 7fc3d759e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d81f76a0 con 0x7fc3d80cff80 2023-11-26T07:24:27.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.851+0000 7fc3d759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d815a400 con 0x7fc3d815e7c0 2023-11-26T07:24:27.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.851+0000 7fc3d6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d8160a50 0x7fc3d815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.852+0000 7fc3d6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d8160a50 0x7fc3d815aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53266/0 (socket says 172.21.15.77:53266) 2023-11-26T07:24:27.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.852+0000 7fc3d6d9d640 1 -- 172.21.15.77:0/823741257 learned_addr learned my addr 172.21.15.77:0/823741257 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:27.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.852+0000 7fc3d5d9b640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3d815e7c0 0x7fc3d81f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.852+0000 7fc3d659c640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d80cff80 0x7fc3d80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.852+0000 7fc3d6d9d640 1 -- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3d815e7c0 msgr2=0x7fc3d81f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.852+0000 7fc3d6d9d640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3d815e7c0 0x7fc3d81f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.852+0000 7fc3d6d9d640 1 -- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d80cff80 msgr2=0x7fc3d80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.852+0000 7fc3d6d9d640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d80cff80 0x7fc3d80cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.852+0000 7fc3d6d9d640 1 -- 172.21.15.77:0/823741257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d00094d0 con 0x7fc3d8160a50 2023-11-26T07:24:27.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.852+0000 7fc3d659c640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3d80cff80 0x7fc3d80cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:27.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.852+0000 7fc3d6d9d640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d8160a50 0x7fc3d815aee0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fc3d002b9d0 tx=0x7fc3d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:27.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.853+0000 7fc3ceffd640 1 -- 172.21.15.77:0/823741257 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0043400 con 0x7fc3d8160a50 2023-11-26T07:24:27.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.853+0000 7fc3ceffd640 1 -- 172.21.15.77:0/823741257 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d0043580 con 0x7fc3d8160a50 2023-11-26T07:24:27.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.853+0000 7fc3ceffd640 1 -- 172.21.15.77:0/823741257 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0043930 con 0x7fc3d8160a50 2023-11-26T07:24:27.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.853+0000 7fc3d759e640 1 -- 172.21.15.77:0/823741257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d815a6e0 con 0x7fc3d8160a50 2023-11-26T07:24:27.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.853+0000 7fc3d759e640 1 -- 172.21.15.77:0/823741257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d80cba20 con 0x7fc3d8160a50 2023-11-26T07:24:27.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.854+0000 7fc3d759e640 1 -- 172.21.15.77:0/823741257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3d80d1c30 con 0x7fc3d8160a50 2023-11-26T07:24:27.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.855+0000 7fc3ceffd640 1 -- 172.21.15.77:0/823741257 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fc3d002e070 con 0x7fc3d8160a50 2023-11-26T07:24:27.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.856+0000 7fc3ceffd640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc3b806b920 0x7fc3b806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.856+0000 7fc3ceffd640 1 -- 172.21.15.77:0/823741257 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc3d003e070 con 0x7fc3d8160a50 2023-11-26T07:24:27.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.856+0000 7fc3d659c640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc3b806b920 0x7fc3b806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.856+0000 7fc3ceffd640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] conn(0x7fc3b8071780 0x7fc3b8073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:27.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.856+0000 7fc3ceffd640 1 -- 172.21.15.77:0/823741257 --> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3b8074250 con 0x7fc3b8071780 2023-11-26T07:24:27.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.856+0000 7fc3ceffd640 1 -- 172.21.15.77:0/823741257 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3d00afbc0 con 0x7fc3d8160a50 2023-11-26T07:24:27.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.856+0000 7fc3d659c640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc3b806b920 0x7fc3b806dde0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80012e0 tx=0x7fc3c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:27.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.857+0000 7fc3d5d9b640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] conn(0x7fc3b8071780 0x7fc3b8073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:27.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.857+0000 7fc3d5d9b640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] conn(0x7fc3b8071780 0x7fc3b8073ba0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:27.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.859+0000 7fc3ceffd640 1 -- 172.21.15.77:0/823741257 <== osd.4 v2:172.21.15.159:6816/3986384485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc3b8074250 con 0x7fc3b8071780 2023-11-26T07:24:27.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.874+0000 7fc3d759e640 1 -- 172.21.15.77:0/823741257 --> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc3d80d1950 con 0x7fc3b8071780 2023-11-26T07:24:27.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.875+0000 7fc3ceffd640 1 -- 172.21.15.77:0/823741257 <== osd.4 v2:172.21.15.159:6816/3986384485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc3c000b960 con 0x7fc3b8071780 2023-11-26T07:24:27.877 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:27.878 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:27.878 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:27.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.875+0000 7fc3d759e640 1 -- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] conn(0x7fc3b8071780 msgr2=0x7fc3b8073ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.875+0000 7fc3d759e640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.159:6816/3986384485,v1:172.21.15.159:6818/3986384485] conn(0x7fc3b8071780 0x7fc3b8073ba0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:27.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.875+0000 7fc3d759e640 1 -- 172.21.15.77:0/823741257 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc3b806b920 msgr2=0x7fc3b806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.875+0000 7fc3d759e640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fc3b806b920 0x7fc3b806dde0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80012e0 tx=0x7fc3c8009040 comp rx=0 tx=0).stop 2023-11-26T07:24:27.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.875+0000 7fc3d759e640 1 -- 172.21.15.77:0/823741257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d8160a50 msgr2=0x7fc3d815aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:27.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.876+0000 7fc3d759e640 1 --2- 172.21.15.77:0/823741257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d8160a50 0x7fc3d815aee0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fc3d002b9d0 tx=0x7fc3d0004730 comp rx=0 tx=0).stop 2023-11-26T07:24:27.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.876+0000 7fc3d6d9d640 1 -- 172.21.15.77:0/823741257 reap_dead start 2023-11-26T07:24:27.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.876+0000 7fc3d759e640 1 -- 172.21.15.77:0/823741257 shutdown_connections 2023-11-26T07:24:27.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.876+0000 7fc3d759e640 1 -- 172.21.15.77:0/823741257 >> 172.21.15.77:0/823741257 conn(0x7fc3d809c500 msgr2=0x7fc3d806ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:27.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.876+0000 7fc3d759e640 1 -- 172.21.15.77:0/823741257 shutdown_connections 2023-11-26T07:24:27.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:27.876+0000 7fc3d759e640 1 -- 172.21.15.77:0/823741257 wait complete. 2023-11-26T07:24:27.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-26T07:24:28.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.112+0000 7f190f4e7640 1 Processor -- start 2023-11-26T07:24:28.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.113+0000 7f190f4e7640 1 -- start start 2023-11-26T07:24:28.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.114+0000 7f190f4e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f19081461d0 0x7f19080b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.114+0000 7f190f4e7640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f19080b4fe0 0x7f19080b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.114+0000 7f190f4e7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080b3890 0x7f190815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.114+0000 7f190f4e7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080b3d00 con 0x7f19081461d0 2023-11-26T07:24:28.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.114+0000 7f190f4e7640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190806d180 con 0x7f19080b4fe0 2023-11-26T07:24:28.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.114+0000 7f190f4e7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190806ba70 con 0x7f19080b3890 2023-11-26T07:24:28.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.115+0000 7f190d283640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f19081461d0 0x7f19080b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.115+0000 7f190d283640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f19081461d0 0x7f19080b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53270/0 (socket says 172.21.15.77:53270) 2023-11-26T07:24:28.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.115+0000 7f190d283640 1 -- 172.21.15.77:0/1635734226 learned_addr learned my addr 172.21.15.77:0/1635734226 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.115+0000 7f190d283640 1 -- 172.21.15.77:0/1635734226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080b3890 msgr2=0x7f190815dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.115+0000 7f190d283640 1 --2- 172.21.15.77:0/1635734226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080b3890 0x7f190815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.115+0000 7f190d283640 1 -- 172.21.15.77:0/1635734226 >> v2:172.21.15.159:3300/0 conn(0x7f19080b4fe0 msgr2=0x7f19080b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.115+0000 7f190d283640 1 --2- 172.21.15.77:0/1635734226 >> v2:172.21.15.159:3300/0 conn(0x7f19080b4fe0 0x7f19080b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.115+0000 7f190d283640 1 -- 172.21.15.77:0/1635734226 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190806bd50 con 0x7f19081461d0 2023-11-26T07:24:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.116+0000 7f190d283640 1 --2- 172.21.15.77:0/1635734226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19081461d0 0x7f19080b4aa0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009e80 tx=0x7f18f802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ccf4fa5a9dc588 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.116+0000 7f1907fff640 1 -- 172.21.15.77:0/1635734226 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f802ca50 con 0x7f19081461d0 2023-11-26T07:24:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.117+0000 7f1907fff640 1 -- 172.21.15.77:0/1635734226 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f802cbb0 con 0x7f19081461d0 2023-11-26T07:24:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.117+0000 7f1907fff640 1 -- 172.21.15.77:0/1635734226 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80343f0 con 0x7f19081461d0 2023-11-26T07:24:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.117+0000 7f190f4e7640 1 -- 172.21.15.77:0/1635734226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19081461d0 msgr2=0x7f19080b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.117+0000 7f190f4e7640 1 --2- 172.21.15.77:0/1635734226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19081461d0 0x7f19080b4aa0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009e80 tx=0x7f18f802beb0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.117+0000 7f190f4e7640 1 -- 172.21.15.77:0/1635734226 shutdown_connections 2023-11-26T07:24:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.117+0000 7f190f4e7640 1 --2- 172.21.15.77:0/1635734226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080b3890 0x7f190815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.117+0000 7f190f4e7640 1 --2- 172.21.15.77:0/1635734226 >> v2:172.21.15.159:3300/0 conn(0x7f19080b4fe0 0x7f19080b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.117+0000 7f190f4e7640 1 --2- 172.21.15.77:0/1635734226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19081461d0 0x7f19080b4aa0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.117+0000 7f190f4e7640 1 -- 172.21.15.77:0/1635734226 >> 172.21.15.77:0/1635734226 conn(0x7f1908061340 msgr2=0x7f1908061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.117+0000 7f190f4e7640 1 -- 172.21.15.77:0/1635734226 shutdown_connections 2023-11-26T07:24:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.117+0000 7f190f4e7640 1 -- 172.21.15.77:0/1635734226 wait complete. 2023-11-26T07:24:28.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.119+0000 7f190f4e7640 1 Processor -- start 2023-11-26T07:24:28.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.119+0000 7f190f4e7640 1 -- start start 2023-11-26T07:24:28.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.120+0000 7f190f4e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080b3890 0x7f19080ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.120+0000 7f190f4e7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080b4fe0 0x7f190813ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.120+0000 7f190f4e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19081461d0 0x7f19080cf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.120+0000 7f190f4e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190813f350 con 0x7f19081461d0 2023-11-26T07:24:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.120+0000 7f190f4e7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19080cab10 con 0x7f19080b3890 2023-11-26T07:24:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.120+0000 7f190f4e7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19080cadf0 con 0x7f19080b4fe0 2023-11-26T07:24:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.120+0000 7f190da84640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19081461d0 0x7f19080cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.120+0000 7f190da84640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19081461d0 0x7f19080cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53278/0 (socket says 172.21.15.77:53278) 2023-11-26T07:24:28.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.121+0000 7f190da84640 1 -- 172.21.15.77:0/1134072085 learned_addr learned my addr 172.21.15.77:0/1134072085 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:28.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.121+0000 7f190d283640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080b3890 0x7f19080ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.121+0000 7f190ca82640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080b4fe0 0x7f190813ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.121+0000 7f190da84640 1 -- 172.21.15.77:0/1134072085 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080b4fe0 msgr2=0x7f190813ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.121+0000 7f190da84640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080b4fe0 0x7f190813ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.121+0000 7f190da84640 1 -- 172.21.15.77:0/1134072085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080b3890 msgr2=0x7f19080ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.121+0000 7f190da84640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080b3890 0x7f19080ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.121+0000 7f190da84640 1 -- 172.21.15.77:0/1134072085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8009b30 con 0x7f19081461d0 2023-11-26T07:24:28.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.121+0000 7f190da84640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19081461d0 0x7f19080cf110 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1900009fd0 tx=0x7f190000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:28.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.122+0000 7f1905ffb640 1 -- 172.21.15.77:0/1134072085 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011830 con 0x7f19081461d0 2023-11-26T07:24:28.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.122+0000 7f1905ffb640 1 -- 172.21.15.77:0/1134072085 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1900011990 con 0x7f19081461d0 2023-11-26T07:24:28.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.122+0000 7f190f4e7640 1 -- 172.21.15.77:0/1134072085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19080cb0d0 con 0x7f19081461d0 2023-11-26T07:24:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.122+0000 7f1905ffb640 1 -- 172.21.15.77:0/1134072085 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011d20 con 0x7f19081461d0 2023-11-26T07:24:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.122+0000 7f190f4e7640 1 -- 172.21.15.77:0/1134072085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19080cb690 con 0x7f19081461d0 2023-11-26T07:24:28.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.123+0000 7f190f4e7640 1 -- 172.21.15.77:0/1134072085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1908067470 con 0x7f19081461d0 2023-11-26T07:24:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.124+0000 7f1905ffb640 1 -- 172.21.15.77:0/1134072085 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f190001b460 con 0x7f19081461d0 2023-11-26T07:24:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.125+0000 7f1905ffb640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f18f406b8f0 0x7f18f406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.125+0000 7f1905ffb640 1 -- 172.21.15.77:0/1134072085 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1900087cd0 con 0x7f19081461d0 2023-11-26T07:24:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.125+0000 7f190d283640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f18f406b8f0 0x7f18f406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.126+0000 7f190d283640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f18f406b8f0 0x7f18f406ddb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f18f8035000 tx=0x7f18f8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:28.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.130+0000 7f1905ffb640 1 -- 172.21.15.77:0/1134072085 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19000582a0 con 0x7f19081461d0 2023-11-26T07:24:28.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.318+0000 7f190f4e7640 1 -- 172.21.15.77:0/1134072085 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1908145aa0 con 0x7f18f406b8f0 2023-11-26T07:24:28.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.319+0000 7f1905ffb640 1 -- 172.21.15.77:0/1134072085 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1908145aa0 con 0x7f18f406b8f0 2023-11-26T07:24:28.322 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 4 to deep-scrub 2023-11-26T07:24:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 -- 172.21.15.77:0/1134072085 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f18f406b8f0 msgr2=0x7f18f406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f18f406b8f0 0x7f18f406ddb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f18f8035000 tx=0x7f18f8030000 comp rx=0 tx=0).stop 2023-11-26T07:24:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 -- 172.21.15.77:0/1134072085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19081461d0 msgr2=0x7f19080cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19081461d0 0x7f19080cf110 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1900009fd0 tx=0x7f190000b8e0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 -- 172.21.15.77:0/1134072085 shutdown_connections 2023-11-26T07:24:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f18f406b8f0 0x7f18f406ddb0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19081461d0 0x7f19080cf110 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080b4fe0 0x7f190813ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 --2- 172.21.15.77:0/1134072085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080b3890 0x7f19080ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 -- 172.21.15.77:0/1134072085 >> 172.21.15.77:0/1134072085 conn(0x7f1908061340 msgr2=0x7f1908142910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:28.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 -- 172.21.15.77:0/1134072085 shutdown_connections 2023-11-26T07:24:28.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.322+0000 7f190f4e7640 1 -- 172.21.15.77:0/1134072085 wait complete. 2023-11-26T07:24:28.343 INFO:tasks.ceph:Scrubbing osd.5 2023-11-26T07:24:28.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:28.468 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:28.479 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:28.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.541+0000 7f951d867640 1 Processor -- start 2023-11-26T07:24:28.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.542+0000 7f951d867640 1 -- start start 2023-11-26T07:24:28.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.543+0000 7f951d867640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9518144510 0x7f951806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.543+0000 7f951d867640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f951815edd0 0x7f95180b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.543+0000 7f951d867640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f95180ccd00 0x7f95180b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.543+0000 7f951d867640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95181448f0 con 0x7f951815edd0 2023-11-26T07:24:28.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.543+0000 7f951d867640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9518144d80 con 0x7f95180ccd00 2023-11-26T07:24:28.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.543+0000 7f951d867640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951815f2d0 con 0x7f9518144510 2023-11-26T07:24:28.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.543+0000 7f9517fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f951815edd0 0x7f95180b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.543+0000 7f9517fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f951815edd0 0x7f95180b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53284/0 (socket says 172.21.15.77:53284) 2023-11-26T07:24:28.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.543+0000 7f9517fff640 1 -- 172.21.15.77:0/1358188661 learned_addr learned my addr 172.21.15.77:0/1358188661 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:28.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.544+0000 7f951d066640 1 --2- 172.21.15.77:0/1358188661 >> v2:172.21.15.159:3300/0 conn(0x7f95180ccd00 0x7f95180b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.544+0000 7f951c865640 1 --2- 172.21.15.77:0/1358188661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9518144510 0x7f951806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.544+0000 7f9517fff640 1 -- 172.21.15.77:0/1358188661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9518144510 msgr2=0x7f951806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:28.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.544+0000 7f9517fff640 1 --2- 172.21.15.77:0/1358188661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9518144510 0x7f951806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.544+0000 7f9517fff640 1 -- 172.21.15.77:0/1358188661 >> v2:172.21.15.159:3300/0 conn(0x7f95180ccd00 msgr2=0x7f95180b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:28.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.544+0000 7f9517fff640 1 --2- 172.21.15.77:0/1358188661 >> v2:172.21.15.159:3300/0 conn(0x7f95180ccd00 0x7f95180b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.544+0000 7f9517fff640 1 -- 172.21.15.77:0/1358188661 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951815f5b0 con 0x7f951815edd0 2023-11-26T07:24:28.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.545+0000 7f9517fff640 1 --2- 172.21.15.77:0/1358188661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f951815edd0 0x7f95180b0ae0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f951806df70 tx=0x7f950402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6baaf6d39be34b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:28.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.546+0000 7f95177fe640 1 -- 172.21.15.77:0/1358188661 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9504004230 con 0x7f951815edd0 2023-11-26T07:24:28.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.546+0000 7f95177fe640 1 -- 172.21.15.77:0/1358188661 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9504004390 con 0x7f951815edd0 2023-11-26T07:24:28.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.546+0000 7f95177fe640 1 -- 172.21.15.77:0/1358188661 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9504003810 con 0x7f951815edd0 2023-11-26T07:24:28.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.546+0000 7f951d867640 1 -- 172.21.15.77:0/1358188661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f951815edd0 msgr2=0x7f95180b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.546+0000 7f951d867640 1 --2- 172.21.15.77:0/1358188661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f951815edd0 0x7f95180b0ae0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f951806df70 tx=0x7f950402b860 comp rx=0 tx=0).stop 2023-11-26T07:24:28.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.547+0000 7f951d867640 1 -- 172.21.15.77:0/1358188661 shutdown_connections 2023-11-26T07:24:28.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.547+0000 7f951d867640 1 --2- 172.21.15.77:0/1358188661 >> v2:172.21.15.159:3300/0 conn(0x7f95180ccd00 0x7f95180b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.547+0000 7f951d867640 1 --2- 172.21.15.77:0/1358188661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f951815edd0 0x7f95180b0ae0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.547+0000 7f951d867640 1 --2- 172.21.15.77:0/1358188661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9518144510 0x7f951806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.547+0000 7f951d867640 1 -- 172.21.15.77:0/1358188661 >> 172.21.15.77:0/1358188661 conn(0x7f95180cb8a0 msgr2=0x7f95180cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:28.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.547+0000 7f951d867640 1 -- 172.21.15.77:0/1358188661 shutdown_connections 2023-11-26T07:24:28.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.547+0000 7f951d867640 1 -- 172.21.15.77:0/1358188661 wait complete. 2023-11-26T07:24:28.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.548+0000 7f951d867640 1 Processor -- start 2023-11-26T07:24:28.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.548+0000 7f951d867640 1 -- start start 2023-11-26T07:24:28.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.549+0000 7f951d867640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95180ccd00 0x7f951813cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.549+0000 7f951d867640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9518144510 0x7f951815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.549+0000 7f951d867640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f951815edd0 0x7f951815df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.549+0000 7f951d867640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95180cdc30 con 0x7f951815edd0 2023-11-26T07:24:28.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.549+0000 7f951d867640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951815e730 con 0x7f9518144510 2023-11-26T07:24:28.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.549+0000 7f951d867640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180cd290 con 0x7f95180ccd00 2023-11-26T07:24:28.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.550+0000 7f951d066640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f951815edd0 0x7f951815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.550+0000 7f951d066640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f951815edd0 0x7f951815df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53298/0 (socket says 172.21.15.77:53298) 2023-11-26T07:24:28.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.550+0000 7f951d066640 1 -- 172.21.15.77:0/1284071864 learned_addr learned my addr 172.21.15.77:0/1284071864 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:28.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.550+0000 7f9517fff640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9518144510 0x7f951815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.550+0000 7f951c865640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95180ccd00 0x7f951813cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.550+0000 7f951d066640 1 -- 172.21.15.77:0/1284071864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95180ccd00 msgr2=0x7f951813cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.550+0000 7f951d066640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f95180ccd00 0x7f951813cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.550+0000 7f951d066640 1 -- 172.21.15.77:0/1284071864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9518144510 msgr2=0x7f951815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.550+0000 7f951d066640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9518144510 0x7f951815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.550+0000 7f951d066640 1 -- 172.21.15.77:0/1284071864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9504009460 con 0x7f951815edd0 2023-11-26T07:24:28.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.550+0000 7f951d066640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f951815edd0 0x7f951815df10 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f9510007e40 tx=0x7f951000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:28.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.551+0000 7f95157fa640 1 -- 172.21.15.77:0/1284071864 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510014620 con 0x7f951815edd0 2023-11-26T07:24:28.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.551+0000 7f95157fa640 1 -- 172.21.15.77:0/1284071864 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951000ee90 con 0x7f951815edd0 2023-11-26T07:24:28.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.551+0000 7f95157fa640 1 -- 172.21.15.77:0/1284071864 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95100149e0 con 0x7f951815edd0 2023-11-26T07:24:28.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.551+0000 7f951d867640 1 -- 172.21.15.77:0/1284071864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95180cd570 con 0x7f951815edd0 2023-11-26T07:24:28.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.551+0000 7f951d867640 1 -- 172.21.15.77:0/1284071864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951815e450 con 0x7f951815edd0 2023-11-26T07:24:28.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.552+0000 7f951d867640 1 -- 172.21.15.77:0/1284071864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95180b3c30 con 0x7f951815edd0 2023-11-26T07:24:28.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.553+0000 7f95157fa640 1 -- 172.21.15.77:0/1284071864 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f9510014b40 con 0x7f951815edd0 2023-11-26T07:24:28.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.554+0000 7f95157fa640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f94fc06b8f0 0x7f94fc06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.554+0000 7f95157fa640 1 -- 172.21.15.77:0/1284071864 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9510088950 con 0x7f951815edd0 2023-11-26T07:24:28.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.554+0000 7f951c865640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f94fc06b8f0 0x7f94fc06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.554+0000 7f95157fa640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] conn(0x7f94fc071750 0x7f94fc073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.554+0000 7f95157fa640 1 -- 172.21.15.77:0/1284071864 --> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94fc074220 con 0x7f94fc071750 2023-11-26T07:24:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.554+0000 7f95157fa640 1 -- 172.21.15.77:0/1284071864 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f951008d5a0 con 0x7f951815edd0 2023-11-26T07:24:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.555+0000 7f9517fff640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] conn(0x7f94fc071750 0x7f94fc073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.555+0000 7f951c865640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f94fc06b8f0 0x7f94fc06ddb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f950c006fd0 tx=0x7f950c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:28.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.555+0000 7f9517fff640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] conn(0x7f94fc071750 0x7f94fc073b70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:28.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.557+0000 7f95157fa640 1 -- 172.21.15.77:0/1284071864 <== osd.5 v2:172.21.15.159:6800/3212169486 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f94fc074220 con 0x7f94fc071750 2023-11-26T07:24:28.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.571+0000 7f951d867640 1 -- 172.21.15.77:0/1284071864 --> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f951815fb70 con 0x7f94fc071750 2023-11-26T07:24:28.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.572+0000 7f95157fa640 1 -- 172.21.15.77:0/1284071864 <== osd.5 v2:172.21.15.159:6800/3212169486 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9504004500 con 0x7f94fc071750 2023-11-26T07:24:28.575 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:28.575 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:28.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.572+0000 7f951d867640 1 -- 172.21.15.77:0/1284071864 >> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] conn(0x7f94fc071750 msgr2=0x7f94fc073b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.572+0000 7f951d867640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.159:6800/3212169486,v1:172.21.15.159:6801/3212169486] conn(0x7f94fc071750 0x7f94fc073b70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.573+0000 7f951d867640 1 -- 172.21.15.77:0/1284071864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f94fc06b8f0 msgr2=0x7f94fc06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.573+0000 7f951d867640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f94fc06b8f0 0x7f94fc06ddb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f950c006fd0 tx=0x7f950c008040 comp rx=0 tx=0).stop 2023-11-26T07:24:28.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.573+0000 7f951d867640 1 -- 172.21.15.77:0/1284071864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f951815edd0 msgr2=0x7f951815df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.573+0000 7f951d867640 1 --2- 172.21.15.77:0/1284071864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f951815edd0 0x7f951815df10 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f9510007e40 tx=0x7f951000e4b0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.573+0000 7f951d066640 1 -- 172.21.15.77:0/1284071864 reap_dead start 2023-11-26T07:24:28.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.573+0000 7f951d867640 1 -- 172.21.15.77:0/1284071864 shutdown_connections 2023-11-26T07:24:28.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.573+0000 7f951d867640 1 -- 172.21.15.77:0/1284071864 >> 172.21.15.77:0/1284071864 conn(0x7f95180cb8a0 msgr2=0x7f951813ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:28.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.573+0000 7f951d867640 1 -- 172.21.15.77:0/1284071864 shutdown_connections 2023-11-26T07:24:28.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.573+0000 7f951d867640 1 -- 172.21.15.77:0/1284071864 wait complete. 2023-11-26T07:24:28.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-26T07:24:28.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.836+0000 7ffa62f33640 1 Processor -- start 2023-11-26T07:24:28.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.836+0000 7ffa62f33640 1 -- start start 2023-11-26T07:24:28.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.837+0000 7ffa62f33640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffa5c15c7f0 0x7ffa5c06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.837+0000 7ffa62f33640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0cf450 0x7ffa5c0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.837+0000 7ffa62f33640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c0cece0 con 0x7ffa5c0cdfb0 2023-11-26T07:24:28.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.837+0000 7ffa62f33640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c156010 con 0x7ffa5c15c7f0 2023-11-26T07:24:28.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.837+0000 7ffa62f33640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c06ce30 con 0x7ffa5c0cf450 2023-11-26T07:24:28.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.837+0000 7ffa614d0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ffa5c0cdfb0 0x7ffa5c0ce440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55438/0 (socket says 172.21.15.77:55438) 2023-11-26T07:24:28.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.837+0000 7ffa614d0640 1 -- 172.21.15.77:0/4056910165 learned_addr learned my addr 172.21.15.77:0/4056910165 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa60ccf640 1 --2- 172.21.15.77:0/4056910165 >> v2:172.21.15.159:3300/0 conn(0x7ffa5c15c7f0 0x7ffa5c06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630950155 0 0) 0x7ffa5c0cece0 con 0x7ffa5c0cdfb0 2023-11-26T07:24:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa53fff640 1 --2- 172.21.15.77:0/4056910165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0cf450 0x7ffa5c0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa44003520 con 0x7ffa5c0cdfb0 2023-11-26T07:24:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2545175687 0 0) 0x7ffa44003520 con 0x7ffa5c0cdfb0 2023-11-26T07:24:28.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0cf450 msgr2=0x7ffa5c0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 --2- 172.21.15.77:0/4056910165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0cf450 0x7ffa5c0cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 >> v2:172.21.15.159:3300/0 conn(0x7ffa5c15c7f0 msgr2=0x7ffa5c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 --2- 172.21.15.77:0/4056910165 >> v2:172.21.15.159:3300/0 conn(0x7ffa5c15c7f0 0x7ffa5c06db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c06d040 con 0x7ffa5c0cdfb0 2023-11-26T07:24:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7ffa54001670 con 0x7ffa5c0cdfb0 2023-11-26T07:24:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 >> v1:172.21.15.77:6789/0 conn(0x7ffa5c0cdfb0 legacy=0x7ffa5c0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 --2- 172.21.15.77:0/4056910165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa44003970 0x7ffa44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 --2- 172.21.15.77:0/4056910165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0cf450 0x7ffa440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 --2- 172.21.15.77:0/4056910165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa44004d00 0x7ffa44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c156010 con 0x7ffa44004d00 2023-11-26T07:24:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c06ce30 con 0x7ffa44003970 2023-11-26T07:24:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.838+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4400ba60 con 0x7ffa5c0cf450 2023-11-26T07:24:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.839+0000 7ffa614d0640 1 --2- 172.21.15.77:0/4056910165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa44004d00 0x7ffa44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.839+0000 7ffa614d0640 1 -- 172.21.15.77:0/4056910165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0cf450 msgr2=0x7ffa440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.839+0000 7ffa614d0640 1 --2- 172.21.15.77:0/4056910165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0cf450 0x7ffa440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.839+0000 7ffa614d0640 1 -- 172.21.15.77:0/4056910165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa44003970 msgr2=0x7ffa44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:28.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.839+0000 7ffa614d0640 1 --2- 172.21.15.77:0/4056910165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa44003970 0x7ffa44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.839+0000 7ffa614d0640 1 -- 172.21.15.77:0/4056910165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa44003520 con 0x7ffa44004d00 2023-11-26T07:24:28.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.840+0000 7ffa614d0640 1 --2- 172.21.15.77:0/4056910165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa44004d00 0x7ffa44005180 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c240 tx=0x7ffa440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de583a436b7776 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:28.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.840+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5402cae0 con 0x7ffa44004d00 2023-11-26T07:24:28.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.840+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5402cc40 con 0x7ffa44004d00 2023-11-26T07:24:28.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.840+0000 7ffa537fe640 1 -- 172.21.15.77:0/4056910165 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa540058d0 con 0x7ffa44004d00 2023-11-26T07:24:28.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.841+0000 7ffa62f33640 1 -- 172.21.15.77:0/4056910165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa44004d00 msgr2=0x7ffa44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.841+0000 7ffa62f33640 1 --2- 172.21.15.77:0/4056910165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa44004d00 0x7ffa44005180 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c240 tx=0x7ffa440057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.841+0000 7ffa614d0640 1 -- 172.21.15.77:0/4056910165 reap_dead start 2023-11-26T07:24:28.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.841+0000 7ffa62f33640 1 -- 172.21.15.77:0/4056910165 shutdown_connections 2023-11-26T07:24:28.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.841+0000 7ffa62f33640 1 -- 172.21.15.77:0/4056910165 >> 172.21.15.77:0/4056910165 conn(0x7ffa5c06a920 msgr2=0x7ffa5c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:28.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.841+0000 7ffa62f33640 1 -- 172.21.15.77:0/4056910165 shutdown_connections 2023-11-26T07:24:28.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.841+0000 7ffa62f33640 1 -- 172.21.15.77:0/4056910165 wait complete. 2023-11-26T07:24:28.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.843+0000 7ffa62f33640 1 Processor -- start 2023-11-26T07:24:28.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.843+0000 7ffa62f33640 1 -- start start 2023-11-26T07:24:28.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.844+0000 7ffa62f33640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa44004d00 0x7ffa5c149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.844+0000 7ffa62f33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c1571f0 0x7ffa5c0ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.844+0000 7ffa62f33640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0ad550 0x7ffa5c0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.844+0000 7ffa62f33640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0ad9d0 con 0x7ffa5c1571f0 2023-11-26T07:24:28.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.844+0000 7ffa62f33640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c156150 con 0x7ffa44004d00 2023-11-26T07:24:28.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.844+0000 7ffa62f33640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c156430 con 0x7ffa5c0ad550 2023-11-26T07:24:28.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.844+0000 7ffa53fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c1571f0 0x7ffa5c0ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.844+0000 7ffa53fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c1571f0 0x7ffa5c0ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53320/0 (socket says 172.21.15.77:53320) 2023-11-26T07:24:28.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.844+0000 7ffa53fff640 1 -- 172.21.15.77:0/940803768 learned_addr learned my addr 172.21.15.77:0/940803768 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:28.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.845+0000 7ffa60ccf640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa44004d00 0x7ffa5c149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.845+0000 7ffa53fff640 1 -- 172.21.15.77:0/940803768 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0ad550 msgr2=0x7ffa5c0b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.845+0000 7ffa614d0640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0ad550 0x7ffa5c0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.845+0000 7ffa53fff640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0ad550 0x7ffa5c0b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.845+0000 7ffa53fff640 1 -- 172.21.15.77:0/940803768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa44004d00 msgr2=0x7ffa5c149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:28.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.845+0000 7ffa53fff640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa44004d00 0x7ffa5c149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:28.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.845+0000 7ffa53fff640 1 -- 172.21.15.77:0/940803768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c156710 con 0x7ffa5c1571f0 2023-11-26T07:24:28.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.845+0000 7ffa60ccf640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa44004d00 0x7ffa5c149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:28.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.845+0000 7ffa53fff640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c1571f0 0x7ffa5c0ad010 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00d800 tx=0x7ffa4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:28.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.845+0000 7ffa517fa640 1 -- 172.21.15.77:0/940803768 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00b6c0 con 0x7ffa5c1571f0 2023-11-26T07:24:28.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.846+0000 7ffa517fa640 1 -- 172.21.15.77:0/940803768 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00b820 con 0x7ffa5c1571f0 2023-11-26T07:24:28.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.846+0000 7ffa517fa640 1 -- 172.21.15.77:0/940803768 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00bbb0 con 0x7ffa5c1571f0 2023-11-26T07:24:28.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.846+0000 7ffa62f33640 1 -- 172.21.15.77:0/940803768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c1569f0 con 0x7ffa5c1571f0 2023-11-26T07:24:28.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.846+0000 7ffa62f33640 1 -- 172.21.15.77:0/940803768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c149880 con 0x7ffa5c1571f0 2023-11-26T07:24:28.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.847+0000 7ffa62f33640 1 -- 172.21.15.77:0/940803768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c0cfd30 con 0x7ffa5c1571f0 2023-11-26T07:24:28.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.848+0000 7ffa517fa640 1 -- 172.21.15.77:0/940803768 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7ffa4c00bd10 con 0x7ffa5c1571f0 2023-11-26T07:24:28.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.849+0000 7ffa517fa640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffa4806b8f0 0x7ffa4806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:28.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.849+0000 7ffa517fa640 1 -- 172.21.15.77:0/940803768 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffa4c0883b0 con 0x7ffa5c1571f0 2023-11-26T07:24:28.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.849+0000 7ffa60ccf640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffa4806b8f0 0x7ffa4806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:28.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.850+0000 7ffa60ccf640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffa4806b8f0 0x7ffa4806ddb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ffa580070b0 tx=0x7ffa5800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:28.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:28.853+0000 7ffa517fa640 1 -- 172.21.15.77:0/940803768 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa4c054bf0 con 0x7ffa5c1571f0 2023-11-26T07:24:29.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.042+0000 7ffa62f33640 1 -- 172.21.15.77:0/940803768 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa5c06e060 con 0x7ffa4806b8f0 2023-11-26T07:24:29.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.043+0000 7ffa517fa640 1 -- 172.21.15.77:0/940803768 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffa58009b80 con 0x7ffa4806b8f0 2023-11-26T07:24:29.045 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 5 to deep-scrub 2023-11-26T07:24:29.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.045+0000 7ffa62f33640 1 -- 172.21.15.77:0/940803768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffa4806b8f0 msgr2=0x7ffa4806ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.045+0000 7ffa62f33640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffa4806b8f0 0x7ffa4806ddb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ffa580070b0 tx=0x7ffa5800b040 comp rx=0 tx=0).stop 2023-11-26T07:24:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.045+0000 7ffa62f33640 1 -- 172.21.15.77:0/940803768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c1571f0 msgr2=0x7ffa5c0ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.045+0000 7ffa62f33640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c1571f0 0x7ffa5c0ad010 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00d800 tx=0x7ffa4c00dcc0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.046+0000 7ffa62f33640 1 -- 172.21.15.77:0/940803768 shutdown_connections 2023-11-26T07:24:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.046+0000 7ffa62f33640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7ffa4806b8f0 0x7ffa4806ddb0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.046+0000 7ffa62f33640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0ad550 0x7ffa5c0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.046+0000 7ffa62f33640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c1571f0 0x7ffa5c0ad010 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.046+0000 7ffa62f33640 1 --2- 172.21.15.77:0/940803768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa44004d00 0x7ffa5c149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.046+0000 7ffa62f33640 1 -- 172.21.15.77:0/940803768 >> 172.21.15.77:0/940803768 conn(0x7ffa5c06a920 msgr2=0x7ffa5c06d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.046+0000 7ffa62f33640 1 -- 172.21.15.77:0/940803768 shutdown_connections 2023-11-26T07:24:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.046+0000 7ffa62f33640 1 -- 172.21.15.77:0/940803768 wait complete. 2023-11-26T07:24:29.066 INFO:tasks.ceph:Scrubbing osd.6 2023-11-26T07:24:29.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.266+0000 7fea875b0640 1 Processor -- start 2023-11-26T07:24:29.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.266+0000 7fea875b0640 1 -- start start 2023-11-26T07:24:29.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.268+0000 7fea875b0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea8015d9c0 0x7fea8006cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.268+0000 7fea875b0640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fea800b4b10 0x7fea80070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.268+0000 7fea875b0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea800d1170 con 0x7fea800705b0 2023-11-26T07:24:29.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.268+0000 7fea875b0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea80070a40 con 0x7fea8015d9c0 2023-11-26T07:24:29.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.268+0000 7fea875b0640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea800d1ea0 con 0x7fea800b4b10 2023-11-26T07:24:29.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.268+0000 7fea8534c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea8015d9c0 0x7fea8006cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.268+0000 7fea8534c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea8015d9c0 0x7fea8006cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53332/0 (socket says 172.21.15.77:53332) 2023-11-26T07:24:29.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.268+0000 7fea8534c640 1 -- 172.21.15.77:0/2646076588 learned_addr learned my addr 172.21.15.77:0/2646076588 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:29.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.269+0000 7fea84b4b640 1 --2- 172.21.15.77:0/2646076588 >> v2:172.21.15.159:3300/0 conn(0x7fea800b4b10 0x7fea80070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.269+0000 7fea8534c640 1 -- 172.21.15.77:0/2646076588 >> v2:172.21.15.159:3300/0 conn(0x7fea800b4b10 msgr2=0x7fea80070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.269+0000 7fea8534c640 1 --2- 172.21.15.77:0/2646076588 >> v2:172.21.15.159:3300/0 conn(0x7fea800b4b10 0x7fea80070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.269+0000 7fea8534c640 1 -- 172.21.15.77:0/2646076588 >> v1:172.21.15.77:6789/0 conn(0x7fea800705b0 legacy=0x7fea8006b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.269+0000 7fea8534c640 1 -- 172.21.15.77:0/2646076588 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8006d4a0 con 0x7fea8015d9c0 2023-11-26T07:24:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.270+0000 7fea8534c640 1 --2- 172.21.15.77:0/2646076588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea8015d9c0 0x7fea8006cec0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fea8006dc40 tx=0x7fea7c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1a67342273dcc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.270+0000 7fea77fff640 1 -- 172.21.15.77:0/2646076588 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c02f840 con 0x7fea8015d9c0 2023-11-26T07:24:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.270+0000 7fea77fff640 1 -- 172.21.15.77:0/2646076588 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c02f9a0 con 0x7fea8015d9c0 2023-11-26T07:24:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.270+0000 7fea77fff640 1 -- 172.21.15.77:0/2646076588 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c02fd30 con 0x7fea8015d9c0 2023-11-26T07:24:29.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.271+0000 7fea875b0640 1 -- 172.21.15.77:0/2646076588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea8015d9c0 msgr2=0x7fea8006cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.271+0000 7fea875b0640 1 --2- 172.21.15.77:0/2646076588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea8015d9c0 0x7fea8006cec0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fea8006dc40 tx=0x7fea7c02ba20 comp rx=0 tx=0).stop 2023-11-26T07:24:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.271+0000 7fea875b0640 1 -- 172.21.15.77:0/2646076588 shutdown_connections 2023-11-26T07:24:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.271+0000 7fea875b0640 1 --2- 172.21.15.77:0/2646076588 >> v2:172.21.15.159:3300/0 conn(0x7fea800b4b10 0x7fea80070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.271+0000 7fea875b0640 1 --2- 172.21.15.77:0/2646076588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea8015d9c0 0x7fea8006cec0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.271+0000 7fea875b0640 1 -- 172.21.15.77:0/2646076588 >> 172.21.15.77:0/2646076588 conn(0x7fea8006e8a0 msgr2=0x7fea8006ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.271+0000 7fea875b0640 1 -- 172.21.15.77:0/2646076588 shutdown_connections 2023-11-26T07:24:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.271+0000 7fea875b0640 1 -- 172.21.15.77:0/2646076588 wait complete. 2023-11-26T07:24:29.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.273+0000 7fea875b0640 1 Processor -- start 2023-11-26T07:24:29.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.273+0000 7fea875b0640 1 -- start start 2023-11-26T07:24:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.274+0000 7fea875b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800705b0 0x7fea800acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.274+0000 7fea875b0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea800b4b10 0x7fea801f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.274+0000 7fea875b0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea8015d9c0 0x7fea800a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.274+0000 7fea875b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea800a9650 con 0x7fea800705b0 2023-11-26T07:24:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.274+0000 7fea875b0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea801f3c30 con 0x7fea800b4b10 2023-11-26T07:24:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.274+0000 7fea875b0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea800a9380 con 0x7fea8015d9c0 2023-11-26T07:24:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.274+0000 7fea8534c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800705b0 0x7fea800acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.274+0000 7fea8534c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800705b0 0x7fea800acb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53334/0 (socket says 172.21.15.77:53334) 2023-11-26T07:24:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.274+0000 7fea8534c640 1 -- 172.21.15.77:0/536870231 learned_addr learned my addr 172.21.15.77:0/536870231 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.275+0000 7fea8534c640 1 -- 172.21.15.77:0/536870231 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea8015d9c0 msgr2=0x7fea800a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.275+0000 7fea8534c640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea8015d9c0 0x7fea800a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.275+0000 7fea8534c640 1 -- 172.21.15.77:0/536870231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea800b4b10 msgr2=0x7fea801f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.275+0000 7fea8534c640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea800b4b10 0x7fea801f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.275+0000 7fea8534c640 1 -- 172.21.15.77:0/536870231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c0094d0 con 0x7fea800705b0 2023-11-26T07:24:29.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.275+0000 7fea8534c640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800705b0 0x7fea800acb50 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fea7c000c00 tx=0x7fea7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:29.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.276+0000 7fea75ffb640 1 -- 172.21.15.77:0/536870231 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c037c40 con 0x7fea800705b0 2023-11-26T07:24:29.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.276+0000 7fea75ffb640 1 -- 172.21.15.77:0/536870231 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c037da0 con 0x7fea800705b0 2023-11-26T07:24:29.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.276+0000 7fea75ffb640 1 -- 172.21.15.77:0/536870231 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c041640 con 0x7fea800705b0 2023-11-26T07:24:29.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.276+0000 7fea875b0640 1 -- 172.21.15.77:0/536870231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea800a9b70 con 0x7fea800705b0 2023-11-26T07:24:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.276+0000 7fea875b0640 1 -- 172.21.15.77:0/536870231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea800aa130 con 0x7fea800705b0 2023-11-26T07:24:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.277+0000 7fea875b0640 1 -- 172.21.15.77:0/536870231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea800d1980 con 0x7fea800705b0 2023-11-26T07:24:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.278+0000 7fea75ffb640 1 -- 172.21.15.77:0/536870231 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fea7c0417a0 con 0x7fea800705b0 2023-11-26T07:24:29.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.279+0000 7fea75ffb640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fea6406b8f0 0x7fea6406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.279+0000 7fea75ffb640 1 -- 172.21.15.77:0/536870231 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fea7c03c070 con 0x7fea800705b0 2023-11-26T07:24:29.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.279+0000 7fea84b4b640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fea6406b8f0 0x7fea6406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.279+0000 7fea75ffb640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] conn(0x7fea64071750 0x7fea64073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.279+0000 7fea75ffb640 1 -- 172.21.15.77:0/536870231 --> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea64074220 con 0x7fea64071750 2023-11-26T07:24:29.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.279+0000 7fea75ffb640 1 -- 172.21.15.77:0/536870231 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea7c0af980 con 0x7fea800705b0 2023-11-26T07:24:29.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.280+0000 7fea84b4b640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fea6406b8f0 0x7fea6406ddb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fea800cd4c0 tx=0x7fea70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:29.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.280+0000 7fea85b4d640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] conn(0x7fea64071750 0x7fea64073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.281+0000 7fea85b4d640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] conn(0x7fea64071750 0x7fea64073b70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:29.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.283+0000 7fea75ffb640 1 -- 172.21.15.77:0/536870231 <== osd.6 v2:172.21.15.159:6808/4233966301 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fea64074220 con 0x7fea64071750 2023-11-26T07:24:29.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.297+0000 7fea875b0640 1 -- 172.21.15.77:0/536870231 --> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fea800d16a0 con 0x7fea64071750 2023-11-26T07:24:29.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.298+0000 7fea75ffb640 1 -- 172.21.15.77:0/536870231 <== osd.6 v2:172.21.15.159:6808/4233966301 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fea78001d80 con 0x7fea64071750 2023-11-26T07:24:29.300 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:29.300 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:29.301 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:29.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.298+0000 7fea875b0640 1 -- 172.21.15.77:0/536870231 >> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] conn(0x7fea64071750 msgr2=0x7fea64073b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.298+0000 7fea875b0640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.159:6808/4233966301,v1:172.21.15.159:6809/4233966301] conn(0x7fea64071750 0x7fea64073b70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.298+0000 7fea875b0640 1 -- 172.21.15.77:0/536870231 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fea6406b8f0 msgr2=0x7fea6406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.298+0000 7fea875b0640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fea6406b8f0 0x7fea6406ddb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fea800cd4c0 tx=0x7fea70008040 comp rx=0 tx=0).stop 2023-11-26T07:24:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.298+0000 7fea875b0640 1 -- 172.21.15.77:0/536870231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800705b0 msgr2=0x7fea800acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.298+0000 7fea875b0640 1 --2- 172.21.15.77:0/536870231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800705b0 0x7fea800acb50 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fea7c000c00 tx=0x7fea7c004730 comp rx=0 tx=0).stop 2023-11-26T07:24:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.298+0000 7fea85b4d640 1 -- 172.21.15.77:0/536870231 reap_dead start 2023-11-26T07:24:29.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.298+0000 7fea875b0640 1 -- 172.21.15.77:0/536870231 shutdown_connections 2023-11-26T07:24:29.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.298+0000 7fea875b0640 1 -- 172.21.15.77:0/536870231 >> 172.21.15.77:0/536870231 conn(0x7fea8006e8a0 msgr2=0x7fea800cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:29.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.299+0000 7fea875b0640 1 -- 172.21.15.77:0/536870231 shutdown_connections 2023-11-26T07:24:29.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.299+0000 7fea875b0640 1 -- 172.21.15.77:0/536870231 wait complete. 2023-11-26T07:24:29.316 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-26T07:24:29.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.507+0000 7f212b59e640 1 Processor -- start 2023-11-26T07:24:29.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.507+0000 7f212b59e640 1 -- start start 2023-11-26T07:24:29.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.508+0000 7f212b59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f212c15d5c0 0x7f212c0b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.508+0000 7f212b59e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212c0d1d80 con 0x7f212c0d1610 2023-11-26T07:24:29.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.508+0000 7f212b59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212c0d2060 con 0x7f212c0d08b0 2023-11-26T07:24:29.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.508+0000 7f212b59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c0d2340 con 0x7f212c15d5c0 2023-11-26T07:24:29.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.508+0000 7f2129d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f212c0d1610 0x7f212c0d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55466/0 (socket says 172.21.15.77:55466) 2023-11-26T07:24:29.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.508+0000 7f2129d9b640 1 -- 172.21.15.77:0/1095551524 learned_addr learned my addr 172.21.15.77:0/1095551524 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:29.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674684626 0 0) 0x7f212c0d1d80 con 0x7f212c0d1610 2023-11-26T07:24:29.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2114003520 con 0x7f212c0d1610 2023-11-26T07:24:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212a59c640 1 --2- 172.21.15.77:0/1095551524 >> v2:172.21.15.159:3300/0 conn(0x7f212c15d5c0 0x7f212c0b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 936781708 0 0) 0x7f2114003520 con 0x7f212c0d1610 2023-11-26T07:24:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 >> v2:172.21.15.159:3300/0 conn(0x7f212c15d5c0 msgr2=0x7f212c0b8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 --2- 172.21.15.77:0/1095551524 >> v2:172.21.15.159:3300/0 conn(0x7f212c15d5c0 0x7f212c0b8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 >> v1:172.21.15.159:6789/0 conn(0x7f212c0d08b0 legacy=0x7f212c0b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c0d2620 con 0x7f212c0d1610 2023-11-26T07:24:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f2120001670 con 0x7f212c0d1610 2023-11-26T07:24:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 >> v1:172.21.15.77:6789/0 conn(0x7f212c0d1610 legacy=0x7f212c0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21140039c0 0x7f2114003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21140047c0 0x7f2114004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 0x7f211400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.509+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0d2340 con 0x7f2114005250 2023-11-26T07:24:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.510+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211400c1a0 con 0x7f21140039c0 2023-11-26T07:24:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.510+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211400c360 con 0x7f21140047c0 2023-11-26T07:24:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.510+0000 7f212ad9d640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 0x7f211400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.510+0000 7f2129d9b640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21140047c0 0x7f2114004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.510+0000 7f212a59c640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21140039c0 0x7f2114003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.510+0000 7f212ad9d640 1 -- 172.21.15.77:0/1095551524 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21140047c0 msgr2=0x7f2114004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.510+0000 7f212ad9d640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21140047c0 0x7f2114004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.510+0000 7f212ad9d640 1 -- 172.21.15.77:0/1095551524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21140039c0 msgr2=0x7f2114003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.510+0000 7f212ad9d640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21140039c0 0x7f2114003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.510+0000 7f212ad9d640 1 -- 172.21.15.77:0/1095551524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114003520 con 0x7f2114005250 2023-11-26T07:24:29.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.510+0000 7f212a59c640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21140039c0 0x7f2114003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:29.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.511+0000 7f212ad9d640 1 -- 172.21.15.77:0/1095551524 reap_dead start 2023-11-26T07:24:29.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.511+0000 7f212ad9d640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 0x7f211400b980 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f21240044b0 tx=0x7f21140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7a7a61e60a4784 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:29.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.512+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124006d50 con 0x7f2114005250 2023-11-26T07:24:29.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.512+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2124007020 con 0x7f2114005250 2023-11-26T07:24:29.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.512+0000 7f212959a640 1 -- 172.21.15.77:0/1095551524 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21240073d0 con 0x7f2114005250 2023-11-26T07:24:29.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.512+0000 7f212b59e640 1 -- 172.21.15.77:0/1095551524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 msgr2=0x7f211400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.512+0000 7f212b59e640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 0x7f211400b980 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f21240044b0 tx=0x7f21140057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.512+0000 7f212b59e640 1 -- 172.21.15.77:0/1095551524 shutdown_connections 2023-11-26T07:24:29.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.512+0000 7f212b59e640 1 --2- 172.21.15.77:0/1095551524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 0x7f211400b980 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.512+0000 7f212b59e640 1 -- 172.21.15.77:0/1095551524 >> 172.21.15.77:0/1095551524 conn(0x7f212c061310 msgr2=0x7f212c061720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:29.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.512+0000 7f212b59e640 1 -- 172.21.15.77:0/1095551524 shutdown_connections 2023-11-26T07:24:29.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.512+0000 7f212b59e640 1 -- 172.21.15.77:0/1095551524 wait complete. 2023-11-26T07:24:29.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.514+0000 7f212b59e640 1 Processor -- start 2023-11-26T07:24:29.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.514+0000 7f212b59e640 1 -- start start 2023-11-26T07:24:29.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.515+0000 7f212b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 0x7f212c0c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.515+0000 7f212b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f212c15e320 0x7f212c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.515+0000 7f212b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f212c0cb360 0x7f212c0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.515+0000 7f212b59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0cce00 con 0x7f2114005250 2023-11-26T07:24:29.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.515+0000 7f212b59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c15ece0 con 0x7f212c15e320 2023-11-26T07:24:29.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.515+0000 7f212b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0c7780 con 0x7f212c0cb360 2023-11-26T07:24:29.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.516+0000 7f212a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 0x7f212c0c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.516+0000 7f212a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 0x7f212c0c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53360/0 (socket says 172.21.15.77:53360) 2023-11-26T07:24:29.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.516+0000 7f212a59c640 1 -- 172.21.15.77:0/3905493939 learned_addr learned my addr 172.21.15.77:0/3905493939 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:29.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.516+0000 7f212a59c640 1 -- 172.21.15.77:0/3905493939 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f212c0cb360 msgr2=0x7f212c0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.516+0000 7f212a59c640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f212c0cb360 0x7f212c0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.516+0000 7f212a59c640 1 -- 172.21.15.77:0/3905493939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f212c15e320 msgr2=0x7f212c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.516+0000 7f212a59c640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f212c15e320 0x7f212c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.516+0000 7f212a59c640 1 -- 172.21.15.77:0/3905493939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c0cbd20 con 0x7f2114005250 2023-11-26T07:24:29.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.516+0000 7f212a59c640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 0x7f212c0c7c10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f211c00e810 tx=0x7f211c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:29.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.517+0000 7f211affd640 1 -- 172.21.15.77:0/3905493939 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c00c6d0 con 0x7f2114005250 2023-11-26T07:24:29.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.517+0000 7f211affd640 1 -- 172.21.15.77:0/3905493939 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c00c830 con 0x7f2114005250 2023-11-26T07:24:29.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.517+0000 7f211affd640 1 -- 172.21.15.77:0/3905493939 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c00cba0 con 0x7f2114005250 2023-11-26T07:24:29.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.517+0000 7f212b59e640 1 -- 172.21.15.77:0/3905493939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c0c8150 con 0x7f2114005250 2023-11-26T07:24:29.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.517+0000 7f212b59e640 1 -- 172.21.15.77:0/3905493939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c0c7130 con 0x7f2114005250 2023-11-26T07:24:29.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.518+0000 7f212b59e640 1 -- 172.21.15.77:0/3905493939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c04e840 con 0x7f2114005250 2023-11-26T07:24:29.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.520+0000 7f211affd640 1 -- 172.21.15.77:0/3905493939 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f211c00cd00 con 0x7f2114005250 2023-11-26T07:24:29.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.521+0000 7f211affd640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f210c06b920 0x7f210c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.521+0000 7f211affd640 1 -- 172.21.15.77:0/3905493939 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f211c087cd0 con 0x7f2114005250 2023-11-26T07:24:29.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.521+0000 7f2129d9b640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f210c06b920 0x7f210c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.522+0000 7f2129d9b640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f210c06b920 0x7f210c06dde0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f21200017a0 tx=0x7f2120009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:29.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.525+0000 7f211affd640 1 -- 172.21.15.77:0/3905493939 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f211c054830 con 0x7f2114005250 2023-11-26T07:24:29.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.709+0000 7f212b59e640 1 -- 172.21.15.77:0/3905493939 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f212c0d1aa0 con 0x7f210c06b920 2023-11-26T07:24:29.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.710+0000 7f211affd640 1 -- 172.21.15.77:0/3905493939 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2120007e20 con 0x7f210c06b920 2023-11-26T07:24:29.712 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 6 to deep-scrub 2023-11-26T07:24:29.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 -- 172.21.15.77:0/3905493939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f210c06b920 msgr2=0x7f210c06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f210c06b920 0x7f210c06dde0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f21200017a0 tx=0x7f2120009040 comp rx=0 tx=0).stop 2023-11-26T07:24:29.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 -- 172.21.15.77:0/3905493939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 msgr2=0x7f212c0c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 0x7f212c0c7c10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f211c00e810 tx=0x7f211c00ecd0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 -- 172.21.15.77:0/3905493939 shutdown_connections 2023-11-26T07:24:29.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f210c06b920 0x7f210c06dde0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f212c0cb360 0x7f212c0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f212c15e320 0x7f212c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 --2- 172.21.15.77:0/3905493939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2114005250 0x7f212c0c7c10 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 -- 172.21.15.77:0/3905493939 >> 172.21.15.77:0/3905493939 conn(0x7f212c061310 msgr2=0x7f212c0b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:29.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 -- 172.21.15.77:0/3905493939 shutdown_connections 2023-11-26T07:24:29.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.712+0000 7f212b59e640 1 -- 172.21.15.77:0/3905493939 wait complete. 2023-11-26T07:24:29.732 INFO:tasks.ceph:Scrubbing osd.7 2023-11-26T07:24:29.732 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:29.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.933+0000 7f2a39ce0640 1 Processor -- start 2023-11-26T07:24:29.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.934+0000 7f2a39ce0640 1 -- start start 2023-11-26T07:24:29.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.935+0000 7f2a39ce0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3415d8d0 0x7f2a340d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.935+0000 7f2a39ce0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a340cdf30 con 0x7f2a340d0a50 2023-11-26T07:24:29.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.935+0000 7f2a39ce0640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a340d3b50 con 0x7f2a3415d4f0 2023-11-26T07:24:29.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.935+0000 7f2a39ce0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340d3e30 con 0x7f2a3415d8d0 2023-11-26T07:24:29.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.935+0000 7f2a2bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2a340d0a50 0x7f2a340d30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55482/0 (socket says 172.21.15.77:55482) 2023-11-26T07:24:29.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.935+0000 7f2a2bfff640 1 -- 172.21.15.77:0/2293142994 learned_addr learned my addr 172.21.15.77:0/2293142994 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:29.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090468451 0 0) 0x7f2a340cdf30 con 0x7f2a340d0a50 2023-11-26T07:24:29.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a20003520 con 0x7f2a340d0a50 2023-11-26T07:24:29.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a33fff640 1 --2- 172.21.15.77:0/2293142994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3415d8d0 0x7f2a340d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2830769593 0 0) 0x7f2a20003520 con 0x7f2a340d0a50 2023-11-26T07:24:29.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3415d8d0 msgr2=0x7f2a340d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:29.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 --2- 172.21.15.77:0/2293142994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3415d8d0 0x7f2a340d17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 >> v1:172.21.15.159:6789/0 conn(0x7f2a3415d4f0 legacy=0x7f2a340cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:29.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a340ce1d0 con 0x7f2a340d0a50 2023-11-26T07:24:29.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f2a1c001670 con 0x7f2a340d0a50 2023-11-26T07:24:29.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 >> v1:172.21.15.77:6789/0 conn(0x7f2a340d0a50 legacy=0x7f2a340d30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 --2- 172.21.15.77:0/2293142994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a200039a0 0x7f2a20003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 --2- 172.21.15.77:0/2293142994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a200047c0 0x7f2a20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 --2- 172.21.15.77:0/2293142994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3415d8d0 0x7f2a200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340d3e30 con 0x7f2a200039a0 2023-11-26T07:24:29.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2000bab0 con 0x7f2a200047c0 2023-11-26T07:24:29.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.936+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2000bc70 con 0x7f2a3415d8d0 2023-11-26T07:24:29.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.937+0000 7f2a337fe640 1 --2- 172.21.15.77:0/2293142994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a200039a0 0x7f2a20003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.937+0000 7f2a337fe640 1 -- 172.21.15.77:0/2293142994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3415d8d0 msgr2=0x7f2a200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:29.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.937+0000 7f2a337fe640 1 --2- 172.21.15.77:0/2293142994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3415d8d0 0x7f2a200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.937+0000 7f2a337fe640 1 -- 172.21.15.77:0/2293142994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a200047c0 msgr2=0x7f2a20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:29.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.937+0000 7f2a337fe640 1 --2- 172.21.15.77:0/2293142994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a200047c0 0x7f2a20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.937+0000 7f2a337fe640 1 -- 172.21.15.77:0/2293142994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20003520 con 0x7f2a200039a0 2023-11-26T07:24:29.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.938+0000 7f2a337fe640 1 --2- 172.21.15.77:0/2293142994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a200039a0 0x7f2a20003dc0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2a24001750 tx=0x7f2a200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ac262a434d936e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:29.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.938+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a240052d0 con 0x7f2a200039a0 2023-11-26T07:24:29.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.938+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2402e050 con 0x7f2a200039a0 2023-11-26T07:24:29.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.938+0000 7f2a32ffd640 1 -- 172.21.15.77:0/2293142994 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a240035f0 con 0x7f2a200039a0 2023-11-26T07:24:29.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.939+0000 7f2a39ce0640 1 -- 172.21.15.77:0/2293142994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a200039a0 msgr2=0x7f2a20003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.939+0000 7f2a39ce0640 1 --2- 172.21.15.77:0/2293142994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a200039a0 0x7f2a20003dc0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2a24001750 tx=0x7f2a200057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.939+0000 7f2a33fff640 1 -- 172.21.15.77:0/2293142994 reap_dead start 2023-11-26T07:24:29.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.939+0000 7f2a39ce0640 1 -- 172.21.15.77:0/2293142994 shutdown_connections 2023-11-26T07:24:29.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.939+0000 7f2a39ce0640 1 -- 172.21.15.77:0/2293142994 >> 172.21.15.77:0/2293142994 conn(0x7f2a34061950 msgr2=0x7f2a3408af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:29.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.939+0000 7f2a39ce0640 1 -- 172.21.15.77:0/2293142994 shutdown_connections 2023-11-26T07:24:29.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.939+0000 7f2a39ce0640 1 -- 172.21.15.77:0/2293142994 wait complete. 2023-11-26T07:24:29.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.941+0000 7f2a39ce0640 1 Processor -- start 2023-11-26T07:24:29.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.941+0000 7f2a39ce0640 1 -- start start 2023-11-26T07:24:29.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a39ce0640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a200039a0 0x7f2a340c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a39ce0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a341f6d60 0x7f2a341f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a39ce0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a341f7720 0x7f2a3414c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a39ce0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340cf3c0 con 0x7f2a341f6d60 2023-11-26T07:24:29.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a39ce0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340c9a30 con 0x7f2a341f7720 2023-11-26T07:24:29.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a39ce0640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340c9c20 con 0x7f2a200039a0 2023-11-26T07:24:29.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a2bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a341f6d60 0x7f2a341f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a2bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a341f6d60 0x7f2a341f71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53376/0 (socket says 172.21.15.77:53376) 2023-11-26T07:24:29.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a2bfff640 1 -- 172.21.15.77:0/616373377 learned_addr learned my addr 172.21.15.77:0/616373377 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:29.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a2bfff640 1 -- 172.21.15.77:0/616373377 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a200039a0 msgr2=0x7f2a340c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a2bfff640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a200039a0 0x7f2a340c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a2bfff640 1 -- 172.21.15.77:0/616373377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a341f7720 msgr2=0x7f2a3414c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a2bfff640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a341f7720 0x7f2a3414c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.942+0000 7f2a2bfff640 1 -- 172.21.15.77:0/616373377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3415eb70 con 0x7f2a341f6d60 2023-11-26T07:24:29.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.943+0000 7f2a2bfff640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a341f6d60 0x7f2a341f71e0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00c840 tx=0x7f2a1c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:29.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.943+0000 7f2a30ff9640 1 -- 172.21.15.77:0/616373377 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0074e0 con 0x7f2a341f6d60 2023-11-26T07:24:29.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.943+0000 7f2a30ff9640 1 -- 172.21.15.77:0/616373377 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c007640 con 0x7f2a341f6d60 2023-11-26T07:24:29.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.943+0000 7f2a39ce0640 1 -- 172.21.15.77:0/616373377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3415ee50 con 0x7f2a341f6d60 2023-11-26T07:24:29.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.943+0000 7f2a30ff9640 1 -- 172.21.15.77:0/616373377 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c004a20 con 0x7f2a341f6d60 2023-11-26T07:24:29.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.943+0000 7f2a39ce0640 1 -- 172.21.15.77:0/616373377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3415f410 con 0x7f2a341f6d60 2023-11-26T07:24:29.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.944+0000 7f2a39ce0640 1 -- 172.21.15.77:0/616373377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a340d3800 con 0x7f2a341f6d60 2023-11-26T07:24:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.945+0000 7f2a30ff9640 1 -- 172.21.15.77:0/616373377 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f2a1c004b80 con 0x7f2a341f6d60 2023-11-26T07:24:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.946+0000 7f2a30ff9640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2a1406b8f0 0x7f2a1406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.946+0000 7f2a30ff9640 1 -- 172.21.15.77:0/616373377 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2a1c0875e0 con 0x7f2a341f6d60 2023-11-26T07:24:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.946+0000 7f2a337fe640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2a1406b8f0 0x7f2a1406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.946+0000 7f2a30ff9640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] conn(0x7f2a14071750 0x7f2a14073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:29.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.946+0000 7f2a30ff9640 1 -- 172.21.15.77:0/616373377 --> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a14074220 con 0x7f2a14071750 2023-11-26T07:24:29.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.946+0000 7f2a30ff9640 1 -- 172.21.15.77:0/616373377 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a1c08f2a0 con 0x7f2a341f6d60 2023-11-26T07:24:29.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.947+0000 7f2a337fe640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2a1406b8f0 0x7f2a1406ddb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2a24033000 tx=0x7f2a2402f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:29.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.947+0000 7f2a33fff640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] conn(0x7f2a14071750 0x7f2a14073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:29.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.948+0000 7f2a33fff640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] conn(0x7f2a14071750 0x7f2a14073b70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:29.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.950+0000 7f2a30ff9640 1 -- 172.21.15.77:0/616373377 <== osd.7 v2:172.21.15.159:6817/162809389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2a14074220 con 0x7f2a14071750 2023-11-26T07:24:29.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.964+0000 7f2a39ce0640 1 -- 172.21.15.77:0/616373377 --> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2a340ce790 con 0x7f2a14071750 2023-11-26T07:24:29.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.965+0000 7f2a30ff9640 1 -- 172.21.15.77:0/616373377 <== osd.7 v2:172.21.15.159:6817/162809389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2a2c00f040 con 0x7f2a14071750 2023-11-26T07:24:29.967 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-26T07:24:29.967 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:29.968 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-26T07:24:29.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.965+0000 7f2a39ce0640 1 -- 172.21.15.77:0/616373377 >> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] conn(0x7f2a14071750 msgr2=0x7f2a14073b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.965+0000 7f2a39ce0640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.159:6817/162809389,v1:172.21.15.159:6820/162809389] conn(0x7f2a14071750 0x7f2a14073b70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:29.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.965+0000 7f2a39ce0640 1 -- 172.21.15.77:0/616373377 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2a1406b8f0 msgr2=0x7f2a1406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.965+0000 7f2a39ce0640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f2a1406b8f0 0x7f2a1406ddb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2a24033000 tx=0x7f2a2402f000 comp rx=0 tx=0).stop 2023-11-26T07:24:29.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.965+0000 7f2a39ce0640 1 -- 172.21.15.77:0/616373377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a341f6d60 msgr2=0x7f2a341f71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:29.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.965+0000 7f2a39ce0640 1 --2- 172.21.15.77:0/616373377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a341f6d60 0x7f2a341f71e0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00c840 tx=0x7f2a1c00cd00 comp rx=0 tx=0).stop 2023-11-26T07:24:29.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.965+0000 7f2a33fff640 1 -- 172.21.15.77:0/616373377 reap_dead start 2023-11-26T07:24:29.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.966+0000 7f2a39ce0640 1 -- 172.21.15.77:0/616373377 shutdown_connections 2023-11-26T07:24:29.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.966+0000 7f2a39ce0640 1 -- 172.21.15.77:0/616373377 >> 172.21.15.77:0/616373377 conn(0x7f2a34061950 msgr2=0x7f2a340b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:29.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.966+0000 7f2a39ce0640 1 -- 172.21.15.77:0/616373377 shutdown_connections 2023-11-26T07:24:29.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:29.966+0000 7f2a39ce0640 1 -- 172.21.15.77:0/616373377 wait complete. 2023-11-26T07:24:29.984 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-26T07:24:30.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.182+0000 7f55a5989640 1 Processor -- start 2023-11-26T07:24:30.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.182+0000 7f55a5989640 1 -- start start 2023-11-26T07:24:30.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.183+0000 7f55a5989640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a015c7f0 0x7f55a006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.183+0000 7f55a5989640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f55a00cf450 0x7f55a00cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.183+0000 7f55a5989640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a00cece0 con 0x7f55a00cdfb0 2023-11-26T07:24:30.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.183+0000 7f55a5989640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a0156010 con 0x7f55a00cf450 2023-11-26T07:24:30.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.183+0000 7f55a5989640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a006ce30 con 0x7f55a015c7f0 2023-11-26T07:24:30.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.184+0000 7f559effd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a015c7f0 0x7f55a006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.184+0000 7f559effd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a015c7f0 0x7f55a006db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.77:57722/0 (socket says 172.21.15.77:57722) 2023-11-26T07:24:30.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.184+0000 7f559effd640 1 -- 172.21.15.77:0/976500619 learned_addr learned my addr 172.21.15.77:0/976500619 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:30.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.184+0000 7f559e7fc640 1 --2- 172.21.15.77:0/976500619 >> v2:172.21.15.159:3300/0 conn(0x7f55a00cf450 0x7f55a00cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.185+0000 7f559effd640 1 -- 172.21.15.77:0/976500619 >> v2:172.21.15.159:3300/0 conn(0x7f55a00cf450 msgr2=0x7f55a00cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:30.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.185+0000 7f559effd640 1 --2- 172.21.15.77:0/976500619 >> v2:172.21.15.159:3300/0 conn(0x7f55a00cf450 0x7f55a00cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.185+0000 7f559effd640 1 -- 172.21.15.77:0/976500619 >> v1:172.21.15.159:6789/0 conn(0x7f55a00cdfb0 legacy=0x7f55a00ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.185+0000 7f559effd640 1 -- 172.21.15.77:0/976500619 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a006d040 con 0x7f55a015c7f0 2023-11-26T07:24:30.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.186+0000 7f559effd640 1 --2- 172.21.15.77:0/976500619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a015c7f0 0x7f55a006db20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5590009e50 tx=0x7f559002bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49208cf94b8d7c95 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:30.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.187+0000 7f559dffb640 1 -- 172.21.15.77:0/976500619 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559002caf0 con 0x7f55a015c7f0 2023-11-26T07:24:30.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.187+0000 7f559dffb640 1 -- 172.21.15.77:0/976500619 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559002cc50 con 0x7f55a015c7f0 2023-11-26T07:24:30.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.187+0000 7f559dffb640 1 -- 172.21.15.77:0/976500619 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55900343f0 con 0x7f55a015c7f0 2023-11-26T07:24:30.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.187+0000 7f55a5989640 1 -- 172.21.15.77:0/976500619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a015c7f0 msgr2=0x7f55a006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.187+0000 7f55a5989640 1 --2- 172.21.15.77:0/976500619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a015c7f0 0x7f55a006db20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5590009e50 tx=0x7f559002bf50 comp rx=0 tx=0).stop 2023-11-26T07:24:30.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.188+0000 7f55a5989640 1 -- 172.21.15.77:0/976500619 shutdown_connections 2023-11-26T07:24:30.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.188+0000 7f55a5989640 1 --2- 172.21.15.77:0/976500619 >> v2:172.21.15.159:3300/0 conn(0x7f55a00cf450 0x7f55a00cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.188+0000 7f55a5989640 1 --2- 172.21.15.77:0/976500619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a015c7f0 0x7f55a006db20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.188+0000 7f55a5989640 1 -- 172.21.15.77:0/976500619 >> 172.21.15.77:0/976500619 conn(0x7f55a006a920 msgr2=0x7f55a006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:30.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.188+0000 7f55a5989640 1 -- 172.21.15.77:0/976500619 shutdown_connections 2023-11-26T07:24:30.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.188+0000 7f55a5989640 1 -- 172.21.15.77:0/976500619 wait complete. 2023-11-26T07:24:30.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.190+0000 7f55a5989640 1 Processor -- start 2023-11-26T07:24:30.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.190+0000 7f55a5989640 1 -- start start 2023-11-26T07:24:30.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.191+0000 7f55a5989640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a00cdfb0 0x7f55a0154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.191+0000 7f55a5989640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a00cf450 0x7f55a00aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.191+0000 7f55a5989640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55a015c7f0 0x7f55a00af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.191+0000 7f55a5989640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0155050 con 0x7f55a015c7f0 2023-11-26T07:24:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.191+0000 7f55a5989640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0154a60 con 0x7f55a00cf450 2023-11-26T07:24:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.191+0000 7f55a5989640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0157660 con 0x7f55a00cdfb0 2023-11-26T07:24:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.192+0000 7f559f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55a015c7f0 0x7f55a00af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.192+0000 7f559f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55a015c7f0 0x7f55a00af190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53380/0 (socket says 172.21.15.77:53380) 2023-11-26T07:24:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.192+0000 7f559f7fe640 1 -- 172.21.15.77:0/2764007232 learned_addr learned my addr 172.21.15.77:0/2764007232 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.192+0000 7f559effd640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a00cdfb0 0x7f55a0154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.192+0000 7f559e7fc640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a00cf450 0x7f55a00aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.192+0000 7f559f7fe640 1 -- 172.21.15.77:0/2764007232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a00cdfb0 msgr2=0x7f55a0154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.192+0000 7f559f7fe640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a00cdfb0 0x7f55a0154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.192+0000 7f559f7fe640 1 -- 172.21.15.77:0/2764007232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a00cf450 msgr2=0x7f55a00aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.192+0000 7f559f7fe640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a00cf450 0x7f55a00aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.192+0000 7f559f7fe640 1 -- 172.21.15.77:0/2764007232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5590009b30 con 0x7f55a015c7f0 2023-11-26T07:24:30.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.193+0000 7f559f7fe640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55a015c7f0 0x7f55a00af190 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f559800c3c0 tx=0x7f559800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:30.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.193+0000 7f5597fff640 1 -- 172.21.15.77:0/2764007232 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55980052d0 con 0x7f55a015c7f0 2023-11-26T07:24:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.193+0000 7f5597fff640 1 -- 172.21.15.77:0/2764007232 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5598005430 con 0x7f55a015c7f0 2023-11-26T07:24:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.193+0000 7f55a5989640 1 -- 172.21.15.77:0/2764007232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a0157940 con 0x7f55a015c7f0 2023-11-26T07:24:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.193+0000 7f5597fff640 1 -- 172.21.15.77:0/2764007232 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598003830 con 0x7f55a015c7f0 2023-11-26T07:24:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.193+0000 7f55a5989640 1 -- 172.21.15.77:0/2764007232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a0157f00 con 0x7f55a015c7f0 2023-11-26T07:24:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.194+0000 7f55a5989640 1 -- 172.21.15.77:0/2764007232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a0067470 con 0x7f55a015c7f0 2023-11-26T07:24:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.196+0000 7f5597fff640 1 -- 172.21.15.77:0/2764007232 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f5598003990 con 0x7f55a015c7f0 2023-11-26T07:24:30.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.197+0000 7f5597fff640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f558006b8f0 0x7f558006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.197+0000 7f5597fff640 1 -- 172.21.15.77:0/2764007232 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5598087670 con 0x7f55a015c7f0 2023-11-26T07:24:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.197+0000 7f559effd640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f558006b8f0 0x7f558006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.198+0000 7f559effd640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f558006b8f0 0x7f558006ddb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5590035000 tx=0x7f5590030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.201+0000 7f5597fff640 1 -- 172.21.15.77:0/2764007232 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5598053f40 con 0x7f55a015c7f0 2023-11-26T07:24:30.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.377+0000 7f55a5989640 1 -- 172.21.15.77:0/2764007232 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f55a006e060 con 0x7f558006b8f0 2023-11-26T07:24:30.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.378+0000 7f5597fff640 1 -- 172.21.15.77:0/2764007232 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f559003e400 con 0x7f558006b8f0 2023-11-26T07:24:30.381 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 7 to deep-scrub 2023-11-26T07:24:30.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 -- 172.21.15.77:0/2764007232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f558006b8f0 msgr2=0x7f558006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f558006b8f0 0x7f558006ddb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5590035000 tx=0x7f5590030000 comp rx=0 tx=0).stop 2023-11-26T07:24:30.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 -- 172.21.15.77:0/2764007232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55a015c7f0 msgr2=0x7f55a00af190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55a015c7f0 0x7f55a00af190 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f559800c3c0 tx=0x7f559800c880 comp rx=0 tx=0).stop 2023-11-26T07:24:30.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 -- 172.21.15.77:0/2764007232 shutdown_connections 2023-11-26T07:24:30.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f558006b8f0 0x7f558006ddb0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55a015c7f0 0x7f55a00af190 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a00cf450 0x7f55a00aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 --2- 172.21.15.77:0/2764007232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55a00cdfb0 0x7f55a0154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 -- 172.21.15.77:0/2764007232 >> 172.21.15.77:0/2764007232 conn(0x7f55a006a920 msgr2=0x7f55a00ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:30.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 -- 172.21.15.77:0/2764007232 shutdown_connections 2023-11-26T07:24:30.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.381+0000 7f55a5989640 1 -- 172.21.15.77:0/2764007232 wait complete. 2023-11-26T07:24:30.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:24:30.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.597+0000 7fad25809640 1 Processor -- start 2023-11-26T07:24:30.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.598+0000 7fad25809640 1 -- start start 2023-11-26T07:24:30.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.599+0000 7fad25809640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad200cfb30 0x7fad200cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.599+0000 7fad25809640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad200b2690 con 0x7fad2006aa30 2023-11-26T07:24:30.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.599+0000 7fad25809640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2006ed00 con 0x7fad200b28d0 2023-11-26T07:24:30.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.599+0000 7fad25809640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad200cc7f0 con 0x7fad200cfb30 2023-11-26T07:24:30.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.599+0000 7fad1effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fad2006aa30 0x7fad200cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55496/0 (socket says 172.21.15.77:55496) 2023-11-26T07:24:30.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.599+0000 7fad1effd640 1 -- 172.21.15.77:0/3911375065 learned_addr learned my addr 172.21.15.77:0/3911375065 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:30.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1f7fe640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad200cfb30 0x7fad200cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150009655 0 0) 0x7fad200b2690 con 0x7fad2006aa30 2023-11-26T07:24:30.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad0c003520 con 0x7fad2006aa30 2023-11-26T07:24:30.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2844623917 0 0) 0x7fad0c003520 con 0x7fad2006aa30 2023-11-26T07:24:30.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad200cfb30 msgr2=0x7fad200cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:30.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad200cfb30 0x7fad200cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 >> v1:172.21.15.159:6789/0 conn(0x7fad200b28d0 legacy=0x7fad200cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2006efe0 con 0x7fad2006aa30 2023-11-26T07:24:30.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fad100019f0 con 0x7fad2006aa30 2023-11-26T07:24:30.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 >> v1:172.21.15.77:6789/0 conn(0x7fad2006aa30 legacy=0x7fad200cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c0039a0 0x7fad0c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad0c0047c0 0x7fad0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad200cfb30 0x7fad0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad200cc7f0 con 0x7fad0c0039a0 2023-11-26T07:24:30.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c00bb40 con 0x7fad0c0047c0 2023-11-26T07:24:30.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c00bd00 con 0x7fad200cfb30 2023-11-26T07:24:30.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.600+0000 7fad1effd640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c0039a0 0x7fad0c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.601+0000 7fad1f7fe640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad200cfb30 0x7fad0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.601+0000 7fad1effd640 1 -- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad200cfb30 msgr2=0x7fad0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:30.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.601+0000 7fad1e7fc640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad0c0047c0 0x7fad0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.601+0000 7fad1effd640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad200cfb30 0x7fad0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.601+0000 7fad1effd640 1 -- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad0c0047c0 msgr2=0x7fad0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:30.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.601+0000 7fad1effd640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad0c0047c0 0x7fad0c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.601+0000 7fad1effd640 1 -- 172.21.15.77:0/3911375065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c003520 con 0x7fad0c0039a0 2023-11-26T07:24:30.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.601+0000 7fad1f7fe640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad200cfb30 0x7fad0c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:30.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.602+0000 7fad1effd640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c0039a0 0x7fad0c003dc0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fad1000a830 tx=0x7fad0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b835064ce1900366 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:30.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.602+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100072d0 con 0x7fad0c0039a0 2023-11-26T07:24:30.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.602+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1002f070 con 0x7fad0c0039a0 2023-11-26T07:24:30.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.602+0000 7fad1dffb640 1 -- 172.21.15.77:0/3911375065 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100076b0 con 0x7fad0c0039a0 2023-11-26T07:24:30.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.603+0000 7fad25809640 1 -- 172.21.15.77:0/3911375065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c0039a0 msgr2=0x7fad0c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.603+0000 7fad25809640 1 --2- 172.21.15.77:0/3911375065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c0039a0 0x7fad0c003dc0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fad1000a830 tx=0x7fad0c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.603+0000 7fad1f7fe640 1 -- 172.21.15.77:0/3911375065 reap_dead start 2023-11-26T07:24:30.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.603+0000 7fad25809640 1 -- 172.21.15.77:0/3911375065 shutdown_connections 2023-11-26T07:24:30.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.603+0000 7fad25809640 1 -- 172.21.15.77:0/3911375065 >> 172.21.15.77:0/3911375065 conn(0x7fad200999d0 msgr2=0x7fad200b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:30.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.603+0000 7fad25809640 1 -- 172.21.15.77:0/3911375065 shutdown_connections 2023-11-26T07:24:30.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.603+0000 7fad25809640 1 -- 172.21.15.77:0/3911375065 wait complete. 2023-11-26T07:24:30.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.604+0000 7fad25809640 1 Processor -- start 2023-11-26T07:24:30.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.605+0000 7fad25809640 1 -- start start 2023-11-26T07:24:30.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.605+0000 7fad25809640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad0c0039a0 0x7fad201551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.605+0000 7fad25809640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad20158080 0x7fad200ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad25809640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad20158500 0x7fad200ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad25809640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad201f2d20 con 0x7fad20158500 2023-11-26T07:24:30.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad25809640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad20155c30 con 0x7fad20158080 2023-11-26T07:24:30.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad25809640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad20155f10 con 0x7fad0c0039a0 2023-11-26T07:24:30.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad1f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad20158500 0x7fad200ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad1f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad20158500 0x7fad200ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53390/0 (socket says 172.21.15.77:53390) 2023-11-26T07:24:30.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad1f7fe640 1 -- 172.21.15.77:0/4087274463 learned_addr learned my addr 172.21.15.77:0/4087274463 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:30.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad1effd640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad0c0039a0 0x7fad201551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad1e7fc640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad20158080 0x7fad200ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad1f7fe640 1 -- 172.21.15.77:0/4087274463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad0c0039a0 msgr2=0x7fad201551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad1f7fe640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad0c0039a0 0x7fad201551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad1f7fe640 1 -- 172.21.15.77:0/4087274463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad20158080 msgr2=0x7fad200ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad1f7fe640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad20158080 0x7fad200ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad1f7fe640 1 -- 172.21.15.77:0/4087274463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad201561f0 con 0x7fad20158500 2023-11-26T07:24:30.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.606+0000 7fad1effd640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad0c0039a0 0x7fad201551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:30.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.607+0000 7fad1f7fe640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad20158500 0x7fad200ae790 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fad200cff40 tx=0x7fad1800e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:30.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.607+0000 7fad17fff640 1 -- 172.21.15.77:0/4087274463 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800c070 con 0x7fad20158500 2023-11-26T07:24:30.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.607+0000 7fad17fff640 1 -- 172.21.15.77:0/4087274463 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad18013630 con 0x7fad20158500 2023-11-26T07:24:30.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.607+0000 7fad17fff640 1 -- 172.21.15.77:0/4087274463 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad180139e0 con 0x7fad20158500 2023-11-26T07:24:30.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.607+0000 7fad25809640 1 -- 172.21.15.77:0/4087274463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad201564d0 con 0x7fad20158500 2023-11-26T07:24:30.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.607+0000 7fad25809640 1 -- 172.21.15.77:0/4087274463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad201557c0 con 0x7fad20158500 2023-11-26T07:24:30.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.608+0000 7fad25809640 1 -- 172.21.15.77:0/4087274463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad201569f0 con 0x7fad20158500 2023-11-26T07:24:30.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.609+0000 7fad17fff640 1 -- 172.21.15.77:0/4087274463 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fad18013b40 con 0x7fad20158500 2023-11-26T07:24:30.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.610+0000 7fad17fff640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0006b8f0 0x7fad0006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:30.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.610+0000 7fad17fff640 1 -- 172.21.15.77:0/4087274463 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fad18087790 con 0x7fad20158500 2023-11-26T07:24:30.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.610+0000 7fad1effd640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0006b8f0 0x7fad0006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:30.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.610+0000 7fad1effd640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0006b8f0 0x7fad0006ddb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fad10034000 tx=0x7fad10007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:30.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.614+0000 7fad17fff640 1 -- 172.21.15.77:0/4087274463 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad201569f0 con 0x7fad20158500 2023-11-26T07:24:30.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.789+0000 7fad25809640 1 -- 172.21.15.77:0/4087274463 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad2006f5a0 con 0x7fad0006b8f0 2023-11-26T07:24:30.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.792+0000 7fad17fff640 1 -- 172.21.15.77:0/4087274463 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48498 (secure 0 0 0) 0x7fad10001930 con 0x7fad0006b8f0 2023-11-26T07:24:30.794 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:30.795 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:24:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.794+0000 7fad25809640 1 -- 172.21.15.77:0/4087274463 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0006b8f0 msgr2=0x7fad0006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.794+0000 7fad25809640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0006b8f0 0x7fad0006ddb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fad10034000 tx=0x7fad10007000 comp rx=0 tx=0).stop 2023-11-26T07:24:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.794+0000 7fad25809640 1 -- 172.21.15.77:0/4087274463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad20158500 msgr2=0x7fad200ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.794+0000 7fad25809640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad20158500 0x7fad200ae790 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fad200cff40 tx=0x7fad1800e8b0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.795+0000 7fad25809640 1 -- 172.21.15.77:0/4087274463 shutdown_connections 2023-11-26T07:24:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.795+0000 7fad25809640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fad0006b8f0 0x7fad0006ddb0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.795+0000 7fad25809640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad20158500 0x7fad200ae790 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.795+0000 7fad25809640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad20158080 0x7fad200ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.795+0000 7fad25809640 1 --2- 172.21.15.77:0/4087274463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad0c0039a0 0x7fad201551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:30.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.795+0000 7fad25809640 1 -- 172.21.15.77:0/4087274463 >> 172.21.15.77:0/4087274463 conn(0x7fad200999d0 msgr2=0x7fad200afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:30.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.795+0000 7fad25809640 1 -- 172.21.15.77:0/4087274463 shutdown_connections 2023-11-26T07:24:30.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:30.795+0000 7fad25809640 1 -- 172.21.15.77:0/4087274463 wait complete. 2023-11-26T07:24:30.816 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2023-11-26T07:24:29.738995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":266616,"kb_used_data":8840,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754708104,"statfs":{"total":773094113280,"available":772821098496,"internally_reserved":0,"allocated":9052160,"data_stored":4545544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.663764"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":221,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-26T07:24:17.418825+0000","last_change":"2023-11-26T07:17:25.282588+0000","last_active":"2023-11-26T07:24:17.418825+0000","last_peered":"2023-11-26T07:24:17.418825+0000","last_clean":"2023-11-26T07:24:17.418825+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:24:17.418825+0000","last_undegraded":"2023-11-26T07:24:17.418825+0000","last_fullsized":"2023-11-26T07:24:17.418825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:23.903458+0000","last_clean_scrub_stamp":"2023-11-26T07:17:23.903458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:09.962982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":1010969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0629999999999999,"15min":1.038},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6739999999999999,"5min":1.768,"15min":1.768},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.103,"15min":1.079},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.514,"5min":2.298,"15min":2.298},"last":0.76000000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.085,"15min":1.0589999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.171,"15min":1.2090000000000001},"min":{"1min":0.76400000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.9650000000000001},"last":0.83799999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.2190000000000001,"15min":1.175},"min":{"1min":0.81100000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6100000000000001,"5min":1.9239999999999999,"15min":2.0760000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.173,"15min":1.262},"min":{"1min":0.81899999999999995,"5min":0.73599999999999999,"15min":0.70399999999999996},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.5339999999999998},"last":0.89500000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.177,"15min":1.2230000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6359999999999999,"5min":1.694,"15min":1.9299999999999999},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3400000000000001,"15min":1.3580000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":2.2389999999999999},"last":1.0609999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.3140000000000001,"15min":1.347},"min":{"1min":0.63,"5min":0.63,"15min":0.60599999999999998},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.774},"last":0.998},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4279999999999999,"15min":1.4530000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.57399999999999995},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.3780000000000001},"last":1.141}]},{"osd":5,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.448,"15min":1.4870000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.65900000000000003},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.8330000000000002},"last":1.095},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3640000000000001,"15min":1.446},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.54600000000000004},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":2.149},"last":1.4810000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.5720000000000001,"15min":1.6539999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.75},"max":{"1min":2.258,"5min":2.258,"15min":2.7280000000000002},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5509999999999999,"15min":1.619},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.56299999999999994},"max":{"1min":2.008,"5min":2.1349999999999998,"15min":2.4590000000000001},"last":1.573}]}]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.103,"15min":1.117},"min":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":3.2029999999999998},"last":1.107},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.101,"15min":1.2330000000000001},"min":{"1min":0.70599999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.306,"5min":2.4279999999999999,"15min":3.169},"last":1.3160000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1839999999999999,"15min":1.1859999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.661,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.002},{"interface":"front","average":{"1min":1.113,"5min":1.2070000000000001,"15min":1.149},"min":{"1min":0.85799999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5620000000000001,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.55}]},{"osd":2,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1200000000000001,"15min":1.121},"min":{"1min":0.81399999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5029999999999999,"5min":1.71,"15min":1.71},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.321,"5min":1.282,"15min":1.3600000000000001},"min":{"1min":0.94799999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":3.1110000000000002},"last":0.83099999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3009999999999999,"15min":1.2789999999999999},"min":{"1min":0.84599999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.9730000000000001,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.268,"15min":1.2629999999999999},"min":{"1min":1.0289999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.4379999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3959999999999999,"15min":1.3779999999999999},"min":{"1min":0.746,"5min":0.69099999999999995,"15min":0.56200000000000006},"max":{"1min":3.0070000000000001,"5min":4.6539999999999999,"15min":4.6539999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.4319999999999999,"15min":1.3879999999999999},"min":{"1min":0.96899999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.841,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":1.6919999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.391,"15min":1.403},"min":{"1min":0.72199999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.752,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.641},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5509999999999999,"15min":1.542},"min":{"1min":1.089,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":3.1230000000000002,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":1.385}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.577,"15min":1.556},"min":{"1min":1.2190000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.5600000000000001,"5min":4.202,"15min":4.202},"last":1.879},{"interface":"front","average":{"1min":1.508,"5min":1.554,"15min":1.5660000000000001},"min":{"1min":0.91600000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.9119999999999999,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.796}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0740000000000001,"15min":1.0309999999999999},"min":{"1min":0.82999999999999996,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4199999999999999,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.1579999999999999,"15min":1.048},"min":{"1min":0.72399999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.736,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1659999999999999,"15min":1.0880000000000001},"min":{"1min":0.82999999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5149999999999999,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.171,"15min":1.1679999999999999},"min":{"1min":0.73799999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.589,"5min":4.7859999999999996,"15min":4.7859999999999996},"last":1.036}]},{"osd":2,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1240000000000001,"15min":1.0640000000000001},"min":{"1min":0.79200000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.609,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.254,"15min":1.288},"min":{"1min":0.92700000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4179999999999999,"5min":3.77,"15min":3.77},"last":0.85499999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2569999999999999,"15min":1.2949999999999999},"min":{"1min":0.80000000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7450000000000001,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.2,"5min":1.254,"15min":1.2130000000000001},"min":{"1min":0.81399999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6879999999999999,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.333}]},{"osd":4,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3899999999999999,"15min":1.4470000000000001},"min":{"1min":0.80700000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7030000000000001,"5min":3.835,"15min":3.835},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.415,"15min":1.4550000000000001},"min":{"1min":1.2549999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.8520000000000001,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":1.147}]},{"osd":6,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.498,"15min":1.538},"min":{"1min":0.97699999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.988,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":1.365},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4159999999999999,"15min":1.452},"min":{"1min":0.94499999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.734,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":1.4279999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:23:33 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.5289999999999999,"15min":1.589},"min":{"1min":1.3089999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.9399999999999999,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":1.23},{"interface":"front","average":{"1min":1.544,"5min":1.5409999999999999,"15min":1.591},"min":{"1min":1.2569999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.819,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":1.5309999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.012,"15min":1.1100000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.385,"5min":1.6040000000000001,"15min":2.7440000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0940000000000001,"15min":1.028},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.458,"5min":2.04,"15min":2.04},"last":1.081}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.78500000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.587,"5min":1.7509999999999999,"15min":2.2850000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.23,"5min":1.244,"15min":1.2410000000000001},"min":{"1min":0.80700000000000005,"5min":0.749,"15min":0.67800000000000005},"max":{"1min":1.673,"5min":1.79,"15min":1.79},"last":0.95699999999999996}]},{"osd":2,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.2110000000000001,"15min":1.268},"min":{"1min":0.76400000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.595,"5min":1.964,"15min":2.3109999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.157,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.90000000000000002,"5min":0.72099999999999997,"15min":0.68500000000000005},"max":{"1min":1.8620000000000001,"5min":1.944,"15min":1.944},"last":1.014}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.28,"15min":1.3089999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5049999999999999,"5min":2.2010000000000001,"15min":2.4159999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3149999999999999,"15min":1.341},"min":{"1min":0.94699999999999995,"5min":0.93999999999999995,"15min":0.88900000000000001},"max":{"1min":1.6739999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.3049999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.331,"15min":1.3540000000000001},"min":{"1min":0.79800000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7609999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.7949999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.448,"15min":1.494},"min":{"1min":0.98699999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.738,"5min":2.3319999999999999,"15min":2.899},"last":1.216}]},{"osd":6,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.448,"15min":1.494},"min":{"1min":1.0449999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9239999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.5660000000000001,"15min":1.6240000000000001},"min":{"1min":1.123,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.7170000000000001,"5min":2.4239999999999999,"15min":3.008},"last":1.663}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.6319999999999999,"15min":1.7270000000000001},"min":{"1min":1.2170000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.982,"5min":2.4460000000000002,"15min":2.6059999999999999},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.5960000000000001,"15min":1.6819999999999999},"min":{"1min":1.0409999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0640000000000001,"5min":2.343,"15min":3.085},"last":1.4099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78100000000000003,"15min":0.84699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.377},"max":{"1min":1.3999999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.878,"15min":0.90000000000000002},"min":{"1min":0.55400000000000005,"5min":0.41499999999999998,"15min":0.35199999999999998},"max":{"1min":1.452,"5min":1.5920000000000001,"15min":1.764},"last":1.0009999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76600000000000001,"15min":0.83399999999999996},"min":{"1min":0.436,"5min":0.371,"15min":0.371},"max":{"1min":1.4550000000000001,"5min":1.508,"15min":1.784},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.97199999999999998},"min":{"1min":0.505,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3480000000000001,"5min":1.5649999999999999,"15min":2.2749999999999999},"last":0.84399999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.99299999999999999,"15min":1.0609999999999999},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.643,"5min":1.6559999999999999,"15min":2.7109999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.0349999999999999,"15min":1.099},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.44600000000000001},"max":{"1min":1.413,"5min":1.599,"15min":2.379},"last":1.2}]},{"osd":4,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0820000000000001,"15min":1.121},"min":{"1min":0.76600000000000001,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4199999999999999,"5min":1.5529999999999999,"15min":2.0209999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.1839999999999999,"15min":1.3169999999999999},"min":{"1min":0.79100000000000004,"5min":0.77500000000000002,"15min":0.72999999999999998},"max":{"1min":1.645,"5min":1.766,"15min":2.859},"last":1.3839999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2090000000000001,"15min":1.331},"min":{"1min":0.86299999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.498,"5min":1.9350000000000001,"15min":2.504},"last":1.117},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.155,"15min":1.2310000000000001},"min":{"1min":0.83999999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5189999999999999,"5min":1.8280000000000001,"15min":2.1709999999999998},"last":1.421}]},{"osd":6,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2410000000000001,"15min":1.403},"min":{"1min":0.84799999999999998,"5min":0.80400000000000005,"15min":0.79100000000000004},"max":{"1min":1.746,"5min":1.899,"15min":3.8540000000000001},"last":1.159},{"interface":"front","average":{"1min":1.24,"5min":1.29,"15min":1.4119999999999999},"min":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.73199999999999998},"max":{"1min":1.589,"5min":1.903,"15min":3.226},"last":1.0660000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2250000000000001,"15min":1.278},"min":{"1min":0.82899999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.605,"5min":2.129,"15min":2.1509999999999998},"last":1.133},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3580000000000001,"15min":1.482},"min":{"1min":0.86599999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.853,"5min":2.089,"15min":3.956},"last":1.266}]}]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78700000000000003,"15min":0.93500000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.827,"5min":1.827,"15min":2.7799999999999998},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.002,"5min":0.90200000000000002,"15min":1.044},"min":{"1min":0.505,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.972,"5min":2.0459999999999998,"15min":2.8300000000000001},"last":0.50800000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79700000000000004,"15min":0.93899999999999995},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2470000000000001,"5min":1.5229999999999999,"15min":1.645},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.877,"15min":1.0009999999999999},"min":{"1min":0.55300000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.304,"5min":1.6990000000000001,"15min":1.901},"last":0.46999999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.877,"15min":1.028},"min":{"1min":0.44700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.9039999999999999,"5min":2.2240000000000002,"15min":2.4100000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0529999999999999,"15min":1.2070000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.7490000000000001,"5min":1.8939999999999999,"15min":2.5619999999999998},"last":0.92700000000000005}]},{"osd":4,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1859999999999999,"15min":1.264},"min":{"1min":0.91800000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.677,"5min":1.8939999999999999,"15min":2.0129999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1679999999999999,"15min":1.268},"min":{"1min":0.81000000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.849,"5min":1.849,"15min":2.3359999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.135,"15min":1.2270000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.901},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.206,"15min":1.3540000000000001},"min":{"1min":0.84599999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.796,"5min":1.796,"15min":2.395},"last":0.98599999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3180000000000001,"15min":1.4279999999999999},"min":{"1min":0.93600000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.5329999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.246,"5min":1.266,"15min":1.3300000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.6579999999999999,"5min":2.0750000000000002,"15min":2.2280000000000002},"last":1.3149999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:23:34 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.327,"15min":1.4590000000000001},"min":{"1min":0.94299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.0760000000000001,"5min":2.1309999999999998,"15min":2.4710000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.296,"5min":1.3240000000000001,"15min":1.409},"min":{"1min":0.90200000000000002,"5min":0.86099999999999999,"15min":0.73399999999999999},"max":{"1min":1.74,"5min":2.1320000000000001,"15min":2.4009999999999998},"last":1.1910000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.749,"15min":0.80500000000000005},"min":{"1min":0.45500000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.23,"5min":1.589,"15min":1.589},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.83999999999999997,"15min":0.93600000000000005},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.722,"5min":2.2909999999999999,"15min":2.6960000000000002},"last":0.48699999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.85899999999999999},"min":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.93899999999999995,"15min":0.98799999999999999},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.8480000000000001},"last":0.53200000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0349999999999999,"15min":1.069},"min":{"1min":0.45000000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.726,"5min":1.895,"15min":1.9710000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.93799999999999994,"15min":1.0329999999999999},"min":{"1min":0.499,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.5700000000000001,"5min":2.319,"15min":2.319},"last":0.68799999999999994}]},{"osd":4,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.153,"15min":1.2230000000000001},"min":{"1min":0.77600000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.635,"5min":1.7210000000000001,"15min":2.294},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1379999999999999,"15min":1.2350000000000001},"min":{"1min":0.83499999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.663,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.78900000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.224,"15min":1.3440000000000001},"min":{"1min":0.751,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.7609999999999999,"5min":2.1509999999999998,"15min":2.5819999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.359,"15min":1.3799999999999999},"min":{"1min":1.046,"5min":0.83899999999999997,"15min":0.76700000000000002},"max":{"1min":1.9450000000000001,"5min":1.9650000000000001,"15min":2.4569999999999999},"last":1.3160000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2509999999999999,"15min":1.355},"min":{"1min":0.82199999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5569999999999999,"5min":2.198,"15min":3.2389999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.25,"15min":1.337},"min":{"1min":0.82299999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.839,"5min":1.992,"15min":2.2810000000000001},"last":1.0940000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.331,"15min":1.367},"min":{"1min":0.78700000000000003,"5min":0.755,"15min":0.755},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.3690000000000002},"last":1.252},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.325,"15min":1.466},"min":{"1min":0.86099999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.845,"5min":1.9630000000000001,"15min":3.3500000000000001},"last":1.038}]}]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":1010969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.35899999999999999},"max":{"1min":1.2969999999999999,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.78900000000000003,"15min":0.86799999999999999},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5720000000000001,"5min":1.593,"15min":1.593},"last":0.439}]},{"osd":2,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.86699999999999999,"15min":0.93999999999999995},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1080000000000001,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.90200000000000002,"15min":0.99099999999999999},"min":{"1min":0.49099999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.97899999999999998,"15min":0.94499999999999995},"min":{"1min":0.46100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.0289999999999999,"5min":9.4939999999999998,"15min":9.4939999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0589999999999999,"15min":1.133},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6060000000000001,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.77800000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3169999999999999,"15min":1.3089999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.753},"max":{"1min":2.081,"5min":4.9290000000000003,"15min":4.9290000000000003},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.3140000000000001,"15min":1.2589999999999999},"min":{"1min":0.83999999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.738,"5min":9.7240000000000002,"15min":9.7240000000000002},"last":0.628}]},{"osd":5,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.288,"15min":1.278},"min":{"1min":0.76000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.8280000000000001,"5min":9.6039999999999992,"15min":9.6039999999999992},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3400000000000001,"15min":1.375},"min":{"1min":0.95399999999999996,"5min":0.754,"15min":0.754},"max":{"1min":1.9670000000000001,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":1.0289999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.327,"15min":1.387},"min":{"1min":0.81000000000000005,"5min":0.77300000000000002,"15min":0.76900000000000002},"max":{"1min":2.1240000000000001,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.242,"15min":1.337},"min":{"1min":0.86399999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.9319999999999999,"5min":2.0590000000000002,"15min":2.6709999999999998},"last":0.76000000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:23:40 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.357,"15min":1.421},"min":{"1min":0.91200000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.1669999999999998,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3580000000000001,"15min":1.347},"min":{"1min":0.78200000000000003,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.3639999999999999,"5min":9.9320000000000004,"15min":9.9320000000000004},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:24:30.820 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-26T07:17:23.903458+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=26, tm_hour=7, tm_min=17, tm_sec=23, tm_wday=6, tm_yday=330, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=26, tm_hour=7, tm_min=24, tm_sec=23, tm_wday=6, tm_yday=330, tm_isdst=0) 2023-11-26T07:24:30.821 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-26T07:24:50.821 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:24:51.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.040+0000 7f3667294640 1 Processor -- start 2023-11-26T07:24:51.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.040+0000 7f3667294640 1 -- start start 2023-11-26T07:24:51.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.041+0000 7f3667294640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36600cf450 0x7f36600cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.042+0000 7f3667294640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f36600cdfb0 0x7f36600ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.042+0000 7f3667294640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36600cece0 con 0x7f366015c7f0 2023-11-26T07:24:51.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.042+0000 7f3667294640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3660156010 con 0x7f36600cdfb0 2023-11-26T07:24:51.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.042+0000 7f3667294640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366006ce30 con 0x7f36600cf450 2023-11-26T07:24:51.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.042+0000 7f3665030640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f366015c7f0 0x7f366006db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35618/0 (socket says 172.21.15.77:35618) 2023-11-26T07:24:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.042+0000 7f3665030640 1 -- 172.21.15.77:0/3953906660 learned_addr learned my addr 172.21.15.77:0/3953906660 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.042+0000 7f366482f640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36600cf450 0x7f36600cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.042+0000 7f3665831640 1 --2- 172.21.15.77:0/3953906660 >> v2:172.21.15.159:3300/0 conn(0x7f36600cdfb0 0x7f36600ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.042+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129646967 0 0) 0x7f36600cece0 con 0x7f366015c7f0 2023-11-26T07:24:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f364c003520 con 0x7f366015c7f0 2023-11-26T07:24:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4105581608 0 0) 0x7f364c003520 con 0x7f366015c7f0 2023-11-26T07:24:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36600cf450 msgr2=0x7f36600cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:51.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36600cf450 0x7f36600cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 >> v2:172.21.15.159:3300/0 conn(0x7f36600cdfb0 msgr2=0x7f36600ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:51.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 --2- 172.21.15.77:0/3953906660 >> v2:172.21.15.159:3300/0 conn(0x7f36600cdfb0 0x7f36600ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366006d040 con 0x7f366015c7f0 2023-11-26T07:24:51.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7f365c001670 con 0x7f366015c7f0 2023-11-26T07:24:51.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 >> v1:172.21.15.77:6789/0 conn(0x7f366015c7f0 legacy=0x7f366006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36600cf450 0x7f364c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f364c003ef0 0x7f364c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f364c004d00 0x7f364c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3660156010 con 0x7f364c003ef0 2023-11-26T07:24:51.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366006ce30 con 0x7f364c004d00 2023-11-26T07:24:51.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c00b9d0 con 0x7f36600cf450 2023-11-26T07:24:51.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.043+0000 7f366482f640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f364c003ef0 0x7f364c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.044+0000 7f3665831640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f364c004d00 0x7f364c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.044+0000 7f3665030640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36600cf450 0x7f364c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.044+0000 7f366482f640 1 -- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36600cf450 msgr2=0x7f364c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:51.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.044+0000 7f366482f640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36600cf450 0x7f364c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.044+0000 7f366482f640 1 -- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f364c004d00 msgr2=0x7f364c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:51.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.044+0000 7f366482f640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f364c004d00 0x7f364c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.044+0000 7f366482f640 1 -- 172.21.15.77:0/3953906660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c003520 con 0x7f364c003ef0 2023-11-26T07:24:51.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.044+0000 7f3665831640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f364c004d00 0x7f364c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:51.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.044+0000 7f3665030640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36600cf450 0x7f364c003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:51.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.045+0000 7f366482f640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f364c003ef0 0x7f364c0047c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f3650009ac0 tx=0x7f364c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53a2cc987bec56b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:51.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.045+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365002c6b0 con 0x7f364c003ef0 2023-11-26T07:24:51.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.045+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365002c810 con 0x7f364c003ef0 2023-11-26T07:24:51.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.045+0000 7f3657fff640 1 -- 172.21.15.77:0/3953906660 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365002cba0 con 0x7f364c003ef0 2023-11-26T07:24:51.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.046+0000 7f3667294640 1 -- 172.21.15.77:0/3953906660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f364c003ef0 msgr2=0x7f364c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.046+0000 7f3667294640 1 --2- 172.21.15.77:0/3953906660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f364c003ef0 0x7f364c0047c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f3650009ac0 tx=0x7f364c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.046+0000 7f3665831640 1 -- 172.21.15.77:0/3953906660 reap_dead start 2023-11-26T07:24:51.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.046+0000 7f3667294640 1 -- 172.21.15.77:0/3953906660 shutdown_connections 2023-11-26T07:24:51.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.046+0000 7f3667294640 1 -- 172.21.15.77:0/3953906660 >> 172.21.15.77:0/3953906660 conn(0x7f366006a920 msgr2=0x7f366006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:51.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.046+0000 7f3667294640 1 -- 172.21.15.77:0/3953906660 shutdown_connections 2023-11-26T07:24:51.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.046+0000 7f3667294640 1 -- 172.21.15.77:0/3953906660 wait complete. 2023-11-26T07:24:51.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.048+0000 7f3667294640 1 Processor -- start 2023-11-26T07:24:51.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.048+0000 7f3667294640 1 -- start start 2023-11-26T07:24:51.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3667294640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f364c003ef0 0x7f36601f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3667294640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3660072420 0x7f36601f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3667294640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3660158300 0x7f366006d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3667294640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600b20e0 con 0x7f3660158300 2023-11-26T07:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3667294640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36601f3840 con 0x7f364c003ef0 2023-11-26T07:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3667294640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3660156e70 con 0x7f3660072420 2023-11-26T07:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3665831640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3660158300 0x7f366006d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3665831640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3660158300 0x7f366006d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44244/0 (socket says 172.21.15.77:44244) 2023-11-26T07:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3665831640 1 -- 172.21.15.77:0/1580475826 learned_addr learned my addr 172.21.15.77:0/1580475826 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f366482f640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3660072420 0x7f36601f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3665831640 1 -- 172.21.15.77:0/1580475826 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3660072420 msgr2=0x7f36601f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3665831640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3660072420 0x7f36601f3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3665030640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f364c003ef0 0x7f36601f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3665831640 1 -- 172.21.15.77:0/1580475826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f364c003ef0 msgr2=0x7f36601f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3665831640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f364c003ef0 0x7f36601f6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3665831640 1 -- 172.21.15.77:0/1580475826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3660158b70 con 0x7f3660158300 2023-11-26T07:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.049+0000 7f3665030640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f364c003ef0 0x7f36601f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.050+0000 7f3665831640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3660158300 0x7f366006d970 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f36600d00e0 tx=0x7f3658009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.050+0000 7f3655ffb640 1 -- 172.21.15.77:0/1580475826 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658007cc0 con 0x7f3660158300 2023-11-26T07:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.050+0000 7f3655ffb640 1 -- 172.21.15.77:0/1580475826 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3658007e40 con 0x7f3660158300 2023-11-26T07:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.050+0000 7f3655ffb640 1 -- 172.21.15.77:0/1580475826 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658014640 con 0x7f3660158300 2023-11-26T07:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.050+0000 7f3667294640 1 -- 172.21.15.77:0/1580475826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3660158e50 con 0x7f3660158300 2023-11-26T07:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.050+0000 7f3667294640 1 -- 172.21.15.77:0/1580475826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36600b2330 con 0x7f3660158300 2023-11-26T07:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.051+0000 7f3667294640 1 -- 172.21.15.77:0/1580475826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3660067470 con 0x7f3660158300 2023-11-26T07:24:51.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.052+0000 7f3655ffb640 1 -- 172.21.15.77:0/1580475826 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f36580147a0 con 0x7f3660158300 2023-11-26T07:24:51.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.053+0000 7f3655ffb640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f364406b8f0 0x7f364406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.053+0000 7f3655ffb640 1 -- 172.21.15.77:0/1580475826 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3658087c50 con 0x7f3660158300 2023-11-26T07:24:51.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.053+0000 7f3665030640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f364406b8f0 0x7f364406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.054+0000 7f3665030640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f364406b8f0 0x7f364406ddb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f365c001eb0 tx=0x7f365c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:51.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.058+0000 7f3655ffb640 1 -- 172.21.15.77:0/1580475826 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3658054630 con 0x7f3660158300 2023-11-26T07:24:51.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.246+0000 7f3667294640 1 -- 172.21.15.77:0/1580475826 --> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3660071a00 con 0x7f364406b8f0 2023-11-26T07:24:51.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.248+0000 7f3655ffb640 1 -- 172.21.15.77:0/1580475826 <== mgr.4110 v2:172.21.15.77:6832/2342497679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48331 (secure 0 0 0) 0x7f3660071a00 con 0x7f364406b8f0 2023-11-26T07:24:51.251 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:51.252 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-26T07:24:51.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.252+0000 7f3667294640 1 -- 172.21.15.77:0/1580475826 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f364406b8f0 msgr2=0x7f364406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.252+0000 7f3667294640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f364406b8f0 0x7f364406ddb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f365c001eb0 tx=0x7f365c009040 comp rx=0 tx=0).stop 2023-11-26T07:24:51.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.252+0000 7f3667294640 1 -- 172.21.15.77:0/1580475826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3660158300 msgr2=0x7f366006d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.252+0000 7f3667294640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3660158300 0x7f366006d970 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f36600d00e0 tx=0x7f3658009cd0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.252+0000 7f3667294640 1 -- 172.21.15.77:0/1580475826 shutdown_connections 2023-11-26T07:24:51.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.252+0000 7f3667294640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f364406b8f0 0x7f364406ddb0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.252+0000 7f3667294640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3660158300 0x7f366006d970 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.252+0000 7f3667294640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3660072420 0x7f36601f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.252+0000 7f3667294640 1 --2- 172.21.15.77:0/1580475826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f364c003ef0 0x7f36601f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.252+0000 7f3667294640 1 -- 172.21.15.77:0/1580475826 >> 172.21.15.77:0/1580475826 conn(0x7f366006a920 msgr2=0x7f366006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:51.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.252+0000 7f3667294640 1 -- 172.21.15.77:0/1580475826 shutdown_connections 2023-11-26T07:24:51.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.253+0000 7f3667294640 1 -- 172.21.15.77:0/1580475826 wait complete. 2023-11-26T07:24:51.275 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2023-11-26T07:24:49.744440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":266604,"kb_used_data":8840,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754708116,"statfs":{"total":773094113280,"available":772821110784,"internally_reserved":0,"allocated":9052160,"data_stored":4545544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003434"},"pg_stats":[{"pgid":"1.0","version":"80'119","reported_seq":232,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-26T07:24:31.812788+0000","last_change":"2023-11-26T07:24:31.812854+0000","last_active":"2023-11-26T07:24:31.812788+0000","last_peered":"2023-11-26T07:24:31.812788+0000","last_clean":"2023-11-26T07:24:31.812788+0000","last_became_active":"2023-11-26T07:17:25.279894+0000","last_became_peered":"2023-11-26T07:17:25.279894+0000","last_unstale":"2023-11-26T07:24:31.812788+0000","last_undegraded":"2023-11-26T07:24:31.812788+0000","last_fullsized":"2023-11-26T07:24:31.812788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'119","last_scrub_stamp":"2023-11-26T07:24:31.812607+0000","last_deep_scrub":"80'119","last_deep_scrub_stamp":"2023-11-26T07:24:31.812607+0000","last_clean_scrub_stamp":"2023-11-26T07:24:31.812607+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:14:44.070574+0000","scrub_duration":0.012973323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1576960,"data_stored":1010969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.048,"15min":1.042},"min":{"1min":0.63600000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.623,"5min":1.706,"15min":1.768},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0960000000000001,"15min":1.075},"min":{"1min":0.64100000000000001,"5min":0.627,"15min":0.627},"max":{"1min":1.4430000000000001,"5min":2.298,"15min":2.298},"last":1.3979999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:24:35 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1020000000000001,"15min":1.0649999999999999},"min":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.462,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.1519999999999999,"15min":1.204},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7769999999999999,"5min":1.8899999999999999,"15min":1.9650000000000001},"last":1.228}]},{"osd":2,"last update":"Sun Nov 26 07:24:35 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.204,"15min":1.179},"min":{"1min":0.76600000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7350000000000001,"5min":1.9239999999999999,"15min":2.0760000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.171,"15min":1.2569999999999999},"min":{"1min":0.81799999999999995,"5min":0.73599999999999999,"15min":0.70399999999999996},"max":{"1min":1.877,"5min":1.877,"15min":2.5339999999999998},"last":1.341}]},{"osd":3,"last update":"Sun Nov 26 07:24:35 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1779999999999999,"15min":1.2190000000000001},"min":{"1min":0.77600000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.9299999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3240000000000001,"15min":1.3540000000000001},"min":{"1min":0.876,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.835,"5min":1.9650000000000001,"15min":2.2389999999999999},"last":1.4379999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:24:35 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.292,"15min":1.3420000000000001},"min":{"1min":0.89900000000000002,"5min":0.63,"15min":0.60599999999999998},"max":{"1min":2.0009999999999999,"5min":2.1259999999999999,"15min":2.774},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.399,"15min":1.4470000000000001},"min":{"1min":0.93700000000000006,"5min":0.66400000000000003,"15min":0.57399999999999995},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.3780000000000001},"last":1.4890000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:24:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.423,"15min":1.48},"min":{"1min":0.998,"5min":0.69999999999999996,"15min":0.65900000000000003},"max":{"1min":2.177,"5min":2.4009999999999998,"15min":2.8330000000000002},"last":1.109},{"interface":"front","average":{"1min":1.524,"5min":1.369,"15min":1.4490000000000001},"min":{"1min":0.86199999999999999,"5min":0.78200000000000003,"15min":0.54600000000000004},"max":{"1min":4.7480000000000002,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":1.29}]},{"osd":6,"last update":"Sun Nov 26 07:24:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.556,"15min":1.645},"min":{"1min":1.1899999999999999,"5min":0.80400000000000005,"15min":0.75},"max":{"1min":2.1120000000000001,"5min":2.258,"15min":2.7280000000000002},"last":1.462},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.518,"15min":1.6100000000000001},"min":{"1min":1.0069999999999999,"5min":0.97699999999999998,"15min":0.56299999999999994},"max":{"1min":1.8089999999999999,"5min":2.0630000000000002,"15min":2.4590000000000001},"last":1.5229999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.1739999999999999,"15min":1.139},"min":{"1min":0.79200000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":5.9610000000000003,"5min":5.9610000000000003,"15min":5.9610000000000003},"last":1.637},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.127,"15min":1.222},"min":{"1min":0.83599999999999997,"5min":0.69499999999999995,"15min":0.67500000000000004},"max":{"1min":1.4530000000000001,"5min":2.4279999999999999,"15min":3.169},"last":1.171}]},{"osd":1,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.90800000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5389999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.766},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.206,"15min":1.1479999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.55,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.3799999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.133,"15min":1.1220000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6950000000000001,"5min":1.71,"15min":1.71},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3120000000000001,"15min":1.3580000000000001},"min":{"1min":0.83099999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6639999999999999,"5min":2.6539999999999999,"15min":3.1110000000000002},"last":1.4279999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.327,"15min":1.286},"min":{"1min":0.95999999999999996,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7509999999999999,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":1.278},{"interface":"front","average":{"1min":1.286,"5min":1.2929999999999999,"15min":1.2649999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6379999999999999,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.2270000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.4079999999999999,"15min":1.3799999999999999},"min":{"1min":1.1020000000000001,"5min":0.69099999999999995,"15min":0.56200000000000006},"max":{"1min":1.6779999999999999,"5min":4.6539999999999999,"15min":4.6539999999999999},"last":1.554},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4650000000000001,"15min":1.3939999999999999},"min":{"1min":1.2250000000000001,"5min":0.59299999999999997,"15min":0.51700000000000002},"max":{"1min":1.7070000000000001,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":1.5940000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.405,"15min":1.401},"min":{"1min":0.93999999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.7949999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.573,"15min":1.542},"min":{"1min":1.266,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.819,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":1.839}]},{"osd":7,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.591,"15min":1.5529999999999999},"min":{"1min":1.048,"5min":0.66700000000000004,"15min":0.58699999999999997},"max":{"1min":1.879,"5min":4.202,"15min":4.202},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.542,"5min":1.573,"15min":1.5640000000000001},"min":{"1min":1.0980000000000001,"5min":0.73899999999999999,"15min":0.71699999999999997},"max":{"1min":1.796,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.6759999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.083,"15min":1.0429999999999999},"min":{"1min":0.64400000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.9670000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.288},{"interface":"front","average":{"1min":1.133,"5min":1.1599999999999999,"15min":1.0580000000000001},"min":{"1min":0.77100000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6599999999999999,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.999}]},{"osd":1,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.171,"15min":1.093},"min":{"1min":0.77000000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.6140000000000001,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":1.139},{"interface":"front","average":{"1min":1.119,"5min":1.1639999999999999,"15min":1.165},"min":{"1min":0.73899999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.6870000000000001,"5min":4.7859999999999996,"15min":4.7859999999999996},"last":1.3220000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1679999999999999,"15min":1.0760000000000001},"min":{"1min":0.67900000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.645,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.254,"15min":1.2829999999999999},"min":{"1min":0.84899999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5449999999999999,"5min":3.77,"15min":3.77},"last":1.0620000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.258,"15min":1.288},"min":{"1min":0.84699999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.663,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":1.446},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.278,"15min":1.218},"min":{"1min":0.96799999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6930000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.345}]},{"osd":4,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.371,"15min":1.4379999999999999},"min":{"1min":0.84899999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.76,"5min":3.835,"15min":3.835},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.385,"5min":1.4159999999999999,"15min":1.4490000000000001},"min":{"1min":0.97999999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.784,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":1.3879999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5,"15min":1.534},"min":{"1min":1.1559999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.893,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.431,"15min":1.45},"min":{"1min":0.88900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.794,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":1.5049999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.5229999999999999,"15min":1.5780000000000001},"min":{"1min":1.1879999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.891,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":1.25},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.5489999999999999,"15min":1.5880000000000001},"min":{"1min":1.2070000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.845,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":1.645}]}]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:38 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0269999999999999,"15min":1.1060000000000001},"min":{"1min":0.69199999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5609999999999999,"5min":1.6040000000000001,"15min":2.7440000000000002},"last":1.204},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.085,"15min":1.034},"min":{"1min":0.69099999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.72,"5min":2.04,"15min":2.04},"last":1.536}]},{"osd":1,"last update":"Sun Nov 26 07:24:38 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.161,"15min":1.1679999999999999},"min":{"1min":0.81899999999999995,"5min":0.69099999999999995,"15min":0.67700000000000005},"max":{"1min":1.5900000000000001,"5min":1.7509999999999999,"15min":2.2850000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.222,"15min":1.232},"min":{"1min":0.81299999999999994,"5min":0.75700000000000001,"15min":0.67800000000000005},"max":{"1min":1.4790000000000001,"5min":1.79,"15min":1.79},"last":1.411}]},{"osd":2,"last update":"Sun Nov 26 07:24:38 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2090000000000001,"15min":1.262},"min":{"1min":0.77300000000000002,"5min":0.71299999999999997,"15min":0.69699999999999995},"max":{"1min":1.7010000000000001,"5min":1.964,"15min":2.3109999999999999},"last":1.454},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.196,"15min":1.262},"min":{"1min":0.748,"5min":0.72099999999999997,"15min":0.68500000000000005},"max":{"1min":1.8640000000000001,"5min":1.944,"15min":1.944},"last":1.101}]},{"osd":3,"last update":"Sun Nov 26 07:24:38 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.266,"15min":1.3049999999999999},"min":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.631,"5min":2.2010000000000001,"15min":2.4159999999999999},"last":1.357},{"interface":"front","average":{"1min":1.282,"5min":1.3149999999999999,"15min":1.3360000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.5800000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:24:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3180000000000001,"15min":1.3500000000000001},"min":{"1min":0.82599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.452,"15min":1.4910000000000001},"min":{"1min":0.998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.8360000000000001,"5min":2.3319999999999999,"15min":2.899},"last":1.518}]},{"osd":6,"last update":"Sun Nov 26 07:24:38 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.425,"15min":1.482},"min":{"1min":0.98599999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.595,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.482},{"interface":"front","average":{"1min":1.667,"5min":1.5800000000000001,"15min":1.625},"min":{"1min":1.125,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":1.629}]},{"osd":7,"last update":"Sun Nov 26 07:24:38 2023","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.625,"15min":1.7150000000000001},"min":{"1min":1.1899999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.222,"5min":2.4460000000000002,"15min":2.6059999999999999},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.569,"15min":1.671},"min":{"1min":1.1279999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0489999999999999,"5min":2.343,"15min":3.085},"last":1.768}]}]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.81100000000000005,"15min":0.84699999999999998},"min":{"1min":0.41999999999999998,"5min":0.39300000000000002,"15min":0.377},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88700000000000001,"15min":0.89800000000000002},"min":{"1min":0.439,"5min":0.41499999999999998,"15min":0.35199999999999998},"max":{"1min":1.5,"5min":1.5920000000000001,"15min":1.764},"last":1.391}]},{"osd":1,"last update":"Sun Nov 26 07:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78100000000000003,"15min":0.82799999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1910000000000001,"5min":1.4550000000000001,"15min":1.784},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.03,"5min":0.90700000000000003,"15min":0.97199999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41399999999999998},"max":{"1min":2.073,"5min":2.073,"15min":2.2749999999999999},"last":1.01}]},{"osd":2,"last update":"Sun Nov 26 07:24:45 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.034,"15min":1.0609999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.754,"5min":1.754,"15min":2.7109999999999999},"last":1.234},{"interface":"front","average":{"1min":1.238,"5min":1.0920000000000001,"15min":1.1060000000000001},"min":{"1min":0.65000000000000002,"5min":0.47099999999999997,"15min":0.44600000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.379},"last":1.5049999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:24:45 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.0880000000000001,"15min":1.1200000000000001},"min":{"1min":0.74199999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":2.0209999999999999},"last":1.133},{"interface":"front","average":{"1min":1.131,"5min":1.1879999999999999,"15min":1.3},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.603,"5min":1.766,"15min":2.859},"last":1.079}]},{"osd":5,"last update":"Sun Nov 26 07:24:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2430000000000001,"15min":1.325},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.752},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.504},"last":1.341},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1659999999999999,"15min":1.226},"min":{"1min":0.80700000000000005,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.659,"5min":1.8280000000000001,"15min":2.1709999999999998},"last":0.93600000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:24:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.262,"15min":1.389},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.633,"5min":1.899,"15min":3.8540000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3260000000000001,"15min":1.4039999999999999},"min":{"1min":0.84799999999999998,"5min":0.80200000000000005,"15min":0.73199999999999998},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":3.226},"last":1.4330000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:24:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2529999999999999,"15min":1.276},"min":{"1min":0.74399999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.381,"15min":1.47},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.77100000000000002},"max":{"1min":1.9339999999999999,"5min":2.089,"15min":3.956},"last":1.4690000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.79800000000000004,"15min":0.92800000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.7509999999999999,"5min":1.827,"15min":2.7799999999999998},"last":1.135},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.88900000000000001,"15min":1.0269999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.472,"5min":1.972,"15min":2.8300000000000001},"last":1.4670000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.82999999999999996,"15min":0.93400000000000005},"min":{"1min":0.50900000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.51,"5min":1.5229999999999999,"15min":1.645},"last":1.6040000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.86599999999999999,"15min":0.98599999999999999},"min":{"1min":0.46999999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2230000000000001,"5min":1.6990000000000001,"15min":1.901},"last":1.0389999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.872,"15min":1.0129999999999999},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.254,"5min":1.9430000000000001,"15min":2.4100000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.171,"5min":1.0820000000000001,"15min":1.2},"min":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.04,"5min":2.04,"15min":2.5619999999999998},"last":1.3700000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.208,"15min":1.2589999999999999},"min":{"1min":0.81399999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.8560000000000001,"5min":1.8939999999999999,"15min":2.0129999999999999},"last":1.663},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1639999999999999,"15min":1.2569999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.633,"5min":1.849,"15min":2.3359999999999999},"last":1.268}]},{"osd":5,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.1599999999999999,"15min":1.226},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.839,"5min":1.839,"15min":1.901},"last":1.423},{"interface":"front","average":{"1min":1.347,"5min":1.2310000000000001,"15min":1.349},"min":{"1min":0.78800000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.395},"last":1.528}]},{"osd":6,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3220000000000001,"15min":1.419},"min":{"1min":0.90800000000000003,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.9119999999999999,"5min":2.1669999999999998,"15min":2.5329999999999999},"last":1.337},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.28,"15min":1.3300000000000001},"min":{"1min":1.0329999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.964,"5min":1.964,"15min":2.2280000000000002},"last":1.5589999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:24:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3180000000000001,"15min":1.4450000000000001},"min":{"1min":0.79300000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.4710000000000001},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3260000000000001,"15min":1.4059999999999999},"min":{"1min":1.0169999999999999,"5min":0.86099999999999999,"15min":0.73399999999999999},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.4009999999999998},"last":1.8460000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":983040,"data_stored":420601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.748,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1899999999999999,"5min":1.589,"15min":1.589},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.84699999999999998,"15min":0.93100000000000005},"min":{"1min":0.48699999999999999,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":1.6120000000000001,"5min":2.2909999999999999,"15min":2.6960000000000002},"last":1.294}]},{"osd":2,"last update":"Sun Nov 26 07:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.84599999999999997,"15min":0.86099999999999999},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.38100000000000001},"max":{"1min":1.494,"5min":1.514,"15min":1.514},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.93000000000000005,"15min":0.98099999999999998},"min":{"1min":0.53200000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2849999999999999,"5min":1.579,"15min":1.8480000000000001},"last":0.97199999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:24:37 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0269999999999999,"15min":1.0640000000000001},"min":{"1min":0.57799999999999996,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3939999999999999,"5min":1.895,"15min":1.9710000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.96399999999999997,"15min":1.038},"min":{"1min":0.59899999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7070000000000001,"5min":2.319,"15min":2.319},"last":1.1539999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:24:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.194,"15min":1.2330000000000001},"min":{"1min":0.84599999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":2.294},"last":1.377},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.151,"15min":1.2330000000000001},"min":{"1min":0.78900000000000003,"5min":0.65500000000000003,"15min":0.65300000000000002},"max":{"1min":1.9490000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.4059999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:24:37 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2350000000000001,"15min":1.3320000000000001},"min":{"1min":0.77400000000000002,"5min":0.751,"15min":0.48799999999999999},"max":{"1min":1.6000000000000001,"5min":2.1509999999999998,"15min":2.5819999999999999},"last":1.224},{"interface":"front","average":{"1min":1.381,"5min":1.3640000000000001,"15min":1.379},"min":{"1min":0.97199999999999998,"5min":0.86399999999999999,"15min":0.76700000000000002},"max":{"1min":1.657,"5min":1.9650000000000001,"15min":2.4569999999999999},"last":1.2529999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:24:37 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.2689999999999999,"15min":1.355},"min":{"1min":0.88900000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.8640000000000001,"5min":2.198,"15min":3.2389999999999999},"last":1.512},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2549999999999999,"15min":1.331},"min":{"1min":0.82499999999999996,"5min":0.75600000000000001,"15min":0.71499999999999997},"max":{"1min":1.841,"5min":1.992,"15min":2.2810000000000001},"last":1.48}]},{"osd":7,"last update":"Sun Nov 26 07:24:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.323,"15min":1.363},"min":{"1min":0.93999999999999995,"5min":0.755,"15min":0.755},"max":{"1min":1.7230000000000001,"5min":2.0329999999999999,"15min":2.3690000000000002},"last":1.349},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.323,"15min":1.458},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.8640000000000001,"5min":1.954,"15min":3.3500000000000001},"last":1.431}]}]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1576960,"data_stored":1010969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.75700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1259999999999999,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81100000000000005,"15min":0.86199999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.3129999999999999,"5min":1.593,"15min":1.593},"last":1.4690000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90100000000000002,"15min":0.93400000000000005},"min":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.40899999999999997},"max":{"1min":1.405,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.93899999999999995,"15min":0.98799999999999999},"min":{"1min":0.51000000000000001,"5min":0.49099999999999999,"15min":0.432},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.97099999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:24:42 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.02,"15min":0.94399999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.647,"5min":9.4939999999999998,"15min":9.4939999999999998},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.117,"15min":1.133},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.837,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":1.2150000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:24:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.345,"15min":1.3089999999999999},"min":{"1min":0.85299999999999998,"5min":0.77200000000000002,"15min":0.753},"max":{"1min":2.4649999999999999,"5min":4.9290000000000003,"15min":4.9290000000000003},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3640000000000001,"15min":1.266},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0219999999999998,"5min":9.7240000000000002,"15min":9.7240000000000002},"last":1.1739999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:24:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3340000000000001,"15min":1.2809999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.65200000000000002},"max":{"1min":2.1160000000000001,"5min":9.6039999999999992,"15min":9.6039999999999992},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3600000000000001,"15min":1.371},"min":{"1min":0.95999999999999996,"5min":0.754,"15min":0.754},"max":{"1min":1.9410000000000001,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":1.375}]},{"osd":6,"last update":"Sun Nov 26 07:24:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3460000000000001,"15min":1.381},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.992,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":1.133},{"interface":"front","average":{"1min":1.381,"5min":1.294,"15min":1.337},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.59199999999999997},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.6299999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:24:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3919999999999999,"15min":1.415},"min":{"1min":0.80600000000000005,"5min":0.79900000000000004,"15min":0.63700000000000001},"max":{"1min":2.6560000000000001,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.413,"15min":1.345},"min":{"1min":0.78700000000000003,"5min":0.753,"15min":0.61399999999999999},"max":{"1min":2.2160000000000002,"5min":9.9320000000000004,"15min":9.9320000000000004},"last":1.4099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:24:51.312 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-26T07:24:51.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.520+0000 7fdb46f83640 1 Processor -- start 2023-11-26T07:24:51.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.521+0000 7fdb46f83640 1 -- start start 2023-11-26T07:24:51.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.522+0000 7fdb46f83640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400cc0f0 0x7fdb400c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.522+0000 7fdb46f83640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4015eea0 con 0x7fdb400c57e0 2023-11-26T07:24:51.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.522+0000 7fdb46f83640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb400abf30 con 0x7fdb4015b440 2023-11-26T07:24:51.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.522+0000 7fdb46f83640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4015b820 con 0x7fdb400cc0f0 2023-11-26T07:24:51.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.523+0000 7fdb45520640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdb400c57e0 0x7fdb4006c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35620/0 (socket says 172.21.15.77:35620) 2023-11-26T07:24:51.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.523+0000 7fdb45520640 1 -- 172.21.15.77:0/4240252409 learned_addr learned my addr 172.21.15.77:0/4240252409 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:51.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.523+0000 7fdb3ffff640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400cc0f0 0x7fdb400c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.523+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161505522 0 0) 0x7fdb4015eea0 con 0x7fdb400c57e0 2023-11-26T07:24:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.523+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb2c003520 con 0x7fdb400c57e0 2023-11-26T07:24:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 168074138 0 0) 0x7fdb2c003520 con 0x7fdb400c57e0 2023-11-26T07:24:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400cc0f0 msgr2=0x7fdb400c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400cc0f0 0x7fdb400c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 >> v1:172.21.15.159:6789/0 conn(0x7fdb4015b440 legacy=0x7fdb400cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4015f0f0 con 0x7fdb400c57e0 2023-11-26T07:24:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2891721897 0 0) 0x7fdb38001670 con 0x7fdb400c57e0 2023-11-26T07:24:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 >> v1:172.21.15.77:6789/0 conn(0x7fdb400c57e0 legacy=0x7fdb4006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 0x7fdb2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb2c0047c0 0x7fdb2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400cc0f0 0x7fdb2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4015b820 con 0x7fdb2c0039a0 2023-11-26T07:24:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c00bae0 con 0x7fdb2c0047c0 2023-11-26T07:24:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c00bca0 con 0x7fdb400cc0f0 2023-11-26T07:24:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb44d1f640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 0x7fdb2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3ffff640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb2c0047c0 0x7fdb2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb45520640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400cc0f0 0x7fdb2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb44d1f640 1 -- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400cc0f0 msgr2=0x7fdb2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb44d1f640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400cc0f0 0x7fdb2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb44d1f640 1 -- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb2c0047c0 msgr2=0x7fdb2c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb44d1f640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb2c0047c0 0x7fdb2c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb44d1f640 1 -- 172.21.15.77:0/4240252409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c003520 con 0x7fdb2c0039a0 2023-11-26T07:24:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb45520640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400cc0f0 0x7fdb2c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.524+0000 7fdb3ffff640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb2c0047c0 0x7fdb2c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:51.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.525+0000 7fdb44d1f640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 0x7fdb2c003dc0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fdb30001e50 tx=0x7fdb2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cb7b5c60f45513 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:51.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.526+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30003b70 con 0x7fdb2c0039a0 2023-11-26T07:24:51.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.526+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb30003cd0 con 0x7fdb2c0039a0 2023-11-26T07:24:51.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.526+0000 7fdb3f7fe640 1 -- 172.21.15.77:0/4240252409 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30005310 con 0x7fdb2c0039a0 2023-11-26T07:24:51.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.526+0000 7fdb46f83640 1 -- 172.21.15.77:0/4240252409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 msgr2=0x7fdb2c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.526+0000 7fdb46f83640 1 --2- 172.21.15.77:0/4240252409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 0x7fdb2c003dc0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fdb30001e50 tx=0x7fdb2c0057f0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.526+0000 7fdb45520640 1 -- 172.21.15.77:0/4240252409 reap_dead start 2023-11-26T07:24:51.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.526+0000 7fdb46f83640 1 -- 172.21.15.77:0/4240252409 shutdown_connections 2023-11-26T07:24:51.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.526+0000 7fdb46f83640 1 -- 172.21.15.77:0/4240252409 >> 172.21.15.77:0/4240252409 conn(0x7fdb400b0c50 msgr2=0x7fdb400b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:51.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.527+0000 7fdb46f83640 1 -- 172.21.15.77:0/4240252409 shutdown_connections 2023-11-26T07:24:51.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.527+0000 7fdb46f83640 1 -- 172.21.15.77:0/4240252409 wait complete. 2023-11-26T07:24:51.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.528+0000 7fdb46f83640 1 Processor -- start 2023-11-26T07:24:51.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.528+0000 7fdb46f83640 1 -- start start 2023-11-26T07:24:51.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.529+0000 7fdb46f83640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 0x7fdb400b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.529+0000 7fdb46f83640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400b36f0 0x7fdb400ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.529+0000 7fdb46f83640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb4015ba40 0x7fdb400ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.529+0000 7fdb46f83640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4015c360 con 0x7fdb2c0039a0 2023-11-26T07:24:51.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.529+0000 7fdb46f83640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400b3bb0 con 0x7fdb4015ba40 2023-11-26T07:24:51.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.529+0000 7fdb46f83640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400b3e90 con 0x7fdb400b36f0 2023-11-26T07:24:51.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.530+0000 7fdb44d1f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 0x7fdb400b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.530+0000 7fdb44d1f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 0x7fdb400b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44266/0 (socket says 172.21.15.77:44266) 2023-11-26T07:24:51.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.530+0000 7fdb44d1f640 1 -- 172.21.15.77:0/1386991467 learned_addr learned my addr 172.21.15.77:0/1386991467 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:51.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.530+0000 7fdb44d1f640 1 -- 172.21.15.77:0/1386991467 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400b36f0 msgr2=0x7fdb400ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.530+0000 7fdb44d1f640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400b36f0 0x7fdb400ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.530+0000 7fdb44d1f640 1 -- 172.21.15.77:0/1386991467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb4015ba40 msgr2=0x7fdb400ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.530+0000 7fdb44d1f640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb4015ba40 0x7fdb400ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.530+0000 7fdb44d1f640 1 -- 172.21.15.77:0/1386991467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb400b4170 con 0x7fdb2c0039a0 2023-11-26T07:24:51.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.530+0000 7fdb44d1f640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 0x7fdb400b31b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fdb3002bf90 tx=0x7fdb300014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:51.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.531+0000 7fdb3d7fa640 1 -- 172.21.15.77:0/1386991467 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3003e070 con 0x7fdb2c0039a0 2023-11-26T07:24:51.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.531+0000 7fdb3d7fa640 1 -- 172.21.15.77:0/1386991467 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb30006b50 con 0x7fdb2c0039a0 2023-11-26T07:24:51.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.531+0000 7fdb3d7fa640 1 -- 172.21.15.77:0/1386991467 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30007030 con 0x7fdb2c0039a0 2023-11-26T07:24:51.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.531+0000 7fdb46f83640 1 -- 172.21.15.77:0/1386991467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb400b4450 con 0x7fdb2c0039a0 2023-11-26T07:24:51.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.531+0000 7fdb46f83640 1 -- 172.21.15.77:0/1386991467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb40156f10 con 0x7fdb2c0039a0 2023-11-26T07:24:51.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.532+0000 7fdb46f83640 1 -- 172.21.15.77:0/1386991467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4004e8b0 con 0x7fdb2c0039a0 2023-11-26T07:24:51.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.533+0000 7fdb3d7fa640 1 -- 172.21.15.77:0/1386991467 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fdb30007190 con 0x7fdb2c0039a0 2023-11-26T07:24:51.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.534+0000 7fdb3d7fa640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2006b8f0 0x7fdb2006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.534+0000 7fdb3d7fa640 1 -- 172.21.15.77:0/1386991467 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdb300a9b80 con 0x7fdb2c0039a0 2023-11-26T07:24:51.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.534+0000 7fdb3ffff640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2006b8f0 0x7fdb2006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.535+0000 7fdb3ffff640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2006b8f0 0x7fdb2006ddb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdb400c90c0 tx=0x7fdb28008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:51.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.538+0000 7fdb3d7fa640 1 -- 172.21.15.77:0/1386991467 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb30076680 con 0x7fdb2c0039a0 2023-11-26T07:24:51.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.726+0000 7fdb46f83640 1 -- 172.21.15.77:0/1386991467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fdb4015c0b0 con 0x7fdb2c0039a0 2023-11-26T07:24:51.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.733+0000 7fdb3d7fa640 1 -- 172.21.15.77:0/1386991467 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v26)=0 v26) v1 ==== 123+0+0 (secure 0 0 0) 0x7fdb30079ca0 con 0x7fdb2c0039a0 2023-11-26T07:24:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.735+0000 7fdb3d7fa640 1 -- 172.21.15.77:0/1386991467 <== mon.0 v2:172.21.15.77:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdb30076680 con 0x7fdb2c0039a0 2023-11-26T07:24:51.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.737+0000 7fdb46f83640 1 -- 172.21.15.77:0/1386991467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2006b8f0 msgr2=0x7fdb2006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.737+0000 7fdb46f83640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2006b8f0 0x7fdb2006ddb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdb400c90c0 tx=0x7fdb28008040 comp rx=0 tx=0).stop 2023-11-26T07:24:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.737+0000 7fdb46f83640 1 -- 172.21.15.77:0/1386991467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 msgr2=0x7fdb400b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.737+0000 7fdb46f83640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 0x7fdb400b31b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fdb3002bf90 tx=0x7fdb300014a0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.738+0000 7fdb46f83640 1 -- 172.21.15.77:0/1386991467 shutdown_connections 2023-11-26T07:24:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.738+0000 7fdb46f83640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7fdb2006b8f0 0x7fdb2006ddb0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.738+0000 7fdb46f83640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb4015ba40 0x7fdb400ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.738+0000 7fdb46f83640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb400b36f0 0x7fdb400ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.738+0000 7fdb46f83640 1 --2- 172.21.15.77:0/1386991467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb2c0039a0 0x7fdb400b31b0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.738+0000 7fdb46f83640 1 -- 172.21.15.77:0/1386991467 >> 172.21.15.77:0/1386991467 conn(0x7fdb400b0c50 msgr2=0x7fdb400ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.738+0000 7fdb46f83640 1 -- 172.21.15.77:0/1386991467 shutdown_connections 2023-11-26T07:24:51.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.738+0000 7fdb46f83640 1 -- 172.21.15.77:0/1386991467 wait complete. 2023-11-26T07:24:51.760 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:24:51.760 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:24:51.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.964+0000 7f8815244640 1 Processor -- start 2023-11-26T07:24:51.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.965+0000 7f8815244640 1 -- start start 2023-11-26T07:24:51.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.966+0000 7f8815244640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88100cfb60 0x7f88100abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.966+0000 7f8815244640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88100ce270 con 0x7f88100cc470 2023-11-26T07:24:51.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.966+0000 7f8815244640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881006d0a0 con 0x7f88100ce640 2023-11-26T07:24:51.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.966+0000 7f8815244640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881006c560 con 0x7f88100cfb60 2023-11-26T07:24:51.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.967+0000 7f880ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f88100cc470 0x7f88100cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35624/0 (socket says 172.21.15.77:35624) 2023-11-26T07:24:51.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.967+0000 7f880ed9d640 1 -- 172.21.15.77:0/2150841346 learned_addr learned my addr 172.21.15.77:0/2150841346 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-26T07:24:51.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.967+0000 7f8807fff640 1 --2- 172.21.15.77:0/2150841346 >> v2:172.21.15.77:3300/0 conn(0x7f88100cfb60 0x7f88100abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.967+0000 7f8807fff640 1 -- 172.21.15.77:0/2150841346 >> v1:172.21.15.159:6789/0 conn(0x7f88100ce640 legacy=0x7f881006d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:51.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.967+0000 7f8807fff640 1 -- 172.21.15.77:0/2150841346 >> v1:172.21.15.77:6789/0 conn(0x7f88100cc470 legacy=0x7f88100cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.967+0000 7f8807fff640 1 -- 172.21.15.77:0/2150841346 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881006c770 con 0x7f88100cfb60 2023-11-26T07:24:51.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.968+0000 7f8807fff640 1 --2- 172.21.15.77:0/2150841346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88100cfb60 0x7f88100abfc0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097a0 tx=0x7f87f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8949a0a05c7ce843 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:51.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.969+0000 7f880e59c640 1 -- 172.21.15.77:0/2150841346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8031830 con 0x7f88100cfb60 2023-11-26T07:24:51.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.969+0000 7f880e59c640 1 -- 172.21.15.77:0/2150841346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f87f8031990 con 0x7f88100cfb60 2023-11-26T07:24:51.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.969+0000 7f880e59c640 1 -- 172.21.15.77:0/2150841346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8031d40 con 0x7f88100cfb60 2023-11-26T07:24:51.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.969+0000 7f8815244640 1 -- 172.21.15.77:0/2150841346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88100cfb60 msgr2=0x7f88100abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.969+0000 7f8815244640 1 --2- 172.21.15.77:0/2150841346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88100cfb60 0x7f88100abfc0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097a0 tx=0x7f87f802b8d0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.969+0000 7f8815244640 1 -- 172.21.15.77:0/2150841346 shutdown_connections 2023-11-26T07:24:51.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.969+0000 7f8815244640 1 --2- 172.21.15.77:0/2150841346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88100cfb60 0x7f88100abfc0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.969+0000 7f8815244640 1 -- 172.21.15.77:0/2150841346 >> 172.21.15.77:0/2150841346 conn(0x7f881006a920 msgr2=0x7f881006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.970+0000 7f8815244640 1 -- 172.21.15.77:0/2150841346 shutdown_connections 2023-11-26T07:24:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.970+0000 7f8815244640 1 -- 172.21.15.77:0/2150841346 wait complete. 2023-11-26T07:24:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.971+0000 7f8815244640 1 Processor -- start 2023-11-26T07:24:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.971+0000 7f8815244640 1 -- start start 2023-11-26T07:24:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.972+0000 7f8815244640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88100cc470 0x7f8810163b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.972+0000 7f8815244640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88100ce640 0x7f8810162100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.972+0000 7f8815244640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f88100cfb60 0x7f8810162640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.972+0000 7f8815244640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881015f8d0 con 0x7f88100cc470 2023-11-26T07:24:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.972+0000 7f8815244640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8810164ac0 con 0x7f88100ce640 2023-11-26T07:24:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.972+0000 7f8815244640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88100937e0 con 0x7f88100cfb60 2023-11-26T07:24:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.973+0000 7f880ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88100cc470 0x7f8810163b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.973+0000 7f880ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88100cc470 0x7f8810163b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44272/0 (socket says 172.21.15.77:44272) 2023-11-26T07:24:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.973+0000 7f880ed9d640 1 -- 172.21.15.77:0/1205920043 learned_addr learned my addr 172.21.15.77:0/1205920043 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-26T07:24:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.973+0000 7f8807fff640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88100ce640 0x7f8810162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.973+0000 7f880ed9d640 1 -- 172.21.15.77:0/1205920043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f88100cfb60 msgr2=0x7f8810162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.973+0000 7f880ed9d640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f88100cfb60 0x7f8810162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.973+0000 7f880ed9d640 1 -- 172.21.15.77:0/1205920043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88100ce640 msgr2=0x7f8810162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.973+0000 7f880ed9d640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88100ce640 0x7f8810162100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.973+0000 7f880ed9d640 1 -- 172.21.15.77:0/1205920043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8009400 con 0x7f88100cc470 2023-11-26T07:24:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.973+0000 7f880ed9d640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88100cc470 0x7f8810163b20 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f880000c4a0 tx=0x7f880000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.974+0000 7f88077fe640 1 -- 172.21.15.77:0/1205920043 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800005ce0 con 0x7f88100cc470 2023-11-26T07:24:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.974+0000 7f88077fe640 1 -- 172.21.15.77:0/1205920043 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8800005e40 con 0x7f88100cc470 2023-11-26T07:24:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.974+0000 7f88077fe640 1 -- 172.21.15.77:0/1205920043 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800007290 con 0x7f88100cc470 2023-11-26T07:24:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.974+0000 7f8815244640 1 -- 172.21.15.77:0/1205920043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8810099bd0 con 0x7f88100cc470 2023-11-26T07:24:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.974+0000 7f8815244640 1 -- 172.21.15.77:0/1205920043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881009a190 con 0x7f88100cc470 2023-11-26T07:24:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.975+0000 7f8815244640 1 -- 172.21.15.77:0/1205920043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88100b3c70 con 0x7f88100cc470 2023-11-26T07:24:51.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.976+0000 7f88077fe640 1 -- 172.21.15.77:0/1205920043 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f88000074b0 con 0x7f88100cc470 2023-11-26T07:24:51.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.977+0000 7f88077fe640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f87f006b8f0 0x7f87f006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:51.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.977+0000 7f88077fe640 1 -- 172.21.15.77:0/1205920043 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8800087800 con 0x7f88100cc470 2023-11-26T07:24:51.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.977+0000 7f8807fff640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f87f006b8f0 0x7f87f006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:51.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.978+0000 7f8807fff640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f87f006b8f0 0x7f87f006ddb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f87f8036000 tx=0x7f87f8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:51.981+0000 7f88077fe640 1 -- 172.21.15.77:0/1205920043 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8800054040 con 0x7f88100cc470 2023-11-26T07:24:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.194+0000 7f8815244640 1 -- 172.21.15.77:0/1205920043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8810067470 con 0x7f88100cc470 2023-11-26T07:24:52.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.195+0000 7f88077fe640 1 -- 172.21.15.77:0/1205920043 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f8800017e80 con 0x7f88100cc470 2023-11-26T07:24:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-26T07:24:52.197 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":47,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/277058454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":277058454},{"type":"v1","addr":"172.21.15.159:6835","nonce":277058454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4120615192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4120615192},{"type":"v1","addr":"172.21.15.77:6835","nonce":4120615192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/52209425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":52209425},{"type":"v1","addr":"172.21.15.159:6834","nonce":52209425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2317138548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2317138548},{"type":"v1","addr":"172.21.15.77:6837","nonce":2317138548}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[]} 2023-11-26T07:24:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 47 2023-11-26T07:24:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.197+0000 7f8815244640 1 -- 172.21.15.77:0/1205920043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f87f006b8f0 msgr2=0x7f87f006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.197+0000 7f8815244640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f87f006b8f0 0x7f87f006ddb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f87f8036000 tx=0x7f87f8008030 comp rx=0 tx=0).stop 2023-11-26T07:24:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.197+0000 7f8815244640 1 -- 172.21.15.77:0/1205920043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88100cc470 msgr2=0x7f8810163b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.197+0000 7f8815244640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88100cc470 0x7f8810163b20 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f880000c4a0 tx=0x7f880000c960 comp rx=0 tx=0).stop 2023-11-26T07:24:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.198+0000 7f8815244640 1 -- 172.21.15.77:0/1205920043 shutdown_connections 2023-11-26T07:24:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.198+0000 7f8815244640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.77:6832/2342497679,v1:172.21.15.77:6833/2342497679] conn(0x7f87f006b8f0 0x7f87f006ddb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.198+0000 7f8815244640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f88100cfb60 0x7f8810162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.198+0000 7f8815244640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88100ce640 0x7f8810162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.198+0000 7f8815244640 1 --2- 172.21.15.77:0/1205920043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88100cc470 0x7f8810163b20 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.198+0000 7f8815244640 1 -- 172.21.15.77:0/1205920043 >> 172.21.15.77:0/1205920043 conn(0x7f881006a920 msgr2=0x7f88100ad1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.198+0000 7f8815244640 1 -- 172.21.15.77:0/1205920043 shutdown_connections 2023-11-26T07:24:52.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-26T07:24:52.198+0000 7f8815244640 1 -- 172.21.15.77:0/1205920043 wait complete. 2023-11-26T07:24:52.219 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-26T07:24:52.219 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-26T07:24:52.219 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:24:52.219 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.233 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:24:52.233 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:24:52.233 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.299 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:24:52.300 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:24:52.300 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.320 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:24:52.321 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:24:52.321 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.392 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:24:52.393 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-26T07:24:52.393 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-26T07:24:52.393 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.472 INFO:tasks.ceph.osd.0:Stopped 2023-11-26T07:24:52.472 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-26T07:24:52.472 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.537 INFO:tasks.ceph.osd.1:Stopped 2023-11-26T07:24:52.537 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-26T07:24:52.537 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.614 INFO:tasks.ceph.osd.2:Stopped 2023-11-26T07:24:52.614 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-26T07:24:52.614 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.679 INFO:tasks.ceph.osd.3:Stopped 2023-11-26T07:24:52.679 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-26T07:24:52.679 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.769 INFO:tasks.ceph.osd.4:Stopped 2023-11-26T07:24:52.769 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-26T07:24:52.769 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.827 INFO:tasks.ceph.osd.5:Stopped 2023-11-26T07:24:52.827 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-26T07:24:52.828 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.887 INFO:tasks.ceph.osd.6:Stopped 2023-11-26T07:24:52.887 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-26T07:24:52.887 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:52.967 INFO:tasks.ceph.osd.7:Stopped 2023-11-26T07:24:52.967 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-26T07:24:52.968 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-26T07:24:52.968 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:56.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-11-26T07:24:58.617 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:58.627 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:59.069 INFO:tasks.ceph.mgr.y:Stopped 2023-11-26T07:24:59.070 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-26T07:24:59.070 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:59.161 INFO:tasks.ceph.mgr.x:Stopped 2023-11-26T07:24:59.161 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-26T07:24:59.162 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-26T07:24:59.162 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:59.198 INFO:tasks.ceph.mon.a:Stopped 2023-11-26T07:24:59.198 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-26T07:24:59.198 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:59.225 INFO:tasks.ceph.mon.b:Stopped 2023-11-26T07:24:59.226 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-26T07:24:59.226 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:59.297 INFO:tasks.ceph.mon.c:Stopped 2023-11-26T07:24:59.298 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-26T07:24:59.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-26T07:24:59.412 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:24:59.412 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-26T07:24:59.636 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:24:59.636 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-26T07:24:59.793 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:24:59.794 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-26T07:24:59.956 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:24:59.957 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-26T07:25:00.122 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:25:00.123 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-26T07:25:00.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:25:00.373 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-26T07:25:00.529 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:25:00.530 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-26T07:25:00.694 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:25:00.695 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-26T07:25:00.853 INFO:tasks.ceph:Archiving mon data... 2023-11-26T07:25:00.855 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351/data/mon.a.tgz 2023-11-26T07:25:00.855 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2023-11-26T07:25:00.914 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.uAXgaWFg3H 2023-11-26T07:25:00.914 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.uAXgaWFg3H 2023-11-26T07:25:01.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.uAXgaWFg3H 2023-11-26T07:25:01.313 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.uAXgaWFg3H is 713KB 2023-11-26T07:25:01.423 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.uAXgaWFg3H 2023-11-26T07:25:01.482 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351/data/mon.b.tgz 2023-11-26T07:25:01.482 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2023-11-26T07:25:01.542 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.NovyjHLT3n 2023-11-26T07:25:01.542 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.NovyjHLT3n 2023-11-26T07:25:01.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-11-26T07:25:01.792 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.NovyjHLT3n 2023-11-26T07:25:01.946 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.NovyjHLT3n is 717KB 2023-11-26T07:25:02.063 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.NovyjHLT3n 2023-11-26T07:25:02.121 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351/data/mon.c.tgz 2023-11-26T07:25:02.121 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2023-11-26T07:25:02.173 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.FMk2QutF5n 2023-11-26T07:25:02.174 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.FMk2QutF5n 2023-11-26T07:25:02.407 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.FMk2QutF5n 2023-11-26T07:25:02.564 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.FMk2QutF5n is 717KB 2023-11-26T07:25:02.677 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.FMk2QutF5n 2023-11-26T07:25:02.737 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-26T07:25:02.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-26T07:25:02.746 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-26T07:25:02.842 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-26T07:25:02.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-26T07:25:02.849 DEBUG:teuthology.orchestra.run.smithi159:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-26T07:25:02.946 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-26T07:25:02.954 INFO:teuthology.orchestra.run.smithi159.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-26T07:25:02.965 INFO:tasks.ceph:Archiving crash dumps... 2023-11-26T07:25:02.967 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351/remote/smithi077/crash 2023-11-26T07:25:02.968 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-26T07:25:03.047 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351/remote/smithi159/crash 2023-11-26T07:25:03.048 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-26T07:25:03.149 INFO:tasks.ceph:Shutting down logrotate 2023-11-26T07:25:03.149 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:25:03.157 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:25:03.289 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-26T07:25:03.387 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-26T07:25:03.489 INFO:tasks.ceph:Compressing logs... 2023-11-26T07:25:03.490 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-26T07:25:03.499 DEBUG:teuthology.orchestra.run.smithi159:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-26T07:25:03.589 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121045.log 2023-11-26T07:25:03.590 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96057.log 2023-11-26T07:25:03.590 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129374.log 2023-11-26T07:25:03.591 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-26T07:25:03.592 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142095.log 2023-11-26T07:25:03.592 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121045.log.gz 2023-11-26T07:25:03.593 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95531.log 2023-11-26T07:25:03.593 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129374.log.gz 2023-11-26T07:25:03.594 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.1.96057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.96057.log.gz 2023-11-26T07:25:03.594 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96575.log 2023-11-26T07:25:03.594 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95027.log 2023-11-26T07:25:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142095.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142095.log.gzgzip 2023-11-26T07:25:03.596 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.131426.log 2023-11-26T07:25:03.596 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122532.log 2023-11-26T07:25:03.596 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95531.log.gz 2023-11-26T07:25:03.596 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.1.96575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.96575.log.gz 2023-11-26T07:25:03.596 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88353.log 2023-11-26T07:25:03.597 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.1.95027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95027.log.gz 2023-11-26T07:25:03.597 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95559.log 2023-11-26T07:25:03.599 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95551.log 2023-11-26T07:25:03.599 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131426.log.gz 2023-11-26T07:25:03.599 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122532.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122532.log.gz 2023-11-26T07:25:03.599 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131345.log 2023-11-26T07:25:03.599 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.88353.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88353.log.gz 2023-11-26T07:25:03.599 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94405.log 2023-11-26T07:25:03.599 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.1.95559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95559.log.gz 2023-11-26T07:25:03.600 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96579.log 2023-11-26T07:25:03.600 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.3.94405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.94405.log.gz 2023-11-26T07:25:03.601 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-26T07:25:03.601 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.1.96579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.96579.log.gz 2023-11-26T07:25:03.602 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-26T07:25:03.602 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95551.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95551.log.gz 2023-11-26T07:25:03.602 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102133.log 2023-11-26T07:25:03.603 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129947.log 2023-11-26T07:25:03.603 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.131345.log.gz 2023-11-26T07:25:03.603 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.102133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142377.log 2023-11-26T07:25:03.603 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102133.log.gz 2023-11-26T07:25:03.605 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120690.log 2023-11-26T07:25:03.605 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129947.log.gz 2023-11-26T07:25:03.605 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142377.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142377.log.gz 2023-11-26T07:25:03.605 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109855.log 2023-11-26T07:25:03.606 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88553.log 2023-11-26T07:25:03.606 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88433.log 2023-11-26T07:25:03.606 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.88553.log: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-26T07:25:03.606 INFO:teuthology.orchestra.run.smithi159.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88553.log.gz 2023-11-26T07:25:03.607 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95023.log 2023-11-26T07:25:03.607 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.88433.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-26T07:25:03.608 INFO:teuthology.orchestra.run.smithi159.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88433.log.gz 2023-11-26T07:25:03.608 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.1.95023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95023.log.gz 2023-11-26T07:25:03.608 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-26T07:25:03.610 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120690.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-26T07:25:03.610 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120690.log.gz 2023-11-26T07:25:03.610 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121385.log 2023-11-26T07:25:03.610 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109855.log.gz 2023-11-26T07:25:03.610 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96209.log 2023-11-26T07:25:03.610 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121385.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.121385.log.gz 2023-11-26T07:25:03.610 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96293.log 2023-11-26T07:25:03.611 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131511.log 2023-11-26T07:25:03.611 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96209.log.gz 2023-11-26T07:25:03.613 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-26T07:25:03.613 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88313.log 2023-11-26T07:25:03.613 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88473.log 2023-11-26T07:25:03.613 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96293.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96293.log.gz 2023-11-26T07:25:03.614 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96419.log 2023-11-26T07:25:03.614 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95534.log 2023-11-26T07:25:03.614 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.131511.log.gz 2023-11-26T07:25:03.614 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96419.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96419.log.gz 2023-11-26T07:25:03.614 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101349.log 2023-11-26T07:25:03.616 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109144.log 2023-11-26T07:25:03.616 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95534.log.gz 2023-11-26T07:25:03.616 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96251.log 2023-11-26T07:25:03.616 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101349.log.gz 2023-11-26T07:25:03.617 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.88313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88393.log 2023-11-26T07:25:03.617 INFO:teuthology.orchestra.run.smithi159.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88313.log.gz 2023-11-26T07:25:03.617 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.88473.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-26T07:25:03.617 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.88473.log.gz 2023-11-26T07:25:03.618 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109144.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109144.log.gz 2023-11-26T07:25:03.618 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99753.log 2023-11-26T07:25:03.618 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100713.log 2023-11-26T07:25:03.619 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96251.log.gz 2023-11-26T07:25:03.620 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.88393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95563.log 2023-11-26T07:25:03.620 INFO:teuthology.orchestra.run.smithi159.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88393.log.gz 2023-11-26T07:25:03.620 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94401.log 2023-11-26T07:25:03.620 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99753.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99753.log.gz 2023-11-26T07:25:03.621 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100881.log 2023-11-26T07:25:03.621 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98454.log 2023-11-26T07:25:03.621 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100713.log.gz 2023-11-26T07:25:03.623 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.1.95563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95563.log.gz 2023-11-26T07:25:03.623 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.3.94401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.94401.log.gz 2023-11-26T07:25:03.623 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-26T07:25:03.623 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100881.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100881.log.gz 2023-11-26T07:25:03.624 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94655.log 2023-11-26T07:25:03.624 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100671.log 2023-11-26T07:25:03.624 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98454.log.gz 2023-11-26T07:25:03.624 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94655.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94655.log.gz 2023-11-26T07:25:03.624 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98706.log 2023-11-26T07:25:03.625 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100671.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100671.log.gz -5 2023-11-26T07:25:03.625 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94314.log 2023-11-26T07:25:03.626 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94003.log 2023-11-26T07:25:03.627 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98706.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98706.log.gz 2023-11-26T07:25:03.627 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140919.log 2023-11-26T07:25:03.629 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94314.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94314.log.gz 2023-11-26T07:25:03.629 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110975.log 2023-11-26T07:25:03.629 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100587.log 2023-11-26T07:25:03.629 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140919.log.gz 2023-11-26T07:25:03.630 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.1.94003.log: gzip -5 --verbose 93.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-26T07:25:03.630 INFO:teuthology.orchestra.run.smithi159.stderr: -- /var/log/ceph/ceph-mon.b.log 2023-11-26T07:25:03.630 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94003.log.gz 2023-11-26T07:25:03.630 INFO:teuthology.orchestra.run.smithi159.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-26T07:25:03.631 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94012.log 2023-11-26T07:25:03.631 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88273.log 2023-11-26T07:25:03.633 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110975.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110975.log.gz 2023-11-26T07:25:03.633 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110165.log 2023-11-26T07:25:03.633 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98622.log 2023-11-26T07:25:03.633 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100587.log.gz 2023-11-26T07:25:03.633 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110165.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.110165.log.gz 2023-11-26T07:25:03.633 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.131904.log 2023-11-26T07:25:03.633 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99027.log 2023-11-26T07:25:03.633 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98622.log.gz 2023-11-26T07:25:03.636 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131904.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.131904.log.gz 2023-11-26T07:25:03.636 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98901.log 2023-11-26T07:25:03.636 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110249.log 2023-11-26T07:25:03.636 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99027.log.gz 2023-11-26T07:25:03.636 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110880.log 2023-11-26T07:25:03.636 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98901.log.gz 2023-11-26T07:25:03.637 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.1.94012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94012.log.gz 2023-11-26T07:25:03.637 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.88273.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88273.log.gz 2023-11-26T07:25:03.637 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-26T07:25:03.637 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88513.log 2023-11-26T07:25:03.638 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100965.log 2023-11-26T07:25:03.638 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110249.log.gz 2023-11-26T07:25:03.638 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110880.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.110880.log.gz --verbose 2023-11-26T07:25:03.638 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.130587.log 2023-11-26T07:25:03.640 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-client.admin.88513.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88513.log.gz 2023-11-26T07:25:03.640 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-26T07:25:03.640 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110123.log 2023-11-26T07:25:03.641 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100965.log.gz 2023-11-26T07:25:03.641 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110796.log 2023-11-26T07:25:03.641 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130587.log.gz 2023-11-26T07:25:03.642 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96061.log 2023-11-26T07:25:03.643 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98412.log 2023-11-26T07:25:03.643 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110123.log.gz 2023-11-26T07:25:03.644 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110796.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110796.log.gz 2023-11-26T07:25:03.644 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94571.log 2023-11-26T07:25:03.644 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120378.log 2023-11-26T07:25:03.644 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98412.log.gz 2023-11-26T07:25:03.645 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130235.log 89.0% 2023-11-26T07:25:03.645 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94571.log.gz 2023-11-26T07:25:03.646 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96461.log 2023-11-26T07:25:03.646 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120378.log.gz 2023-11-26T07:25:03.647 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130235.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.130235.log.gz 2023-11-26T07:25:03.647 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139786.log 2023-11-26T07:25:03.648 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98985.log 2023-11-26T07:25:03.648 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96461.log.gz 2023-11-26T07:25:03.648 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139786.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139786.log.gz 2023-11-26T07:25:03.649 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121642.log 2023-11-26T07:25:03.650 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.1.96061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.96061.log.gz 2023-11-26T07:25:03.650 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109591.log 2023-11-26T07:25:03.651 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98985.log.gz 2023-11-26T07:25:03.651 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140278.log 2023-11-26T07:25:03.652 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121642.log.gz 2023-11-26T07:25:03.652 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109591.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.109591.log.gz 2023-11-26T07:25:03.652 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.140056.log 2023-11-26T07:25:03.653 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130419.log 2023-11-26T07:25:03.654 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140278.log.gz 2023-11-26T07:25:03.655 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110754.log 2023-11-26T07:25:03.655 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140056.log.gz 2023-11-26T07:25:03.656 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121003.log 2023-11-26T07:25:03.656 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130419.log.gz 2023-11-26T07:25:03.657 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96545.log 2023-11-26T07:25:03.657 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110754.log.gz 2023-11-26T07:25:03.658 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100299.log 2023-11-26T07:25:03.658 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121003.log.gz 2023-11-26T07:25:03.659 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96545.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96545.log.gz 2023-11-26T07:25:03.659 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122616.log 2023-11-26T07:25:03.660 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139534.log 2023-11-26T07:25:03.660 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100299.log.gz 2023-11-26T07:25:03.661 INFO:teuthology.orchestra.run.smithi159.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-26T07:25:03.661 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99795.log 2023-11-26T07:25:03.662 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122616.log.gz 2023-11-26T07:25:03.662 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121988.log 2023-11-26T07:25:03.662 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139534.log.gz 2023-11-26T07:25:03.663 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97991.log 2023-11-26T07:25:03.664 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99795.log.gz 2023-11-26T07:25:03.665 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139702.log 2023-11-26T07:25:03.665 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121988.log.gz 2023-11-26T07:25:03.666 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.97991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141233.log 2023-11-26T07:25:03.666 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97991.log.gz 2023-11-26T07:25:03.667 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120742.log 2023-11-26T07:25:03.667 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139702.log.gz 2023-11-26T07:25:03.668 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141233.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.141233.log.gz --verbose 2023-11-26T07:25:03.668 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.102091.log 2023-11-26T07:25:03.669 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122180.log 2023-11-26T07:25:03.669 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120742.log.gz 2023-11-26T07:25:03.670 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.102091.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102091.log.gz 2023-11-26T07:25:03.670 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94823.log 2023-11-26T07:25:03.671 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121129.log 2023-11-26T07:25:03.671 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122180.log.gz 2023-11-26T07:25:03.672 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130067.log 2023-11-26T07:25:03.673 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94823.log.gz 2023-11-26T07:25:03.673 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121129.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121129.log.gz 2023-11-26T07:25:03.674 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112199.log 2023-11-26T07:25:03.675 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96125.log 2023-11-26T07:25:03.675 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130067.log.gz 2023-11-26T07:25:03.676 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.112199.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112199.log.gz 2023-11-26T07:25:03.677 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120546.log 2023-11-26T07:25:03.678 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129332.log 2023-11-26T07:25:03.678 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96125.log.gz 2023-11-26T07:25:03.679 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98370.log 2023-11-26T07:25:03.679 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120546.log.gz 2023-11-26T07:25:03.680 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129332.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129332.log.gz 2023-11-26T07:25:03.680 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142138.log 2023-11-26T07:25:03.681 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99921.log 2023-11-26T07:25:03.681 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98370.log.gz 2023-11-26T07:25:03.682 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88386.log 2023-11-26T07:25:03.682 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142138.log.gz 2023-11-26T07:25:03.683 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99921.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99921.log.gz 2023-11-26T07:25:03.684 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109228.log 2023-11-26T07:25:03.685 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.88386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95549.log 2023-11-26T07:25:03.685 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88386.log.gz 2023-11-26T07:25:03.686 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109228.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109228.log.gz 2023-11-26T07:25:03.686 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129596.log 2023-11-26T07:25:03.687 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131468.log 2023-11-26T07:25:03.687 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95549.log.gz 2023-11-26T07:25:03.688 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129596.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129596.log.gz 2023-11-26T07:25:03.688 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119822.log 2023-11-26T07:25:03.689 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131468.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131468.log.gz 2023-11-26T07:25:03.689 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95033.log 2023-11-26T07:25:03.691 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129428.log 2023-11-26T07:25:03.691 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.119822.log.gz 2023-11-26T07:25:03.691 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95033.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95033.log.gz -5 2023-11-26T07:25:03.692 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.109897.log 2023-11-26T07:25:03.692 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96167.log 2023-11-26T07:25:03.693 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129428.log.gz 2023-11-26T07:25:03.694 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109897.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109897.log.gz 2023-11-26T07:25:03.694 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94399.log 2023-11-26T07:25:03.695 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109717.log 2023-11-26T07:25:03.695 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96167.log.gz 2023-11-26T07:25:03.696 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94399.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94399.log.gz 2023-11-26T07:25:03.696 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141087.log 2023-11-26T07:25:03.697 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97897.log 2023-11-26T07:25:03.698 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109717.log.gz 2023-11-26T07:25:03.699 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141087.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141087.log.gz 2023-11-26T07:25:03.699 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82046.log 2023-11-26T07:25:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.97897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141045.log 2023-11-26T07:25:03.700 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97897.log.gz 2023-11-26T07:25:03.701 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.tmp-client.admin.82046.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82046.log.gz 2023-11-26T07:25:03.701 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131775.log 2023-11-26T07:25:03.702 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110460.log 88.4% 2023-11-26T07:25:03.702 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141045.log.gz 2023-11-26T07:25:03.703 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95884.log 2023-11-26T07:25:03.703 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131775.log.gz 2023-11-26T07:25:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110460.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.110460.log.gz 2023-11-26T07:25:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141759.log 2023-11-26T07:25:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132222.log 2023-11-26T07:25:03.705 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95884.log.gz 2023-11-26T07:25:03.706 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141759.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.141759.log.gz 2023-11-26T07:25:03.706 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.101703.log 2023-11-26T07:25:03.707 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130900.log 2023-11-26T07:25:03.707 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.132222.log.gz 2023-11-26T07:25:03.708 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111739.log 2023-11-26T07:25:03.708 INFO:teuthology.orchestra.run.smithi077.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.101703.log.gz 2023-11-26T07:25:03.709 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130900.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130900.log.gz 2023-11-26T07:25:03.709 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131110.log 2023-11-26T07:25:03.710 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129863.log 2023-11-26T07:25:03.711 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111739.log.gz 2023-11-26T07:25:03.711 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131110.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.131110.log.gz 2023-11-26T07:25:03.712 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122072.log 2023-11-26T07:25:03.712 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119099.log 2023-11-26T07:25:03.713 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129863.log.gz 2023-11-26T07:25:03.713 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101559.log 2023-11-26T07:25:03.714 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122072.log.gz 2023-11-26T07:25:03.715 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139972.log 2023-11-26T07:25:03.715 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119099.log.gz 2023-11-26T07:25:03.716 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101559.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101559.log.gz 2023-11-26T07:25:03.716 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101265.log 2023-11-26T07:25:03.717 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139972.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139972.log.gz 2023-11-26T07:25:03.717 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121087.log 2023-11-26T07:25:03.718 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132574.log 2023-11-26T07:25:03.718 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101265.log.gz 2023-11-26T07:25:03.719 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111263.log 2023-11-26T07:25:03.719 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121087.log.gz 2023-11-26T07:25:03.720 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99963.log 2023-11-26T07:25:03.720 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.132574.log.gz 2023-11-26T07:25:03.721 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111263.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.111263.log.gz 2023-11-26T07:25:03.721 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.99189.log 2023-11-26T07:25:03.722 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132658.log 2023-11-26T07:25:03.722 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99963.log.gz 2023-11-26T07:25:03.723 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99189.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99189.log.gz 2023-11-26T07:25:03.723 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112259.log 2023-11-26T07:25:03.724 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109186.log 2023-11-26T07:25:03.724 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.132658.log.gz 2023-11-26T07:25:03.725 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.112259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132072.log 2023-11-26T07:25:03.725 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112259.log.gz 2023-11-26T07:25:03.726 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100629.log 2023-11-26T07:25:03.726 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109186.log.gz 2023-11-26T07:25:03.727 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132072.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.132072.log.gz -5 2023-11-26T07:25:03.728 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.109270.log 2023-11-26T07:25:03.728 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100629.log: gzip -5 87.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.100629.log.gz /var/log/ceph/ceph-client.admin.129692.log 2023-11-26T07:25:03.728 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-26T07:25:03.729 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95198.log 2023-11-26T07:25:03.730 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109270.log.gz 2023-11-26T07:25:03.730 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109939.log 2023-11-26T07:25:03.731 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129692.log.gz 2023-11-26T07:25:03.731 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95198.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95198.log.gz 2023-11-26T07:25:03.732 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100173.log 2023-11-26T07:25:03.733 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140792.log 2023-11-26T07:25:03.733 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109939.log.gz 2023-11-26T07:25:03.734 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100173.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100173.log.gz 2023-11-26T07:25:03.734 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120793.log 2023-11-26T07:25:03.735 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110712.log 2023-11-26T07:25:03.735 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140792.log.gz 2023-11-26T07:25:03.736 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110418.log 2023-11-26T07:25:03.736 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120793.log.gz 2023-11-26T07:25:03.737 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111221.log 2023-11-26T07:25:03.737 INFO:teuthology.orchestra.run.smithi077.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110712.log.gz 2023-11-26T07:25:03.738 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140835.log 2023-11-26T07:25:03.738 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110418.log.gz 2023-11-26T07:25:03.739 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111221.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111221.log.gz 2023-11-26T07:25:03.739 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119609.log 2023-11-26T07:25:03.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140835.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140835.log.gz 2023-11-26T07:25:03.740 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112118.log 2023-11-26T07:25:03.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119609.log: gzip -5 88.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.119609.log.gz -- 2023-11-26T07:25:03.741 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.139414.log 2023-11-26T07:25:03.742 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.112118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112118.log.gz 2023-11-26T07:25:03.742 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100131.log 2023-11-26T07:25:03.743 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121946.log 2023-11-26T07:25:03.743 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139414.log.gz 2023-11-26T07:25:03.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100131.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100131.log.gz 2023-11-26T07:25:03.744 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96503.log 2023-11-26T07:25:03.745 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98118.log 2023-11-26T07:25:03.745 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121946.log.gz 2023-11-26T07:25:03.746 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96503.log: gzip 89.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.96503.log.gz -- 2023-11-26T07:25:03.746 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.131026.log 2023-11-26T07:25:03.747 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120420.log 2023-11-26T07:25:03.747 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98118.log.gz 2023-11-26T07:25:03.748 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131026.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.131026.log.gz 2023-11-26T07:25:03.748 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94865.log 2023-11-26T07:25:03.749 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120026.log 2023-11-26T07:25:03.749 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120420.log.gz 2023-11-26T07:25:03.750 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111613.log 2023-11-26T07:25:03.750 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94865.log.gz 2023-11-26T07:25:03.751 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95885.log 2023-11-26T07:25:03.751 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120026.log.gz 2023-11-26T07:25:03.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130377.log 2023-11-26T07:25:03.752 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111613.log.gz 2023-11-26T07:25:03.753 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139618.log 2023-11-26T07:25:03.754 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95885.log.gz 2023-11-26T07:25:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130377.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130377.log.gz 2023-11-26T07:25:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93985.log 2023-11-26T07:25:03.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97812.log 2023-11-26T07:25:03.756 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139618.log.gz 2023-11-26T07:25:03.756 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.93985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99489.log 2023-11-26T07:25:03.757 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93985.log.gz 2023-11-26T07:25:03.758 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.97812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140666.log 2023-11-26T07:25:03.758 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97812.log.gz 2023-11-26T07:25:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99489.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99489.log.gz 2023-11-26T07:25:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95215.log 2023-11-26T07:25:03.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100047.log 2023-11-26T07:25:03.760 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140666.log.gz 2023-11-26T07:25:03.761 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130335.log 2023-11-26T07:25:03.761 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95215.log.gz 2023-11-26T07:25:03.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100047.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100047.log.gz 2023-11-26T07:25:03.762 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121734.log 2023-11-26T07:25:03.763 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121512.log 2023-11-26T07:25:03.763 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130335.log.gz 2023-11-26T07:25:03.764 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121734.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121734.log.gz 2023-11-26T07:25:03.764 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102038.log 2023-11-26T07:25:03.765 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101601.log 2023-11-26T07:25:03.765 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121512.log.gz 2023-11-26T07:25:03.766 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.102038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111931.log 2023-11-26T07:25:03.766 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102038.log.gz 2023-11-26T07:25:03.767 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121598.log 2023-11-26T07:25:03.768 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101601.log.gz 2023-11-26T07:25:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111931.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111931.log.gz 2023-11-26T07:25:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121862.log 2023-11-26T07:25:03.769 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121598.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-26T07:25:03.770 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121598.log.gz 2023-11-26T07:25:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140440.log 2023-11-26T07:25:03.771 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121862.log.gz 2023-11-26T07:25:03.771 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130109.log 2023-11-26T07:25:03.772 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131733.log 2023-11-26T07:25:03.773 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140440.log.gz 2023-11-26T07:25:03.773 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-26T07:25:03.774 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130109.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.130109.log.gz 2023-11-26T07:25:03.774 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96335.log 2023-11-26T07:25:03.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99363.log 2023-11-26T07:25:03.775 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131733.log.gz 2023-11-26T07:25:03.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96335.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96335.log.gz 2023-11-26T07:25:03.776 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94697.log 2023-11-26T07:25:03.777 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99363.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99363.log.gz 2023-11-26T07:25:03.777 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142544.log 2023-11-26T07:25:03.778 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94697.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94697.log.gz 2023-11-26T07:25:03.778 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111393.log 2023-11-26T07:25:03.779 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142544.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.142544.log.gz 2023-11-26T07:25:03.779 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94781.log 2023-11-26T07:25:03.781 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111393.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.111393.log.gz -5 2023-11-26T07:25:03.781 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.121904.log 2023-11-26T07:25:03.782 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98034.log 2023-11-26T07:25:03.782 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94781.log.gz 2023-11-26T07:25:03.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122114.log 2023-11-26T07:25:03.783 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121904.log.gz 2023-11-26T07:25:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140014.log 2023-11-26T07:25:03.784 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98034.log.gz 2023-11-26T07:25:03.785 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141633.log 2023-11-26T07:25:03.785 INFO:teuthology.orchestra.run.smithi077.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.122114.log.gz 2023-11-26T07:25:03.786 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140014.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140014.log.gz 2023-11-26T07:25:03.786 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131819.log 2023-11-26T07:25:03.787 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130461.log 2023-11-26T07:25:03.787 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141633.log.gz 2023-11-26T07:25:03.788 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131819.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.131819.log.gz 2023-11-26T07:25:03.788 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130151.log 2023-11-26T07:25:03.789 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.122371.log 2023-11-26T07:25:03.790 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130461.log.gz 2023-11-26T07:25:03.790 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101769.log 2023-11-26T07:25:03.791 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130151.log.gz 2023-11-26T07:25:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.122371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.122371.log.gz 2023-11-26T07:25:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112385.log 2023-11-26T07:25:03.793 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140961.log 2023-11-26T07:25:03.793 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101769.log.gz 2023-11-26T07:25:03.794 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.112385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130713.log 2023-11-26T07:25:03.794 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112385.log.gz 2023-11-26T07:25:03.795 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97947.log 2023-11-26T07:25:03.795 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140961.log.gz 2023-11-26T07:25:03.796 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95878.log 2023-11-26T07:25:03.796 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130713.log.gz 2023-11-26T07:25:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.97947.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97947.log.gz 2023-11-26T07:25:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139372.log 2023-11-26T07:25:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95878.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95878.log.gz 2023-11-26T07:25:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101517.log 2023-11-26T07:25:03.799 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99609.log 2023-11-26T07:25:03.799 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139372.log.gz 2023-11-26T07:25:03.800 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141549.log 2023-11-26T07:25:03.800 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101517.log.gz 2023-11-26T07:25:03.801 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99609.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99609.log.gz 2023-11-26T07:25:03.801 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130984.log 2023-11-26T07:25:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131683.log 2023-11-26T07:25:03.803 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141549.log.gz 2023-11-26T07:25:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130984.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130984.log.gz 2023-11-26T07:25:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96851.log 2023-11-26T07:25:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131683.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131683.log.gz 2023-11-26T07:25:03.805 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112122.log 2023-11-26T07:25:03.805 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121427.log 2023-11-26T07:25:03.806 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96851.log.gz 2023-11-26T07:25:03.806 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.112122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112122.log.gz 2023-11-26T07:25:03.807 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98538.log 2023-11-26T07:25:03.808 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121427.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121427.log.gz 2023-11-26T07:25:03.808 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119195.log 2023-11-26T07:25:03.809 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98538.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98538.log.gz 2023-11-26T07:25:03.809 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100463.log 2023-11-26T07:25:03.810 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119195.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119195.log.gz 2023-11-26T07:25:03.810 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110544.log 2023-11-26T07:25:03.811 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119261.log 2023-11-26T07:25:03.811 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100463.log.gz 2023-11-26T07:25:03.812 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94272.log 2023-11-26T07:25:03.812 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110544.log.gz 2023-11-26T07:25:03.813 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109981.log 2023-11-26T07:25:03.813 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119261.log.gz 2023-11-26T07:25:03.814 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100839.log 2023-11-26T07:25:03.814 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94272.log.gz 2023-11-26T07:25:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99147.log 2023-11-26T07:25:03.815 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109981.log.gz 2023-11-26T07:25:03.816 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111527.log 2023-11-26T07:25:03.816 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100839.log.gz 2023-11-26T07:25:03.817 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129905.log 2023-11-26T07:25:03.817 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99147.log.gz 2023-11-26T07:25:03.818 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97199.log 2023-11-26T07:25:03.818 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111527.log.gz 2023-11-26T07:25:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139930.log 2023-11-26T07:25:03.819 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129905.log.gz 2023-11-26T07:25:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.97199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97199.log.gz 2023-11-26T07:25:03.820 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131553.log 2023-11-26T07:25:03.821 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139930.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139930.log.gz 2023-11-26T07:25:03.821 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100545.log 2023-11-26T07:25:03.822 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94441.log 2023-11-26T07:25:03.822 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.131553.log.gz 2023-11-26T07:25:03.823 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95212.log 2023-11-26T07:25:03.823 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100545.log.gz 2023-11-26T07:25:03.824 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119651.log 2023-11-26T07:25:03.824 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94441.log.gz 2023-11-26T07:25:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95212.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95212.log.gzgzip 2023-11-26T07:25:03.825 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.141675.log 2023-11-26T07:25:03.826 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119651.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119651.log.gz 2023-11-26T07:25:03.826 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95887.log 2023-11-26T07:25:03.827 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95548.log 2023-11-26T07:25:03.827 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141675.log.gz 2023-11-26T07:25:03.828 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95887.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95887.log.gz 2023-11-26T07:25:03.828 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120462.log 2023-11-26T07:25:03.829 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95548.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95548.log.gz 2023-11-26T07:25:03.829 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131068.log 2023-11-26T07:25:03.830 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120462.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120462.log.gz 2023-11-26T07:25:03.830 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121554.log 2023-11-26T07:25:03.831 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119906.log 2023-11-26T07:25:03.831 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131068.log.gz 2023-11-26T07:25:03.832 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121554.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121554.log.gz 2023-11-26T07:25:03.832 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119471.log 2023-11-26T07:25:03.833 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131946.log 2023-11-26T07:25:03.833 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119906.log.gz 2023-11-26T07:25:03.834 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141801.log 2023-11-26T07:25:03.834 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119471.log.gz 2023-11-26T07:25:03.835 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98943.log 2023-11-26T07:25:03.835 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131946.log.gz 2023-11-26T07:25:03.836 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98202.log 2023-11-26T07:25:03.836 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141801.log.gz 2023-11-26T07:25:03.837 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111349.log 2023-11-26T07:25:03.837 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98943.log.gz 2023-11-26T07:25:03.838 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98202.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98202.log.gzgzip 2023-11-26T07:25:03.838 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95201.log 2023-11-26T07:25:03.839 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109675.log 2023-11-26T07:25:03.839 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111349.log.gz 2023-11-26T07:25:03.840 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111136.log 2023-11-26T07:25:03.840 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95201.log.gz 2023-11-26T07:25:03.841 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109675.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109675.log.gz 2023-11-26T07:25:03.841 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119141.log 2023-11-26T07:25:03.842 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122448.log 2023-11-26T07:25:03.843 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111136.log.gz 2023-11-26T07:25:03.844 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99711.log 2023-11-26T07:25:03.844 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119141.log.gz 2023-11-26T07:25:03.844 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122448.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122448.log.gz 2023-11-26T07:25:03.845 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120919.log 2023-11-26T07:25:03.846 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130816.log 2023-11-26T07:25:03.846 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99711.log.gz 2023-11-26T07:25:03.847 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120919.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120919.log.gz 2023-11-26T07:25:03.847 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111865.log 2023-11-26T07:25:03.848 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130816.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.130816.log.gz 2023-11-26T07:25:03.848 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140362.log 2023-11-26T07:25:03.849 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111865.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-26T07:25:03.850 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140362.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.111865.log.gz 2023-11-26T07:25:03.851 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101960.log 2023-11-26T07:25:03.851 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140362.log.gz 2023-11-26T07:25:03.852 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130193.log 2023-11-26T07:25:03.853 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.101960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101960.log.gz 2023-11-26T07:25:03.853 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131988.log 2023-11-26T07:25:03.854 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130193.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130193.log.gz 2023-11-26T07:25:03.855 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141129.log 2023-11-26T07:25:03.856 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131988.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.131988.log.gzgzip 2023-11-26T07:25:03.856 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.112343.log 2023-11-26T07:25:03.857 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141129.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141129.log.gz 2023-11-26T07:25:03.857 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142198.log 2023-11-26T07:25:03.858 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.112343.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112343.log.gz 2023-11-26T07:25:03.858 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95883.log 2023-11-26T07:25:03.859 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142198.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142198.log.gz 2023-11-26T07:25:03.860 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110670.log 2023-11-26T07:25:03.861 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95883.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95883.log.gz 2023-11-26T07:25:03.861 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98496.log 2023-11-26T07:25:03.862 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110670.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110670.log.gz 2023-11-26T07:25:03.862 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120294.log 2023-11-26T07:25:03.863 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98496.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.98496.log.gz 2023-11-26T07:25:03.863 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.142502.log 2023-11-26T07:25:03.864 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120294.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120294.log.gz 2023-11-26T07:25:03.864 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110039.log 2023-11-26T07:25:03.866 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110628.log 2023-11-26T07:25:03.866 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142502.log.gz 2023-11-26T07:25:03.867 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110039.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110039.log.gz 2023-11-26T07:25:03.867 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120110.log 2023-11-26T07:25:03.868 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110628.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110628.log.gz 2023-11-26T07:25:03.868 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121304.log 2023-11-26T07:25:03.869 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120110.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120110.log.gz 2023-11-26T07:25:03.869 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122030.log 2023-11-26T07:25:03.870 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121304.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121304.log.gz 2023-11-26T07:25:03.871 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111305.log 2023-11-26T07:25:03.871 INFO:teuthology.orchestra.run.smithi159.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-26T07:25:03.872 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122030.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122030.log.gz 2023-11-26T07:25:03.872 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94907.log 2023-11-26T07:25:03.873 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112439.log 2023-11-26T07:25:03.873 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111305.log.gz 2023-11-26T07:25:03.874 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94907.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94907.log.gz 2023-11-26T07:25:03.874 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111485.log 2023-11-26T07:25:03.876 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.112439.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112439.log.gz 2023-11-26T07:25:03.876 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120588.log 2023-11-26T07:25:03.876 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111485.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111485.log.gz 2023-11-26T07:25:03.877 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95213.log 2023-11-26T07:25:03.878 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120588.log: gzip -5 --verbose 89.0% -- -- replaced with /var/log/ceph/ceph-client.admin.120588.log.gz /var/log/ceph/ceph-client.admin.132156.log 2023-11-26T07:25:03.878 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-26T07:25:03.879 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95213.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95213.log.gz 2023-11-26T07:25:03.879 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98286.log 2023-11-26T07:25:03.880 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141317.log 2023-11-26T07:25:03.880 INFO:teuthology.orchestra.run.smithi077.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.132156.log.gz 2023-11-26T07:25:03.881 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98286.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98286.log.gz 2023-11-26T07:25:03.882 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99273.log 2023-11-26T07:25:03.882 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141317.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.141317.log.gz 2023-11-26T07:25:03.883 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94527.log 2023-11-26T07:25:03.884 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99273.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99273.log.gz 2023-11-26T07:25:03.884 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122670.log 2023-11-26T07:25:03.885 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102217.log 2023-11-26T07:25:03.885 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94527.log.gz 2023-11-26T07:25:03.886 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122670.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122670.log.gz 2023-11-26T07:25:03.886 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110376.log 2023-11-26T07:25:03.887 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.102217.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102217.log.gz 2023-11-26T07:25:03.887 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121470.log 2023-11-26T07:25:03.888 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110376.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110376.log.gz 2023-11-26T07:25:03.888 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119387.log 2023-11-26T07:25:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121470.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.121470.log.gz 2023-11-26T07:25:03.890 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.110586.log 2023-11-26T07:25:03.891 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119387.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119387.log.gz 2023-11-26T07:25:03.891 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112301.log 2023-11-26T07:25:03.891 INFO:teuthology.orchestra.run.smithi159.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-26T07:25:03.892 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110586.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110586.log.gz 2023-11-26T07:25:03.892 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120336.log 2023-11-26T07:25:03.893 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.112301.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112301.log.gz 2023-11-26T07:25:03.893 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100005.log 2023-11-26T07:25:03.894 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120336.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120336.log.gz 2023-11-26T07:25:03.894 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141275.log 2023-11-26T07:25:03.895 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100005.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100005.log.gz 2023-11-26T07:25:03.895 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120252.log 2023-11-26T07:25:03.897 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141275.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141275.log.gz 2023-11-26T07:25:03.897 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96587.log 2023-11-26T07:25:03.898 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120252.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120252.log.gz 2023-11-26T07:25:03.898 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94991.log 2023-11-26T07:25:03.899 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141969.log 2023-11-26T07:25:03.899 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96587.log.gz 2023-11-26T07:25:03.900 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94991.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94991.log.gz 2023-11-26T07:25:03.900 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139468.log 2023-11-26T07:25:03.901 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141969.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.141969.log.gz --verbose 2023-11-26T07:25:03.902 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.141359.log 2023-11-26T07:25:03.902 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139468.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139468.log.gz 2023-11-26T07:25:03.903 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99837.log 2023-11-26T07:25:03.904 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141359.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-26T07:25:03.905 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141359.log.gz 2023-11-26T07:25:03.905 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99837.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99837.log.gz 2023-11-26T07:25:03.905 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140877.log 2023-11-26T07:25:03.906 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142248.log 2023-11-26T07:25:03.908 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140877.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140877.log.gz 2023-11-26T07:25:03.908 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132030.log 2023-11-26T07:25:03.909 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142248.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142248.log.gz 2023-11-26T07:25:03.910 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98160.log 2023-11-26T07:25:03.911 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132030.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132030.log.gz 2023-11-26T07:25:03.911 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111178.log 2023-11-26T07:25:03.912 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88130.log 2023-11-26T07:25:03.913 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98160.log.gz 2023-11-26T07:25:03.914 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111178.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.111178.log.gz -5 2023-11-26T07:25:03.914 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.101391.log 2023-11-26T07:25:03.915 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.88130.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.88130.log.gz 2023-11-26T07:25:03.915 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122574.log 2023-11-26T07:25:03.917 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110207.log 2023-11-26T07:25:03.917 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122574.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101391.log.gz 2023-11-26T07:25:03.918 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122574.log.gz 2023-11-26T07:25:03.918 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130545.log 2023-11-26T07:25:03.919 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110207.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110207.log.gz 2023-11-26T07:25:03.919 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98859.log 2023-11-26T07:25:03.921 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130671.log 2023-11-26T07:25:03.921 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130545.log.gz 2023-11-26T07:25:03.922 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98859.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98859.log.gz 2023-11-26T07:25:03.922 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142011.log 2023-11-26T07:25:03.924 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130671.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.130671.log.gz 2023-11-26T07:25:03.924 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102273.log 2023-11-26T07:25:03.925 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142011.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142011.log.gz 2023-11-26T07:25:03.925 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101181.log 2023-11-26T07:25:03.926 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.102273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95835.log 2023-11-26T07:25:03.927 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102273.log.gz 2023-11-26T07:25:03.928 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101181.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101181.log.gz 2023-11-26T07:25:03.928 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141591.log 2023-11-26T07:25:03.929 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95835.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95835.log.gz 2023-11-26T07:25:03.930 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122490.log 2023-11-26T07:25:03.931 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141591.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141591.log.gz 2023-11-26T07:25:03.931 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97854.log 2023-11-26T07:25:03.932 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108975.log 2023-11-26T07:25:03.933 INFO:teuthology.orchestra.run.smithi077.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122490.log.gz 2023-11-26T07:25:03.933 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.97854.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97854.log.gz 2023-11-26T07:25:03.934 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96713.log 2023-11-26T07:25:03.935 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.108975.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108975.log.gz 2023-11-26T07:25:03.935 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99669.log 2023-11-26T07:25:03.936 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109549.log 2023-11-26T07:25:03.937 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99669.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.96713.log.gz 2023-11-26T07:25:03.938 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99669.log.gz 2023-11-26T07:25:03.938 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94095.log 2023-11-26T07:25:03.940 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109549.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109549.log.gz 2023-11-26T07:25:03.940 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98328.log 2023-11-26T07:25:03.941 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94095.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94095.log.gz 2023-11-26T07:25:03.941 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120504.log 2023-11-26T07:25:03.942 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98328.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98328.log.gz 2023-11-26T07:25:03.943 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141843.log 2023-11-26T07:25:03.944 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129650.log 2023-11-26T07:25:03.944 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120504.log.gz 2023-11-26T07:25:03.945 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141843.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141843.log.gz 2023-11-26T07:25:03.945 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142419.log 2023-11-26T07:25:03.946 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129650.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129650.log.gz 2023-11-26T07:25:03.947 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99447.log 2023-11-26T07:25:03.948 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111571.log 2023-11-26T07:25:03.948 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142419.log.gz 2023-11-26T07:25:03.949 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99447.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99447.log.gz 2023-11-26T07:25:03.950 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109102.log 2023-11-26T07:25:03.951 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111571.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111571.log.gz 2023-11-26T07:25:03.951 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101097.log 2023-11-26T07:25:03.953 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109102.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109102.log.gz 2023-11-26T07:25:03.953 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119345.log 2023-11-26T07:25:03.954 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101097.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.101097.log.gz -5 2023-11-26T07:25:03.954 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94949.log 2023-11-26T07:25:03.955 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119345.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119345.log.gz 2023-11-26T07:25:03.956 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109420.log 2023-11-26T07:25:03.957 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100215.log 2023-11-26T07:25:03.957 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94949.log.gz 2023-11-26T07:25:03.958 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109420.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109420.log.gz 2023-11-26T07:25:03.959 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111655.log 2023-11-26T07:25:03.959 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100215.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100215.log.gz 2023-11-26T07:25:03.960 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140098.log 2023-11-26T07:25:03.961 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131595.log 2023-11-26T07:25:03.962 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111655.log.gz 2023-11-26T07:25:03.962 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140098.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.140098.log.gz 2023-11-26T07:25:03.963 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110838.log 2023-11-26T07:25:03.964 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131595.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131595.log.gz 2023-11-26T07:25:03.964 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109312.log 2023-11-26T07:25:03.965 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120068.log 2023-11-26T07:25:03.966 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110838.log.gz 2023-11-26T07:25:03.967 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109312.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109312.log.gz 2023-11-26T07:25:03.967 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140482.log 2023-11-26T07:25:03.968 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120068.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120068.log.gz 2023-11-26T07:25:03.968 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119780.log 2023-11-26T07:25:03.970 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99405.log 2023-11-26T07:25:03.970 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140482.log.gz 2023-11-26T07:25:03.971 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119780.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119780.log.gz 2023-11-26T07:25:03.971 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139828.log 2023-11-26T07:25:03.972 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99405.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99405.log.gz 2023-11-26T07:25:03.973 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100797.log 2023-11-26T07:25:03.974 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129821.log 2023-11-26T07:25:03.974 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139828.log.gz 2023-11-26T07:25:03.975 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100797.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100797.log.gz 2023-11-26T07:25:03.976 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121776.log 2023-11-26T07:25:03.977 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129821.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129821.log.gz 2023-11-26T07:25:03.977 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-26T07:25:03.978 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121776.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121776.log.gz 2023-11-26T07:25:03.979 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140708.log 2023-11-26T07:25:03.980 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109354.log 2023-11-26T07:25:03.981 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140708.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140708.log.gz 2023-11-26T07:25:03.981 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110502.log 2023-11-26T07:25:03.983 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109354.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.109354.log.gz 2023-11-26T07:25:03.983 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140750.log 2023-11-26T07:25:03.984 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110502.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110502.log.gz 2023-11-26T07:25:03.984 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141190.log 2023-11-26T07:25:03.986 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140750.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140750.log.gz 2023-11-26T07:25:03.986 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130942.log 2023-11-26T07:25:03.988 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141190.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141190.log.gz 2023-11-26T07:25:03.988 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121224.log 2023-11-26T07:25:03.989 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140608.log 2023-11-26T07:25:03.989 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130942.log.gz 2023-11-26T07:25:03.991 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142053.log 2023-11-26T07:25:03.991 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121224.log.gz 2023-11-26T07:25:03.992 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140608.log: gzip -5 88.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.140608.log.gz /var/log/ceph/ceph-client.admin.139888.log 2023-11-26T07:25:03.992 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-26T07:25:03.994 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142053.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142053.log.gz 2023-11-26T07:25:03.994 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140566.log 2023-11-26T07:25:03.995 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139888.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139888.log.gz 2023-11-26T07:25:03.995 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96377.log 2023-11-26T07:25:03.997 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140566.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140566.log.gz 2023-11-26T07:25:03.997 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129554.log 2023-11-26T07:25:03.998 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96377.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96377.log.gz 2023-11-26T07:25:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88514.log 2023-11-26T07:25:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129554.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129554.log.gz 2023-11-26T07:25:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110334.log 2023-11-26T07:25:04.001 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.88514.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88514.log.gz 2023-11-26T07:25:04.002 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119864.log 2023-11-26T07:25:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110334.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110334.log.gz 2023-11-26T07:25:04.003 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98076.log 2023-11-26T07:25:04.005 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119864.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119864.log.gz 2023-11-26T07:25:04.005 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97770.log 2023-11-26T07:25:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98076.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98076.log.gz 2023-11-26T07:25:04.006 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101223.log 2023-11-26T07:25:04.008 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.97770.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97770.log.gz 2023-11-26T07:25:04.008 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95819.log 2023-11-26T07:25:04.009 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101223.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101223.log.gz 2023-11-26T07:25:04.009 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120194.log 2023-11-26T07:25:04.010 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95819.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95819.log.gz 2023-11-26T07:25:04.011 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98580.log 2023-11-26T07:25:04.012 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120194.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120194.log.gz 2023-11-26T07:25:04.012 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101661.log 2023-11-26T07:25:04.014 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98580.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98580.log.gz 2023-11-26T07:25:04.014 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95540.log 2023-11-26T07:25:04.015 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101661.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101661.log.gz 2023-11-26T07:25:04.016 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101307.log 2023-11-26T07:25:04.017 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95540.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95540.log.gz 2023-11-26T07:25:04.017 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102175.log 2023-11-26T07:25:04.019 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101307.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101307.log.gz 2023-11-26T07:25:04.019 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141717.log 2023-11-26T07:25:04.020 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.102175.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102175.log.gz 2023-11-26T07:25:04.020 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101054.log 2023-11-26T07:25:04.022 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141717.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141717.log.gz 2023-11-26T07:25:04.022 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101956.log 2023-11-26T07:25:04.023 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101054.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101054.log.gz 2023-11-26T07:25:04.023 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94483.log 2023-11-26T07:25:04.024 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.101956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101956.log.gz 2023-11-26T07:25:04.025 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120877.log 2023-11-26T07:25:04.026 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94483.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94483.log.gz 2023-11-26T07:25:04.027 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-26T07:25:04.028 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120877.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120877.log.gz 2023-11-26T07:25:04.028 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99531.log 2023-11-26T07:25:04.030 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97208.log 2023-11-26T07:25:04.031 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99531.log: gzip -5 88.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.99531.log.gz /var/log/ceph/ceph-client.admin.110081.log 2023-11-26T07:25:04.032 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-26T07:25:04.032 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.97208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97208.log.gz 2023-11-26T07:25:04.033 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141927.log 2023-11-26T07:25:04.035 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121692.log 2023-11-26T07:25:04.035 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110081.log.gz 2023-11-26T07:25:04.035 INFO:teuthology.orchestra.run.smithi159.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-26T07:25:04.036 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98748.log 2023-11-26T07:25:04.036 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141927.log.gz 2023-11-26T07:25:04.037 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111823.log 2023-11-26T07:25:04.038 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121692.log.gz 2023-11-26T07:25:04.039 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99105.log 2023-11-26T07:25:04.039 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98748.log.gz 2023-11-26T07:25:04.040 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119513.log 2023-11-26T07:25:04.041 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111823.log.gz 2023-11-26T07:25:04.042 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119303.log 2023-11-26T07:25:04.042 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99105.log.gz 2023-11-26T07:25:04.044 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100257.log 2023-11-26T07:25:04.044 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119513.log.gz 2023-11-26T07:25:04.045 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119303.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119303.log.gz 2023-11-26T07:25:04.046 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96671.log 2023-11-26T07:25:04.046 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100257.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100257.log.gz 2023-11-26T07:25:04.047 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130629.log 2023-11-26T07:25:04.048 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139576.log 2023-11-26T07:25:04.049 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96671.log.gz 2023-11-26T07:25:04.050 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131265.log 2023-11-26T07:25:04.050 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130629.log.gz 2023-11-26T07:25:04.051 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142462.log 2023-11-26T07:25:04.052 INFO:teuthology.orchestra.run.smithi077.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.139576.log.gz 2023-11-26T07:25:04.053 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100755.log 2023-11-26T07:25:04.053 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131265.log.gz 2023-11-26T07:25:04.055 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120648.log 2023-11-26T07:25:04.055 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142462.log.gz 2023-11-26T07:25:04.056 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100755.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-26T07:25:04.056 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100755.log.gz 2023-11-26T07:25:04.057 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120648.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120648.log.gz 2023-11-26T07:25:04.058 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141003.log 2023-11-26T07:25:04.059 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130773.log 2023-11-26T07:25:04.061 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141003.log: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141003.log.gz 2023-11-26T07:25:04.061 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-26T07:25:04.062 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101475.log 2023-11-26T07:25:04.062 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130773.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130773.log.gz 2023-11-26T07:25:04.063 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109633.log 2023-11-26T07:25:04.065 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108933.log 2023-11-26T07:25:04.065 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101475.log.gz 2023-11-26T07:25:04.066 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141885.log 2023-11-26T07:25:04.066 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109633.log.gz 2023-11-26T07:25:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.108933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95829.log 2023-11-26T07:25:04.068 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108933.log.gz 2023-11-26T07:25:04.069 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132712.log 2023-11-26T07:25:04.069 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141885.log.gz 2023-11-26T07:25:04.071 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95829.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95829.log.gz -5 2023-11-26T07:25:04.071 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.131862.log 2023-11-26T07:25:04.072 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94191.log 2023-11-26T07:25:04.073 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.132712.log.gz 2023-11-26T07:25:04.074 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96629.log 2023-11-26T07:25:04.074 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.131862.log.gz 2023-11-26T07:25:04.075 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95546.log 2023-11-26T07:25:04.076 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94191.log.gz 2023-11-26T07:25:04.077 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96629.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-26T07:25:04.077 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96629.log.gz 2023-11-26T07:25:04.079 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111781.log 2023-11-26T07:25:04.079 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95546.log.gz 2023-11-26T07:25:04.080 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95200.log 2023-11-26T07:25:04.081 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111781.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111781.log.gz 2023-11-26T07:25:04.083 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95200.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95200.log.gz 2023-11-26T07:25:04.083 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-26T07:25:04.085 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111443.log 2023-11-26T07:25:04.088 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.111443.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111443.log.gz 2023-11-26T07:25:04.089 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140524.log 2023-11-26T07:25:04.092 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95544.log 2023-11-26T07:25:04.093 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140524.log.gz 2023-11-26T07:25:04.095 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101139.log 2023-11-26T07:25:04.100 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95544.log: /var/log/ceph/ceph-client.admin.101139.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.2.97637.log 2023-11-26T07:25:04.101 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95544.log.gz 2023-11-26T07:25:04.102 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101139.log.gz 2023-11-26T07:25:04.105 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.2.97637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132114.log 2023-11-26T07:25:04.108 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.97637.log.gz 2023-11-26T07:25:04.108 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139660.log 2023-11-26T07:25:04.111 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 88.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.94739.log 2023-11-26T07:25:04.113 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139660.log: -- replaced with /var/log/ceph/ceph-client.admin.132114.log.gz 2023-11-26T07:25:04.116 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8%/var/log/ceph/ceph-client.admin.94739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98244.log 2023-11-26T07:25:04.117 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.139660.log.gz 2023-11-26T07:25:04.118 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94739.log.gz 2023-11-26T07:25:04.119 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98664.log 2023-11-26T07:25:04.124 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.98244.log: /var/log/ceph/ceph-client.admin.98664.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110292.log 2023-11-26T07:25:04.125 INFO:teuthology.orchestra.run.smithi077.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.98244.log.gz -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-26T07:25:04.125 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-26T07:25:04.126 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98664.log.gz 2023-11-26T07:25:04.127 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95210.log 2023-11-26T07:25:04.128 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110292.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110292.log.gz 2023-11-26T07:25:04.129 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94357.log 2023-11-26T07:25:04.130 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95210.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95210.log.gz 2023-11-26T07:25:04.132 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94357.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94357.log.gz 2023-11-26T07:25:04.132 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100383.log 2023-11-26T07:25:04.134 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101433.log 2023-11-26T07:25:04.134 INFO:teuthology.orchestra.run.smithi159.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-26T07:25:04.136 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100383.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100383.log.gz 2023-11-26T07:25:04.137 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101433.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101433.log.gz 2023-11-26T07:25:04.138 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140194.log 2023-11-26T07:25:04.139 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132490.log 2023-11-26T07:25:04.141 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140194.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140194.log.gz 2023-11-26T07:25:04.142 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132490.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.132490.log.gz 2023-11-26T07:25:04.143 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131639.log 2023-11-26T07:25:04.145 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95214.log 2023-11-26T07:25:04.146 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131639.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.131639.log.gz 2023-11-26T07:25:04.148 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.95214.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95214.log.gz 2023-11-26T07:25:04.148 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100089.log 2023-11-26T07:25:04.150 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132409.log 2023-11-26T07:25:04.152 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100089.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100089.log.gz 2023-11-26T07:25:04.153 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.132409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.132409.log.gz 2023-11-26T07:25:04.153 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101009.log 2023-11-26T07:25:04.156 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.101009.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101009.log.gz 2023-11-26T07:25:04.157 INFO:teuthology.orchestra.run.smithi159.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-26T07:25:04.157 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109795.log 2023-11-26T07:25:04.158 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.97641.log 2023-11-26T07:25:04.160 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109795.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109795.log.gz 2023-11-26T07:25:04.161 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.2.97641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119429.log 2023-11-26T07:25:04.162 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.97641.log.gz 2023-11-26T07:25:04.163 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100341.log 2023-11-26T07:25:04.165 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119429.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.119429.log.gz 2023-11-26T07:25:04.166 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100341.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100341.log.gz 2023-11-26T07:25:04.167 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.122367.log 2023-11-26T07:25:04.169 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97337.log 2023-11-26T07:25:04.170 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.122367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.122367.log.gz 2023-11-26T07:25:04.172 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.97337.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97337.log.gz 2023-11-26T07:25:04.172 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140320.log 2023-11-26T07:25:04.174 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120152.log 2023-11-26T07:25:04.175 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140320.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140320.log.gz 2023-11-26T07:25:04.177 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120152.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120152.log.gz 2023-11-26T07:25:04.177 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140236.log 2023-11-26T07:25:04.179 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120961.log 2023-11-26T07:25:04.181 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140236.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140236.log.gz 2023-11-26T07:25:04.183 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120961.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120961.log.gz 2023-11-26T07:25:04.183 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132532.log 2023-11-26T07:25:04.185 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130858.log 2023-11-26T07:25:04.185 INFO:teuthology.orchestra.run.smithi159.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-26T07:25:04.186 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132532.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.132532.log.gz 2023-11-26T07:25:04.188 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130858.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130858.log.gz 2023-11-26T07:25:04.188 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119555.log 2023-11-26T07:25:04.190 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109017.log 2023-11-26T07:25:04.192 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119555.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119555.log.gz 2023-11-26T07:25:04.193 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109017.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109017.log.gz 2023-11-26T07:25:04.193 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129989.log 2023-11-26T07:25:04.196 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129989.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129989.log.gz 2023-11-26T07:25:04.197 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131168.log 2023-11-26T07:25:04.199 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119948.log 2023-11-26T07:25:04.200 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131168.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.131168.log.gz 2023-11-26T07:25:04.201 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96083.log 2023-11-26T07:25:04.202 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119948.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119948.log.gz 2023-11-26T07:25:04.203 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121820.log 2023-11-26T07:25:04.204 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.96083.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96083.log.gz 2023-11-26T07:25:04.205 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94613.log 2023-11-26T07:25:04.207 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121820.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121820.log.gz 2023-11-26T07:25:04.207 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142292.log 2023-11-26T07:25:04.208 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.94613.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94613.log.gz 2023-11-26T07:25:04.209 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100923.log 2023-11-26T07:25:04.211 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142292.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142292.log.gz 2023-11-26T07:25:04.212 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99879.log 2023-11-26T07:25:04.212 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.100923.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100923.log.gz 2023-11-26T07:25:04.213 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129494.log 2023-11-26T07:25:04.220 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99879.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99879.log.gz 2023-11-26T07:25:04.220 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132616.log 2023-11-26T07:25:04.220 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129494.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129494.log.gz 2023-11-26T07:25:04.220 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99231.log 2023-11-26T07:25:04.221 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132616.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.132616.log.gz 2023-11-26T07:25:04.221 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139744.log 2023-11-26T07:25:04.222 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.99231.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99231.log.gz 2023-11-26T07:25:04.222 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120835.log 2023-11-26T07:25:04.223 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139744.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139744.log.gz 2023-11-26T07:25:04.224 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-26T07:25:04.225 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120835.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120835.log.gz 2023-11-26T07:25:04.226 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130503.log 2023-11-26T07:25:04.229 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.130503.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130503.log.gz 2023-11-26T07:25:04.230 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111697.log 2023-11-26T07:25:04.233 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130293.log 2023-11-26T07:25:04.234 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111697.log.gz 2023-11-26T07:25:04.235 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142334.log 2023-11-26T07:25:04.238 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130293.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130293.log.gz 2023-11-26T07:25:04.240 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132413.log 2023-11-26T07:25:04.243 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.132413.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142334.log.gz 2023-11-26T07:25:04.244 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111055.log 2023-11-26T07:25:04.245 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.132413.log.gz 2023-11-26T07:25:04.248 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111055.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111055.log.gz 2023-11-26T07:25:04.541 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-26T07:25:04.555 INFO:teuthology.orchestra.run.smithi159.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-26T07:25:04.559 INFO:teuthology.orchestra.run.smithi159.stderr: 2023-11-26T07:25:04.559 INFO:teuthology.orchestra.run.smithi159.stderr:real 0m1.010s 2023-11-26T07:25:04.559 INFO:teuthology.orchestra.run.smithi159.stderr:user 0m3.323s 2023-11-26T07:25:04.559 INFO:teuthology.orchestra.run.smithi159.stderr:sys 0m0.417s 2023-11-26T07:25:04.560 INFO:teuthology.orchestra.run.smithi077.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-26T07:25:04.607 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-26T07:25:04.633 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-26T07:25:05.136 INFO:teuthology.orchestra.run.smithi077.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-26T07:25:05.193 INFO:teuthology.orchestra.run.smithi077.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-26T07:25:06.036 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-26T07:25:06.040 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-26T07:25:06.040 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m2.493s 2023-11-26T07:25:06.040 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m6.717s 2023-11-26T07:25:06.040 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m1.728s 2023-11-26T07:25:06.041 INFO:tasks.ceph:Archiving logs... 2023-11-26T07:25:06.042 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351/remote/smithi077/log 2023-11-26T07:25:06.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-26T07:25:07.285 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351/remote/smithi159/log 2023-11-26T07:25:07.286 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-26T07:25:07.773 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-26T07:25:07.782 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-26T07:25:07.783 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-26T07:25:07.792 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-26T07:25:07.951 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-26T07:25:07.960 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-26T07:25:07.960 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:25:07.970 DEBUG:teuthology.orchestra.run.smithi159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:25:08.018 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2023-11-26T07:25:08.026 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-26T07:25:08.026 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2023-11-26T07:25:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 48 +1431us[+1431us] +/- 93ms 2023-11-26T07:25:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv02.front.sepia.ceph.com 3 6 377 49 -940us[ -932us] +/- 68ms 2023-11-26T07:25:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 -59us[ -59us] +/- 78ms 2023-11-26T07:25:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:25:08.028 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2023-11-26T07:25:08.036 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-26T07:25:08.036 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2023-11-26T07:25:08.036 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 48 +1416us[+1416us] +/- 93ms 2023-11-26T07:25:08.036 INFO:teuthology.orchestra.run.smithi159.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 -928us[ -892us] +/- 68ms 2023-11-26T07:25:08.036 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 -49us[ -49us] +/- 78ms 2023-11-26T07:25:08.036 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:25:08.037 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-26T07:25:08.046 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-26T07:25:08.047 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-26T07:25:08.075 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-26T07:25:08.357 DEBUG:teuthology.orchestra.run.smithi159:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-26T07:25:08.618 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-26T07:25:08.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:25:08.728 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-26T07:25:08.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:25:08.839 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-26T07:25:08.848 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-26T07:25:08.876 INFO:teuthology.task.internal:Duration was 1230.106564 seconds 2023-11-26T07:25:08.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-26T07:25:08.908 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-26T07:25:08.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-26T07:25:08.917 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-26T07:25:09.073 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-26T07:25:09.075 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-26T07:25:09.431 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-26T07:25:09.432 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2023-11-26T07:25:09.432 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-26T07:25:09.498 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi159.front.sepia.ceph.com 2023-11-26T07:25:09.498 DEBUG:teuthology.orchestra.run.smithi159:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-26T07:25:09.577 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-26T07:25:09.577 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-26T07:25:09.587 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-26T07:25:09.681 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-26T07:25:09.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-26T07:25:09.686 DEBUG:teuthology.orchestra.run.smithi159:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-26T07:25:09.867 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-26T07:25:09.881 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-26T07:25:09.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-26T07:25:09.969 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-26T07:25:10.075 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-26T07:25:10.084 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:25:10.094 DEBUG:teuthology.orchestra.run.smithi159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:25:10.202 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2023-11-26T07:25:10.206 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = core 2023-11-26T07:25:10.259 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:25:10.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:25:10.308 DEBUG:teuthology.orchestra.run.smithi159:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:25:10.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:25:10.363 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-26T07:25:10.377 INFO:teuthology.task.internal:Transferring archived files... 2023-11-26T07:25:10.378 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351/remote/smithi077 2023-11-26T07:25:10.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-26T07:25:10.487 DEBUG:teuthology.misc:Transferring archived files from smithi159:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351/remote/smithi159 2023-11-26T07:25:10.488 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-26T07:25:10.597 INFO:teuthology.task.internal:Removing archive directory... 2023-11-26T07:25:10.597 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-26T07:25:10.607 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-26T07:25:10.664 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-26T07:25:10.675 INFO:teuthology.task.internal:Not uploading archives. 2023-11-26T07:25:10.676 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-26T07:25:10.700 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-26T07:25:10.701 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-26T07:25:10.709 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-26T07:25:10.760 INFO:teuthology.orchestra.run.smithi077.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 26 07:25 /home/ubuntu/cephtest 2023-11-26T07:25:10.769 INFO:teuthology.orchestra.run.smithi159.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 26 07:25 /home/ubuntu/cephtest 2023-11-26T07:25:10.772 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-26T07:25:10.783 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-26T07:25:10.844 INFO:teuthology.nuke:Checking targets against current locks 2023-11-26T07:25:10.866 DEBUG:teuthology.nuke:shortname: smithi077 2023-11-26T07:25:10.867 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-26T07:25:10.890 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:37.499128', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM/ATFn2p0pwIyeNjWm72qoXq3rg+iTZFIlhhCYpbsSXLiPEAjkpLBV2LltLg0yO82BbJAWCERqN+lc6fA+6YA='} 2023-11-26T07:25:10.893 DEBUG:teuthology.nuke:shortname: smithi159 2023-11-26T07:25:10.894 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-26T07:25:10.918 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467351', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:37.500664', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4K/8XUKafj24hIFBgmXqB1H2JY1MwqMBlgBgCc2Ayt1MZFqLRuNcBu5kqkr9jddzcZxW06vijAfW0QJT5M9ZU='} 2023-11-26T07:25:10.946 INFO:teuthology.orchestra.console.smithi077:Power off 2023-11-26T07:25:10.947 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-26T07:25:10.968 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2023-11-26T07:25:10.969 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:25:10.988 INFO:teuthology.orchestra.console.smithi159:Power off 2023-11-26T07:25:10.988 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-26T07:25:10.998 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-11-26T07:25:11.010 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-11-26T07:25:11.010 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:25:11.034 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-11-26T07:25:15.000 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:25:15.035 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:25:15.110 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-11-26T07:25:15.144 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-11-26T07:25:19.113 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:25:19.145 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:25:19.227 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-11-26T07:25:19.254 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-11-26T07:25:19.329 INFO:teuthology.orchestra.console.smithi077:Power off completed 2023-11-26T07:25:19.355 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-11-26T07:25:19.461 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} duration: 1230.106564283371 failure_reason: 'Test failure: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9e40e613a9c94bfba5fd4921795118e3 status: fail success: false 2023-11-26T07:25:19.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-26T07:25:19.543 INFO:teuthology.run:FAIL